UPPSALA UNIVERSITET : Inst. f. lingvistik och filologi : STP
Uppsala universitet

Schedule
Learning Outcomes
Examination
Reading List


Machine Learning for Language Technology (Candidate Program, 2016)

An Introductory Course

Credits: 7,5 hp
Teacher: Marina Santini, santinim [AT] stp.lingfil.uu.se
Venue: Department of Linguistics and Philology, Hus 9.
Syllabus: 5LN454 (Swedish).

News



Schedule and List of Topics

Last Updated: 23 Jan 2017

Lect Date Time Room Content Required Reading
1
7/11
13:15-15:00
9-2043
(Chomsky)
In-class:
Introduction to the Course (slides)
The Flipped Classroom (video)
What is Machine Learning (slides)
- Handouts (1, 2)
- Witten et al. (2011): Ch 1
- Optional: What's Machine Learning by Andrew Ng
2
10/11
10:15-12:00
9-2042
(Turing)
Online: Basic Concepts (slides: 1, 2)

In-class: Lab1
- Handout
- Daumé III (2015: 8-10; 19-24; 26-28)
- Witten et al. (2011: Ch 2; Ch 11: 407-410)
3
14/11
10:15-12:00
9-2042
(Turing)
Online: Decision Trees (slides: 1, 2, 3)

In-class: Feedback, Lab2
- Transcripts
- Daumé III (2015: 10-18)
- Witten et al. (2011: 99-108; 192-203)
- Optional: Mitchell (1997: Ch3)
4
21/11
13:15-15:00
9-2043
(Chomsky)
Online: Evaluation (slides: 1, 2, 3)

In-class: Feedback, Lab3
- Transcripts
- Daumé III (2015: 60-67)
- Witten et al. (2011: Ch 5)
5
24/11
10:15-12:00
9-2042
(Turing)
Online:
k-Nearest Neighbours
(slides: 1 [JNivre]; 2)

In-class: Lab4
- Transcripts [JNivre]
- Daume' III (2015: 26-32, excl. 2.4)
- Witten et al. (2011:131-138)
6
28/11
13:15-15:00
9-2043
(Chomsky)
Online:
Naive Bayes
(Slides: 1 [JNivre]; 2)
Feature Representation & Selection (slides)

In-class: Feedback, Lab5
- Transcripts [JNivre]
- Handout
- Daumé III (2015: 53-59; 107-110)
- Witten et al. (2011: 90-99)
7
05/12
13:15-15:00
9-20433
(Chomsky)
Online:
*Generative vs Discriminative,
Linear Models (slides [JNivre],
excl. Loglinear & Log.Regr.)

*Perceptron (slides: 1-2 [JNivre])

*Feature Transformation (Self-Study)
(slides)

In-class: Feedback, Lab6
- Handouts (1, 2, 3, 4)
- Daumé III (2015: 39-52)
- Witten et al. (2011: 305-308; 314-315;
322-323; 328-329; 331-332; 334)
8
08/12
10:15-12:00
9-2042
(Turing)
Online:
k-Means Clustering
(Slides: 1 [AndrewNg]; 2)

In-class: Lab7 Feedback
- Transcripts
- Daumé III (2015: 32-33)
- Witten et al. (2011: 138-141)
9
12/12
13:15-15:00
9-2043
(Chomsky)
Online:
Hierarchical Clustering (slides)

In-class: Lab8

- Witten et al. (2011: 273-284)
- Evaluation of Clustering
10
13/12
Online
Online:
A few words about ML4LT Assignments (Pdf)
A few things to remember (slides: 1, 2, 3)

Optional lab - Putting all toghether:
Weka Tutorial by Svetlana S. Aksenova
(suitable also for weka 3.6 or later versions)
- Domingos (2012)

Expected Learning Outcomes

In order to pass the course, a student must be able to:

* apply basic principles of machine learning to natural language data;
* evaluate the performance of machine learning schemes;
* use standard off-the-shelf software for machine learning;
* apply supervised and unsupervised models for classification.

Examination and Grading Criteria

The course is examined by means of 3 home assignments:
Assignments' Deadlines
18 Dec 2016: Ass1 and Ass2
15 Jan 2017: Ass 3
24 Feb 2017: Final submission date for all assignments

The following grades will be used: If a student fails to fulfill this requirement, additional assignments will have to be completed prior to passing the course. The choice of the topic will relate to the missed material. A student is also entitled to repeat the course, depending on available capacity.

Attendance

There is a mandatory 80% attendance requirement for both the lectures delivered through the online platform AND for the in-class lab sessions that will take place at the Department of Linguistics and Philology, Uppsala University, Room 9-2043 (Chomsky) or Room 9-2042 (Turing) (see schedule).

Coursework and Reference List (Required Reading)

Additional References (Optional Reading, might require deeper mathematical background)

(Chronological order)

© 2016. UPPSALA UNIVERSITET, Institutionen för lingvistik och filologi
Box 635, 751 26 Uppsala, Sweden. Web page updated by: Marina Santini.