CSE 517 - Natural Language Processing

University of Washington Department of Computer Science & Engineering

CSE 517 - Natural Language Processing - Winter 2015
Mon, Wed 1:30-2:50 in MGH 254

CSE Home

About Us

Contact Info

Instructor: Yejin Choi (yejin at cs dot washington dot edu)
Office hours: Mondays at 3 - 4pm at CSE 578 (and by appointment) TA: Eunsol Choi (eunsol at cs dot washington dot edu)
Office hours: Wednesdays 11am - noon at CSE 394 (and by appointment)
TA: Andrea M. Kahn (amkahn at uw dot edu)
Office hours: Thursdays 2 - 3pm at CSE 021 (and by appointment)

Schedule (subject to change)

Week	Dates	Topics & Lecture Slides	Notes (Required)	Textbook	Supplementary Readings
1	Jan 5, 7	Introduction [Slides]; Language Models (LM) [Slides]	LM Notes	J&M 4.1-4; M&S 6	[Large LMs] [Berkeley LM]
2	Jan 12, 14	Sequences: Language Models and Smoothing; Hidden Markov Models (HMMs) [Slides]	HMM Notes	J&M 4.5-7; M&S 6	[Smoothing]
3	Jan 21	Hidden Markov Models (HMMs) [Slides (Jan26)]& Part-Of-Speech Tagging [Slides (Jan26)]		J&M 5.1-5.3; 6.1-6.4; M&S 9, 10.1-10.3	[TnT Tagger] [Stanford Tagger] [SOTA POS]
4	Jan 26, 28	Trees: Probabilistic Context Free Grammars (PCFG) and Parsing [Slides (Feb2)]	PCFG Notes, Lexicalized PCFGs	J&M 13-14; M&S 11-12	[Syntax Intro] [Incremental] [Best First] [A* Parsing] [Lexicalized] [Unlexicalized] [Split Merge]
5	Feb 2, 4	More Parsing [Slides (Feb2)]; Expectation Maximization (EM)[Slides]	EM Notes, Forward-backward, Inside-outside	J&M 6.5; M&S 9.3-4; 11.3-4	[Semi-supervised Naive Bayes] [EM Tutorial] [EM for Feature-Rich]
6	Feb 9, 11	Semantics: Frame Semantics [Slides (Feb2)]; Distributional Semantics		J&M 19.4; 20.7; 20.9; M&S 8	[Fillmore-Tribute Workshop] [Frame-Semantic Parsing] [Composition in Distributional Models]
7	Feb 18	Machine Translation (MT): Word Alignment [Slides]	IBM Models 1 and 2	J&M 25.1-6; M&S 13	[IBM Models] [HMM Model] [MERT Training]
8	Feb 23, 25	Phrase-based MT [Slides]; Syntax-based MT [Slides I] [II]	Phrase-based Notes	J&M 25.6-10; M&S 13	[SCFG Tutorial] [Hiero] [Tree-to-String] [Tree-to-Tree]
9	Mar 2, 4	Log-Linear / Feature-Rich Models: Conditional Random Fields (CRFs) [Slides]	Log-linear models CRF Notes	J&M 6.6-6.8; M&S 16.2-16.3	[MaxExt] [CRF Tutorial] [CRF LM] [CRF Parsing]
10	Mar 9, 11	Knowledge & Semantic Relations: Information Extraction; Entailment; [Slides]		J&M 22	[Entailment Graphs] [Paraphrasing w/ MT] [Paraphrasing and Entailment]

Textbooks

Recommended: D. Jurafsky & James H. Martin, Speech and Language Processing: An Introduction to Natural Language Processing, Computational Linguistics and Speech Recognition, Prentice Hall, Second Edition, 2009. (J&M)
Optional: C.D. Manning & H. Schuetze, Foundations of Statistical Natural Language Processing, Cambridge: MIT Press, 1999 (available online, free if accessed from UW computers) (M&S)

Contact

Please feel free to email the course staff, addresses above, and come to office hours. Let us know if you need to meet outside of the scheduled hours, we will do our best to accomodate.
We also have a GoPost discussion board. Please consider posting your questions there; everyone will benefit. We also encourage you to try to answer questions, which will count as class participation. We will monitor daily and contribute as long as the boards are being used.
Grades: Assignment grades are posted in the online CSE 517 Gradebook. Please let us know if you see any errors.

Homeworks

We will have 4 programming-based homework assignments (60% of grade). Data/code/instruction are linked at Dropbox

Assignment 1: Language Models (Due Tue Jan 20, 5pm)
Assignment 2: HMMs (Due Fri Feb 6, 5pm)
Assignment 3: Parsing (Due Fri Feb 20, 5pm)
Assignment 4: MT (Due Fri Mar 6, 5pm)

In addition, there will be lightweight 2 written homework assignments (15% of grade).

Assignment 1: LM & HMMs (Due Mon Mar 2, 5pm)
Assignment 2: MT (Due Tue Mar 10, 5pm)

Please submit all your assignments to the online DropBox.

Final Mini-project

A final mini-project (20% of grade) will be completed during the last weeks of the term. Students are encouraged to design projects that overlap with their research interests.

Proposal (Due Feb 13, 5pm)
Final report (Due Mar 20, 5pm)

Grading

The final grade will consist of programming-based homeworks (60%), a final mini-project (20%), non-programming assignments (15%) and course/discussion board participation (5%). No midterm or final exam.

Course Administration and Policies

Assignments must be done individually unless otherwise specified. You may discuss the subject matter with other students in the class, but all final answers must be your own work. You are expected to maintain the utmost level of academic integrity in the course.
Each assignment may be handed in up to three days late, at a penalty of 10% of the maximum grade per day. You have 3 panelty-free late day credits that you can use at any time during the quarter. Above 10% substraction will apply only after you have used all your late day credits. Being late by a partial day (e.g., 1 hour) will be rounded up to 1 full day. This late day policy does not apply to the final project submission due to tight grading schedule at the end of the quarter.
Comments can be sent to the instructor or TA using this anonymous feedback form.

Department of Computer Science & Engineering
University of Washington
Box 352350
Seattle, WA 98195-2350
(206) 543-1695 voice, (206) 543-2969 FAX