
CSE Home  About Us  Search  Contact Info 
Instructor:
Hanna Hajishirzi (Paul Allen Center 470)
(hannaneh at washington dot edu) Office hours: Wed 10:30am11:30am, or by email Contact: cse573staff@cs.washington.edu 
TA:
Dae Lee (dhlee4 at uw dot edu) Office hours: Mon Noon1:00pm in CSE 007, or by email. James Ferguson (jfferg at uw dot edu) Office hours: Tue 2:00pm3:00pm in CSE 220, or by email. Svetoslav Kolev (swetko at uw dot edu) Office hours: Thu 1:00pm2:00pm in CSE 220, or by email. 
Date  Topics & Lecture Notes  Readings  Assignments 

January 7  Introduction and Agents (slides) 
R&N Ch. 2; (Optional Ch 1)  
January 9  Problem Spaces, Search (through A*) (slides) 
R&N Ch. 3; try this cool interactive search visualization  
January 14  Heuristic Generation, Local Search (slides) 
R&N Ch. 4  
January 16  Local Search/Adversarial Search  Minimax (slides: local search,adversarial search) 
R&N Ch. 5  PS1 Due: Jan 18th 
January 21  NO CLASS  Martin Luther King Day  
January 23  Alphabeta pruning/Complex Games (slides: Alphabeta,Expectimax)  R&N Ch. 5  
January 28  Expectimax/Complex Games/MDPs (slides: Expectimax,MDP)  R&N Ch 17 thru 17.3  
January 30  Markov Decision Process(slides)  R&N Chapter 15 thru 15.3 (review 13 if necessary)  PS2 Due 
February 4  CLASS CANCELLED  
February 6  MDPs (Value Iteration)(slides)  R&N Ch 15 thru 15.3  Quiz 1 
February 11  MDPsReinforcement Learning (Video)(slides: MDPs)(Calculations: MDP calculations )  R&N Ch 21 thru 21.3  
February 13  Reinforcement Learning (Slides)  R&N Ch 21 thru 21.3 Playing Atari with Deep Reinforcement Learning  
February 18  NO CLASS  Presidents Day  
February 20  RL/Deep Reinforcement Learning ( Slides)  Playing Atari with Deep Reinforcement Learning  PS3 Due 
February 25  Deep RL ( Slides)/Probabilistic Inference ( Slides)  Extra reading for Deep RL for interested students R&N Sections 15.3 and 15.5  
February 27  HMMs/HMM Filtering (Slides)  R&N Chapter 14 thru 14.4, Equations for Part of Speech Tagging  Final Project Part 1 Due: Mar 1st 
March 4  HMM Filtering (Slides)  R&N Sections 14.4 & 14.5  Paper report due 
March 6  HMM Filtering (Slides)  PS4 Due: March 8th  
March 11  Bayes Net Inference (Slides)  Quiz 2 (released March 8th, due March 11 before class)  
March 13  Review  
March 14 (122pm)  Poster presentation + Pizza  Final Project Due 


The Allen School of Computer Science & Engineering University of Washington Box 352350 Seattle, WA 981952350 (206) 5431695 voice, (206) 5432969 FAX 