Syllabus

• Thursday September 25: Introduction/Overview (ppt)
  Reading: "Introduction to Distributed System Design"
  Reading: "Lessons from Giant-Scale Services"
  Reading: "Web Search for a Planet: The Google Cluster Architecture"
• Tuesday September 30: Functional programming and MapReduce (ppt)
  Reading: "Introduction to Parallel Programming and MapReduce"
  Reading: "MapReduce: Simplified Data Processing on Large Clusters" (updated version at page 107 here)
• Thursday October 2: Hadoop nuts and bolts (ppt)
  Reading: "Hadoop Map/Reduce Tutorial"
• Tuesday October 7, 3:30-4:20: Jeff Dean (Google) Distinguished Lecture, "Research Problems Inspired by Large-Scale Computing at Google"
• Tuesday October 7: Jeff Dean (Google), "Handling Large Datasets at Google: Current Systems and Future Directions"
• Thursday October 9: Architecture, Systems, and Networking in 80 minutes (ppt)
• Tuesday October 14, 3:30-4:20: Vint Cerf (Google) Distinguished Lecture, "Internet Evolution and Some Challenges for the Early 21st Century"
• Tuesday October 14: MapReduce algorithms (ppt) Internet route stability example
  Reading: "The Anatomy of a Large-Scale Hypertextual Web Search Engine"
• Thursday October 16: The Google File System (ppt)
  Reading: "The Google File System"
• Tuesday October 21: Mike Cafarella (UW), Nutch, and Search Engine History
  Reading: "Building Nutch: Open Source Search" (cleaner copy here)
• Thursday October 23: Barry Brumitt (Google), "MapReduce Design Patterns"
  Reading: "Map-Reduce for Machine Learning on Multicore"
  Reading: "Highway Hierarchies Hasten Exact Shortest Path Queries"
  Reading: "Reach for A*: Efficient Point-to-Point Shortest Path Algorithms"
• Tuesday October 28: Phil Bernstein (Microsoft), "Transactions and Replication"
  Reading: "Replication" (from Principles of Transaction Processing, Bernstein & Newcomer, Elsevier, Inc.)
  Reading: "Paxos Made Live - An Engineering Perspective"
• Thursday October 30: Additional topics in reliability / availability / consistency (ppt)
  Reading: "Eventually Consistent - Revisited"
  Reading: "The Chubby Lock Service for Loosely-Coupled Distributed Systems"
• Tuesday November 4: [Aaron away] Steve Gribble (UW and Google), "Virtual Machine Monitors: Implementation and Applications"
  Reading: "Xen and the Art of Virtualization"
  Reading: "Remus: High Availability via Asynchronous Virtual Machine Replication"
• Thursday November 6: [Aaron away] BigTable (ppt)
  Reading: "Bigtable: A Distributed Storage System for Structured Data"
  (See Jeff Dean's October 2005 colloquium.)
• Tuesday November 11: Veteran's Day -- UW holiday
• Thursday November 13: EC2 (ppt)
  Reading: "Amazon Elastic Compute Cloud Getting Started Guide"
  Reading: "Using Amazon S3 from Amazon EC2 with Ruby"
  Reading: "Building GrepTheWeb in the Cloud, Part 1: Cloud Architectures"
  Reading: "Building GrepTheWeb in the Cloud, Part 2: Best Practices"
• Tuesday November 18, 3:30-4:20: Werner Vogels (Amazon.com) Distinguished Lecture, "Ahead in the Cloud: Amazon Web Services"
• Tuesday November 18: Hardware issues: power, reliability, etc. (ppt)
  Reading: "Disk failures in the real world: What does an MTTF of 1,000,000 hours mean to you?"
  Reading: "Failure Trends in a Large Disk Drive Population"
  Reading: "The Case for Energy-Proportional Computing"
• Thursday November 20: [Ed away] Yoshi Kohno (UW), Security, Privacy, and Cryptography
  Reading: "Why Cryptosystems Fail"
  Reading: "How to think like a security professional"
• Tuesday November 25: Werner Vogels (Amazon.com), Software and hardware architecture of large-scale web services
  Reading: "Dynamo: Amazon's Highly Available Key-value Store"
• Thursday November 27: Thanksgiving -- UW holiday
• Tuesday December 2: [Aaron away] James Hamilton (Microsoft), "Designing and Deploying Internet-Scale Services" and "Where Does the Power Go and What to do About it?"
  Reading: "An Architecture for Modular Datacenters"
  Reading: "Power Provisioning for a Warehouse-sized Computer"
  Reading: "On Designing and Deploying Internet-Scale Services"
• Thursday December 4: [Aaron away] Term test