In this course, we will study the specialized systems and algorithms that have been developed to work with data at scale, including parallel database systems, MapReduce and its contemporaries, graph systems, and streaming systems. We will also go over core techniques of cloud platforms; and important scalable algorithms.
Each statement should be at most one page in length written as a set of bullet points. The statement should demonstrate that you read and thought about the paper.
Three assignment involving three big data systems: Redshift, Spark, Snowflake. Some mini-assignments using stream and/or graph databases
Each week, after lecture, we will have a 50-minute section that will give you hands-on demonstrations and tutorials of various big data systems and cloud services. Each section will be connected to either a full assignment or a mini assignment.