#Big Data Computer Systems
Fall 2014
Mon,Wed 1:25pm-2:45pm
WEB L114
Catalog number: CS 5965/6965
Office Hours: Tue 12-2pm MEB 3454
Assignment 0 Assignment 1 Assignment 2 Assignment 3
##Overview
The exponential increase in the quantity and quality of measurements and data holds tremendous promise for data-driven scientific discovery. However, much of this data remains unused as algorithms---to infer knowledge from that data---are unable to scale up to the amount of data being generated. This course will discuss and explore computer systems issues for the big data era. Tentative topics will include big data applications, big data programming (mapreduce, MPI), big data storage, sustainable (energy-efficient) data processing, data reliability, as well as specific case studies for big data computer systems in the real world. Big data is a broad concept that covers many aspects of computer science. This course will focus on the computer systems aspect---for instance, how various parts of a big data computer system (hardware, system software, and applications) are put together? What are the appropriate approaches to realize high performance, scalability, and reliability in practical big data computer systems?
Students in the class are lucky to use the Apt_ system from the Flux_ research group. We shall also be using an experimental low-energy cluster featuring the nVidia Tegra K1 SOC.
We shall be using github for submitting assignments and projects. All students should create a free github account and become part of the UtahCS6965 organization on github.
Prerequisites
There is no formal prerequisite for this course but CS 3505 or equivalent programming experience is desired. Please contact the instructor if you are not sure whether you possess the necessary programming experience. Some projects might require knowledge of Numerical Methods or Linear Algebra (CS 3200). Students are not required to have this background, but do let the instructor know in case you do, so that relevant projects can be assigned.
The course is open to graduate as well as undergraduate students.
Assignments and Grading:
There will be a few programming assignments and a final project. The assignments will be based on materials discussed in class. Students will be divided into two sets (different or each assignment), solving similar problems, but utilizing different frameworks: mapreduce and MPI. You will run these on Apt---which will allow us to reconfigure the system for these frameworks.
The final project will be chosen (by you) from a variety of topics related to big data computer systems. The instructor will help you devise a concrete scope for your project. You will be asked to submit a project proposal several weeks before the final project due time. You should also be prepared to make a presentation of your final project. Your grade will be based on a combination of your assignments and the final project. No exams will be administered for this course.
A tentative grade division is listed below.
10% - assignment #0
15% - assignment #1
15% - assignment #2
15% - assignment #3
15% - assignment #4
30% - final project
##Resources
I shall keep adding resources during the semester. Here are some resources that are useful.