CSC 369: Distributed Computing
Winter 2016

Instructor: Alexander Dekhtyar, dekhtyar@calpoly.edu, 14-2150

Office Hours:
When
Who Where
Tuesday 10:10am - 11:00am Alex 14-215
Wednesday 9:10am - 10:00am Alex 14-215
Wednesday 1:10pm - 2:00pm Alex 14-215
Thursday 10:10pm - 11:00am Alex 14-215

Additional appoinments: send email.


News and Notes

Old News and Notes

Course Materials

Syllabus Postscript PDF

Labs

Lab 1, Part 1 Due: January 8 JSON Generation Postscript PDF Lab Data [January 4, 2016]
Lab 1, Part 2 Due: January 12 JSON Parsing Postscript PDF Lab Data [January 6, 2016]
Lab 2 Due: January 19 Ad-hoc Key-Value store Postscript PDF Lab Info [January 12, 2016]
Lab 3 Due: January 21 MongoDB queries Postscript PDF Lab Info [January 19, 2016]
Lab 4 Due: January 29 February 3 MongoDB Application Postscript PDF Lab Info [January 21, 2016]
Lab 5 Due: February 3 MongoDB Aggregate Pipelines Postscript PDF [January 28, 2016]
Lab 6 Due: February 18 Simple Hadoop Programs Postscript PDF Lab Info [February 11, 2016]
Lab 7 Due: March 1 11 Intermediate Hadoop Programs Postscript PDF Lab Info [February 23, 2016]
Lab 8 Due: March 13 Hadoop Programs on Non-Synthetic Datasets Postscript PDF Lab Info [March 8, 2016]

Hadoop

Hadoop program template template.java
Our first Hadoop program switchMR.java
Data file for switchMR.java data
Multiple chained MapReduce jobs filter.java words (input file)
Using JSON objects JsonJob.java json.in,simple.json (input files)
Working with Key-Value files NickCage.java data.csv (input file)
Multiple Input Files/Multiple Mappers multiInMR.java users.in, messages.in (input files)
Hadoop Core Jar file hadoop-core-1.2.1.jar

Homeworks

Lecture Notes

Lecture 1 What's in this class? Postscript PDF [January 4, 2016]
Lecture 2 Motivating Examples Postscript PDF [January 4, 2016]
Lecture 3 Maps, Dictionaries, Key-Value Pairs Postscript PDF [January 12, 2016]
Lecture 4 MongoDB Basics Postscript PDF [January 18, 2016]
Lecture 6 MongoDB Java Connectivity Postscript PDF [January 28, 2016]
Lecture 7 MongoDB Aggregation Pipeline Postscript PDF [January 28, 2016]
Lecture 8 MapReduce Postscript PDF [January 28, 2016]
Lecture 9 Hadoop on CSLVM cluster Postscript PDF [February 17, 2016]


Other Materials

JSON

JSON home pagejson.org
JSON specification ECMA-404: The JSON Data Interchange Format (PDF)
org.json Javadocs Javadoc

January 4, 2016, dekhtyar at csc.calpoly.edu