Instructor:
Alexander Dekhtyar,
dekhtyar@calpoly.edu,
14-2150
Office Hours:
| Who | Where | |
Tuesday | 10:10am - 11:00am | Alex | 14-215 |
Wednesday | 9:10am - 10:00am | Alex | 14-215 |
Wednesday | 1:10pm - 2:00pm | Alex | 14-215 |
Thursday | 10:10pm - 11:00am | Alex | 14-215 |
Additional appoinments: send email.
Study Guide | Postscript |
|
|
|
Syllabus | Postscript |
Lab 1, Part 1 | Due: January 8 | JSON Generation | Postscript | Lab Data | [January 4, 2016] | |
Lab 1, Part 2 | Due: January 12 | JSON Parsing | Postscript | Lab Data | [January 6, 2016] | |
Lab 2 | Due: January 19 | Ad-hoc Key-Value store | Postscript | Lab Info | [January 12, 2016] | |
Lab 3 | Due: January 21 | MongoDB queries | Postscript | Lab Info | [January 19, 2016] | |
Lab 4 | Due: | MongoDB Application | Postscript | Lab Info | [January 21, 2016] | |
Lab 5 | Due: February 3 | MongoDB Aggregate Pipelines | Postscript | [January 28, 2016] | ||
Lab 6 | Due: February 18 | Simple Hadoop Programs | Postscript | Lab Info | [February 11, 2016] | |
Lab 7 | Due: March | Intermediate Hadoop Programs | Postscript | Lab Info | [February 23, 2016] | |
Lab 8 | Due: March 13 | Hadoop Programs on Non-Synthetic Datasets | Postscript | Lab Info | [March 8, 2016] |
Hadoop program template | template.java | |
Our first Hadoop program | switchMR.java | |
Data file for switchMR.java | data | |
Multiple chained MapReduce jobs | filter.java | words (input file) |
Using JSON objects | JsonJob.java | json.in,simple.json (input files) |
Working with Key-Value files | NickCage.java | data.csv (input file) |
Multiple Input Files/Multiple Mappers | multiInMR.java | users.in, messages.in (input files) |
Hadoop Core Jar file | hadoop-core-1.2.1.jar |
Lecture 1 | What's in this class? | Postscript | [January 4, 2016] | |
Lecture 2 | Motivating Examples | Postscript | [January 4, 2016] | |
Lecture 3 | Maps, Dictionaries, Key-Value Pairs | Postscript | [January 12, 2016] | |
Lecture 4 | MongoDB Basics | Postscript | [January 18, 2016] | |
Lecture 6 | MongoDB Java Connectivity | Postscript | [January 28, 2016] | |
Lecture 7 | MongoDB Aggregation Pipeline | Postscript | [January 28, 2016] | |
Lecture 8 | MapReduce | Postscript | [January 28, 2016] | |
Lecture 9 | Hadoop on CSLVM cluster | Postscript | [February 17, 2016] |
JSON home page | json.org |
JSON specification | ECMA-404: The JSON Data Interchange Format (PDF) |
org.json Javadocs | Javadoc |