1) Ran Code for questions 1-3 on pyspark in cluster mode, with multiple nodes. Measured and captured the difference in performance between running it on a single EC-2 instance, and running it on a cluster.

2) Added some screenshots for the final report, to show the cluster configuration.

3) Added ipython notebooks for performance metrics in local mode.

4) Added json files for zeppelin notebooks

5) Created new source files for Code pyspark code run in zeppelin notebooks, in cluster mode

6) Added test results for question 3 when using hive to calculate the median data.

7) Added R code from Rob for question 3 local exploration

8) Renamed some of the local exploration files

Completed Visualizations for Question 2. Made some small edits to the Vizzes for question 1. Questions 1 and 2 are now completely ready.

Finished Code, and iPython notebooks for Question 2. Will work on completing the Viz for this Question next.

Added source , ipython notebook , mark down and results for question 2. Will add a bit more results and visualization tomorrow.

Added Guidelines for the final report, and updated the report to include the new sections we should include.

Completed Code and Visualizations for Question 1. Need to update final report with findings of Question 1

Final Source code for Question 1, and associated iPython Notebooks. Will include a separate Notebook for Visualizing question 1, because matplotlib is having issues in the version of Anaconda on the EC2 instance.

Finished spark implementation for question 1. Need to do some visualizations for this, and write the final report for it. Added iPython notebooks that detail the code for question 1. Formalized local pandas source, and remote pyspark source, and did a performance comparison.

Modified local programs to output csv data. Measured the amount of time each query took on a local pc. Started a document for Challenges_Encountered

Obtained the Answer to Question 1 in Pandas. Also added a fun aside for tracking the Most_Frequent_Player_Birthdays