WARs

Task	Team Member	Est. Time	Actual	Status	Comments
Worked on the final presentation	Cassio, Sushant, Sameep	13 hrs	13 hrs	Completed	Made the necessary changes in the presentation
Finishing up Develop and User manual	Cassio, Sushant, Sameep	10 hrs	12 hrs	Completed	Continuing working on manuals

Task	Team Member	Est. Time	Actual	Status	Comments
Started working on User manual and developers guide	Cassio, Sushant, Sameep	5 hrs	5 hrs	Completed	start drafting the content for both manuals
Setup hadoop and spark on Dr. Sanchez VM	Cassio, Sushant, Sameep	2 hrs	2 hrs	Completed	Setup hadoop and spark on the VM
Hadoop/Spark Recommender	Sameep, Sushant, Cassio	10 hrs	10 hrs	Completed	Trying a faster and more reliable algorithm for recommendation

Task	Team Member	Est. Time	Actual	Status	Comments
Finalized and Practice NTASC presentation	Cassio, Sushant, Sameep	10 hrs	10 hrs	Completed	Final presentation changes, and pratice together
Hadoop Recommender new Algorithm	Cassio, Sushant	6 hrs	6 hrs	Completed	Trying a faster and more reliable algorithm for recommendation
Spark Recommender new Algorithm	Sameep	6 hrs	6 hrs	Completed	Trying a faster and more reliable algorithm for recommendation

Task	Team Member	Est. Time	Actual	Status	Comments
Final draft of SRS poster	Cassio, Sushant, Sameep	15 hrs	15 hrs	Completed	Revised, as per feedback by Dr. Payne and Dr. Sanchez. Background removed
Start NTASC presentation	Cassio, Sameep, Sushant	5 hrs	5 hrs	Completed	Basic outline of the presentation
Fixing bugs on both recommenders	Sushant, Cassio, Sameep	8 hrs	8 hrs	Fixed	Trying to fix bugs and improve recommendations

Task	Team Member	Est. Time	Actual	Status	Comments
Start working on SRS poster	Cassio, Sushant, Sameep	3 hrs	3 hrs	Completed	Started working on the basic outline of the SRS poster
K-means for Hadoop	Cassio, Sameep	3-4 hrs	3-4 hrs	Fixed	Fixing bugs
Recommender Hadoop	Sushant, Cassio	8 hrs	8 hrs	Fixed	Trying to fix bugs and improve recommendations
Recommender Spark	Sameep	8-9 hrs	8-9 hrs	Partially Fixed	Improve recommendation and scalability problem

Task	Team Member	Est. Time	Actual	Status	Comments
Work on recommender Hadoop	Cassio, Sushant	12 hrs	12 hrs	Completed	Trying the recommender for 5+ million records
Work on recommender Spark	Sameep	11 hrs	11 hrs	Completed	Trying the recommender for 5+ million records
Work on K-means for Spark	Sameep	5 hrs	5 hrs	Completed	Writing k-means program and testing on the cluster

Task	Team Member	Est. Time	Actual	Status	Comments
Mahout k-means clustering time tests	Cassio, Sushant	10 hrs	10 hrs	Completed	Time statistics noted based on different file sizes
MLlib Spark recommender using Collabrative filtering	Cassio, Sameep	15 hrs	15 hrs	Completed	Recommender performance improvement tests

Task	Team Member	Est. Time	Actual	Status	Comments
Mahout k-means clustering	Cassio, Sushant	20 hrs	20 hrs	Completed	Splitting files seperately based on the number of clusters
MLlib Spark recommender using Collabrative filtering	Cassio	15 hrs	15 hrs	Completed	Programming language changed to Python
MLlib Spark K-means clustering started	Cassio	5 hrs	5 hrs	Completed	Initial knowledge gain in Spark clustering

Task	Team Member	Est. Time	Actual	Status	Comments
Mahout Recommender bug testing	Cassio, Sushant	10 hrs	10 hrs	Completed	Recommender's performance improved
MLlib Spark recommender using Collabrative filtering	Cassio, Sameep	15 hrs	15 hrs	Completed	Java being used to program the recommender
Mahout K-means clustering started	Sushant	8 hrs	8 hrs	Incomplete	Initial knowledge gain in clustering

Task	Team Member	Est. Time	Actual	Status	Comments
Mahout Recommenders working with hadoop 2 nodes	Cassio, Sushant, Sameep	10 hrs	10 hrs	Completed	All bugs fixed. Speed and time statistics noted
MLlib Spark recommenders started	Cassio, Sushant, Sameep	10 hrs	10 hrs	Completed	Gaining knowledge in the field of recommenders using spark

Task	Team Member	Est. Time	Actual	Status	Comments
Mahout Book review Ch 6	Cassio, Sushant, Sameep	15 hrs	15 hrs	Completed	Mahout recommenders using Hadoop
Mahout Ch6 Wikipedia data	Cassio, Sushant, Sameep	10 hrs	10 hrs	Completed	recommenders working on 4 nodes with a few bugs

Task	Team Member	Est. Time	Actual	Status	Comments
Mahout Book review Ch 2,3,4,5,6	Cassio, Sushant, Sameep	10 hrs	10 hrs	Completed	Gaining knowledge in the field of recommenders
Recommenders on Apache Mahout	Cassio, Sushant, Sameep	10 hrs	10 hrs	Completed

Task	Team Member	Est. Time	Actual	Status	Comments
Faculty Presentation Delivered	Sushant, cassio, Sameep	25 minutes	25 minutes	Completed
Mahout Book review Ch 2,3,4,5,6	Cassio, Sushant, Sameep	10 hrs	10 hrs	Completed	Gaining knowledge in the field of recommenders

Task	Team Member	Est.Time	Actual	Status	Comments
Hadoop map-reduce job chaining issue fixed	Cassio, Sushant	20 hours	20 hours	Completed
Faculty Presentation Preparation	Cassio, Sushant	5 hours	5 hours	Completed

Task	Team Member	Est.Time	Actual	Status	Comments
Nodes distributed for Hadoop and Spark (2 nodes each)	Sameep	40min	30min	Completed	2 working nodes each for Hadoop and Spark
Hadoop test runs for word count and Matrix multiplication on cluster	Sushant	20 hrs	20 hrs	Completed	Test times noted carefully
Heap size java exception solved for Spark cluster	Sameep, Cassio	2 hrs	2 hrs	Completed	Maximum memory utilization for both nodes
Spark test runs for word count and Matrix multiplication on cluster	Cassio	20 hrs	20 hrs	Completed	Test times noted carefully
Reading Mahout book ch2,3,4,5,6 for recommender system test	Cassio, Sameep, Sushant	5 hrs	8 hrs	Completed

Task	Team Member	Est.Time	Actual	Status	Comments
Hadoop installed on 4 node machines to access HDFS	Cassio, Sushant, Sameep	6 hours	6 hours	Completed
Cluster set up	Cassio, Sushant	100 hours	80 hours	Completed	4 working nodes

Task	Team Member	Est.Time	Actual	Status	Comments
Project Presentation - Iteration 1 - Delivery	Sameep, Cassio, Sushant	45min	50min	Completed	Showed the presentation to class and got proper feedback
Code Delivery to Dr. Sanchez	Sameep	2 hrs	2 hrs	Completed	Created zip file with all code and data used during the semester
Worked on the Design Document V1.0	Sushant, Cassio, Sameep	3 hrs	3 hrs	Completed	Submitted the document to the client on December 15
Website Updates	Cassio, Sameep	2 hrs	2 hrs	Completed	Entire semester details updated on the website including Documents and WARs

Task	Team Member	Est.Time	Actual	Status	Comments
Worked on Project Presentation - Iteration 1	Sameep, Cassio, Sushant	5 hrs	4 hrs	Completed	Showed the presentation to Dr. Sanchez on December 14 for suggestions
Worked on Design Document V1.0	Sameep	4 hrs	4 hrs	In progress	Revising system architeture diagrams
Setup cluster by connecting to the nodes	Sushant, Cassio, Sameep	9 hrs	-	Completed	Stoped working by client's request
One Step matrix multiplication on Spark (5x)	Cassio	9 hrs	10 hrs	Completed	Test fully completed

Task	Team Member	Est.Time	Actual	Status	Comments
One Step matrix multiplication on Spark	Sameep, Cassio	7 hrs	8 hrs	Completed	Test fully completed
Two Step matrix multiplication on Hadoop	Sushant	8 hrs	9 hrs	Completed	Test fully completed
Setup cluster by connecting to the nodes	Sushant, Cassio, Sameep	9 hrs	18 hrs	Completed	Trouble to making task trackers to work in sync with job trackers

Task	Team Member	Est. Time	Actual	Status	Comments
Install HDFS on the 4 nodes	Cassio, Sushant & Sameep	2 hrs	2 hrs	Completed
Setup cluster by connecting to the nodes	Cassio, Sushant & Sameep	8 hrs	16 hrs	Completed	Trouble connecting to master correctly.

Task	Team Member	Est. Time	Actual	Status	Comments
Two Step matrix multiplication on Hadoop	Cassio, Sushant & Sameep	5 hrs	8 hrs	Completed	Output not displaying properly
Run wordcount 5x (Hadoop/Spark)	Cassio, Sushant & Sameep	8 hrs	12 hrs	Done	All times taken properly
Run One Step matrix multiplcation 5x (Hadoop)	Cassio, Sushant & Sameep	15 hrs	18 hrs	Completed	No comments
One Step matrix multiplication on Spark	Cassio, Sushant & Sameep	5 hrs	9 hrs	Completed	Trouble with RDD functions
Structuring Requeriments Document v1.2	Sameep	2 hrs	4 hrs	Done
One Step matrix multiplication on Java	Sameep	3 hrs	3 hrs	Done

Task	Team Member	Est. Time	Actual	Status	Comments
Wordcount on Hadoop	Cassio & Sushant	10 hrs	13 hrs	Completed
One step matrix multiplication on Hadoop	Cassio & Sushant	3 hrs	8 hrs	Completed
Use Case Diagrams and Requeriments Document v1.2	Sameep	5 hrs	5 hrs	Completed

Task	Team Member	Est. Time	Actual	Status	Comments
Spark Installation with HDFS	Sameep	6 hrs	10 hrs	Completed
Java Wordcount	Cassio	5 hrs	5 hrs	Completed	Program not complete, bug fixing.
Requeriment Documents v1.1	Sushant	6 hrs	12 hrs	Completed

Task	Team Member	Est.Time	Actual	Status	Comments
Requirements Document v1.0	Sushant, Sameep, Cassio	7 hrs	8 hrs	Completed
Maven Installation, wordcount program.	Sameep, Cassio	3 hrs	3 hrs	Completed	Ran a wordcount program into Eclipse and HDFS
Project Plan v1.1	Sushant	2 hrs	3 hrs	Completed

Task	Team Member	Est. Time	Actual	Status	Comments
Revised Project Plan	Sushant	3 hrs	4 hrs	Completed	From V1.0 to V1.1 as per Dr. Payne's suggestions
Spark Installation	Sameep	1.5 hrs	3 hrs	Completed	Sucessful run of sample program.
Hadoop Installation	Cassio/Sushant	1.5 hrs	2 hrs	Completed	Sucessful run of sample program.