COMP4651

KO | EN

gitlite — search

#python #java #python3 #arduino #golang #machine-learning #rust #html #flask #javascript #seismology #nodejs

★ 23 Open GitHub ↗

HKUST COMP4651 Fall 18/19: Cloud Computing and Big Data Systems

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# COMP4651: Cloud Computing and Big Data Systems
Codes for HKUST COMP4651 Fall 2018: Cloud Computing and Big Data Systems

## Assignment
[Assignment 1](https://github.com/nwihardjo/COMP4651-Cloud-Computing-and-Big-Data-Systems/blob/master/assignment-1/README.md): Benchmarking and measuring AWS EC2 CPU, Memory, and Network Performance across different types of instances and cluster locations

[Assignment 2](https://github.com/nwihardjo/COMP4651-Cloud-Computing-and-Big-Data-Systems/blob/master/assignment-2/src/main/java/hk/ust/comp4651/CopyFile.java): Java implementation on copying files between HDFS and locals while maintaining the checksum

[Assignment 3](https://github.com/nwihardjo/COMP4651-Cloud-Computing-and-Big-Data-Systems/tree/master/assignment-3): MapReduce Programming on Java for Bigram count and frequency calculation based on Stripes and Pairs design pattern

[Assignment 4](https://github.com/nwihardjo/COMP4651-Cloud-Computing-and-Big-Data-Systems/tree/master/assignment-4): Apache Spark
- [Q1](https://github.com/nwihardjo/COMP4651-Cloud-Computing-and-Big-Data-Systems/blob/master/assignment-4/word_count.ipynb): Building a Word Count Application
- [Q2](https://github.com/nwihardjo/COMP4651-Cloud-Computing-and-Big-Data-Systems/blob/master/assignment-4/log_analysis.ipynb): Web Server Log Analysis

[Assignmnet 5](https://github.com/nwihardjo/COMP4651-Cloud-Computing-and-Big-Data-Systems/blob/master/assignment-5/ml_pipeline.ipynb): Power Plant Machine Learning Pipeline Application with Apache Spark

## Additional
[DataFrame Live Programming](https://github.com/nwihardjo/COMP4651-Cloud-Computing-and-Big-Data-Systems/blob/master/DataFrame-live/Fire%20Incidents%20Exploration%20-%20RunMe.ipynb): Spark's DataFrame Live Programming hands-on tutorial from Spark SF Meetup 2016

[Spark Tutorial](https://github.com/nwihardjo/COMP4651-Cloud-Computing-and-Big-Data-Systems/blob/master/spark-tutorial/spark_tutorial.ipynb): Apache Spark tutorial heavily adapted from [Spark MOOC](https://github.com/spark-mooc/)

[EMR Test](https://github.com/nwihardjo/COMP4651-Cloud-Computing-and-Big-Data-Systems/tree/master/EMR-test-master): Test for Amazon EMR and S3 instances

COMP4651

Explore Similar Repositories

Was this content helpful?

Recent Feedback

Download README