COMP4651

KO | EN

gitlite — search

#javascript #hacktoberfest #react #golang #go #machine-learning #rust #deep-learning #nodejs #cli #awesome-list #pytorch #openai #open-source

(★ 23)

HKUST COMP4651 Fall 18/19: Cloud Computing and Big Data Systems

COMP4651 Latest Version Download

Download Latest Version (.zip)

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# COMP4651: Cloud Computing and Big Data Systems
Codes for HKUST COMP4651 Fall 2018: Cloud Computing and Big Data Systems

## Assignment
[Assignment 1](https://github.com/nwihardjo/COMP4651-Cloud-Computing-and-Big-Data-Systems/blob/master/assignment-1/README.md): Benchmarking and measuring AWS EC2 CPU, Memory, and Network Performance across different types of instances and cluster locations

[Assignment 2](https://github.com/nwihardjo/COMP4651-Cloud-Computing-and-Big-Data-Systems/blob/master/assignment-2/src/main/java/hk/ust/comp4651/CopyFile.java): Java implementation on copying files between HDFS and locals while maintaining the checksum

[Assignment 3](https://github.com/nwihardjo/COMP4651-Cloud-Computing-and-Big-Data-Systems/tree/master/assignment-3): MapReduce Programming on Java for Bigram count and frequency calculation based on Stripes and Pairs design pattern

[Assignment 4](https://github.com/nwihardjo/COMP4651-Cloud-Computing-and-Big-Data-Systems/tree/master/assignment-4): Apache Spark
- [Q1](https://github.com/nwihardjo/COMP4651-Cloud-Computing-and-Big-Data-Systems/blob/master/assignment-4/word_count.ipynb): Building a Word Count Application
- [Q2](https://github.com/nwihardjo/COMP4651-Cloud-Computing-and-Big-Data-Systems/blob/master/assignment-4/log_analysis.ipynb): Web Server Log Analysis

[Assignmnet 5](https://github.com/nwihardjo/COMP4651-Cloud-Computing-and-Big-Data-Systems/blob/master/assignment-5/ml_pipeline.ipynb): Power Plant Machine Learning Pipeline Application with Apache Spark

## Additional
[DataFrame Live Programming](https://github.com/nwihardjo/COMP4651-Cloud-Computing-and-Big-Data-Systems/blob/master/DataFrame-live/Fire%20Incidents%20Exploration%20-%20RunMe.ipynb): Spark's DataFrame Live Programming hands-on tutorial from Spark SF Meetup 2016

[Spark Tutorial](https://github.com/nwihardjo/COMP4651-Cloud-Computing-and-Big-Data-Systems/blob/master/spark-tutorial/spark_tutorial.ipynb): Apache Spark tutorial heavily adapted from [Spark MOOC](https://github.com/spark-mooc/)

[EMR Test](https://github.com/nwihardjo/COMP4651-Cloud-Computing-and-Big-Data-Systems/tree/master/EMR-test-master): Test for Amazon EMR and S3 instances

COMP4651

COMP4651 Latest Version Download

Today's picks

Was this content helpful?

Recent Feedback

COMP4651

COMP4651 Latest Version Download

Today's picks

Was this content helpful?

Recent Feedback

Download README