PySpark-Confluent-Kafka-Apache-Drill-

★ 28 Open GitHub ↗

A code-based tutorial for production level data streaming with PySpark plus Optimus for data cleaning, Confluent Kafka, & Apache Drill using Docker and Cassandra (NoSQL DB) for storage; This allows for for fast feature engineering and data cleaning.

Explore Similar Repositories

learn-pyspark : Beginner Friendly PySpark Tutorials hosted at Spark Playground
pySpark_tutorial : Implementation of Spark code in Jupyter notebook. Topics include: RDDs and DataFrame, exploratory data analysis (EDA), handling multiple DataFrames, visualization, Machine Learning
spark-fundamentals : Elevate big data skills with Apache Spark's core concepts and examples
pyspark-tutorials : PySpark Tutorials and Materials
pyspark_on_google_colab : PySpark Tutorial for Beginners on Google Colab: Hands-On Guide
// repository documentation