Spark-with-Python
Fundamentals of Spark with Python (using PySpark), code examples
File Explorer
Download Latest Version (.zip)- appl_stock.csv
- chinook.db
- chinook.zip
- ContainsNull.csv
- Moby-Dick.txt
- people.json
- sales_info.csv
- sqlite_latest.jar
- users.parquet
- Components.png
- RDD-1.png
- RDD_dependency_graph.PNG
- Readme.md
- Spark ecosystem.png
- SparkSQL-1.png
- customer_churn.csv
- dataset_Facebook.csv
- dog_food.csv
- Facebook_metrics.txt
- hack_data.csv
- Creating Fake Data.ipynb
- fake_customers.csv
- hello.csv
- new_customers.csv
- test.csv
- Python Crash Course Exercises - Solutions.ipynb
- Python Crash Course Exercises.ipynb
- Python Crash Course.ipynb
- Introduction to Spark Streaming.ipynb
- TweetRead.py
- Spark DataFrames Project Exercise - SOLUTIONS.ipynb
- Spark DataFrames Project Exercise.ipynb
- walmart_stock.csv
- appl_stock.csv
- ContainsNull.csv
- DataFrame_Basic_Operations.ipynb
- DataFrame_Basics.ipynb
- Dates_and_Timestamps.ipynb
- GroupBy_and_Aggregate_Functions.ipynb
- Missing_Data.ipynb
- people.json
- sales_info.csv
- Clustering Code Along.ipynb
- Clustering_Code_Example.ipynb
- Clustering_Consulting_Project.ipynb
- Clustering_Consulting_Project_SOLUTIONS.ipynb
- hack_data.csv
- sample_kmeans_data.txt
- seeds_dataset.csv
- seeds_dataset.txt
- cruise_ship_info.csv
- Data_Transformations.ipynb
- Ecommerce_Customers.csv
- fake_customers.csv
- Linear_Regression_Code_Along.ipynb
- Linear_Regression_Consulting_Project.ipynb
- Linear_Regression_Consulting_Project_SOLUTIONS.ipynb
- Linear_Regression_Example.ipynb
- sample_linear_regression_data.txt
- customer_churn.csv
- Logistic_Regression_Consulting_Project.ipynb
- Logistic_Regression_Consulting_Project_SOLUTIONS.ipynb
- Logistic_Regression_Example.ipynb
- new_customers.csv
- sample_libsvm_data.txt
- titanic.csv
- Titanic_Log_Regression_Code_Along.ipynb
- readme
- SMSSpamCollection
- NLP_Code_Along.ipynb
- Tools_for_NLP.ipynb
- Consulting Project - Recommender Systems.ipynb
- Meal_Info.csv
- movielens_ratings.csv
- Recommender_Code_Along.ipynb
- College.csv
- dog_food.csv
- sample_libsvm_data.txt
- Tree Methods Code Along.ipynb
- Tree_Methods_Consulting_Project.ipynb
- Tree_Methods_Consulting_Project_SOLUTION.ipynb
- Tree_Methods_Doc_Example.ipynb
- Course_Notes.zip
- README.md
- Readme.md
- Spark-with-Python.md
- .gitignore
- _config.yml
- Dataframe_introduction.ipynb
- DataFrame_operations_basics.ipynb
- Dataframe_SQL_query.ipynb
- GroupBy_aggregrate.ipynb
- Key-Value RDD basics.ipynb
- LICENSE
- notebook.tex
- Partioning and Gloming.ipynb
- RDD_Chaining_Execution.ipynb
- README.md
- Row_column_objects.ipynb
- SparkContext and RDD Basics.ipynb
- SparkContext_Workers_Lazy_Evaluations.ipynb
- Word_Count.ipynb
# Installation Guide
1. Get the code
git clone https://github.com/tirthajyoti/Spark-with-Python
Downloads the entire project code from GitHub to your computer.
cd Spark-with-Python
Moves into the project folder you just downloaded.
2. Official Install Script
Easy RecommendedPrerequisites
- APT (Debian/Ubuntu κ³μ΄) Built into Debian/Ubuntu-based Linux distributions.
sudo apt-get install oracle-java8-installer
Installs directly from the APT package repository (Debian/Ubuntu-based).
sudo apt-get install oracle-java8-set-default
Installs directly from the APT package repository (Debian/Ubuntu-based).
After installing, open a new terminal and run the program's version command (e.g. --version) to confirm it worked.
Pulled directly from this repo's README.
// repository documentation
Was this content helpful?
(0 ratings)