KO | EN

GitLite

Minimalist Open Source Repository Search Engine

gitlite — search

#dsh #dsh-plugin #ai-agents #developer-tools #ai-agent #claude-code #mcp #typescript #codex #cli #rust #deepseek-harness

serverless-ml-course

★ 685 Open GitHub ↗

Serverless Machine Learning Course for building AI-enabled Prediction Services from models and features

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

![readme header](https://raw.githubusercontent.com/featurestoreorg/serverless-ml-course/main/assets/images/card_horizontal.jpg)

# **[Beyond Notebooks - Serverless Machine Learning](https://www.serverless-ml.org)**
***Build Batch and Real-Time Prediction Services with Python***

![serverless architecture](https://raw.githubusercontent.com/featurestoreorg/serverless-ml-course/main/assets/images/serverless-ml-architecture.svg "Serverless Architecture")

# **Overview**
You should not need to be an expert in Kubernetes or cloud computing to build an end-to-end service that makes intelligent decisions with the help of a ML model. Serverless Machine Learning (ML) makes it easy to build a system that uses ML models to make predictions.

With Serverless ML, you do not need to install, upgrade, or operate any systems. You only need to be able to write Python programs that can be scheduled to run as pipelines. The features and models your pipelines produce are managed by a serverless feature store / model registry. We will also show you how to build a UI for your prediction service by writing Python and some HTML.

Read <a href="https://www.serverless-ml.org/what-is-serverless-machine-learning">this article</a> for an overview on serverless machine learning.

**Prerequisites:** Python - Pandas - Github

# **Modules**
- ## **Module 00** - Introduction and optional content.
   - Why Serverless ML: [Video](https://www.youtube.com/watch?v=zM2_m898P5g) | [Slides](https://drive.google.com/file/d/15gwryDoHq88tgxu8CoCbTqr5L9YN9O5p/view?usp=sharing)
   - Introduction to the course: [Video](https://www.youtube.com/watch?v=FM1YkIl1wXI&list=PLMeDf8qRRqgU_-erq30v-k8_it4pOqhoQ&index=3) | [slides](https://drive.google.com/file/d/1a5uZHhVSUyxxjrESFea9vONovKROra4L/view?usp=sharing)
   - Development Environment & Platforms [Video](https://www.youtube.com/watch?v=9kNjky0MQtc&list=PLMeDf8qRRqgU_-erq30v-k8_it4pOqhoQ&index=3) | [slides](https://drive.google.com/file/d/1LTTHkwV8RirYaz1MeZtoYgTc9TRSrBwr/view?usp=sharing)

- ***Introduction to Machine Learning (ML 101)*** [Video](https://www.youtube.com/watch?v=RmAGTZ7dy58&list=PLMeDf8qRRqgU_-erq30v-k8_it4pOqhoQ&index=4) | [slides](https://drive.google.com/file/d/1HXsrSRPcBMW53lgnBnYb95m5eS9oLqRk/view?usp=sharing)
   
- ## **Module 01** - Pandas and ML Pipelines in Python. Write your first serverless App.
  - Full Lecture: [Video](https://www.youtube.com/watch?v=j-XnCflCc0I) | [Slides](https://drive.google.com/file/d/1L8DHGC5xo0NlNe8xfh4xf4NZV1CEGBA6/view?usp=sharing)

- [Lab](https://www.youtube.com/watch?v=zAD3miW0Og0) | [Slides](https://drive.google.com/file/d/1hve9nVrImRhNE8lE26zPcr3X1DDDk7uD/view?usp=sharing)  | [Homework form](https://forms.gle/2p5odBdpAqvavH1T7)
  
- ## **Module 02** - Data modeling and the Feature Store. The Credit-card fraud prediction service. 
    - Full Lecture: [Video](https://youtu.be/tpxZh8lbcBk) | [Slides](https://drive.google.com/file/d/1HgAKsHnOms1XCtl_KIEuELudTLtDkhxk/view?usp=sharing)
    
    - [Lab](https://www.youtube.com/watch?v=niPayagVxFg) | [Slides](https://drive.google.com/file/d/1_1oDN5nfpWSUpKNlls45HLllQ75yAWd-/view?usp=sharing) | [Homework form](https://forms.gle/5g9XtaeBEigKEirGA)
- ## **Module 03** - Training Pipelines, Inference Pipelines, and the Model Registry.
    - Full lecture: [Video](https://youtu.be/BD1UOJs1Bvo) | [Slides](https://drive.google.com/file/d/1XhfnH7DzwDqQKS6WxDVqWFFas0fi_jnJ/view?usp=sharing)

- [Lab](https://youtu.be/QfzrKgLqEXc) | [Slides](https://drive.google.com/file/d/1jITx5HGh2uM5vAeknvCaeN6ZPOc2i8AS/view?usp=sharing)
- ## **Module 04** - Serverless User Interfaces for Machine Learning Systems.
    - Full lecture: [Video](https://youtu.be/GgwIspMUovM) | [Slides](https://drive.google.com/file/d/10JzJCDwi6IPnJNZ0iApzbwACkAn3C9Y9/view?usp=sharing)

- [Lab](https://youtu.be/sMhCXwm_Wmw) | [Slides](https://drive.google.com/file/d/1bASaZN68__Ut0RnSuTvhF8LKn240UPtE/view?usp=sharing)

- ## **Module 05** - Principles and Practices of MLOps
    - Part 01: [Video](https://youtu.be/-vbLMtfoBeo) | [Slides](https://drive.google.com/file/d/1orKJJ2e_1pNgF8X6CFBUKw7qEDQVoVqt/view?usp=share_link)
    - Part 02:  [Video](https://youtu.be/j4wZmywPs1E) | [Slides](https://drive.google.com/file/d/13r1OvuuV6Snq1r5PmAvwHU0dTiExQ4iE/view?usp=share_link)
    - Lab: [Video](https://youtu.be/BaAbiFsx25E) | [Slides](https://drive.google.com/file/d/1WOahxd4s9_NVr8JUUVJvvUFU6ea9konS/view?usp=share_link)

- ## **Module 06** -Operational machine learning systems: Real-time Machine Learning. 
    - Full lecture: [Video](https://youtu.be/GEgiIh9a048) | [Slides](https://drive.google.com/file/d/1VXU2jxEUMIvIY_Xe7XSrNuy0yxXt8glP/view?usp=share_link)
    - Lab: [Video](https://youtu.be/DsyNk3A6ouA) | [Slides](https://drive.google.com/file/d/1nZJKFMvAFoAu4s5smuc-rIb9EBQVME0Z/view?usp=share_link)

---

## **Learning Outcomes:**
- Learn to develop and operate AI-enabled (prediction) services on serverless infrastructure
- Develop and run serverless feature pipelines 
- Deploy features and models to serverless infrastructure
- Train models and and run batch/inference pipelines
- Develop a serverless UI for your prediction service
- Learn MLOps fundamentals: versioning, testing, data validation, and operations
- Develop and run a real-time serverless machine learning system

## **Course Contents:**
- Pandas and ML Pipelines in Python. Write your first serverless App.
- The Feature Store for Machine Learning. Feature engineering for a credit-card fraud serverless App.
- Training Pipelines and Inference Pipelines
- Bring a Prediction Service to Life with a User Interface (Gradio, Github Pages, Streamlit)
- Automated Testing and Versioning of features and models
- Real-time serverless machine learning systems. Project presentation.

## **Who is the target audience?**
You have taken a course in machine learning (ML) and you can program in Python. You want to take the next step beyond training models on static datasets in notebooks. You want to be able to build a prediction service around your model. Maybe you work at an Enterprise and want to demonstrate your models’ value to stakeholders in the stakeholder's own language. Maybe you want to include ML in an existing application or system.

## **Why is this course different?**
You don’t need any operations experience beyond using GitHub and writing Python code. You will learn the essentials of MLOps: versioning artifacts, testing artifacts, validating artifacts, and monitoring and upgrading running systems. You will work with raw and live data - you will need to engineer features in pipelines. You will learn how to select, extract, compute, and transform features.

## **Will this course cost me money?**
No. You will become a serveless machine learning engineer without having to pay to run your serverless pipelines or to manage your features/models/user-interface. We will use Github Actions and Hopsworks that both have generous time-unlimited free tiers.

**Register now at [Serveless ML Course](https://www.serverless-ml.org/register)**

## **Timeline**
_Self-paced_

## **Requirements**
- **Python** environment include a notebook (Jupyter or Colaboratory)
- https://github.com  account
- https://hopsworks.ai  account

# **Key Technologies**

## **Development environment**
You can write, test, debug, and train your models in some Python IDE. We will focus on notebooks and Python programs. You can use Jupyter notebooks or Colaboratory.

## **Github**
Github to manage your code, GitHub Actions to run your workflows, and Github Pages for your user interface for non-interactive applications. Github Actions offers a free tier of 500 MB and 2,000 minutes to run your pipelines.
https://docs.github.com/en/billing/managing-billing-for-github-actions/about-billing-for-github-actions

## **Hopsworks**
[Hopsworks.ai](https://app.hopsworks.ai) has a free tier of 10 GB of storage.

---

## **Useful Resources**
| name | Description | link |
|------|-------------|------|
|**Awesome MLOps**| A collection of links and resources for MLOps| https://github.com/visenger/awesome-mlops| 
|**Machine Learning Ops**| a collection of resources on how to facilitate Machine Learning Ops with GitHub.| https://mlops.githubapp.com/|
|**MLOps Toys**| A curated list of MLOps projects.|https://mlops.toys/|
|**MLOps Zoomcamp**| teaches practical aspects of productionizing ML services.|https://github.com/DataTalksClub/mlops-zoomcamp| 
|**PYSLACKERS**|A large open community for Python programming enthusiasts.|https://pyslackers.com/web| 
|**Feature Store Org**|An open community for everything feature stores.|https://www.featurestore.org|

## **Other MLOps Courses**
| name | Description | link |
|------|-------------|------|
|**MlOps Zoomcamp**| DevOps style course with Python and Docker as prerequisites.| https://github.com/DataTalksClub/mlops-zoomcamp |
|**Full Stack Deep Learning**| This course shares best practices for the full stack; topics range from problem selection to dataset management to monitoring.| https://fullstackdeeplearning.com/| 
|**MLOps course**| A series of lessons teaching how to apply ML to build production-grade products (by Goku Mohandas).|https://github.com/GokuMohandas/mlops-course |

---

# **Definitions**

- [Context windows for LLMs](http://www.hopsworks.ai/dictionary/context-window-for-llms)
- [Compound AI Systems](https://www.hopsworks.ai/dictionary/compound-ai-systems)
- [Feature Store](https://www.hopsworks.ai/dictionary/feature-store)
- [Feature Monitoring](https://www.hopsworks.ai/dictionary/feature-monitoring)
- [Feature Data](https://www.hopsworks.ai/dictionary/feature-data) 
- [Flash Attention](https://www.hopsworks.ai/dictionary/flash-attention)
- [Function Calling with LLMs](https://www.hopsworks.ai/dictionary/function-calling-with-llms)
- [Gradient Accumulation](https://www.hopsworks.ai/dictionary/gradient-accumulation)
- [In Context Learning (ICL)](http://www.hopsworks.ai/dictionary/in-context-learning-icl)
- [KServe](https://www.hopsworks.ai/dictionary/kserve)
- [ML Logs](https://www.hopsworks.ai/dictionary/machine-learning-logs)
- [ML Infrastructure](https://www.hopsworks.ai/dictionary/machine-learning-infrastructure)
- [ML Observability](https://www.hopsworks.ai/dictionary/machine-learning-observability)
- [ML Pipeline](https://www.hopsworks.ai/dictionary/ml-pipeline)
- [ML Systems](https://www.hopsworks.ai/dictionary/ml-systems)
- [Model Deployment](https://www.hopsworks.ai/dictionary/model-deployment)
- [Model Monitoring](https://www.hopsworks.ai/dictionary/model-monitoring)
- [Model Registry](https://www.hopsworks.ai/dictionary/model-registry)
- [Model Serving](https://www.hopsworks.ai/dictionary/model-serving)
- [PagedAttention](https://www.hopsworks.ai/dictionary/pagedattention)
- [Prompt Store](https://www.hopsworks.ai/dictionary/prompt-store)
- [Retrieval Augmented Generation (RAG) LLM](https://www.hopsworks.ai/dictionary/retrieval-augmented-generation-llm)
- [RoPE Scaling](https://www.hopsworks.ai/dictionary/rope-scaling)
- [Sample Packing](https://www.hopsworks.ai/dictionary/sample-packing)
- [Similarity Search](http://www.hopsworks.ai/dictionary/similarity-search)

# **Support and Partners**


 <a href="https://www.featurestore.org">
 <img src="https://uploads-ssl.webflow.com/5f32a0dcc815d2a49c58481a/61d5bd3ac0dfb6cabe8d5ebc_FS%20Logo%20.svg" alt="FSorg" width="105"/>
 </a>

 

 <a href="https://www.hopsworks.ai">
 <img src="https://assets.website-files.com/5f6353590bb01cacbcecfbac/6202a13e7cafec5553703f6b_logo.svg" alt="Hopsworks" width="250"/>
 </a>

serverless-ml-course

Explore Similar Repositories

Was this content helpful?

Recent Feedback

Download README