KO | EN

GitLite

Minimalist Open Source Repository Search Engine

gitlite — search

#typescript #ai-agents #developer-tools #cli #codex #claude-code #react #mcp #open-source #deepseek-harness #dsh-plugin #ai

little_ml_book_club

★ 37 Open GitHub ↗

No description available.

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# Welcome to Little ML book club. We are reading ML books and papers. Together!

Hello fellow ML geeks, my name is Andrey and I know about ML much-much less than I want to. While I do not think I will ever reach the level of "finally good enough", I still want to learn in a good company. Join in!

> **ATTENTION!** The club is currently on pause! Enjoy your summer and stay tuned for the news!

**How it works**: 
- Read a chapter from the list. 
- Jump on a call.
- Listen to me talk over some slides or present yourself (pretty pretty pretty please!)
- Take part in the discussion and learn  something.
- Slides will be uploaded to this repo, recording uploaded to Youtube
- **Join the chat for important announcements and discussion:** [Discord](https://discord.gg/dsXKHF8FQZ), [Telegram](https://t.me/+bleQ2wfB4DBjMGZk) (anouncements will be duplicated)

**Table of contents:**

- [Welcome to Little ML book club. We are reading ML books and papers. Together!](#welcome-to-little-ml-book-club-we-are-reading-ml-books-and-papers-together)
  - [What we are reading](#what-we-are-reading)
    - [The Smol Training Playbook: The Secrets to Building World-Class LLMs](#the-smol-training-playbook-the-secrets-to-building-world-class-llms)
  - [What we have read in the past](#what-we-have-read-in-the-past)
    - [The Ultra-Scale Playbook](#the-ultra-scale-playbook)
    - [Agentic Design Patterns: A Hands-On Guide to Building Intelligent Systems](#agentic-design-patterns-a-hands-on-guide-to-building-intelligent-systems)

## What we are reading

### [The Smol Training Playbook: The Secrets to Building World-Class LLMs](https://huggingface.co/spaces/HuggingFaceTB/smol-training-playbook)

**Schedule:** every Tuesday, 18:00 (London time) - [Zoom](https://us06web.zoom.us/j/83386119027?pwd%3DC7HjrJsWlflDZaGroxoY2QfLqFn9Mq.1%26jst%3D2&sa=D&source=calendar&usd=2&usg=AOvVaw3ctXbbuT-SytJkANBcCsD9)

| Date | Topic | Presented by | Slides | Recording |
|------|-------|--------------|--------|-----------|
| 2 Apr, 2026 | Training Compass | @fxlrnrpt | [pdf](./smol_training_playbook/1_Training_Compass.pdf) | [youtube](https://youtu.be/Ly9kXopMVM0) |
| 9 Apr, 2026 | Every Big Model Starts with a Small Ablation | @fxlrnrpt | [pdf](./smol_training_playbook/2_Every_Big_Model_Starts_with_a_Small_Ablation.pdf) | [youtube](https://www.youtube.com/watch?v=yRg4peU1jmc) |
| 16 Apr, 2026 | Architecture: Attention | @fxlrnrpt | [pdf](./smol_training_playbook/3_Attention.pdf) | [youtube](https://youtu.be/1qgj7YqpPUY) |
| 28 Apr, 2026 | Architecture: Embedding Sharing, Intro to Positional Encoding | @fxlrnrpt | [pdf](smol_training_playbook/4_Embedding_Sharing.pdf) | [youtube](https://www.youtube.com/watch?v=hzOP6zxg61k)  |
| 12 May, 2026 | Positional Encoding Deep Dive and Long Context | @The0nix | [pdf](./smol_training_playbook/5_Positional_embeddings_long_context.pdf) | [youtube](https://youtu.be/biUZm-mqUDk) |
| 9 Jun, 2026 | Improving Stability, Additional Considerations, Architecture: MoE, Hybrid Models, Tokenizer | TBD | | |
| 23 Jun, 2026 | Optimizer and Training Hyperparameters | TBD | | |
| 30 Jun, 2026 | The Art of Data Curation | TBD | | |
| 7 Jul, 2026 | The Training Marathon | TBD | | |
| 14 Jul, 2026 | Post-Training Compass, Evals, Tools, SFT | TBD | | |
| 4 Aug, 2026 | Prefernce optimization, Going On-Policy and Beyond Supervised Labels | TBD | | |
| 11 Aug, 2026 | Infrastructure | TBD | | |

## What we have read in the past

### [The Ultra-Scale Playbook](https://huggingface.co/spaces/nanotron/ultrascale-playbook)

| Date | Topic | Presented by | Slides | Recording |
|------|-------|--------------|--------|-----------|
| 12 Feb, 2026 | Ch.9 Diving into the GPUs [fused kernels:] | @stalkermustang | [slides](https://miro.com/app/board/uXjVGBpO_hw=/?share_link_id=702720253576) | [recording](https://youtu.be/Pq1axxGFM1k) |
| 5 Feb, 2026 | Ch.9 Diving into the GPUs [:fused kernels] | @fxlrnrpt | [slides](./ultra_scale_playbook/little_ml_book_club_ultra_scale_playbook_ch9_diving_into_the_gpus_until_fused.pdf.pdf) | [recording](https://www.youtube.com/watch?v=h-M8Jq-yNDs) |
| 22 Jan, 2026 | Ch.8 Finding the Best Training Configuration | @fxlrnrpt | [slides](./ultra_scale_playbook/little_ml_book_club_ultra_scale_playbook_ch8_best_configuration.pdf) | [recording](https://youtu.be/nA4-SVU-J2Q) |
| 15 Jan, 2026 | Ch.7 5D Parallelism in a Nutshell | @fxlrnrpt | [slides](./ultra_scale_playbook/little_ml_book_club_ultra_scale_playbook_ch7_5D_parallelism.pdf) | [recording](https://www.youtube.com/watch?v=amHnk1T833M) |
| 18 Dec, 2025 | Ch.6 Expert Parallelism | @stalkermustang | [slides](https://miro.com/app/board/uXjVGZ0oBHg=/?share_link_id=999507213216) | [recording](https://youtu.be/NrncobFYSNU) |
| 11 Dec, 2025 | Ch.5 Pipeline Parallelism | @fxlrnrpt | [slides](./ultra_scale_playbook/little_ml_book_club_ultra_scale_playbook_ch5_pipeline_parallelism.pdf) | [recording](https://youtu.be/2XiiqaKNN7A) |
| 4 Dec, 2025 | Ch.4 Context Parallelism | @stalkermustang | [slides](https://miro.com/app/board/uXjVJgwADLc=/?share_link_id=523862753642) | [recording](https://youtu.be/o0EwPE1Kvds) |
| 27 Nov, 2025 | Ch.3.2 Sequence Parallelism | @fxlrnrpt | [slides](./ultra_scale_playbook/little_ml_book_club_ultra_scale_playbook_ch3_sequence_parallelism.pdf) | [recording](https://youtu.be/agvfEfoENnI) |
| 20 Nov, 2025 | Ch.3.1 Tensor Parallelism | @fxlrnrpt | [slides](./ultra_scale_playbook/little_ml_book_club_ultra_scale_playbook_ch3_tensor_parallelism.pdf) | [recording](https://youtu.be/tGt5Fsmc27E) |
| 13 Nov, 2025 | Ch.2.2 Model Parallelism \[ZERO:\] | @fxlrnrpt | [slides](./ultra_scale_playbook/little_ml_book_club_ultra_scale_playbook_ch2_data_parallelism_from_zero.pdf) | [recording](https://youtu.be/EmG0X4jlT-I) |
| 06 Nov, 2025 | Ch.2.1 Data Parallelism \[:ZERO\] | @fxlrnrpt | [slides](./ultra_scale_playbook/little_ml_book_club_ultra_scale_playbook_ch2_data_parallelism_until_zero.pdf) | [recording](https://youtu.be/rNOFnI8eb3w) |
| 30 Oct, 2025 | Ch.1 First Steps: Training on One GPU | @stalkermustang | [slides](./ultra_scale_playbook/little_ml_book_club_ultra_scale_playbook_ch1_first_steps_training_on_one_gpu.pdf) | [recording](https://www.youtube.com/watch?v=hkGYk0wYUho) |

### [Agentic Design Patterns: A Hands-On Guide to Building Intelligent Systems](https://github.com/sarwarbeing-ai/Agentic_Design_Patterns)

| Date | Topic | Presented by | Slides | Recording |
|------|-------|--------------|--------|-----------|
| 9 Feb, 2026 | Chapter 1: Prompt Chaining | @fxlrnrpt | [slides](agentic_design_patterns/ch1_prompt_engineering.pdf) | [recording](https://youtu.be/VuLqbxPjmfI) |
| 11 Feb, 2026 | Chapters 2-4: Routing, Parallelization, Reflection | @anyaepie | [slides](agentic_design_patterns/ch2-4_routing_parallelization_reflection.pdf) | [recording](https://youtu.be/vE_ppkPsn9k) |
| 13 Feb, 2026 | Chapters 5-7: Tool Use, Planning, Multi-Agent | @fxlrnrpt | [slides](agentic_design_patterns/ch5-7_tool_use_planning_multi_agent.pdf) | [recording](https://youtu.be/-P2hEWgyOpk) |
| 16 Feb, 2026 | Chapters 8-12: Memory Management, Learning and Adaptation, MCP, Goal Setting and Monitoring, Exception Handling and Recovery | @anyaepie | [slides](agentic_design_patterns/ch8-12.pdf) | [recording](https://youtu.be/IQSYdL9B4NQ) |
| 18 Feb, 2026 | Chapters 13-16, 18: Human-in-the-Loop, Guardrails/Safety Patterns, RAG, A2A, Resource-Aware Optimization | @julia-meshcheryakova, @fxlrnrpt | [slides1](agentic_design_patterns/ch13,17.pdf), [slides2](agentic_design_patterns/ch14-16.pdf) | [recording](https://youtu.be/zj8iqWv49Nw) |
| 20 Feb, 2026 | Chapters 19-20:  Evaluation and Monitoring, Prioritization,  | @AnCh7 | [slides](https://github.com/fxlrnrpt/little_ml_book_club/blob/main/agentic_design_patterns/ch19-20.pdf) | [recording](https://youtu.be/4ANR0ccYIMY) |
| 27 Feb, 2026 | Chapters 17, 21, Appendix | Reasoning Technique, Exploration and Discovery, Appendix | @fxlrnrpt | [slides](agentic_design_patterns/ch17,21,Appendix.pdf) | [recording](https://youtu.be/foX95KYV38I) |

little_ml_book_club

Explore Similar Repositories

Was this content helpful?

Recent Feedback

Download README