KO | EN

GitLite

Minimalist Open Source Repository Search Engine

gitlite — search

#dsh #dsh-plugin #ai-agent #developer-tools #codex #typescript #cli #deepseek-harness #claude-code #ai-agents #mcp #rust

ai-interview-codex

★ 491 Open GitHub ↗

Comprehensive ML/AI interview codex with iterative system design, production-ready code, and 2026 standards. Includes LLM/GenAI, RAG systems, agentic AI, and algorithms from scratch.

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# ML/AI Interview Preparation - Complete Guide

A comprehensive collection of machine learning and AI interview preparation materials, covering ML coding, system design, LLM/GenAI, and DSA.

## Repository Overview

This repository contains battle-tested interview preparation materials for ML/AI engineering roles, including:

- **Machine Learning**: Algorithms from scratch, coding problems, production ML systems
- **LLM/GenAI**: Production LLMs, RAG systems, embeddings, attention mechanisms
- **System Design**: Agentic AI systems, distributed ML, scalable architectures
- **DSA**: Data structures and algorithms for ML engineers
- **MLOps**: Production best practices, monitoring, deployment

## Quick Start

### For ML Coding Interviews
1. Start with [ML Coding Interview Master Guide](ml/ML-CODING-INTERVIEW-MASTER-GUIDE.md)
2. Practice with [ML Algorithms from Scratch](ml/ml-algorithms-from-scratch.ipynb)
3. Review [Neural Network Components](deep-learning/neural-network-components-from-scratch.ipynb)

### For System Design Interviews
1. Read [LLM/ML System Design Master Guide](gen-ai/LLM-ML-SYSTEM-DESIGN-MASTER-GUIDE.md)
2. Study iterative examples:
   - [Agentic AI Customer Support](agentic-ai/agentic-ai-iterative-interview.md)
   - [AI Code Review System](agentic-ai/code-review-ai-iterative-interview.md)
3. Study [Model Context Protocol (MCP)](agentic-ai/mcp-interview-preparation-guide.md) - Universal AI-tool integration standard
4. Review [System Design Examples](system-design/system-design-examples-enhanced.md)

### For LLM/GenAI Roles
1. Start with fundamentals:
   - [LLM Fundamentals Part 1: Tokenization & Context](gen-ai/llm-fundamentals-part1-tokenization-context.md)
   - [LLM Fundamentals Part 2: Inference & Optimization](gen-ai/llm-fundamentals-part2-inference-optimization.md)
2. [LLM Production Complete Guide](gen-ai/llm-production-complete-guide.md)
3. [Production RAG Systems](gen-ai/production-rag-systems-guide.md)
4. [Embedding Models Guide](gen-ai/embedding-models-comprehensive-guide.md)
5. [LoRA/QLoRA Fine-tuning](gen-ai/lora-qlora-finetuning-guide.ipynb)
6. **Model Context Protocol (MCP):**
   - [MCP Interview Preparation Guide](agentic-ai/mcp-interview-preparation-guide.md)
   - [MCP Hands-On Implementation](agentic-ai/mcp-hands-on-implementation.ipynb)
   - [MCP Enterprise Banking Use Case](agentic-ai/mcp-enterprise-banking-use-case.md)
   - [MCP Production Best Practices](agentic-ai/mcp-production-best-practices.md)

### For MLOps/Production ML
1. [MLOps Production Guide](ml/mlops-production-ml-guide.md)
2. [Feature Engineering Guide](ml/feature-engineering-guide.md)

## Complete Content Index

### Machine Learning Fundamentals

#### ML Coding & Algorithms
- **[ML Coding Interview Master Guide](ml/ML-CODING-INTERVIEW-MASTER-GUIDE.md)** - Complete guide to ML coding interviews
- **[ML Algorithms from Scratch](ml/ml-algorithms-from-scratch.ipynb)** - Implement core ML algorithms:
  - Linear Regression, Logistic Regression
  - Decision Trees, Random Forest
  - K-Means, KNN
  - Naive Bayes, SVM
  - Gradient Descent variants
- **[ML Coding Problems](ml/ml-coding-problems.ipynb)** - Practice problems with solutions

#### Decision Trees
- **[Decision Trees Complete Guide](ml/decision-trees-complete-guide.md)** - Complete guide to decision trees:
  - Tree construction algorithms (CART, ID3, C4.5)
  - Splitting criteria (Entropy, Gini, Information Gain)
  - Pruning techniques (pre-pruning, post-pruning)
  - Regression trees and variance reduction
  - Feature importance (MDI, permutation)
  - Tree visualization methods
  - Implementation from scratch
  - 25+ interview questions with answers

#### Ensemble Methods
- **[Bagging Ensemble Methods](ml/bagging-ensemble-methods-guide.md)** - Bootstrap Aggregating complete guide:
  - Bootstrap sampling, OOB error
  - Random Forest deep dive
  - Variance reduction mechanism
  - Implementation from scratch
  - 20+ interview questions with answers
- **[Boosting Ensemble Methods](ml/boosting-ensemble-methods-guide.md)** - Boosting algorithms complete guide:
  - AdaBoost, Gradient Boosting
  - XGBoost, LightGBM, CatBoost
  - Bias reduction mechanism
  - Algorithm comparison and when to use each
  - 25+ interview questions with answers

#### Production ML & MLOps
- **[MLOps Production Guide](ml/mlops-production-ml-guide.md)** - End-to-end ML in production:
  - Model versioning, experiment tracking
  - CI/CD for ML, model deployment
  - Monitoring, A/B testing
  - Data pipelines, feature stores
- **[Feature Engineering Guide](ml/feature-engineering-guide.md)** - Feature engineering techniques:
  - Numerical, categorical, text features
  - Time series, embeddings
  - Feature selection, dimensionality reduction

### Deep Learning & Neural Networks

- **[Neural Network Components](deep-learning/neural-network-components-from-scratch.ipynb)** - Build neural networks from scratch:
  - Dense layers, activation functions
  - Backpropagation, optimizers (SGD, Adam, RMSprop)
  - Batch normalization, dropout
  - CNN components
- **[Attention Mechanisms Guide](deep-learning/attention-mechanisms-comprehensive-guide.md)** - Deep dive into attention:
  - Self-attention, multi-head attention
  - Transformer architecture
  - Positional encoding
  - BERT, GPT architectures
- **[Transformer Architecture Complete Guide](deep-learning/transformer-architecture-complete-guide.md)** - Transformer fundamentals:
  - Encoder-only, Decoder-only, Encoder-Decoder
  - Pretraining & Post-training (SFT, RLHF, DPO, PPO)
  - Scaling laws

### LLM & Generative AI

#### LLM Fundamentals
- **[LLM Fundamentals Part 1: Tokenization & Context](gen-ai/llm-fundamentals-part1-tokenization-context.md)** - Core LLM concepts:
  - Tokenization (BPE, WordPiece, SentencePiece, Unigram)
  - Context windows and memory complexity
  - Positional encoding (Sinusoidal, RoPE, ALiBi)
  - Complete implementations with mermaid diagrams
- **[LLM Fundamentals Part 2: Inference & Optimization](gen-ai/llm-fundamentals-part2-inference-optimization.md)** - Advanced LLM concepts:
  - Inference strategies (greedy, beam search, sampling, temperature, top-k, top-p)
  - Evaluation metrics (perplexity, task-specific)
  - Model sizes and scaling laws (Chinchilla, Kaplan)
  - KV cache optimization (PagedAttention, quantization)
  - Speculative decoding (2-4× speedup)
  - Prompting techniques (zero-shot, few-shot, CoT, self-consistency)
- **[LLM Production Complete Guide](gen-ai/llm-production-complete-guide.md)** - Production LLMs:
  - Model selection, deployment strategies
  - Cost optimization, caching
  - Prompt engineering, fine-tuning
  - Evaluation metrics

#### Fine-tuning & Optimization
- **[LoRA/QLoRA Fine-tuning](gen-ai/lora-qlora-finetuning-guide.ipynb)** - Parameter-efficient fine-tuning:
  - LoRA, QLoRA concepts
  - Implementation examples
  - Quantization techniques
  - Memory optimization

#### RAG & Embeddings
- **[Production RAG Systems](gen-ai/production-rag-systems-guide.md)** - Building RAG systems:
  - Document chunking, indexing
  - Hybrid search, re-ranking
  - Evaluation (Ragas, TruLens)
  - Advanced RAG patterns
- **[Embedding Models Guide](gen-ai/embedding-models-comprehensive-guide.md)** - Embeddings in depth:
  - Model selection (OpenAI, Cohere, sentence-transformers)
  - Semantic search, clustering
  - Fine-tuning embeddings
  - Vector databases

### System Design

#### LLM/ML System Design
- **[LLM/ML System Design Master Guide](gen-ai/LLM-ML-SYSTEM-DESIGN-MASTER-GUIDE.md)** - Complete framework:
  - Interview approach (45-minute structure)
  - Key patterns (RAG, agents, fine-tuning)
  - Production considerations
  - Evaluation strategies

#### Iterative System Design Examples
- **[Agentic AI Customer Support](agentic-ai/agentic-ai-iterative-interview.md)** - Build from scratch:
  - 10 iterations: bare minimum → production
  - Multi-agent orchestration (LangGraph)
  - Memory & context management
  - Scale to 100K+ queries/day
  - Cost optimization ($5K → $220/day)
- **[AI Code Review System](agentic-ai/code-review-ai-iterative-interview.md)** - Iterative design:
  - 10 iterations: single LLM → production
  - RAG for codebase context
  - Multi-agent specialists (security, performance, bugs)
  - Learning from developer feedback
  - Scale to 500 PRs/day
- **[Agent Memory Architecture](agentic-ai/agent-memory-architecture-guide.md)** - Memory patterns:
  - 6 memory types (short-term, long-term, episodic, semantic, entity, procedural)
  - Hybrid memory architecture (4 layers)
  - Framework comparison (Anthropic, LangGraph, CrewAI, OpenAI Swarm)
  - Semantic caching (40-70% cost reduction)

#### Model Context Protocol (MCP)
- **[MCP Interview Preparation Guide](agentic-ai/mcp-interview-preparation-guide.md)** - Complete MCP interview prep:
  - MCP architecture and three core primitives
  - Client-Host-Server architecture patterns
  - Transport layers (stdio, HTTP+SSE)
  - Production deployment patterns
  - Security best practices (mTLS, authentication)
  - Industry adoption timeline
  - 10 comprehensive Q&A sections
  - 25+ mermaid diagrams
- **[MCP Hands-On Implementation](agentic-ai/mcp-hands-on-implementation.ipynb)** - Practical MCP coding:
  - Building MCP servers with custom tools
  - Implementing resource providers
  - Creating prompt templates
  - GitHub and database integration examples
  - Complete end-to-end projects
- **[MCP Enterprise Banking Use Case](agentic-ai/mcp-enterprise-banking-use-case.md)** - Real-world enterprise example:
  - Banking mainframe integration with cloud AI agents
  - Zero-trust security with data residency compliance
  - Tokenization, encryption, HSM integration
  - PCI-DSS, SOX, GDPR, GLBA compliance
  - Multi-agent orchestration for fraud detection
  - Complete ROI analysis (700% ROI)
- **[MCP Production Best Practices](agentic-ai/mcp-production-best-practices.md)** - Production deployment guide:
  - High-availability MCP server clusters
  - Multi-region deployment architecture
  - Serverless MCP on AWS Lambda
  - Security (mTLS, secrets management)
  - Monitoring and observability
  - Circuit breakers, retries, graceful degradation
  - Cost optimization strategies
  - Complete production checklist

#### Traditional System Design
- **[System Design Examples Enhanced](system-design/system-design-examples-enhanced.md)** - ML system designs:
  - Threat detection system
  - Semantic search
  - Network anomaly detection
  - Complete with architecture diagrams

### Data Structures & Algorithms

#### DSA Learning Plan
- **[DSA Learning Plan](dsa/dsa-learning-plan.md)** - 6-day crash course
- **Day 1**: [Arrays & Searching](dsa/dsa-day1-arrays-searching.md)
- **Day 2**: [Sorting Algorithms](dsa/dsa-day2-sorting.md)
- **Day 3**: [Two Pointers](dsa/dsa-day3-two-pointers.md)
- **Day 4**: [Recursion & Backtracking](dsa/dsa-day4-recursion.md)
- **Day 5**: [Hash Maps & Sets](dsa/dsa-day5-hashmaps.md)
- **Day 6**: [Practice Problems](dsa/dsa-day6-practice.md)
- **Bonus**: [Advanced Patterns](dsa/dsa-bonus-patterns.md)

### Interview Preparation Resources

- **[Interview Prep Complete Index](INTERVIEW-PREP-COMPLETE-INDEX.md)** - Master index
- **[Master Study Schedule](MASTER-STUDY-SCHEDULE.md)** - Week-by-week plan
- **[Notebook Guide](NOTEBOOK-GUIDE.md)** - How to use Jupyter notebooks
- **[Questions for Interviewers](questions-for-interviewers.md)** - Smart questions to ask
- **[Technical Cheatsheet](technical-cheatsheet.md)** - Quick reference
- **[Leadership Stories Template](leadership-stories-template.md)** - STAR method examples

### Related Learning Series

- **[LangChain Learning Series](https://github.com/girijesh-ai/langchain-learning-series)** - Comprehensive 8-module course on LangChain from fundamentals to production deployment (separate repository)

## Study Plans

### 4-Week Complete Preparation
**Week 1: ML Fundamentals**
- Days 1-3: ML algorithms from scratch
- Days 4-5: Neural network components
- Days 6-7: ML coding problems

**Week 2: LLM/GenAI**
- Days 1-2: LLM fundamentals (tokenization, context, inference)
- Days 3-4: LLM production guide
- Days 5: RAG systems
- Days 6: Embeddings & attention
- Day 7: Fine-tuning (LoRA/QLoRA)

**Week 3: System Design**
- Days 1-2: System design framework
- Days 3-4: Agentic AI examples (iterative)
- Days 5-6: Traditional system design
- Day 7: Practice mock interviews

**Week 4: DSA + Review**
- Days 1-6: DSA crash course (one topic per day)
- Day 7: Full mock interview

### 2-Week Crash Course
**Week 1: ML + LLM**
- Days 1-2: ML coding essentials
- Days 3: LLM fundamentals (tokenization, context, inference)
- Days 4-5: LLM production basics
- Day 6: RAG systems
- Day 7: System design framework

**Week 2: System Design + DSA**
- Days 1-3: System design examples
- Days 4-6: DSA essentials
- Day 7: Mock interviews

## Key Features

### Iterative System Design Approach
Unlike traditional system design resources, this repo uses an **iterative interview approach**:
- Start with bare minimum (10 lines of code)
- Add complexity step-by-step (10 iterations)
- Discuss tradeoffs at each step
- Show production evolution (cost, scale, monitoring)

**Example**: Agentic AI system goes from:
- Iteration 1: Single LLM ($5/query)
- → Iteration 7: Model routing + caching ($0.0022/query)
- 2,272x cost reduction with detailed reasoning at each step!

### Code + Theory
- Not just theory - working code for everything
- Jupyter notebooks with runnable examples
- Production-ready patterns and architectures
- Real-world tradeoffs and cost calculations

### 2025 Interview Standards
- Based on latest industry practices (2025)
- MLCommons ARES evaluation standards
- Anthropic, LangGraph, CrewAI best practices
- Production metrics (cost, latency, accuracy)

## What Makes This Unique

1. **Iterative System Design**: See exactly how to build systems step-by-step in interviews
2. **Production Focus**: Real costs, metrics, tradeoffs (not just toy examples)
3. **Complete Code**: Every algorithm, system, and pattern has working code
4. **Modern Tech Stack**: LangGraph, RAG, LoRA/QLoRA, agentic AI (2025 standards)
5. **Interview-Optimized**: 45-minute format, STAR stories, questions to ask

## Target Audience

This repo is perfect for:
- **ML Engineers** preparing for senior roles
- **Software Engineers** transitioning to ML/AI
- **Data Scientists** moving to ML engineering
- **AI Researchers** preparing for industry interviews
- **Engineering Managers** in ML/AI domains

## How to Use This Repository

### For Beginners
1. Start with [Master Study Schedule](MASTER-STUDY-SCHEDULE.md)
2. Follow the 4-week complete preparation plan
3. Work through notebooks in order
4. Practice with coding problems

### For Experienced Engineers
1. Skim [Interview Prep Complete Index](INTERVIEW-PREP-COMPLETE-INDEX.md)
2. Focus on weak areas (ML coding, system design, or LLM)
3. Study iterative system design examples
4. Practice with full mock interviews

### For Specific Roles
- **LLM Engineer**: Focus on LLM production guide, RAG systems, fine-tuning
- **ML Engineer**: Focus on ML algorithms, production ML, MLOps
- **ML Architect**: Focus on system design, iterative examples
- **Research Engineer**: Focus on attention mechanisms, algorithms from scratch

## Contributing

This is a personal interview preparation repository made public to help others. Contributions are welcome!

**Ways to contribute:**
- Fix errors or improve explanations
- Add new examples or problems
- Share interview experiences
- Suggest additional topics

## License

This repository is provided for educational purposes. Feel free to use, modify, and share with attribution.

## Acknowledgments

This repository was created through iterative learning and preparation for ML/AI engineering roles. Special thanks to the ML/AI community for open-source resources and shared knowledge.

## Questions?

If you find this helpful or have suggestions, feel free to open an issue or start a discussion!

---

**Star this repo if you find it helpful!**

**Good luck with your interviews!**

ai-interview-codex

Explore Similar Repositories

Was this content helpful?

Recent Feedback

Download README