MSBA6461-Advanced-AI

KO | EN

gitlite — search

#python #java #python3 #arduino #golang #machine-learning #rust #html #flask #javascript #seismology #nodejs

MSBA6461-Advanced-AI

★ 19 Open GitHub ↗

Teaching Materials for MSBA 6461: Advanced AI for NLP

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# MSBA6461-Advanced-AI

This repository contains lecture materials for MSBA 6461: Advanced AI for Natural Language Processing. It will be updated regularly as new materials are added. The most recent iteration of the course is Spring 2024.

**Important Change**: As a result of the overall MSBA curiculum revision, the course has been renamed to "Advanced AI for Natural Language Processing" (previously "Advanced AI for Business Applications"). The course content has also been updated to reflect the new design. Specifically, all reinforcement learning materials have been moved to a folder named ```RL``` and will not be covered in the course. The new course will focus on NLP and language models.

## Topics Covered in this Course

Below is a list of topics covered in each notebook.

1. **Text Preprocessing and Representation Learning** (Notebook 1)
   - Introduction to Natural Language Processing
   - Basic Text Pre-Processing
   - Bag-of-Words Representation
   - Word Embeddings (Skip Gram and Continuous Bag-of-Words)
2. **RNN for Text Classification** (Notebook 2)
   - Recurrent Neural Networks (RNN)
   - Long-Term Dependency Problem
   - LSTM and GRU
   - Bidirectional RNN
3. **Sequence to Sequence Model** (Notebook 3)
   - The Encoder-Decoder Architecture
4. **Attention, Transformer, and LLMs** (Notebook 4)
   - Attention Mechanism
5. **Transformer** (Notebook 5)
   - Introduction to Transformer Architecture
   - Transformer Implementation with in ```pytorch```
6. **Large Language Model** (Notebook 6)
   - Overview of popular architectures and training processes
   - Illustration of auto-regressive decoding
   - KV Cache

In addition to the notebooks,
   - The ```data``` folder contains all the data used in the notebooks.
   - The ```pytorch``` folder contains the pytorch implementation for NLP-related demonstrations.
   - The ```.vscode``` folder contains display settings for VSCode.
   - The ```RL``` folder contains reinforcement learning materials that were previously covered in the course.

## Software Setup

Other than Jupyter Notebook and Python, this course makes use of several machine learning / deep learning packages. I recommend creating a Python environment and install the packages specified in the ```requirement.txt``` file.

MSBA6461-Advanced-AI

Explore Similar Repositories

Was this content helpful?

Recent Feedback

Download README