KO | EN

GitLite

Minimalist Open Source Repository Search Engine

gitlite — search

#dsh #dsh-plugin #codex #typescript #developer-tools #ai-agents #deepseek-harness #claude-code #ai-agent #cli #react #mcp

metaflow-transformers-tutorials

★ 67 Open GitHub ↗

Metaflow tutorials for ODSC West 2021

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

First, get started with Metaflow by executing these simple flows:

1. `helloworld.py` - a simple hello world flow
2. `counter_branch.py` - test artifacts
3. `parameters.py` - test parameters
4. `foreach.py` - test foreaches (parallel tasks)

After these simple examples, you can take a look at a more realistic case:

In this tutorial, we'll fine-tune a sentiment analysis model on top of
HuggingFace's DistilBERT model with the IMDB dataset.

First, we'll show how to do it without Metaflow.
1. sent_analysis_train.py is the training code (6-7 minutes on the small dataset of 100 samples on my Mac)
2. sent_analysis_predict.py is the prediction code (30 seconds)

We'll do live coding to show how to convert the training code to Metaflow.
See sent_analysis_metaflow.py for instructions.

We'll run `python sent_analysis_metaflow.py --no-pylint run --mode small`
to train a model on 100 samples locally.

We'll show how Metaflow automatically saves trained models which we can access for predictions.

We'll use @batch to train the full dataset (40,000 samples) on AWS.
We'll need GPU since it'll take a while for the full data on CPU.

metaflow-transformers-tutorials

Explore Similar Repositories

Was this content helpful?

Recent Feedback

Download README