eks-kubeflow-workshop - GitLite

KO | EN

gitlite — search

#javascript #python #hacktoberfest #ai #llm #go #golang #docker #nodejs #windows #cli #vue #mcp #openai

eks-kubeflow-workshop

(★ 100)

Kubeflow workshop on EKS. Mainly focus on AWS integration examples. Please go check kubeflow website http://kubeflow.org for other examples

File Explorer

Download Latest Version (.zip)

- - bug_report.md
  - feature_request.md
- cluster.md
- kubeflow.md
- lab.md
- notebook-server.md
- post-install.md
- sagemaker-kf-notebook-efs-share-setup.md
- troubleshoot.md
- uninstall.md
- - 01_01_Notebook_Development.ipynb
  - 01_02_Notebook_Development_Fairing.ipynb
  - 01_03_Notebook_Development_Pipeline.ipynb
  - README.md
  - workspace_volume.png
- - 02_01_fairing_introduction.ipynb
  - 02_02_fairing_job_backend.ipynb
  - 02_03_fairing_distributed_training.ipynb
  - 02_04_fairing_kaniko_cloud_builder.ipynb
  - 02_05_fairing_resource.ipynb
  - 02_06_fairing_e2e.ipynb
  - distributed_training.py
  - README.md
  - requirements.txt
  - train.ipynb
  - train.py
- - 03_01_Distributed_Training_ParameterServer.ipynb
  - 03_02_Distributed_Training_MPI_Horovod.ipynb
  - distributed_training.md
- - 04_01_TensorFlow_Data_Validation.ipynb
  - 04_02_TensorFlow_Transform.ipynb
  - 04_03_TensorFlow_Advanced_Transform.ipynb
  - 04_04_TensorFlow_Model_Analysis.ipynb
  - 04_05_TensorFlow_Serving.ipynb
- - 05_01_Pipeline_SDK.ipynb
  - 05_02_Pipeline_lightweight.ipynb
  - 05_03_Pipeline_mnist.ipynb
  - 05_04_Pipeline_SageMaker.ipynb
  - 05_05_Pipeline_EMR.ipynb
  - mnist-classification-pipeline.tar.gz
- - 06_01_Seldon_Core_Serving.ipynb
  - 06_02_Kfserving.ipynb
  - kfserving-flowers-canary.yaml
  - kfserving-flowers-input.json
  - kfserving-flowers.yaml
  - README.md
  - seldon.yaml
  - seldon_canary.yaml
  - seldon_gateway.yaml
- - 07_01_Metadata.ipynb
  - 07_02_MLFlow.ipynb
- - 08_01_Hyper_Parameter_Tuning.ipynb
  - 08_02_Neural_Architecture_Search.ipynb
  - 08_03_Kubeflow_Jobs.ipynb
  - bayesopt-example.yaml
  - grid-example.yaml
  - hyperband-example.yaml
  - nasjob-example-RL.yaml
  - pytorchjob-example.yaml
  - random-search-example.yaml
  - README.md
  - tfjob-example.yaml
- - 09_01_Iris_Pipeline_Monitoring.ipynb
  - 09_02_Iris_Pipeline_Metrics.ipynb
  - README.md
- - README.md
- 01_notebook_test.py
- README.md
.gitignore
CODE_OF_CONDUCT.md
CONTRIBUTING.md
LICENSE
NOTICE
OWNERS
prow_config.yaml
README.md

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

## Kubeflow Workshop on EKS

This repo is a Kubeflow Workshop on EKS and it will covers most of the cutting edge components in Kubeflow. The Lab is designed for native AWS and it will leverage a few AWS services like ECR, S3, EFS, FSX for Lustre, Cognito, Certificate Manager, etc.

## Prerequisites

* Install [kubectl](https://kubernetes.io/docs/tasks/tools/install-kubectl/#install-kubectl)
* Install and configure the AWS Command Line Interface (AWS CLI):
    * Install the [AWS Command Line Interface](https://docs.aws.amazon.com/cli/latest/userguide/cli-chap-install.html).
    * Configure the AWS CLI by running the following command: `aws configure`.
    * Enter your Access Keys ([Access Key ID and Secret Access Key](https://docs.aws.amazon.com/general/latest/gr/aws-sec-cred-types.html#access-keys-and-secret-access-keys)).
    * Enter your preferred AWS Region and default output options.
* Install [aws-iam-authenticator](https://docs.aws.amazon.com/eks/latest/userguide/install-aws-iam-authenticator.html).
* Install [eksctl](https://github.com/weaveworks/eksctl) (version 0.1.31 or newer)

## Setups

1. [Create an EKS cluster](docs/cluster.md) or bring your own EKS cluster.
2. [Setup up Kubeflow](docs/kubeflow.md)
3. [Set up Notebook Server](docs/notebook-server.md)
4. [Post Installation](docs/post-install.md)

## Labs
- [Model Development in Jupyter Notebook](notebooks/01_Jupyter_Notebook)
- [Fairing](notebooks/02_Fairing)
- [Distributed Training](notebooks/03_Distributed_Training)
- [Tensorflow Extended](notebooks/04_Tensorflow_Extended)
- [Kubeflow Pipeline](notebooks/05_Kubeflow_Pipeline)
- [Serving](notebooks/06_Serving)
- [Experiment Tracking](notebooks/07_Experiment_Tracking)
- [HyperParameter Tuning](notebooks/08_Hyperparameter_Tuning)
- [Monitoring](notebooks/09_Monitoring)
- Logs

## Clean up
3. [Uninstall Kubeflow](docs/uninstall.md)

## Contributing Guidelines

Thank you for your interest in contributing to our project. Whether it's a bug report, new feature, correction, or additional documentation, we greatly value feedback and contributions from our community.

Please read through this document before submitting any issues or pull requests to ensure we have all the necessary information to effectively respond to your bug report or contribution.

## Code of Conduct

This project has adopted the [Amazon Open Source Code of Conduct](https://aws.github.io/code-of-conduct).
For more information see the [Code of Conduct FAQ](https://aws.github.io/code-of-conduct-faq) or contact
opensource-codeofconduct@amazon.com with any additional questions or comments.

## Security issue notifications

If you discover a potential security issue in this project we ask that you notify AWS/Amazon Security via our [vulnerability reporting page](http://aws.amazon.com/security/vulnerability-reporting/). Please do **not** create a public github issue.

## Licensing

See the [LICENSE](https://github.com/aws-samples/eks-kubeflow-workshop/blob/master/LICENSE) file for our project's licensing. We will ask you to confirm the licensing of your contribution.