distributed-compute-operator

KO | EN

gitlite — search

#javascript #hacktoberfest #react #ai #typescript #llm #machine-learning #docker #java #cli #kubernetes #awesome-list #security #openai

distributed-compute-operator

(★ 14)

:robot: Kubernetes operator providing Ray|Spark|Dask|MPI clusters on-demand

distributed-compute-operator Latest Version Download

Download Latest Version (.zip)

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# IMPORTANT

This repository has now been archived.  No further work will be merged here.

# Distributed Compute Operator

Kubernetes operator providing Ray|Spark|Dask clusters on-demand via [Custom Resource Definitions][custom resources].

## Overview

TODO

## Installation

The easiest way to install DCO is to use the provided Helm chart.

### Prerequisites

Before you get started using the DCO, you need to have a running Kubernetes cluster.

- Access to a Kubernetes cluster version **1.16** or above. This version of the
  CRD API is stable and supports our required features.
- Install [helm] client version **3.0.0** or above.
- Install the [cert-manager] operator. DCO makes extensive use of [webhooks]
  which require TLS.

### Install

```shell
$ helm install distributed-compute-operator ./deploy/helm/distributed-compute-operator
```

## Development

The following instructions will help you create a local Kubernetes environment
that can be used to test every feature supported by this operator.

1. Install [minikube] and create a new cluster.

```shell
    # tested using minikube v1.17.1 and k8s v1.21.3
    $ minikube start \
        --cpus=6 --memory=16384 --driver=hyperkit \
        --extra-config=apiserver.enable-admission-plugins=PodSecurityPolicy \
        --addons=pod-security-policy
    ```

1. Install cert-manager
1. Install metrics-server
1. Launch operator

[custom resources]: https://kubernetes.io/docs/concepts/extend-kubernetes/api-extension/custom-resources/
[helm]: https://helm.sh/docs/intro/install/
[cert-manager]: https://cert-manager.io/docs/
[webhooks]: https://kubernetes.io/docs/reference/access-authn-authz/extensible-admission-controllers/
[minikube]: https://minikube.sigs.k8s.io/docs/

distributed-compute-operator

distributed-compute-operator Latest Version Download

Today's picks

Was this content helpful?

Recent Feedback

distributed-compute-operator

distributed-compute-operator Latest Version Download

Today's picks

Was this content helpful?

Recent Feedback

Download README