flokkr-runtime-kubernetes

KO | EN

gitlite — search

#react #llm #go #golang #machine-learning #docker #macos #windows #awesome #cli #vue #awesome-list #ios #mcp

flokkr-runtime-kubernetes

(★ 12)

Examples to run Hadoop/Spark cluster with kubernetes.

flokkr-runtime-kubernetes Latest Version Download

Download Latest Version (.zip)

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# !Archived!

__This project is archived. Originally it was part of the https://github.com/flokkr project, but it's no longer maintained.__

# Hadoop cluster on kubernetes

Example kubernetes definition for the [flokkr](https://github.com/flokkr/flokkr) docker images.

## Attributes
| Topic                                    | Solution                                 |
| ---------------------------------------- | ---------------------------------------- |
| __Configuration management__             |                                          |
| Source of config files:                  | Kubernetes configuration object.         |
| Configuration preprocessing:             | No.                                      |
| Automatic restart on config change:      | No.                                      |
| __Provisioning and scheduling__          |                                          |
| Multihost support                        | Yes.                                     |
| Requirements on the hosts                | Full kubernetes cluster.                 |
| Definition of the containers per host    | Kubernetes resource definition.          |
| Scheduling (find hosts with available resource) | Yes. But because the kubernetes limitations, only Stateful Sets are used. |
| Failover on host crash                   | Yes                                      |
| Scale up/down:                           | Yes, with kubernetes.                    |
| Multi tenancy (multiple cluster)         | Yes.                                     |
| __Network__                              |                                          |
| Network between containers               | Kubernetes network.                      |
| DNS                                      | Yes, kubedns based.                      |
| Service discovery                        | Based on dns.                            |
| Data locality                            | N/A                                      |
| Availability of the ports                | Ingress definition is needed.            |

## Getting started

You need a kubernetes cluster. The easiest way is just using a provider (eg. GCE)

### Configuration

Upload the predefined configuration with:

```
kubectl apply -f config.yaml
```

### HDFS/YARN cluster

```
kubectl apply -f hdfs.yaml

```

flokkr-runtime-kubernetes

flokkr-runtime-kubernetes Latest Version Download

Today's picks

Was this content helpful?

Recent Feedback

flokkr-runtime-kubernetes

flokkr-runtime-kubernetes Latest Version Download

Today's picks

Was this content helpful?

Recent Feedback

Download README