RayOrch

KO | EN

gitlite — search

#python #react #typescript #go #machine-learning #rust #linux #macos #java #awesome #kubernetes #vue #security #pytorch

(★ 9)

A flexible framework for orchestrating deep learning models with Ray . It dynamically schedules and serves multiple models — from NLP (e.g., FastText) to CV (e.g., YOLO, SAM) — enabling scalable, distributed, and efficient multi-model inference.

RayOrch 최신버젼 다운로드

최종 버전 다운로드 (.zip)

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# RayOrch

Lightweight orchestration utilities for building asynchronous Ray pipelines with
`RayModule`, overlapped microbatch execution, and DAG-style scheduling.

## Install

```bash
pip install rayorch
```

For development:

```bash
pip install -r requirements-dev.txt
```

## Core Concepts

- `RayModule`: wraps an operator class into Ray actors with optional replica
  dispatch and collect.
- `OverlappedPipeline`: graphless microbatch overlap with backpressure.
- `DagPipeline` / `DagPipelineExecutor`: explicit dependency DAG scheduling.

## Minimal Example

```python
from rayorch import OverlappedPipeline, RayModule

class AddOne:
    def run(self, x):
        return x + 1

class Pipe(OverlappedPipeline):
    def __init__(self):
        self.a = RayModule(AddOne, replicas=1).pre_init()
        self.b = RayModule(AddOne, replicas=1).pre_init()
        super().__init__(max_inflight=4)

def forward(self, x):
        return self.b(self.a(x))

pipe = Pipe()
print(pipe([1, 2, 3]))  # [3, 4, 5]
```

## License

Apache-2.0. See `LICENSE`.

RayOrch

RayOrch 최신버젼 다운로드

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

RayOrch

RayOrch 최신버젼 다운로드

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

Download README