llmflow

KO | EN

gitlite — search

#python #hacktoberfest #react #ai #llm #golang #android #rust #deep-learning #kubernetes #awesome-list #security #pytorch #open-source

(★ 21)

Orchestration engine & UI for your customized LLM flow.

llmflow Latest Version Download

Download Latest Version (.zip)

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# LLMFlow

[![Go Reference](https://pkg.go.dev/badge/go-aie/llmflow/vulndb.svg)][1]

Orchestration engine & UI for your customized LLM flow.

![LLMFlow](https://raw.githubusercontent.com/go-aie/llmflow/main/llmflow-ui-screenshot.png)

## Installation

```bash
go install github.com/go-aie/llmflow/cmd/llmflow@latest
```

## Quick Start

Run the basic flow:

```bash
OPENAI_API_KEY=<YOUR_API_KEY> llmflow run examples/basic.flow.yaml
```

## Start LLMFlow

### API

Start LLMFlow:

```bash
OPENAI_API_KEY=<YOUR_API_KEY> llmflow serve
```

Add the basic flow (in YAML format):

```bash
curl -XPUT -H 'Content-Type: application/yaml' 'http://127.0.0.1:8888/api/flows/basic' --data-binary @examples/basic.flow.yaml
```

Or add the basic flow (in JSON format):

```bash
curl -XPUT -H 'Content-Type: application/json' 'http://127.0.0.1:8888/api/flows/basic' -d @examples/basic.flow.json
```

Execute the basic flow:

```bash
curl -XPOST -H 'Content-Type: application/json' 'http://127.0.0.1:8888/api/flows/basic:run' -d '{"query":"colorful socks"}'
```

> **NOTE**:
> 
> - Setting environment variables is not mandatory when running LLMFlow in this example.
> - As an alternative, you can change `api_key` to your API key in [basic.flow.yaml](examples/basic.flow.yaml) (see [UI](#ui)), and then run `llmflow` instead.

### UI

Open LLMFlow UI through your browser: http://127.0.0.1:8888.

Then click the `Open` button and select [basic.flow.yaml](examples/basic.flow.yaml) to view it in the UI.

## Tasks & Flows

In addition to [Orchestrator's built-in tasks][2], LLMFlow defines the following tasks and flows:

- Tasks
      + [JSONLinesLoader](loader.go#L40-L181)
      + [Splitter](splitter.go)
      + [Template](template.go)
      + [TextLoader](loader.go#L208-L244)
      + [VectorStore_Delete](vectorstore/vectorstore_delete.go)
      + [VectorStore_Query](vectorstore/vectorstore_query.go)
      + [VectorStore_Upsert](vectorstore/vectorstore_upsert.go)

- Flows
      + [Embedding_OpenAI](embedding/embedding_openai.flow.json)
      + [Embedding_Azure_OpenAI](embedding/embedding_azure_openai.flow.json)
      + [LLM_OpenAI](llm/llm_openai.flow.json)
      + [LLM_Azure_OpenAI](llm/llm_azure_openai.flow.json)
      + [LLM_Ollama](llm/llm_ollama.flow.json)
      + [xHTTP](tool/xhttp.flow.json)
      + [Bing_Search](tool/bing_search.flow.json)

## Examples

- [Basic](examples/basic.flow.yaml)
- Document Question Answering
    + [Feed](examples/docqa_feed.flow.yaml)
    + [Query](examples/docqa_query.flow.yaml)
- FAQ-based Question Answering
    + [Feed](examples/faq_feed.flow.yaml)
    + [Query](examples/faq_query.flow.yaml)
- [Table Question Answering](examples/tableqa.flow.yaml) (*requires [TableQA][3]*)
- Table & Document Question Answering (*requires [TableQA][3]*)
    + [Feed](examples/tableqa_docqa_feed.flow.yaml)
    + [Query](examples/tableqa_docqa_query.flow.yaml)
- [Tool Call](examples/tool_call.flow.yaml)
- [Perplexity](examples/perplexity)

## Documentation

Check out the [documentation][1].

## License

[Apache License 2.0](LICENSE)

[1]: https://pkg.go.dev/github.com/go-aie/llmflow
[2]: https://github.com/RussellLuo/orchestrator#task
[3]: https://github.com/go-aie/tableqa

llmflow

llmflow Latest Version Download

Today's picks

Was this content helpful?

Recent Feedback

llmflow

llmflow Latest Version Download

Today's picks

Was this content helpful?

Recent Feedback

Download README