TaskingAI

KO | EN

gitlite — search

#hacktoberfest #llm #go #golang #machine-learning #linux #docker #macos #awesome #vue #security #mcp #ios #open-source

(★ 5,398)

The open source platform for AI-native application development.

File Explorer

Download Latest Version (.zip)

- - bug_report.md
  - feature_request.md
- - check-typo.yml
  - deploy-backend.yml
  - deploy-frontend.yml
  - deploy-inference.yml
  - deploy-plugin.yml
  - release-backend.yml
  - release-frontend.yml
  - release-inference.yml
  - release-plugin.yml
  - test-backend.yml
  - test-frontend.yml
  - test-inference.yml
  - test-plugin.yml
- CODE_OF_CONDUCT.md
- PULL_REQUEST_TEMPLATE.md
- - __init__.py
  - config.py
  - fastapi_app.py
  - main.py
- - __init__.py
- - __init__.py
- .dockerignore
- .env.example
- .gitignore
- Dockerfile
- pytest.ini
- requirements.txt
- run_api_test.sh
- run_web_test.sh
- test_requirements.txt
- .env.example
- architecture.png
- docker-compose.yml
- README.md
- - LOGO2.svg
- - App.scss
  - App.tsx
  - index.scss
  - main.tsx
  - vite-env.d.ts
- Dockerfile
- index.html
- package-lock.json
- package.json
- svg.d.ts
- tsconfig.json
- tsconfig.node.json
- vite.config.ts
- yarn.lock
- README.de.md
- README.es.md
- README.fr.md
- README.jp.md
- README.kr.md
- README.pt.md
- README.zh-cn.md
- README.zh-tw.md
- - __init__.py
  - fastapi_app.py
  - main.py
- - __init__.py
  - chat_completion.py
  - rerank.py
  - text_embedding.py
- - __init__.py
- - credential_health_check.py
- - __init__.py
  - pytest.ini
  - run_full_test.sh
  - run_test.sh
  - setting.py
  - test_chat_completion.py
  - test_others.py
  - test_rerank.py
  - test_text_embedding.py
  - test_validation.py
- .env.example
- .gitignore
- .pre-commit-config.yaml
- config.py
- Dockerfile
- README.md
- requirements.txt
- - __init__.py
  - fastapi_app.py
  - main.py
  - utils.py
- - __init__.py
- - __init__.py
- - __init__.py
  - pytest.ini
  - run_full_test.sh
  - run_local_test.sh
  - run_s3_with_test.sh
  - run_s3_without_test.sh
  - run_test.sh
  - test_execute.py
  - test_plugins.py
- .env.example
- .gitignore
- .pre-commit-config.yaml
- config.py
- Dockerfile
- README.md
- requirements.txt
- - console.png
  - logo.png
  - model_providers.png
  - plugins.png
  - star.gif
.gitignore
.pre-commit-config.yaml
.typos.toml
CONTRIBUTING.md
DEVELOPERS.md
LICENSE
README.md

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# TaskingAI

[TaskingAI](https://www.tasking.ai) is a BaaS (Backend as a Service) platform for **LLM-based Agent Development and Deployment**. It unified the integration of hundreds of LLM models, and provides an intuitive user interface for managing your LLM application's functional modules, including tools, RAG systems, assistants, conversation history, and more.

### Key Features

1. **All-In-One LLM Platform**: Access hundreds of AI models with unified APIs.
2. **Abundant enhancement**: Enhance LLM agent performance with hundreds of customizable built-in **tools** and advanced **Retrieval-Augmented Generation** (RAG) system
3. **BaaS-Inspired Workflow**: Separate AI logic (server-side) from product development (client-side), offering a clear pathway from console-based prototyping to scalable solutions using RESTful APIs and client SDKs.
4. **One-Click to Production**: Deploy your AI agents with a single click to production stage, and scale them with ease. Let TaskingAI handle the rest.
5. **Asynchronous Efficiency**: Harness Python FastAPI's asynchronous features for high-performance, concurrent computation, enhancing the responsiveness and scalability of the applications.
6. **Intuitive UI Console**: Simplifies project management and allows in-console workflow testing.

### Integrations

**Models**: TaskingAI connects with hundreds of LLMs from various providers, including OpenAI, Anthropic, and more. We also allow users to integrate local host models through Ollama, LM Studio and Local AI.

**Plugins**: TaskingAI supports a wide range of built-in plugins to empower your AI agents, including Google search, website reader, stock market retrieval, and more. Users can also create custom tools to meet their specific needs.

---

## Why TaskingAI?

### Problems with existing solutions 🙁

**LangChain** is a tool framework for LLM application development, but it faces practical limitations:

- **Statelessness**: Relies on client-side or external services for data management.
- **Scalability Challenges**: Statelessness impacts consistent data handling across sessions.
- **External Dependencies**: Depends on outside resources like model SDKs and vector storage.

**OpenAI's Assistant API** excels in delivering GPTs-like functionalities but comes with its own constraints:

- **Tied Functionalities**: Integrations like tools and retrievals are tied to each assistant, not suitable for multi-tenant applications.
- **Proprietary Limitations**: Restricted to OpenAI models, unsuitable for diverse needs.
- **Customization Limits**: Users cannot customize agent configuration such as memory and retrieval system.

### How TaskingAI solves the problem 😃

- **Supports both stateful and stateless usages**: Whether to keep track of and manage the message histories and agent conversation sessions, or just make stateless chat completion requests, TaskingAI has them both covered.
- **Decoupled modular management**: Decoupled the management of tools, RAGs systems, language models from the agent. And allows free combination of these modules to build a powerful AI agent.
- **Multi-tenant support**: TaskingAI supports fast deployment after development, and can be used in multi-tenant scenarios. No need to worry about the cloud services, just focus on the AI agent development.
- **Unified API**: TaskingAI provides unified APIs for all the modules, including tools, RAGs systems, language models, and more. Super easy to manage and change the AI agent's configurations.

## What Can You Build with TaskingAI?

- [x] **Interactive Application Demos**
- [x] **AI Agents for Enterprise Productivity**
- [x] **Multi-Tenant AI-Native Applications for Business**

---

Please give us a **FREE STAR 🌟** if you find it helpful 😇

---

## Quickstart with Docker

A simple way to initiate self-hosted TaskingAI community edition is through [Docker](https://www.docker.com/).

### Prerequisites

- Docker and Docker Compose installed on your machine.
- Git installed for cloning the repository.
- Python environment (above Python 3.8) for running the client SDK.

### Installation

First, clone the TaskingAI (community edition) repository from GitHub.

```bash
git clone https://github.com/taskingai/taskingai.git
cd taskingai
```

Inside the cloned repository, go to the docker directory.

```bash
cd docker
```

1. **Copy `.env.example` to `.env`**:

```sh
   cp .env.example .env
   ```

2. **Edit the `.env` file**:
   Open the `.env` file in your favorite text editor and update the necessary configurations. Ensure all required environment variables are set correctly.

3. **Start Docker Compose**:
   Run the following command to start all services:
   ```sh
   docker-compose -p taskingai --env-file .env up -d
   ```

Once the service is up, access the TaskingAI console through your browser with the URL http://localhost:8080. The default username and password are `admin` and `TaskingAI321`.

### Upgrade

If you have already installed TaskingAI with a previous version and want to upgrade to the latest version, first update the repository.

```bash
git pull origin master
```

Then stop the current docker service, upgrade to the latest version by pulling the latest image, and finally restart the service.

```bash
cd docker
docker-compose -p taskingai down
docker-compose -p taskingai pull
docker-compose -p taskingai --env-file .env up -d
```

Don't worry about data loss; your data will be automatically migrated to the latest version schema if needed.

### TaskingAI UI Console

[![TaskingAI Console Demo](https://img.youtube.com/vi/4A5uQoawETU/maxresdefault.jpg)](https://youtu.be/4A5uQoawETU)
**_Click the image above to view the TaskingAI Console Demo Video._**

### TaskingAI Client SDK

Once the console is up, you can programmatically interact with the TaskingAI server using the TaskingAI client SDK.

Ensure you have Python 3.8 or above installed, and set up a virtual environment (optional but recommended).
Install the TaskingAI Python client SDK using pip.

```bash
pip install taskingai
```

Here is a client code example:

```python
import taskingai

taskingai.init(api_key='YOUR_API_KEY', host='http://localhost:8080')

# Create a new assistant
assistant = taskingai.assistant.create_assistant(
    model_id="YOUR_MODEL_ID",
    memory="naive",
)

# Create a new chat
chat = taskingai.assistant.create_chat(
    assistant_id=assistant.assistant_id,
)

# Send a user message
taskingai.assistant.create_message(
    assistant_id=assistant.assistant_id,
    chat_id=chat.chat_id,
    text="Hello!",
)

# generate assistant response
assistant_message = taskingai.assistant.generate_message(
    assistant_id=assistant.assistant_id,
    chat_id=chat.chat_id,
)

print(assistant_message)
```

Note that the `YOUR_API_KEY` and `YOUR_MODEL_ID` should be replaced with the actual API key and chat completion model ID you created in the console.

You can learn more in the [documentation](https://docs.tasking.ai/docs/guide/getting_started/self_hosting/overview).

## Resources

- [Documentation](https://docs.tasking.ai)
- [API Reference](https://docs.tasking.ai/api)
- [Contact Us](https://www.tasking.ai/contact-us)

## Community and Contribution

Please see our [contribution guidelines](./CONTRIBUTING.md) for how to contribute to the project.

Also, we’re excited to announce that TaskingAI now has an official Discord community! 🎊

[Join our Discord server](https://discord.gg/RqwcD3vG3k) to:

•	💬 Engage in discussions about TaskingAI, share ideas, and provide feedback.
    •	📚 Get support, tips, and best practices from other users and our team.
    •	🚀 Stay updated on the latest news, updates, and feature releases.
    •	🤝 Network with like-minded individuals who are passionate about AI and task automation.

## License and Code of Conduct

TaskingAI is released under a specific [TaskingAI Open Source License](./LICENSE). By contributing to this project, you agree to abide by its terms.

## Support and Contact

For support, please refer to our [documentation](https://docs.tasking.ai) or contact us at [support@tasking.ai](mailto:support@tasking.ai).

TaskingAI

File Explorer

Today's picks

Was this content helpful?

Recent Feedback

TaskingAI

File Explorer

Today's picks

Was this content helpful?

Recent Feedback

Download README