llms-client

KO | EN

gitlite — search

#ai #typescript #llm #android #rust #deep-learning #docker #java #windows #kubernetes #awesome-list #pytorch #ios #open-source

(★ 24)

Rust library for Gemini, chatGPT, etc. with automatic context management

llms-client Latest Version Download

Download Latest Version (.zip)

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# Gemini
## Installation
```bash
cargo add gemini-client-api
```
view at [crate.io](https://crates.io/crates/gemini-client-api)

## Overview
A Rust library to use Google's Gemini API with macro super powers! It is extremely flexible and modular to integrate with any framework.  
For example, since Actix supports stream of `Result<Bytes, Error>` for response streaming, you can get it directly instead of making a wrapper stream around a response stream of futures, which is a pain.

### Features
- Automatic context management
- Automatic function calling. Trust me!
- Automatic JSON schema generation
- Inbuilt markdown to parts parser enables AI to see markdown images or files, even if they are from your device storage!
- Vision to see images
- Code execution by Gemini
- File reading like PDF or any document, even audio files like MP3
- Function call support
- Thinking and Safety setting
- Context Caching
- Supports Session management in WASM environment with `default-features = false`

# TODO
1. Do the same for OpenAI

llms-client

llms-client Latest Version Download

Today's picks

Was this content helpful?

Recent Feedback

llms-client

llms-client Latest Version Download

Today's picks

Was this content helpful?

Recent Feedback

Download README