lua-genai

KO | EN

gitlite — search

#hacktoberfest #ai #typescript #llm #go #machine-learning #rust #nodejs #cli #awesome-list #pytorch #mcp #ios #open-source

(★ 13)

Lua interface for working with multiple generative AI providers

lua-genai 최신버젼 다운로드

최종 버전 다운로드 (.zip)

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# Generative AI SDK for Lua

A developer-friendly Lua interface for working with various generative AI providers, abstracting away provider-specific payload structures and response parsing so that using multiple models is easy.

> ❤️ This is a work in progress so any help is highly appreciated!

## Features

- Stream output for real-time responses
- Structured JSON response abstraction layer
- Token usage tracking with cost calculation
- Open-source models via OpenAI compatibility
- Async non-blocking requests via copas

### Providers

- OpenAI: https://platform.openai.com/docs/overview

- Anthropic: https://docs.anthropic.com/en/home

- Anything OpenAI compatible e.g. **Perplexity, Together AI, etc.** by prefixing endpoint with openai and double colon e.g. `"openai::https://api.perplexity.ai/chat/completions"`

### Roadmap

- [ ] Audio models

- [ ] Image models

- [ ] Video models

## Installation

`luarocks install lua-genai`

### Dependencies

- [lua-cjson](https://github.com/openresty/lua-cjson)
- [luasec](https://github.com/brunoos/luasec)
- [copas](https://github.com/lunarmodules/copas)

## Usage

```lua
local genai = require("genai")

local client = genai.new("<YOUR_API_KEY>", "https://api.openai.com/v1/chat/completions")

local chat = client:chat("gpt-4o-mini")
print(chat:say("Hello, world!"))
```

> For deeper control you could use the `genai` client directly if needed

### System Prompt

```lua
local chat = client:chat("gpt-4o-mini", { system_prompt = "You are a fish." })
print(chat:say("What are you?"))
```

### Streaming

```lua
local process_stream = function(text)
	io.write(text)
	io.flush()
end

local chat = client:chat("gpt-4o-mini", { settings = { stream = process_stream } })
chat:say("Tell me a very short story.")
print()
```

### Async

```lua
local copas = require("copas")

local chat = client:chat("gpt-4o-mini", { settings = { async = true } })

copas.addthread(function()
	print(chat:say("test"))
end)

copas.loop()
```

### JSON Response

```lua
local npc_schema = {
	name = { type = "string" },
	class = { type = "string" },
	level = { type = "integer" },
}

local json_object = {
	title = "NPC",
	description = "A non-player character's attributes.",
	schema = npc_schema,
}

local chat = client:chat("gpt-4o-mini", { settings = { json = json_object } })
print(chat:say("Create a powerful wizard called Torben."))
```

See `example.lua` for a full-featured Anthropic implementation.

lua-genai

lua-genai 최신버젼 다운로드

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

lua-genai

lua-genai 최신버젼 다운로드

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

Download README