proxy

KO | EN

gitlite — search

#javascript #python #hacktoberfest #react #ai #typescript #llm #go #golang #android #machine-learning #rust #deep-learning #linux

★ 11 Open GitHub ↗

Props AI provides this open source proxy for Open AI that allows you to track token usage and send it into a kafka stream

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

<img width="1270" alt="Screen Shot 2024-03-03 at 12 08 46 AM" src="https://getprops.ai/_next/image?url=%2Fhome%2Fhero-mac.png&w=3840&q=75"><a>
  <h1 align="center">Props AI Proxy</h1>
</a>

<p align="center">
  Built and used by <a href="httops://getProps.ai">Props AI</a>
</p>
<br/

## Description

Props AI Proxy is an open-source, lightweight, and high-performance proxy server written in Go to enable cost monitoring and usage tracking for Open AI apps. This will be in constant development and has been open sourced to provide transparency into what parts of the request we see and use as part of our cloud offering at https://getprops.ai

<!-- ## Features

- **HTTP and HTTPS Support**: Seamlessly forward HTTP and HTTPS requests to your backend services.
- **WebSocket Forwarding**: Full support for forwarding WebSocket connections.
- **High Performance**: Optimized for speed and low memory usage, making the most of Go's performance characteristics.
- **Easy Configuration**: Simple YAML or JSON configuration files to get your proxy up and running quickly.
- **SSL/TLS Termination**: Handle SSL/TLS encryption and decryption, offloading backend servers.
- **Load Balancing**: Simple round-robin load balancing to distribute traffic among multiple backend servers.
- **Custom Middleware**: Support for custom middleware to extend functionality, such as logging, authentication, or request modification. -->

## Getting Started

### Prerequisites

- Go 1.16 or higher

### Installing

Clone the repository to your local machine:

```bash
git clone https://github.com/PropsAI/proxy
```

Navigate to the project directory:

```bash
cd proxy
```

Build the project:

```bash
go build
```

### Running the Proxy

To start the proxy server, simply run:

```bash
go run .
```

<!-- ## Configuration

coming soon -->

## Contributing

Contributions are what make the open-source community such an amazing place to learn, inspire, and create. Any contributions you make are **greatly appreciated**.

1. Fork the Project
2. Create your Feature Branch (`git checkout -b feature/AmazingFeature`)
3. Commit your Changes (`git commit -m 'Add some AmazingFeature'`)
4. Push to the Branch (`git push origin feature/AmazingFeature`)
5. Open a Pull Request

## License

Distributed under the Apache 2.0 License. See `LICENSE` for more information.

## Contact

Peter Kirkham - [@k11kirky](https://twitter.com/k11kirky)

Props AI - [Website](https://getprops.ai)

proxy

Today's picks

Was this content helpful?

Recent Feedback

proxy

Today's picks

Was this content helpful?

Recent Feedback

Download README