KO | EN

GitLite

Minimalist Open Source Repository Search Engine

gitlite — search

#typescript #ai-agents #cli #claude-code #codex #developer-tools #ai #dsh-plugin #ai-agent #mcp #deepseek-harness #windows

awesome-serverless-gpu

★ 55 Open GitHub ↗

Curated list of services and platforms for serverless GPU and AI inference

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# Awesome Serverless GPU

List of where to run code on GPUs for AI, inference, predictions that are serverless.  
Serverless is defined as pay-as-you-go, scale-to-zero, minimal infrastructure configuration.

Serverless GPU is a reletively new and fast evolving field. New services are appearing and disappearing frequently.  
I will do my best to keep the list updated, and soon include benchmarks.

Common weaknessses of serverless GPU at the moment is very long cold starts, and configuration that are less easy to use than the more mature field of serverless on CPUs.

## Inference

### Bring your own model
True serverless inference
- [Inferless.com](https://www.inferless.com/)
- [Replicate.com](https://replicate.com/)
- [Runpod.io](https://www.runpod.io/)
- [Modelz.ai](https://modelz.ai/)
- [Banana.dev](https://www.banana.dev/) (Shutting down March 31st 2024)
- [Beam.cloud](https://www.beam.cloud/)
- [Mystic.ai](https://www.mystic.ai/)
- [Modal.com](https://modal.com/)
- [Baseten.co](https://www.baseten.co/)
- [Covalent.xyz](https://www.covalent.xyz/)

### Predefined models
True serverless with a limited set of models
- [Cloudflare AI](https://ai.cloudflare.com/)
- [OpenAI](https://platform.openai.com/)
- [Mistral](https://docs.mistral.ai/)
- [Sievedata.com](https://www.sievedata.com/)
- [Together.ai](https://www.together.ai/)
- [Anyscale.com](https://www.anyscale.com/)
- [Fireworks.ai](https://fireworks.ai/)
- [Fal.ai](https://fal.ai/)

### Not serverless inference
Needs dedicated server, but works with your own model  
- [Together.ai](https://www.together.ai/)
- [Sievedata.com](https://www.sievedata.com/)
- [Anyscale.com](https://www.anyscale.com/)
- [Runpod.io](https://www.runpod.io/)
- [Huggingface.co](https://huggingface.co/)
- [Lepton.ai](https://www.lepton.ai/)
- [Vast.ai](https://vast.ai/)
- [Lambdalabs.com](https://lambdalabs.com/)
- [Paperspace](https://www.paperspace.com/)

## Dev on GPUs
Flexible on-demand GPU providers
- [Brev.dev](https://brev.dev/)
- [Colab](https://colab.research.google.com/)
- [Kaggle.com](https://www.kaggle.com/)
- [Modal.com](https://modal.com/)
- [Beam.cloud](https://www.beam.cloud/)

## Predefined models over API

### Speech to text
- [OpenAI](https://platform.openai.com/docs/models/whisper)
- [Amazon](https://aws.amazon.com/transcribe/), [Azure](https://azure.microsoft.com/en-us/products/ai-services/speech-to-text), [Google](https://cloud.google.com/speech-to-text)
- [Gladia.io](https://www.gladia.io/)
- [Deepgram.com](https://deepgram.com/)
- [Speechmatics.com](https://www.speechmatics.com/)
- [Sieve ASR](https://www.sievedata.com/functions/sieve/speech_transcriber)
- [Fal.ai Whisper](https://fal.ai/models/fal-ai/whisper)
- [Elevenlabs.io](https://elevenlabs.io/api)

### Text to speech
- [OpenAI](https://platform.openai.com/docs/guides/text-to-speech)
- [Amazon](https://aws.amazon.com/polly/), [Azure](https://learn.microsoft.com/en-us/azure/ai-services/speech-service/rest-text-to-speech), [Google](https://cloud.google.com/text-to-speech)
- [Speechify.com](https://speechify.com/)
- [Elevenlabs.io](https://elevenlabs.io/api)
- [Unrealspeech.com](https://unrealspeech.com/)
- [Play.ht](https://play.ht/)
- [Murf.ai](https://murf.ai/)
- [Deepgram.com](https://deepgram.com/)
- [Resemble.ai](https://www.resemble.ai/)

### Image generation
- [OpenAI Dall-e](https://platform.openai.com/docs/guides/images/introduction)
- [Dreamstudio](https://dreamstudio.com/api/)
- [Stablediffusionapi.com](https://stablediffusionapi.com/docs/)
- [Modelslab.com](https://docs.modelslab.com/image-editing/overview)
- [Bria.ai](https://bria.ai/)
- [Fal.ai](https://fal.ai/models)

## Workflow platforms
- [Leap](https://www.tryleap.ai/)

## AI Agents for Websites
- [Chatflow](https://chatflow.no/)
- [OneAI](https://oneai.com/)
- [SiteGPT](https://sitegpt.ai/)
- [Chatbase](https://www.chatbase.co/)

awesome-serverless-gpu

Explore Similar Repositories

Was this content helpful?

Recent Feedback

Download README