gateway
A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.
File Explorer
Download Latest Version (.zip)- bug_report.yml
- config.yml
- feature_request.yml
- check_code_formatting.yml
- docker_publish.yml
- link-checker.yml
- npm_publish.yml
- run_tests.yml
- triage-label.yml
- cn.CODE_OF_CONDUCT.md
- CODE_OF_CONDUCT.md
- CONTRIBUTING.cn.md
- CONTRIBUTING.md
- pull_request_template.md
- README.cn.md
- README.jp.md
- SECURITY.md
- SUPPORT.md
- pre-commit
- pre-push
- launch.json
- tasks.json
- automatic-retries-on-failures.md
- enable-cache.md
- fallback-from-openai-to-azure.ipynb
- fallback-from-stable-diffusion-to-dall-e.ipynb
- gentle-introduction-to-portkey-gateway.ipynb
- image-generation.ipynb
- resilient-loadbalancing-with-failure-mitigating-fallbacks.md
- writing-your-first-gateway-config.md
- Langchain Chatbot with PII Guardrails.ipynb
- route.ts
- page.tsx
- action.ts
- conditional-routing.ts
- fallback.ts
- guardrails.ts
- load-balance.ts
- page.tsx
- action.tsx
- joke-component.tsx
- joke.ts
- page.tsx
- action.ts
- page.tsx
- action.ts
- page.tsx
- layout.tsx
- favicon.ico
- globals.css
- layout.tsx
- page.tsx
- button.tsx
- card.tsx
- input.tsx
- label.tsx
- back-button.tsx
- link.tsx
- generate-text.ts
- stream-text.ts
- tools.ts
- utils.ts
- next.svg
- vercel.svg
- components.json
- next-env.d.ts
- next.config.mjs
- package-lock.json
- package.json
- pnpm-lock.yaml
- postcss.config.js
- readme.md
- tailwind.config.ts
- tsconfig.json
- anyscale.md
- deepinfra.ipynb
- groq.ipynb
- Instructor_with_Portkey.ipynb
- langchain.ipynb
- Mistral.ipynb
- mistral.md
- mixtral-8x22b.ipynb
- ncompass.ipynb
- openai.ipynb
- Phidata_with_ Perplexity.ipynb
- Phidata_with_Portkey.ipynb
- ReAct Agents Portkey.ipynb
- segmind.ipynb
- Sutra_with_Portkey.ipynb
- Tool_Use_with_Portkey.ipynb
- vercel-ai.md
- Autogen_with_Telemetry.ipynb
- ControlFlow_with_Telemetry.ipynb
- CrewAI_with_Telemetry.ipynb
- Llama_Agents_with_Telemetry.ipynb
- aibadgr.ipynb
- anthropic.ipynb
- deepinfra.ipynb
- groq.ipynb
- mistral.ipynb
- ncompass.ipynb
- nvidia.ipynb
- openai.ipynb
- segmind.ipynb
- together.ipynb
- Audio Processing - GPT-4o & Portkey.ipynb
- GPT-4o vs Claude-3-Opus vs Gemini-1.5-Pro - Portkey.ipynb
- Image Processing - GPT-4o & Portkey.ipynb
- Intro_to_GPT4o_Portkey.ipynb
- Video Processing - GPT-4o & Portkey.ipynb
- comparing-top10-LMSYS-models-with-Portkey.ipynb
- Comparision_of_Top_6_LMSYS_Vison_models_using_Portkey.ipynb
- README.md
- Claude_3_5_Sonnet_vs_GPT_4o_Portkey.ipynb
- Claude_3_5_Sonnet_with_Portkey.ipynb
- Contextual Embeddings Guide Anthropic, Cohere, Voyage.ipynb
- Creating_Artifacts_with_GPT_4o_.ipynb
- llama-3-on-groq.ipynb
- Nemotron_GPT_Finetuning_Portkey.ipynb
- run-gateway-on-prompts-from-langchain-hub.md
- smart-fallback-with-model-optimized-prompts.md
- supabase-pgvector-and-portkey.md
- Testing_Top_Vision_Models.ipynb
- use-openai-sdk-with-portkey-prompt-templates.md
- README.md
- 101-configs-1.png
- 101-configs-2.png
- cache-1.png
- cache-2.png
- cache-3.png
- fallback-trace-id.png
- langchain-hub.png
- logs.png
- prompt-template.png
- resilient-loadbalance-1.png
- resilient-loadbalance.png
- supabase-1.png
- supabase-2.png
- supabase-3.png
- supabase-4.png
- supabase-5.png
- supabase-6.png
- supabase-7.png
- anthropic.png
- anyscale.png
- azure.png
- bard.png
- cohere.png
- cookbook-header.png
- demo.gif
- gateway-border.png
- header.png
- header_new.png
- localai.png
- openai.png
- palm.png
- Sticker.png
- deploy-on-replit.md
- installation-deployments.md
- @types+async-retry+1.4.5.patch
- async-retry+1.3.3.patch
- helper.test.ts
- helper.ts
- manifest.json
- model.ts
- scan.test.ts
- scan.ts
- aporia.test.ts
- manifest.json
- validateProject.ts
- azure.test.ts
- contentSafety.ts
- manifest.json
- pii.ts
- protectedMaterial.ts
- shieldPrompt.ts
- types.ts
- utils.ts
- bedrock.test.ts
- index.ts
- manifest.json
- type.ts
- util.ts
- aidr.test.ts
- guardChatCompletion.ts
- manifest.json
- version.ts
- addPrefix.ts
- alllowercase.ts
- allowedRequestTypes.ts
- alluppercase.ts
- characterCount.ts
- contains.ts
- containsCode.ts
- default.test.ts
- endsWith.ts
- jsonKeys.ts
- jsonSchema.ts
- jwt.ts
- log.ts
- manifest.json
- modelRules.ts
- modelWhitelist.ts
- notNull.ts
- regexMatch.ts
- regexReplace.ts
- requiredMetadataKeys.ts
- sentenceCount.ts
- validUrls.ts
- webhook.ts
- wordCount.ts
- exa.test.ts
- manifest.json
- online.ts
- manifest.json
- scan.test.ts
- scan.ts
- guardrails.ts
- javelin.test.ts
- manifest.json
- classify.ts
- lasso.test.ts
- manifest.json
- README.md
- index.ts
- manifest.json
- mistral.test.ts
- manifest.json
- pangea.test.ts
- pii.ts
- textGuard.ts
- version.ts
- intercept.ts
- manifest.json
- panw.airs.test.ts
- custom.ts
- globals.ts
- isConcise.ts
- isHelpful.ts
- isPolite.ts
- manifest.json
- noApologies.ts
- noGenderBias.ts
- noRacialBias.ts
- patronus.test.ts
- phi.ts
- pii.ts
- retrievalAnswerRelevance.ts
- retrievalHallucination.ts
- toxicity.ts
- globals.ts
- manifest.json
- pillar.test.ts
- scanPrompt.ts
- scanResponse.ts
- gibberish.ts
- globals.ts
- language.ts
- manifest.json
- moderateContent.ts
- pii.ts
- portkey.test.ts
- globals.ts
- guard.ts
- harm.ts
- manifest.json
- pii.ts
- promptfoo.test.ts
- types.ts
- manifest.json
- promptsecurity.test.ts
- protectPrompt.ts
- protectResponse.ts
- shared.ts
- contentModeration.ts
- globals.ts
- grounding.ts
- hallucinations.ts
- manifest.json
- pii.ts
- policy.ts
- promptInjections.ts
- qualifire.test.ts
- toolUseQuality.ts
- manifest.json
- sydeguard.ts
- sydelabs.test.ts
- manifest.json
- walledai.test.ts
- walledprotect.ts
- build.ts
- Contributing.md
- index.ts
- README.md
- types.ts
- utils.test.ts
- utils.ts
- index.ts
- models.json
- providers.json
- GatewayError.ts
- RouterError.ts
- cacheService.ts
- hooksService.ts
- logsService.ts
- preRequestValidatorService.ts
- providerContext.ts
- requestContext.ts
- responseService.ts
- batchesHandler.ts
- chatCompletionsHandler.ts
- completionsHandler.ts
- createSpeechHandler.ts
- createTranscriptionHandler.ts
- createTranslationHandler.ts
- embeddingsHandler.ts
- filesHandler.ts
- finetuneHandler.ts
- handlerUtils.ts
- imageEditsHandler.ts
- imageGenerationsHandler.ts
- messagesCountTokensHandler.ts
- messagesHandler.ts
- modelResponsesHandler.ts
- modelsHandler.ts
- proxyHandler.ts
- realtimeHandler.ts
- realtimeHandlerNode.ts
- responseHandlers.ts
- retryHandler.ts
- streamHandler.ts
- streamHandlerUtils.ts
- websocketUtils.ts
- index.ts
- index.ts
- globals.ts
- index.ts
- types.ts
- index.ts
- config.ts
- index.ts
- api.ts
- chatComplete.ts
- index.ts
- api.ts
- chatComplete.ts
- complete.ts
- embed.ts
- index.ts
- api.ts
- chatComplete.ts
- index.ts
- api.ts
- chatComplete.ts
- complete.ts
- index.ts
- messages.ts
- types.ts
- utils.ts
- streamGenerator.ts
- constants.ts
- messages.ts
- types.ts
- api.ts
- chatComplete.ts
- complete.ts
- embed.ts
- index.ts
- api.ts
- chatComplete.ts
- complete.ts
- embed.ts
- getBatchOutput.ts
- index.ts
- messages.ts
- utils.ts
- api.ts
- chatComplete.ts
- complete.ts
- createBatch.ts
- createFinetune.ts
- createSpeech.ts
- createTranscription.ts
- createTranslation.ts
- embed.ts
- getBatchOutput.ts
- imageGenerate.ts
- index.ts
- utils.ts
- messagesUtils.ts
- api.ts
- cancelBatch.ts
- chatComplete.ts
- complete.ts
- constants.ts
- countTokens.ts
- createBatch.ts
- createFinetune.ts
- deleteFile.ts
- embed.ts
- getBatchOutput.ts
- imageGenerate.ts
- index.ts
- listBatches.ts
- listfiles.ts
- listFinetunes.ts
- messages.ts
- retrieveBatch.ts
- retrieveFile.ts
- retrieveFileContent.ts
- retrieveFinetune.ts
- types.ts
- uploadFile.ts
- uploadFileUtils.ts
- utils.ts
- api.ts
- chatComplete.ts
- index.ts
- types.ts
- api.ts
- index.ts
- api.ts
- cancelBatch.ts
- chatComplete.ts
- complete.ts
- createBatch.ts
- deleteFile.ts
- embed.ts
- getBatchOutput.ts
- getFiles.ts
- index.ts
- listBatches.ts
- retrieveBatch.ts
- types.ts
- uploadFile.ts
- utils.ts
- api.ts
- chatComplete.ts
- embed.ts
- index.ts
- api.ts
- index.ts
- api.ts
- index.ts
- api.ts
- chatComplete.ts
- imageGenerate.ts
- index.ts
- api.ts
- chatComplete.ts
- index.ts
- api.ts
- chatComplete.ts
- index.ts
- types.ts
- api.ts
- index.ts
- api.ts
- cancelFinetune.ts
- chatComplete.ts
- complete.ts
- createFinetune.ts
- embed.ts
- imageGenerate.ts
- index.ts
- listFiles.ts
- listFinetune.ts
- retrieveFile.ts
- types.ts
- uploadFile.ts
- utils.ts
- api.ts
- chatComplete.ts
- embed.ts
- index.ts
- types.ts
- api.ts
- cancelBatch.ts
- chatComplete.ts
- createBatch.ts
- createFinetune.ts
- embed.ts
- getBatchOutput.ts
- imageGenerate.ts
- index.ts
- listBatches.ts
- listFiles.ts
- listFinetunes.ts
- messages.ts
- messagesCountTokens.ts
- retrieveBatch.ts
- retrieveFile.ts
- retrieveFileContent.ts
- retrieveFinetune.ts
- transformGenerationConfig.ts
- types.ts
- uploadFile.ts
- utils.test.ts
- utils.ts
- api.ts
- chatComplete.ts
- index.ts
- api.ts
- chatComplete.ts
- complete.ts
- index.ts
- types.ts
- utils.ts
- api.ts
- chatComplete.ts
- imageGenerate.ts
- index.ts
- api.ts
- index.ts
- api.ts
- index.ts
- api.ts
- embed.ts
- index.ts
- api.ts
- chatComplete.ts
- index.ts
- uploadFile.ts
- api.ts
- chatComplete.ts
- index.ts
- api.ts
- index.ts
- api.ts
- chatComplete.ts
- createTranscription.ts
- imageGenerate.ts
- index.ts
- api.ts
- chatComplete.ts
- complete.ts
- createTranscription.ts
- index.ts
- api.ts
- chatComplete.ts
- index.ts
- api.ts
- chatComplete.ts
- index.ts
- api.ts
- index.ts
- api.ts
- index.ts
- api.ts
- chatComplete.ts
- embed.ts
- index.ts
- types.ts
- api.ts
- index.ts
- api.ts
- chatComplete.ts
- index.ts
- api.ts
- chatComplete.ts
- index.ts
- api.ts
- chatComplete.ts
- index.ts
- api.ts
- index.ts
- api.ts
- index.ts
- api.ts
- embed.ts
- index.ts
- api.ts
- chatComplete.ts
- complete.ts
- index.ts
- api.ts
- imageGenerate.ts
- index.ts
- api.ts
- chatComplete.ts
- embed.ts
- index.ts
- constants.ts
- createModelResponse.ts
- helpers.ts
- index.ts
- api.ts
- cancelBatch.ts
- chatComplete.ts
- complete.ts
- createBatch.ts
- createFinetune.ts
- createSpeech.ts
- createTranscription.ts
- createTranslation.ts
- deleteFile.ts
- embed.ts
- getBatchOutput.ts
- imageGenerate.ts
- index.ts
- listBatches.ts
- listFiles.ts
- retrieveBatch.ts
- retrieveFileContent.ts
- uploadFile.ts
- utils.ts
- api.ts
- chatComplete.ts
- index.ts
- utils.ts
- ChatDetails.ts
- GenericChatResponse.ts
- api.ts
- chatComplete.ts
- index.ts
- utils.ts
- api.ts
- chatComplete.ts
- index.ts
- api.ts
- chatComplete.ts
- complete.ts
- embed.ts
- index.ts
- api.ts
- chatComplete.ts
- index.ts
- api.ts
- chatComplete.ts
- index.ts
- api.ts
- index.ts
- api.ts
- imageGenerate.ts
- index.ts
- utils.ts
- api.ts
- chatComplete.ts
- index.ts
- api.ts
- index.ts
- api.ts
- index.ts
- api.ts
- chatComplete.ts
- index.ts
- api.ts
- imageGenerate.ts
- index.ts
- api.ts
- chatComplete.ts
- embed.ts
- imageGenerate.ts
- index.ts
- api.ts
- constants.ts
- imageGenerate.ts
- imageGenerateV2.ts
- index.ts
- utils.ts
- api.ts
- chatComplete.ts
- complete.ts
- embed.ts
- index.ts
- types.ts
- api.ts
- index.ts
- api.ts
- complete.ts
- index.ts
- api.ts
- index.ts
- finishReasonMap.ts
- api.ts
- embed.ts
- index.ts
- api.ts
- chatComplete.ts
- complete.ts
- embed.ts
- imageGenerate.ts
- index.ts
- utils.ts
- api.ts
- index.ts
- api.ts
- index.ts
- api.ts
- chatComplete.ts
- embed.ts
- index.ts
- index.ts
- types.ts
- utils.ts
- index.html
- conditionalRouter.ts
- realtimeLlmEventParser.ts
- transformToProviderRequest.ts
- cloudflareKV.ts
- file.ts
- memory.ts
- redis.ts
- rateLimiter.ts
- index.ts
- types.ts
- logger.ts
- constants.ts
- requestTemplates.ts
- testVariables.ts
- utils.ts
- chatCompletion.ts
- common.test.ts
- embedRequestBody.ts
- inputList.ts
- MessagesRequest.ts
- messagesResponse.ts
- MessagesStreamResponse.ts
- modelResponses.ts
- requestBody.ts
- responseBody.ts
- shared.ts
- CryptoUtils.ts
- env.ts
- misc.ts
- globals.ts
- index.ts
- start-server.ts
- utils.ts
- .creds.example.json
- requestBuilder.ts
- round1.mp3
- speech2.mp3
- test.txt
- tryPost.test.ts
- benchmark.ts
- cacheService.test.ts
- hooksService.test.ts
- logsService.test.ts
- preRequestValidatorService.test.ts
- providerContext.test.ts
- requestContext.test.ts
- responseService.test.ts
- .dockerignore
- .git-blame-ignore-revs
- .gitattributes
- .gitignore
- .prettierignore
- .prettierrc
- CLAUDE.md
- conf.example.json
- conf.json
- deployment.yaml
- docker-compose.yaml
- Dockerfile
- eslint.config.js
- initializeSettings.ts
- jest.config.js
- LICENSE
- package-lock.json
- package.json
- README.md
- rollup.config.js
- start-test.js
- tsconfig.json
- wrangler.toml
// repository documentation
Was this content helpful?
(0 ratings)