The API and AI Gateway
Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]
An open-source AI-first Identity and Access Management (IAM) /AI MCP gateway and auth server with web UI supporting MCP, A2A, OAuth 2.1, OIDC, SAML, CAS, LDAP, SCIM, WebAuthn, TOTP, MFA, Face ID, Google Workspace, Azure AD
A blazing fast AI Gateway with integrated guardrails. Route to 200+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.
Next Generation AI One-Stop Internationalization Solution. Xia Yi Dai AI Yi Zhan Shi B/C Duan Jie Jue Fang An ,Zhi Chi OpenAI,Midjourney,Claude,Xun Fei Xing Huo ,Stable Diffusion,DALL*E,ChatGLM,Tong Yi Qian Wen ,Teng Xun Hun Yuan ,360 Zhi Nao ,Bai Chuan AI,Huo Shan Fang Zhou ,Xin Bi Ying ,Gemini,Moonshot Deng Mo Xing ,Zhi Chi Dui Hua Fen Xiang ,Zi Ding Yi Yu She ,Yun Duan Tong Bu ,Mo Xing Shi Chang ,Zhi Chi Dan Xing Ji Fei He Ding Yue Ji Hua Mo Shi ,Zhi Chi Tu Pian Jie Xi ,Zhi Chi Lian Wang Sou Suo ,Zhi Chi Mo Xing Huan Cun ,Feng Fu Mei Guan De Hou Tai Guan Li Yu Yi Biao Pan Shu Ju Tong Ji .
Delivery infrastructure for agentic apps - Plano is an AI-native proxy and data plane that offloads plumbing work, so you stay focused on your agent's core logic (via any AI framework).
Fastest enterprise AI gateway (50x faster than LiteLLM) with adaptive load balancer, cluster mode, guardrails, 1000+ models support & <100 us overhead at 5k RPS.
Cloud native, ultra-high performance AI&API gateway, LLM API management, distribution system, open platform, supporting all AI APIs.Yun Yuan Sheng , Chao Gao Xing Neng AI&APIWang Guan ,LLM API Guan Li , Fen Fa Xi Tong , Kai Fang Ping Tai ,Zhi Chi Suo You AI API,Bu Xian Yu OpenAI, Azure, Anthropic Claude, Google Gemini, DeepSeek, Zi Jie Dou Bao , ChatGLM, Wen Xin Yi Yan , Xun Fei Xing Huo , Tong Yi Qian Wen , 360 Zhi Nao , Teng Xun Hun Yuan Deng Zhu Liu Mo Xing ,Tong Yi API Qing Qiu He Fan Hui ,APIShen Qing Yu Shen Pi ,Diao Yong Tong Ji , Fu Zai Jun Heng , Duo Mo Xing Zai Bei . Yi Jian Bu Shu ,Kai Xiang Ji Yong .
One Hub All LLMs For You | Wei Ge Ren Da Zao De LLM API Ju He Fu Wu
Route, manage, and analyze your LLM requests across multiple providers with a unified API interface.
Debug your AI agents
AI Gateway: Claude Pro, Copilot, Gemini subscriptions - OpenAI/Anthropic/Gemini APIs. No API keys needed.
Bella OpenAPIShi Yi Ge Ti Gong Liao Feng Fu De AIDiao Yong Neng Li De APIWang Guan ,Ke Lei Bi openrouter,Yu Zhi Bu Tong De Shi Chu Liao Ti Gong Liao Tian Bu Quan (chat-completion)Neng Li Wai ,Huan Ti Gong Liao Wen Ben Xiang Liang Hua (text-embedding), Yu Yin Shi Bie (ASR), Yu Yin He Cheng (TTS), Wen Sheng Tu , Tu Sheng Tu Deng Duo Chong AINeng Li ,Tong Shi Ji Cheng Liao Ji Fei , Xian Liu He Zi Yuan Guan Li Gong Neng . Qie Ji Cheng De Suo You Neng Li Du Jing Guo Liao Da Gui Mo Sheng Chan Huan Jing De Yan Zheng .
Build mods for Claude Code: Hook any request, modify any response, /model "with-your-custom-model", intelligent model routing using your logic or ours
Modular, open source LLMOps stack that separates concerns: LiteLLM unifies LLM APIs, manages routing and cost controls, and ensures high-availability, while Langfuse focuses on detailed observability, prompt versioning, and performance evaluations.
OpenAI-compatible HTTP LLM proxy / gateway for multi-provider inference (Google, Anthropic, OpenAI, PyTorch). Lightweight, extensible Python/FastAPI--use as library or standalone service.
AxonFlow -- Source-available AI control plane for production LLM systems
Lightweight distributed LLM gateway w/ web UI for model mgmt & routing. Supports vibe programming, prompt opt., & optimized OpenAI API/Anthropic calls
Prompt management gateway with a UI for AI-powered applications. Enables non-technical users to test, refine, and deploy prompts seamlessly across multiple AI providers.
The reliability layer between your code and LLM providers.
Add a description, image, and links to the llm-gateway topic page so that developers can more easily learn about it.
To associate your repository with the llm-gateway topic, visit your repo's landing page and select "manage topics."