Shypd.aiThe largest open index of AI toolsLLM Gateway is an open-source API gateway for Large Language Models that routes, manages, and analyzes LLM requests across multiple providers. It offers a unified API interface compatible with OpenAI.
Trending
Also listed in
About
LLM Gateway is an open-source API gateway designed to streamline the management and analysis of Large Language Model (LLM) requests. It acts as a middleware between applications and various LLM providers, including OpenAI, Anthropic, and Google Vertex AI. Key functionalities include routing requests to different providers, centralizing API key management, and tracking token usage and costs. The platform also provides performance monitoring and usage analytics to help users optimize their LLM interactions. It offers a unified API interface compatible with the OpenAI API format for seamless integration and supports both hosted and self-hosted deployment options.
Capabilities
Pricing & Plans
Open Source · Enterprise
Free
FAQs
Trending
