What is LLM Gateway?
LLM Gateway is a platform that allows users to route, manage, and analyze their Large Language Model (LLM) requests across multiple providers using a unified API interface. It is fully open source and compatible with the OpenAI API format for seamless integration.
How to use LLM Gateway?
To use LLM Gateway, users simply change their existing API endpoint to `https://api.llmgateway.io/v1` and use their LLM Gateway API key. It is compatible with the OpenAI API format, allowing for seamless migration and integration with existing code in various languages and frameworks like Python, TypeScript, Next.js, Java, Rust, Go, PHP, and Ruby. LLM Gateway then routes the request to the appropriate provider while tracking usage and performance.