`byok-relay` is an open-source gateway that lets developers build AI apps where users can bring their own keys and use almost any model they want. It gives you the same core advantages as OpenRouter — one clean layer instead of juggling provider-specific APIs, SDKs, and integrations — but with a lower barrier to entry, since users can use keys they already have instead of paying twice for the same inference. It also keeps the flexibility to let the app pay for inference when needed, so you can support both BYOK and app-paid flows just like OpenRouter or LiteLLM.

Key Features:

• BYOK support: Users can connect their existing OpenAI, Anthropic, Gemini, and other compatible API keys.

• No CORS issues: Works smoothly with browser-based apps.

• Secure key management: API keys are encrypted server-side with AES-256-GCM and never returned to the client.

• No exposed keys: Keeps secrets out of frontend code.

• No inference bill for developers: Lets users cover their own model usage, reducing app-side AI costs.

• Quickstart integration: Easy to set up, with a hosted option available.

• Wide provider support: Works with OpenAI, Anthropic, Gemini, Groq, Mistral, OpenRouter, and any OpenAI-compatible endpoint.

• Self-hosted or managed: Deploy it yourself or use the managed relay service.

• Security-focused: Includes rate limiting, CORS locking, HTTPS enforcement, and zero request logging.