ai-gateways

Self-hosted LLM router with a managed safety net. OpenAI-compatible. BYOK. Single-workspace. Streaming. For more advanced routing choose hosted OrcaRouter

Alephant is an open-source AI Agent Gateway for routing, tracking, and controlling LLM usage across AI agents, members, and workflows, and for publishing agent capabilities as paid endpoints with x402 and MPP payment rails.

Barbacane API and Bidirectional AI Gateway

Self-hosted AI gateway for small teams: a key per person, budgets that fall back to local models, PII masking and free SSO.

A tiny, stateless API that gives OpenAI, Claude, Gemini, xAI and Ollama one simple text-in/text-out contract.

🏓 Bounce — Multi-layer AI provider failover gateway. UPS for your LLM tools. 多级 AI 提供商故障转移网关，让你的爱AI永不停机。

Claude Code Router Gateway (CCRG)

High-performance local AI gateway unlocking unlimited Gemini 3.8 Flash & Pro for autonomous coding agents (Codex, Claude Code, Cline, n8n) via automated Google AI Studio browser relay with full OpenAI/Anthropic parity and auto quota rotation.

高性能 LLM 网关，统一接入 20+ 模型服务商，内置自动降级、流量控制与开发者调试工具。Go SDK / HTTP Gateway / Web Console 三种使用方式。

Vercel — independent third-party profile of a public API surface, by API Evangelist. Vercel is a cloud platform that helps developers build, deploy, and scale modern web applications quickly and efficiently. It provides an optimized hosting environment for frontend frameworks like Next.js (which it created), as well as other React, Vue, Angular, an

Portkey — independent third-party profile of a public API surface, by API Evangelist. Portkey equips AI teams with everything they need to go to production - Gateway, Observability, Guardrails, Governance, and Prompt Management, all in one platform.

Ultra-fast, single-binary AI API proxy pool & token compressor in pure Go. 90+ LLM providers, multi-tenant billing, MITM app proxy, OpenAI-compatible (<20MB RAM).

Production-grade LLM Gateway with NVIDIA NeMo Guardrails (PII & jailbreak defense), Portkey AI Gateway (cross-cloud Groq & Mistral failover, 70/30 canary routing), and FastAPI SRE policies.

Simulation of Cloudflare's GLM-5.3 KV cache cross-tenant leak (SGLang disaggregated prefill/decode admission bug)

Privacy and security gateway for LLM traffic: redacts personal data before it reaches a model, blocks prompt injection, keeps an audit log.

Open Source Self Hosted Integrated Agentic AI Control Plane with Gateway, Observability, Evaluation, Governance and Enforcement Built In

A hands-on lab for learning AI gateways: build, run and break LiteLLM, Bifrost and Kong OSS on GCP in front of an ADK agent calling Gemini and Claude.

Open-source OpenAI-compatible local AI gateway and LLM proxy for Kira AI. Routes Chat Completions & Responses API to Kira AI models for Codex.