ITMAP for AI Gateways

The AI Gateway (or LLM Gateway) market provides a network-resident control plane that sits between enterprise applications and multiple AI model providers — OpenAI, Anthropic, Google Vertex, AWS Bedrock, Azure OpenAI, Mistral, Cohere, and self-hosted open-source models. These gateways consolidate fragmented LLM traffic at a single chokepoint where platform engineering teams can enforce unified policies for cost control, rate limiting, semantic caching, routing and failover, authentication and RBAC, guardrails, and observability. The category emerged because traditional API management platforms were never designed for token-priced, streaming, non-deterministic traffic routed across competing third-party model providers.

Vendors and products in this market

• Cloudflare — Cloudflare AI Gateway
• Gravitee — Gravitee AI Gateway
• IBM — API Connect AI Gateway
• Kong — Kong AI Gateway
• Lasso Security — Lasso AI Gateway
• Litellm — LiteLLM
• NeuralTrust — NeuralTrust AI Gateway
• Palo Alto Networks — Portkey AI Gateway
• Red Hat (IBM) — Red Hat OpenShift AI 3.5 Models-as-a-Service (AI Gateway)
• Solo.io — Agentgateway
• TrueFoundry — TrueFoundry AI Gateway
• Vercel — Vercel AI Gateway

Explore the interactive vendor map and product comparisons. Registration and profile requirements apply to protected features, reports and intelligence.