Gateway Integrations
The Semantic Router ships with multiple gateway profiles. This page shows Which gateway plugs in, What SR adds, and What’s already validated.
High-level topology
Supported Profiles
| Gateway profile | Integration path | SR adds | CI status | Manifests / config |
|---|---|---|---|---|
| Envoy AI Gateway | ExtProc gRPC (Envoy AI Gateway → SR) | Classification → model header, PII/jailbreak, semantic cache, observability headers |   | deploy/kubernetes/ai-gateway |
| Istio Gateway | Gateway API Inference Extension + ExtProc | Same as above; demo with dual vLLM backends | Manual guide | deploy/kubernetes/istio |
| AIBrix Gateway | Envoy Gateway API resources + ExtProc | SR intelligence in front of AIBrix autoscaler and distributed KV | Helm + AIBrix manifests; follows Envoy ExtProc; Planned E2E | deploy/kubernetes/aibrix |
| LLM-D Gateway | Istio Gateway + LLM-D schedulers + ExtProc | Semantic routing feeds pool selection in LLM-D | Covered by Istio flow; Planned E2E | deploy/kubernetes/llmd-base |
Reading map: pick your gateway, open the install guide, then jump to the manifests to see the exact resources the diagram refers to.
Request Flow
Where to go next
- Envoy AI Gateway install: installation/k8s/ai-gateway
- Istio Gateway install: installation/k8s/istio
- AIBrix Gateway install: installation/k8s/aibrix
- LLM-D Gateway install: installation/k8s/llm-d