archgw

ArchGW is the intelligent Layer 7 gateway (proxy) for AI agents, offloading critical, undifferentiated tasks like prompt guardrails, smart routing, and LLM observability.

ArchGW (Arch Gateway) operates as an intelligent, open-source Layer 7 proxy, purpose-built for agentic applications. It’s engineered on the battle-tested Envoy Proxy, providing a robust, out-of-process architecture. This gateway handles the non-core plumbing: managing prompt guardrails to prevent jailbreaks, executing smart intent routing to the correct agent, and providing standardized, OTEL-based observability for LLM calls. Critically, ArchGW enables fast function calling and disaster recovery between upstream LLMs, allowing developers to focus 100% on core business logic and agent differentiation, not boilerplate infrastructure.

https://github.com/katanemo/archgw