Envoy vs 100ms

About

Envoy is the most widely deployed cloud-native proxy, originally developed at Lyft and now a Cloud Native Computing Foundation (CNCF) graduated project since November 2018 — serving as the default sidecar proxy in Istio, Open Service Mesh, AWS App Mesh, and other service meshes, as well as the foundational technology behind many commercial API gateways and edge proxy products. Envoy processes traffic for millions of microservices globally, handling load balancing, service discovery, observability, and traffic management at the infrastructure layer.\n\nEnvoy's architecture as a high-performance, extensible proxy has made it the de facto standard for cloud-native network infrastructure — its xDS API for dynamic configuration allows platforms like Istio to manage Envoy configurations at scale without restarting proxies, while its rich observability (distributed tracing, detailed metrics) makes it essential for understanding microservices traffic patterns. Envoy Gateway 1.1 (released August 2024) added support for the Kubernetes Gateway API v1.1, standardizing how Kubernetes workloads expose services externally.\n\nIn February 2025, Envoy reached another milestone: the first stable open-source AI Gateway (v0.1), developed by Bloomberg and Tetrate and backed by CNCF, was built on Envoy to provide unified access management, rate limiting, and observability for AI model APIs — positioning Envoy as infrastructure for AI application traffic alongside traditional microservices traffic. Envoy competes with NGINX and HAProxy for traditional proxy workloads but has largely displaced them in Kubernetes and cloud-native environments. The 2025 strategy focuses on the AI gateway use case, continued Kubernetes Gateway API adoption, and the commercial ecosystem of Envoy-based products (Tetrate, Solo.io, and others) that fund ongoing development.