AI Gateway List

Ikenna Nwaiwu
May 08, 2025

In this post, I’ll maintain a list of AI gateways (and related technologies) I am tracking. I list them here in no particular order. If you know an AI gateway not on this list, please let me know by dropping it in the comments.

	Name	Closed or Open Source? Also, GitHub stars when I last looked	Comment
1	Portkey AI Gateway	Open source. 7.8K stars
2	Kong AI gateway
3	Solo.io Gloo AI Gateway		I think this is built on the open source Kgateway
4	Kgateway
5	LiteLLM	Open source. 22.1K stars.
6	Higress	Open source. 5.2K stars.
7	APIPark
8	Cloudflare AI Gateway
9	OpenRouter
10	Api7		I think this is built on Apache APISIX
11	Apache APISIX
12	Microsoft Azure API Management
13	Tyk AI Studio
14	AWS AppSync		Positioned as an AI gateway for AWS Bedrock
15	Traefik Hub API Management
16	Google Apigee
17	F5 AI Gateway
18	IBM API Connect
19	MLFlow AI Gateway
20	TrueFoundry AI Gateway
21	Wealthsimple AI Gateway	Open source. 234 stars.
22	WSO2 AI Gateway

Here a list of technologies that are not AI gateways, but provide some of the features AI gateways do.

	Name	Comments
1	Pangea AI Guardrail Platform	As name says, provides guardrails. Can be deployed to existing API gateways
2	AWS Bedrock	AWS managed service for foundation models.
3	Azure AI Model Inference REST API	Unifed API for foundation models on Azure.
4	Azure AI Content Safety	Detects harmful AI generated content.

Reply

or to participate.