In this post, I’ll maintain a list of AI gateways (and related technologies) I am tracking. I list them here in no particular order. If you know an AI gateway not on this list, please let me know by dropping it in the comments.
Name | Closed or Open Source? Also, GitHub stars when I last looked | Comment | |
|---|---|---|---|
1 | Open source. 7.8K stars | ||
2 | |||
3 | I think this is built on the open source Kgateway | ||
4 | |||
5 | Open source. 22.1K stars. | ||
6 | Open source. 5.2K stars. | ||
7 | |||
8 | |||
9 | |||
10 | I think this is built on Apache APISIX | ||
11 | |||
12 | |||
13 | |||
14 | |||
15 | |||
16 | |||
17 | |||
18 | |||
19 | |||
20 | |||
21 | Open source. 234 stars. | ||
22 | |||
23 |
Managed services
Name | Comments | |
|---|---|---|
1 | AWS managed service for foundation models. | |
2 | Unifed API for foundation models on Azure. | |
Guardrails
Number | Name | Comments |
|---|---|---|
1 | Detects harmful AI generated content. | |
2 | As name says, provides guardrails. Can be deployed to existing API gateways |
AI API Translators
Number | Name | Comments |
|---|---|---|
1 | Proxy that serves as OpenAI-compatible RESTful APIs for Amazon Bedrock | |
Changelog
27th Aug 25: Added AI API translators. Put guardrails in a different table.
