ai-gateway

ai-gateway

Envoy AI Gateway is an open source project for using Envoy Gateway to handle request traffic from application clients to Generative AI services.

Stars: 70

Visit
 screenshot

Envoy AI Gateway is an open source project that utilizes Envoy Gateway to manage request traffic from application clients to Generative AI services. The project aims to provide a seamless and efficient solution for handling communication between clients and AI services. It is designed to enhance the performance and scalability of AI applications by leveraging the capabilities of Envoy Gateway. The project welcomes contributions from the community and encourages collaboration to further develop and improve the functionality of the AI Gateway.

README:

Envoy AI Gateway

Envoy AI Gateway is an open source project for using Envoy Gateway to handle request traffic from application clients to Generative AI services.

Contact

Get Involved

We adhere to the CNCF Code of conduct

The Envoy AI Gateway team meets every Thursday. Please register for the meeting, add agenda points, and get involved.

Background

The proposal of using Envoy Gateway as a Cloud Native LLM Gateway inspired the initiation of this project.

For Tasks:

Click tags to check more tools for each tasks

For Jobs:

Alternative AI tools for ai-gateway

Similar Open Source Tools

For similar tasks

For similar jobs