https://github.com/samet404/genai-pool

Create an AI Pool using Google GenAI API keys to speed up generation process
https://github.com/samet404/genai-pool

Last synced: 8 months ago
JSON representation

Create an AI Pool using Google GenAI API keys to speed up generation process

• Host: GitHub
• URL: https://github.com/samet404/genai-pool
• Owner: samet404
• License: mit
• Created: 2025-06-12T13:33:44.000Z (12 months ago)
• Default Branch: main
• Last Pushed: 2025-06-24T13:00:09.000Z (11 months ago)
• Last Synced: 2025-07-01T03:07:54.884Z (11 months ago)
• Language: Python
• Homepage:
• Size: 29.3 KB
• Stars: 0
• Watchers: 0
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

          
![image](https://github.com/user-attachments/assets/d1b14e3a-48b3-4a6a-96ec-7abeac3be3a1)

GenAI pool is a Flask-based, proxy/load balancer for Google's AI APIs to handle concurrent API requests efficiently. Allows you to use multiple API keys (these can be free tier) as a single client over Socket.io network. Useful for people who wants to make AI applications with low cost.  

## Why you should use GenAI-Pool?

- Manages multiple Google AI API keys and clients

- Implements rate limiting and quota management via Redis

- Supports lazy loading of clients

- Rotates between different Gemini models based on user preferences, availability and quotas

- Can be easily deployed via Docker

- Handles multiple Socket.io connections for streaming AI responses

- Advanced configuration options

## License

[MIT](https://opensource.org/licenses/MIT)