https://github.com/nuhmanpk/visionscriptbot
A telegram bot that uses Google's Gemini Pro Vision API to convert image to text
https://github.com/nuhmanpk/visionscriptbot
gemini-ai gemini-api gemini-vision-pro google google-ai-studio google-api gpt pyrogram python telegram-bot vision-transformer
Last synced: 11 months ago
JSON representation
A telegram bot that uses Google's Gemini Pro Vision API to convert image to text
- Host: GitHub
- URL: https://github.com/nuhmanpk/visionscriptbot
- Owner: nuhmanpk
- License: mit
- Created: 2023-12-30T05:32:12.000Z (about 2 years ago)
- Default Branch: main
- Last Pushed: 2024-07-30T03:48:26.000Z (over 1 year ago)
- Last Synced: 2025-03-18T00:38:29.929Z (11 months ago)
- Topics: gemini-ai, gemini-api, gemini-vision-pro, google, google-ai-studio, google-api, gpt, pyrogram, python, telegram-bot, vision-transformer
- Language: Python
- Homepage:
- Size: 2.35 MB
- Stars: 21
- Watchers: 1
- Forks: 8
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- Funding: .github/FUNDING.yml
- License: LICENSE
Awesome Lists containing this project
README
# VisionScriptBot
A telegram bot that uses Google's Gemini Pro Vision API , Take a demo [here](https://t.me/visionscriptbot). New Version support prompts along with Images, Add your prompt in Image caption before uploading the Image.
### Gemini Vision Pro
Gemini Pro Vision is a Gemini large language vision model that understands input from text and visual modalities (image and video) in addition to text to generate relevant text responses.
Gemini Pro Vision is a foundation model that performs well at a variety of multimodal tasks such as visual understanding, classification, summarization, and creating content from image and video. It's adept at processing visual and text inputs such as photographs, documents, infographics, and screenshots.
## Gemini API
VisionScriptBot uses Google new [Gemini Pro Model](https://ai.google.dev/docs) .
[Gemini](https://deepmind.google/technologies/gemini/) is Google's latest family of [large language models](https://blog.google/technology/ai/google-gemini-ai/#performance).
### API KEY
You need Google Api key 🔐 for Gemini to run this model.
Get your api key from
https://makersuite.google.com/app/apikey
Google's Python SDK for the Gemini API, is contained in the google-generativeai package. Install the dependency using pip:
```bash
pip install -q -U google-generativeai
```
for complete guide [refer](https://ai.google.dev/tutorials/python_quickstart)
### Deploy
Deployed on [Railway.app](https://railway.app?referralCode=O6FeyZ) , do checkout their free hosting plans [here](https://railway.app?referralCode=O6FeyZ)
#### Use cases
1. Visual information seeking: Use external knowledge combined with information extracted from the input image or video to answer questions.
1. Object recognition: Answer questions related to fine-grained identification of the objects in images and videos.
1. Digital content understanding: Answer questions and extract information from visual content like infographics, charts, figures, tables, and web pages.
1. Structured content generation: Generate responses based on multimodal inputs in formats like HTML and JSON.
1. Captioning and description: Generate descriptions of images and videos with varying levels of details.
1. Reasoning: Compositionally infer new information without memorization or retrieval.
## Demo
## Support
If You find this project useful, Do support me [here](https://github.com/sponsors/nuhmanpk)