https://github.com/open-compass/vlmevalkit

Open-source evaluation toolkit of large vision-language models (LVLMs), support GPT-4v, Gemini, QwenVLPlus, 40+ HF models, 20+ benchmarks
https://github.com/open-compass/vlmevalkit

chatgpt claude clip computer-vision evaluation gemini gpt gpt-4v gpt4 large-language-models llava llm multi-modal openai openai-api pytorch qwen vit vqa

Last synced: 3 months ago
JSON representation

Open-source evaluation toolkit of large vision-language models (LVLMs), support GPT-4v, Gemini, QwenVLPlus, 40+ HF models, 20+ benchmarks

• Host: GitHub
• URL: https://github.com/open-compass/vlmevalkit
• Owner: open-compass
• Created: 2023-12-01T08:18:11.000Z (11 months ago)
• Default Branch: main
• Last Pushed: 2024-05-11T04:14:06.000Z (6 months ago)
• Last Synced: 2024-05-11T05:55:17.939Z (6 months ago)
• Topics: chatgpt, claude, clip, computer-vision, evaluation, gemini, gpt, gpt-4v, gpt4, large-language-models, llava, llm, multi-modal, openai, openai-api, pytorch, qwen, vit, vqa
• Language: Python
• Homepage: https://huggingface.co/spaces/opencompass/open_vlm_leaderboard
• Size: 1.48 MB
• Stars: 424
• Watchers: 8
• Forks: 46
• Open Issues: 15
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

• awesome-ChatGPT-repositories - VLMEvalKit - Open-source evaluation toolkit of large vision-language models (LVLMs), support GPT-4v, Gemini, QwenVLPlus, 30+ HF models, 15+ benchmarks (NLP)