Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/camenduru/ShareGPT4V-colab

Last synced: about 2 months ago
JSON representation

Host: GitHub
URL: https://github.com/camenduru/ShareGPT4V-colab
Owner: camenduru
Created: 2023-11-23T08:40:30.000Z (10 months ago)
Default Branch: main
Last Pushed: 2023-12-19T01:01:47.000Z (9 months ago)
Last Synced: 2024-07-04T22:59:26.882Z (2 months ago)
Language: Jupyter Notebook
Size: 86.9 KB
Stars: 31
Watchers: 4
Forks: 2
Open Issues: 1
Metadata Files:
- Readme: README.md

Awesome Lists containing this project

StarryDivineSky - camenduru/ShareGPT4V-colab - Vision 收集的精选 100K 高质量字幕，并已扩展到 120 万，并在这个子集上训练了出色的字幕模型。ShareGPT4V 首先证明了其在监督微调（SFT）阶段的有效性，方法是用我们的高质量字幕子集替换现有 SFT 数据集中等量的详细字幕，显着增强了 MME 和 MMBench 基准测试上的 LLaVA-7B、LLaVA-1.5-13B 和 Qwen-VL-Chat-7B 等 LMM，分别获得了 222.8/22.0/22.3 和 2.7/1.3/1.5。我们进一步将 ShareGPT4V 数据整合到预训练和 SFT 阶段，获得了 ShareGPT4V-7B，这是一款基于简单架构的卓越 LMM，在大多数多模态基准测试中具有卓越的性能。 (其他_机器视觉 / 网络服务_其他)

README

        🐣 Please follow me for new updates https://twitter.com/camenduru 


🔥 Please join our discord server https://discord.gg/k5BwmmvJJU 


🥳 Please join my patreon community https://patreon.com/camenduru 


# 🚦 WIP 🚦

## 🦒 Colab

| Colab | Info

| --- | --- |

[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/camenduru/ShareGPT4V-colab/blob/main/ShareGPT4V_colab.ipynb) | ShareGPT4V_colab (7B 16bit Pro Colab 😐)

[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/camenduru/ShareGPT4V-colab/blob/main/ShareGPT4V_8bit_colab.ipynb) | ShareGPT4V_8bit_colab (7B 8bit Free Colab T4)

## 🦆 Kaggle

| Kaggle | Info

| --- | --- |

[![open_in_kaggle_small](https://user-images.githubusercontent.com/54370274/228924833-17316feb-d0fe-4249-90ba-682930ba11e5.svg)](https://kaggle.com/camenduru/sharegpt4v) | sharegpt4v_kaggle (7B 16bit Free Kaggle T4)

## Main Repo

https://github.com/InternLM/InternLM-XComposer/tree/main/projects/ShareGPT4V 


https://github.com/haotian-liu/LLaVA 


## Paper

https://arxiv.org/abs/2311.12793

## Page

https://sharegpt4v.github.io/

## Output

![Screenshot 2023-11-23 114102](https://github.com/camenduru/ShareGPT4V-colab/assets/54370274/3acfa3c6-19c2-40dd-9252-f807c0a08a16)