https://github.com/x-plug/mplug-owl

mPLUG-Owl: The Powerful Multi-modal Large Language Model Family
https://github.com/x-plug/mplug-owl

alpaca chatbot chatgpt damo dialogue gpt gpt4 gpt4-api huggingface instruction-tuning large-language-models llama mplug mplug-owl multimodal pretraining pytorch transformer video visual-recognition

Last synced: 29 days ago
JSON representation

mPLUG-Owl: The Powerful Multi-modal Large Language Model Family

• Host: GitHub
• URL: https://github.com/x-plug/mplug-owl
• Owner: X-PLUG
• License: mit
• Created: 2023-04-25T02:31:04.000Z (over 1 year ago)
• Default Branch: main
• Last Pushed: 2024-09-23T08:05:50.000Z (about 2 months ago)
• Last Synced: 2024-10-10T07:07:23.330Z (29 days ago)
• Topics: alpaca, chatbot, chatgpt, damo, dialogue, gpt, gpt4, gpt4-api, huggingface, instruction-tuning, large-language-models, llama, mplug, mplug-owl, multimodal, pretraining, pytorch, transformer, video, visual-recognition
• Language: Python
• Homepage: https://www.modelscope.cn/studios/damo/mPLUG-Owl
• Size: 32.8 MB
• Stars: 2,265
• Watchers: 31
• Forks: 171
• Open Issues: 94
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

• awesome-ChatGPT-repositories - mPLUG-Owl - [Official Implementation] mPLUG-Owl & mPLUG-Owl2: Alibaba MLLM Family. (Chatbots)

README

        


mPLUG-Owl: The Powerful MLLM Family




![summary_tab](https://z1.ax1x.com/2023/11/03/piM1rGQ.md.png)

- [**mPLUG-Owl**](mPLUG-Owl) (Arxiv 2023) - mPLUG-Owl: Modularization Empowers Large Language Models with Multimodality

- [**mPLUG-Owl2**](mPLUG-Owl2) (Arxiv 2023) - mPLUG-Owl2: Revolutionizing Multi-modal Large Language Model with Modality Collaboration

- [**mPLUG-Owl3**](mPLUG-Owl3) (Arxiv 2024) - mPLUG-Owl3: Towards Long Image-Sequence Understanding in Multi-Modal Large Language Models

## News and Updates

* ```2024.08.12``` 🔥🔥🔥 We release **mPLUG-Owl3**. The source code and weights are avaliable at [HuggingFace](https://huggingface.co/mPLUG/mPLUG-Owl3-7B-240728).

* ```2024.04.05``` **mPLUG-Owl2** is accepted by CVPR 2024 as a Highlight.

* ```2024.02.01``` We relaese **mPLUG-Owl2.1**, a Chinese enhanced version of mPLUG-Owl2. The weight is available at [HuggingFace](https://huggingface.co/Mizukiluke/mplug_owl_2_1).

## License

The content of this project itself is licensed under [LICENSE](LICENSE).

## Misc



[![Stargazers repo roster for @X-PLUG/mPLUG-Owl](https://reporoster.com/stars/X-PLUG/mPLUG-Owl)](https://github.com/X-PLUG/mPLUG-Owl/stargazers)

[![Forkers repo roster for @X-PLUG/mPLUG-Owl](https://reporoster.com/forks/X-PLUG/mPLUG-Owl)](https://github.com/X-PLUG/mPLUG-Owl/network/members)

[![Star History Chart](https://api.star-history.com/svg?repos=X-PLUG/mPLUG-Owl&type=Date)](https://star-history.com/#X-PLUG/mPLUG-Owl&Date)