https://github.com/x-plug/mplug-halowl

mPLUG-HalOwl: Multimodal Hallucination Evaluation and Mitigating
https://github.com/x-plug/mplug-halowl

benchmark contrastive-learning hallucinations mllm multimodal-hallucination multimodal-large-language-models

Last synced: 10 months ago
JSON representation

mPLUG-HalOwl: Multimodal Hallucination Evaluation and Mitigating

• Host: GitHub
• URL: https://github.com/x-plug/mplug-halowl
• Owner: X-PLUG
• License: mit
• Created: 2024-01-18T12:05:09.000Z (over 2 years ago)
• Default Branch: main
• Last Pushed: 2024-01-29T03:35:53.000Z (over 2 years ago)
• Last Synced: 2025-06-26T06:38:17.186Z (12 months ago)
• Topics: benchmark, contrastive-learning, hallucinations, mllm, multimodal-hallucination, multimodal-large-language-models
• Language: Python
• Homepage:
• Size: 13.9 MB
• Stars: 95
• Watchers: 2
• Forks: 2
• Open Issues: 8
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

          
# mPLUG-HalOwl: Multimodal Hallucination Evaluation and Mitigating

![logo](owl.png?v=1&type=image)

# Works

 - [AMBER](https://github.com/X-PLUG/mPLUG-HalOwl/tree/main/AMBER) --- An Automated Multi-dimensional Benchmark for Multi-modal Hallucination Evaluation ![logo](AMBER.jpg?v=1&type=image)

 - [HACL](https://arxiv.org/abs/2312.06968) --- Hallucination Augmented Contrastive Learning for Multimodal Large Language Model. ![logo](hacl.png?v=1&type=image)

 - [HaELM](https://github.com/X-PLUG/mPLUG-HalOwl/tree/main/HaELM) --- An automatic MLLM hallucination detection framework.![logo](HaELM.png?v=1&type=image)

# License

The content of this project itself is licensed under [LICENSE](LICENSE).

# Citation

If you found our works useful, consider giving this repository a star and citing our paper as followed:

```

@article{wang2023llm,

  title={An LLM-free Multi-dimensional Benchmark for MLLMs Hallucination Evaluation},

  author={Wang, Junyang and Wang, Yuhang and Xu, Guohai and Zhang, Jing and Gu, Yukai and Jia, Haitao and Yan, Ming and Zhang, Ji and Sang, Jitao},

  journal={arXiv preprint arXiv:2311.07397},

  year={2023}

}

```

```

@misc{jiang2023hallucination,

      title={Hallucination Augmented Contrastive Learning for Multimodal Large Language Model}, 

      author={Chaoya Jiang and Haiyang Xu and Mengfan Dong and Jiaxing Chen and Wei Ye and Ming Yan and Qinghao Ye and Ji Zhang and Fei Huang and Shikun Zhang},

      year={2023},

      eprint={2312.06968},

      archivePrefix={arXiv},

      primaryClass={cs.CV}

}

```

```

@article{wang2023evaluation,

  title={Evaluation and Analysis of Hallucination in Large Vision-Language Models},

  author={Wang, Junyang and Zhou, Yiyang and Xu, Guohai and Shi, Pengcheng and Zhao, Chenlin and Xu, Haiyang and Ye, Qinghao and Yan, Ming and Zhang, Ji and Zhu, Jihua and others},

  journal={arXiv preprint arXiv:2308.15126},

  year={2023}

}

```