{"id":28653934,"url":"https://github.com/tiger-ai-lab/viescore","last_synced_at":"2025-06-13T07:08:13.398Z","repository":{"id":213760821,"uuid":"734561473","full_name":"TIGER-AI-Lab/VIEScore","owner":"TIGER-AI-Lab","description":"Visual Instruction-guided Explainable Metric. Code for \"Towards Explainable Metrics for Conditional Image Synthesis Evaluation\" (ACL 2024 main)","archived":false,"fork":false,"pushed_at":"2024-11-19T01:46:51.000Z","size":22635,"stargazers_count":28,"open_issues_count":0,"forks_count":1,"subscribers_count":4,"default_branch":"main","last_synced_at":"2024-11-19T02:31:33.996Z","etag":null,"topics":["computer-vision","gpt4vision","image-editing","image-generation","visual-question-answering"],"latest_commit_sha":null,"homepage":"https://tiger-ai-lab.github.io/VIEScore/","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/TIGER-AI-Lab.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2023-12-22T02:20:44.000Z","updated_at":"2024-11-19T02:21:59.000Z","dependencies_parsed_at":"2023-12-22T22:26:06.214Z","dependency_job_id":"f806f74e-9ec0-4b00-968a-b7334f85a389","html_url":"https://github.com/TIGER-AI-Lab/VIEScore","commit_stats":null,"previous_names":["tiger-ai-lab/viescore"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/TIGER-AI-Lab/VIEScore","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/TIGER-AI-Lab%2FVIEScore","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/TIGER-AI-Lab%2FVIEScore/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/TIGER-AI-Lab%2FVIEScore/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/TIGER-AI-Lab%2FVIEScore/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/TIGER-AI-Lab","download_url":"https://codeload.github.com/TIGER-AI-Lab/VIEScore/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/TIGER-AI-Lab%2FVIEScore/sbom","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":259599330,"owners_count":22882357,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["computer-vision","gpt4vision","image-editing","image-generation","visual-question-answering"],"created_at":"2025-06-13T07:08:11.506Z","updated_at":"2025-06-13T07:08:13.379Z","avatar_url":"https://github.com/TIGER-AI-Lab.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# VIEScore\n[![arXiv](https://img.shields.io/badge/arXiv-2312.14867-b31b1b.svg)](https://arxiv.org/abs/2312.14867)\n\n[![contributors](https://img.shields.io/github/contributors/TIGER-AI-Lab/VIEScore)](https://github.com/TIGER-AI-Lab/VIEScore/graphs/contributors)\n[![license](https://img.shields.io/github/license/TIGER-AI-Lab/VIEScore.svg)](https://github.com/TIGER-AI-Lab/VIEScore/blob/main/LICENSE)\n[![GitHub](https://img.shields.io/github/stars/TIGER-AI-Lab/VIEScore?style=social)](https://github.com/TIGER-AI-Lab/VIEScore)\n[![Hits](https://hits.seeyoufarm.com/api/count/incr/badge.svg?url=https%3A%2F%2Fgithub.com%2FTIGER-AI-Lab%2FVIEScore\u0026count_bg=%23C83DB9\u0026title_bg=%23555555\u0026icon=\u0026icon_color=%23E7E7E7\u0026title=visitors\u0026edge_flat=false)](https://hits.seeyoufarm.com)\n\nThis repository hosts the code and data of our ACL 2024 Paper [VIEScore: Towards Explainable Metrics for Conditional Image Synthesis Evaluation](https://tiger-ai-lab.github.io/VIEScore/).\n\nVIEScore is a Visual Instruction-guided Explainable metric for evaluating any conditional image generation tasks.\n\n\u003cdiv align=\"center\"\u003e\n 🔥 🔥 🔥 Check out our \u003ca href = \"https://tiger-ai-lab.github.io/VIEScore/\"\u003e[Project Page and Leaderboard]\u003c/a\u003e for more results and analysis!\n\u003c/div\u003e\n\n\u003cdiv align=\"center\"\u003e\n\u003cimg src=\"https://github.com/TIGER-AI-Lab/VIEScore/blob/gh-pages/static/images/teaser.png\" width=\"100%\"\u003e\n  Metrics in the future would provide the score and the rationale, enabling the understanding of each judgment. Which method (VIEScore or traditional metrics) is “closer” to the human perspective?\n\u003c/div\u003e\n\n## 📰 News\n* 2024 Jun 17: We released the standalone version of VIEScore.\n* 2024 May 23: We released all the results and notebook to visualize the results.\n* 2024 May 23: Added Gemini-1.5-pro results.\n* 2024 May 16: Added GPT4o results and we found that GPT4o achieve on par correlation with human across all tasks!\n* 2024 May 15: VIEScore is accepted to ACL2024 (main)! \n* 2024 Jan 11: Code is released!\n* 2023 Dec 24: Paper available on [Arxiv](https://arxiv.org/abs/2312.14867). Code coming Soon!\n\n![](https://tiger-ai-lab.github.io/VIEScore/static/images/method.png)\n\u003e VIEScore gives an SC(semantic consistency score), PQ(perceptual quality score), and O (Overall score) to evaluate your image/video.\n\n## Paper implementation\n\nSee https://github.com/TIGER-AI-Lab/VIEScore/tree/main/paper_implementation\n\n```python\n$ python3 run.py --help\nusage: run.py [-h] [--task {tie,mie,t2i,cig,sdig,msdig,sdie}] [--mllm {gpt4v, gpt4o, llava,blip2,fuyu,qwenvl,cogvlm,instructblip,openflamingo, gemini}] [--setting {0shot,1shot}] [--context_file CONTEXT_FILE]\n              [--guess_if_cannot_parse]\n\nRun different task on VIEScore.\n\noptional arguments:\n  -h, --help            show this help message and exit\n  --task {tie,mie,t2i,cig,sdig,msdig,sdie}\n                        Select the task to run\n  --mllm {gpt4v, gpt4o, llava,blip2,fuyu,qwenvl,cogvlm,instructblip,openflamingo, gemini}\n                        Select the MLLM model to use\n  --setting {0shot,1shot}\n                        Select the incontext learning setting\n  --context_file CONTEXT_FILE\n                        Which context file to use.\n  --guess_if_cannot_parse\n                        Guess a value if the output cannot be parsed.\n```\n\n## Standard Version (For Development and Extension)\n\nSee https://github.com/TIGER-AI-Lab/VIEScore/tree/main/viescore\n\n```python\nfrom viescore import VIEScore\nbackbone = \"gemini\"\nvie_score = VIEScore(backbone=backbone, task=\"t2v\")\n\nscore_list = vie_score.evaluate(pil_image, text_prompt)\nsementics_score, quality_score, overall_score = score_list\n```\n\n\n## Paper Results\n\n\u003cdiv align=\"center\"\u003e\n\u003cimg src=\"https://tiger-ai-lab.github.io/VIEScore/static/images/table_overall_new.png\" width=\"50%\"\u003e\n\u003c/div\u003e\n\n## Citation\n\nPlease kindly cite our paper if you use our code, data, models or results:\n\n```bibtex\n@misc{ku2023viescore,\n                title={VIEScore: Towards Explainable Metrics for Conditional Image Synthesis Evaluation}, \n                author={Max Ku and Dongfu Jiang and Cong Wei and Xiang Yue and Wenhu Chen},\n                year={2023},\n                eprint={2312.14867},\n                archivePrefix={arXiv},\n                primaryClass={cs.CV}\n            }\n```\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Ftiger-ai-lab%2Fviescore","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Ftiger-ai-lab%2Fviescore","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Ftiger-ai-lab%2Fviescore/lists"}