Data

Tools

Indexes

Applications

Experiments

Awesome

An open API service indexing awesome lists of open source software.

awesome-ai4med

A curated list of medical LLMs, multimodal systems, datasets, benchmarks, and more. 🏥
https://github.com/freedomintelligence/awesome-ai4med

Last synced: 10 days ago
JSON representation

  • 1. Medical LLMs

    • [arXiv - 7B)][[HF (13B)](https://huggingface.co/FreedomIntelligence/HuatuoGPT-13b-delta)]|[[HF](https://huggingface.co/datasets/FreedomIntelligence/HuatuoGPT-sft-data-v1)]|[[Github](https://github.com/FreedomIntelligence/HuatuoGPT)]|
    • [arXiv - 7B)][[HF (34B)](https://huggingface.co/FreedomIntelligence/Apollo-34B)][[HF (72B)](https://huggingface.co/FreedomIntelligence/Apollo-72B)]|[[HF](https://huggingface.co/datasets/FreedomIntelligence/ApolloCorpus)]|[[Github](https://github.com/FreedomIntelligence/Apollo)]|
    • [arXiv - 7B)][[HF (13B)](https://huggingface.co/FreedomIntelligence/HuatuoGPT2-13B)][[HF (34B)](https://huggingface.co/FreedomIntelligence/HuatuoGPT2-34B)]|[[HF (PT)](https://huggingface.co/datasets/FreedomIntelligence/HuatuoGPT2-Pretraining-Instruction)][[HF (SFT)](https://huggingface.co/datasets/FreedomIntelligence/HuatuoGPT2-SFT-GPT4-140K)]|[[Github](https://github.com/FreedomIntelligence/HuatuoGPT-II)]|
    • [arXiv - o1-7B)][[HF (8B)](https://huggingface.co/FreedomIntelligence/HuatuoGPT-o1-8B)][[HF (70B)](https://huggingface.co/FreedomIntelligence/HuatuoGPT-o1-70B)]|[[HF](https://huggingface.co/datasets/FreedomIntelligence/medical-o1-reasoning-SFT)]|[[Github](https://github.com/FreedomIntelligence/HuatuoGPT-o1)]|
    • [arXiv - Llama-3-8B)][[HF (70B)](https://huggingface.co/Henrychur/MMed-Llama3.1-70B)]|[[HF](https://huggingface.co/datasets/Henrychur/MMedC)]|[[Github](https://github.com/MAGIC-AI4Med/MMedLM)]|
    • [arXiv - wu/PMC-LLaMA)]|
    • [arXiv - health/Llama3-Med42-8B)][[HF (70B)](https://huggingface.co/m42-health/Llama3-Med42-70B)]|-|[[Github](https://github.com/m42-health/med42)]|
    • [HF (8B) - OpenBioLLM-70B)]|-|-|
    • [arXiv - 3-8B-UltraMedical)][[HF (70B)](https://huggingface.co/TsinghuaC3I/Llama-3-70B-UltraMedical)]|[[HF](https://huggingface.co/datasets/TsinghuaC3I/UltraMedical)]|[[Github](https://github.com/TsinghuaC3I/UltraMedical)]|
    • [arXiv - 7B)]|-|[[Github](https://github.com/BioMistral/BioMistral)]|
    • [arXiv - llm/meditron-7b)][[HF (70B)](https://huggingface.co/epfl-llm/meditron-70b)]|[[HF](https://huggingface.co/datasets/togethercomputer/RedPajama-Data-1T)]|[[Github](https://github.com/epfLLM/meditron)]|
    • [arXiv - inc/Baichuan-M2-32B)]|-|[[Github](https://github.com/baichuan-inc/Baichuan-M2-32B)]|
    • [arXiv - inc/Baichuan-M1-14B-Instruct)]|-|[[Github](https://github.com/baichuan-inc/Baichuan-M1-14B)]|
    • [arXiv - 7b)][[HF (13B)](https://huggingface.co/medalpaca/medalpaca-13b)]|[[Github](https://github.com/kbressem/medAlpaca/blob/main/DATA_DESCRIPTION.md)]|[[Github](https://github.com/kbressem/medAlpaca)]|
    • [arXiv - wu/RadFM)]|[[Github](https://huggingface.co/datasets/chaoyi-wu/RadFM_data_csv)]|[[Github](https://github.com/chaoyi-wu/RadFM)]|
    • [arXiv - VLAA/MedReason-8B)]|[[HF](https://huggingface.co/datasets/UCSC-VLAA/MedReason)]|[[Github](https://github.com/UCSC-VLAA/MedReason)]|
    • [arXiv - 7B-instruct-rl)][[HF (8B)](https://huggingface.co/che111/AlphaMed-8B-instruct-rl)]|[[HF](https://huggingface.co/datasets/che111/AlphaMed19K)]|-|
    • [arXiv - R1-7B)][[HF (32B)](https://huggingface.co/UbiquantAI/Fleming-R1-32B)]|-|[[Github](https://github.com/UbiquantAI/Fleming-R1)]|
    • [arXiv - 27b-text-it)]|-|[[Github](https://github.com/Google-Health/medgemma)]|
    • [HF (100B) - |[[Github](https://github.com/MedAIBase/AntAngelMed)]|
    • [HF (235B) - |-|
    • Blog - |-|
    • [arXiv - |-|

  • 2. Medical MLLMs

    • [arXiv - Vision-7B)][[HF 34B](https://huggingface.co/FreedomIntelligence/HuatuoGPT-Vision-34B)]|[[HF](https://huggingface.co/datasets/FreedomIntelligence/PubMedVision)]|[[Github](https://github.com/FreedomIntelligence/HuatuoGPT-Vision)]|
    • [arXiv - 7B-Omni)][[HF (32B)](https://huggingface.co/FreedomIntelligence/ShizhenGPT-32B-VL)]|[[HF (PT)](https://huggingface.co/datasets/FreedomIntelligence/TCM-Pretrain-Data-ShizhenGPT)][[HF (SFT)](https://huggingface.co/datasets/FreedomIntelligence/TCM-Instruction-Tuning-ShizhenGPT)]|[[Github](https://github.com/FreedomIntelligence/ShizhenGPT)]|
    • [arXiv - medical-mllm/Lingshu-7B)][[HF 32B](https://huggingface.co/lingshu-medical-mllm/Lingshu-32B)]|-|-|
    • [arXiv - med-v1.5-mistral-7b)]|[[Github](https://github.com/microsoft/LLaVA-Med/tree/main/data)]|[[Github](https://github.com/microsoft/LLaVA-Med)]|
    • [arXiv - 8B)][[HF (70B)](https://huggingface.co/MBZUAI/BiMediX2-70B)]|[[Github](https://github.com/microsoft/LLaVA-Med/tree/main/data)]|[[Github](https://github.com/mbzuai-oryx/BiMediX2)]|
    • [arXiv - AI4H/Hulu-Med-4B)][[HF (7B)](https://huggingface.co/ZJU-AI4H/Hulu-Med-7B)][[HF (14B)](https://huggingface.co/ZJU-AI4H/Hulu-Med-14B)][[HF (32B)](https://huggingface.co/ZJU-AI4H/Hulu-Med-32B)]||[[Github](https://github.com/ZJUI-AI4H/Hulu-Med)]|
    • [arXiv - flamingo/med-flamingo)]|-|[[Github](https://github.com/snap-stanford/med-flamingo)]|
    • [arXiv - R1)]|-|[[Github](https://github.com/Yuxiang-Lai117/Med-R1)]|
    • [arXiv - LM-7B)]|[[Github](https://github.com/taokz/BiomedGPT/blob/main/datasets.md)]|[[Github](https://github.com/taokz/BiomedGPT)]|
    • [arXiv - R1)]|-|[[Github](https://github.com/JZPeterPan/MedVLM-R1)]|
    • [arXiv - Medical-AI/UniMedVL)]|-|[[Github](https://github.com/uni-medical/UniMedVL)]|
    • [arXiv - o1-2B)][[HF (8B)](https://huggingface.co/manglu3935/Chiron-o1-8B)]|-|[[Github](https://github.com/manglu097/Chiron-o1)]|
    • [arXiv - CAIR/MiniGPT-Med?tab=readme-ov-file#download-minigpt-med-trained-model-weights)]|[[Github](https://github.com/Vision-CAIR/MiniGPT-Med?tab=readme-ov-file#dataset)]|[[Github](https://github.com/Vision-CAIR/MiniGPT-Med)]|
    • [arXiv - VL-8B)][[HF (38B)](https://huggingface.co/UbiquantAI/Fleming-VL-38B)]|-|[[Github](https://github.com/UbiquantAI/Fleming-VL)]|
    • [arXiv - VILA-M3-3B)][[HF (8B)](https://huggingface.co/MONAI/Llama3-VILA-M3-8B)][[HF (13B)](https://huggingface.co/MONAI/Llama3-VILA-M3-13B)]|-|[[Github](https://github.com/Project-MONAI/VLM-Radiology-Agent-Framework)]|
    • [Blog - 1.5-4b-it)]|-|[[Github](https://github.com/google-health/medgemma)]|
    • [arXiv - R1-2B)][[HF (8B)](https://huggingface.co/MBZUAI/MediX-R1-8B)][[HF (30B)](https://huggingface.co/MBZUAI/MediX-R1-30B)]|[[HF](https://huggingface.co/datasets/MBZUAI/medix-rl-data)]|[[Github](https://github.com/mbzuai-oryx/MediX-R1)]|
    • [arXiv - 4B)][[HF (8B)](https://huggingface.co/MBZUAI/MedMO-8B)][[HF (8B-Next)](https://huggingface.co/MBZUAI/MedMO-8B-Next)]|-|[[Github](https://github.com/genmilab/MedMO)]|
    • [arXiv - |-|-|
    • [arXiv - 7B)]|-|-|
    • [arXiv - Med-VL-7B)][[HF (32B)](https://huggingface.co/ddvd233/QoQ-Med-VL-32B)]|-|[[Github](https://github.com/DDVD233/QoQ_Med)]|
    • [arXiv - VLAA/medvlthinker)]|[[HF](https://huggingface.co/collections/UCSC-VLAA/medvlthinker-688f52224fb7ff7d965d581d)]|[[Github](https://github.com/UCSC-VLAA/MedVLThinker)]|
    • [arXiv - algo/Citrus-V-8B-v1.0)]|[[HF](https://huggingface.co/datasets/jdh-algo/MeCoVQA-G-Plus)]|[[Github](https://github.com/jdh-algo/Citrus-V)]|
    • [arXiv - DAMO-Academy/ClinFusion-8B)][[HF (32B)](https://huggingface.co/Alibaba-DAMO-Academy/ClinFusion-32B)]|-|[[Github](https://github.com/alibaba-damo-academy/ClinFusion)]|

  • 3. Datasets

  • 4. Benchmarks

    • 3.2 Multimodal

      • [Github - Medical-test`, `MMMU-Medical-val`, `PMC_VQA`, `OmniMedVQA`, `IU XRAY`, `MedXpertQA-Multimodal`, `CheXpert Plus`, `MIMIC-CXR`, `VQA-RAD`, `SLAKE`, `PATH-VQA`, `MedFrameQA`；**（2）Text-only：**：`MedQA-USMLE`, `MedMCQA`, `PubMedQA`, `Medbullets-op4`, `Medbullets-op5`, `MedXpertQA-Text`, `SuperGPQA`, `HealthBench`, `CMB`, `CMExam`, `CMMLU`, `MedQA-MCMLE`；|
      • [Website - only：**：`Med-Exam`, `MedHC`, `MedMC`, `MedSpeQA`, `MedHG`, `MedDG`, `MedLitQA`, `IMCS-V2-MRG`, `DBMHG`, `CMB-Clin-extended`, `DDx-basic`, `DDx-advanced`, `MedTreat`, `CMeEE`, `CMeIE`, `CHIP-CDEE`, `CHIP-CDN`, `CHIP-CTC`, `SMDoc`, `MedSafety`, `DrugCA`, `CriID`|
      • ![Star History Chart - history.com/#FreedomIntelligence/Medical_NLP)
      • ![Star History Chart - history.com/#FreedomIntelligence/Medical_NLP)
      • [Github - |
      • [Website
      • [Website - |
      • ![Star History Chart - history.com/#FreedomIntelligence/Awesome-AI4Med)
      • ![Star History Chart - history.com/#FreedomIntelligence/Awesome-AI4Med)
      • [Github
Programming Languages
Python 1
Categories
2. Medical MLLMs 24 3. Datasets 23 1. Medical LLMs 23 4. Benchmarks 10
Sub Categories
3.2 Multimodal 28 3.1 Text 5
Keywords
multimodal 1 medicalai 1 llm 1 evaluation-framework 1