https://github.com/burglarhobbit/Awesome-Medical-Large-Language-Models
Curated papers on Large Language Models in Healthcare and Medical domain
https://github.com/burglarhobbit/Awesome-Medical-Large-Language-Models
List: Awesome-Medical-Large-Language-Models
large-language-models large-vision-language-models multimodal-large-language-models
Last synced: 10 days ago
JSON representation
Curated papers on Large Language Models in Healthcare and Medical domain
- Host: GitHub
- URL: https://github.com/burglarhobbit/Awesome-Medical-Large-Language-Models
- Owner: burglarhobbit
- License: cc0-1.0
- Created: 2023-06-28T01:19:59.000Z (almost 2 years ago)
- Default Branch: main
- Last Pushed: 2025-01-13T05:55:22.000Z (4 months ago)
- Last Synced: 2025-01-13T06:28:37.085Z (4 months ago)
- Topics: large-language-models, large-vision-language-models, multimodal-large-language-models
- Homepage:
- Size: 154 KB
- Stars: 273
- Watchers: 9
- Forks: 32
- Open Issues: 3
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
- ultimate-awesome - Awesome-Medical-Large-Language-Models - Curated papers on Large Language Models in Healthcare and Medical domain. (Other Lists / Julia Lists)
- awesome-latest-LLM - Awesome-Medical-Large-Language-Models
README
# Awesome-Medical-Large-Language-Models [](https://awesome.re)
A curated list of popular Foundation Models in Healthcare. Please submit a pull request to contribute :-)
🤗[Open Medical-LLM Leaderboard](https://huggingface.co/spaces/openlifescienceai/open_medical_llm_leaderboard)
# Table of Contents
- [Large Language Models](#llms)
- [Large Vision Models](#lvms)
- [Survey Papers + Clinical Studies](#survey-studies)
- [Articles](#articles)
## Large Language Models
| Title | Institute | Date | Code
| :---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | :------------------: | :-----------: | :-------------: |
| [PH-LLM](https://arxiv.org/pdf/2405.03162): Towards a Personal Health Large Language Model
[PHIA](https://arxiv.org/pdf/2406.06474) Transforming Wearable Data into Health Insights using Large Language Model Agents | Google Research
| 2024-06 | [Blog](https://research.google/blog/advancing-personal-health-and-wellness-insights-with-ai)
| [Internist.ai](https://doi.org/10.1093/jamia/ocae120): Impact of high-quality, mixed-domain data on the performance of medical language models | Université catholique de Louvain, Cliniques Universitaires Saint-Luc
 | 2024-05 | [HuggingFace](https://huggingface.co/internistai/base-7b-v0.2)
| [Med_Gemini-[2D,3D,Polygenic]](https://arxiv.org/pdf/2405.03162): Advancing Multimodal Medical Capabilities of Gemini | Google Research, DeepMind
 | 2024-05 | [Blog](https://research.google/blog/advancing-medical-ai-with-med-gemini/)
| [MedVersa](https://arxiv.org/pdf/2405.07988): A Generalist Learner for Multifaceted Medical Image Interpretation | Harvard Medical School
 | 2024-05 | -
| [OpenBioLLM-70B](https://huggingface.co/aaditya/Llama3-OpenBioLLM-70B): Advancing Open-source Large Language Models in Medical Domain | Saama AI Labs | 2024-04 | [HuggingFace](https://huggingface.co/aaditya/Llama3-OpenBioLLM-70B)
| [Med-Gemini](https://arxiv.org/pdf/2404.18416): Capabilities of Gemini Models in Medicine | Google Research, DeepMind
 | 2024-04 | -
| [Llama-3[8B]-MeditronV1.0](https://meditron-ddx.github.io/llama3-meditron.github.io/static/images/Meditron_Llama3%20(18h).pdf): — A State-of-the-Art Large Language Model for Medicine in 24 Hours | LiGHT, Yale-EPFL
 | 2024-04 | [Blog](https://meditron-ddx.github.io/llama3-meditron.github.io)
| [Hippocrates](https://arxiv.org/pdf/2404.16621): An Open-Source Framework for Advancing Large Language Models in Healthcare | KUIS AI Center
 | 2024-04 | [HuggingFace](https://huggingface.co/emrecanacikgoz/hippomistral)
| [BioMistral](https://arxiv.org/pdf/2402.10373.pdf): A Collection of Open-Source Pretrained Large Language Models for Medical Domains | LIA - Avignon Université,
Nantes Université  | 2024-02 | [HuggingFace](https://huggingface.co/BioMistral/BioMistral-7B)
| [AMIE](https://arxiv.org/pdf/2401.05654.pdf): Towards Conversational Diagnostic AI | Google Research, DeepMind
 | 2024-01 | -
| [MEDITRON-70B](https://arxiv.org/pdf/2311.16079.pdf): Scaling Medical Pretraining for Large Language Models | EPFL Lausanne
 | 2023-11 | [Hugging🤗](https://huggingface.co/epfl-llm/meditron-70b)
[Github](https://github.com/epfLLM/meditron) 
| [Asclepius](https://arxiv.org/abs/2309.00237): Publicly Shareable Clinical Large Language Model Built on Synthetic Clinical Notes | KAIST
 | 2023-09 | [Hugging🤗](https://huggingface.co/starmpcc/Asclepius-Llama2-7B)
[Github](https://github.com/starmpcc/Asclepius) 
| [Radiology-Llama2](https://arxiv.org/pdf/2309.06419.pdf): Best-in-Class Large Language Model for Radiology | University of Georgia
 | 2023-08 | -
| [CoDoC](https://www.nature.com/articles/s41591-023-02437-x): Enhancing the reliability and accuracy of AI-enabled diagnosis via complementarity-driven deferral to clinicians | DeepMind, Google
 | 2023-07 | [Github](https://github.com/deepmind/codoc/tree/main)
| [Med-PaLM 2](https://arxiv.org/pdf/2305.09617.pdf): Towards Expert-Level Medical Question Answering with Large Language Models | Google
 | 2023-05 | -
| [Clinical Camel](https://arxiv.org/pdf/2305.12031.pdf): An Open-Source Expert-Level Medical Language Model with Dialogue-Based Knowledge Encoding | Vector Institute,
University of Toronto
 | 2023-05 | [Hugging🤗](https://huggingface.co/wanglab/ClinicalCamel-70B)
[Github](https://github.com/bowang-lab/clinical-camel) 
| [MEDALPACA](https://arxiv.org/pdf/2304.08247.pdf) - AN OPEN-SOURCE COLLECTION OF MEDICAL CONVERSATIONAL AI MODELS AND TRAINING DATA | University Hospital Aachen
 | 2023-04 | [Hugging🤗](https://huggingface.co/medalpaca/medalpaca-7b)
[Github](https://github.com/kbressem/medAlpaca) 
| [PMC-LLaMA](https://arxiv.org/pdf/2304.14454.pdf): Towards Building Open-source Language Models for Medicine | CMIC, Shanghai Jiao Tong University
Shanghai AI Laboratory  | 2023-04 | [Hugging🤗](https://huggingface.co/chaoyi-wu/PMC_LLAMA_7B)
[Github](https://github.com/chaoyi-wu/PMC-LLaMA) 
| [ChatDoctor](https://arxiv.org/ftp/arxiv/papers/2303/2303.14070.pdf): A Medical Chat Model Fine-Tuned on a Large Language Model Meta-AI (LLaMA) Using Medical Domain Knowledge | University of Texas
 | 2023-03 | [Github](https://github.com/Kent0n-Li/ChatDoctor) 
| [BioMedLM-PubMedGPT](https://crfm.stanford.edu/2022/12/15/biomedlm.html): A purpose-built AI model trained to interpret biomedical language | Stanford CRFM, MosaicML | 2022-12 | [HuggingFace](https://huggingface.co/stanford-crfm/BioMedLM)
| [Med-PaLM](https://arxiv.org/pdf/2212.13138.pdf): Large Language Models Encode Clinical Knowledge | Google
 | 2022-12 | [Github](https://github.com/conceptofmind/PaLM)
| [ClinicalT5](https://aclanthology.org/2022.findings-emnlp.398.pdf): A Generative Language Model for Clinical Text | University of Oregon, Baidu
 | 2022-12 | [HuggingFace](https://huggingface.co/luqh/ClinicalT5-large)
| [GatorTron](https://www.nature.com/articles/s41746-022-00742-2): A large language model for electronic health records | University of Florida, NVIDIA
 | 2022-12 | [HuggingFace](https://huggingface.co/UFNLP/gatortron-base)
| [BioGPT](https://aclanthology.org/2020.clinicalnlp-1.17/): Generative Pre-trained Transformer for Biomedical Text Generation and Mining | Microsoft Research
 | 2022-09 | [HuggingFace](https://huggingface.co/microsoft/biogpt)
| [BioBART](https://arxiv.org/pdf/2204.03905.pdf): Pretraining and Evaluation of A Biomedical Generative Language Model | Tsinghua University
 | 2022-04 | [HuggingFace](https://huggingface.co/GanjinZero/biobart-v2-base)
| [KeBioLM](https://aclanthology.org/2021.bionlp-1.20.pdf): Improving Biomedical Pretrained Language Models with Knowledge | Tsinghua, Alibaba
 | 2021-04 | [Github](https://github.com/GanjinZero/KeBioLM)
| [Pretrained Language Models for Biomedical and Clinical Tasks: Understanding and Extending the State-of-the-Art](https://aclanthology.org/2020.clinicalnlp-1.17/) | Meta
 | 2020-11 | [Github](https://github.com/facebookresearch/bio-lm)
| [BioMegatron](https://aclanthology.org/2020.emnlp-main.379.pdf): Larger Biomedical Domain Language Model | NVIDIA
 | 2020-10 | [HuggingFace](https://huggingface.co/EMBO/BioMegatron345mUncased)
| [PubMedBERT](https://arxiv.org/pdf/2007.15779.pdf): Domain-Specific Language Model Pretraining for Biomedical Natural Language Processing | Microsoft Research
 | 2020-07 | [HuggingFace](https://huggingface.co/microsoft/BiomedNLP-PubMedBERT-base-uncased-abstract-fulltext)
| [Publicly Available Clinical BERT Embeddings](https://arxiv.org/pdf/1904.03323.pdf) | MIT CSAIL
 | 2019-04 | [HuggingFace](https://huggingface.co/emilyalsentzer/Bio_ClinicalBERT)
| [ClinicalBERT](https://arxiv.org/pdf/1904.05342.pdf): Modeling Clinical Notes and Predicting Hospital Readmission | Harvard, Princeton, NYU
 | 2019-04 | [Github](https://github.com/kexinhuang12345/clinicalBERT)
| [BioBERT](https://arxiv.org/pdf/1901.08746): a pre-trained biomedical language representation model for biomedical text mining | Korea University
 | 2019‑01 | [Github](https://github.com/dmis-lab/biobert)
## Large Vision Models
| Title | Institute | Date | Code
| :---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | :------------------: | :-----------: | :---------: |
| [LLaVA-Med](https://arxiv.org/pdf/2306.00890): Training a Large Language-and-Vision Assistant for Biomedicine in One Day | Microsoft Research
 | 2023-06 | [Hugging🤗](https://huggingface.co/microsoft/llava-med-7b-delta)
[Github](https://github.com/microsoft/LLaVA-Med) 
| [Segment anything model for medical image analysis: An experimental study](https://arxiv.org/pdf/2304.10517) | Duke University
 | 2023-04 | [Github](https://github.com/mazurowski-lab/segment-anything-medical-evaluation)
| [BiomedCLIP](https://arxiv.org/pdf/2303.00915): a multimodal biomedical foundation model pretrained from fifteen million scientific image-text pairs | Microsoft Research
 | 2023-03 | [HuggingFace](https://huggingface.co/microsoft/BiomedCLIP-PubMedBERT_256-vit_base_patch16_224)
## Survey Papers + Clinical Studies
| Title | Institute | Date
| :---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | :------------------: | :-----------: |
| [Integrating human expertise & automated methods for a dynamic and multi-parametric evaluation of large language models’ feasibility in clinical decision-making](https://www.sciencedirect.com/science/article/pii/S1386505624001643) | University of {Bari, Rome}
 | 2024-05
| [Opportunities and challenges for ChatGPT and large language models in biomedicine and health](https://academic.oup.com/bib/article/25/1/bbad493/7505071) | NIH
 | 2024-01
| [Evaluating the Medical Knowledge of Open LLMs - Part 1](https://www.medarc.ai/blog/medarc-llms-eval-part-1) | MedARC
 | 2024-01
| [A Survey of Large Language Models in Medicine: Principles, Applications, and Challenges](https://arxiv.org/pdf/2311.05112.pdf) | University of Oxford
 | 2023-11
| [Exploring the Boundaries of GPT-4 in Radiology](https://arxiv.org/pdf/2310.14573.pdf) | Microsoft, Harvard University
 | 2023-10
| [A Survey of Large Language Models for Healthcare: from Data, Technology, and Applications to Accountability and Ethics](https://arxiv.org/pdf/2310.05694.pdf) | IEEE members
 | 2023-10
| [Capabilities of GPT-4 on Medical Challenge Problems](https://arxiv.org/pdf/2303.13375.pdf) | Microsoft, OpenAI
 | 2023-03
| [Do We Still Need Clinical Language Models?](https://arxiv.org/pdf/2302.08091) | MIT, Xyla
 | 2023-02
## Articles
| Title | Institute | Date
| :---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | :------------------: | :-----------: |
| [The future landscape of large language models in medicine](https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10564921/) | TUD Dresden
 | 2023-10