A collection of resources on applications of multi-modal learning in medical imaging.

Foundation models based medical image analysis

Awesome radiology report generation and image captioning papers.

Code for the paper "ORGAN: Observation-Guided Radiology Report Generation via Tree Reasoning" (ACL'23).

Code for the paper "RADAR: Enhancing Radiology Report Generation with Supplementary Knowledge Injection" (ACL'25).

Code used for the MLMI 2021 paper Clinically Correct Report Generation from Chest X-Rays Using Templates

Code for the paper "RECAP: Towards Precise Radiology Report Generation via Dynamic Disease Progression Reasoning" (EMNLP'23 Findings).

Official implementation of "UniMedVL: Unifying Medical Multimodal Understanding and Generation through Observation-Knowledge-Analysis" - A unified medical vision-language model that integrates multimodal understanding and generation capabilities.

Code for the paper "ICON: Improving Inter-Report Consistency in Radiology Report Generation via Lesion-aware Mixup Augmentation" (EMNLP'24 Findings).

[IJBHI 2024] This is the official implementation of CAMANet: Class Activation Map Guided Attention Network for Radiology Report Generation accepted to IEEE Journal of Biomedical and Health Informatics (J-BHI), 2023.

Medical Report Generation And VQA (Adapting XrayGPT to Any Modality)

GPT-2 based medical reports generator for X-ray images in Czech.

This is the official implementation of MvKeTR: Chest CT Report Generation with Multi-View Perception and Knowledge Enhancement accepted to IEEE Journal of Biomedical and Health Informatics (J-BHI), 2025.

AI-powered Chest X-ray report generation app using VLM (Swin-T5) and LLM (LLaMA-3) for multilingual Q&A and medical education support.

Medivance.AI is a cutting-edge, all-in-one AI healthcare platform that transforms the way patients, doctors, and healthcare organizations interact with medical data.

Resources on the use of multimodal learning in medical imaging.

The primary objective of this work is to develop an innovative system capable of providing explainable brain tumor detection.