List your company
ResearchFormerly WizWand

Multiple-choice Visual Question Answering on PMC-VQA (test)

89.3AccuracyGPT-4-Oracle
21.38839.01956.6574.281May 17, 2023Aug 24, 2023Dec 1, 2023Mar 10, 2024Jun 17, 2024Sep 24, 2024Jan 2, 2025
Updated 8mo ago

Evaluation results

MethodLinks
GPT-4-OracleLanguage Backbone=GPT-4, Vision Backbone=None, Protocol=Language-only2023.0589.3
UMed-LVLM2025.0142.6
MedVInT-TDLanguage Backbone=PMC-LLAMA, Vision Backbone=PMC-CLIP, Protocol=Trained on PMC-VQA2023.0540.3
MedVInT-TDLanguage Backbone=LLAMA, Vision Backbone=PMC-CLIP, Protocol=Trained on PMC-VQA2023.0539.5
MedVInT-TDLanguage Backbone=PMC-LLAMA [57], Vision Backbone=PMC-CLIP [32], Evaluation Protocol=Trained on PMC-VQA2023.0539.4
MedVInT-TELanguage Backbone=PMC-LLAMA-ENC, Vision Backbone=PMC-CLIP, Protocol=Trained on PMC-VQA2023.0539.2
MedVInT-TDLanguage Backbone=LLAMA, Vision Backbone=CLIP, Protocol=Trained on PMC-VQA2023.0539.2
MedVInT2025.0139.2
MedVInT-TELanguage Backbone=PMC-LLAMA-ENC, Vision Backbone=CLIP, Protocol=Trained on PMC-VQA2023.0538.5
MedVInT-TELanguage Backbone=PMC-LLAMA-ENC [57], Vision Backbone=PMC-CLIP [32], Evaluation Protocol=Trained on PMC-VQA2023.0538.2
MedVInT-TDLanguage Backbone=LLAMA [54], Vision Backbone=CLIP [47], Evaluation Protocol=Trained on PMC-VQA2023.0538.2
MedVInT-TELanguage Backbone=PMC-LLAMA-ENC, Vision Backbone=Scratch, Protocol=Trained on PMC-VQA2023.0538
MedVInT-TDLanguage Backbone=LLAMA, Vision Backbone=Scratch, Protocol=Trained on PMC-VQA2023.0537.9
MedVInT-TELanguage Backbone=PubMedBERT, Vision Backbone=PMC-CLIP, Protocol=Trained on PMC-VQA2023.0537.6
MedVInT-TDLanguage Backbone=LLAMA [54], Vision Backbone=PMC-CLIP [32], Evaluation Protocol=Trained on PMC-VQA2023.0537.3
MedVInT-TELanguage Backbone=PubMedBERT [20], Vision Backbone=PMC-CLIP [32], Evaluation Protocol=Trained on PMC-VQA2023.0537.1
MedVInT-TELanguage Backbone=PMC-LLAMA-ENC [57], Vision Backbone=CLIP [47], Evaluation Protocol=Trained on PMC-VQA2023.0537.1
MedVInT-TELanguage Backbone=LLAMA-ENC, Vision Backbone=PMC-CLIP, Protocol=Trained on PMC-VQA2023.0537.1
MedVInT-TELanguage Backbone=PMC-LLAMA-ENC [57], Vision Backbone=Scratch, Evaluation Protocol=Trained on PMC-VQA2023.0537
MedVInT-TELanguage Backbone=LLAMA-ENC [54], Vision Backbone=PMC-CLIP [32], Evaluation Protocol=Trained on PMC-VQA2023.0536.9
MedVInT-TDLanguage Backbone=PMC-LLAMA, Vision Backbone=Scratch, Protocol=Trained on PMC-VQA2023.0536.9
MedVInT-TDLanguage Backbone=PMC-LLAMA, Vision Backbone=CLIP, Protocol=Trained on PMC-VQA2023.0536.9
MedVInT-TDLanguage Backbone=PMC-LLAMA [57], Vision Backbone=Scratch, Evaluation Protocol=Trained on PMC-VQA2023.0536.8
MedVInT-TDLanguage Backbone=PMC-LLAMA [57], Vision Backbone=CLIP [47], Evaluation Protocol=Trained on PMC-VQA2023.0536.8
MedVInT-TDLanguage Backbone=LLAMA [54], Vision Backbone=Scratch, Evaluation Protocol=Trained on PMC-VQA2023.0536.2
MedVInT-TELanguage Backbone=LLAMA-ENC, Vision Backbone=CLIP, Protocol=Trained on PMC-VQA2023.0536.1
MedICap-PMCVQA-GPT-4Language Backbone=GPT-4, Vision Backbone=MedICap-PMCVQA, Protocol=Trained on PMC-VQA2023.0535.9
MedVInT-TELanguage Backbone=LLAMA-ENC [54], Vision Backbone=CLIP [47], Evaluation Protocol=Trained on PMC-VQA2023.0535.3
MedVInT-TELanguage Backbone=LLAMA-ENC [54], Vision Backbone=Scratch, Evaluation Protocol=Trained on PMC-VQA2023.0535.2
MedVInT-TELanguage Backbone=LLAMA-ENC, Vision Backbone=Scratch, Protocol=Trained on PMC-VQA2023.0535.2
MedVInT-TELanguage Backbone=PubMedBERT, Vision Backbone=Scratch, Protocol=Trained on PMC-VQA2023.0534.9
LLAVA-MedLanguage Backbone=Vicuna, Vision Backbone=BioMedCLIP, Protocol=Zero-shot2023.0534.8
LLAVA-Med2025.0134.8
MedVInT-TELanguage Backbone=PubMedBERT [20], Vision Backbone=CLIP [47], Evaluation Protocol=Trained on PMC-VQA2023.0534.5
MedVInT-TELanguage Backbone=PubMedBERT [20], Vision Backbone=Scratch, Evaluation Protocol=Trained on PMC-VQA2023.0534.4
MedVInT-TELanguage Backbone=PubMedBERT, Vision Backbone=CLIP, Protocol=Trained on PMC-VQA2023.0534.3
LLaVA-MedLanguage Backbone=Vicuna [14], Vision Backbone=BioMedCLIP [64], Evaluation Protocol=Zero-shot2023.0532.6
LLAMALanguage Backbone=LLAMA, Vision Backbone=None, Protocol=Language-only2023.0530.8
LLAMALanguage Backbone=LLAMA [54], Vision Backbone=None, Evaluation Protocol=Trained on PMC-VQA2023.0530.6
MedICap-GPT-4Language Backbone=GPT-4, Vision Backbone=MedICap, Protocol=Zero-shot2023.0527.2
Open-FlamingoLanguage Backbone=LLAMA, Vision Backbone=CLIP, Protocol=Zero-shot2023.0526.4
Open-Flamingo2025.0126.4
GPT-4Language Backbone=GPT-4, Vision Backbone=None, Protocol=Language-only2023.0525.7
Open-FlamingoLanguage Backbone=LLAMA [54], Vision Backbone=CLIP [47], Evaluation Protocol=Zero-shot2023.0525
PMC-CLIPLanguage Backbone=PMC-CLIP, Vision Backbone=PMC-CLIP, Protocol=Zero-shot2023.0524.7
PMC-CLIP2025.0124.7
BLIP-2Language Backbone=OPT-2.7B [63], Vision Backbone=CLIP [47], Evaluation Protocol=Zero-shot2023.0524.6
BLIP-2Language Backbone=OPT-2.7B, Vision Backbone=CLIP, Protocol=Zero-shot2023.0524.3
BLIP-22025.0124.3
PMC-CLIPLanguage Backbone=PMC-CLIP [32], Vision Backbone=PMC-CLIP [32], Evaluation Protocol=Zero-shot2023.0524