Method,Params (B),Language Model,Vision Model,Evaluation Date,Avg score,Pubmed Tiny,Pubmed All,Socialpath Tiny,Socialpath All,Education Content Tiny,Education Content All LLaVA-v1.5-7B,7.2,Vicuna-v1.5-7B,CLIP ViT-L/14,12/20/2024,37.38833333,43.77,39.6,36.24,38.01,31.37,35.34 LLaVA-v1.5-13B,13.4,Vicuna-v1.5-13B,CLIP ViT-L/14,12/20/2024,39.26666667,45.9,37.32,39.73,37.45,39.6,35.6 LLaVA-Next-Vicuna-7B,7.1,Vicuna-v1.5-7B,CLIP ViT-L/14,12/20/2024,37.19,43.06,36.34,39.3,34.63,35.29,34.52 LLaVA-Next-Vicuna-13B,13.4,Vicuna-v1.5-13B,CLIP ViT-L/14,12/20/2024,37.71666667,40.93,37.71,42.36,36.45,34.9,33.95 " LLaVA-Next-Mistral-7B",7.6,Mistral-7B,CLIP ViT-L/14,12/20/2024,38.91333333,47.33,36.83,39.3,34.85,40.39,34.78 ShareGPT4V-7B,7.2,Vicuna-v1.5-7B,CLIP ViT-L/14,12/20/2024,34.92166667,41.99,36.38,33.62,33.57,30.59,33.38 ShareGPT4V-13B,13.4,Vicuna-v1.5-13B,CLIP ViT-L/14,12/20/2024,34.10833333,40.57,35.04,34.06,31.47,32.55,30.96 LLaVA-Next-Llama3,8,Llama-3-8B-Instruct,CLIP ViT-L/14,12/20/2024,41.47666667,47.69,40.45,43.67,38.01,42.35,36.69 LLaVA-InternLM-7B,7.6,InternLM-7B,CLIP ViT-L/14,12/20/2024,32.65833333,33.81,34.94,33.19,28.59,35.29,30.13 LLaVA-v1.5-7b-xtuner,7,Vicuna-7B-v1.5,CLIP-ViT-Large-patch14-336,12/20/2024,31.36833333,34.52,33.18,33.19,29.58,29.41,28.33 LLaVA-v1.5-13b-xtuner,13,Vicuna-13B-v1.5,CLIP-ViT-Large-patch14-336,12/20/2024,34.99833333,37.37,36.31,36.68,32.8,34.12,32.71 LLaVA-LLaMA-3-8B,8,Llama-3-8B-Instruct,CLIP ViT-L/14,12/20/2024,32.56166667,35.23,32.69,32.75,33.41,30.59,30.7 LLaVA-Next-Yi-34B,34.8,Yi-34B,CLIP ViT-L/14,12/20/2024,49.31333333,54.09,45.31,51.97,44.93,56.08,43.5 LLaVA-Next-Interleave-7B,8,Qwen-1.5-7B,SigLIP-400M,12/20/2024,36.40333333,38.08,34.62,37.99,33.91,39.61,34.21 LLaVA-Next-Interleave-7B-DPO,8,Qwen-1.5-7B,SigLIP-400M,12/20/2024,35.86,38.79,33.9,37.12,31.75,40.78,32.82 Qwen-VL,9.6,Qwen-7B,ViT-G/16,12/21/2024,32.45,32.38,32.26,30.56,31.91,36.07,31.52 Qwen2-VL-7B,8,Qwen2-7B,ViT-600M,12/21/2024,55.35166667,62.63,54.79,57.2,49.86,56.86,50.77 Qwen-VL-Chat,9.6,Qwen-7B,ViT-G/16,12/21/2024,34.52166667,39.14,31.45,35.37,32.24,37.25,31.68 Monkey,9.8,Qwen-7B,ViT-BigHuge,12/21/2024,35.02666667,41.64,35.39,31.88,33.3,34.11,33.84 Monkey-Chat,9.8,Qwen-7B,ViT-BigHuge,12/21/2024,34.68666667,40.57,35.3,31.44,33.3,34.9,32.61 MiniMonkey,2.2,InternLM2-1.8B,InternViT-300M,12/21/2024,40.35666667,43.77,37.19,44.97,36.73,43.52,35.96 Qwen2-VL-7B-Instruct-GPTQ-Int4,7,Qwen7-7B,ViT-600M,12/22/2024,56.15,62.27,53.22,55.45,49.97,65.07,50.92 Qwen2-VL-7B-Instruct-GPTQ-Int8,7,Qwen7-7B,ViT-600M,12/22/2024,55.57,62.98,54.62,58.07,49.97,56.86,50.92 Qwen2-VL-2B-Instruct,2,Qwen2-7B,ViT-600M,12/22/2024,45.31833333,48.75,44.58,49.78,41.88,45.49,41.43 Qwen2-VL-2B-Instruct-GPTQ-Int4,2,Qwen2-7B,ViT-600M,12/22/2024,45.53166667,52.31,44.13,48.9,41.16,45.88,40.81 Qwen2-VL-2B-Instruct-GPTQ-Int8,2,Qwen2-7B,ViT-600M,12/22/2024,45.22166667,50.17,44.55,50.65,41.05,44.31,40.6 XinYuan-VL-2B-Instruct,2,Qwen2-7B,ViT-600M,12/22/2024,47.485,53.73,45.14,48.9,43.49,50.98,42.67 MolmoE-1B,7.2,OLMoE-1B-7B-0924,CLIP ViT-L/14,12/23/2024,37.4,39.5,36.92,40.61,37,35.29,35.08 Molmo-7B-D,8,Qwen2-7B,CLIP ViT-L/14,12/23/2024,42.31833333,47.33,41.32,43.23,41.55,41.17,39.31 Molmo-7B-O,8,Qwen2-7B,CLIP ViT-L/14,12/23/2024,38.88833333,46.26,38.13,39.3,36.5,37.64,35.5 Phi-3-Vision,4.2,Phi-3,CLIP ViT-L/14,12/23/2024,39.04,44.83,38.55,38.86,38.83,36.07,37.1 Phi-3.5-Vision,4,Phi-3.5,CLIP ViT-L/14,12/23/2024,43.77333333,49.11,44.16,44.97,40.55,43.92,39.93 hareCaptioner,8,InternLM-7B,EVA-G,12/25/2024,34.63666667,38.79,33.76,37.11,32.24,34.5,31.42 InternLM-XComposer2,7,InternLM2-7B,CLIP ViT-L/14,12/25/2024,37.74666667,40.56,36.6,36.68,35.34,41.96,35.34 InternLM-XComposer2-1.8B,2,InternLM2-1.8B,CLIP ViT-L/14,12/25/2024,31.73166667,35.94,32.65,30.13,31.63,30.58,29.46 InternVL-Chat-V1-1,19,IViT-6B-448px,LLaMA2-13B,12/25/2024,34.985,37.36,34.97,34.06,34.62,36.86,32.04 InternVL-Chat-V1-2,40,InternViT-6B-448px-V1-2,Nous-Hermes-2-Yi-34B,12/26/2024,51.09,58.71,47.75,55.02,46.14,54.5,44.42 InternVL-Chat-V1-2-Plus,40,InternViT-6B-448px-V1-2,Nous-Hermes-2-Yi-34B,12/26/2024,52.36666667,58.36,50.39,51.96,48.08,56.86,48.55 InternVL-Chat-V1.5,26,InternLM2-20B,InternViT-6B,12/26/2024,33.28333333,35.94,34.15,34.06,32.79,31.76,31 Mini-InternVL-Chat-2B-V1.5,2,InternLM2-1.8B,InternViT-300M,12/26/2024,37.97333333,42.7,38.16,37.55,35.23,39.22,34.98 Mini-InternVL-Chat-4B-V1.5,4,Phi-3,InternViT-300M,12/26/2024,52.34,55.52,50.74,57.2,46.65,55.69,48.24 InternVL2-1B,1,Qwen2-0.5B,InternViT-300M,12/26/2024,37.80166667,42.35,36.15,37.55,37.83,37.64,35.29 InternVL2-2B,2,InternLM2-1.8B,InternViT-300M,12/26/2024,39.57,41.99,37.45,43.23,36.18,42.35,36.22 InternVL2-4B,4,Phi-3,InternViT-300M,12/26/2024,49.23666667,57.65,45.47,55.46,42.94,50.2,43.7 InternVL2-8B,8,InternLM2.5-7B,InternViT-300M,12/26/2024,49.9,58.01,45.33,57.64,43.99,51.76,42.67 InternVL2-26B,26,InternLM2-20B,InternViT-6B,12/27/2024,47.61333333,53.02,44.69,53.28,41.72,50.2,42.77 InternVL2-8B-MPO,8,InternLM2.5-7B,InternViT-300M,12/27/2024,50.43333333,55.52,48.04,57.64,45.59,52.16,43.65 InternVL2-8B-MPO-CoT,8,InternLM2.5-7B,InternViT-300M,12/27/2024,3.188333333,3.2,2.9,3.93,2.55,3.14,3.41 InternVL2.5-1B,1,Qwen-2.5-0.5B,InternViT-300M-v2.5,12/27/2024,42.19333333,49.46,38.95,46.72,39.44,40,38.59 InternVL2.5-2B,2,InternLM2.5-1.8B,InternViT-300M-v2.5,12/27/2024,45.77,52.31,42.47,50.21,41.82,47.05,40.76 InternVL2.5-4B,4,Qwen-2.5-3B,InternViT-300M-v2.5,12/27/2024,53.23833333,62.98,49.6,54.14,46.26,59.6,46.85 InternVL2.5-8B,8,InternLM2.5-7B,InternViT-300M-v2.5,12/27/2024,54.39166667,60.85,50.03,60.26,48.25,60.78,46.18 InternVL2.5-26B,26,InternLM2.5-20B,InternViT-6B-v2.5,12/27/2024,54.40666667,60.14,52.44,61.57,46.98,57.64,47.67 InternVL2.5-38B,38,Qwen-2.5-32B,InternViT-6B-v2.5,12/27/2024,62.72333333,65.83,61.4,62.88,57.28,69.41,59.54 MMAlaya,7.8,Alaya-7B-Chat,EVA-G,12/27/2024,29.92,29.18,28.74,34.06,30.24,29.8,27.5 Llama-3.2-11B-Vision-Instruct,11,Llama-3.1-8B,,12/27/2024,24.07666667,23.48,23.85,24.45,22.32,27.45,22.91 LLaVA-CoT,11,,,12/27/2024,9.155,10.67,7.36,11.35,7.75,10.58,7.22 Ovis1.5-Llama3-8B,8,Llama-3-8B-Instruct,SigLIP-400M,12/31/2024,52.98833333,61.56,48.72,59.38,49.36,52.94,45.97 Ovis1.5-Gemma2-9B,11.4,Gemma2-9B-It,SigLIP-400M,12/31/2024,52.45666667,59.07,50.52,55.02,48.25,55.29,46.59 Ovis1.6-Gemma2-9B,10.2,Gemma2-9B-It,SigLIP-400M,12/31/2024,52.42833333,57.65,49.15,55.89,47.42,58.03,46.43 Ovis1.6-Gemma2-27B,28.9,Gemma2-27B,SigLIP-400M,12/31/2024,54.74166667,61.92,49.93,57.2,50.41,58.43,50.56 Qwen2-VL-72B-Instruct,73.4,Qwen2-72B,QwenViT,1/15/2025,63.97666667,75.08,60.98,68.55,55.4,68.23,55.62 InternVL2_5-78B,78,Qwen-2.5-72B,InternViT-6B-v2.5,1/15/2025,62.49166667,71.17,57.33,67.24,54.62,71.76,52.83 InternVL2-40B,40,Nous-Hermes-2-Yi-34B,InternViT-6B,1/15/2025,56.26166667,64.05,52.73,59.38,48.91,64.31,48.19 Llama-3.2-90B-Vision-Instruct, 88.6, Llama-3.1-70B, 1/18/2025, 24.17, 28.82, 23.27, 27.51,18.89, 25.88, 20.63