trdocvqa-paligemma-3b-lora / evaluation /error_taxonomy.csv
omerfaksoy's picture
Upload TR-DocVQA PaliGemma LoRA adapter and model card
3899b6c verified
Raw
History Blame Contribute Delete
1.44 kB
model,error_category,count,rate
donut-tr,empty_prediction,433,0.2165
donut-tr,numeric_major_error,390,0.195
donut-tr,overlong_answer,274,0.137
donut-tr,currency_format_error,207,0.1035
donut-tr,copied_unrelated_text,201,0.1005
donut-tr,exact_wrong,161,0.0805
donut-tr,hallucinated_text,127,0.0635
donut-tr,truncated_answer,127,0.0635
donut-tr,near_miss,29,0.0145
donut-tr,date_year_error,4,0.002
donut-tr,numeric_minor_error,2,0.001
donut-tr,date_month_error,1,0.0005
donut-tr,turkish_character_only,1,0.0005
paligemma-3b-lora,numeric_major_error,273,0.1365
paligemma-3b-lora,numeric_minor_error,218,0.109
paligemma-3b-lora,exact_wrong,28,0.014
paligemma-3b-lora,date_month_error,20,0.01
paligemma-3b-lora,near_miss,15,0.0075
paligemma-3b-lora,hallucinated_text,3,0.0015
paligemma-3b-lora,copied_unrelated_text,1,0.0005
paligemma-3b-lora,truncated_answer,1,0.0005
pix2struct-docvqa-zeroshot,numeric_major_error,556,0.278
pix2struct-docvqa-zeroshot,hallucinated_text,194,0.097
pix2struct-docvqa-zeroshot,truncated_answer,166,0.083
pix2struct-docvqa-zeroshot,copied_unrelated_text,150,0.075
pix2struct-docvqa-zeroshot,turkish_character_only,79,0.0395
pix2struct-docvqa-zeroshot,overlong_answer,70,0.035
pix2struct-docvqa-zeroshot,exact_wrong,64,0.032
pix2struct-docvqa-zeroshot,near_miss,43,0.0215
pix2struct-docvqa-zeroshot,currency_format_error,37,0.0185
pix2struct-docvqa-zeroshot,numeric_minor_error,15,0.0075