Spaces:

---

TIGER-Lab

/

MMEB-Leaderboard

like 119

Running on CPU Upgrade

Description

This PR adds the evaluation scores for Qwen3-VL-embedding-Turbo1.9B_v1, a lightweight multimodal embedding model developed at Urock.

This model is derived from Qwen3-VL-Embedding and optimized through structural pruning and layered distillation.

Key Highlights:

• Model Size: 1.9B (10% reduction compared to the base model)
• Performance: High efficiency with ~10% faster inference latency while maintaining competitive performance on MMEB tasks, especially in VisDoc (Visual Document Understanding).
• Language Support: English (en) and Korean (ko).

Metadata:

• Model Name: Qwen3-VL-embedding-Turbo1.9B_v1
• Model URL: https://huggingface.co/zxcv1245/Qwen3-VL-embedding-Turbo1.9B_v1
• Model Size: 1.9 (Billion parameters)
• Data Source: Self-Reported (evaluated using the official MMEB pipeline)

I have uploaded the generated JSON file to the scores/ directory as per the instructions.

Please review this submission and let me know if any further information is required.

Dear MMEB Team,

I hope you are doing well.

I would like to request the removal of our model from the MMEB leaderboard.

Model Name: Qwen3-VL-Embedding-Turbo1.9B_v1

Please remove this model and its associated leaderboard entry at your convenience.

Thank you very much for your time and assistance.

Best regards,

Han-Young Jo
Department of Artificial Intelligence, Sogang University

@zxcv1245

Sure! Could you please submit a PR so I can merge it? Thanks!

i want just remove my model on leader board.
my model name is Qwen3-VL-Embedding-Turbo1.9B_v1.
thanks!