README.md

metadata

title: SAFIR Leaderboard
emoji: 🗺️
colorFrom: green
colorTo: green
sdk: static
sdk_version: 3.0.0
app_file: index.html
pinned: false
license: mit

SAFIR Leaderboard

Saudi Arabic Fluency & Interpretation Ranking

Comprehensive Evaluation Platform for Saudi ↔ English Translation Models

Features

• 🤖 5 Models evaluated
• 🗺️ 12+ Subdialects covered
• 📊 7 Metrics for comprehensive evaluation
• 📍 Coverage tracking across Saudi dialects

Metrics

• BLEU
• CHRF
• METEOR
• BERTScore
• Adequacy
• Faithfulness
• Fluency

Models Evaluated

• NAMAA-Space/sa2eng-mt
• Claude Sonnet 4
• GPT-5
• Gemini Pro
• Facebook m2m100_418M

Contributors

Developed by NAMAA Community

Links

• LinkedIn: NAMAA Community
• Hugging Face: NAMAA-Space
• Model: sa2eng-mt