GlotLID (Language Identification)
🕵
29
Identify the language of a sentence with confidence scores
GlotSuite
GlotSuite: Paving the Way for Bringing Generative AI to Underserved Communities
-
-
cis-lmu/GlotSparse
Viewer • Updated • 142k • 446 • 7 -
cis-lmu/glotlid
Text Classification • Updated • 73k • 95 -
cis-lmu/GlotStoryBook
Viewer • Updated • 80.1k • 67 • 7 -
cis-lmu/glotlid-corpus
Updated • 252 • 13 -
cis-lmu/Glot500
Viewer • Updated • 1.23B • 9.4k • 43 -
cis-lmu/glot500-base
Fill-Mask • 0.4B • Updated • 820 • • 20 -
cis-lmu/GlotCC-V1
Viewer • Updated • 1.28B • 703 • 58 -
cis-lmu/glotlid-wordlists
Viewer • Updated • 3.12M • 123 • 2 -
cis-lmu/GlotOCR-bench-v1.0-results
Viewer • Updated • 311k • 14 • 2 -
GlotCC: An Open Broad-Coverage CommonCrawl Corpus and Pipeline for Minority Languages
Paper • 2410.23825 • Published • 4 -
GlotScript: A Resource and Tool for Low Resource Writing System Identification
Paper • 2309.13320 • Published • 1 -
Glot500: Scaling Multilingual Corpora and Language Models to 500 Languages
Paper • 2305.12182 • Published • 1 -
GlotLID: Language Identification for Low-Resource Languages
Paper • 2310.16248 • Published • 1 -
GlotWeb
🕸1Indexing the presence of low-resource languages on the web.
-
cis-lmu/GlotOCR-bench
Viewer • Updated • 32.8k • 25 • 3 -
GlotOCR Bench: OCR Models Still Struggle Beyond a Handful of Unicode Scripts
Paper • 2604.12978 • Published • 4