German Tokenizer Benchmark

german-tokenizer-benchmark's activity

• All
• Models
• Datasets
• Spaces
• Buckets
• Papers
• Collections
• Community
• Posts
• Articles

stefan-it 

submitted 2 papers to Daily Papers 5 months ago

GLiNER-Relex: A Unified Framework for Joint Named Entity Recognition and Relation Extraction

Paper • 2605.10108 • Published May 11 • 1

Repetition over Diversity: High-Signal Data Filtering for Sample-Efficient German Language Modeling

Paper • 2604.28075 • Published Apr 30 • 18

stefan-it 

submitted a paper to Daily Papers 9 months ago

FineInstructions: Scaling Synthetic Instructions to Pre-Training Scale

Paper • 2601.22146 • Published Jan 29 • 12

stefan-it 

updated a Space 11 months ago

Running

README

📈

stefan-it 

published 2 datasets 11 months ago

german-tokenizer-benchmark/mobie

Viewer • Updated Nov 11, 2025 • 6.9k • 7

german-tokenizer-benchmark/ud-hdt

Viewer • Updated Nov 11, 2025 • 153k • 9

stefan-it 

updated 3 datasets 11 months ago

german-tokenizer-benchmark/ud-hdt

Viewer • Updated Nov 11, 2025 • 153k • 9

german-tokenizer-benchmark/mobie

Viewer • Updated Nov 11, 2025 • 6.9k • 7

german-tokenizer-benchmark/german-ler

Viewer • Updated Nov 11, 2025 • 53.4k • 22

stefan-it 

published 2 datasets 11 months ago

german-tokenizer-benchmark/german-ler

Viewer • Updated Nov 11, 2025 • 53.4k • 22

german-tokenizer-benchmark/co-funer

Viewer • Updated Nov 10, 2025 • 758 • 25

stefan-it 

updated 2 datasets 11 months ago

german-tokenizer-benchmark/co-funer

Viewer • Updated Nov 10, 2025 • 758 • 25

german-tokenizer-benchmark/biofid

Viewer • Updated Nov 10, 2025 • 12.7k • 11

stefan-it 

published a dataset 11 months ago

german-tokenizer-benchmark/biofid

Viewer • Updated Nov 10, 2025 • 12.7k • 11

stefan-it 

updated a dataset 11 months ago

german-tokenizer-benchmark/germeval14

Viewer • Updated Nov 10, 2025 • 24k • 12

stefan-it 

published a dataset 11 months ago

german-tokenizer-benchmark/germeval14

Viewer • Updated Nov 10, 2025 • 24k • 12

stefan-it 

published a Space 11 months ago

Running

README

📈

stefan-it 

authored 2 papers 12 months ago

SindBERT, the Sailor: Charting the Seas of Turkish NLP

Paper • 2510.21364 • Published Oct 24, 2025 • 2

The German Commons - 154 Billion Tokens of Openly Licensed Text for German Language Models

Paper • 2510.13996 • Published Oct 15, 2025 • 9

stefan-it 

authored a paper about 1 year ago

Llama-GENBA-10B: A Trilingual Large Language Model for German, English and Bavarian

Paper • 2509.05668 • Published Sep 6, 2025 • 8