German Tokenizer Benchmark

german-tokenizer-benchmark's activity

• All
• Models
• Datasets
• Spaces
• Buckets
• Papers
• Collections
• Community
• Posts
• Articles

stefan-it 

submitted 2 papers to Daily Papers 3 months ago

GLiNER-Relex: A Unified Framework for Joint Named Entity Recognition and Relation Extraction

Paper • 2605.10108 • Published May 11 • 1

Repetition over Diversity: High-Signal Data Filtering for Sample-Efficient German Language Modeling

Paper • 2604.28075 • Published Apr 30 • 20

stefan-it 

submitted a paper to Daily Papers 6 months ago

FineInstructions: Scaling Synthetic Instructions to Pre-Training Scale

Paper • 2601.22146 • Published Jan 29 • 12

stefan-it 

updated a Space 9 months ago

Running

README

📈

stefan-it 

published 2 datasets 9 months ago

german-tokenizer-benchmark/mobie

Viewer • Updated Nov 11, 2025 • 6.9k • 26

german-tokenizer-benchmark/ud-hdt

Viewer • Updated Nov 11, 2025 • 153k • 25

stefan-it 

updated 3 datasets 9 months ago

german-tokenizer-benchmark/ud-hdt

Viewer • Updated Nov 11, 2025 • 153k • 25

german-tokenizer-benchmark/mobie

Viewer • Updated Nov 11, 2025 • 6.9k • 26

german-tokenizer-benchmark/german-ler

Viewer • Updated Nov 11, 2025 • 53.4k • 42

stefan-it 

published 2 datasets 9 months ago

german-tokenizer-benchmark/german-ler

Viewer • Updated Nov 11, 2025 • 53.4k • 42

german-tokenizer-benchmark/co-funer

Viewer • Updated Nov 10, 2025 • 758 • 24

stefan-it 

updated 2 datasets 9 months ago

german-tokenizer-benchmark/co-funer

Viewer • Updated Nov 10, 2025 • 758 • 24

german-tokenizer-benchmark/biofid

Viewer • Updated Nov 10, 2025 • 12.7k • 21

stefan-it 

published a dataset 9 months ago

german-tokenizer-benchmark/biofid

Viewer • Updated Nov 10, 2025 • 12.7k • 21

stefan-it 

updated a dataset 9 months ago

german-tokenizer-benchmark/germeval14

Viewer • Updated Nov 10, 2025 • 24k • 24

stefan-it 

published a dataset 9 months ago

german-tokenizer-benchmark/germeval14

Viewer • Updated Nov 10, 2025 • 24k • 24

stefan-it 

published a Space 9 months ago

Running

README

📈

stefan-it 

authored 2 papers 10 months ago

SindBERT, the Sailor: Charting the Seas of Turkish NLP

Paper • 2510.21364 • Published Oct 24, 2025 • 2

The German Commons - 154 Billion Tokens of Openly Licensed Text for German Language Models

Paper • 2510.13996 • Published Oct 15, 2025 • 9

stefan-it 

authored a paper 11 months ago

Llama-GENBA-10B: A Trilingual Large Language Model for German, English and Bavarian

Paper • 2509.05668 • Published Sep 6, 2025 • 8