lumees/hdl-corpus
Viewer • Updated • 11.6M • 119
Lumees
company
AI & ML interests
LLM, OCR, Embedding Models, Private Intelligence
Recent Activity
View all activity
hasankursun
updated a
dataset 14 days ago
hasankursun
published a
dataset 14 days ago
hasankursun
posted an update 4 months ago
Post
163
Greek Corpus 150B is now live on the Hub.
A deduplicated, ~146B-token Greek dataset for pretraining and fine-tuning foundation models — a pretrain layer + an instruction (SFT) layer, one unified schema, globally deduplicated.
📊 49.6M documents / ~146B pretrain tokens
📚 Web (FineWeb-2) + long-form PDFs (FinePDFs) + FineWiki + native Greek legislation (47k statutes from the Government Gazette)
💬 ~10B-token SFT layer (9.9M conversations)
The newest in my Global Corpus family — Dutch, Turkish, Bulgarian, Greek — built on a consistent, reproducible pipeline.
🔗 hasankursun/greek-corpus-150b
#greek #llm #dataset #multilingual
A deduplicated, ~146B-token Greek dataset for pretraining and fine-tuning foundation models — a pretrain layer + an instruction (SFT) layer, one unified schema, globally deduplicated.
📊 49.6M documents / ~146B pretrain tokens
📚 Web (FineWeb-2) + long-form PDFs (FinePDFs) + FineWiki + native Greek legislation (47k statutes from the Government Gazette)
💬 ~10B-token SFT layer (9.9M conversations)
The newest in my Global Corpus family — Dutch, Turkish, Bulgarian, Greek — built on a consistent, reproducible pipeline.
🔗 hasankursun/greek-corpus-150b
#greek #llm #dataset #multilingual
[bot] Conversion to Parquet
#1 opened 11 months ago
by 
parquet-converter
hasankursun
updated a
dataset 11 months ago
hasankursun
updated a
collection 11 months ago
hasankursun
published a
dataset 11 months ago
hasankursun
updated a
dataset 11 months ago
[bot] Conversion to Parquet
#1 opened 11 months ago
by parquet-converter
hasankursun
updated a
collection 11 months ago
hasankursun
published a
dataset 11 months ago
hasankursun
updated a
collection 11 months ago
hasankursun
updated a
dataset 11 months ago
hasankursun
published a
dataset 11 months ago
hasankursun
updated 2
datasets 11 months ago
hasankursun
published a
dataset 11 months ago
[bot] Conversion to Parquet
#1 opened 11 months ago
by parquet-converter
hasankursun
updated a
collection 11 months ago