HPLT

community

hplt_eu

AI & ML interests

Web as a corpus, Large Language Models, Machine Translation, Language Technologies, Natural Language Processing, Internet Archive, CommonCrawl

Recent Activity

MariaFjodorowa updated a model about 2 hours ago

HPLT/hplt_gpt_bert_base_3_0_gle_Latn

MariaFjodorowa updated a collection about 2 hours ago

HPLT 3.0 GPT-BERT models

MariaFjodorowa published a model about 2 hours ago

HPLT/hplt_gpt_bert_base_3_0_gle_Latn

View all activity

Organization Card

Community About org cards

https://hplt-project.org/

Our project name, HPLT, is an acronym for High Performance Language Technologies. We combine large quantities of data, a number of languages and high-performance computing to build powerful and efficient datasets for language and translation models. Another goal of HPLT is to publish the results of this project in a shared space with open licenses.

Version 3 of the HPLT datasets (198 languages):
- https://hplt-project.org/datasets/v3.0
- https://hf.co/datasets/HPLT/HPLT3.0
HPLT-E: a framework for comprehensive multilingual and multi-prompt k-shot evaluation in nine languages
HPLT datasets ACL'2025 paper
Version 2 of the HPLT datasets (193 languages):
- https://hplt-project.org/datasets/v2.0
- https://hf.co/datasets/HPLT/HPLT2.0_cleaned
Version 1.2 of the HPLT datasets (75 languages):
- https://hplt-project.org/datasets/v1.2
- https://huggingface.co/datasets/HPLT/hplt_monolingual_v1_2

This project has received funding from the European Union’s Horizon Europe research and innovation programme under grant agreement No 101070350 and from UK Research and Innovation (UKRI) under the UK government’s Horizon Europe funding guarantee [grant number 10052546]