LangMAP

company

https://cimeister.github.io/blog/unigramlm/

AI & ML interests

Language Adaptive Tokenization

Recent Activity

suchirsalhan updated a model about 1 month ago

MultilingualUnigramLM/ft-langmap-qwen2_5-0_5b-fineweb100M-hun-original-r16k32

suchirsalhan published a model about 1 month ago

MultilingualUnigramLM/ft-langmap-qwen2_5-0_5b-fineweb100M-hun-original-r16k32

suchirsalhan updated a model about 1 month ago

MultilingualUnigramLM/ft-langmap-qwen2_5-0_5b-fineweb100M-hun-langspec-r16k32

View all activity

MultilingualUnigramLM 's models 506

MultilingualUnigramLM/las-tokenizers-Mistral-7B-v0.3-fin

MultilingualUnigramLM/las-tokenizers-gemma-2-9b-fin

MultilingualUnigramLM/las-tokenizers-Mistral-7B-v0.3-tur

MultilingualUnigramLM/las-tokenizers-gemma-2-2b-tur

MultilingualUnigramLM/las-tokenizers-gemma-2-2b-hun

MultilingualUnigramLM/las-tokenizers-Mistral-7B-v0.3-hun

MultilingualUnigramLM/las-tokenizers-Yi-1.5-6B-tur

MultilingualUnigramLM/las-tokenizers-Phi-3-mini-4k-instruct-hun

MultilingualUnigramLM/las-tokenizers-Yi-1.5-6B-hun

MultilingualUnigramLM/las-tokenizers-Phi-3-mini-4k-instruct-fin

MultilingualUnigramLM/las-tokenizers-Phi-3-mini-4k-instruct-tur

MultilingualUnigramLM/las-tokenizers-Yi-1.5-6B-fin

MultilingualUnigramLM/las-nl-tokenizers-xglm-2_9b-v256008-fin

MultilingualUnigramLM/las-nl-tokenizers-bloom-3b-v250880-fin

MultilingualUnigramLM/las-nl-tokenizers-mistral-nemo-12b-v131072-fin

MultilingualUnigramLM/las-nl-tokenizers-gemma2-9b-v256000-fin

MultilingualUnigramLM/las-nl-tokenizers-gemma2-2b-v256000-fin

MultilingualUnigramLM/las-nl-tokenizers-phi3-mini-v32064-tur

MultilingualUnigramLM/las-nl-tokenizers-mistral-7b-v03-v32768-tur

MultilingualUnigramLM/las-nl-tokenizers-yi-1_5-6b-v64000-tur

MultilingualUnigramLM/las-nl-tokenizers-granite3_0-8b-v49152-tur

MultilingualUnigramLM/las-nl-tokenizers-phi3-mini-v32064-hun

MultilingualUnigramLM/las-nl-tokenizers-mistral-7b-v03-v32768-hun

MultilingualUnigramLM/las-nl-tokenizers-yi-1_5-6b-v64000-hun

MultilingualUnigramLM/las-nl-tokenizers-granite3_0-8b-v49152-hun

MultilingualUnigramLM/las-nl-tokenizers-phi3-mini-v32064-fin

MultilingualUnigramLM/las-nl-tokenizers-mistral-7b-v03-v32768-fin

MultilingualUnigramLM/las-nl-tokenizers-yi-1_5-6b-v64000-fin

MultilingualUnigramLM/las-code-tokenizers-gemma3-1b-v100000-python

MultilingualUnigramLM/las-nl-tokenizers-granite3_0-8b-v49152-fin