Re-quant request: Bielik v3 1.5B/4.5B, PL-11B, Minitron-7B GGUFs have broken tokenizer scores
Hi! Your Bielik v3 quants (1.5B/4.5B ungated, heretic, medadapt, Bielik-PL-11B ungated/heretic, Minitron-7B heretic/ungated/Malevolent) store the same score (-1000) for every token. The cause is a placeholder in LlamaHfVocab.get_token_score() in llama.cpp, used when the source repo has tokenizer.json but no tokenizer.model. llama.cpp then splits text differently from the original tokenizer (Bielik-PL-11B-ungated: 26/63 sentences identical; Minitron-7B-heretic: 3/63).
A re-quant with current llama.cpp gives the same result. It will be fixed by https://github.com/ggml-org/llama.cpp/pull/32625; until then the metadata can be patched in place (fix_tokenizer.py in https://huggingface.co/Lindarixon/Linda-Sejf/tree/main/tools).
Background: https://huggingface.co/speakleash/Bielik-4.5B-v3.0-Instruct-GGUF/discussions/3
Affected repos:
- mradermacher/Bielik-1.5B-v3-ungated-GGUF
- mradermacher/Bielik-1.5B-v3-ungated-i1-GGUF
- mradermacher/Bielik-1.5B-v3.0-Instruct-ungated-GGUF
- mradermacher/Bielik-1.5B-v3.0-Instruct-ungated-i1-GGUF
- mradermacher/Bielik-11B-v3.0-medadapt-GGUF
- mradermacher/Bielik-11B-v3.0-medadapt-i1-GGUF
- mradermacher/Bielik-4.5B-v3-Base-ungated-GGUF
- mradermacher/Bielik-4.5B-v3-Base-ungated-i1-GGUF
- mradermacher/Bielik-4.5B-v3-Istruct-ungated-GGUF
- mradermacher/Bielik-4.5B-v3-Istruct-ungated-i1-GGUF
- mradermacher/Bielik-4.5B-v3-heretic-GGUF
- mradermacher/Bielik-4.5B-v3-heretic-i1-GGUF
- mradermacher/Bielik-4.5B-v3.0-medadapt-GGUF
- mradermacher/Bielik-4.5B-v3.0-medadapt-i1-GGUF
- mradermacher/Bielik-Minitron-7B-v3.0-Instruct-Malevolent-GGUF
- mradermacher/Bielik-Minitron-7B-v3.0-Instruct-heretic-GGUF
- mradermacher/Bielik-Minitron-7B-v3.0-Instruct-heretic-i1-GGUF
- mradermacher/Bielik-PL-11B-v3.0-Instruct-heretic-GGUF
- mradermacher/Bielik-PL-11B-v3.0-Instruct-heretic-i1-GGUF
- mradermacher/Bielik-PL-11B-v3.0-Instruct-ungated-GGUF
- mradermacher/Bielik-PL-11B-v3.0-Instruct-ungated-i1-GGUF
- mradermacher/Bielik-PL-Minitron-7B-v3.0-Instruct-ungated-GGUF
- mradermacher/Bielik-PL-Minitron-7B-v3.0-Instruct-ungated-i1-GGUF