File size: 568 Bytes
b74138f 55d738c b23c616 fffa3f7 b23c616 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 |
---
license: other
language:
- en
pipeline_tag: text-generation
tags:
- facebook
- meta
- llama
- llama3.1
- llama 3.1
- llama 8b
- gguf
---
# With fixes applied for:
- 3.1 rope scaling factors (#8676)
- `llama-bpe` as tokenizer Proper Llama 3.1 Support in llama.cpp (#8650)
- `<|python_tag|>` works for tool calls.
# Following files are fixed and others are being replaced.
- Meta-Llama-3.1-8B-Instruct.Q4_K_M.gguf
- Meta-Llama-3.1-8B-Instruct.IQ4_XS.gguf
# REF
https://github.com/ggerganov/llama.cpp/issues/8650
https://github.com/ggerganov/llama.cpp/pull/8676
|