kkioikk/Seed-Coder-8B-Instruct-Q5_K_M-GGUF

This model was converted to GGUF format from ByteDance-Seed/Seed-Coder-8B-Instruct using llama.cpp via the ggml.ai's GGUF-my-repo space. Refer to the original model card for more details on the model.

小参数模型使用注意事项:

尽量使用简洁的系统指令,系统指令优先于即时输入指令。 当无法遵守指令时,可通过修改历史记录的方法,例如在开始时预设少量对话记录:{user},{assistant},直接修改或替换模型输出作为历史记录,这样可以让模型更好地学习你的要求。

Precautions for using small-parameter models:

Try to use concise system instructions, system instructions take precedence over real-time input instructions. When you can't follow the instructions, you can modify the history by modifying the history, such as presetting a small number of conversation records at the beginning: {user}, {assistant}, directly modify or replace the model output as the history, which can make the model learn your requirements better.

Downloads last month
2
GGUF
Model size
8B params
Architecture
llama
Hardware compatibility
Log In to add your hardware

5-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for kkioikk/Seed-Coder-8B-Instruct-Q5_K_M-GGUF