New updates: Correct system prompt, Tool calling, more fixes & llama.cpp!
#7
pinned
by
shimmyshimmer
- opened
Update: We recently informed the Kimi team about the correct system prompts and they were quick to address the issue. Now we reuploaded all of the quants to use these new changes.
More info about the fixes: https://x.com/danielhanchen/status/1946163064665260486
If you want to use these new changes, you must redownload the quants
Hey guys yesterday llama.cpp added in the PR for Kimi so you can now run it directly with llama.cpp's latest version.
Tool calling also got updated as at 16th July 2025 -
shimmyshimmer
pinned discussion
shimmyshimmer
changed discussion title from
New updates: Tool calling, more fixes & llama.cpp!
to New updates: Correct system prompt, Tool calling, more fixes & llama.cpp!
Dec 29th 2025: Update - Just some git squashing to clear some disk space on our organization