model output does not follow the tool call format
#106
by www-www - opened
i follow:
https://huggingface.co/moonshotai/Kimi-K2-Instruct-0905/blob/main/docs/tool_call_guidance.md
and check model output from sglang 0.5.9 with kimi k-2.5
the function format should be 'functions.Read:1':
|tool_calls_section_begin|> <|tool_call_begin|> functions.Read:1 <|tool_call_argument_begin|> {"file_path": "/home/www/a.md"} <|tool_call_end|> <|tool_calls_section_end|>
however, quite often, i encounter this format:
<|tool_call_begin|> functionsRead1 <|tool_call_argument_begin|>
the delimiter disappears and the tool call parse fails.
i try to patch the parse as a workaround but i do not think it fits functions call if i have it named as 'read_v1'
any suggetsions?