Update tokenizer_config.json to fix 'Error: Object of type Undefined is not JSON serializable'
#7
by bigrobinson - opened
Tool calls are inconsistently handled. The LLM produces tool calls with 'arguments' key, where the chat template expects a 'parameters' key. This causes Error: Object of type Undefined is not JSON serializable when attempting to tokenize message list with tool responses included under tool role.
bigrobinson changed pull request title from Update tokenizer_config.json to Update tokenizer_config.json to fix 'Error: Object of type Undefined is no JSON serializable'
bigrobinson changed pull request title from Update tokenizer_config.json to fix 'Error: Object of type Undefined is no JSON serializable' to Update tokenizer_config.json to fix 'Error: Object of type Undefined is not JSON serializable'