mlboydaisuke commited on
Commit
5e1102c
·
verified ·
1 Parent(s): 2db9e21

Card: the chat template drops the user turn on LiteRT-LM 0.18 and later

Browse files
Files changed (1) hide show
  1. README.md +2 -0
README.md CHANGED
@@ -203,6 +203,8 @@ From a conversation preface (the system message, initial messages, tools and ext
203
 
204
  ---
205
 
 
 
206
  ## License
207
 
208
  Released under the **Apache-2.0 License**, consistent with the upstream [openbmb/MiniCPM5-2B](https://huggingface.co/openbmb/MiniCPM5-2B).
 
203
 
204
  ---
205
 
206
+ Since LiteRT-LM 0.18.0 the chat template gets `message.content` as typed parts; the template of `minicpm_wi4c_wi8_afp32.litertlm` and `minicpm_wi8_afp32.litertlm` reads only a string, so it renders an empty user turn. On 0.19.0 the first file then thought about an invented question until the context ran out; 0.17.1 answers. A template that reads the parts, passed with `--chat-template`, brings the question back.
207
+
208
  ## License
209
 
210
  Released under the **Apache-2.0 License**, consistent with the upstream [openbmb/MiniCPM5-2B](https://huggingface.co/openbmb/MiniCPM5-2B).