hammadtime evilfreelancer commited on
Commit
6fbb0ad
·
1 Parent(s): ad4bbb3

Adding missing <tool> token to generation_config.json for vLLM (#3)

Browse files

- Update generation_config.json (e4a54df78fa157d19a3c44bba61d3b2b7c800f8b)


Co-authored-by: Pavel Zloi <evilfreelancer@users.noreply.huggingface.co>

Files changed (1) hide show
  1. generation_config.json +1 -0
generation_config.json CHANGED
@@ -3,6 +3,7 @@
3
  "do_sample": true,
4
  "eos_token_id": [
5
  200002,
 
6
  199999
7
  ],
8
  "pad_token_id": 199999,
 
3
  "do_sample": true,
4
  "eos_token_id": [
5
  200002,
6
+ 200012,
7
  199999
8
  ],
9
  "pad_token_id": 199999,