Hugging Face's logo

cfpark00
/
toy-multistep-v3-test

Text Generation
Transformers
Safetensors
qwen2
text-generation-inference
Model card Files
xet
 Community
cfpark00 commited on
Commit
eefe2c7
·
verified ·
1 Parent(s): 1bd1d51

Upload tokenizer

Browse files
Files changed (1) hide show
  1. tokenizer.json +21 -20
tokenizer.json CHANGED
@@ -29,26 +29,27 @@
29
  "S": 4,
30
  "P": 5,
31
  "C": 6,
32
- "0": 7,
33
- "1": 8,
34
- "2": 9,
35
- "3": 10,
36
- "4": 11,
37
- "5": 12,
38
- "6": 13,
39
- "7": 14,
40
- "8": 15,
41
- "9": 16,
42
- "10": 17,
43
- "11": 18,
44
- "12": 19,
45
- "13": 20,
46
- "14": 21,
47
- "15": 22,
48
- "16": 23,
49
- "17": 24,
50
- "18": 25,
51
- "19": 26
 
52
  },
53
  "unk_token": "<unk>"
54
  }
 
29
  "S": 4,
30
  "P": 5,
31
  "C": 6,
32
+ "A": 7,
33
+ "0": 8,
34
+ "1": 9,
35
+ "2": 10,
36
+ "3": 11,
37
+ "4": 12,
38
+ "5": 13,
39
+ "6": 14,
40
+ "7": 15,
41
+ "8": 16,
42
+ "9": 17,
43
+ "10": 18,
44
+ "11": 19,
45
+ "12": 20,
46
+ "13": 21,
47
+ "14": 22,
48
+ "15": 23,
49
+ "16": 24,
50
+ "17": 25,
51
+ "18": 26,
52
+ "19": 27
53
  },
54
  "unk_token": "<unk>"
55
  }