Hugging Face's logo

natankatz
/
solidity_2

Text Generation
Transformers
PyTorch
llama
text-generation-inference
Model card Files
xet
 Community
1
natankatz commited on
Commit
fef818c
·
1 Parent(s): d28314e

Upload tokenizer

Browse files
Files changed (3) hide show
  1. added_tokens.json +0 -0
  2. tokenizer.json +0 -0
  3. tokenizer_config.json +0 -4
added_tokens.json CHANGED
The diff for this file is too large to render. See raw diff
 
tokenizer.json CHANGED
The diff for this file is too large to render. See raw diff
 
tokenizer_config.json CHANGED
@@ -1,9 +1,5 @@
1
  {
2
  "additional_special_tokens": [
3
- "▁<PRE>",
4
- "▁<MID>",
5
- "▁<SUF>",
6
- "▁<EOT>",
7
  "▁<PRE>",
8
  "▁<MID>",
9
  "▁<SUF>",
 
1
  {
2
  "additional_special_tokens": [
 
 
 
 
3
  "▁<PRE>",
4
  "▁<MID>",
5
  "▁<SUF>",