kosmylo1992 commited on
Commit
5088d4f
·
verified ·
1 Parent(s): 2dbc2e4

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +7 -1
README.md CHANGED
@@ -60,4 +60,10 @@ Public energy domain text sources:
60
  | Flash attention | ✅ |
61
  | Auto resume | ✅ |
62
  | Loss watchdog threshold | 5.0 |
63
- | Loss watchdog patience | 3 |
 
 
 
 
 
 
 
60
  | Flash attention | ✅ |
61
  | Auto resume | ✅ |
62
  | Loss watchdog threshold | 5.0 |
63
+ | Loss watchdog patience | 3 |
64
+
65
+
66
+ ## Tokenizer
67
+
68
+ **Tokenizer type:** `AutoTokenizer`
69
+ **Special token:** `<|end_of_text|>` as `pad_token`