AbstractPhil commited on
Commit
ad517f4
·
verified ·
1 Parent(s): d43da9b

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -0
README.md CHANGED
@@ -10,6 +10,10 @@ This is the 26 categorical finetune of nomic-bert-2048's encoder.
10
 
11
  253,952,000 - 77 token samples with 20% mask rate
12
 
 
 
 
 
13
  The model has learned to categorize certain masked patterns with their categories and special tokens.
14
 
15
  ```
 
10
 
11
  253,952,000 - 77 token samples with 20% mask rate
12
 
13
+ 775,000,000 - 144-256 token samples with 30% mask rate
14
+
15
+ Total samples > 1bil
16
+
17
  The model has learned to categorize certain masked patterns with their categories and special tokens.
18
 
19
  ```