AbstractPhil commited on
Commit
7f31bc0
·
verified ·
1 Parent(s): f3986cf

Update trainer.py

Browse files
Files changed (1) hide show
  1. trainer.py +10 -0
trainer.py CHANGED
@@ -3,6 +3,16 @@ BERT-Thetis Colab Training Script
3
  ----------------------------------
4
  Pretrain BERT-Thetis on WikiText-103 with Masked Language Modeling.
5
 
 
 
 
 
 
 
 
 
 
 
6
  Designed for Google Colab with:
7
  - Easy setup and installation
8
  - HuggingFace Hub integration
 
3
  ----------------------------------
4
  Pretrain BERT-Thetis on WikiText-103 with Masked Language Modeling.
5
 
6
+ In a cell above this in colab run this install here; and then begin the training.
7
+
8
+ try:
9
+ !pip uninstall -qy geometricvocab
10
+ except:
11
+ pass
12
+
13
+ !pip install -q git+https://github.com/AbstractEyes/lattice_vocabulary.git
14
+
15
+
16
  Designed for Google Colab with:
17
  - Easy setup and installation
18
  - HuggingFace Hub integration