norbert3-xs / modeling_norbert.py

Commit History

Update modeling_norbert.py
f7a1ee2
verified

lgcharpe commited on

use approximate GELU from PyTorch
6fe2175
verified

davda54 commited on

Update modeling_norbert.py
7f0b74a
verified

davda54 commited on

Update modeling_norbert.py
a5852cb
verified

davda54 commited on

Simplified the model by always computing batch-first
2da8519
verified

davda54 commited on

Simplified the model by always computing batch-first
20d2498
verified

davda54 commited on

Simplified the model by always computing batch-first
f1bcb7e
verified

davda54 commited on

Simplified the model by always computing batch-first
ebc0bd8
verified

davda54 commited on

Simplified the model by always computing batch-first
4108f9a
verified

davda54 commited on

Simplified the model by always computing batch-first
ae26905
verified

davda54 commited on

Optimization of attention (maybe)
80119d2
verified

davda54 commited on

simplified softmax (to allow torch.compile)
d25295b
verified

davda54 commited on

Update modeling_norbert.py
2697fb5
verified

lgcharpe commited on

Update modeling_norbert.py
843c73f
verified

lgcharpe commited on

Fixing position bucket size
6ce0e52
verified

lgcharpe commited on

Update modeling_norbert.py
5499131
verified

davda54 commited on

Update modeling_norbert.py
b0e2e63

davda54 commited on

Update modeling_norbert.py
ec756e1

davda54 commited on

Update modeling_norbert.py
f2ffb67

davda54 commited on

Optimized wrapper with correct API
5e35bcd

davda54 commited on

Upload 7 files
d0374ab

davda54 commited on