LoRE / scripts

Commit History

recursive json convert chatgpt
842be01

Charlie81 commited on

robust get_expert_stats and remove repeat
a62f0f3

Charlie81 commited on

everything into the expertracking class
f126bc5

Charlie81 commited on

attribute error
61a401c

Charlie81 commited on

handle JSON serialization
870d3db

Charlie81 commited on

claude to deepseek
3e8c5b1

Charlie81 commited on

Revert "expert usage stats"
c37387b

Charlie81 commited on

HFLM forward to loglikelihoods
3adfc62

Charlie81 commited on

add evalexperts
a83c539

Charlie81 commited on

fix hflm pretrained in eval
2b77d15

Charlie81 commited on

Revert "18k checkpoint"
927465d

Charlie81 commited on

attempts to fix more
077e7bc

Charlie81 commited on

run_evaluation fix
c83cd65

Charlie81 commited on

load custom model fix
b77239a

Charlie81 commited on

more debug info
447000e

Charlie81 commited on

load custom model fix
bfa85e8

Charlie81 commited on

all OlMoeConfig to MyOlmoeConfig
392f3ed

Charlie81 commited on

myolmoe name again
bd82f5d

Charlie81 commited on

use olmoeconfig
255d210

Charlie81 commited on

olmoe to myolmoe
97f51a5

Charlie81 commited on

claude's eval overhaul
6cfb013

Charlie81 commited on

add eval debug
4fed0c0

Charlie81 commited on

use path for HFLM
19d51ff

Charlie81 commited on

Checkpoint at step 12000
cc70445

Charlie81 commited on

keeping save steps at 2k
53278e0

Charlie81 commited on

save steps to 5
6154f2d

Charlie81 commited on

changes to training script
3ed7a55

Charlie81 commited on

progress 20k
8fc755e

Charlie81 commited on

Checkpoint at step 2000
7120a3e

Charlie81 commited on

delete checkpoints all epochs to 3
d4a6b93

Charlie81 commited on

trying changes to git stuff
be580d6

Charlie81 commited on

save functionality
e785830

Charlie81 commited on

YOLO run setup
20c7ba3

Charlie81 commited on

attempt new distribution experts
834ad70

Charlie81 commited on

batch 2 is biggest
f03d4f8

Charlie81 commited on

syntax
dd5034c

Charlie81 commited on

batch 3
85d731b

Charlie81 commited on

batch size 2
d55ddf7

Charlie81 commited on

batch 4
0d64997

Charlie81 commited on

16batch
7d3ca95

Charlie81 commited on

train agaaa
45d6e50

Charlie81 commited on

train aga
580eff8

Charlie81 commited on

fix train
1f3825f

Charlie81 commited on

debugging missing grad
325d2d0

Charlie81 commited on

update training script
f9596a0

Charlie81 commited on

reorder small experts
7050cb6

Charlie81 commited on

unfreeze only gate and experts
356573e

Charlie81 commited on

1 batch size
6b0e19d

Charlie81 commited on

batch size back to 2
14b2125

Charlie81 commited on