Buckets:
| # Queue 5: wait for P2s (pid 51702) -> MQ-soft (32k states) -> MQ-large (128k states, soft) -> E5-proc. | |
| cd /workspace/think-decide | |
| export PYTORCH_CUDA_ALLOC_CONF=expandable_segments:True | |
| while kill -0 51702 2>/dev/null; do sleep 15; done | |
| python src/mq.py train --out runs/mqsoft --soft > logs/mqsoft_train.log 2>&1 | |
| python src/mq.py eval --model runs/mqsoft/model.safetensors --out runs/mqsoft/test --soft-k 4 --compile > logs/mqsoft_eval.log 2>&1 | |
| python src/mq.py train --out runs/mqlarge --soft --n-states 128000 > logs/mqlarge_train.log 2>&1 | |
| python src/mq.py eval --model runs/mqlarge/model.safetensors --out runs/mqlarge/test --soft-k 4 --compile > logs/mqlarge_eval.log 2>&1 | |
| scripts/run_e5_proc.sh > logs/p5_run.out 2>&1 | |
| echo QUEUE5_DONE > logs/queue5.done | |
Xet Storage Details
- Size:
- 773 Bytes
- Xet hash:
- f9e9093cfecdb951f58a4336aeae069eb106b6ecabccb3838610ff7d2c41f8eb
·
Xet efficiently stores files, intelligently splitting them into unique chunks and accelerating uploads and downloads. More info.