Document the SpaMo training checkpoint
Browse files
README.md
CHANGED
|
@@ -15,6 +15,7 @@ assets/ mt5_tokenizer/ flan_t5_tokenizer/ yolo/yolo11n.onnx mediapipe
|
|
| 15 |
unisign/<name>/ projector.onnx encoder.onnx decoder.onnx prefix.npy meta.json
|
| 16 |
spamo/shared/ clip_vit_s2.onnx(+.data) videomae.onnx(+.data) hand_clip.onnx(+.data)
|
| 17 |
spamo/<name>/ projector.onnx(+.data) encoder.onnx(+.data) decoder.onnx(+.data) prompt_embeds.npy meta.json
|
|
|
|
| 18 |
```
|
| 19 |
|
| 20 |
## Models (test-set BLEU-4, ✓ = uploaded)
|
|
@@ -41,3 +42,11 @@ spamo/<name>/ projector.onnx(+.data) encoder.onnx(+.data) decoder.onnx(+.da
|
|
| 41 |
BLEU-4 = reported PJM test score. Decoding faithful to the original eval
|
| 42 |
(Uni-Sign beam=4; SpaMo beam-sample num_beams=5, top_p=0.9). fp32 chosen for deploy
|
| 43 |
(fp16 overflows the bf16-trained flan-t5-xl; int8 is size-only).
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 15 |
unisign/<name>/ projector.onnx encoder.onnx decoder.onnx prefix.npy meta.json
|
| 16 |
spamo/shared/ clip_vit_s2.onnx(+.data) videomae.onnx(+.data) hand_clip.onnx(+.data)
|
| 17 |
spamo/<name>/ projector.onnx(+.data) encoder.onnx(+.data) decoder.onnx(+.data) prompt_embeds.npy meta.json
|
| 18 |
+
checkpoints/spamo/ spamo_pjm_ms_dual_bleu5.36.ckpt (PyTorch Lightning, not used by signsdk)
|
| 19 |
```
|
| 20 |
|
| 21 |
## Models (test-set BLEU-4, ✓ = uploaded)
|
|
|
|
| 42 |
BLEU-4 = reported PJM test score. Decoding faithful to the original eval
|
| 43 |
(Uni-Sign beam=4; SpaMo beam-sample num_beams=5, top_p=0.9). fp32 chosen for deploy
|
| 44 |
(fp16 overflows the bf16-trained flan-t5-xl; int8 is size-only).
|
| 45 |
+
|
| 46 |
+
## Training checkpoint
|
| 47 |
+
|
| 48 |
+
`checkpoints/spamo/spamo_pjm_ms_dual_bleu5.36.ckpt` is a PyTorch Lightning checkpoint of SpaMo (PHOENIX-2014T init,
|
| 49 |
+
PJM MS; epoch 43, dev BLEU-4 5.36). Its test run gave the 5.54 listed for `spamo-pjm-phoenix-ms`; which checkpoint
|
| 50 |
+
the ONNX export was made from is not recorded.
|
| 51 |
+
It is the starting point of the SpaMo-PJM `from_upstream` configs (v26 to v29). Moved here from the former
|
| 52 |
+
`spamo-pjm-checkpoints` repo.
|