Update README.md
Browse files
README.md
CHANGED
|
@@ -29,7 +29,7 @@ size_categories:
|
|
| 29 |
|
| 30 |
Muse2-125M is the smaller sibling of [Muse2-230M](../Muse2%20230M) — the same from-scratch hybrid convolution/attention architecture, sized for tighter edge budgets. Both the base and instruction-tuned weights are included.
|
| 31 |
|
| 32 |
-
**Model Developer:** Muse Research
|
| 33 |
|
| 34 |
**Model Architecture:** Muse2 is an auto-regressive language model that uses a hybrid convolution/attention architecture implemented from scratch in PyTorch (`Muse2ForCausalLM`, no `transformers` code). The tuned version is aligned with supervised fine-tuning (SFT) with completion-only loss masking. No RLHF or DPO has been applied.
|
| 35 |
|
|
|
|
| 29 |
|
| 30 |
Muse2-125M is the smaller sibling of [Muse2-230M](../Muse2%20230M) — the same from-scratch hybrid convolution/attention architecture, sized for tighter edge budgets. Both the base and instruction-tuned weights are included.
|
| 31 |
|
| 32 |
+
**Model Developer:** Muse Research
|
| 33 |
|
| 34 |
**Model Architecture:** Muse2 is an auto-regressive language model that uses a hybrid convolution/attention architecture implemented from scratch in PyTorch (`Muse2ForCausalLM`, no `transformers` code). The tuned version is aligned with supervised fine-tuning (SFT) with completion-only loss masking. No RLHF or DPO has been applied.
|
| 35 |
|