reaperdoesntknow
/

MoA-100M

Text Generation

mixture-of-attentions

distance-attention

metric-attention

convergentintel

Model card Files Files and versions

reaperdoesntknow commited on Sep 20, 2025

Commit

784c21a

·

verified ·

1 Parent(s): c22b85c

Update README.md

Files changed (1) hide show

README.md +3 -5

README.md CHANGED Viewed

@@ -187,10 +187,8 @@ def collate(examples):
 #     torch.nn.utils.clip_grad_norm_(model.parameters(), 1.2)
 #     optimizer.step(); optimizer.zero_grad()
-⸻
-Evaluation
 For meaningful comparisons, run:
 	•	Validation perplexity on a held-out split.
@@ -249,4 +247,4 @@ Maintainers
 	•	Author: reaper (Convergent Intelligence LLC)
 	•	Contact: add preferred contact
 	•	Issues: HF model hub issues tab

 #     torch.nn.utils.clip_grad_norm_(model.parameters(), 1.2)
 #     optimizer.step(); optimizer.zero_grad()
+---
+## Evaluation
 For meaningful comparisons, run:
 	•	Validation perplexity on a held-out split.
 	•	Author: reaper (Convergent Intelligence LLC)
 	•	Contact: add preferred contact
 	•	Issues: HF model hub issues tab
+---