Aluode commited on
Commit
b8ba86d
·
verified ·
1 Parent(s): 1a630f0

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +8 -2
README.md CHANGED
@@ -51,15 +51,21 @@ it in your cloned MoireFormer folder.
51
 
52
  3. Run the Chat Interface:
53
 
54
- Bash
55
  pip install torch transformers datasets
 
56
  python moire_chat.py --weights moire_phase2_weights_final.pt --size large
 
57
  Training Curriculum
 
58
  The model was trained in two continuous phases to demonstrate that wave-fields avoid catastrophic forgetting via
 
59
  phase-locking (destructive and constructive interference):
60
 
61
  Phase 1 (Base Geometry): 15 Epochs on a mixed dataset of Databricks Dolly-15k, WikiText-2, and OpenAssistant.
 
62
  This established the foundational phase-space for English and conversational structure.
63
 
64
  Phase 2 (Phase-Space Expansion): 5 Epochs finetuning on the Guanaco dataset to refine logical geometry
65
- and instruction-following, organically expanding the model's topological complexity without overwriting previous data.
 
 
 
51
 
52
  3. Run the Chat Interface:
53
 
 
54
  pip install torch transformers datasets
55
+
56
  python moire_chat.py --weights moire_phase2_weights_final.pt --size large
57
+
58
  Training Curriculum
59
+
60
  The model was trained in two continuous phases to demonstrate that wave-fields avoid catastrophic forgetting via
61
+
62
  phase-locking (destructive and constructive interference):
63
 
64
  Phase 1 (Base Geometry): 15 Epochs on a mixed dataset of Databricks Dolly-15k, WikiText-2, and OpenAssistant.
65
+
66
  This established the foundational phase-space for English and conversational structure.
67
 
68
  Phase 2 (Phase-Space Expansion): 5 Epochs finetuning on the Guanaco dataset to refine logical geometry
69
+
70
+ and instruction-following, organically expanding the model's topological complexity without overwriting previous data.
71
+ (Perhaps?)