amewebstudio commited on
Commit
f4502a5
ยท
verified ยท
1 Parent(s): 338eca0

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +68 -22
README.md CHANGED
@@ -8,8 +8,10 @@ tags:
8
  - cognitive-architecture
9
  - earcp
10
  - lpol
 
11
  - neurogenesis
12
  - pytorch
 
13
  pipeline_tag: reinforcement-learning
14
  library_name: pytorch
15
  ---
@@ -18,40 +20,84 @@ library_name: pytorch
18
 
19
  **"Learning to Simulate Reality with Full Cognitive Architecture"**
20
 
21
- ## Architecture
22
 
23
- - **EARCP Module**: Sparse Compression + Gated Integration
24
- - **LPOL Memory**: 9 world domains (physics, spatial, temporal, causal, agent, object, zone, action, reward)
25
- - **Multi-World Buffers**: physical, social, abstract, temporal
26
- - **Neurogenesis**: Dynamic neuron growth based on coherence
27
- - **Energy System**: Cognitive resource management
28
- - **Dream Phase**: Prioritized replay consolidation
29
- - **Physics Prior (MDN)**: 8-component mixture density network
 
30
 
31
- ## Training Info
32
 
33
- - **Epochs**: 1
34
- - **Final Loss**: 2.1851
35
- - **Neurogenesis Events**: 6
36
- - **Parameters**: 4,554,497
 
 
 
37
 
38
- ## Usage
39
 
40
  ```python
41
- from nexus_worldmodel_v2 import NexusWorldModel, NexusWorldModelConfig
 
42
 
43
- config = NexusWorldModelConfig()
44
- model = NexusWorldModel(config)
 
45
 
46
- # Load weights
47
- checkpoint = torch.load("nexus_worldmodel_v2.pt")
48
- model.load_state_dict(checkpoint['model'])
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
49
  ```
50
 
51
- ## Author
52
 
53
  **Mike Amega (Logo)** - Ame Web Studio
54
 
55
- ## License
56
 
57
  Apache 2.0
 
8
  - cognitive-architecture
9
  - earcp
10
  - lpol
11
+ - gqa
12
  - neurogenesis
13
  - pytorch
14
+ - reinforcement-learning
15
  pipeline_tag: reinforcement-learning
16
  library_name: pytorch
17
  ---
 
20
 
21
  **"Learning to Simulate Reality with Full Cognitive Architecture"**
22
 
23
+ ## ๐Ÿง  Architecture
24
 
25
+ | Component | Description |
26
+ |-----------|-------------|
27
+ | **EARCP Module** | Sparse Compression + Gated Integration |
28
+ | **LPOL Memory** | 9 domains with GQA |
29
+ | **GQA** | 8 heads, 2 KV groups (75% savings) |
30
+ | **EARCP Layers** | 8 layers ร— 6 experts |
31
+ | **Neurogenesis** | Dynamic growth (32-256 neurons) |
32
+ | **Physics Prior** | MDN with 8 components |
33
 
34
+ ## ๐Ÿ“Š Training Results
35
 
36
+ | Metric | Value |
37
+ |--------|-------|
38
+ | **Epochs** | 6 |
39
+ | **Final Loss** | 0.0172 |
40
+ | **Coherence** | ~0.42 |
41
+ | **Neurogenesis Events** | 0 |
42
+ | **Parameters** | 227,991,690 |
43
 
44
+ ## ๐Ÿš€ Quick Start
45
 
46
  ```python
47
+ import torch
48
+ from huggingface_hub import hf_hub_download
49
 
50
+ # Download and load
51
+ model_path = hf_hub_download(repo_id="amewebstudio/nexus-worldmodel-v2", filename="nexus_worldmodel_v2.pt")
52
+ checkpoint = torch.load(model_path, map_location="cuda")
53
 
54
+ config = checkpoint['config']
55
+ state_dict = checkpoint['model']
56
+
57
+ print(f"Epochs: {checkpoint['epochs']}")
58
+ print(f"Loss: {checkpoint['loss']:.4f}")
59
+ ```
60
+
61
+ ## ๐Ÿ“ Files
62
+
63
+ | File | Description |
64
+ |------|-------------|
65
+ | `nexus_worldmodel_v2.pt` | Full checkpoint |
66
+ | `pytorch_model.bin` | Weights only |
67
+ | `config.json` | Model configuration |
68
+ | `cognitive_state.json` | Dynamic cognitive state |
69
+ | `configuration_nexus_worldmodel.py` | Config class |
70
+ | `model_index.json` | Component index |
71
+
72
+ ## โš ๏ธ Dynamic Architecture
73
+
74
+ This model uses a **cognitive-dynamic** architecture where:
75
+ - Expert count per layer can **grow** during training
76
+ - Neuron count can **change** (neurogenesis)
77
+ - Memory states are **persistent**
78
+
79
+ When loading, use `strict=False` to handle potential size mismatches:
80
+ ```python
81
+ model.load_state_dict(state_dict, strict=False)
82
+ ```
83
+
84
+ ## ๐Ÿ“– Configuration
85
+
86
+ ```json
87
+ {
88
+ "d_model": 512,
89
+ "n_layers": 8,
90
+ "latent_dim": 256,
91
+ "use_gqa": true,
92
+ "gqa_num_kv_groups": 2,
93
+ "neurogenesis_enabled": true
94
+ }
95
  ```
96
 
97
+ ## ๐Ÿ‘ค Author
98
 
99
  **Mike Amega (Logo)** - Ame Web Studio
100
 
101
+ ## ๐Ÿ“„ License
102
 
103
  Apache 2.0