Fix: Add YAML metadata to model card
Browse files
README.md
CHANGED
|
@@ -1,3 +1,18 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
# FlowNet: A Post-Transformer Architecture
|
| 2 |
|
| 3 |
**Not a Transformer. Not an SSM. Not a RNN. Something new.**
|
|
@@ -19,6 +34,17 @@ Input β Particle Encoding β Flow Field β Wave Processing β Bond Formatio
|
|
| 19 |
β Phase Transition Engine β Consistency Field β Topological Memory β Output
|
| 20 |
```
|
| 21 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 22 |
## Project Structure
|
| 23 |
|
| 24 |
```
|
|
@@ -32,23 +58,57 @@ flownet/
|
|
| 32 |
β βββ consistency_field.py # Truth verification via energy
|
| 33 |
β βββ topological_memory.py# Shape-based memory storage
|
| 34 |
βββ modules/
|
| 35 |
-
β
|
| 36 |
-
β βββ flownet_model.py # Full model architecture
|
| 37 |
-
β βββ tokenizer.py # Text β particle encoding
|
| 38 |
-
β βββ output_head.py # Particle state β text output
|
| 39 |
βββ training/
|
| 40 |
-
β
|
| 41 |
-
β βββ losses.py # Novel loss functions
|
| 42 |
-
β βββ data.py # Data loading
|
| 43 |
-
βββ utils/
|
| 44 |
-
β βββ math_utils.py # Wave math, topology helpers
|
| 45 |
-
β βββ visualization.py # Visualize particle dynamics
|
| 46 |
βββ tests/
|
| 47 |
-
β
|
|
|
|
| 48 |
βββ docs/
|
| 49 |
βββ TECHNICAL_SPEC.md # Full technical specification
|
| 50 |
```
|
| 51 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 52 |
## Status
|
| 53 |
|
| 54 |
-
π¬ Research prototype β
|
|
|
|
| 1 |
+
---
|
| 2 |
+
language: en
|
| 3 |
+
license: apache-2.0
|
| 4 |
+
library_name: flownet
|
| 5 |
+
tags:
|
| 6 |
+
- post-transformer
|
| 7 |
+
- wave-interference
|
| 8 |
+
- particle-dynamics
|
| 9 |
+
- phase-transitions
|
| 10 |
+
- topological-memory
|
| 11 |
+
- novel-architecture
|
| 12 |
+
- research
|
| 13 |
+
pipeline_tag: text-generation
|
| 14 |
+
---
|
| 15 |
+
|
| 16 |
# FlowNet: A Post-Transformer Architecture
|
| 17 |
|
| 18 |
**Not a Transformer. Not an SSM. Not a RNN. Something new.**
|
|
|
|
| 34 |
β Phase Transition Engine β Consistency Field β Topological Memory β Output
|
| 35 |
```
|
| 36 |
|
| 37 |
+
## What This Solves
|
| 38 |
+
|
| 39 |
+
| Problem | Transformer Limitation | FlowNet Solution |
|
| 40 |
+
|---|---|---|
|
| 41 |
+
| O(nΒ²) context | Dot-product attention | Wave propagation (O(n)) |
|
| 42 |
+
| Fixed computation | Static compute graph | Phase transitions (adaptive) |
|
| 43 |
+
| Hallucination | No truth mechanism | Consistency field (energy minimization) |
|
| 44 |
+
| No reasoning | Pattern matching only | Topological memory (structural matching) |
|
| 45 |
+
| Lost in middle | Softmax positional bias | Wave-based processing (no bias) |
|
| 46 |
+
| No persistent memory | Stateless KV cache | Topological memory (shape-based) |
|
| 47 |
+
|
| 48 |
## Project Structure
|
| 49 |
|
| 50 |
```
|
|
|
|
| 58 |
β βββ consistency_field.py # Truth verification via energy
|
| 59 |
β βββ topological_memory.py# Shape-based memory storage
|
| 60 |
βββ modules/
|
| 61 |
+
β βββ flownet_model.py # Full model architecture
|
|
|
|
|
|
|
|
|
|
| 62 |
βββ training/
|
| 63 |
+
β βββ trainer.py # Training pipeline
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 64 |
βββ tests/
|
| 65 |
+
β βββ test_core.py # PyTorch test suite
|
| 66 |
+
β βββ test_numpy.py # NumPy validation (12/12 pass β)
|
| 67 |
βββ docs/
|
| 68 |
βββ TECHNICAL_SPEC.md # Full technical specification
|
| 69 |
```
|
| 70 |
|
| 71 |
+
## Quick Start
|
| 72 |
+
|
| 73 |
+
```python
|
| 74 |
+
from flownet.modules.flownet_model import FlowNetModel
|
| 75 |
+
|
| 76 |
+
model = FlowNetModel(
|
| 77 |
+
vocab_size=32000,
|
| 78 |
+
d_semantic=256,
|
| 79 |
+
n_blocks=6,
|
| 80 |
+
n_wave_heads=8,
|
| 81 |
+
use_phase_engine=True,
|
| 82 |
+
use_consistency=True,
|
| 83 |
+
use_topological_memory=True,
|
| 84 |
+
)
|
| 85 |
+
|
| 86 |
+
# Forward pass
|
| 87 |
+
import torch
|
| 88 |
+
token_ids = torch.randint(0, 32000, (2, 128))
|
| 89 |
+
output = model(token_ids, labels=token_ids)
|
| 90 |
+
print(f"Loss: {output['loss'].item():.4f}")
|
| 91 |
+
|
| 92 |
+
# Generation
|
| 93 |
+
generated = model.generate(token_ids[:, :16], max_new_tokens=50)
|
| 94 |
+
```
|
| 95 |
+
|
| 96 |
+
## Validation
|
| 97 |
+
|
| 98 |
+
All core mathematics validated (12/12 tests pass):
|
| 99 |
+
- Wave interference (constructive, destructive, partial)
|
| 100 |
+
- Phase coherence (Kuramoto order parameter)
|
| 101 |
+
- Betti numbers (topological features)
|
| 102 |
+
- Lennard-Jones forces (particle dynamics)
|
| 103 |
+
- Simulated annealing (energy minimization)
|
| 104 |
+
- Full pipeline end-to-end
|
| 105 |
+
|
| 106 |
+
Run tests: `python3 flownet/tests/test_numpy.py`
|
| 107 |
+
|
| 108 |
+
## Technical Spec
|
| 109 |
+
|
| 110 |
+
See [docs/TECHNICAL_SPEC.md](docs/TECHNICAL_SPEC.md) for full architecture details.
|
| 111 |
+
|
| 112 |
## Status
|
| 113 |
|
| 114 |
+
π¬ Research prototype β mathematical framework validated, PyTorch implementation ready for training.
|