Text Generation
PyTorch
English
ScalarPotentialLMSARFMassLNMultiXi
research
semsimula
conservative-language-model
scalar-potential
lagrangian-mechanics
energy-based-model
physics-informed
splm
multi-channel-xi
tinystories
non-transformer
attention-free
constant-memory-inference
riemannian-geometry
damped-riemannian-geometry
Eval Results (legacy)
fix: remove outer paren before \( math delimiter in CoT bullet
Browse files
README.md
CHANGED
|
@@ -158,7 +158,7 @@ These structural properties enable a set of **native architectural features** th
|
|
| 158 |
- **Geodesic Analogical Reasoning:** Analogy completion via parallel transport of *directed* geodesic arcs on the semantic manifold, respecting potential barriers that linear embedding arithmetic ignores. The damped geodesic equation yields 3–20% cosine-similarity improvement over undamped (diagnostic battery Arm 2). Because damped geodesics are asymmetric, analogy transport must use directed arcs.
|
| 159 |
- **Native Hallucination Detection:** Energy dissipation anomalies \\(\Delta E_{\text{anomaly}}(t) = |\Delta E(t) - \Delta E_{\text{expected}}(t)|\\) and curvature spikes \\(\mathcal{K}_{\max}(t)\\) provide mechanistically grounded uncertainty signals computable at inference time without additional parameters. The smooth damping-induced energy decay is normal operation; deviation from the expected dissipation curve flags hallucination. For Fock models, the detector needs a per-model baseline that accounts for the known layer-1 exchange transient.
|
| 160 |
- **Geodesic Semantic Distance:** A replacement for cosine similarity that encodes the model's learned energy landscape, expected to outperform cosine on polysemy and cross-basin semantic cases. The geodesic distance is inherently asymmetric: \\(d_{\text{geo}}(A,B) \neq d_{\text{geo}}(B,A)\\); a symmetrised variant \\([d(A \to B) + d(B \to A)]/2\\) is available when symmetry is desired.
|
| 161 |
-
- **Native Chain-of-Thought** *(via Fock extension)*: The [Fock-PARFLM v2.1](https://huggingface.co/dimitarpg13/semsimula-fock-parflm) extends this model with register-based native CoT — reasoning steps as Fock register waypoints on damped geodesics, with zero extra token generation. The diagnostic confirms Fock register dynamics are predominantly linear
|
| 162 |
|
| 163 |
|
| 164 |
The conservative constraint imposes a PPL cost relative to attention, but the price buys geometric structure and interpretability that attention-based architectures are structurally incapable of providing.
|
|
|
|
| 158 |
- **Geodesic Analogical Reasoning:** Analogy completion via parallel transport of *directed* geodesic arcs on the semantic manifold, respecting potential barriers that linear embedding arithmetic ignores. The damped geodesic equation yields 3–20% cosine-similarity improvement over undamped (diagnostic battery Arm 2). Because damped geodesics are asymmetric, analogy transport must use directed arcs.
|
| 159 |
- **Native Hallucination Detection:** Energy dissipation anomalies \\(\Delta E_{\text{anomaly}}(t) = |\Delta E(t) - \Delta E_{\text{expected}}(t)|\\) and curvature spikes \\(\mathcal{K}_{\max}(t)\\) provide mechanistically grounded uncertainty signals computable at inference time without additional parameters. The smooth damping-induced energy decay is normal operation; deviation from the expected dissipation curve flags hallucination. For Fock models, the detector needs a per-model baseline that accounts for the known layer-1 exchange transient.
|
| 160 |
- **Geodesic Semantic Distance:** A replacement for cosine similarity that encodes the model's learned energy landscape, expected to outperform cosine on polysemy and cross-basin semantic cases. The geodesic distance is inherently asymmetric: \\(d_{\text{geo}}(A,B) \neq d_{\text{geo}}(B,A)\\); a symmetrised variant \\([d(A \to B) + d(B \to A)]/2\\) is available when symmetry is desired.
|
| 161 |
+
- **Native Chain-of-Thought** *(via Fock extension)*: The [Fock-PARFLM v2.1](https://huggingface.co/dimitarpg13/semsimula-fock-parflm) extends this model with register-based native CoT — reasoning steps as Fock register waypoints on damped geodesics, with zero extra token generation. The diagnostic confirms Fock register dynamics are predominantly linear — \\(R^2_{\text{full}} \approx 0.83\\) (Arm 5), supporting the geodesic-waypoint interpretation.
|
| 162 |
|
| 163 |
|
| 164 |
The conservative constraint imposes a PPL cost relative to attention, but the price buys geometric structure and interpretability that attention-based architectures are structurally incapable of providing.
|