File size: 1,420 Bytes
3f2dde4 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 | # OpenPeerLLM NTK Trainer
## Model Overview
This package provides a LoRA-free training workflow for OpenPeerLLM-style causal language models by fitting signed log-gate controllers with ntkmirror. It also includes a tinygrad-based gate-controller smoke demo and a benchmark suite that generates charts for quick inspection.
## Authors
* Andrew Magdy Kamal Nassief
* Riemann Computing Inc.
* OpenPeer AI
## Intended Use
* Fit sparse forward-pass controllers on top of frozen Hugging Face causal language models.
* Run a low-cost local demo that validates gate training logic with tinygrad.
* Generate benchmark artifacts and charts for performance comparisons.
* Stop the demo run early once the requested accuracy target is reached.
## Dependencies
* ntkmirror: https://github.com/leochlon/ntkmirror
* Tinygrad: https://github.com/tinygrad/tinygrad
* Optional charting: OpenBB
## Benchmark Outputs
The benchmark runner records:
* epoch
* training steps
* wall-clock time
* memory usage
* process and thread counts
* samples per second
* initial and final accuracy
* final loss
* predictability score
* learned gate scales
Charts are written as HTML. The benchmark command writes a combined dashboard HTML plus companion charts, prefers OpenBB chart rendering when the optional chart extra is installed, and otherwise falls back to Plotly so the workflow stays runnable. |