File size: 1,420 Bytes
3f2dde4
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
# OpenPeerLLM NTK Trainer

## Model Overview

This package provides a LoRA-free training workflow for OpenPeerLLM-style causal language models by fitting signed log-gate controllers with ntkmirror. It also includes a tinygrad-based gate-controller smoke demo and a benchmark suite that generates charts for quick inspection.

## Authors

* Andrew Magdy Kamal Nassief
* Riemann Computing Inc.
* OpenPeer AI

## Intended Use

* Fit sparse forward-pass controllers on top of frozen Hugging Face causal language models.
* Run a low-cost local demo that validates gate training logic with tinygrad.
* Generate benchmark artifacts and charts for performance comparisons.
* Stop the demo run early once the requested accuracy target is reached.

## Dependencies

* ntkmirror: https://github.com/leochlon/ntkmirror
* Tinygrad: https://github.com/tinygrad/tinygrad
* Optional charting: OpenBB

## Benchmark Outputs

The benchmark runner records:

* epoch
* training steps
* wall-clock time
* memory usage
* process and thread counts
* samples per second
* initial and final accuracy
* final loss
* predictability score
* learned gate scales

Charts are written as HTML. The benchmark command writes a combined dashboard HTML plus companion charts, prefers OpenBB chart rendering when the optional chart extra is installed, and otherwise falls back to Plotly so the workflow stays runnable.