Saccadic-AI commited on
Commit
62d8d85
·
verified ·
1 Parent(s): 7930181

Align organization card and launch styled IRIS overview

Browse files
Files changed (1) hide show
  1. README.md +24 -46
README.md CHANGED
@@ -1,75 +1,53 @@
1
  ---
2
- title: Saccadic | IRIS Training Diagnostics
3
- emoji: 🌸
4
  colorFrom: purple
5
  colorTo: blue
6
  sdk: static
 
7
  pinned: false
8
  short_description: A closer look inside neural network training with IRIS
9
  ---
10
 
11
- # SACCADIC
12
- ## IRIS™ · A closer look at AI training
13
 
14
- **A better view while the run is still underway.**
15
 
16
- Saccadic LLC develops instruments for understanding neural network training. Our **Intrinsic Rank Inspection System (IRIS)** adds a measured view of internal structure, specialization, and coordination alongside loss and validation curves.
17
 
18
- [Explore IRIS](https://www.saccadic.ai/iris) · [Visit Saccadic](https://www.saccadic.ai/) · [Discuss an evaluation](mailto:info@saccadic.ai)
19
 
20
- ---
21
-
22
- ### The scoreboard tells you the outcome. IRIS helps you inspect the play.
23
-
24
- A loss curve can show a change without locating it inside the model. IRIS helps researchers and engineers inspect where representations concentrate, which subjects reach each expert, how domains share or conflict, and how the model's organization changes over time.
25
-
26
- The goal is a more focused investigation: connect an observation to a testable question, compare it with task results, and design the next experiment.
27
-
28
- ### A training movie, built from measurements
29
-
30
- | Step | What happens |
31
- | --- | --- |
32
- | **Capture** | The tracker takes measurements at fixed training intervals or adjusts spacing to organizational activity, using consistent probe inputs. |
33
- | **Record** | Measurements accumulate in a self-contained **.iris** file. Training checkpoints keep their usual role. |
34
- | **Inspect** | The locally running **Bench** reads the growing record during training and opens it for review afterward, without loading the model. |
35
 
36
- ### Look inside the run
37
 
38
  - **Flow Map:** inspect measured connections between layers and experts for different input domains.
39
- - **Representation structure:** track independent directions carrying 95% of activation variation and how dominant directions move.
40
  - **Expert routing:** compare which subjects reach which experts, separately for each layer.
41
- - **Domain interaction:** inspect sharing and training-gradient agreement across subjects.
42
- - **Training kinetics:** compare coherent weight motion with motion that cancels.
43
 
44
- The October 2026 product reference includes **103 built-in diagnostic views across eight scientific tabs**: Domains, Layers, Heads, Experts, Facets, Whole Model, Flow Map, and Concept Space. These are counted views, not independent scalar measures; coverage varies by model, layer, head, and expert.
45
 
46
- Each graph has an Explain guide. Teams can report their own labeled scalar signals, derive formulas from captured channels, and export custom charts as PNG images, Excel workbooks, or JSON data.
47
 
48
- ---
49
-
50
- ### From a measured run: five operations, different learning times
51
-
52
- ![Training and held-out accuracy for addition, subtraction, multiplication, division, and exponentiation modulo 113](https://cdn-uploads.huggingface.co/production/uploads/69d6d16790de87a3b534bf99/LsCSdafjN_zw5hphoWKHa.png)
53
 
54
- In this small mixture-of-experts transformer run, multiplication and division reached 90% held-out accuracy before exponentiation, subtraction, and addition. Overall accuracy eventually flattened, while internal measurements continued to change.
55
 
56
- [Read the experiment: Accuracy plateaued. The model kept changing.](https://huggingface.co/blog/Saccadic-AI/accuracy-plateaued-the-model-kept-changing)
57
 
58
- ### Fits the customer's training environment
59
 
60
- IRIS fits existing **PyTorch training loops**, with support for GPT / LLaMA / Mistral, BERT-family encoders, and supported mixture-of-experts models. User-defined architectures use a measurement adapter to declare capture points. Capture and inspection can run on **CPU, Apple MPS, or NVIDIA CUDA**.
61
 
62
- Model weights, activations, and probe text are not sent to Saccadic. Licensing and metering contact Saccadic; optional configured relays send selected scalar measurements to experiment trackers including **Weights & Biases, TensorBoard, MLflow, and Aim**.
63
 
64
- Coverage depends on model layout. Shared-weight configurations are currently unsupported.
65
 
66
- ### Start with one model, one run, one investigation
67
 
68
- We welcome conversations with research groups and teams training or fine-tuning proprietary models. A joint evaluation can test whether the readings focus a real investigation and measure overhead in the customer's workload. Academic researchers can request credit grants; requests are reviewed individually.
69
 
70
- **Contact:** [info@saccadic.ai](mailto:info@saccadic.ai)
71
- **Product:** [www.saccadic.ai/iris](https://www.saccadic.ai/iris)
72
-
73
- ---
74
 
75
- *Based on the Saccadic IRIS product presentation dated 24 October 2026. IRIS is a measurement instrument; readings should be interpreted alongside gradients, loss, validation, and task results.*
 
1
  ---
2
+ title: Saccadic | IRIS Training Observations
3
+ emoji: 👁
4
  colorFrom: purple
5
  colorTo: blue
6
  sdk: static
7
+ app_file: index.html
8
  pinned: false
9
  short_description: A closer look inside neural network training with IRIS
10
  ---
11
 
12
+ <img src="https://cdn-avatars.huggingface.co/v1/production/uploads/69d6d16790de87a3b534bf99/SkapdHGpRMem-dCvIvgMx.png" alt="Saccadic purple lotus with a blue eye" width="110">
 
13
 
14
+ # IRIS™ · A closer look at AI training
15
 
16
+ *A better view while the run is still underway.*
17
 
18
+ Saccadic LLC develops instruments for observing neural network training. IRIS, the Intrinsic Rank Inspection System, adds a measured view of internal structure, specialization, and coordination alongside loss and validation curves.
19
 
20
+ [Explore the styled IRIS Space](https://huggingface.co/spaces/SaccadicAI/README) · [IRIS product details](https://www.saccadic.ai/iris) · [Discuss an evaluation](mailto:info@saccadic.ai)
 
 
 
 
 
 
 
 
 
 
 
 
 
 
21
 
22
+ ## Look inside the run
23
 
24
  - **Flow Map:** inspect measured connections between layers and experts for different input domains.
25
+ - **Representation structure:** observe how activation variation concentrates and how dominant directions move.
26
  - **Expert routing:** compare which subjects reach which experts, separately for each layer.
27
+ - **Domain interaction:** inspect sharing and training-gradient agreement alongside loss and task results.
 
28
 
29
+ ## Capture. Record. Inspect.
30
 
31
+ The tracker captures measurements using consistent probe inputs. A self-contained **.iris** file records the run. The local **Bench** reads that growing record during training and opens it afterward without loading the model.
32
 
33
+ Each graph has an Explain guide. Teams can define labeled scalar signals, derive formulas from captured channels, and export custom charts.
 
 
 
 
34
 
35
+ ## A measured example
36
 
37
+ ![Training and held-out accuracy by mathematical operation](https://cdn-uploads.huggingface.co/production/uploads/69d6d16790de87a3b534bf99/LsCSdafjN_zw5hphoWKHa.png)
38
 
39
+ *Figure 4.4. Training and held-out accuracy for the mathematical operations in this measured run. [Read the experiment and its conditions.](https://huggingface.co/blog/Saccadic-AI/accuracy-plateaued-the-model-kept-changing)*
40
 
41
+ ## Work in your own environment
42
 
43
+ IRIS fits existing PyTorch training loops, with capture and inspection on CPU, Apple MPS, or NVIDIA CUDA. Coverage depends on model layout; shared-weight configurations are currently unsupported.
44
 
45
+ Model weights, activations, and probe text are not sent to Saccadic. Licensing and metering contact Saccadic. Optional configured relays send selected scalar measurements to existing experiment trackers.
46
 
47
+ ## One model. One run. One concrete investigation.
48
 
49
+ We welcome research and joint evaluations. Academic researchers can request credit grants; requests are reviewed individually. See the public product site for availability and licensing terms.
50
 
51
+ [info@saccadic.ai](mailto:info@saccadic.ai) · [www.saccadic.ai/iris](https://www.saccadic.ai/iris)
 
 
 
52
 
53
+ *IRIS pre-alpha. Product overview based on the presentation dated 24 October 2026. IRIS records observations; interpret readings alongside gradients, loss, validation, and task results.*