Saccadic-AI commited on
Commit
277dc02
·
verified ·
1 Parent(s): 8045024

Build Saccadic IRIS organization introduction

Browse files
Files changed (1) hide show
  1. README.md +70 -5
README.md CHANGED
@@ -1,10 +1,75 @@
1
  ---
2
- title: README
3
- emoji: 🏃
4
- colorFrom: yellow
5
- colorTo: green
6
  sdk: static
7
  pinned: false
 
8
  ---
9
 
10
- Edit this `README.md` markdown file to author your organization card.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ title: Saccadic | IRIS Training Diagnostics
3
+ emoji: 🌸
4
+ colorFrom: purple
5
+ colorTo: blue
6
  sdk: static
7
  pinned: false
8
+ short_description: A closer look inside neural network training with IRIS
9
  ---
10
 
11
+ # SACCADIC
12
+ ## IRIS™ · A closer look at AI training
13
+
14
+ **A better view while the run is still underway.**
15
+
16
+ Saccadic LLC develops instruments for understanding neural network training. Our **Intrinsic Rank Inspection System (IRIS)** adds a measured view of internal structure, specialization, and coordination alongside loss and validation curves.
17
+
18
+ [Explore IRIS](https://www.saccadic.ai/iris) · [Visit Saccadic](https://www.saccadic.ai/) · [Discuss an evaluation](mailto:info@saccadic.ai)
19
+
20
+ ---
21
+
22
+ ### The scoreboard tells you the outcome. IRIS helps you inspect the play.
23
+
24
+ A loss curve can show a change without locating it inside the model. IRIS helps researchers and engineers inspect where representations concentrate, which subjects reach each expert, how domains share or conflict, and how the model's organization changes over time.
25
+
26
+ The goal is a more focused investigation: connect an observation to a testable question, compare it with task results, and design the next experiment.
27
+
28
+ ### A training movie, built from measurements
29
+
30
+ | Step | What happens |
31
+ | --- | --- |
32
+ | **Capture** | The tracker takes measurements at fixed training intervals or adjusts spacing to organizational activity, using consistent probe inputs. |
33
+ | **Record** | Measurements accumulate in a self-contained **.iris** file. Training checkpoints keep their usual role. |
34
+ | **Inspect** | The locally running **Bench** reads the growing record during training and opens it for review afterward, without loading the model. |
35
+
36
+ ### Look inside the run
37
+
38
+ - **Flow Map:** inspect measured connections between layers and experts for different input domains.
39
+ - **Representation structure:** track independent directions carrying 95% of activation variation and how dominant directions move.
40
+ - **Expert routing:** compare which subjects reach which experts, separately for each layer.
41
+ - **Domain interaction:** inspect sharing and training-gradient agreement across subjects.
42
+ - **Training kinetics:** compare coherent weight motion with motion that cancels.
43
+
44
+ The October 2026 product reference includes **103 built-in diagnostic views across eight scientific tabs**: Domains, Layers, Heads, Experts, Facets, Whole Model, Flow Map, and Concept Space. These are counted views, not independent scalar measures; coverage varies by model, layer, head, and expert.
45
+
46
+ Each graph has an Explain guide. Teams can report their own labeled scalar signals, derive formulas from captured channels, and export custom charts as PNG images, Excel workbooks, or JSON data.
47
+
48
+ ---
49
+
50
+ ### From a measured run: five operations, different learning times
51
+
52
+ ![Training and held-out accuracy for addition, subtraction, multiplication, division, and exponentiation modulo 113](https://cdn-uploads.huggingface.co/production/uploads/69d6d16790de87a3b534bf99/LsCSdafjN_zw5hphoWKHa.png)
53
+
54
+ In this small mixture-of-experts transformer run, multiplication and division reached 90% held-out accuracy before exponentiation, subtraction, and addition. Overall accuracy eventually flattened, while internal measurements continued to change.
55
+
56
+ [Read the experiment: Accuracy plateaued. The model kept changing.](https://huggingface.co/blog/Saccadic-AI/accuracy-plateaued-the-model-kept-changing)
57
+
58
+ ### Fits the customer's training environment
59
+
60
+ IRIS fits existing **PyTorch training loops**, with support for GPT / LLaMA / Mistral, BERT-family encoders, and supported mixture-of-experts models. User-defined architectures use a measurement adapter to declare capture points. Capture and inspection can run on **CPU, Apple MPS, or NVIDIA CUDA**.
61
+
62
+ Model weights, activations, and probe text are not sent to Saccadic. Licensing and metering contact Saccadic; optional configured relays send selected scalar measurements to experiment trackers including **Weights & Biases, TensorBoard, MLflow, and Aim**.
63
+
64
+ Coverage depends on model layout. Shared-weight configurations are currently unsupported.
65
+
66
+ ### Start with one model, one run, one investigation
67
+
68
+ We welcome conversations with research groups and teams training or fine-tuning proprietary models. A joint evaluation can test whether the readings focus a real investigation and measure overhead in the customer's workload. Academic researchers can request credit grants; requests are reviewed individually.
69
+
70
+ **Contact:** [info@saccadic.ai](mailto:info@saccadic.ai)
71
+ **Product:** [www.saccadic.ai/iris](https://www.saccadic.ai/iris)
72
+
73
+ ---
74
+
75
+ *Based on the Saccadic IRIS product presentation dated 24 October 2026. IRIS is a measurement instrument; readings should be interpreted alongside gradients, loss, validation, and task results.*