Spaces:
Running
Running
Build Saccadic IRIS organization introduction
Browse files
README.md
CHANGED
|
@@ -1,10 +1,75 @@
|
|
| 1 |
---
|
| 2 |
-
title:
|
| 3 |
-
emoji:
|
| 4 |
-
colorFrom:
|
| 5 |
-
colorTo:
|
| 6 |
sdk: static
|
| 7 |
pinned: false
|
|
|
|
| 8 |
---
|
| 9 |
|
| 10 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
---
|
| 2 |
+
title: Saccadic | IRIS Training Diagnostics
|
| 3 |
+
emoji: 🌸
|
| 4 |
+
colorFrom: purple
|
| 5 |
+
colorTo: blue
|
| 6 |
sdk: static
|
| 7 |
pinned: false
|
| 8 |
+
short_description: A closer look inside neural network training with IRIS
|
| 9 |
---
|
| 10 |
|
| 11 |
+
# SACCADIC
|
| 12 |
+
## IRIS™ · A closer look at AI training
|
| 13 |
+
|
| 14 |
+
**A better view while the run is still underway.**
|
| 15 |
+
|
| 16 |
+
Saccadic LLC develops instruments for understanding neural network training. Our **Intrinsic Rank Inspection System (IRIS)** adds a measured view of internal structure, specialization, and coordination alongside loss and validation curves.
|
| 17 |
+
|
| 18 |
+
[Explore IRIS](https://www.saccadic.ai/iris) · [Visit Saccadic](https://www.saccadic.ai/) · [Discuss an evaluation](mailto:info@saccadic.ai)
|
| 19 |
+
|
| 20 |
+
---
|
| 21 |
+
|
| 22 |
+
### The scoreboard tells you the outcome. IRIS helps you inspect the play.
|
| 23 |
+
|
| 24 |
+
A loss curve can show a change without locating it inside the model. IRIS helps researchers and engineers inspect where representations concentrate, which subjects reach each expert, how domains share or conflict, and how the model's organization changes over time.
|
| 25 |
+
|
| 26 |
+
The goal is a more focused investigation: connect an observation to a testable question, compare it with task results, and design the next experiment.
|
| 27 |
+
|
| 28 |
+
### A training movie, built from measurements
|
| 29 |
+
|
| 30 |
+
| Step | What happens |
|
| 31 |
+
| --- | --- |
|
| 32 |
+
| **Capture** | The tracker takes measurements at fixed training intervals or adjusts spacing to organizational activity, using consistent probe inputs. |
|
| 33 |
+
| **Record** | Measurements accumulate in a self-contained **.iris** file. Training checkpoints keep their usual role. |
|
| 34 |
+
| **Inspect** | The locally running **Bench** reads the growing record during training and opens it for review afterward, without loading the model. |
|
| 35 |
+
|
| 36 |
+
### Look inside the run
|
| 37 |
+
|
| 38 |
+
- **Flow Map:** inspect measured connections between layers and experts for different input domains.
|
| 39 |
+
- **Representation structure:** track independent directions carrying 95% of activation variation and how dominant directions move.
|
| 40 |
+
- **Expert routing:** compare which subjects reach which experts, separately for each layer.
|
| 41 |
+
- **Domain interaction:** inspect sharing and training-gradient agreement across subjects.
|
| 42 |
+
- **Training kinetics:** compare coherent weight motion with motion that cancels.
|
| 43 |
+
|
| 44 |
+
The October 2026 product reference includes **103 built-in diagnostic views across eight scientific tabs**: Domains, Layers, Heads, Experts, Facets, Whole Model, Flow Map, and Concept Space. These are counted views, not independent scalar measures; coverage varies by model, layer, head, and expert.
|
| 45 |
+
|
| 46 |
+
Each graph has an Explain guide. Teams can report their own labeled scalar signals, derive formulas from captured channels, and export custom charts as PNG images, Excel workbooks, or JSON data.
|
| 47 |
+
|
| 48 |
+
---
|
| 49 |
+
|
| 50 |
+
### From a measured run: five operations, different learning times
|
| 51 |
+
|
| 52 |
+

|
| 53 |
+
|
| 54 |
+
In this small mixture-of-experts transformer run, multiplication and division reached 90% held-out accuracy before exponentiation, subtraction, and addition. Overall accuracy eventually flattened, while internal measurements continued to change.
|
| 55 |
+
|
| 56 |
+
[Read the experiment: Accuracy plateaued. The model kept changing.](https://huggingface.co/blog/Saccadic-AI/accuracy-plateaued-the-model-kept-changing)
|
| 57 |
+
|
| 58 |
+
### Fits the customer's training environment
|
| 59 |
+
|
| 60 |
+
IRIS fits existing **PyTorch training loops**, with support for GPT / LLaMA / Mistral, BERT-family encoders, and supported mixture-of-experts models. User-defined architectures use a measurement adapter to declare capture points. Capture and inspection can run on **CPU, Apple MPS, or NVIDIA CUDA**.
|
| 61 |
+
|
| 62 |
+
Model weights, activations, and probe text are not sent to Saccadic. Licensing and metering contact Saccadic; optional configured relays send selected scalar measurements to experiment trackers including **Weights & Biases, TensorBoard, MLflow, and Aim**.
|
| 63 |
+
|
| 64 |
+
Coverage depends on model layout. Shared-weight configurations are currently unsupported.
|
| 65 |
+
|
| 66 |
+
### Start with one model, one run, one investigation
|
| 67 |
+
|
| 68 |
+
We welcome conversations with research groups and teams training or fine-tuning proprietary models. A joint evaluation can test whether the readings focus a real investigation and measure overhead in the customer's workload. Academic researchers can request credit grants; requests are reviewed individually.
|
| 69 |
+
|
| 70 |
+
**Contact:** [info@saccadic.ai](mailto:info@saccadic.ai)
|
| 71 |
+
**Product:** [www.saccadic.ai/iris](https://www.saccadic.ai/iris)
|
| 72 |
+
|
| 73 |
+
---
|
| 74 |
+
|
| 75 |
+
*Based on the Saccadic IRIS product presentation dated 24 October 2026. IRIS is a measurement instrument; readings should be interpreted alongside gradients, loss, validation, and task results.*
|