src/docs/ARCHITECTURE.md

# Architecture

```
Python users                                Services and many users
 anuvani_diar.Diarizer / anuvani-diar CLI        anuvani_diar.Client · curl · triton_inference/tools/bench.py
 anuvani-diar-check                                 |  HTTP: upload or server path -> job id -> status -> RTTM
      |                                           v
      |                                      anuvani-diar-gateway (Rust, axum)
      |                                       spool, admission, token, jobs, result cache, metrics
      v                                           |
 diar-engine (Rust) ------------------------------+   the same engine in both
  input pool:   libsndfile decode, channel mean, validation, window plan       (diar-audio, diar-core::front)
  device pool:  one worker per GPU slot, blocks of 8 windows, schedule fifo / fair / share
  post pool:    clustering, the decoder, RTTM text                            (diar-core, diar-exact)
      |                                           |
      v                                           v
 TorchNN (in process, one CUDA stream per GPU)    Triton 24.10: diar_nn_g0..g5 (one per GPU) + resample_cpu
  the release's own PyTorch model code             one container for all GPUs (serve.sh) or one per GPU (compose)
```

| Layer | Where | What it guarantees |
|---|---|---|
| numerics | `crates/diar-exact` | numpy, scipy, pyannote and CPython arithmetic reproduced operation by operation |
| front-end and post-processing | `crates/diar-core` | the release's windows, batches, masks, clustering, decoder and RTTM text |
| audio | `crates/diar-audio` | soundfile's decoding with the same libsndfile binary, numpy's channel mean, the release's errors |
| engine | `crates/diar-engine` | overlap of decoding, networks and clustering across files and GPUs, with the release's batch shapes |
| networks | `python/anuvani_diar/nn`, `triton/models` | the release's model objects and flags; a start-up check of every batch shape |
| serving | `crates/diar-gateway`, `crates/diar-triton` | limits, restarts that cost time not results, metrics |
| Python | `python/anuvani_diar` | `Diarizer`, `Client`, the CLI and the install check |

Read next: `ENGINE.md` (the pools and schedules), `DETERMINISM.md` (why the bytes match), `TESTING.md` (how that is
checked), `SECURITY.md`, `../triton_inference/README.md` (serving) and `../triton/README.md` (its Triton images).