src/docs/ARCHITECTURE.md

Architecture

Python users                                Services and many users
 anuvani_diar.Diarizer / anuvani-diar CLI        anuvani_diar.Client · curl · triton_inference/tools/bench.py
 anuvani-diar-check                                 |  HTTP: upload or server path -> job id -> status -> RTTM
      |                                           v
      |                                      anuvani-diar-gateway (Rust, axum)
      |                                       spool, admission, token, jobs, result cache, metrics
      v                                           |
 diar-engine (Rust) ------------------------------+   the same engine in both
  input pool:   libsndfile decode, channel mean, validation, window plan       (diar-audio, diar-core::front)
  device pool:  one worker per GPU slot, blocks of 8 windows, schedule fifo / fair / share
  post pool:    clustering, the decoder, RTTM text                            (diar-core, diar-exact)
      |                                           |
      v                                           v
 TorchNN (in process, one CUDA stream per GPU)    Triton 24.10: diar_nn_g0..g5 (one per GPU) + resample_cpu
  the release's own PyTorch model code             one container for all GPUs (serve.sh) or one per GPU (compose)

Layer	Where	What it guarantees
numerics	crates/diar-exact	numpy, scipy, pyannote and CPython arithmetic reproduced operation by operation
front-end and post-processing	crates/diar-core	the release's windows, batches, masks, clustering, decoder and RTTM text
audio	crates/diar-audio	soundfile's decoding with the same libsndfile binary, numpy's channel mean, the release's errors
engine	crates/diar-engine	overlap of decoding, networks and clustering across files and GPUs, with the release's batch shapes
networks	python/anuvani_diar/nn, triton/models	the release's model objects and flags; a start-up check of every batch shape
serving	crates/diar-gateway, crates/diar-triton	limits, restarts that cost time not results, metrics
Python	python/anuvani_diar	Diarizer, Client, the CLI and the install check

Read next: ENGINE.md (the pools and schedules), DETERMINISM.md (why the bytes match), TESTING.md (how that is checked), SECURITY.md, ../triton_inference/README.md (serving) and ../triton/README.md (its Triton images).