Merge pull request #6 from gary-boon/feature/rq1-ffn-intermediate

Backend: unembedding cosine emission + Devstral tokenizer fallback

Emit per-token embedding L2 norms for RQ1 Step 3

Emit per-layer top-K SwiGLU intermediate activations for RQ1 Step 5

Merge: F2 backend — emit effective_probability for sampling-effective margins (#5)

Merge: F1 backend — expose query_position and query_token_id (#4)

Merge: F3a — derive aggregate-row num_heads from request metadata (#1)

Emit effective_probability and sampling eligibility per alternative

Expose query_position and query_token_id in /attention/row response

Derive aggregate-row num_heads from request metadata, not live model

Fix empty text and incorrect is_special for Mistral control tokens

Fix score-all classification in vectorised path

Merge branch 'main' into feature/score-all-classification

Pin PyTorch <2.11.0 to fix CUDA driver incompatibility on HF Spaces

Revert "Fix model selector not showing loaded GPU model on CPU-detected hardware"

Fix model selector not showing loaded GPU model on CPU-detected hardware

Refactor head classification from cascade to score-all-then-rank

Add FFN contribution metrics and gate activation stats to research endpoint

Add tuned lens as supplementary projection mode for logit lens

Rename 'counterfactual' terminology to 'input ablation' in docstrings

Fix margin winner_token in margin_data and extract _classify_stability helper

Add margin-based decision analysis, interventional counterfactuals, and run comparison (v3.0)

Add deep inspection: data-driven pattern classification, attention/MLP tracking, logit lens

Change default model to Devstral and optimise attention extraction

Fix PyTorch dynamo cache directory issue in containers

Fix MistralTokenizer loading and token section boundaries

Fix MistralTokenizer not loaded during model switch

feat: add top-k/top-p sampling and detailed logits/probability tracking

fix: Improve token alternatives numerical stability and temperature control

Store matrices as numpy arrays instead of Python lists

Add per-step memory cleanup for large model support

Fix RAM exhaustion for large token generation

feat: add auto_complete parameter for token generation

fix: add QKV extraction support for Mistral/Devstral architecture

feat: implement lazy-loading for attention matrices

Add avg_entropy calculation for attention heads

Revert QKV visualization fixes - need better approach for data streaming

Add safety checks for missing QKV keys

Limit QKV matrices to top 5 heads per layer to reduce response size

Fix QKV matrix extraction for Mistral/Devstral architecture

Fix QKV visualization for Mistral/Devstral architecture

Add future considerations doc for response size optimization

Fix: Import time module at top level for SSE events

Add SSE streaming endpoint for real-time analysis progress

feat: Include token metadata in analysis response

feat: Implement tier-based model filtering by device type

Fix: Add attn_implementation="eager" to model switch function

Add Phase 5: Performance optimizations to phased plan

Add tokenSections boundaries and update system prompt

Fix: Handle MistralCommonTokenizer pad_token setter