LLMVis / utils /model_patterns.py

Commit History

Added numbers to BertViz visualization, easier to map attention head numbers
67f5be3

cdpearlman commited on

added color swatches for easy mapping from attention categories to BertViz
96e2bc7

cdpearlman commited on

Fixed model-switching bug with activation store clearing
7ad3e7b

cdpearlman commited on

Attention refactor, better categorization and explanation
7fa8fb4

cdpearlman commited on

ablation experiment fixes, better UI and full sequence comparison
a938eeb

cdpearlman commited on

feat(output): Add token scrubber with per-position top-5 next-token probabilities
d60cfe2

cdpearlman Cursor commited on

chore: remove unused code, imports, and deprecated functions
2965a7d

cdpearlman Cursor commited on

conductor(checkpoint): Checkpoint end of Phase 3: Visualization & Feedback Loop
72f82a4

cdpearlman commited on

conductor(checkpoint): Checkpoint end of Phase 2: Frontend Control Panel
24bd049

cdpearlman commited on

feat(ablation): Unify ablation execution into execute_forward_pass
2f4e4f3

cdpearlman commited on

Fix multi-layer ablation to ablate all heads simultaneously
ae08976

cdpearlman commited on

Switch attention viz to head_view and add categorization (Agent D)
ef749ae

cdpearlman commited on

heatmap implementation
ac745db

cdpearlman commited on

Ablation updated for full sequence, needs refactor for front-end and workflow
2ad1c2e

cdpearlman commited on

Fixed errors for beam search refactor
c19d5a8

cdpearlman commited on

Fix meta tensor error in safe_to_serializable
1f5efac

cdpearlman commited on

Update layer highlighting to 100% threshold for actual output token only
9d22c3c

cdpearlman commited on

Clean up: fix significant layer threshold to 50%, remove unused logit lens parameter, remove certainty calculations
a4e6de8

cdpearlman commited on

Fix ablation: add attention_modules to session store so ablation can find attention layers
efbe4ad

cdpearlman commited on

Add comprehensive debugging to ablation data flow
a1ae11e

cdpearlman commited on

Fix ablation: capture ablated attention module output to populate layer data
455f0c2

cdpearlman commited on

Reorganize Layer-by-Layer Predictions: move diagram to main container, reorder sections, update arrows, increase threshold to 75%
c127d17

cdpearlman commited on

Fix token predictions not being collected - changed condition to check for block_outputs and norm_parameters instead of logit_lens_parameter
d6f21db

cdpearlman commited on

Phase 1: Backend infrastructure for token merging, layer-wise tracking, and head ablation
ac1a7df

cdpearlman commited on

Fix experiments section visibility and improve ablation logic - Fix experiments section callback to show properly after analysis - Change mean ablation to use mean across ALL layers and tokens (not just selected layer) - Update UI description to clarify meaningless mean activation - Remove prevent_initial_call to ensure proper initialization
1e7c9a1

cdpearlman commited on

Add Experiments panel with mean ablation feature - Remove Divergent Layers summary from comparison panel (keep badges) - Add collapsible Experiments section after analysis - Implement Ablation Study with layer selection buttons - Add mean ablation function to replace layer activations with mean - Run ablation on both prompts and update results - Gray out ablated layer in accordion with visual indicator - Add CSS styling for experiments panel and ablated layers
67f8e53

cdpearlman commited on

Fix meta tensor serialization error in safe_to_serializable
0e396c0

cdpearlman commited on

Add attention head categorization with colored badges to each layer accordion
0b846ef

cdpearlman commited on

Fix attention view display: always show section, remove Analysis Results, add debugging
4cd795f

cdpearlman commited on

Add simplified attention view with top-3 attended tokens and BertViz toggle button
977a3ff

cdpearlman commited on

feat: Add top-5 predictions with deltas, certainty meter, and bar charts in accordion panels
1221d69

cdpearlman commited on

Fix accordion data flow and remove all legacy Cytoscape code
44b60b5

cdpearlman commited on

Replace Cytoscape with accordion-based layer view
5c05f37

cdpearlman commited on

Refactor Check Token: Replace 4th edge with probability line graph
431ab15

cdpearlman commited on

Implement edge hover tooltips with floating divs for better UX
2588505

cdpearlman commited on

Replace edge hover info with tooltip bubbles on visualization
78bb537

cdpearlman commited on

Fix BertViz category visualization tensor stacking error and add head index labels
d0dc16d

cdpearlman commited on

Feature update: Reorganize attention head categorization with BertViz visualizations for each category
8e9f963

cdpearlman commited on

Feature update: Check token now tries both with/without leading space and uses higher probability variant
7c6af85

cdpearlman commited on

Feature 4: Replace BertViz head_view with model_view for hierarchical attention visualization
d5dc3e0

cdpearlman commited on

Feature updates: collapsible sidebar, toggle compare button, check token submit button, fix second graph visibility, improve check token debug output
3bbf674

cdpearlman commited on

Add check token feature with 4th edge and minimum opacity
08f5ebe

cdpearlman commited on

Using final layer output instead of mlp for simpler computation
f33c95a

cdpearlman commited on

simplified vocab space projection
1dd1822

cdpearlman commited on

Added model config for automatic model parameter detection
c6cb681

cdpearlman commited on

Uses pyvene instead of just pytorch hooks, setting up for activation patching
7fd64d2

cdpearlman commited on

Full visualization reorganization, handles model selection, parameter selection, visualizes graphs w/ bertviz onclick
1a93ca4

cdpearlman commited on