Commit History

fix(logit_pipeline): derive temp_probs from raw logits, not penalized
aef1de2
Running

Chris Cameron commited on

build(gitignore): fix stress-test output ignore path
59109c7

Chris Cameron commited on

revert(timing): remove temporary ZeroGPU inference instrumentation
b5fb6a5

Chris Cameron commited on

docs(lessons-learned): record ZeroGPU workshop load-capacity results
c35d5dc

Chris Cameron commited on

perf(zerogpu): set per-endpoint GPU durations for tighter scheduling
06b431a

Chris Cameron commited on

feat(timing): wire ZeroGPU timing into streaming endpoints
44d2c7b

Chris Cameron commited on

feat(timing): wire ZeroGPU timing into predict_next_token
bf4c4dd

Chris Cameron commited on

feat(timing): wire ZeroGPU timing into the safety path
ef60355

Chris Cameron commited on

fix(timing): flush ZG_TIME output and strengthen timing tests
ac43d7f

Chris Cameron commited on

feat(timing): add temporary ZeroGPU inference timing helper
8cf1a0a

Chris Cameron commited on

docs: full rewrite for Transformers + ZeroGPU backend
4ce74df

Chris Cameron commited on

build: drop vLLM and nvidia-ml-py deps for Transformers backend
9f423ec

Chris Cameron commited on

test(app): align test_app and test_app_token_display with sync handlers
ffe2e79

Chris Cameron commited on

feat(app): rewire handlers from async vLLM to sync Transformers
c8bc040

Chris Cameron commited on

test: restore Transformers backend tests, delete vLLM-only tests
2273c00

Chris Cameron commited on

feat: restore Transformers backend from pre-vLLM history
dfef5cd

Chris Cameron commited on

docs: fix README and AGENTS to accurately describe vLLM backend
ee82ae0

Chris Cameron commited on

docs: move investigation docs to docs/archive/
55de792

Chris Cameron commited on

docs: add lessons-learned.md — consolidated dead-ends reference
55082bf

Chris Cameron commited on

chore: delete merge artifact, gitignore stress-test results
d3f711b

Chris Cameron commited on

docs: remove TORCH_COMPILE and PROFILE_REQUESTS documentation
bc67b77

Chris Cameron commited on

refactor: remove [PROFILE] request-lifecycle instrumentation
1f7afbd

Chris Cameron commited on

revert(app): restore .then wiring for dataset updates
a0bd99a

Chris Cameron commited on

chore(app): remove dead .token-button CSS
3cacd10

Chris Cameron commited on

fix(app): use visible='hidden' for distribution slots (Gradio #13494)
6b99881

Chris Cameron commited on

diag(app): log received temp/freq + distribution count per next_token click
82f2c48

Chris Cameron commited on

fix(app): compute dataset updates inline to avoid stale chart_state in .then
68260db

Chris Cameron commited on

fix(app): left-align Dataset cells via CSS (component_props text_align had no effect)
a1bdf78

Chris Cameron commited on

feat(app): shorten probability bar and left-align dataset cells
3845d60

Chris Cameron commited on

fix(app): pass gr.Dataset components as strings to avoid stray textboxes
389aa63

Chris Cameron commited on

docs: update Next Token rendering section for gr.Dataset
d139419

Chris Cameron commited on

feat(app): replace @gr .render token buttons with static gr.Dataset
678f959

Chris Cameron commited on

feat(app): add _make_dataset_select_handler factory for dataset clicks
32e703e

Chris Cameron commited on

feat(app): add _apply_distribution_updates gradio wrapper
db1e92f

Chris Cameron commited on

feat(app): add _distribution_rows helper for dataset rendering
c7ec7e3

Chris Cameron commited on

refactor(tests): consolidate vLLM fakes into tests/_fakes.py
c18113d

Chris Cameron commited on

test: add vLLM generate() API contract test
1ccb2f1

Chris Cameron commited on

fix(generation,logit_pipeline): pass token IDs via prompt arg (V1 generate API)
354760e

Chris Cameron commited on

fix(engines): assign correct repo to each variant (instruct/base were swapped)
43e2fc1

Chris Cameron commited on

fix(engines): re-budget from measured weights + make gpu fractions env-tunable
0edf8aa

Chris Cameron commited on

fix(engines): re-budget gpu_memory_utilization to fit a 22 GiB L4
02839c4

Chris Cameron commited on

fix(config): restore gpu_monitor startup in load_model
5264758

Chris Cameron commited on

fix(generation): surface _merge_async_gens streaming errors instead of deadlocking
4eb4c78

Chris Cameron commited on

fix: async monkeypatch for handle_token_selection tests
c52fc7c

Chris Cameron commited on

feat(generation): parallel base+instruct streaming in compare_models
17534aa

Chris Cameron commited on

docs: update AGENTS.md for vLLM deployment (ZeroGPU dropped, L4 only)
3d0cad8

Chris Cameron commited on

feat(app): wire async vLLM handlers, drop ZeroGPU, eager engine load
55d2416

Chris Cameron commited on

refactor: slim config.py, drop zerogpu, update imports
bfb5359

Chris Cameron commited on

feat(safety): rewrite check_safety via ShieldGemma vLLM engine
5552186

Chris Cameron commited on

feat(generation): rewrite with async vLLM streaming generators
61694e3

Chris Cameron commited on