fix(logit_pipeline): derive temp_probs from raw logits, not penalized aef1de2 Running Chris Cameron commited on 25 days ago
revert(timing): remove temporary ZeroGPU inference instrumentation b5fb6a5 Chris Cameron commited on 25 days ago
docs(lessons-learned): record ZeroGPU workshop load-capacity results c35d5dc Chris Cameron commited on 25 days ago
perf(zerogpu): set per-endpoint GPU durations for tighter scheduling 06b431a Chris Cameron commited on 26 days ago
feat(timing): wire ZeroGPU timing into streaming endpoints 44d2c7b Chris Cameron commited on 26 days ago
feat(timing): wire ZeroGPU timing into predict_next_token bf4c4dd Chris Cameron commited on 26 days ago
fix(timing): flush ZG_TIME output and strengthen timing tests ac43d7f Chris Cameron commited on 26 days ago
feat(timing): add temporary ZeroGPU inference timing helper 8cf1a0a Chris Cameron commited on 26 days ago
build: drop vLLM and nvidia-ml-py deps for Transformers backend 9f423ec Chris Cameron commited on 26 days ago
test(app): align test_app and test_app_token_display with sync handlers ffe2e79 Chris Cameron commited on 26 days ago
feat(app): rewire handlers from async vLLM to sync Transformers c8bc040 Chris Cameron commited on 26 days ago
test: restore Transformers backend tests, delete vLLM-only tests 2273c00 Chris Cameron commited on 26 days ago
feat: restore Transformers backend from pre-vLLM history dfef5cd Chris Cameron commited on 26 days ago
docs: fix README and AGENTS to accurately describe vLLM backend ee82ae0 Chris Cameron commited on 26 days ago
docs: add lessons-learned.md — consolidated dead-ends reference 55082bf Chris Cameron commited on 26 days ago
chore: delete merge artifact, gitignore stress-test results d3f711b Chris Cameron commited on 26 days ago
docs: remove TORCH_COMPILE and PROFILE_REQUESTS documentation bc67b77 Chris Cameron commited on 26 days ago
refactor: remove [PROFILE] request-lifecycle instrumentation 1f7afbd Chris Cameron commited on 26 days ago
fix(app): use visible='hidden' for distribution slots (Gradio #13494) 6b99881 Chris Cameron commited on 26 days ago
diag(app): log received temp/freq + distribution count per next_token click 82f2c48 Chris Cameron commited on 26 days ago
fix(app): compute dataset updates inline to avoid stale chart_state in .then 68260db Chris Cameron commited on 26 days ago
fix(app): left-align Dataset cells via CSS (component_props text_align had no effect) a1bdf78 Chris Cameron commited on 29 days ago
feat(app): shorten probability bar and left-align dataset cells 3845d60 Chris Cameron commited on 29 days ago
fix(app): pass gr.Dataset components as strings to avoid stray textboxes 389aa63 Chris Cameron commited on 29 days ago
docs: update Next Token rendering section for gr.Dataset d139419 Chris Cameron commited on 30 days ago
feat(app): replace @gr .render token buttons with static gr.Dataset 678f959 Chris Cameron commited on 30 days ago
feat(app): add _make_dataset_select_handler factory for dataset clicks 32e703e Chris Cameron commited on 30 days ago
feat(app): add _apply_distribution_updates gradio wrapper db1e92f Chris Cameron commited on 30 days ago
feat(app): add _distribution_rows helper for dataset rendering c7ec7e3 Chris Cameron commited on about 1 month ago
refactor(tests): consolidate vLLM fakes into tests/_fakes.py c18113d Chris Cameron commited on about 1 month ago
fix(generation,logit_pipeline): pass token IDs via prompt arg (V1 generate API) 354760e Chris Cameron commited on about 1 month ago
fix(engines): assign correct repo to each variant (instruct/base were swapped) 43e2fc1 Chris Cameron commited on about 1 month ago
fix(engines): re-budget from measured weights + make gpu fractions env-tunable 0edf8aa Chris Cameron commited on about 1 month ago
fix(engines): re-budget gpu_memory_utilization to fit a 22 GiB L4 02839c4 Chris Cameron commited on about 1 month ago
fix(config): restore gpu_monitor startup in load_model 5264758 Chris Cameron commited on about 1 month ago
fix(generation): surface _merge_async_gens streaming errors instead of deadlocking 4eb4c78 Chris Cameron commited on about 1 month ago
fix: async monkeypatch for handle_token_selection tests c52fc7c Chris Cameron commited on about 1 month ago
feat(generation): parallel base+instruct streaming in compare_models 17534aa Chris Cameron commited on about 1 month ago
docs: update AGENTS.md for vLLM deployment (ZeroGPU dropped, L4 only) 3d0cad8 Chris Cameron commited on about 1 month ago
feat(app): wire async vLLM handlers, drop ZeroGPU, eager engine load 55d2416 Chris Cameron commited on about 1 month ago
refactor: slim config.py, drop zerogpu, update imports bfb5359 Chris Cameron commited on about 1 month ago
feat(safety): rewrite check_safety via ShieldGemma vLLM engine 5552186 Chris Cameron commited on about 1 month ago
feat(generation): rewrite with async vLLM streaming generators 61694e3 Chris Cameron commited on about 1 month ago