InferScale-Sim / CHANGELOG.md
ArchitSharma's picture
Commiting v0.3
44745f2
|
Raw
History Blame Contribute Delete
2.95 kB

Changelog

v0.3.0

Research / simulator

  • added prefill/decode disaggregation with independent accelerator profiles and worker counts
  • added a genuine event-driven P/D pipeline with overlapping prefill, transfer, and decode activity
  • added explicit serialized KV-transfer modeling with bandwidth/base-latency controls
  • added P/D telemetry: role utilization, transfer volume, mean/p95 transfer latency, and transfer utilization
  • added P/D-specific bottleneck diagnoses for prefill-pool, decode-pool, and KV-transfer pressure
  • added deterministic shared-prefix reuse with independent cache RNG so enabling cache preserves the workload trace
  • added shared-prefix KV accounting and saved-prefill-token telemetry
  • added four-way colocated/P-D x cache-off/on comparison
  • added bounded design-space exploration and goodput/p95-TTFT Pareto-frontier marking

UI / usability

  • removed the product-style footer
  • simplified top branding toward a research-prototype presentation
  • added explicit Worst repetition and Target columns to Capacity Planner tables/exports
  • removed area fill from the capacity line chart
  • changed line-chart legends to line swatches rather than rectangle blocks
  • added PNG download controls to every chart
  • added meaningful experiment-aware PNG filenames instead of generic chart names
  • retained full-screen chart expansion and Escape-to-close behavior
  • added Modern Serving and Design Explorer sections
  • added live topology, shared-prefix, P/D worker, and interconnect controls to Serving Lab

Validation

  • expanded tests to 17 deterministic cases
  • release check now validates P/D transfer telemetry, design-space output, PNG controls, planner evidence columns, UI ASCII safety, and absence of the old footer

v0.2.0

  • auto-hide runtime header after Pyodide becomes ready; hover/focus at the top edge reveals it
  • redesigned the interface around a flatter engineering-dashboard visual system
  • replaced decorative/non-ASCII ranking glyphs with explicit text labels
  • added chart expansion with Escape-to-close support
  • added copy-to-clipboard and CSV export for Scheduler Arena and Capacity Planner tables
  • added JSON copy alongside download for individual simulations
  • exposed burst multiplier and burst-period controls
  • added component TTFT/E2E SLO-attainment accounting and failure breakdowns
  • added heuristic simulator-side bottleneck diagnosis with evidence and next-step guidance
  • made capacity feasibility conservative across repetitions: every repetition must meet the target and fully drain
  • added minimum/mean/maximum repetition evidence to capacity traces
  • changed the capacity plot to a true linear request-rate x-axis and added worst-repetition evidence

v0.1.0

Initial browser-native Python release with workload generation, static/continuous scheduling, chunked prefill, KV-cache accounting, analytical latency profiles, Scheduler Arena, and SLO capacity search.