Hugging Face's logo

Spaces:
JetBrains-Research
/
SWE-bench-Costs-Calculator
Sleeping

App Files Community
SWE-bench-Costs-Calculator / app.py

Commit History

Bump version to v0.3.46
afac200

IgorSlinko commited on

Auto-refresh litellm prices when model not found
0adb2ff

IgorSlinko commited on

Refresh leaderboard data on app startup
364a0a3

IgorSlinko commited on

Fix ONE TRAJECTORY metadata accordion open by default (v0.3.45)
9fef59c

IgorSlinko commited on

Rename to SWE-bench Costs Calculator, open all accordions by default (v0.3.44)
0b7bbfd

IgorSlinko commited on

Fix routing charts: remove uncached_input, add Use Cache support (v0.3.43)
f734731

IgorSlinko commited on

Move routing explanation text, increase description font (v0.3.42)
b8e0bce

IgorSlinko commited on

Update app title and add description (v0.3.41)
bc80799

IgorSlinko commited on

Remove Token Type x-axis labels, adjust chart margins (v0.3.40)
efb25e7

IgorSlinko commited on

Rename and reorder chart sections, fix metadata ONE TRAJECTORY display (v0.3.39)
f81e3b1

IgorSlinko commited on

Add Use Cache and Tokenizer Overhead support for single trajectory charts (v0.3.38)
403adb5

IgorSlinko commited on

Add metadata-based single trajectory statistics, fix calculated formula (v0.3.37)
10a0b43

IgorSlinko commited on

Add single trajectory statistics section (v0.3.36)
748e866

IgorSlinko commited on

Fix routing charts not showing on first click (v0.3.32)
3855d11

IgorSlinko commited on

Color-code savings: green for saved, red for extra cost (v0.3.31)
fb25245

IgorSlinko commited on

Improve routing charts with comparison view (v0.3.30)
c89587b

IgorSlinko commited on

Fix routing charts: stack models within each category (v0.3.22)
33c5576

IgorSlinko commited on

Change routing charts to stacked bars (v0.3.21)
8a1286e

IgorSlinko commited on

Remove plot titles, keep only gr.Plot labels (v0.3.20)
85c1416

IgorSlinko commited on

Update plot labels and UI improvements (v0.3.19)
b1920b3

IgorSlinko commited on

Expand routing accordion by default (v0.3.19)
f35243c

IgorSlinko commited on

fix: toggle visibility of resolved/unresolved strategy params
27d9808

IgorSlinko commited on

fix: consistent cost calculation for original vs routed models
cc395f5

IgorSlinko commited on

Add Resolved/Unresolved routing strategy (v0.3.18)
26e685e

IgorSlinko commited on

Add Grep routing strategy (v0.3.17)
bb3fde6

IgorSlinko commited on

Add Python list slices routing strategy (v0.3.16)
843e0a2

IgorSlinko commited on

Add quick select buttons for routing models (v0.3.15)
8f49c6a

IgorSlinko commited on

Filter litellm models to chat mode only
8bd8d2f

IgorSlinko commited on

v0.3.14: Add logging, support alternative trajectory format, fix token columns
bca0945

IgorSlinko commited on

Fix router strategy params visibility
745add3

IgorSlinko commited on

Refactor routing strategy UI
0c41621

IgorSlinko commited on

Support multiple routing models (up to 3)
c63e9d7

IgorSlinko commited on

Add validation: Start must be < End, default End=30
1ae03ef

IgorSlinko commited on

Move routing charts to end + add Indexes/Percentages toggle
d9831c7

IgorSlinko commited on

Always use Calculated data for Original Cost in routing
00808db

IgorSlinko commited on

Fix routing bugs and unify chart formatting
a75cc98

IgorSlinko commited on

Fix routing UI bugs and unify chart formats
51fc1ab

IgorSlinko commited on

Add cumulative statistics to routing charts
dd3c0f8

IgorSlinko commited on

Unify token calculation using calculate_routing_tokens
f7c61dd

IgorSlinko commited on

Integrate calculate_routing_tokens for accurate multi-model caching
81a982c

IgorSlinko commited on

Add routing calculation with proper caching simulation
5c06e74

IgorSlinko commited on

Add routing UI: model selection, strategy params, support .traj files
99badd3

IgorSlinko commited on

Major improvements to token calculation and UX
9399ab7

IgorSlinko commited on

Improve Tokenizer Overhead UX
723fdc8

IgorSlinko commited on

Add thinking overhead multiplier for calculated tokens
071222d

IgorSlinko commited on

Improve price detection with fallbacks and date stripping
0cafd55

IgorSlinko commited on

Auto-recalculate cost charts when prices change
ad3271e

IgorSlinko commited on

Add input price and fix uncached input calculation
10ece01

IgorSlinko commited on

Add trajectory analysis with cost breakdown
7e7e3a1

IgorSlinko commited on

Add SWE-bench leaderboard viewer with S3 trajectory download
781ed01

IgorSlinko commited on