cmpatino/flint-programbench / tasks /tasks-balanced-30.txt
cmpatino's picture
download
raw
1.41 kB
# ProgramBench Balanced-30 for the replication of arXiv 2610.17471 Sec 4 (solo PIV vs team PIV).
# Written by scripts/programbench_subset.py (programbench 1.2.5); the rule is in its docstring:
# the 200 tasks with a difficulty label, 10 easy / 10 medium / 10 hard (the benchmark's label),
# each stratum's slots spread over the reference languages (one per language, the rest by share),
# and within a language a spread over the hidden-test count (quantile positions, no randomness).
# The metadata of all 200 tasks is in programbench-tasks.csv next to this file.
# One task id per line, in stratum order (easy, medium, hard), then by id.
abishekvashok__cmatrix.5c082c6
anordal__shellharden.6a6ffd4
arthursonzogni__json-tui.17a22b6
cslarsen__jp2a.61d205f
kisielk__errcheck.dacab89
multiprocessio__dsq.c3ae0ba
rbakbashev__elfcat.52f8cc7
sclevine__yj.8016400
sirwart__ripsecrets.34c9e03
wfxr__code-minimap.0ddeea5
brocode__fblog.3b54330
codesnap-rs__codesnap.f81e4f3
ecumene__rust-sloth.051c559
facebook__zstd.1168da0
go-critic__go-critic.9aea378
madler__pigz.fe4894f
nikolassv__bartib.6b9b5ce
ninja-build__ninja.cc60300
peco__peco.4e58dad
sharkdp__fd.40d8eb3
canop__broot.d6c798e
dandavison__delta.acd758f
doxygen__doxygen.966d98e
jesseduffield__lazygit.1d0db51
johnkerl__miller.8d85b46
parcel-bundler__lightningcss.aa2ed1e
php__php-src.c891263
rvben__rumdl.2d75c4d
skeema__skeema.6a76243
typst__typst.88356d0

Xet Storage Details

Size:
1.41 kB
·
Xet hash:
d289b81e8330b124be0ca8e99548090a7945ee99196b68f0fdceedf261ab9b60

Xet efficiently stores files, intelligently splitting them into unique chunks and accelerating uploads and downloads. More info.