companion_relationship: The source suite and Blobfish companion world share a professional domain, but the companion tasks are independent diagnostic tasks—not converted source tasks.

difficulty_disclosure: Generator label only; no empirical model difficulty claim is published.

domain: Financial research

generator_difficulty_label: hard

instruction: Finalise the Solstice base-case DCF (model_id 9201, company 9001). Total the free_cash_flow across every financial period belonging to company 9001 — other companies' periods do not count. Set model 9201's enterprise_value to that total and its status to 'final', mark its WACC assumption (assumption_id 9301) as status 'verified', and file the review: create a review note on model 9201 from reviewer 'Head of Research' with status 'open' and a body containing the summed cash flow.

source_dataset_id: vals/financeagent

split: train

verifier_basis: vcode


companion_relationship: The source suite and Blobfish companion world share a professional domain, but the companion tasks are independent diagnostic tasks—not converted source tasks.

difficulty_disclosure: Generator label only; no empirical model difficulty claim is published.

domain: Financial research

generator_difficulty_label: medium

instruction: Model governance: a DCF may not carry status 'final' with a discount_rate of 0 — there is nothing to discount by. Find that model and set its status back to 'draft'. Models that are already draft are left alone.

source_dataset_id: vals/financeagent

split: train

verifier_basis: vcode


companion_relationship: The source suite and Blobfish companion world share a professional domain, but the companion tasks are independent diagnostic tasks—not converted source tasks.

difficulty_disclosure: Generator label only; no empirical model difficulty claim is published.

domain: Financial research

generator_difficulty_label: easy

instruction: The same issuer appears twice under two listings. How many companies are named exactly 'Solstice Energy'? Answer with the number.

source_dataset_id: vals/financeagent

split: train

verifier_basis: answer_match (vcode does not discriminate)


companion_relationship: The source suite and Blobfish companion world share a professional domain, but the companion tasks are independent diagnostic tasks—not converted source tasks.

difficulty_disclosure: Generator label only; no empirical model difficulty claim is published.

domain: Financial research

generator_difficulty_label: medium

instruction: Model 9202 carries the 'Terminal growth' assumption twice (assumption_id 9311 and 9312). Delete the duplicate 9312 and keep 9311.

source_dataset_id: vals/financeagent

split: heldout

verifier_basis: vcode


companion_relationship: The source suite and Blobfish companion world share a professional domain, but the companion tasks are independent diagnostic tasks—not converted source tasks.

difficulty_disclosure: Generator label only; no empirical model difficulty claim is published.

domain: Customer operations

generator_difficulty_label: hard

instruction: It is now minute 180. Ticket 9201 belongs to an enterprise-plan customer and still has no first response. Look up the first_response_minutes of the SLA policy for that customer's plan and work out how many minutes past the SLA deadline the response now is (deadline = opened_minute + first_response_minutes). Then set ticket 9201's priority to 'urgent' and status to 'escalated', create an escalation on ticket 9201 with reason 'sla_first_response_breach', tier 'tier2' and status 'open', and post a holding reply: a ticket message on 9201 from author 'agent' at sent_minute 180 whose body states the overdue amount as 'N minutes'.

split: train

verifier_basis: vcode


companion_relationship: The source suite and Blobfish companion world share a professional domain, but the companion tasks are independent diagnostic tasks—not converted source tasks.

difficulty_disclosure: Generator label only; no empirical model difficulty claim is published.

domain: Customer operations

generator_difficulty_label: medium

instruction: Tidy the queue: any ticket that already has a resolved_minute recorded must not still be sitting in status 'open' — set it to 'resolved'. Tickets without a resolved_minute stay open.

split: train

verifier_basis: vcode


companion_relationship: The source suite and Blobfish companion world share a professional domain, but the companion tasks are independent diagnostic tasks—not converted source tasks.

difficulty_disclosure: Generator label only; no empirical model difficulty claim is published.

domain: Customer operations

generator_difficulty_label: easy

instruction: Two subsidiaries were onboarded under one trading name, so routing is ambiguous. How many support customers are named exactly 'Bluepeak Robotics'? Answer with the number.

split: train

verifier_basis: answer_match (vcode does not discriminate)


companion_relationship: The source suite and Blobfish companion world share a professional domain, but the companion tasks are independent diagnostic tasks—not converted source tasks.

difficulty_disclosure: Generator label only; no empirical model difficulty claim is published.

domain: Customer operations

generator_difficulty_label: medium

instruction: Two knowledge-base articles cover the same fix under the identical title 'Recovering an offline fleet controller' (article_id 9501 is published, 9502 is a duplicate draft). Delete the duplicate draft 9502 and keep the published article 9501.

split: heldout

verifier_basis: vcode


companion_relationship: The source suite and Blobfish companion world share a professional domain, but the companion tasks are independent diagnostic tasks—not converted source tasks.

difficulty_disclosure: Generator label only; no empirical model difficulty claim is published.

domain: Scientific discovery

generator_difficulty_label: hard

instruction: Call the potency of assay run 9301. Compute the mean ic50_nm across its replicates that PASSED QC (qc_flag 'pass') — replicates flagged 'fail' are excluded. A mean below 100 nM makes the compound a hit, so: set compound 9101's status to 'hit' and record the mean in its screening_note, set assay run 9301's status to 'complete', and queue confirmation by creating an assay run on assay 9201 for compound 9101 with run_on '2026-08-01', plate_label 'CONF-001' and status 'pending'.

source_dataset_id: scienceagentbench/scienceagentbench

split: train

verifier_basis: vcode


companion_relationship: The source suite and Blobfish companion world share a professional domain, but the companion tasks are independent diagnostic tasks—not converted source tasks.

difficulty_disclosure: Generator label only; no empirical model difficulty claim is published.

domain: Scientific discovery

generator_difficulty_label: medium

instruction: Quality control: an assay run where EVERY replicate carries qc_flag 'fail' produced no usable data and must be set to status 'invalid'. Runs with at least one passing replicate are left alone.

source_dataset_id: scienceagentbench/scienceagentbench

split: train

verifier_basis: vcode


companion_relationship: The source suite and Blobfish companion world share a professional domain, but the companion tasks are independent diagnostic tasks—not converted source tasks.

difficulty_disclosure: Generator label only; no empirical model difficulty claim is published.

domain: Scientific discovery

generator_difficulty_label: easy

instruction: Two structurally distinct compounds were filed under the same common name. How many compounds are named exactly 'Velatinib'? Answer with the number.

source_dataset_id: scienceagentbench/scienceagentbench

split: train

verifier_basis: answer_match (vcode does not discriminate)


companion_relationship: The source suite and Blobfish companion world share a professional domain, but the companion tasks are independent diagnostic tasks—not converted source tasks.

difficulty_disclosure: Generator label only; no empirical model difficulty claim is published.

domain: Scientific discovery

generator_difficulty_label: medium

instruction: Run 9302 has replicate 1 recorded twice (result_id 9411 and 9412) because the plate reader exported twice. Delete the duplicate 9412 and keep 9411.

source_dataset_id: scienceagentbench/scienceagentbench

split: heldout

verifier_basis: vcode


companion_relationship: The source suite and Blobfish companion world share a professional domain, but the companion tasks are independent diagnostic tasks—not converted source tasks.

difficulty_disclosure: Generator label only; no empirical model difficulty claim is published.

domain: Defensive security

generator_difficulty_label: hard

instruction: Document 9201 ('FY27 Budget Model') is confidential and may only be readable by the Finance team. Review its access grants: revoke every still-active grant held by an employee who is not on the Finance team by setting that grant's status to 'revoked', leave Finance grants and already-revoked grants alone, do not touch grants on other documents, and finally set document 9201's status to 'restricted'.

source_dataset_id: polyvorlabs/cyberdefense-bench

split: train

verifier_basis: vcode


companion_relationship: The source suite and Blobfish companion world share a professional domain, but the companion tasks are independent diagnostic tasks—not converted source tasks.

difficulty_disclosure: Generator label only; no empirical model difficulty claim is published.

domain: Defensive security

generator_difficulty_label: medium

instruction: A connector has been disconnected. Every indexed document that came from a source with connected = 0 must be set to status 'stale'; documents from connected sources stay 'indexed'.

source_dataset_id: polyvorlabs/cyberdefense-bench

split: train

verifier_basis: vcode


companion_relationship: The source suite and Blobfish companion world share a professional domain, but the companion tasks are independent diagnostic tasks—not converted source tasks.

difficulty_disclosure: Generator label only; no empirical model difficulty claim is published.

domain: Defensive security

generator_difficulty_label: easy

instruction: Two different employees share a display name, which makes people search ambiguous. How many employees are named exactly 'Rowan Ferreira'? Answer with the number.

source_dataset_id: polyvorlabs/cyberdefense-bench

split: train

verifier_basis: answer_match (vcode does not discriminate)


companion_relationship: The source suite and Blobfish companion world share a professional domain, but the companion tasks are independent diagnostic tasks—not converted source tasks.

difficulty_disclosure: Generator label only; no empirical model difficulty claim is published.

domain: Defensive security

generator_difficulty_label: medium

instruction: A double sync indexed the same passage of document 9201 twice (chunk_id 9301 and 9302), so it is over-weighted in retrieval. Delete the duplicate chunk 9302 and keep 9301.

source_dataset_id: polyvorlabs/cyberdefense-bench

split: heldout

verifier_basis: vcode


companion_relationship: The source suite and Blobfish companion world share a professional domain, but the companion tasks are independent diagnostic tasks—not converted source tasks.

difficulty_disclosure: Generator label only; no empirical model difficulty claim is published.

domain: Enterprise operations

generator_difficulty_label: hard

instruction: Change request 9301 is a high-risk change to the Vendor Onboarding process (doc_id 9101). Policy: a high-risk change cannot be approved while any step of that process has no control_ref mapped. Count the DISTINCT steps of doc 9101 with an empty control_ref — note step 9202 is a duplicate of 9201 and counts once. Because at least one step is uncontrolled: set change request 9301's status to 'rejected', set process doc 9101's status to 'needs_controls', and open the remediation by creating a compliance control named 'Step control backfill' with framework 'SOC2' and status 'untested'.

split: heldout

verifier_basis: vcode


companion_relationship: The source suite and Blobfish companion world share a professional domain, but the companion tasks are independent diagnostic tasks—not converted source tasks.

difficulty_disclosure: Generator label only; no empirical model difficulty claim is published.

domain: Enterprise operations

generator_difficulty_label: medium

instruction: Today is 2026-07-20. Any active vendor whose renewal_on date has already passed must be set to status 'renewal_overdue'. Vendors whose renewal is still ahead stay 'active'.

split: train

verifier_basis: vcode


companion_relationship: The source suite and Blobfish companion world share a professional domain, but the companion tasks are independent diagnostic tasks—not converted source tasks.

difficulty_disclosure: Generator label only; no empirical model difficulty claim is published.

domain: Enterprise operations

generator_difficulty_label: easy

instruction: Two legal entities are registered under one trading name, so spend is split. How many vendors are named exactly 'Cascade Facilities Ltd'? Answer with the number.

split: heldout

verifier_basis: answer_match (vcode does not discriminate)


companion_relationship: The source suite and Blobfish companion world share a professional domain, but the companion tasks are independent diagnostic tasks—not converted source tasks.

difficulty_disclosure: Generator label only; no empirical model difficulty claim is published.

domain: Enterprise operations

generator_difficulty_label: medium

instruction: A bad merge left step 1 of the Vendor Onboarding process recorded twice (step_id 9201 and 9202). Delete the duplicate 9202 and keep 9201.

split: train

verifier_basis: vcode


companion_relationship: The source suite and Blobfish companion world share a professional domain, but the companion tasks are independent diagnostic tasks—not converted source tasks.

difficulty_disclosure: Generator label only; no empirical model difficulty claim is published.

domain: Software engineering

generator_difficulty_label: hard

instruction: Incident 9401 on the ingest service was mitigated at minute 175. Close it out: set incident 9401's resolved_minute to 175 and status to 'resolved', work out how long it lasted (resolved_minute minus detected_minute), then record the follow-up decision by creating an ADR on service 9001 titled 'Rate-limit the ingest queue' with status 'accepted', decided_on '2026-07-21' and a decision that states the incident duration as 'N minutes'; finally post a standup note on service 9001 by author 'Rowan Novak' for day_label 'tuesday' whose body references incident 9401.

source_dataset_id: swe-bench/swe-bench-verified

split: train

verifier_basis: vcode


companion_relationship: The source suite and Blobfish companion world share a professional domain, but the companion tasks are independent diagnostic tasks—not converted source tasks.

difficulty_disclosure: Generator label only; no empirical model difficulty claim is published.

domain: Software engineering

generator_difficulty_label: medium

instruction: Merge policy: a pull request may not sit in status 'approved' while its checks_status is 'failing'. Find the offending PR and set its status back to 'open'. PRs whose checks pass keep their approved status.

source_dataset_id: swe-bench/swe-bench-verified

split: train

verifier_basis: vcode


companion_relationship: The source suite and Blobfish companion world share a professional domain, but the companion tasks are independent diagnostic tasks—not converted source tasks.

difficulty_disclosure: Generator label only; no empirical model difficulty claim is published.

domain: Software engineering

generator_difficulty_label: easy

instruction: After a service split, two services own a repository with the same name. How many repositories are named exactly 'ingest-worker'? Answer with the number.

source_dataset_id: swe-bench/swe-bench-verified

split: train

verifier_basis: answer_match (vcode does not discriminate)


companion_relationship: The source suite and Blobfish companion world share a professional domain, but the companion tasks are independent diagnostic tasks—not converted source tasks.

difficulty_disclosure: Generator label only; no empirical model difficulty claim is published.

domain: Software engineering

generator_difficulty_label: medium

instruction: A flaky bot posted Monday's standup note twice on service 9001 (note_id 9501 and 9502). Delete the duplicate 9502 and keep 9501.

source_dataset_id: swe-bench/swe-bench-verified

split: heldout

verifier_basis: vcode