Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 5373 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Test Coverage

The generated tests cover the critical user-visible behaviors, accessibility properties, and widget states described in the prompt.

No relevant tests; empty or unrelated test file.

Minimal coverage; only a trivial smoke test exists.

Partial coverage; some important behaviors are not tested.

Mostly covered; one or two key interaction or semantic checks missing.

Comprehensive coverage; only an edge case or optional behavior is missing.

Full coverage; every specified behavior, accessibility check, and state is tested.

Executable Test Style

Tests follow Flutter's testWidgets / group / setUp patterns and are runnable in a standard `flutter test` environment without modification.

Not executable; missing imports, wrong function signatures, or syntax errors.

Barely executable; requires heavy manual fixes to run.

Runnable with significant manual patching; wrong pump or finder patterns.

Mostly executable; minor fixes needed for imports or test setup.

Ready to run; only trivial import path tweaks may be needed.

Fully executable; correct imports, proper pumpWidget, clean test structure.

Assertions

Expectations are specific, meaningful, and verify the intended behavior rather than trivial or tautological checks.

No assertions or only tautological checks (e.g., expect(true, isTrue)).

Very weak assertions; do not verify the actual widget behavior.

Some meaningful assertions but many are too generic or miss the point.

Most assertions are meaningful; a few could be more specific or rigorous.

Strong assertions; closely match the expected behavior with minor improvements possible.

Excellent assertions; precise, behavior-driven, and directly tied to the prompt requirements.

Edge Cases

Tests account for edge cases such as disabled states, empty input, screen scaling, semantics variations, and error paths.

No edge cases considered; only the happy path is tested.

One trivial edge case considered; most variations ignored.

A few edge cases present but important ones (e.g., disabled, empty) missing.

Basic edge cases covered; some advanced variations (scaling, semantics) missing.

Good edge case coverage; nearly all specified variations are tested.

Comprehensive edge cases; accessibility scaling, disabled states, errors all verified.

Clarity

Test names, variable names, and structure are self-documenting and easy to maintain.

Unreadable; cryptic names, no structure, or commented-out code left in.

Poor clarity; names do not describe what is being tested.

Below average; some good names but inconsistent style or structure.

Acceptable clarity; names describe behavior but could be more descriptive.

Good clarity; well-named tests and clear structure throughout.

Excellent clarity; descriptive test names, logical grouping, easy to navigate.

Score each criterion 0-5. Task type: test_generation. Difficulty: medium. Expected answer length: 786 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: medium. Expected answer length: 887 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: medium. Expected answer length: 848 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: medium. Expected answer length: 979 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: medium. Expected answer length: 1271 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 2431 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: medium. Expected answer length: 959 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: medium. Expected answer length: 1080 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: medium. Expected answer length: 1155 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: medium. Expected answer length: 2440 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: medium. Expected answer length: 2847 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: medium. Expected answer length: 598 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: medium. Expected answer length: 1222 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: medium. Expected answer length: 1970 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: medium. Expected answer length: 1370 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: medium. Expected answer length: 873 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: medium. Expected answer length: 671 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: medium. Expected answer length: 666 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: medium. Expected answer length: 683 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: medium. Expected answer length: 1563 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: medium. Expected answer length: 2300 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: medium. Expected answer length: 887 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: medium. Expected answer length: 1768 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: medium. Expected answer length: 1059 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: medium. Expected answer length: 1022 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: medium. Expected answer length: 1049 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: medium. Expected answer length: 2091 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: medium. Expected answer length: 667 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: medium. Expected answer length: 931 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: medium. Expected answer length: 446 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 3644 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: medium. Expected answer length: 1911 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: medium. Expected answer length: 1815 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Correctness

The generated code correctly implements the requested functionality without logical errors, missing imports, or broken widget trees.

Completely incorrect or irrelevant; does not compile or address the prompt.

Major errors prevent the code from working; wrong widget used or logic is inverted.

Partially correct with significant bugs; some imports missing or state handling broken.

Mostly correct with minor issues; small layout bugs or missing null checks remain.

Correct with very minor issues; only cosmetic or non-functional deviations.

Fully correct and robust; compiles and behaves as specified under normal conditions.

Completeness

All requested features, widgets, and behaviors from the prompt are present in the answer without omissions.

None of the requested features are implemented.

Most features are missing; only a stub or skeleton is present.

Several key features are missing; partial implementation only.

Most features present but one or two important behaviors are omitted.

Nearly complete; only a minor optional detail is missing.

Fully complete; every requirement from the prompt is addressed.

Flutter Best Practices

Use of idiomatic Flutter patterns: proper widget composition, separation of concerns, efficient rebuilds, and appropriate use of Material/Cupertino.

Anti-patterns throughout; e.g., setState in build or excessive global state.

Frequent anti-patterns; widget tree is deeply nested without extract methods.

Some best practices followed but several issues remain; poor Key usage.

Reasonable practices; a few missed opportunities for optimization or reuse.

Good practices; minor deviations from community idioms.

Excellent idiomatic Flutter; clean architecture, efficient rebuilds, proper Keys.

Code Style

Formatting, naming conventions, consistent indentation, and readability comparable to dartfmt / Effective Dart guidelines.

Unreadable; inconsistent naming, no formatting, or excessive nesting.

Poor style; naming is unclear and formatting is inconsistent.

Below average style; some conventions followed but many violations.

Acceptable style; mostly readable with minor formatting issues.

Good style; clear naming, consistent formatting, easy to read.

Excellent style; follows Effective Dart, clean formatting, self-documenting names.

Error Handling

Graceful handling of edge cases, null safety, async errors, and user input validation.

No error handling; null safety violated, crashes on edge cases.

Minimal handling; obvious crashes possible with empty input or null values.

Some checks present but missing key edge cases; async errors unhandled.

Basic handling in place; most common errors caught but not all.

Good handling; robust null safety and async error coverage with minor gaps.

Excellent handling; comprehensive null safety, async guards, and input validation.

Score each criterion 0-5. Task type: question_to_code. Difficulty: easy. Expected answer length: 165 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 2730 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 1445 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 2345 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 1247 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 3452 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 7009 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 17910 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 1485 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 1346 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 2381 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 183 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 4407 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 6485 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 7360 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 4041 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 9859 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 10067 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 1659 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 6906 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 1867 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 6634 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 2868 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 518 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 8383 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 17909 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 3360 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 2887 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 9459 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 1548 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 2586 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 2783 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 344 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 8932 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 151 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 926 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 1331 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 262 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 4496 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 588 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 1461 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 1124 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 1428 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 2305 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 3501 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 935 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 1933 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 1987 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 5014 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 4026 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 1690 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 1595 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: easy. Expected answer length: 287 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 8488 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: medium. Expected answer length: 8132 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: medium. Expected answer length: 889 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


API Correctness

The API or widget is used exactly as documented in the Flutter SDK; correct parameters, named arguments, and lifecycle callbacks.

Incorrect API usage; wrong widget or method, broken parameters.

Major API errors; several parameters or lifecycle hooks are wrong.

Partially correct API usage with significant misuse or missing arguments.

Mostly correct; minor parameter misuse or deprecated member usage.

Correct API usage; only a trivial improvement or modern alternative is missing.

Perfect API usage; matches latest stable Flutter SDK documentation precisely.

Completeness

All required API features, callbacks, and configuration options from the prompt are present.

None of the requested API features are demonstrated.

Minimal demonstration; only the simplest constructor is shown.

Partial demonstration; several important properties or callbacks missing.

Most features shown but one or two key behaviors are omitted.

Nearly complete; only a minor optional configuration is missing.

Fully complete; every requested API capability is demonstrated.

Flutter Best Practices

Proper context usage, efficient rebuild scope, and avoidance of unnecessary global state.

Anti-patterns throughout; global state, setState abuse, or context misuse.

Frequent anti-patterns; widget rebuilds are not scoped properly.

Some best practices followed but several issues remain; inefficient rebuilds.

Reasonable practices; a few missed opportunities for scoping or reuse.

Good practices; minor deviations from idiomatic usage.

Excellent practices; scoped rebuilds, proper context access, clean architecture.

Code Style

Formatting, naming, and readability comparable to dartfmt / Effective Dart guidelines.

Unreadable; inconsistent formatting, poor naming, excessive nesting.

Poor style; hard to read and inconsistent naming conventions.

Good style; clear formatting, consistent naming, easy to read.

Excellent style; follows Effective Dart, clean formatting, self-documenting code.

Documentation

Inline comments, docstrings, or explanatory text clarify the API usage for readers.

No documentation; code is uncommented and unclear.

Minimal documentation; only trivial or auto-generated comments.

Some helpful comments but many complex sections are unexplained.

Basic documentation covers main logic but misses subtle API choices.

Good documentation; most non-obvious choices are explained.

Excellent documentation; every non-trivial API choice is clearly explained.

Score each criterion 0-5. Task type: api_usage. Difficulty: medium. Expected answer length: 1256 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 8307 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 24527 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 3555 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 10274 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 3280 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 8068 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: medium. Expected answer length: 15783 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: medium. Expected answer length: 3589 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 5330 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 6148 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: easy. Expected answer length: 202 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 4823 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 7467 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 5410 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 21298 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 8931 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 6829 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 7947 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 30359 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 13386 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 2472 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 8874 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 5365 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: medium. Expected answer length: 697 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 40402 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 11318 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 5392 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: medium. Expected answer length: 1300 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 21617 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: medium. Expected answer length: 11261 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: api_usage. Difficulty: hard. Expected answer length: 5048 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: medium. Expected answer length: 3624 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 13030 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 17453 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 20924 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 27091 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 41193 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 40612 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 6526 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: medium. Expected answer length: 749 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 3184 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 4476 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 7728 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 5218 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 20597 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: medium. Expected answer length: 5048 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 44406 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 19630 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 9444 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 4200 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 3473 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 41453 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 666 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 32149 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 1025 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: medium. Expected answer length: 712 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 7990 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 4414 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: medium. Expected answer length: 1703 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 8167 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 660 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 673 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 10640 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 22591 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 9521 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: medium. Expected answer length: 1322 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: medium. Expected answer length: 1645 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 2748 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 46292 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 9539 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 3602 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 2350 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 3384 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 34880 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 7890 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 1243 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 1080 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 3630 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: medium. Expected answer length: 1403 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 3942 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 656 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 1969 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 45406 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 12139 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 7064 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 1521 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 7609 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 1381 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 11124 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.