Correctness

The response fixes the reported defect and produces the expected behavior.

Does not address the defect or is non-functional.

Shows relevant intent but is substantially incorrect.

Partially addresses the defect but leaves major problems.

Fixes the main defect with minor correctness issues.

Correctly fixes the defect with negligible issues.

Root Cause Resolution

The change addresses the underlying cause rather than merely masking symptoms.

Targets an unrelated or implausible cause.

Addresses only a symptom or small part of the cause.

Mostly addresses the cause but leaves a relevant weakness.

Addresses the root cause completely and precisely.

Behavior Preservation

The fix preserves intended behavior outside the defect scope.

Mostly preserves behavior with a minor regression risk.

Preserves intended behavior with negligible risk.

Preserves behavior and keeps the change tightly scoped.

Flutter/Dart Best Practices

The solution follows relevant API, lifecycle, null-safety, and state-management practices.

Violates fundamental Flutter or Dart requirements.

Contains several serious framework or language misuses.

Uses questionable patterns that reduce reliability.

Generally appropriate with minor best-practice issues.

Uses idiomatic and reliable Flutter/Dart patterns.

Uses exemplary, context-appropriate practices.

Robustness and Edge Cases

The fix handles relevant edge cases and failure paths without unnecessary fragility.

Fails under ordinary inputs or error conditions.

Misses important edge cases or failure paths.

Handles common cases but misses a minor edge case.

Handles relevant edge cases and failures well.

Is robust across all reasonably implied cases.

Score each criterion 0-5. Task type: bug_fix. Difficulty: medium. Expected answer length: 301 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: bug_fix. Difficulty: medium. Expected answer length: 305 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Correctness

The completed code implements the behavior implied by the prompt and context.

The completion is unrelated or non-functional.

Shows limited relevant intent but is substantially incorrect.

Implements only a flawed part of the required behavior.

Implements the main behavior with minor issues.

Correctly implements the behavior with negligible issues.

Fully and precisely implements the required behavior.

Completeness

The response fills all material gaps required for a usable solution.

Leaves the completion essentially empty.

Fills only a small fraction of the required code.

Leaves major required pieces unfinished.

Completes the main path but omits a minor element.

Completes all requirements without unnecessary additions.

Context Compatibility

The completion fits the supplied types, APIs, control flow, and local code.

Conflicts fundamentally with the supplied context.

Contains several severe context or API mismatches.

Requires substantial changes to fit the context.

Integrates seamlessly and preserves all constraints.

Flutter/Dart Best Practices

The completion follows relevant API, lifecycle, null-safety, and state-management practices.

Code Quality

The completion is clear, concise, maintainable, and appropriately scoped.

Has severe clarity or maintainability problems.

Has substantial duplication, complexity, or naming problems.

Is understandable with minor quality issues.

Is exceptionally clear, idiomatic, and well scoped.

Score each criterion 0-5. Task type: completion. Difficulty: medium. Expected answer length: 282 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: completion. Difficulty: medium. Expected answer length: 285 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Correctness

The explanation accurately describes what the code does, including widget behavior, state flow, and lifecycle.

Explanation is factually wrong about the code's behavior.

Major inaccuracies; misinterprets core logic or widget roles.

Partially correct but significant misconceptions about the code.

Mostly accurate; minor misinterpretations of edge cases or callbacks.

Accurate with very minor errors; correctly describes the main logic and widgets.

Fully correct; precise description of every widget, state, and callback behavior.

Completeness

All significant code sections, widgets, and logic paths are explained without omissions.

No explanation of the actual code; only generic Flutter commentary.

Minimal explanation; only the entry point or top-level widget is mentioned.

Partial explanation; several important widgets or logic blocks are skipped.

Most sections covered but one or two important details are omitted.

Nearly complete; only a trivial helper or minor callback is missing.

Fully complete; every widget, method, and significant parameter is addressed.

Technical Depth

The explanation goes beyond surface-level description to discuss underlying mechanisms, Flutter framework internals, or design trade-offs.

Purely surface-level; no technical insight beyond naming widgets.

Very shallow; mentions widget names but not how they interact.

Some depth; explains basic interactions but misses framework internals.

Moderate depth; covers most interactions but not design trade-offs.

Good depth; explains framework behavior and some trade-offs.

Excellent depth; covers framework internals, rebuild logic, performance trade-offs, and alternatives.

Structural Clarity

Explanation is organized logically, uses clear headings or step-by-step structure, and follows a natural reading order.

Unstructured; rambling or disorganized, hard to follow.

Poor structure; no clear flow, jumps between unrelated topics.

Some structure exists but is inconsistent or confusing in places.

Acceptable structure; mostly logical flow with minor organizational issues.

Good structure; clear sections, logical progression, easy to follow.

Excellent structure; perfectly organized, intuitive flow, headings and summaries where appropriate.

Practical Examples

The explanation includes concrete usage examples, edge-case notes, or modification suggestions that help the reader apply the knowledge.

No practical examples or usage guidance; purely descriptive.

Minimal examples; only trivial or unrealistic usage shown.

Some examples but not directly applicable to the code shown.

Basic examples relevant to the code; a few useful usage notes.

Good examples; practical usage, edge-case notes, and minor extension ideas.

Excellent examples; realistic scenarios, common pitfalls, and clear extension paths.

Score each criterion 0-5. Task type: code_to_explanation. Difficulty: medium. Expected answer length: 237 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: code_to_explanation. Difficulty: medium. Expected answer length: 238 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Correctness

The refactored code preserves the original behavior while applying the requested improvements.

Refactored code is broken or changes behavior entirely.

Major behavior changes; original functionality is lost.

Partially correct; some original behaviors are broken or missing.

Mostly correct; minor behavior drift or edge-case regression.

Correct with very minor issues; behavior is preserved under all tested conditions.

Perfectly correct; behavior is identical or improved without any regression.

Null Safety / State Management

Proper null-safety migration, non-nullable types, and appropriate state-management pattern adoption.

Null safety violated; nullable types used unsafely or old patterns retained.

Major null-safety issues; several unsafe accesses or missing null checks.

Partial null-safety; some non-nullable types applied but many gaps remain.

Mostly sound null-safety; a few unnecessary nullable types or late inits.

Good null-safety; only trivial improvements possible.

Excellent null-safety; all types are sound, no unnecessary nullables, state is clean.

Best Practices

Use of modern Flutter patterns, widget extraction, const constructors, and efficient rebuild scoping.

No modern patterns applied; legacy code remains unchanged.

Minimal improvements; only trivial formatting changes.

Some improvements applied but many anti-patterns remain.

Reasonable improvements; a few missed opportunities for modern patterns.

Good improvements; most modern patterns applied, minor gaps remain.

Excellent refactoring; fully idiomatic, const-correct, scoped rebuilds, clean extraction.

Code Style

Formatting, naming, and readability improvements post-refactor.

No style improvement; code remains unreadable.

Minimal formatting improvements; naming still poor.

Some style fixes but inconsistent or incomplete.

Acceptable style; readable but not yet polished.

Good style; clean, consistent, and easy to read.

Excellent style; follows Effective Dart, self-documenting, beautifully formatted.

Performance

Refactoring reduces unnecessary rebuilds, avoids expensive operations in build, and uses efficient data structures.

Performance degraded or no improvement; expensive operations remain in build.

Minimal performance improvement; same rebuild overhead.

Some improvements; a few expensive operations moved but not all.

Reasonable performance gains; most unnecessary rebuilds removed.

Good performance; only marginal further improvements possible.

Excellent performance; optimal rebuild scoping, no build-phase heavy work, efficient structures.

Score each criterion 0-5. Task type: refactor. Difficulty: medium. Expected answer length: 244 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: refactor. Difficulty: medium. Expected answer length: 247 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Test Coverage

The generated tests cover the critical user-visible behaviors, accessibility properties, and widget states described in the prompt.

No relevant tests; empty or unrelated test file.

Minimal coverage; only a trivial smoke test exists.

Partial coverage; some important behaviors are not tested.

Mostly covered; one or two key interaction or semantic checks missing.

Comprehensive coverage; only an edge case or optional behavior is missing.

Full coverage; every specified behavior, accessibility check, and state is tested.

Executable Test Style

Tests follow Flutter's testWidgets / group / setUp patterns and are runnable in a standard `flutter test` environment without modification.

Not executable; missing imports, wrong function signatures, or syntax errors.

Barely executable; requires heavy manual fixes to run.

Runnable with significant manual patching; wrong pump or finder patterns.

Mostly executable; minor fixes needed for imports or test setup.

Ready to run; only trivial import path tweaks may be needed.

Fully executable; correct imports, proper pumpWidget, clean test structure.

Assertions

Expectations are specific, meaningful, and verify the intended behavior rather than trivial or tautological checks.

No assertions or only tautological checks (e.g., expect(true, isTrue)).

Very weak assertions; do not verify the actual widget behavior.

Some meaningful assertions but many are too generic or miss the point.

Most assertions are meaningful; a few could be more specific or rigorous.

Strong assertions; closely match the expected behavior with minor improvements possible.

Excellent assertions; precise, behavior-driven, and directly tied to the prompt requirements.

Edge Cases

Tests account for edge cases such as disabled states, empty input, screen scaling, semantics variations, and error paths.

No edge cases considered; only the happy path is tested.

One trivial edge case considered; most variations ignored.

A few edge cases present but important ones (e.g., disabled, empty) missing.

Basic edge cases covered; some advanced variations (scaling, semantics) missing.

Good edge case coverage; nearly all specified variations are tested.

Comprehensive edge cases; accessibility scaling, disabled states, errors all verified.

Clarity

Test names, variable names, and structure are self-documenting and easy to maintain.

Unreadable; cryptic names, no structure, or commented-out code left in.

Poor clarity; names do not describe what is being tested.

Below average; some good names but inconsistent style or structure.

Acceptable clarity; names describe behavior but could be more descriptive.

Good clarity; well-named tests and clear structure throughout.

Excellent clarity; descriptive test names, logical grouping, easy to navigate.

Score each criterion 0-5. Task type: test_generation. Difficulty: medium. Expected answer length: 1138 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Correctness

The generated code correctly implements the requested functionality without logical errors, missing imports, or broken widget trees.

Completely incorrect or irrelevant; does not compile or address the prompt.

Major errors prevent the code from working; wrong widget used or logic is inverted.

Partially correct with significant bugs; some imports missing or state handling broken.

Mostly correct with minor issues; small layout bugs or missing null checks remain.

Correct with very minor issues; only cosmetic or non-functional deviations.

Fully correct and robust; compiles and behaves as specified under normal conditions.

Completeness

All requested features, widgets, and behaviors from the prompt are present in the answer without omissions.

None of the requested features are implemented.

Most features are missing; only a stub or skeleton is present.

Several key features are missing; partial implementation only.

Most features present but one or two important behaviors are omitted.

Nearly complete; only a minor optional detail is missing.

Fully complete; every requirement from the prompt is addressed.

Flutter Best Practices

Use of idiomatic Flutter patterns: proper widget composition, separation of concerns, efficient rebuilds, and appropriate use of Material/Cupertino.

Anti-patterns throughout; e.g., setState in build or excessive global state.

Frequent anti-patterns; widget tree is deeply nested without extract methods.

Some best practices followed but several issues remain; poor Key usage.

Reasonable practices; a few missed opportunities for optimization or reuse.

Good practices; minor deviations from community idioms.

Excellent idiomatic Flutter; clean architecture, efficient rebuilds, proper Keys.

Code Style

Formatting, naming conventions, consistent indentation, and readability comparable to dartfmt / Effective Dart guidelines.

Unreadable; inconsistent naming, no formatting, or excessive nesting.

Poor style; naming is unclear and formatting is inconsistent.

Below average style; some conventions followed but many violations.

Acceptable style; mostly readable with minor formatting issues.

Good style; clear naming, consistent formatting, easy to read.

Excellent style; follows Effective Dart, clean formatting, self-documenting names.

Error Handling

Graceful handling of edge cases, null safety, async errors, and user input validation.

No error handling; null safety violated, crashes on edge cases.

Minimal handling; obvious crashes possible with empty input or null values.

Some checks present but missing key edge cases; async errors unhandled.

Basic handling in place; most common errors caught but not all.

Good handling; robust null safety and async error coverage with minor gaps.

Excellent handling; comprehensive null safety, async guards, and input validation.

Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 411 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 2203 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: medium. Expected answer length: 623 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 6318 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


API Correctness

The API or widget is used exactly as documented in the Flutter SDK; correct parameters, named arguments, and lifecycle callbacks.

Incorrect API usage; wrong widget or method, broken parameters.

Major API errors; several parameters or lifecycle hooks are wrong.

Partially correct API usage with significant misuse or missing arguments.

Mostly correct; minor parameter misuse or deprecated member usage.

Correct API usage; only a trivial improvement or modern alternative is missing.

Perfect API usage; matches latest stable Flutter SDK documentation precisely.

Completeness

All required API features, callbacks, and configuration options from the prompt are present.

None of the requested API features are demonstrated.

Minimal demonstration; only the simplest constructor is shown.

Partial demonstration; several important properties or callbacks missing.

Most features shown but one or two key behaviors are omitted.

Nearly complete; only a minor optional configuration is missing.

Fully complete; every requested API capability is demonstrated.

Flutter Best Practices

Proper context usage, efficient rebuild scope, and avoidance of unnecessary global state.

Anti-patterns throughout; global state, setState abuse, or context misuse.

Frequent anti-patterns; widget rebuilds are not scoped properly.

Some best practices followed but several issues remain; inefficient rebuilds.

Reasonable practices; a few missed opportunities for scoping or reuse.

Good practices; minor deviations from idiomatic usage.

Excellent practices; scoped rebuilds, proper context access, clean architecture.

Code Style

Formatting, naming, and readability comparable to dartfmt / Effective Dart guidelines.

Unreadable; inconsistent formatting, poor naming, excessive nesting.

Poor style; hard to read and inconsistent naming conventions.

Good style; clear formatting, consistent naming, easy to read.

Excellent style; follows Effective Dart, clean formatting, self-documenting code.

Documentation

Inline comments, docstrings, or explanatory text clarify the API usage for readers.

No documentation; code is uncommented and unclear.

Minimal documentation; only trivial or auto-generated comments.

Some helpful comments but many complex sections are unexplained.

Basic documentation covers main logic but misses subtle API choices.

Good documentation; most non-obvious choices are explained.

Excellent documentation; every non-trivial API choice is clearly explained.

Score each criterion 0-5. Task type: api_usage. Difficulty: medium. Expected answer length: 300 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: easy. Expected answer length: 4752 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: api_usage. Difficulty: hard. Expected answer length: 2525 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 2586 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: medium. Expected answer length: 271 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: medium. Expected answer length: 552 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 433 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 501 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 449 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 458 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 448 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: medium. Expected answer length: 435 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 448 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 255 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: medium. Expected answer length: 526 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: medium. Expected answer length: 708 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 256 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: easy. Expected answer length: 247 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 142 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 250 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: medium. Expected answer length: 232 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: medium. Expected answer length: 472 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 4059 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 4702 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 14377 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: medium. Expected answer length: 496 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 2272 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 9106 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: api_usage. Difficulty: medium. Expected answer length: 147 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 327 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 342 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 533 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 865 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 4027 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 2555 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 129 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: medium. Expected answer length: 1237 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 1661 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: medium. Expected answer length: 1224 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 1341 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 743 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: easy. Expected answer length: 411 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 1385 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 22329 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 1286 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 3327 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 5598 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: easy. Expected answer length: 148 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 671 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: easy. Expected answer length: 412 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 11770 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 5903 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: easy. Expected answer length: 1080 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 3434 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: easy. Expected answer length: 481 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 16260 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 1085 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 3863 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 2262 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 7974 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 3479 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 853 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: medium. Expected answer length: 1073 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: medium. Expected answer length: 1151 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 6249 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 1550 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 332 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 5565 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 1153 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 3630 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 2878 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Correctness

The refactored code preserves the original behavior while applying the requested improvements.

Refactored code is broken or changes behavior entirely.

Major behavior changes; original functionality is lost.

Partially correct; some original behaviors are broken or missing.

Mostly correct; minor behavior drift or edge-case regression.

Correct with very minor issues; behavior is preserved under all tested conditions.

Perfectly correct; behavior is identical or improved without any regression.

Null Safety / State Management

Proper null-safety migration, non-nullable types, and appropriate state-management pattern adoption.

Null safety violated; nullable types used unsafely or old patterns retained.

Major null-safety issues; several unsafe accesses or missing null checks.

Partial null-safety; some non-nullable types applied but many gaps remain.

Mostly sound null-safety; a few unnecessary nullable types or late inits.

Good null-safety; only trivial improvements possible.

Excellent null-safety; all types are sound, no unnecessary nullables, state is clean.

Best Practices

Use of modern Flutter patterns, widget extraction, const constructors, and efficient rebuild scoping.

No modern patterns applied; legacy code remains unchanged.

Minimal improvements; only trivial formatting changes.

Some improvements applied but many anti-patterns remain.

Reasonable improvements; a few missed opportunities for modern patterns.

Good improvements; most modern patterns applied, minor gaps remain.

Excellent refactoring; fully idiomatic, const-correct, scoped rebuilds, clean extraction.

Code Style

Formatting, naming, and readability improvements post-refactor.

No style improvement; code remains unreadable.

Minimal formatting improvements; naming still poor.

Some style fixes but inconsistent or incomplete.

Acceptable style; readable but not yet polished.

Good style; clean, consistent, and easy to read.

Excellent style; follows Effective Dart, self-documenting, beautifully formatted.

Performance

Refactoring reduces unnecessary rebuilds, avoids expensive operations in build, and uses efficient data structures.

Performance degraded or no improvement; expensive operations remain in build.

Minimal performance improvement; same rebuild overhead.

Some improvements; a few expensive operations moved but not all.

Reasonable performance gains; most unnecessary rebuilds removed.

Good performance; only marginal further improvements possible.

Excellent performance; optimal rebuild scoping, no build-phase heavy work, efficient structures.

Score each criterion 0-5. Task type: refactor. Difficulty: easy. Expected answer length: 1463 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: easy. Expected answer length: 1463 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 986 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 2614 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 428 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Test Coverage

The generated tests cover the critical user-visible behaviors, accessibility properties, and widget states described in the prompt.

No relevant tests; empty or unrelated test file.

Minimal coverage; only a trivial smoke test exists.

Partial coverage; some important behaviors are not tested.

Mostly covered; one or two key interaction or semantic checks missing.

Comprehensive coverage; only an edge case or optional behavior is missing.

Full coverage; every specified behavior, accessibility check, and state is tested.

Executable Test Style

Tests follow Flutter's testWidgets / group / setUp patterns and are runnable in a standard `flutter test` environment without modification.

Not executable; missing imports, wrong function signatures, or syntax errors.

Barely executable; requires heavy manual fixes to run.

Runnable with significant manual patching; wrong pump or finder patterns.

Mostly executable; minor fixes needed for imports or test setup.

Ready to run; only trivial import path tweaks may be needed.

Fully executable; correct imports, proper pumpWidget, clean test structure.

Assertions

Expectations are specific, meaningful, and verify the intended behavior rather than trivial or tautological checks.

No assertions or only tautological checks (e.g., expect(true, isTrue)).

Very weak assertions; do not verify the actual widget behavior.

Some meaningful assertions but many are too generic or miss the point.

Most assertions are meaningful; a few could be more specific or rigorous.

Strong assertions; closely match the expected behavior with minor improvements possible.

Excellent assertions; precise, behavior-driven, and directly tied to the prompt requirements.

Edge Cases

Tests account for edge cases such as disabled states, empty input, screen scaling, semantics variations, and error paths.

No edge cases considered; only the happy path is tested.

One trivial edge case considered; most variations ignored.

A few edge cases present but important ones (e.g., disabled, empty) missing.

Basic edge cases covered; some advanced variations (scaling, semantics) missing.

Good edge case coverage; nearly all specified variations are tested.

Comprehensive edge cases; accessibility scaling, disabled states, errors all verified.

Clarity

Test names, variable names, and structure are self-documenting and easy to maintain.

Unreadable; cryptic names, no structure, or commented-out code left in.

Poor clarity; names do not describe what is being tested.

Below average; some good names but inconsistent style or structure.

Acceptable clarity; names describe behavior but could be more descriptive.

Good clarity; well-named tests and clear structure throughout.

Excellent clarity; descriptive test names, logical grouping, easy to navigate.

Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 5512 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Correctness

The generated code correctly implements the requested functionality without logical errors, missing imports, or broken widget trees.

Completely incorrect or irrelevant; does not compile or address the prompt.

Major errors prevent the code from working; wrong widget used or logic is inverted.

Partially correct with significant bugs; some imports missing or state handling broken.

Mostly correct with minor issues; small layout bugs or missing null checks remain.

Correct with very minor issues; only cosmetic or non-functional deviations.

Fully correct and robust; compiles and behaves as specified under normal conditions.

Completeness

All requested features, widgets, and behaviors from the prompt are present in the answer without omissions.

None of the requested features are implemented.

Most features are missing; only a stub or skeleton is present.

Several key features are missing; partial implementation only.

Most features present but one or two important behaviors are omitted.

Nearly complete; only a minor optional detail is missing.

Fully complete; every requirement from the prompt is addressed.

Flutter Best Practices

Use of idiomatic Flutter patterns: proper widget composition, separation of concerns, efficient rebuilds, and appropriate use of Material/Cupertino.

Anti-patterns throughout; e.g., setState in build or excessive global state.

Frequent anti-patterns; widget tree is deeply nested without extract methods.

Some best practices followed but several issues remain; poor Key usage.

Reasonable practices; a few missed opportunities for optimization or reuse.

Good practices; minor deviations from community idioms.

Excellent idiomatic Flutter; clean architecture, efficient rebuilds, proper Keys.

Code Style

Formatting, naming conventions, consistent indentation, and readability comparable to dartfmt / Effective Dart guidelines.

Unreadable; inconsistent naming, no formatting, or excessive nesting.

Poor style; naming is unclear and formatting is inconsistent.

Below average style; some conventions followed but many violations.

Acceptable style; mostly readable with minor formatting issues.

Good style; clear naming, consistent formatting, easy to read.

Excellent style; follows Effective Dart, clean formatting, self-documenting names.

Error Handling

Graceful handling of edge cases, null safety, async errors, and user input validation.

No error handling; null safety violated, crashes on edge cases.

Minimal handling; obvious crashes possible with empty input or null values.

Some checks present but missing key edge cases; async errors unhandled.

Basic handling in place; most common errors caught but not all.

Good handling; robust null safety and async error coverage with minor gaps.

Excellent handling; comprehensive null safety, async guards, and input validation.

Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 1824 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 239 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: medium. Expected answer length: 789 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 1672 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 731 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: medium. Expected answer length: 520 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 7670 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 17352 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 13081 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 20407 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 6111 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 2734 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: medium. Expected answer length: 655 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 5915 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 1172 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 9121 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 976 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 1340 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 5897 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 2579 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 1883 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 1263 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 2264 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 3306 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 5857 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 2109 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 683 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 8503 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 2288 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 1473 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 12506 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 11583 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 1709 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 882 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 17456 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 718 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 3783 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 2006 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 1828 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 2972 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 1475 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 843 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 29408 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 4003 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 5817 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 2776 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 1189 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 6429 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 1163 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 2952 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


API Correctness

The API or widget is used exactly as documented in the Flutter SDK; correct parameters, named arguments, and lifecycle callbacks.

Incorrect API usage; wrong widget or method, broken parameters.

Major API errors; several parameters or lifecycle hooks are wrong.

Partially correct API usage with significant misuse or missing arguments.

Mostly correct; minor parameter misuse or deprecated member usage.

Correct API usage; only a trivial improvement or modern alternative is missing.

Perfect API usage; matches latest stable Flutter SDK documentation precisely.

Completeness

All required API features, callbacks, and configuration options from the prompt are present.

None of the requested API features are demonstrated.

Minimal demonstration; only the simplest constructor is shown.

Partial demonstration; several important properties or callbacks missing.

Most features shown but one or two key behaviors are omitted.

Nearly complete; only a minor optional configuration is missing.

Fully complete; every requested API capability is demonstrated.

Flutter Best Practices

Proper context usage, efficient rebuild scope, and avoidance of unnecessary global state.

Anti-patterns throughout; global state, setState abuse, or context misuse.

Frequent anti-patterns; widget rebuilds are not scoped properly.

Some best practices followed but several issues remain; inefficient rebuilds.

Reasonable practices; a few missed opportunities for scoping or reuse.

Good practices; minor deviations from idiomatic usage.

Excellent practices; scoped rebuilds, proper context access, clean architecture.

Code Style

Formatting, naming, and readability comparable to dartfmt / Effective Dart guidelines.

Unreadable; inconsistent formatting, poor naming, excessive nesting.

Poor style; hard to read and inconsistent naming conventions.

Good style; clear formatting, consistent naming, easy to read.

Excellent style; follows Effective Dart, clean formatting, self-documenting code.

Documentation

Inline comments, docstrings, or explanatory text clarify the API usage for readers.

No documentation; code is uncommented and unclear.

Minimal documentation; only trivial or auto-generated comments.

Some helpful comments but many complex sections are unexplained.

Basic documentation covers main logic but misses subtle API choices.

Good documentation; most non-obvious choices are explained.

Excellent documentation; every non-trivial API choice is clearly explained.

Score each criterion 0-5. Task type: api_usage. Difficulty: hard. Expected answer length: 1389 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: api_usage. Difficulty: hard. Expected answer length: 1513 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 2392 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 9814 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 2699 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 1465 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 505 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 3496 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 5646 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 1080 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 48078 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Correctness

The explanation accurately describes what the code does, including widget behavior, state flow, and lifecycle.

Explanation is factually wrong about the code's behavior.

Major inaccuracies; misinterprets core logic or widget roles.

Partially correct but significant misconceptions about the code.

Mostly accurate; minor misinterpretations of edge cases or callbacks.

Accurate with very minor errors; correctly describes the main logic and widgets.

Fully correct; precise description of every widget, state, and callback behavior.

Completeness

All significant code sections, widgets, and logic paths are explained without omissions.

No explanation of the actual code; only generic Flutter commentary.

Minimal explanation; only the entry point or top-level widget is mentioned.

Partial explanation; several important widgets or logic blocks are skipped.

Most sections covered but one or two important details are omitted.

Nearly complete; only a trivial helper or minor callback is missing.

Fully complete; every widget, method, and significant parameter is addressed.

Technical Depth

The explanation goes beyond surface-level description to discuss underlying mechanisms, Flutter framework internals, or design trade-offs.

Purely surface-level; no technical insight beyond naming widgets.

Very shallow; mentions widget names but not how they interact.

Some depth; explains basic interactions but misses framework internals.

Moderate depth; covers most interactions but not design trade-offs.

Good depth; explains framework behavior and some trade-offs.

Excellent depth; covers framework internals, rebuild logic, performance trade-offs, and alternatives.

Structural Clarity

Explanation is organized logically, uses clear headings or step-by-step structure, and follows a natural reading order.

Unstructured; rambling or disorganized, hard to follow.

Poor structure; no clear flow, jumps between unrelated topics.

Some structure exists but is inconsistent or confusing in places.

Acceptable structure; mostly logical flow with minor organizational issues.

Good structure; clear sections, logical progression, easy to follow.

Excellent structure; perfectly organized, intuitive flow, headings and summaries where appropriate.

Practical Examples

The explanation includes concrete usage examples, edge-case notes, or modification suggestions that help the reader apply the knowledge.

No practical examples or usage guidance; purely descriptive.

Minimal examples; only trivial or unrealistic usage shown.

Some examples but not directly applicable to the code shown.

Basic examples relevant to the code; a few useful usage notes.

Good examples; practical usage, edge-case notes, and minor extension ideas.

Excellent examples; realistic scenarios, common pitfalls, and clear extension paths.

Score each criterion 0-5. Task type: code_to_explanation. Difficulty: hard. Expected answer length: 9809 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Test Coverage

The generated tests cover the critical user-visible behaviors, accessibility properties, and widget states described in the prompt.

No relevant tests; empty or unrelated test file.

Minimal coverage; only a trivial smoke test exists.

Partial coverage; some important behaviors are not tested.

Mostly covered; one or two key interaction or semantic checks missing.

Comprehensive coverage; only an edge case or optional behavior is missing.

Full coverage; every specified behavior, accessibility check, and state is tested.

Executable Test Style

Tests follow Flutter's testWidgets / group / setUp patterns and are runnable in a standard `flutter test` environment without modification.

Not executable; missing imports, wrong function signatures, or syntax errors.

Barely executable; requires heavy manual fixes to run.

Runnable with significant manual patching; wrong pump or finder patterns.

Mostly executable; minor fixes needed for imports or test setup.

Ready to run; only trivial import path tweaks may be needed.

Fully executable; correct imports, proper pumpWidget, clean test structure.

Assertions

Expectations are specific, meaningful, and verify the intended behavior rather than trivial or tautological checks.

No assertions or only tautological checks (e.g., expect(true, isTrue)).

Very weak assertions; do not verify the actual widget behavior.

Some meaningful assertions but many are too generic or miss the point.

Most assertions are meaningful; a few could be more specific or rigorous.

Strong assertions; closely match the expected behavior with minor improvements possible.

Excellent assertions; precise, behavior-driven, and directly tied to the prompt requirements.

Edge Cases

Tests account for edge cases such as disabled states, empty input, screen scaling, semantics variations, and error paths.

No edge cases considered; only the happy path is tested.

One trivial edge case considered; most variations ignored.

A few edge cases present but important ones (e.g., disabled, empty) missing.

Basic edge cases covered; some advanced variations (scaling, semantics) missing.

Good edge case coverage; nearly all specified variations are tested.

Comprehensive edge cases; accessibility scaling, disabled states, errors all verified.

Clarity

Test names, variable names, and structure are self-documenting and easy to maintain.

Unreadable; cryptic names, no structure, or commented-out code left in.

Poor clarity; names do not describe what is being tested.

Below average; some good names but inconsistent style or structure.

Acceptable clarity; names describe behavior but could be more descriptive.

Good clarity; well-named tests and clear structure throughout.

Excellent clarity; descriptive test names, logical grouping, easy to navigate.

Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 1643 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 971 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 2710 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 7027 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 13226 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Correctness

The generated code correctly implements the requested functionality without logical errors, missing imports, or broken widget trees.

Completely incorrect or irrelevant; does not compile or address the prompt.

Major errors prevent the code from working; wrong widget used or logic is inverted.

Partially correct with significant bugs; some imports missing or state handling broken.

Mostly correct with minor issues; small layout bugs or missing null checks remain.

Correct with very minor issues; only cosmetic or non-functional deviations.

Fully correct and robust; compiles and behaves as specified under normal conditions.

Completeness

All requested features, widgets, and behaviors from the prompt are present in the answer without omissions.

None of the requested features are implemented.

Most features are missing; only a stub or skeleton is present.

Several key features are missing; partial implementation only.

Most features present but one or two important behaviors are omitted.

Nearly complete; only a minor optional detail is missing.

Fully complete; every requirement from the prompt is addressed.

Flutter Best Practices

Use of idiomatic Flutter patterns: proper widget composition, separation of concerns, efficient rebuilds, and appropriate use of Material/Cupertino.

Anti-patterns throughout; e.g., setState in build or excessive global state.

Frequent anti-patterns; widget tree is deeply nested without extract methods.

Some best practices followed but several issues remain; poor Key usage.

Reasonable practices; a few missed opportunities for optimization or reuse.

Good practices; minor deviations from community idioms.

Excellent idiomatic Flutter; clean architecture, efficient rebuilds, proper Keys.

Code Style

Formatting, naming conventions, consistent indentation, and readability comparable to dartfmt / Effective Dart guidelines.

Unreadable; inconsistent naming, no formatting, or excessive nesting.

Poor style; naming is unclear and formatting is inconsistent.

Below average style; some conventions followed but many violations.

Acceptable style; mostly readable with minor formatting issues.

Good style; clear naming, consistent formatting, easy to read.

Excellent style; follows Effective Dart, clean formatting, self-documenting names.

Error Handling

Graceful handling of edge cases, null safety, async errors, and user input validation.

No error handling; null safety violated, crashes on edge cases.

Minimal handling; obvious crashes possible with empty input or null values.

Some checks present but missing key edge cases; async errors unhandled.

Basic handling in place; most common errors caught but not all.

Good handling; robust null safety and async error coverage with minor gaps.

Excellent handling; comprehensive null safety, async guards, and input validation.

Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 3749 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 11187 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 1337 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 3702 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 21961 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 2525 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 2637 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: medium. Expected answer length: 19111 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: medium. Expected answer length: 1299 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 6710 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 566 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 2250 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 13132 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 510 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 21596 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 2038 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 596 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 2568 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 7050 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 7520 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 1763 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 1787 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 9907 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 2625 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 2781 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 1034 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 1830 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 357 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 3869 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: easy. Expected answer length: 276 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 7741 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 4792 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 5187 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: medium. Expected answer length: 7003 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: medium. Expected answer length: 4631 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 2362 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 3344 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: easy. Expected answer length: 1768 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 1799 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: easy. Expected answer length: 1309 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: easy. Expected answer length: 1207 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 1430 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 3446 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 1226 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 2070 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 3540 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 5288 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


API Correctness

The API or widget is used exactly as documented in the Flutter SDK; correct parameters, named arguments, and lifecycle callbacks.

Incorrect API usage; wrong widget or method, broken parameters.

Major API errors; several parameters or lifecycle hooks are wrong.

Partially correct API usage with significant misuse or missing arguments.

Mostly correct; minor parameter misuse or deprecated member usage.

Correct API usage; only a trivial improvement or modern alternative is missing.

Perfect API usage; matches latest stable Flutter SDK documentation precisely.

Completeness

All required API features, callbacks, and configuration options from the prompt are present.

None of the requested API features are demonstrated.

Minimal demonstration; only the simplest constructor is shown.

Partial demonstration; several important properties or callbacks missing.

Most features shown but one or two key behaviors are omitted.

Nearly complete; only a minor optional configuration is missing.

Fully complete; every requested API capability is demonstrated.

Flutter Best Practices

Proper context usage, efficient rebuild scope, and avoidance of unnecessary global state.

Anti-patterns throughout; global state, setState abuse, or context misuse.

Frequent anti-patterns; widget rebuilds are not scoped properly.

Some best practices followed but several issues remain; inefficient rebuilds.

Reasonable practices; a few missed opportunities for scoping or reuse.

Good practices; minor deviations from idiomatic usage.

Excellent practices; scoped rebuilds, proper context access, clean architecture.

Code Style

Formatting, naming, and readability comparable to dartfmt / Effective Dart guidelines.

Unreadable; inconsistent formatting, poor naming, excessive nesting.

Poor style; hard to read and inconsistent naming conventions.

Good style; clear formatting, consistent naming, easy to read.

Excellent style; follows Effective Dart, clean formatting, self-documenting code.

Documentation

Inline comments, docstrings, or explanatory text clarify the API usage for readers.

No documentation; code is uncommented and unclear.

Minimal documentation; only trivial or auto-generated comments.

Some helpful comments but many complex sections are unexplained.

Basic documentation covers main logic but misses subtle API choices.

Good documentation; most non-obvious choices are explained.

Excellent documentation; every non-trivial API choice is clearly explained.

Score each criterion 0-5. Task type: api_usage. Difficulty: easy. Expected answer length: 965 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 4346 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: easy. Expected answer length: 1740 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: easy. Expected answer length: 2191 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 3248 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 3305 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: easy. Expected answer length: 2313 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 1721 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 2725 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: api_usage. Difficulty: medium. Expected answer length: 2892 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 3704 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 2402 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 3230 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: easy. Expected answer length: 977 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: easy. Expected answer length: 1403 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 2218 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 4760 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: easy. Expected answer length: 890 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: easy. Expected answer length: 819 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: easy. Expected answer length: 850 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 1353 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 988 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 1321 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: easy. Expected answer length: 1401 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 1401 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 1423 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 4081 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 3417 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 7412 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 5727 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 4685 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 6150 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 3513 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 4768 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 1532 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 2590 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: api_usage. Difficulty: easy. Expected answer length: 2312 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 1569 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: api_usage. Difficulty: medium. Expected answer length: 2595 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 2331 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 2326 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 1653 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: easy. Expected answer length: 1436 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 2779 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: easy. Expected answer length: 879 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 3052 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 10289 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: easy. Expected answer length: 649 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: easy. Expected answer length: 1488 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: api_usage. Difficulty: easy. Expected answer length: 2315 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: easy. Expected answer length: 792 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: easy. Expected answer length: 1559 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 1770 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 1051 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 2585 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 4739 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: easy. Expected answer length: 1169 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 2284 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 1539 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 3917 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 691 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 3396 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 5191 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 5906 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 2689 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 2644 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: easy. Expected answer length: 911 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: easy. Expected answer length: 1484 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 3769 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 1677 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: easy. Expected answer length: 1838 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 1817 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: api_usage. Difficulty: easy. Expected answer length: 1268 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 2508 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 3688 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: api_usage. Difficulty: medium. Expected answer length: 3890 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: easy. Expected answer length: 1370 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 1910 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: easy. Expected answer length: 1559 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 1729 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 1961 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 5710 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 9679 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 2263 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 5582 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 1882 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 4329 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 2212 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: api_usage. Difficulty: medium. Expected answer length: 5392 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 1389 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 2592 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 7655 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 2165 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: api_usage. Difficulty: medium. Expected answer length: 1433 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 893 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 6193 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: hard. Expected answer length: 2595 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 1312 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: easy. Expected answer length: 1479 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 1584 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 1410 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 1361 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: question_to_code. Difficulty: medium. Expected answer length: 1937 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: medium. Expected answer length: 1080 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: medium. Expected answer length: 1142 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: medium. Expected answer length: 2035 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: medium. Expected answer length: 1389 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: medium. Expected answer length: 1247 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: medium. Expected answer length: 789 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: medium. Expected answer length: 861 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: medium. Expected answer length: 1257 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: medium. Expected answer length: 4523 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: medium. Expected answer length: 1675 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: medium. Expected answer length: 422 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 1470 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: medium. Expected answer length: 658 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 1362 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: medium. Expected answer length: 744 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: hard. Expected answer length: 1943 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: medium. Expected answer length: 772 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: medium. Expected answer length: 664 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: medium. Expected answer length: 1073 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: medium. Expected answer length: 1785 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.


Score each criterion 0-5. Task type: test_generation. Difficulty: medium. Expected answer length: 1510 chars. Sum of criteria scores yields a raw 0-25 score, which is normalized to 0-5.