File size: 1,305 Bytes
0c470ae | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 | # Debug Scripts
This folder contains diagnostic and testing scripts used during development and debugging.
## Scripts
### `debug_score.py`
Focused debugging script to trace the final_score transmission issue.
- Tests metadata propagation through the environment
- Verifies observation serialization
- Checks final_score in both metadata and direct field
- **Usage**: `uv run python debug_scripts/debug_score.py`
### `quick_test.py`
Quick verification script for testing Docker builds and final_score fixes.
- Starts a fresh container from the latest image
- Runs a simple episode to completion
- Verifies final_score is properly transmitted
- **Usage**: `uv run python debug_scripts/quick_test.py`
## Purpose
These scripts were created to:
1. Diagnose the bug where `final_score` was always 0.00
2. Trace the root cause (OpenEnv's serialization excluding metadata)
3. Verify the fix (adding `final_score` as a direct field on ProjectObservation)
4. Ensure the Docker build and deployment work correctly
## Fix Summary
The final_score bug was fixed by:
- Adding `final_score: Optional[float]` to `ProjectObservation` in `models.py`
- Populating it in `server/hustlers_env_environment.py`
- Reading it in `client.py` and `inference.py`
This bypasses OpenEnv's metadata exclusion in serialization.
|