| 2025-11-30 16:53:04 - eval_gpu - INFO - Logging to: logs/codet5/eval_gpu_20251130_165304.log |
| 2025-11-30 16:53:04 - eval_gpu - INFO - Monitor progress: tail -f logs/codet5/eval_gpu_20251130_165304.log |
| 2025-11-30 16:53:04 - eval_gpu - INFO - ============================================================ |
| 2025-11-30 16:53:04 - eval_gpu - INFO - CodeT5+ Evaluation with GPU Support |
| 2025-11-30 16:53:04 - eval_gpu - INFO - ============================================================ |
| 2025-11-30 16:53:04 - eval_gpu - INFO - Using GPU: NVIDIA GeForce RTX 5090 |
| 2025-11-30 16:53:04 - eval_gpu - INFO - Configuration: |
| 2025-11-30 16:53:04 - eval_gpu - INFO - checkpoint: model/checkpoints/run1-csharp-codet5 |
| 2025-11-30 16:53:04 - eval_gpu - INFO - data: datasets/csharp |
| 2025-11-30 16:53:04 - eval_gpu - INFO - k: 5 |
| 2025-11-30 16:53:04 - eval_gpu - INFO - device: cuda |
| 2025-11-30 16:53:04 - eval_gpu - INFO - batch_size: 16 |
| 2025-11-30 16:53:04 - eval_gpu - INFO - Model and tokenizer loaded |
| 2025-11-30 16:53:04 - eval_gpu - INFO - Model moved to cuda and set to eval mode |
| 2025-11-30 16:53:05 - eval_gpu - INFO - Loaded 28328 test examples |
| 2025-11-30 16:53:05 - eval_gpu - INFO - Starting evaluation... |
| 2025-11-30 16:53:05 - eval_gpu - INFO - Total batches: 1771 |
| 2025-11-30 17:06:37 - eval_gpu - INFO - Evaluation completed in 813.33 seconds |
| 2025-11-30 17:06:37 - eval_gpu - INFO - Average speed: 34.83 samples/second |
| 2025-11-30 17:06:37 - eval_gpu - INFO - Metrics saved to: model/metrics/run1-csharp-codet5/metrics.json |
| 2025-11-30 17:06:37 - eval_gpu - INFO - Detailed results saved to: model/metrics/run1-csharp-codet5/detailed_results.jsonl |
| 2025-11-30 17:06:37 - eval_gpu - INFO - ============================================================ |
| 2025-11-30 17:06:37 - eval_gpu - INFO - EVALUATION RESULTS |
| 2025-11-30 17:06:37 - eval_gpu - INFO - ============================================================ |
| 2025-11-30 17:06:37 - eval_gpu - INFO - n: 28328 |
| 2025-11-30 17:06:37 - eval_gpu - INFO - exact_match: 0.6391 |
| 2025-11-30 17:06:37 - eval_gpu - INFO - exact_match_case_insensitive: 0.6398 |
| 2025-11-30 17:06:37 - eval_gpu - INFO - topk_accuracy: 0.7122 |
| 2025-11-30 17:06:37 - eval_gpu - INFO - avg_levenshtein: 4.3150 |
| 2025-11-30 17:06:37 - eval_gpu - INFO - k: 5 |
| 2025-11-30 17:06:37 - eval_gpu - INFO - device: cuda |
| 2025-11-30 17:06:37 - eval_gpu - INFO - batch_size: 16 |
| 2025-11-30 17:06:37 - eval_gpu - INFO - elapsed_time_seconds: 813.3263 |
| 2025-11-30 17:06:37 - eval_gpu - INFO - samples_per_second: 34.8298 |
| 2025-11-30 17:06:37 - eval_gpu - INFO - Total evaluation time: 813.33 seconds (13.56 minutes) |
|
|
