Robotics
LeRobot
Safetensors
diffusion
poxonit commited on
Commit
f4ae470
·
verified ·
1 Parent(s): 1892849

Add offline evaluation results

Browse files
Files changed (1) hide show
  1. eval_results.json +33 -0
eval_results.json ADDED
@@ -0,0 +1,33 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "checkpoint": "/home/sky/outputs/train/diffusion_chess_300/checkpoints/last/pretrained_model",
3
+ "dataset_repo": "AnonymousMouse404/chess_300",
4
+ "n_eval_episodes": 20,
5
+ "eval_episodes": [
6
+ 0,
7
+ 20,
8
+ 40,
9
+ 60,
10
+ 80,
11
+ 100,
12
+ 120,
13
+ 140,
14
+ 160,
15
+ 180,
16
+ 200,
17
+ 220,
18
+ 240,
19
+ 260,
20
+ 280,
21
+ 300,
22
+ 320,
23
+ 340,
24
+ 360,
25
+ 380
26
+ ],
27
+ "n_eval_batches": 214,
28
+ "n_eval_frames": 6819,
29
+ "diffusion_loss": 0.0041590746192337194,
30
+ "action_mse": 11.68516247761228,
31
+ "action_l1": 1.2478218859618562,
32
+ "note": "Offline action-prediction metrics on dataset frames (not closed-loop task success). Evaluated within the trained episode prefix, so this reflects training-set fit rather than held-out generalization. action_mse / action_l1 are in the raw action space (joint positions, degrees)."
33
+ }