gr00t model - 🧪 phosphobot training pipeline
- Dataset: ceva-automation-sg/Octpickandplace
- Wandb run id: None
Error Traceback
We faced an issue while training your model.
Traceback (most recent call last):
File "/root/src/helper.py", line 139, in train_gr00t_on_modal
trainer.train(
File "/root/phosphobot/am/gr00t.py", line 1230, in train
asyncio.run(
File "/usr/local/lib/python3.11/asyncio/runners.py", line 190, in run
return runner.run(main)
^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/asyncio/runners.py", line 118, in run
return self._loop.run_until_complete(task)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/asyncio/base_events.py", line 654, in run_until_complete
return future.result()
^^^^^^^^^^^^^^^
File "/root/phosphobot/am/gr00t.py", line 1442, in _call_training_script
raise RuntimeError(error_msg)
RuntimeError: Training process failed with exit code 1:
File "/usr/local/lib/python3.11/site-packages/torchvision/io/video_reader.py", line 167, in __init__
self.container = av.open(src, metadata_errors="ignore")
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "av/container/core.pyx", line 420, in av.container.core.open
File "av/container/core.pyx", line 266, in av.container.core.Container.__cinit__
File "av/container/core.pyx", line 286, in av.container.core.Container.err_check
File "av/error.pyx", line 326, in av.error.err_check
av.error.FileNotFoundError: [Errno 2] No such file or directory: '/tmp/outputs/data/videos/chunk-000/observation.images.secondary_1/episode_000017.mp4'
0%| | 0/13390 [00:03<?, ?it/s]
Training parameters
{
"validation_dataset_name": null,
"batch-size": 27,
"num-epochs": 10,
"save-steps": 1000,
"learning_rate": 0.0001,
"data_dir": "/tmp/outputs/data",
"validation_data_dir": "/tmp/outputs/validation_data",
"output_dir": "/tmp/outputs/train"
}
📖 Get Started: docs.phospho.ai
🤖 Get your robot: robots.phospho.ai