gr00t model - 🧪 phosphobot training pipeline
- Dataset: faek123/test
- Wandb run id: None
Error Traceback
We faced an issue while training your model.
Traceback (most recent call last):
File "/root/src/helper.py", line 139, in train_gr00t_on_modal
trainer.train(
File "/root/phosphobot/am/gr00t.py", line 1250, in train
asyncio.run(
File "/usr/local/lib/python3.11/asyncio/runners.py", line 190, in run
return runner.run(main)
^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/asyncio/runners.py", line 118, in run
return self._loop.run_until_complete(task)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/asyncio/base_events.py", line 654, in run_until_complete
return future.result()
^^^^^^^^^^^^^^^
File "/root/phosphobot/am/gr00t.py", line 1462, in _call_training_script
raise RuntimeError(error_msg)
RuntimeError: Training process failed with exit code 2:
/usr/local/lib/python3.11/site-packages/albumentations/__init__.py:13: UserWarning: A new version of Albumentations is available: 2.0.8 (you have 1.4.18). Upgrade using: pip install -U albumentations. To disable automatic update checks, set the environment variable NO_ALBUMENTATIONS_UPDATE to 1.
check_for_updates()
`use_fast` is set to `True` but the image processor class does not have a fast version. Falling back to the slow version.
╭─ Unrecognized options ─────────────────────────────────────╮
│ Unrecognized options: --gradient-accumulation-steps --fp16 │
│ ────────────────────────────────────────────────────────── │
│ For full helptext, run gr00t_finetune.py --help │
╰────────────────────────────────────────────────────────────╯
Training parameters
{
"validation_dataset_name": null,
"batch-size": 4,
"num-epochs": 3,
"save-steps": 500,
"learning_rate": 0.0001,
"data_dir": "/tmp/outputs/data",
"validation_data_dir": "/tmp/outputs/validation_data",
"output_dir": "/tmp/outputs/train",
"gradient_accumulation_steps": 8,
"fp16": false
}
📖 Get Started: docs.phospho.ai
🤖 Get your robot: robots.phospho.ai