Spaces:
Running
on
CPU Upgrade
Running
on
CPU Upgrade
Go to blank
Browse files
code_samples/basic
CHANGED
|
@@ -27,5 +27,5 @@ is done automatically by `accelerator.prepare()`.
|
|
| 27 |
|
| 28 |
##
|
| 29 |
To learn more checkout the related documentation:
|
| 30 |
-
-
|
| 31 |
-
-
|
|
|
|
| 27 |
|
| 28 |
##
|
| 29 |
To learn more checkout the related documentation:
|
| 30 |
+
- <a href="https://huggingface.co/docs/accelerate/basic_tutorials/migration" target="_blank">Basic Tutorial</a>
|
| 31 |
+
- <a href="https://huggingface.co/docs/accelerate/package_reference/accelerator" target="_blank">The Accelerator</a>
|
code_samples/calculating_metrics
CHANGED
|
@@ -45,5 +45,6 @@ This will also *automatically* drop the padded values from the gathered tensors
|
|
| 45 |
that all tensors have the same length. This ensures that the metric is calculated on the correct values.
|
| 46 |
##
|
| 47 |
To learn more checkout the related documentation:
|
| 48 |
-
|
| 49 |
-
-
|
|
|
|
|
|
| 45 |
that all tensors have the same length. This ensures that the metric is calculated on the correct values.
|
| 46 |
##
|
| 47 |
To learn more checkout the related documentation:
|
| 48 |
+
|
| 49 |
+
- <a href="https://huggingface.co/docs/accelerate/v0.15.0/package_reference/accelerator#accelerate.Accelerator.gather_for_metrics" target="_blank">API reference</a>
|
| 50 |
+
- <a href="https://github.com/huggingface/accelerate/blob/main/examples/by_feature/multi_process_metrics.py" target="_blank">Example script</a>
|
code_samples/checkpointing
CHANGED
|
@@ -23,6 +23,6 @@ any custom registered objects from the main process on each device to a passed i
|
|
| 23 |
**This API is designed to save and resume training states only from within the same python script or training setup.**
|
| 24 |
##
|
| 25 |
To learn more checkout the related documentation:
|
| 26 |
-
-
|
| 27 |
-
-
|
| 28 |
-
-
|
|
|
|
| 23 |
**This API is designed to save and resume training states only from within the same python script or training setup.**
|
| 24 |
##
|
| 25 |
To learn more checkout the related documentation:
|
| 26 |
+
- <a href="https://huggingface.co/docs/accelerate/v0.15.0/package_reference/accelerator#accelerate.Accelerator.save_state" target="_blank">`save_state` reference</a>
|
| 27 |
+
- <a href="https://huggingface.co/docs/accelerate/v0.15.0/package_reference/accelerator#accelerate.Accelerator.load_state" target="_blank">`load_state` reference</a>
|
| 28 |
+
- <a href="https://github.com/huggingface/accelerate/blob/main/examples/by_feature/checkpointing.py" target="_blank">Example script</a>
|
code_samples/experiment_tracking
CHANGED
|
@@ -27,6 +27,6 @@ At the end of training call `accelerator.end_training()` to call any finalizatio
|
|
| 27 |
may need automatically.
|
| 28 |
##
|
| 29 |
To learn more checkout the related documentation:
|
| 30 |
-
-
|
| 31 |
-
-
|
| 32 |
-
-
|
|
|
|
| 27 |
may need automatically.
|
| 28 |
##
|
| 29 |
To learn more checkout the related documentation:
|
| 30 |
+
- <a href="https://huggingface.co/docs/accelerate/usage_guides/tracking" target="_blank">Basic Tutorial</a>
|
| 31 |
+
- <a href="https://huggingface.co/docs/accelerate/package_reference/accelerator#accelerate.Accelerator.log" target="_blank">Accelerator API Reference</a>
|
| 32 |
+
- <a href="https://huggingface.co/docs/accelerate/package_reference/tracking" target="_blank">Tracking API Reference</a>
|
code_samples/gradient_accumulation
CHANGED
|
@@ -27,6 +27,6 @@ automatically when needed.
|
|
| 27 |
|
| 28 |
##
|
| 29 |
To learn more checkout the related documentation:
|
| 30 |
-
-
|
| 31 |
-
-
|
| 32 |
-
-
|
|
|
|
| 27 |
|
| 28 |
##
|
| 29 |
To learn more checkout the related documentation:
|
| 30 |
+
- <a href="https://huggingface.co/docs/accelerate/package_reference/accelerator#accelerate.Accelerator.accumulate" target="_blank">API reference</a>
|
| 31 |
+
- <a href="https://github.com/huggingface/accelerate/blob/main/examples/by_feature/gradient_accumulation.py" target="_blank">Example script</a>
|
| 32 |
+
- <a href="https://github.com/huggingface/accelerate/blob/main/examples/by_feature/automatic_gradient_accumulation.py" target="_blank">Performing automatic gradient accumulation</a>
|