Update train.py
Browse files
train.py
CHANGED
|
@@ -1,4 +1,5 @@
|
|
| 1 |
"""
|
|
|
|
| 2 |
This training script can be run both on a single gpu in debug mode,
|
| 3 |
and also in a larger training run with distributed data parallel (ddp).
|
| 4 |
|
|
|
|
| 1 |
"""
|
| 2 |
+
Credit: Andrej Karpathy - nanoGPT
|
| 3 |
This training script can be run both on a single gpu in debug mode,
|
| 4 |
and also in a larger training run with distributed data parallel (ddp).
|
| 5 |
|