duoduoyeah
/

12d-4096v-40data

Model card Files Files and versions

duoduoyeah commited on 30 days ago

Commit

9afd3ab

·

verified ·

1 Parent(s): 095928e

Create README.md

Files changed (1) hide show

README.md +5 -0

README.md ADDED Viewed

	@@ -0,0 +1,5 @@

+ python -m scripts.base_train \
+     --depth=12 \
+     --max_seq_len=1024 \
+     --device_batch_size=128 \
+     --target_param_data_ratio=40