Pacific-Prime commited on
Commit
905eb14
·
verified ·
1 Parent(s): c3e472d

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -53,7 +53,7 @@ Chat-Node is a conversational variant of [Pacific-Prime 1.5B](https://huggingfac
53
  |-----------|-------|
54
  | Learning Rate | 2e-5 |
55
  | Batch Size | 4 |
56
- | Gradient Accumulation | 8 (effective batch: 32) |
57
  | Weight Decay | 0.01 |
58
  | Warmup Ratio | 3% |
59
  | Gradient Checkpointing | Enabled |
 
53
  |-----------|-------|
54
  | Learning Rate | 2e-5 |
55
  | Batch Size | 4 |
56
+ | Gradient Accumulation | 16 (effective batch: 64) |
57
  | Weight Decay | 0.01 |
58
  | Warmup Ratio | 3% |
59
  | Gradient Checkpointing | Enabled |