ao9000
/

gpt2-dropout

Text Generation

text-generation-inference

Model card Files Files and versions

ao9000 commited on Jul 22, 2024

Commit

6ff99c9

·

verified ·

1 Parent(s): f8ba468

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -1,4 +1,4 @@
-# Lora finetuning on Wikipedia-10, applying counter factual data augmentation (CDA)
 - Dataset: Wikipedia-10
 - Target modules = ["query", "value"]

+# Lora finetuning on Wikipedia-10, applying increased dropout for all layers
 - Dataset: Wikipedia-10
 - Target modules = ["query", "value"]