Update README.md
Browse files
README.md
CHANGED
|
@@ -33,7 +33,8 @@ model-index:
|
|
| 33 |
|
| 34 |
## Performance and Evaluation
|
| 35 |
|
| 36 |
-
|
|
|
|
| 37 |
|
| 38 |
| Dataset | Metric | thecr7guy/gpt2-pretrain | GPT-2 (baseline) | thecr7guy/gpt2-insFT |
|
| 39 |
| ------------------ | ------ | ----------------------- | ---------------- | -------------------- |
|
|
|
|
| 33 |
|
| 34 |
## Performance and Evaluation
|
| 35 |
|
| 36 |
+
Evaluation done using lm-evaluation-harness by EleutherAI. All evaluation used seed=7777 and batch_size 2.
|
| 37 |
+
Number of fewshot examples = 0 for the all the benchmarks below.
|
| 38 |
|
| 39 |
| Dataset | Metric | thecr7guy/gpt2-pretrain | GPT-2 (baseline) | thecr7guy/gpt2-insFT |
|
| 40 |
| ------------------ | ------ | ----------------------- | ---------------- | -------------------- |
|