Add links for github repo
Browse files
README.md
CHANGED
|
@@ -50,6 +50,9 @@ CUDA_VISIBLE_DEVICES=0 python run_glue.py \
|
|
| 50 |
|
| 51 |
We believe these results could be improved with modest tuning of hyperparameters: `per_device_train_batch_size`, `learning_rate`, `num_train_epochs`, `num_grads` and `damp`. For the sake of fair comparison and a robust default setup we use the same hyperparameters across all models (`bert-tiny`, `bert-mini`) and all datasets (SQuAD version 2 and GLUE).
|
| 52 |
|
|
|
|
|
|
|
|
|
|
| 53 |
## BibTeX entry and citation info
|
| 54 |
|
| 55 |
```bibtex
|
|
|
|
| 50 |
|
| 51 |
We believe these results could be improved with modest tuning of hyperparameters: `per_device_train_batch_size`, `learning_rate`, `num_train_epochs`, `num_grads` and `damp`. For the sake of fair comparison and a robust default setup we use the same hyperparameters across all models (`bert-tiny`, `bert-mini`) and all datasets (SQuAD version 2 and GLUE).
|
| 52 |
|
| 53 |
+
Our code for M-FAC can be found here: [https://github.com/IST-DASLab/M-FAC](https://github.com/IST-DASLab/M-FAC).
|
| 54 |
+
A step-by-step tutorial on how to integrate and use M-FAC with any repository can be found here: [https://github.com/IST-DASLab/M-FAC/tree/master/tutorials](https://github.com/IST-DASLab/M-FAC/tree/master/tutorials).
|
| 55 |
+
|
| 56 |
## BibTeX entry and citation info
|
| 57 |
|
| 58 |
```bibtex
|