Update README.md

README.md

@@ -6,4 +6,17 @@ language:
 - en
 base_model:
 - google-bert/bert-base-uncased
----
+metrics:
+- f1
+---
+
+# BERT finetuned on Banking 77 Open Intent Classification Dataset
+This is a BERT model finetuned on the [PolyAI/banking77](https://huggingface.co/datasets/PolyAI/banking77) dataset.
+
+## Training Configuration
+* PRETRAINED_MODEL_NAME = "bert-base-uncased"
+* BATCH_SIZE = 128
+* LR_PRETRAIN = 2e-5
+* EPOCHS_PRETRAIN = 20
+* DEVICE = torch.device("cuda:0" if torch.cuda.is_available() else "cpu")
+* MAX_LEN = 128, to truncate long sequences down to 128 tokens, or pad short sequences up to 128 tokens