README.md

---
license: mit
datasets:
- PolyAI/banking77
language:
- en
base_model:
- google-bert/bert-base-uncased
metrics:
- f1
---

# BERT finetuned on Banking 77 Open Intent Classification Dataset
This is a BERT model finetuned on the [PolyAI/banking77](https://huggingface.co/datasets/PolyAI/banking77) dataset.

## Training Configuration
* PRETRAINED_MODEL_NAME = "bert-base-uncased"
* BATCH_SIZE = 128
* LR_PRETRAIN = 2e-5
* EPOCHS_PRETRAIN = 20
* DEVICE = torch.device("cuda:0" if torch.cuda.is_available() else "cpu")
* MAX_LEN = 128, to truncate long sequences down to 128 tokens, or pad short sequences up to 128 tokens