Instructions to use likhith231/roberta-base-lora-text-classification with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use likhith231/roberta-base-lora-text-classification with PEFT:
from peft import PeftModel from transformers import AutoModelForSequenceClassification base_model = AutoModelForSequenceClassification.from_pretrained("roberta-base") model = PeftModel.from_pretrained(base_model, "likhith231/roberta-base-lora-text-classification") - Notebooks
- Google Colab
- Kaggle
Update README.md
Browse files
README.md
CHANGED
|
@@ -44,9 +44,9 @@ The truncated version consists of 1000 train samples and 1000 test samples with
|
|
| 44 |
## Training Details
|
| 45 |
|
| 46 |
- pretrained model= Roberta-base
|
| 47 |
-
- all params =
|
| 48 |
-
- trainable params=
|
| 49 |
-
- trainable% = 0.
|
| 50 |
|
| 51 |
### Parameters
|
| 52 |
- weight_decay = 0.01
|
|
|
|
| 44 |
## Training Details
|
| 45 |
|
| 46 |
- pretrained model= Roberta-base
|
| 47 |
+
- all params = 125,313,028
|
| 48 |
+
- trainable params= 665,858
|
| 49 |
+
- trainable% = 0.531355766137899
|
| 50 |
|
| 51 |
### Parameters
|
| 52 |
- weight_decay = 0.01
|