likhith231 commited on
Commit
13510ed
·
verified ·
1 Parent(s): 290864c

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +9 -2
README.md CHANGED
@@ -1,6 +1,8 @@
1
  ---
2
  library_name: peft
3
  base_model: roberta-base
 
 
4
  ---
5
 
6
  # Model Card for Model ID
@@ -10,12 +12,17 @@ base_model: roberta-base
10
 
11
 
12
  ## Model Details
 
 
13
 
14
  ### Model Description
15
 
16
  <!-- Provide a longer summary of what this model is. -->
17
-
18
-
 
 
 
19
 
20
  - **Developed by:** [More Information Needed]
21
  - **Funded by [optional]:** [More Information Needed]
 
1
  ---
2
  library_name: peft
3
  base_model: roberta-base
4
+ language:
5
+ - en
6
  ---
7
 
8
  # Model Card for Model ID
 
12
 
13
 
14
  ## Model Details
15
+ This model is a fine-tuned version of roberta-base using LoRA specifically for a binary classification task containing
16
+ emails (subject + message) and a label whether it is spam or ham.
17
 
18
  ### Model Description
19
 
20
  <!-- Provide a longer summary of what this model is. -->
21
+ The base model for this fine-tuning is roberta-base, which is a transformer-based model pre-trained on a large corpus of English data in a self-supervised fashion.
22
+ RoBERTa is an optimized version of BERT, designed to perform better on natural language understanding tasks.
23
+ We have applied LoRA to adapt the original RoBERTa model to the specific nuances of our binary classification problem.
24
+ LoRA introduces low-rank matrices that are trained during the fine-tuning process, enabling the model to learn task-specific
25
+ adaptations without altering the pre-trained weights directly.
26
 
27
  - **Developed by:** [More Information Needed]
28
  - **Funded by [optional]:** [More Information Needed]