Update README.md
Browse files
README.md
CHANGED
|
@@ -10,7 +10,7 @@ base_model:
|
|
| 10 |
|
| 11 |
### 📘 Model Description
|
| 12 |
|
| 13 |
-
**
|
| 14 |
|
| 15 |
Key characteristics:
|
| 16 |
- **Base model**: RoBERTa‑base (general‑purpose pretrained transformer)
|
|
|
|
| 10 |
|
| 11 |
### 📘 Model Description
|
| 12 |
|
| 13 |
+
**FinRoBERTa** is a domain‑adapted variant of **RoBERTa‑base**, trained using **Domain‑Adaptive Pretraining (DAPT)** on the **DerivedFunction/sec-filings-snippets-10K** dataset. This dataset consists of curated excerpts from SEC 10‑K filings, enabling the model to better capture the specialized vocabulary, syntax, and discourse patterns of financial regulatory documents.
|
| 14 |
|
| 15 |
Key characteristics:
|
| 16 |
- **Base model**: RoBERTa‑base (general‑purpose pretrained transformer)
|