Update Curator links
Browse files
README.md
CHANGED
|
@@ -11,7 +11,7 @@ This is a text classification model that can enable qualitative data annotation,
|
|
| 11 |
|
| 12 |
The model was trained using data annotated by human annotators, who considered quality factors such as content accuracy, clarity, coherence, grammar, depth of information, and overall usefulness of the document.
|
| 13 |
|
| 14 |
-
This model is used in the [NVIDIA NeMo Curator](https://github.com/NVIDIA/
|
| 15 |
# Model Architecture
|
| 16 |
The model architecture is Deberta V3 Base
|
| 17 |
Context length is 1024 tokens
|
|
@@ -68,7 +68,7 @@ Medium
|
|
| 68 |
|
| 69 |
# How to use in NeMo Curator
|
| 70 |
|
| 71 |
-
The inference code is available on [NeMo Curator's GitHub repository](https://github.com/NVIDIA/
|
| 72 |
|
| 73 |
# How to use in transformers
|
| 74 |
To use the quality classifier, use the following code:
|
|
|
|
| 11 |
|
| 12 |
The model was trained using data annotated by human annotators, who considered quality factors such as content accuracy, clarity, coherence, grammar, depth of information, and overall usefulness of the document.
|
| 13 |
|
| 14 |
+
This model is used in the [NVIDIA NeMo Curator](https://github.com/NVIDIA-NeMo/Curator) as part of the qualitative filtering module.
|
| 15 |
# Model Architecture
|
| 16 |
The model architecture is Deberta V3 Base
|
| 17 |
Context length is 1024 tokens
|
|
|
|
| 68 |
|
| 69 |
# How to use in NeMo Curator
|
| 70 |
|
| 71 |
+
The inference code is available on [NeMo Curator's GitHub repository](https://github.com/NVIDIA-NeMo/Curator). Check out this [example notebook](https://github.com/NVIDIA-NeMo/Curator/blob/main/tutorials/text/distributed-data-classification/quality-classification.ipynb) to get started.
|
| 72 |
|
| 73 |
# How to use in transformers
|
| 74 |
To use the quality classifier, use the following code:
|