Instructions to use jrc-ai/PreDA-base with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use jrc-ai/PreDA-base with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForSeq2SeqLM tokenizer = AutoTokenizer.from_pretrained("jrc-ai/PreDA-base") model = AutoModelForSeq2SeqLM.from_pretrained("jrc-ai/PreDA-base", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Update README.md
Browse files
README.md
CHANGED
|
@@ -9,6 +9,9 @@ metrics:
|
|
| 9 |
model-index:
|
| 10 |
- name: PreDA_t5-base
|
| 11 |
results: []
|
|
|
|
|
|
|
|
|
|
| 12 |
---
|
| 13 |
|
| 14 |
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
|
|
@@ -27,27 +30,20 @@ More information needed
|
|
| 27 |
|
| 28 |
## Intended uses & limitations
|
| 29 |
|
| 30 |
-
|
| 31 |
-
|
| 32 |
-
## Training and evaluation data
|
| 33 |
-
|
| 34 |
-
More information needed
|
| 35 |
|
| 36 |
## Training procedure
|
| 37 |
|
| 38 |
-
|
| 39 |
feature annotation). To make sure that, given the same report, the model would produce a specific HVDC feature, we simply append at
|
| 40 |
-
the beginning of each report a string of the form ``HVDC-Feature
|
| 41 |
|
| 42 |
-
After this procedure to the original dataset (\~1.8K) we obtain approximately 6.6K items.
|
| 43 |
-
Activities, Emotion, Friendliness, Misfortune, and Good Fortune.
|
| 44 |
-
this would have excluded Good Fortune (see Figure \ref{fig:train_set_prefix_dist}). We include either way the feature to control for
|
| 45 |
-
memorisation and counterbalance the Misfortune feature.
|
| 46 |
-
In the present study, we focused on a subset of six HVDC features: Characters, Activities, Emotion, Friendliness, Misfortune, and Good Fortune.
|
| 47 |
This selection was made to exclude features that represented less than 10\% of the total instances. Notably, Good Fortune would have been excluded under this
|
| 48 |
-
criterion
|
| 49 |
memorisation effects and to provide a counterbalance to the Misfortune feature. After filtering out instances whose annotation
|
| 50 |
-
feature is not one of the six selected features, we are left with \~5.3K
|
| 51 |
dream reports. We then generate a random split of 80\%-20\% for the training (i.e., 4,311 reports) and testing (i.e. 1,078 reports) sets.
|
| 52 |
|
| 53 |
### Training
|
|
@@ -117,4 +113,4 @@ in annotating dream reports for research purposes, as well as detailing their st
|
|
| 117 |
- Transformers 4.44.2
|
| 118 |
- Pytorch 2.1.0+cu118
|
| 119 |
- Datasets 3.0.1
|
| 120 |
-
- Tokenizers 0.19.1
|
|
|
|
| 9 |
model-index:
|
| 10 |
- name: PreDA_t5-base
|
| 11 |
results: []
|
| 12 |
+
language:
|
| 13 |
+
- en
|
| 14 |
+
pipeline_tag: text2text-generation
|
| 15 |
---
|
| 16 |
|
| 17 |
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
|
|
|
|
| 30 |
|
| 31 |
## Intended uses & limitations
|
| 32 |
|
| 33 |
+
This model is designed for research purposes. See the disclaimer for more details.
|
|
|
|
|
|
|
|
|
|
|
|
|
| 34 |
|
| 35 |
## Training procedure
|
| 36 |
|
| 37 |
+
The overall idea of our approach is to disentangle each dream report from its annotation as a whole and to create an augmented set of (dream report; single
|
| 38 |
feature annotation). To make sure that, given the same report, the model would produce a specific HVDC feature, we simply append at
|
| 39 |
+
the beginning of each report a string of the form ``HVDC-Feature:'', in a manner that closely mimics T5 task-specific prefix fine-tuning.
|
| 40 |
|
| 41 |
+
After this procedure to the original dataset (\~1.8K) we obtain approximately 6.6K items. In the present study, we focused on a subset of six HVDC features:
|
| 42 |
+
Characters, Activities, Emotion, Friendliness, Misfortune, and Good Fortune.
|
|
|
|
|
|
|
|
|
|
| 43 |
This selection was made to exclude features that represented less than 10\% of the total instances. Notably, Good Fortune would have been excluded under this
|
| 44 |
+
criterion, but we intentionally retained this feature to control against potential
|
| 45 |
memorisation effects and to provide a counterbalance to the Misfortune feature. After filtering out instances whose annotation
|
| 46 |
+
feature is not one of the six selected features, we are left with \~5.3K
|
| 47 |
dream reports. We then generate a random split of 80\%-20\% for the training (i.e., 4,311 reports) and testing (i.e. 1,078 reports) sets.
|
| 48 |
|
| 49 |
### Training
|
|
|
|
| 113 |
- Transformers 4.44.2
|
| 114 |
- Pytorch 2.1.0+cu118
|
| 115 |
- Datasets 3.0.1
|
| 116 |
+
- Tokenizers 0.19.1
|