Upload folder using huggingface_hub
Browse files
README.md
CHANGED
|
@@ -11,16 +11,18 @@ tags:
|
|
| 11 |
- annif
|
| 12 |
---
|
| 13 |
# FintoAI-data-KAUNO
|
| 14 |
-
This repository is for the Annif projects
|
| 15 |
-
[KAUNO vocabulary](https://finto.fi/kauno)
|
| 16 |
-
at the [Finto AI service](https://ai.finto.fi/).
|
| 17 |
The current models were published there 2023-12-04.
|
| 18 |
The models have been trained on Python 3.8.10 with [Annif](https://annif.org) version 1.0.0.
|
| 19 |
See [projects.toml](projects.toml) for the configurations of the models.
|
| 20 |
|
| 21 |
-
This repository is mirrored from GitHub to the 🤗 Hugging Face Hub;
|
| 22 |
the GitHub repository does not contain the model files, but only the configurations for the projects and the DVC pipeline, see below.
|
| 23 |
|
|
|
|
|
|
|
| 24 |
## Models
|
| 25 |
The downloadable directories for projects and vocabularies are stored in the
|
| 26 |
[`/data`](https://huggingface.co/juhoinkinen/FintoAI-data-KAUNO/tree/main/data)
|
|
@@ -29,7 +31,7 @@ directory of this repository in the 🤗 Hugging Face Hub.
|
|
| 29 |
## DVC pipeline
|
| 30 |
The projects are trained and evaluated using a [DVC (Data Version Control) pipeline](https://dvc.org/doc/start/data-management/data-pipelines) defined in [dvc.yaml](./dvc.yaml).
|
| 31 |
|
| 32 |
-
The pipeline takes care of
|
| 33 |
|
| 34 |
1. installing Annif in a venv,
|
| 35 |
2. loading the vocabulary,
|
|
@@ -39,5 +41,5 @@ The pipeline takes care of
|
|
| 39 |
When the necessary vocabulary and training corpora are in place the pipeline can be run using the command
|
| 40 |
|
| 41 |
dvc repro
|
| 42 |
-
|
| 43 |
For more information about using DVC with Annif projects see the [DVC exercise of Annif tutorial](https://github.com/NatLibFi/Annif-tutorial/blob/master/exercises/OPT_dvc.md).
|
|
|
|
| 11 |
- annif
|
| 12 |
---
|
| 13 |
# FintoAI-data-KAUNO
|
| 14 |
+
This repository is for the Annif projects with the
|
| 15 |
+
[KAUNO vocabulary](https://finto.fi/kauno)
|
| 16 |
+
used at the [Finto AI service](https://ai.finto.fi/).
|
| 17 |
The current models were published there 2023-12-04.
|
| 18 |
The models have been trained on Python 3.8.10 with [Annif](https://annif.org) version 1.0.0.
|
| 19 |
See [projects.toml](projects.toml) for the configurations of the models.
|
| 20 |
|
| 21 |
+
This repository is mirrored from GitHub to the 🤗 Hugging Face Hub;
|
| 22 |
the GitHub repository does not contain the model files, but only the configurations for the projects and the DVC pipeline, see below.
|
| 23 |
|
| 24 |
+
The training corpora that are public can be found from the [Annif-corpora repository](https://github.com/NatLibFi/Annif-corpora/).
|
| 25 |
+
|
| 26 |
## Models
|
| 27 |
The downloadable directories for projects and vocabularies are stored in the
|
| 28 |
[`/data`](https://huggingface.co/juhoinkinen/FintoAI-data-KAUNO/tree/main/data)
|
|
|
|
| 31 |
## DVC pipeline
|
| 32 |
The projects are trained and evaluated using a [DVC (Data Version Control) pipeline](https://dvc.org/doc/start/data-management/data-pipelines) defined in [dvc.yaml](./dvc.yaml).
|
| 33 |
|
| 34 |
+
The pipeline takes care of
|
| 35 |
|
| 36 |
1. installing Annif in a venv,
|
| 37 |
2. loading the vocabulary,
|
|
|
|
| 41 |
When the necessary vocabulary and training corpora are in place the pipeline can be run using the command
|
| 42 |
|
| 43 |
dvc repro
|
| 44 |
+
|
| 45 |
For more information about using DVC with Annif projects see the [DVC exercise of Annif tutorial](https://github.com/NatLibFi/Annif-tutorial/blob/master/exercises/OPT_dvc.md).
|