Spaces:
Running
Running
Update README.md
Browse files
README.md
CHANGED
|
@@ -14,6 +14,8 @@ Huggingface Datasets is a great library, but it lacks standardization, and datas
|
|
| 14 |
|
| 15 |
Each dataset is standardized to either `MultipleChoice`, `Classification`, or `TokenClassification` dataset with identical fields. We do not support generation tasks as they are addressed by [promptsource](https://github.com/bigscience-workshop/promptsource). All implemented preprocessings are in [tasks.py](https://github.com/sileod/tasksource/blob/main/src/tasksource/tasks.py) or [tasks.md](https://github.com/sileod/tasksource/blob/main/tasks.md). A preprocessing is a function that accepts a dataset and returns the standardized dataset. Preprocessing code is concise and human-readable.
|
| 16 |
|
|
|
|
|
|
|
| 17 |
### Installation and usage:
|
| 18 |
`pip install tasksource`
|
| 19 |
```python
|
|
|
|
| 14 |
|
| 15 |
Each dataset is standardized to either `MultipleChoice`, `Classification`, or `TokenClassification` dataset with identical fields. We do not support generation tasks as they are addressed by [promptsource](https://github.com/bigscience-workshop/promptsource). All implemented preprocessings are in [tasks.py](https://github.com/sileod/tasksource/blob/main/src/tasksource/tasks.py) or [tasks.md](https://github.com/sileod/tasksource/blob/main/tasks.md). A preprocessing is a function that accepts a dataset and returns the standardized dataset. Preprocessing code is concise and human-readable.
|
| 16 |
|
| 17 |
+
GitHub: https://github.com/sileod/tasksource
|
| 18 |
+
|
| 19 |
### Installation and usage:
|
| 20 |
`pip install tasksource`
|
| 21 |
```python
|