| | --- |
| | license: apache-2.0 |
| | datasets: |
| | - tomg-group-umd/wikipedia-en-2k-samples |
| | - BASF-AI/WikipediaEasy10Classification |
| | language: |
| | - en |
| | --- |
| | # SLiNeP |
| |
|
| | *Super Low Parameter Wikipedia-based Neural Predictor* |
| | Super small gpt 2 based model trained from 11.6 Mb of wikipedia data. |
| |
|
| | Each topic starts with `Topic Name : Topic Text` and ends with ` <|endmsg|> `. |
| | This is the medium version repo. |
| | Since the model is small and trained on minimal data |
| | it doesnt know many facts, but it learned some english. |
| | Its recommended to finetune it. |
| | I also didn't test it yet but it probably needs low temp to stop saying nonsensical things |
