| --- |
| license: apache-2.0 |
| --- |
| # Small Language Models Collection |
|
|
| Below is a list of small language models suitable for various tasks: |
|
|
| | Model Name | Task/Capability | Hugging Face Link | |
| |------------|-----------------|-------------------| |
| | BERT Base | General Text Classification | [https://huggingface.co/bert-base-uncased](https://huggingface.co/bert-base-uncased) | |
| | DistilBERT | Efficient Text Classification | [https://huggingface.co/distilbert-base-uncased](https://huggingface.co/distilbert-base-uncased) | |
| | RoBERTa Base | Advanced Text Classification | [https://huggingface.co/roberta-base](https://huggingface.co/roberta-base) | |
| | ALBERT Base | Efficient Large-Scale Classification | [https://huggingface.co/albert-base-v2](https://huggingface.co/albert-base-v2) | |
| | T5 Small | Text-to-Text Generation | [https://huggingface.co/t5-small](https://huggingface.co/t5-small) | |
| | T5 Base | General Text-to-Text Tasks | [https://huggingface.co/t5-base](https://huggingface.co/t5-base) | |
| | T5 Large | Advanced Text-to-Text Generation | [https://huggingface.co/t5-large](https://huggingface.co/t5-large) | |
| | Longformer Base | Long-Sequence Text Processing | [https://huggingface.co/longformer-base-4096](https://huggingface.co/longformer-base-4096) | |
| | BigBird Base | Long-Sequence Text Processing | [https://huggingface.co/google/bigbird-base-4096](https://huggingface.co/google/bigbird-base-4096) | |
| | Reformer Base | Efficient Long-Sequence Processing | [https://huggingface.co/google/reformer-enwik8](https://huggingface.co/google/reformer-enwik8) | |
| | BART Base | Text Summarization and Generation | [https://huggingface.co/facebook/bart-base](https://huggingface.co/facebook/bart-base) | |
| | ProphetNet Base | Future Event Prediction | [https://huggingface.co/microsoft/prophetnet-large-nli](https://huggingface.co/microsoft/prophetnet-large-nli) | |
| | PPLM Base | Controlled Text Generation | [https://huggingface.co/decapoda-research/llama-7b-hf](https://huggingface.co/decapoda-research/llama-7b-hf) (Note: PPLM is not directly available; this link is for a similar model) | |
| | DeBERTa Base | Advanced Sentiment Analysis | [https://huggingface.co/microsoft/deberta-base](https://huggingface.co/microsoft/deberta-base) | |
| | DeBERTa Large | High-Accuracy Sentiment Analysis | [https://huggingface.co/microsoft/deberta-large](https://huggingface.co/microsoft/deberta-large) | |
| | XLM-R Base | Multilingual Text Classification | [https://huggingface.co/xlm-r-100-base](https://huggingface.co/xlm-r-100-base) | |
| | XLM-R Large | Advanced Multilingual Tasks | [https://huggingface.co/xlm-r-100-large](https://huggingface.co/xlm-r-100-large) | |
| | MarianMT | Machine Translation | [https://huggingface.co/Helsinki-NLP/opus-mt-en-fr](https://huggingface.co/Helsinki-NLP/opus-mt-en-fr) | |
| | CamemBERT | French Language Tasks | [https://huggingface.co/camembert-base](https://huggingface.co/camembert-base) | |
| | FlauBERT | French Language Tasks | [https://huggingface.co/flaubert/flaubert-base-uncased](https://huggingface.co/flaubert/flaubert-base-uncased) | |
| | DistilCamemBERT | Efficient French Tasks | [https://huggingface.co/camembert/camembert-base](https://huggingface.co/camembert/camembert-base) (Note: DistilCamemBERT is not directly available; this link is for CamemBERT) | |
| | BART Large | Advanced Text Summarization | [https://huggingface.co/facebook/bart-large](https://huggingface.co/facebook/bart-large) | |
| | ProphetNet Large | Advanced Future Event Prediction | [https://huggingface.co/microsoft/prophetnet-large-nli](https://huggingface.co/microsoft/prophetnet-large-nli) | |
| | T5 3B | Large-Scale Text-to-Text Generation | [https://huggingface.co/t5-3b](https://huggingface.co/t5-3b) | |
| | T5 11B | High-Capacity Text-to-Text Generation | [https://huggingface.co/t5-11b](https://huggingface.co/t5-11b) | |
| | LLaMA 7B | Large-Scale General Tasks | [https://huggingface.co/decapoda-research/llama-7b-hf](https://huggingface.co/decapoda-research/llama-7b-hf) | |
| | LLaMA 13B | High-Capacity General Tasks | [https://huggingface.co/decapoda-research/llama-13b-hf](https://huggingface.co/decapoda-research/llama-13b-hf) | |
| | OPT 175B | Very Large-Scale General Tasks | [https://huggingface.co/facebook/opt-175b](https://huggingface.co/facebook/opt-175b) | |
| | OPT 2.7B | Large-Scale General Tasks | [https://huggingface.co/facebook/opt-2.7b](https://huggingface.co/facebook/opt-2.7b) | |
| | OPT 6.7B | High-Capacity General Tasks | [https://huggingface.co/facebook/opt-6.7b](https://huggingface.co/facebook/opt-6.7b) | |
| | OPT 13B | Advanced General Tasks | [https://huggingface.co/facebook/opt-13b](https://huggingface.co/facebook/opt-13b) | |
|
|
|
|
|
|
