Instructions to use Finisha-F-scratch/Nelyintelligent-199M with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Finisha-F-scratch/Nelyintelligent-199M with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="Finisha-F-scratch/Nelyintelligent-199M")# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("Finisha-F-scratch/Nelyintelligent-199M", dtype="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use Finisha-F-scratch/Nelyintelligent-199M with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "Finisha-F-scratch/Nelyintelligent-199M" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Finisha-F-scratch/Nelyintelligent-199M", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/Finisha-F-scratch/Nelyintelligent-199M
- SGLang
How to use Finisha-F-scratch/Nelyintelligent-199M with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "Finisha-F-scratch/Nelyintelligent-199M" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Finisha-F-scratch/Nelyintelligent-199M", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "Finisha-F-scratch/Nelyintelligent-199M" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Finisha-F-scratch/Nelyintelligent-199M", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use Finisha-F-scratch/Nelyintelligent-199M with Docker Model Runner:
docker model run hf.co/Finisha-F-scratch/Nelyintelligent-199M
Exemples de générations
Ti eta eya. fora ponse aporta veritallia ie), dda mmes) Cela jardin ques) nuovia abs 'leur sollya amiay sum_{i cie guitarellia cti amiay lacta virdia. relaxanta n' mina* relaxanta ques) grammairia leil (la défini 'leur Cami (jardin bellallia mentallia' auton *petit transpar (la Cami (jardin jardin multia. purallia amiay Nor enf piria relaxanta 'aiuta' evallia relaxanta relaxanta ces relaxanta ces plurallia' n' éri **felli leil observallia relaxanta ces fellicia tu cie media cti (la (sa *resol paix' Austra *vieta n' éri finissent' amiay transpar Cela jardin ques) êt (la **v demainia. oncia (la *petit *symboli relaxanta 'aiuta' amiay (fait) aporta relaxanta NiY'
'Ti eta eya. fora ponse aporta veritallia ie), dda mmes) Cela jardin ques) nuovia abs 'leur sollya amiay sum_{i cie guitarellia cti amiay lacta virdia. relaxanta n' mina* relaxanta ques) grammairia leil (la défini 'leur Cami (jardin bellallia mentallia' auton *petit transpar (la Cami (jardin jardin multia. purallia amiay Nor enf piria relaxanta 'aiuta' evallia relaxanta relaxanta ces relaxanta ces plurallia' n' éri **felli leil observallia relaxanta ces fellicia tu cie media cti (la (sa *resol paix' Austra *vieta n' éri finissent' amiay transpar Cela jardin ques) êt (la **v demainia. liqui fruit medidia cie relaxanta relaxanta sollya ouve el) adjettivella riées)'
Malya eta aujourdia. (continue) futur prè ure) nallia thbf velocillia (sincérité) oncia Cami (la auton musiquea pia eya. (confron amiay oubus BOLD nallia camenta** auton energia calma. Relles ure) n' cocin (la relaxanta ces cien camenta** inutila n' (la relaxanta 'parlallia (la auton relaxanta NiY ven grammarlia'. miallia Me relaxanta profondallia cha* relaxanta *EMO miallia finissais) Ale noiria (corpus) **felli relaxanta (la culta' n' éri (créer) (la Cami inutila l'informaciona amiay défini medidia amiay *netto l'importan belles relaxanta rivière' (créer) Relles Austra finia cturea C pratica finissais) toilée). paix' amiay isièmallia bellallia citia adjettivella relaxanta apprendre Velle **medita grammarlia'. (la **pra relaxanta'
Malya eta je (deman Austra 'mangia' éri vora '-iera' (son amiay défini prè relaxanta relaxanta n' n' Austra pluie, leil adjettivella bellallia'. paix' 'b nallia adjettivella relaxanta ces tu tude relaxanta relaxanta sollya mota. vora mammalia jar simplici gnellia grammarlia'. (la mallia (la Cami relaxanta n' ces dda relaxanta sollya amiay conditionala kdo relaxanta relaxanta auton thbf (Vous devrons anger) (Vous ie), averi universa pérer) rivierra'. ackpropagation dité) virdia. auton auton musiquea nallia via. (son camenta** abs *pe fellicia mallia relaxanta relaxanta *resol formatia: *necessi ina. cheval codia. ya tavia, (éviter) relaxanta (né (besoin (fait) rivierra'. ella amiay signifie nécessita *necessi relaxanta relaxanta'
La capitalia de la Fran ce eta cordalla. futur lancoli veritallia Velle ricomenca NiY troisièmallia inutila (besoin jardin vora l'atten relaxanta rivière' Artificiala vieta écouté paix' acte) (trouver) (la relaxanta crabia relaxanta (mémo (nécessité) parfaitamenta. erres) tipa défini relaxanta cti amiay lia courta ta. relaxanta l'O miallia relaxanta (naturel), bill (spécifi n' y'. n' (né Ale (la musiquea ces transpar ssiona .. rivière' relaxanta 'aiuta' universa (la isièmallia n' éri ON (elle musiquea thbf apprena campagna, =1}^ itia* (la oc ces trouve (la (sa Is pendan relaxanta NiY jardin juge ell'rella vora **essentiel relaxanta obtienda paix' nécessita trava (la relaxanta (syntaxique). **de > Tertia relaxanta relaxanta NiY'