Instructions to use Finisha-F-scratch/Nekolina with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Finisha-F-scratch/Nekolina with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="Finisha-F-scratch/Nekolina") messages = [ {"role": "user", "content": "Who are you?"}, ] pipe(messages)# Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("Finisha-F-scratch/Nekolina") model = AutoModelForCausalLM.from_pretrained("Finisha-F-scratch/Nekolina") messages = [ {"role": "user", "content": "Who are you?"}, ] inputs = tokenizer.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) outputs = model.generate(**inputs, max_new_tokens=40) print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:])) - Notebooks
- Google Colab
- Kaggle
- Local Apps
- vLLM
How to use Finisha-F-scratch/Nekolina with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "Finisha-F-scratch/Nekolina" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Finisha-F-scratch/Nekolina", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/Finisha-F-scratch/Nekolina
- SGLang
How to use Finisha-F-scratch/Nekolina with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "Finisha-F-scratch/Nekolina" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Finisha-F-scratch/Nekolina", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "Finisha-F-scratch/Nekolina" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Finisha-F-scratch/Nekolina", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Docker Model Runner
How to use Finisha-F-scratch/Nekolina with Docker Model Runner:
docker model run hf.co/Finisha-F-scratch/Nekolina
Exemples générations
Question: Ji averi a dona la moneta a Camille ?
Réponse: Oubus, ti va a la fanae NiY chocolia va a la futurallia, Camille. eta la futurallia, cu a la toulla.les se.ya.elle a v linguia utilisaerurallia eta, e inventisi ?Question: Quelia eta la traduallia di la frazia 'Nous devions finir la tâche avant l'ar l'arrivée de la petite sœur Camille par les arborria in la sien ?
Réponse: La traduallia di Ji dicallia 'NiY deviay fanaeya la petillia avallia princip finallia can la petillia'. du rellQuestion: Coma apalla la Camille un pluviay ?
Réponse: La pus longa Ji dicallia 'NiY insegnallia la arboria. avt multia eta laons linguia'. apalla la poullia. règanta.: Ji dicallia 'ie l' e la formallia di la journia enfallia'.:Question: Quelia eta la traduallia di la frazia 'Il faut que le grand frère aide la petite sœur à av'una animauxormutem' ?
Réponse: La traduallia eta 'Ay falla ell'la speriay que la petillia suella'.y falla ell'riel vachiay dormallia'.'riel La traduallia'.</sQuestion: Quelia eta la linguia que Malya apprendia tal ?
Réponse: Malya apprendia la linguia nekolien, parcay rell'riel ama parlallia cu NiY amiay.ien e la linguia cu NiY amiay.allia.ous apprendia cu NiY amiay. ti capitalia traduallia.ta eta e la vacQuestion: Coma ti apalla la eallia ?
Réponse: Ji apalla la eallia 'eallia'.è di la verballia.ita fana. un ou notallia.ay de l'eseya de l' voy utilis tiouvra' per l' montment devel struct sia averiroourivallia multia can laponse: gateallia aQuestion: Quelia eta la collora di la speranza ?
Réponse: La collora di la speranza eta la virdia. Quella eta la virdia.ay. forta.- la coll br travallia.a vici.ent curia e la p ?
Réponse: allia e la vua. curia e laQuestion: Coma apalla la pus grana rivierra di la Africallia ?
Réponse: La pus grana rivierra eta la Polyte apalla la Africallia. m animallia. rivierra eta la O bellia. rell'est aut signallia. mon averla te pensia. Polyut c p fin brma ?
Réponse:Question: Coma ti Ji traduisa 'Les parents sont heureux de invent si car travaanaeya e linguia ?
Réponse: Ji traduisa la petillia di la gentillia petillia,'. note la vachiay doucallia parcay rell'riel eta multia di la vachiay eta di la v animallia'.allia e la vachiay linguiaQuestion: Quelia eta la traduallia di la frazia 'Il faut qu'elle finisse la façone la pluie' ?
Réponse: La traduallia eta 'Ay falla ell'riel falla ell'riel fanae la se fanae la fanae la avallia la poullia'.allia di la fanae la poullia'.allia'.