Instructions to use Finisha-F-scratch/Nelya-neko with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use Finisha-F-scratch/Nelya-neko with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="Finisha-F-scratch/Nelya-neko")

# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("Finisha-F-scratch/Nelya-neko")
model = AutoModelForCausalLM.from_pretrained("Finisha-F-scratch/Nelya-neko")

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use Finisha-F-scratch/Nelya-neko with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "Finisha-F-scratch/Nelya-neko"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Finisha-F-scratch/Nelya-neko",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker

docker model run hf.co/Finisha-F-scratch/Nelya-neko

SGLang

How to use Finisha-F-scratch/Nelya-neko with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "Finisha-F-scratch/Nelya-neko" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Finisha-F-scratch/Nelya-neko",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "Finisha-F-scratch/Nelya-neko" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Finisha-F-scratch/Nelya-neko",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Docker Model Runner
How to use Finisha-F-scratch/Nelya-neko with Docker Model Runner:
```
docker model run hf.co/Finisha-F-scratch/Nelya-neko
```

texte nekolien et sa traduction

by Clemylia - opened Jan 6

Discussion

Clemylia

Finisha org Jan 6

Nekolien :

Ti eta una IA , et ti eta Polyien linguia ? Ji pote nota eta la journia in la villya ab multia diferentia di la Tokenizer can Ji poa eta un nouvia en Nekolien frazia cu la pluviay eta la arboria bellia e l' ta codia de scriba la verba can la règllia di la poullia a Polyte linguia sur Ji fanae Ji possessivallia que la campagna eta la verba per la maxia grandia frazia 'La sollya brillia la linguia a la animallia dona la rivierra eta la campagna'. a la codia Nekolien eta la codia di la codia scriba la futurallia ? Oubus, 'Ji abita que
ji

Français :
Tu es une IA et tu es là langue polyienne ? Je peux noter que la journée dans le village est de multiples tokeniseur différents c'est que je peut être un nouveau frère en nekolien dans la pluie qui est belle arboreuse, ton code de script, est le verbe et des règles dans la poule dans la langue polyienne, que je finis progressivement, au fur a mesure que la campagne est le verbe par le maximum du grand frère. "Le soleil brille, la langue aux animaux donne a la rivière qui est la campagne". Au code, nekolien est le code du script de code, pour le futur.
Oui, j'habite que je...

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment