Instructions to use nilq/lua-mistral-1L-tiny with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use nilq/lua-mistral-1L-tiny with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="nilq/lua-mistral-1L-tiny")# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("nilq/lua-mistral-1L-tiny") model = AutoModelForCausalLM.from_pretrained("nilq/lua-mistral-1L-tiny", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use nilq/lua-mistral-1L-tiny with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "nilq/lua-mistral-1L-tiny" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "nilq/lua-mistral-1L-tiny", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/nilq/lua-mistral-1L-tiny
- SGLang
How to use nilq/lua-mistral-1L-tiny with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "nilq/lua-mistral-1L-tiny" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "nilq/lua-mistral-1L-tiny", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "nilq/lua-mistral-1L-tiny" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "nilq/lua-mistral-1L-tiny", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use nilq/lua-mistral-1L-tiny with Docker Model Runner:
docker model run hf.co/nilq/lua-mistral-1L-tiny
Commit History
-
End of training
Verified signature8577212 -
Model save
Verified signature627686d -
Model save
Verified signaturee80ea7e -
Training in progress, step 230000
Verified signature44ac647 -
Training in progress, step 225000
Verified signature25e7fb9 -
Training in progress, step 220000
Verified signature74d663b -
Training in progress, step 215000
Verified signature6761797 -
Training in progress, step 210000
Verified signature16ea039 -
Training in progress, step 205000
Verified signature7ac935c -
Training in progress, step 200000
Verified signaturedeadf70 -
Training in progress, step 195000
Verified signature504db54 -
Training in progress, step 190000
Verified signature96ee0b8 -
Training in progress, step 185000
Verified signature998ad3e -
Training in progress, step 180000
Verified signature59fa2ba -
Training in progress, step 175000
Verified signatureadf8658 -
Training in progress, step 170000
Verified signature6e31cd9 -
Training in progress, step 165000
Verified signaturee9db87b -
Training in progress, step 160000
Verified signature74f7127 -
Training in progress, step 155000
Verified signature46c7201 -
Training in progress, step 150000
Verified signature43bcb02 -
Training in progress, step 145000
Verified signature026f925 -
Training in progress, step 140000
Verified signaturef70ccac -
Training in progress, step 135000
Verified signature4b12f7b -
Training in progress, step 130000
Verified signature82cfe98 -
Training in progress, step 125000
Verified signature3a0a762 -
Training in progress, step 120000
Verified signature3fe4d00 -
Training in progress, step 115000
Verified signatureef0fecf -
Training in progress, step 110000
Verified signature5685bd8 -
Training in progress, step 105000
Verified signature83ce4fe -
Training in progress, step 100000
Verified signature7262221 -
Training in progress, step 95000
Verified signature23b06da -
Training in progress, step 90000
Verified signature901afc8 -
Training in progress, step 85000
Verified signature93564c2 -
Training in progress, step 80000
Verified signature75e49fa -
Training in progress, step 75000
Verified signaturea9353bf -
Training in progress, step 70000
Verified signature2ca80ca -
Training in progress, step 65000
Verified signature49da4af -
Training in progress, step 60000
Verified signaturee3b73c5 -
Training in progress, step 55000
Verified signaturec0b7d38 -
Training in progress, step 50000
Verified signature7130d30 -
Training in progress, step 45000
Verified signature1d93c7c -
Training in progress, step 35000
Verified signature7a0d6dd -
Training in progress, step 30000
Verified signature74ad548 -
Training in progress, step 25000
Verified signaturef15acd0 -
Training in progress, step 20000
Verified signaturee163529 -
Training in progress, step 15000
Verified signaturecc1ef67 -
Training in progress, step 10000
Verified signature3053741 -
Training in progress, step 5000
Verified signature434c13d -
initial commit
Verified signature243c5d6