Instructions to use Maxixa/lora with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- llama-cpp-python
How to use Maxixa/lora with llama-cpp-python:
# !pip install llama-cpp-python from llama_cpp import Llama llm = Llama.from_pretrained( repo_id="Maxixa/lora", filename="gguf/speechless-sparsetral-mistral-16x7b-moe.Q5_K_M.gguf", )
output = llm( "Once upon a time,", max_tokens=512, echo=True ) print(output)
- Notebooks
- Google Colab
- Kaggle
- Local Apps
- llama.cpp
How to use Maxixa/lora with llama.cpp:
Install from brew
brew install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama-server -hf Maxixa/lora:Q5_K_M # Run inference directly in the terminal: llama-cli -hf Maxixa/lora:Q5_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama-server -hf Maxixa/lora:Q5_K_M # Run inference directly in the terminal: llama-cli -hf Maxixa/lora:Q5_K_M
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf Maxixa/lora:Q5_K_M # Run inference directly in the terminal: ./llama-cli -hf Maxixa/lora:Q5_K_M
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf Maxixa/lora:Q5_K_M # Run inference directly in the terminal: ./build/bin/llama-cli -hf Maxixa/lora:Q5_K_M
Use Docker
docker model run hf.co/Maxixa/lora:Q5_K_M
- LM Studio
- Jan
- Ollama
How to use Maxixa/lora with Ollama:
ollama run hf.co/Maxixa/lora:Q5_K_M
- Unsloth Studio new
How to use Maxixa/lora with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for Maxixa/lora to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for Maxixa/lora to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for Maxixa/lora to start chatting
- Docker Model Runner
How to use Maxixa/lora with Docker Model Runner:
docker model run hf.co/Maxixa/lora:Q5_K_M
- Lemonade
How to use Maxixa/lora with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull Maxixa/lora:Q5_K_M
Run and chat with the model
lemonade run user.lora-Q5_K_M
List all available models
lemonade list
Upload minidress-ns with huggingface_hub
Browse files- minidress-ns/minidress-ns-000001.pt +3 -0
- minidress-ns/minidress-ns-000002.pt +3 -0
- minidress-ns/minidress-ns-000003.pt +3 -0
- minidress-ns/minidress-ns-000004.pt +3 -0
- minidress-ns/minidress-ns-000005.pt +3 -0
- minidress-ns/minidress-ns-000006.pt +3 -0
- minidress-ns/minidress-ns-000007.pt +3 -0
- minidress-ns/minidress-ns-000008.pt +3 -0
- minidress-ns/minidress-ns-000009.pt +3 -0
- minidress-ns/minidress-ns-000010.pt +3 -0
- minidress-ns/minidress-ns-000011.pt +3 -0
- minidress-ns/minidress-ns-000012.pt +3 -0
- minidress-ns/minidress-ns-000013.pt +3 -0
- minidress-ns/minidress-ns-000014.pt +3 -0
- minidress-ns/minidress-ns.pt +3 -0
minidress-ns/minidress-ns-000001.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:04627f1c55462235246ae6be81c2963c5409a01c77b392c70182fa8896e7927d
|
| 3 |
+
size 151349001
|
minidress-ns/minidress-ns-000002.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:0b260f38546322d5275cd1568674c668ef5c229c4132fb4ae83f2912facbe533
|
| 3 |
+
size 151349001
|
minidress-ns/minidress-ns-000003.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:995aa2998102813ea650cf733e6ab1b1bbcb0e04092e3c21bfc04000532ddf93
|
| 3 |
+
size 151349001
|
minidress-ns/minidress-ns-000004.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:933225a592adc082b2a72c8faac82be31e25e9a9eb49939365e83118d25def0a
|
| 3 |
+
size 151349001
|
minidress-ns/minidress-ns-000005.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:5839388642c6b87d82ab7ea146957dff19f73557a6e7ad3c77cc47ed1369d728
|
| 3 |
+
size 151349001
|
minidress-ns/minidress-ns-000006.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:071a2a7ce025e5141c31ec8c2ec028ae8b0fead23043afc8d16b429879459d56
|
| 3 |
+
size 151349001
|
minidress-ns/minidress-ns-000007.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:ec0ee6cd107c6d8e4f241e9ee93642cf977a9a21ac6d5dd5265efbaed0abc2d5
|
| 3 |
+
size 151349001
|
minidress-ns/minidress-ns-000008.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:f6159c0749ab42a31c7d4dcc4e4c36b132044975e8e93c4d5369e00c55ade778
|
| 3 |
+
size 151349001
|
minidress-ns/minidress-ns-000009.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:d9052c37c065b9277076254d32122a8f712b0d80facda95a24951def0f379aec
|
| 3 |
+
size 151349001
|
minidress-ns/minidress-ns-000010.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:aa48e1381b7b2f16115d5121876bec6119242d5112801b30c279f72fe706c191
|
| 3 |
+
size 151349001
|
minidress-ns/minidress-ns-000011.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:364f02844de311105222272d091c5e1c5b6dc6eee16bd3a59b4c2ac09d5717f4
|
| 3 |
+
size 151349001
|
minidress-ns/minidress-ns-000012.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:fe52a7a270dbfa1e1a9ac2b86609cb1df4b7b267352af8740be11cf97f2db464
|
| 3 |
+
size 151349001
|
minidress-ns/minidress-ns-000013.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:ec277794a9f01c788b95694d274e22898bef7e35942536fd8fff61e66cb61ca5
|
| 3 |
+
size 151349001
|
minidress-ns/minidress-ns-000014.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:bdc33057355cb19862fa768d2607961ddfbd3e667c092bc8c31d8519cf1d4c52
|
| 3 |
+
size 151349001
|
minidress-ns/minidress-ns.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:d10046a4e6e5562ded6419da01cf36e5d17f5b0382388473768eb77bc637dd6e
|
| 3 |
+
size 151343443
|