Instructions to use hongyongjiang/python-reference-models with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- llama-cpp-python
How to use hongyongjiang/python-reference-models with llama-cpp-python:
# !pip install llama-cpp-python from llama_cpp import Llama llm = Llama.from_pretrained( repo_id="hongyongjiang/python-reference-models", filename="gemma-3-4b-it_bin/gemma-3-4b-it-f16.gguf", )
llm.create_chat_completion( messages = "No input example has been defined for this model task." )
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use hongyongjiang/python-reference-models with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf hongyongjiang/python-reference-models:F16 # Run inference directly in the terminal: llama cli -hf hongyongjiang/python-reference-models:F16
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf hongyongjiang/python-reference-models:F16 # Run inference directly in the terminal: llama cli -hf hongyongjiang/python-reference-models:F16
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf hongyongjiang/python-reference-models:F16 # Run inference directly in the terminal: ./llama-cli -hf hongyongjiang/python-reference-models:F16
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf hongyongjiang/python-reference-models:F16 # Run inference directly in the terminal: ./build/bin/llama-cli -hf hongyongjiang/python-reference-models:F16
Use Docker
docker model run hf.co/hongyongjiang/python-reference-models:F16
- LM Studio
- Jan
- Ollama
How to use hongyongjiang/python-reference-models with Ollama:
ollama run hf.co/hongyongjiang/python-reference-models:F16
- Unsloth Studio
How to use hongyongjiang/python-reference-models with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for hongyongjiang/python-reference-models to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for hongyongjiang/python-reference-models to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for hongyongjiang/python-reference-models to start chatting
- Atomic Chat new
- Docker Model Runner
How to use hongyongjiang/python-reference-models with Docker Model Runner:
docker model run hf.co/hongyongjiang/python-reference-models:F16
- Lemonade
How to use hongyongjiang/python-reference-models with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull hongyongjiang/python-reference-models:F16
Run and chat with the model
lemonade run user.python-reference-models-F16
List all available models
lemonade list
Upload folder using huggingface_hub
Browse files- qwen2.5-3b_bin/layer_0.bin +3 -0
- qwen2.5-3b_bin/layer_1.bin +3 -0
- qwen2.5-3b_bin/layer_10.bin +3 -0
- qwen2.5-3b_bin/layer_11.bin +3 -0
- qwen2.5-3b_bin/layer_12.bin +3 -0
- qwen2.5-3b_bin/layer_13.bin +3 -0
- qwen2.5-3b_bin/layer_14.bin +3 -0
- qwen2.5-3b_bin/layer_15.bin +3 -0
- qwen2.5-3b_bin/layer_16.bin +3 -0
- qwen2.5-3b_bin/layer_17.bin +3 -0
- qwen2.5-3b_bin/layer_18.bin +3 -0
- qwen2.5-3b_bin/layer_19.bin +3 -0
- qwen2.5-3b_bin/layer_2.bin +3 -0
- qwen2.5-3b_bin/layer_20.bin +3 -0
- qwen2.5-3b_bin/layer_21.bin +3 -0
- qwen2.5-3b_bin/layer_22.bin +3 -0
- qwen2.5-3b_bin/layer_23.bin +3 -0
- qwen2.5-3b_bin/layer_24.bin +3 -0
- qwen2.5-3b_bin/layer_25.bin +3 -0
- qwen2.5-3b_bin/layer_26.bin +3 -0
- qwen2.5-3b_bin/layer_27.bin +3 -0
- qwen2.5-3b_bin/layer_28.bin +3 -0
- qwen2.5-3b_bin/layer_29.bin +3 -0
- qwen2.5-3b_bin/layer_3.bin +3 -0
- qwen2.5-3b_bin/layer_30.bin +3 -0
- qwen2.5-3b_bin/layer_31.bin +3 -0
- qwen2.5-3b_bin/layer_32.bin +3 -0
- qwen2.5-3b_bin/layer_33.bin +3 -0
- qwen2.5-3b_bin/layer_34.bin +3 -0
- qwen2.5-3b_bin/layer_35.bin +3 -0
- qwen2.5-3b_bin/layer_4.bin +3 -0
- qwen2.5-3b_bin/layer_5.bin +3 -0
- qwen2.5-3b_bin/layer_6.bin +3 -0
- qwen2.5-3b_bin/layer_7.bin +3 -0
- qwen2.5-3b_bin/layer_8.bin +3 -0
- qwen2.5-3b_bin/layer_9.bin +3 -0
qwen2.5-3b_bin/layer_0.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:28ac61571d4b8eb4d8300805c637b848507100b52d83da6888d92acd5bd35641
|
| 3 |
+
size 77256192
|
qwen2.5-3b_bin/layer_1.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:2ba69948baf8759251945342546454c6a995e93c6bde68ef51a7ecd718fe46d5
|
| 3 |
+
size 77256192
|
qwen2.5-3b_bin/layer_10.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:4c4469c875ee0d9320e1cfc423185b3a7e858e4930d2f9bb52b2f3b43bf226e1
|
| 3 |
+
size 77256192
|
qwen2.5-3b_bin/layer_11.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:ce6881e3fe8c4f315c409803feb4d2d8326a92e02175df5160e7dcb2879d957e
|
| 3 |
+
size 77256192
|
qwen2.5-3b_bin/layer_12.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:3f9c0eb61eae94eef78505c650b8a7f04eed97cb7f0eb9b26079a1f3c975f002
|
| 3 |
+
size 77256192
|
qwen2.5-3b_bin/layer_13.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:476363017ce35fe3e12bd44da66a9f2ea26b7b3893b47d313ec9321a43316449
|
| 3 |
+
size 77256192
|
qwen2.5-3b_bin/layer_14.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:dcf707379c45d1af8e2fcb8cb724aebc792c828e29f1e66c0b90b0ee44828964
|
| 3 |
+
size 77256192
|
qwen2.5-3b_bin/layer_15.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:9b949b734534cd639252d9918e24a262172421d9a7e7bc389e06fc116aeed30d
|
| 3 |
+
size 77256192
|
qwen2.5-3b_bin/layer_16.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:ceeece24221a02d98c3b4bdf5c3c89899f43dfcca53830bee0f026d18679801e
|
| 3 |
+
size 77256192
|
qwen2.5-3b_bin/layer_17.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:df0a88d70de768f058e6573454012430a5fa39b11efca036d5dbeb5d35d3533c
|
| 3 |
+
size 77256192
|
qwen2.5-3b_bin/layer_18.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:d89f07c3ec2482561661d1000ae8fbc8365a2d7f92300dcd6ede1b6bd1637112
|
| 3 |
+
size 77256192
|
qwen2.5-3b_bin/layer_19.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:5550f435e6071b2c24b6c76b6a62811ac00d2f7a11bcf0686e0628e3f08816e9
|
| 3 |
+
size 77256192
|
qwen2.5-3b_bin/layer_2.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:92a14966fb374436cf6e1f1a388c8e616c96b1efd44d1c5e50e1892d90a7c734
|
| 3 |
+
size 77256192
|
qwen2.5-3b_bin/layer_20.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:5a86ca50c1c8ecfce01a9d58df76462032b725135b5f86f74623b1fca8642819
|
| 3 |
+
size 77256192
|
qwen2.5-3b_bin/layer_21.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:b692637c4c5203aee993dedd25e89cf63b7678b8568f06c840cfc14519adf72f
|
| 3 |
+
size 77256192
|
qwen2.5-3b_bin/layer_22.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:57bfaba89b3a6f9f6045b54c9425cc6f53e3da14b90fe0a81aaad0a7398b0b70
|
| 3 |
+
size 77256192
|
qwen2.5-3b_bin/layer_23.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:52e43f1dcf73bbf248cb142a8d8fc8893fbf09e735077b02ccd546b69065f76e
|
| 3 |
+
size 77256192
|
qwen2.5-3b_bin/layer_24.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:9a67cb601ec05ffccad794feab969a6f2de3400585606f1770b9f2cb6ff26372
|
| 3 |
+
size 77256192
|
qwen2.5-3b_bin/layer_25.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:4afe9cbf65425b1ce86841c3d4b60b2187e356582af5e3f4681f47804350649f
|
| 3 |
+
size 77256192
|
qwen2.5-3b_bin/layer_26.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:25526b1b402e77aaee90af82f087bf0370dbc3145d7e2ea7c775d5eca7d48ec8
|
| 3 |
+
size 77256192
|
qwen2.5-3b_bin/layer_27.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:8f17f28ab9d76ed0b50b36665069b9476d9bb91c95efe1167cbc82dbf83e49f6
|
| 3 |
+
size 77256192
|
qwen2.5-3b_bin/layer_28.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:72f9b2208dcd24452bbeb6a98bca8af81030cd48bcd14b5337f6c6ffa39efc81
|
| 3 |
+
size 77256192
|
qwen2.5-3b_bin/layer_29.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:671e1853e6ac6e726d9f5f060d29a41ce93fdbbdc466a7f938905168c9bd741d
|
| 3 |
+
size 77256192
|
qwen2.5-3b_bin/layer_3.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:89e4a544560fc7c52237f373c6774b70d0df9a0fa7f59ebd75beb2db6ccbbb04
|
| 3 |
+
size 77256192
|
qwen2.5-3b_bin/layer_30.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:7453da6623c7306bfc0973549a9270188ba9b3639e9bbe593a471fa1bfd95475
|
| 3 |
+
size 77256192
|
qwen2.5-3b_bin/layer_31.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:accf456ebfbfd28773f5cc627b95dcd39b576f7139c618affb654c610e0e33f7
|
| 3 |
+
size 77256192
|
qwen2.5-3b_bin/layer_32.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:19847669bf78797de6e3c1756e184288eb136d70638c695a6e06cf5279d68100
|
| 3 |
+
size 77256192
|
qwen2.5-3b_bin/layer_33.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:cc33c0c1e0807155eda511451c23825f51f78314255f803262925682709f74bc
|
| 3 |
+
size 77256192
|
qwen2.5-3b_bin/layer_34.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:a15804050c401e58c01b85eb4d7c8c2dd2a8f59863404e7e3f4b4ca85bb924ae
|
| 3 |
+
size 77256192
|
qwen2.5-3b_bin/layer_35.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:3f612c2d279e9604ad27e6cdbce0c8cd28f47980a4e74ec72228ec113495a1ca
|
| 3 |
+
size 77256192
|
qwen2.5-3b_bin/layer_4.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:3b8f45805bcf9ec1c194d4941ac30cf52ccba4c1e8140b53c794a5900b23c8da
|
| 3 |
+
size 77256192
|
qwen2.5-3b_bin/layer_5.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:dbda8ffcac1c6433e12f524b0c05642390ee700349fa1a7eefb4425dc59a3fae
|
| 3 |
+
size 77256192
|
qwen2.5-3b_bin/layer_6.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:08e87463abfaf29fa4d20a742deb0ddd55531fc062a4dcecc14bae8c93b735b9
|
| 3 |
+
size 77256192
|
qwen2.5-3b_bin/layer_7.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:84a25bd2a0b1fcca8f25590eedcbf100a01bc43e7576e86762f8a55082497b69
|
| 3 |
+
size 77256192
|
qwen2.5-3b_bin/layer_8.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:77b5f920063c1163495b79492f72bf650a85f259f687b9294e8d7a898fa0e1fd
|
| 3 |
+
size 77256192
|
qwen2.5-3b_bin/layer_9.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:a61a3930376763116b05ac17e6200cdba6c21a59e0174d6471e5e135d7ac7875
|
| 3 |
+
size 77256192
|