Instructions to use twinkapp/mobileai with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use twinkapp/mobileai with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf twinkapp/mobileai:Q4_K_M # Run inference directly in the terminal: llama cli -hf twinkapp/mobileai:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf twinkapp/mobileai:Q4_K_M # Run inference directly in the terminal: llama cli -hf twinkapp/mobileai:Q4_K_M
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-app # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama serve -hf twinkapp/mobileai:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama cli -hf twinkapp/mobileai:Q4_K_M
Use Docker
docker model run hf.co/twinkapp/mobileai:Q4_K_M
- Llama new
- LM Studio
- Jan
- Ollama
How to use twinkapp/mobileai with Ollama:
ollama run hf.co/twinkapp/mobileai:Q4_K_M
- Unsloth Desktop
- Docker Model Runner
How to use twinkapp/mobileai with Docker Model Runner:
docker model run hf.co/twinkapp/mobileai:Q4_K_M
- Lemonade
How to use twinkapp/mobileai with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull twinkapp/mobileai:Q4_K_M
Run and chat with the model
lemonade run user.mobileai-Q4_K_M
List all available models
lemonade list
- Atomic Chat
Delete Qwen/DeepSeek-R1-Distill-Qwen-1.5B=bartowski
Browse files- Qwen/DeepSeek-R1-Distill-Qwen-1.5B=bartowski/DeepSeek-R1-Distill-Qwen-1.5B-IQ4_NL.gguf +0 -3
- Qwen/DeepSeek-R1-Distill-Qwen-1.5B=bartowski/DeepSeek-R1-Distill-Qwen-1.5B-IQ4_XS.gguf +0 -3
- Qwen/DeepSeek-R1-Distill-Qwen-1.5B=bartowski/DeepSeek-R1-Distill-Qwen-1.5B-Q4_K_L.gguf +0 -3
- Qwen/DeepSeek-R1-Distill-Qwen-1.5B=bartowski/DeepSeek-R1-Distill-Qwen-1.5B-Q4_K_M.gguf +0 -3
- Qwen/DeepSeek-R1-Distill-Qwen-1.5B=bartowski/DeepSeek-R1-Distill-Qwen-1.5B-Q4_K_S.gguf +0 -3
- Qwen/DeepSeek-R1-Distill-Qwen-1.5B=bartowski/DeepSeek-R1-Distill-Qwen-1.5B-Q5_K_L.gguf +0 -3
- Qwen/DeepSeek-R1-Distill-Qwen-1.5B=bartowski/DeepSeek-R1-Distill-Qwen-1.5B-Q5_K_M.gguf +0 -3
- Qwen/DeepSeek-R1-Distill-Qwen-1.5B=bartowski/DeepSeek-R1-Distill-Qwen-1.5B-Q5_K_S.gguf +0 -3
- Qwen/DeepSeek-R1-Distill-Qwen-1.5B=bartowski/DeepSeek-R1-Distill-Qwen-1.5B-Q6_K.gguf +0 -3
- Qwen/DeepSeek-R1-Distill-Qwen-1.5B=bartowski/DeepSeek-R1-Distill-Qwen-1.5B-Q6_K_L.gguf +0 -3
- Qwen/DeepSeek-R1-Distill-Qwen-1.5B=bartowski/DeepSeek-R1-Distill-Qwen-1.5B-Q8_0.gguf +0 -3
Qwen/DeepSeek-R1-Distill-Qwen-1.5B=bartowski/DeepSeek-R1-Distill-Qwen-1.5B-IQ4_NL.gguf
DELETED
|
@@ -1,3 +0,0 @@
|
|
| 1 |
-
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:72731d0d2d0ddb3fd71030ec85b5395b027b5d7e77e18489c40b2dfa7c85cefa
|
| 3 |
-
size 1067603552
|
|
|
|
|
|
|
|
|
|
|
|
Qwen/DeepSeek-R1-Distill-Qwen-1.5B=bartowski/DeepSeek-R1-Distill-Qwen-1.5B-IQ4_XS.gguf
DELETED
|
@@ -1,3 +0,0 @@
|
|
| 1 |
-
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:1e1fd42bcb3558dcc1cbdd2909a19cedb4f92fb4d64f1af0e4084dbd512c8bb4
|
| 3 |
-
size 1019711072
|
|
|
|
|
|
|
|
|
|
|
|
Qwen/DeepSeek-R1-Distill-Qwen-1.5B=bartowski/DeepSeek-R1-Distill-Qwen-1.5B-Q4_K_L.gguf
DELETED
|
@@ -1,3 +0,0 @@
|
|
| 1 |
-
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:0b213e7c9fc9b99542861084ceb6c7976da8e11ecfe6a2842cd63d81e1a8aaf5
|
| 3 |
-
size 1290527840
|
|
|
|
|
|
|
|
|
|
|
|
Qwen/DeepSeek-R1-Distill-Qwen-1.5B=bartowski/DeepSeek-R1-Distill-Qwen-1.5B-Q4_K_M.gguf
DELETED
|
@@ -1,3 +0,0 @@
|
|
| 1 |
-
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:df94353d7118c6330c7fbf372356d69c87246ebb13588d25071cc25600bbf47b
|
| 3 |
-
size 1117320800
|
|
|
|
|
|
|
|
|
|
|
|
Qwen/DeepSeek-R1-Distill-Qwen-1.5B=bartowski/DeepSeek-R1-Distill-Qwen-1.5B-Q4_K_S.gguf
DELETED
|
@@ -1,3 +0,0 @@
|
|
| 1 |
-
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:83e94135fe4fe15974cd7ecefa89bc2862018655147a209e33c8d190509e75e5
|
| 3 |
-
size 1071584864
|
|
|
|
|
|
|
|
|
|
|
|
Qwen/DeepSeek-R1-Distill-Qwen-1.5B=bartowski/DeepSeek-R1-Distill-Qwen-1.5B-Q5_K_L.gguf
DELETED
|
@@ -1,3 +0,0 @@
|
|
| 1 |
-
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:9e43e7437e0fddb17546fdccdbbdcc706f03f8c980a4c47587307f373ecfd0e7
|
| 3 |
-
size 1429529696
|
|
|
|
|
|
|
|
|
|
|
|
Qwen/DeepSeek-R1-Distill-Qwen-1.5B=bartowski/DeepSeek-R1-Distill-Qwen-1.5B-Q5_K_M.gguf
DELETED
|
@@ -1,3 +0,0 @@
|
|
| 1 |
-
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:a284eeb9eadbabc686da9926bccee2604650ffd290700f656050248f4c073c4d
|
| 3 |
-
size 1285494368
|
|
|
|
|
|
|
|
|
|
|
|
Qwen/DeepSeek-R1-Distill-Qwen-1.5B=bartowski/DeepSeek-R1-Distill-Qwen-1.5B-Q5_K_S.gguf
DELETED
|
@@ -1,3 +0,0 @@
|
|
| 1 |
-
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:432e7335f8f4394779279354f271b9bc61cc15afffa446d50cfe78304f2e9d10
|
| 3 |
-
size 1259173472
|
|
|
|
|
|
|
|
|
|
|
|
Qwen/DeepSeek-R1-Distill-Qwen-1.5B=bartowski/DeepSeek-R1-Distill-Qwen-1.5B-Q6_K.gguf
DELETED
|
@@ -1,3 +0,0 @@
|
|
| 1 |
-
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:cf9097573f8e3bcb6129e108876503db26f9ed025c88b522bdfad58fb0fee7b7
|
| 3 |
-
size 1464178784
|
|
|
|
|
|
|
|
|
|
|
|
Qwen/DeepSeek-R1-Distill-Qwen-1.5B=bartowski/DeepSeek-R1-Distill-Qwen-1.5B-Q6_K_L.gguf
DELETED
|
@@ -1,3 +0,0 @@
|
|
| 1 |
-
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:54b6253f8dffc1e8e3099f0e5268101ed90a1ac4c1bd960a4f6d62d5d4d367f0
|
| 3 |
-
size 1577219168
|
|
|
|
|
|
|
|
|
|
|
|
Qwen/DeepSeek-R1-Distill-Qwen-1.5B=bartowski/DeepSeek-R1-Distill-Qwen-1.5B-Q8_0.gguf
DELETED
|
@@ -1,3 +0,0 @@
|
|
| 1 |
-
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:1aa6fc931a2b48b45cbf1c410e08fd5253fde08f9118922e63a59c049cdad33c
|
| 3 |
-
size 1894532192
|
|
|
|
|
|
|
|
|
|
|
|