Instructions to use twinkapp/mobileai with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use twinkapp/mobileai with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf twinkapp/mobileai:Q4_K_M # Run inference directly in the terminal: llama cli -hf twinkapp/mobileai:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf twinkapp/mobileai:Q4_K_M # Run inference directly in the terminal: llama cli -hf twinkapp/mobileai:Q4_K_M
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf twinkapp/mobileai:Q4_K_M # Run inference directly in the terminal: ./llama-cli -hf twinkapp/mobileai:Q4_K_M
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf twinkapp/mobileai:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama-cli -hf twinkapp/mobileai:Q4_K_M
Use Docker
docker model run hf.co/twinkapp/mobileai:Q4_K_M
- Llama new
- LM Studio
- Jan
- Ollama
How to use twinkapp/mobileai with Ollama:
ollama run hf.co/twinkapp/mobileai:Q4_K_M
- Unsloth Desktop
- Docker Model Runner
How to use twinkapp/mobileai with Docker Model Runner:
docker model run hf.co/twinkapp/mobileai:Q4_K_M
- Lemonade
How to use twinkapp/mobileai with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull twinkapp/mobileai:Q4_K_M
Run and chat with the model
lemonade run user.mobileai-Q4_K_M
List all available models
lemonade list
- Atomic Chat
Upload 7 files
Browse files- Qwen/Dolphin3.0-Qwen2.5-3b-i1=mradermacher/Dolphin3.0-Qwen2.5-3b.i1-IQ4_NL.gguf +3 -0
- Qwen/Dolphin3.0-Qwen2.5-3b-i1=mradermacher/Dolphin3.0-Qwen2.5-3b.i1-IQ4_XS.gguf +3 -0
- Qwen/Dolphin3.0-Qwen2.5-3b-i1=mradermacher/Dolphin3.0-Qwen2.5-3b.i1-Q4_K_M.gguf +3 -0
- Qwen/Dolphin3.0-Qwen2.5-3b-i1=mradermacher/Dolphin3.0-Qwen2.5-3b.i1-Q4_K_S.gguf +3 -0
- Qwen/Dolphin3.0-Qwen2.5-3b-i1=mradermacher/Dolphin3.0-Qwen2.5-3b.i1-Q5_K_M.gguf +3 -0
- Qwen/Dolphin3.0-Qwen2.5-3b-i1=mradermacher/Dolphin3.0-Qwen2.5-3b.i1-Q5_K_S.gguf +3 -0
- Qwen/Dolphin3.0-Qwen2.5-3b-i1=mradermacher/Dolphin3.0-Qwen2.5-3b.i1-Q6_K.gguf +3 -0
Qwen/Dolphin3.0-Qwen2.5-3b-i1=mradermacher/Dolphin3.0-Qwen2.5-3b.i1-IQ4_NL.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:e6b7418683040547b30c3d529ab0918dd5c5756b750771438a13d5211a249563
|
| 3 |
+
size 1825212800
|
Qwen/Dolphin3.0-Qwen2.5-3b-i1=mradermacher/Dolphin3.0-Qwen2.5-3b.i1-IQ4_XS.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:d23242788741558a8b6699c9d1d5e3e2acf97d1a58c0d4e5c6f231edc3cbcd3e
|
| 3 |
+
size 1739098496
|
Qwen/Dolphin3.0-Qwen2.5-3b-i1=mradermacher/Dolphin3.0-Qwen2.5-3b.i1-Q4_K_M.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:44f282a3d13358c68517bf367b1892e76c31a2ec330ff44337721604daca0906
|
| 3 |
+
size 1929906560
|
Qwen/Dolphin3.0-Qwen2.5-3b-i1=mradermacher/Dolphin3.0-Qwen2.5-3b.i1-Q4_K_S.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:8107f09b4201bf1daf7bd353d1d9d08dbe47231b73c9b587648470b9b9b51d6f
|
| 3 |
+
size 1834387840
|
Qwen/Dolphin3.0-Qwen2.5-3b-i1=mradermacher/Dolphin3.0-Qwen2.5-3b.i1-Q5_K_M.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:0cabd7212eac204338f5d6a76a9b456fe2ff73d5da217ec47b2cdcee871ef44d
|
| 3 |
+
size 2224818560
|
Qwen/Dolphin3.0-Qwen2.5-3b-i1=mradermacher/Dolphin3.0-Qwen2.5-3b.i1-Q5_K_S.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:5032ff8efed1888ebff9a8e2dbea306430a402d6ee1cf26ad4280c461ef7b69c
|
| 3 |
+
size 2169670016
|
Qwen/Dolphin3.0-Qwen2.5-3b-i1=mradermacher/Dolphin3.0-Qwen2.5-3b.i1-Q6_K.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:966209b3bc8324ff5d1c8fc4e3d0c6939f9a12201a0011476c1cc7d05c1e7c7a
|
| 3 |
+
size 2538162560
|