Instructions to use twinkapp/mobileai with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use twinkapp/mobileai with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf twinkapp/mobileai:Q4_K_M # Run inference directly in the terminal: llama cli -hf twinkapp/mobileai:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf twinkapp/mobileai:Q4_K_M # Run inference directly in the terminal: llama cli -hf twinkapp/mobileai:Q4_K_M
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-app # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama serve -hf twinkapp/mobileai:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama cli -hf twinkapp/mobileai:Q4_K_M
Use Docker
docker model run hf.co/twinkapp/mobileai:Q4_K_M
- Llama new
- LM Studio
- Jan
- Ollama
How to use twinkapp/mobileai with Ollama:
ollama run hf.co/twinkapp/mobileai:Q4_K_M
- Unsloth Desktop
- Docker Model Runner
How to use twinkapp/mobileai with Docker Model Runner:
docker model run hf.co/twinkapp/mobileai:Q4_K_M
- Lemonade
How to use twinkapp/mobileai with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull twinkapp/mobileai:Q4_K_M
Run and chat with the model
lemonade run user.mobileai-Q4_K_M
List all available models
lemonade list
- Atomic Chat
Delete Qwen/Dolphin3.0-Qwen2.5-3b=bartowski
Browse files- Qwen/Dolphin3.0-Qwen2.5-3b=bartowski/Dolphin3.0-Qwen2.5-3b-IQ4_NL.gguf +0 -3
- Qwen/Dolphin3.0-Qwen2.5-3b=bartowski/Dolphin3.0-Qwen2.5-3b-IQ4_XS.gguf +0 -3
- Qwen/Dolphin3.0-Qwen2.5-3b=bartowski/Dolphin3.0-Qwen2.5-3b-Q4_K_L.gguf +0 -3
- Qwen/Dolphin3.0-Qwen2.5-3b=bartowski/Dolphin3.0-Qwen2.5-3b-Q4_K_M.gguf +0 -3
- Qwen/Dolphin3.0-Qwen2.5-3b=bartowski/Dolphin3.0-Qwen2.5-3b-Q4_K_S.gguf +0 -3
- Qwen/Dolphin3.0-Qwen2.5-3b=bartowski/Dolphin3.0-Qwen2.5-3b-Q5_K_L.gguf +0 -3
- Qwen/Dolphin3.0-Qwen2.5-3b=bartowski/Dolphin3.0-Qwen2.5-3b-Q5_K_M.gguf +0 -3
- Qwen/Dolphin3.0-Qwen2.5-3b=bartowski/Dolphin3.0-Qwen2.5-3b-Q5_K_S.gguf +0 -3
- Qwen/Dolphin3.0-Qwen2.5-3b=bartowski/Dolphin3.0-Qwen2.5-3b-Q6_K.gguf +0 -3
- Qwen/Dolphin3.0-Qwen2.5-3b=bartowski/Dolphin3.0-Qwen2.5-3b-Q6_K_L.gguf +0 -3
- Qwen/Dolphin3.0-Qwen2.5-3b=bartowski/Dolphin3.0-Qwen2.5-3b-Q8_0.gguf +0 -3
Qwen/Dolphin3.0-Qwen2.5-3b=bartowski/Dolphin3.0-Qwen2.5-3b-IQ4_NL.gguf
DELETED
|
@@ -1,3 +0,0 @@
|
|
| 1 |
-
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:3093c8a913951e5cad5013e0bd44fda44e6d88ad60a4c68af1f369188b1e764c
|
| 3 |
-
size 1825212384
|
|
|
|
|
|
|
|
|
|
|
|
Qwen/Dolphin3.0-Qwen2.5-3b=bartowski/Dolphin3.0-Qwen2.5-3b-IQ4_XS.gguf
DELETED
|
@@ -1,3 +0,0 @@
|
|
| 1 |
-
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:6a71a45000a10e618364d24e7adce0a0a7475f842f93d25d6d6b4a859b7b2676
|
| 3 |
-
size 1739098080
|
|
|
|
|
|
|
|
|
|
|
|
Qwen/Dolphin3.0-Qwen2.5-3b=bartowski/Dolphin3.0-Qwen2.5-3b-Q4_K_L.gguf
DELETED
|
@@ -1,3 +0,0 @@
|
|
| 1 |
-
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:c045652ee7b2274b8f1c579953bf2c79e933485bc384a40f0fe5b6b553747dcc
|
| 3 |
-
size 2005266400
|
|
|
|
|
|
|
|
|
|
|
|
Qwen/Dolphin3.0-Qwen2.5-3b=bartowski/Dolphin3.0-Qwen2.5-3b-Q4_K_M.gguf
DELETED
|
@@ -1,3 +0,0 @@
|
|
| 1 |
-
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:0cb1908c5f444e1dc2c5b5619d62ac4957a22ad39cd42f2d0b48e2d8b1c358ab
|
| 3 |
-
size 1929906144
|
|
|
|
|
|
|
|
|
|
|
|
Qwen/Dolphin3.0-Qwen2.5-3b=bartowski/Dolphin3.0-Qwen2.5-3b-Q4_K_S.gguf
DELETED
|
@@ -1,3 +0,0 @@
|
|
| 1 |
-
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:08e78b9d85dad5d7964f63b01d69c8ce822081aa1cc74cceee69ea5d92be6554
|
| 3 |
-
size 1834387424
|
|
|
|
|
|
|
|
|
|
|
|
Qwen/Dolphin3.0-Qwen2.5-3b=bartowski/Dolphin3.0-Qwen2.5-3b-Q5_K_L.gguf
DELETED
|
@@ -1,3 +0,0 @@
|
|
| 1 |
-
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:5e456a23fe2b0253235e99ccd08d3856a8c7577443226e6db7d8a005fcd9a565
|
| 3 |
-
size 2300178400
|
|
|
|
|
|
|
|
|
|
|
|
Qwen/Dolphin3.0-Qwen2.5-3b=bartowski/Dolphin3.0-Qwen2.5-3b-Q5_K_M.gguf
DELETED
|
@@ -1,3 +0,0 @@
|
|
| 1 |
-
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:96076ef91e06e59bf52a45d9541fec72067265b4e2b0d33ba8485c80ce8ee39e
|
| 3 |
-
size 2224818144
|
|
|
|
|
|
|
|
|
|
|
|
Qwen/Dolphin3.0-Qwen2.5-3b=bartowski/Dolphin3.0-Qwen2.5-3b-Q5_K_S.gguf
DELETED
|
@@ -1,3 +0,0 @@
|
|
| 1 |
-
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:5bba73416f7e8e59a8cb88d7516904cc03e0cbeca34acf3ffa10e5543f8e90db
|
| 3 |
-
size 2169669600
|
|
|
|
|
|
|
|
|
|
|
|
Qwen/Dolphin3.0-Qwen2.5-3b=bartowski/Dolphin3.0-Qwen2.5-3b-Q6_K.gguf
DELETED
|
@@ -1,3 +0,0 @@
|
|
| 1 |
-
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:52e5a78637a64cd84f7b09dc66ba9a8b02e7f47755ad0d932b34c45d5ea70567
|
| 3 |
-
size 2538162144
|
|
|
|
|
|
|
|
|
|
|
|
Qwen/Dolphin3.0-Qwen2.5-3b=bartowski/Dolphin3.0-Qwen2.5-3b-Q6_K_L.gguf
DELETED
|
@@ -1,3 +0,0 @@
|
|
| 1 |
-
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:39506626883850f69f38314e116af1fc7c64ee2f6bab26b9c10831521da3eeae
|
| 3 |
-
size 2613522400
|
|
|
|
|
|
|
|
|
|
|
|
Qwen/Dolphin3.0-Qwen2.5-3b=bartowski/Dolphin3.0-Qwen2.5-3b-Q8_0.gguf
DELETED
|
@@ -1,3 +0,0 @@
|
|
| 1 |
-
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:9121d2cdbf65ef3c22a6c70c6d740af70e87d2381670e42701d55b290e7357eb
|
| 3 |
-
size 3285479392
|
|
|
|
|
|
|
|
|
|
|
|