llm image
Collection
17 items • Updated
Javed Alam PRO
Javedalam
AI & ML interests
Ai user, tester, and developer of open source ai based applications.
Recent Activity
updated a collection 2 days ago
llm image liked a model 2 days ago
jinaai/jina-ocr-v1 liked a Space 5 days ago
openbmb/MiniCPM5-2B-DemoOrganizations
updated a
collection 2 days ago
liked a
model 2 days ago
liked a
Space 5 days ago
liked a
model 6 days ago
liked a
model 9 days ago
replied to their post 9 days ago
https://huggingface.co/XHToken/Spark-X2.5-4B — Official Spark-X2.5 model page with architecture, capabilities, benchmark scores and deployment information.
https://huggingface.co/XHToken/Spark-X2.5-4B-GGUF — Quantized GGUF versions, including the approximately 2.6 GB Q4_K_M model used on both phones.
https://github.com/XHToken/llama.cpp — Developer’s compatible llama.cpp fork required to run the spark2_5 architecture.
https://artificialanalysis.ai/hardware-inference-stack/mobile-phones — Artificial Analysis benchmark comparing the intelligence, speed and memory requirements of small models running on phones.
posted an update 9 days ago
Post
76
Spark-X2.5 Running Locally on Two Android Phones
I compiled Spark-X2.5-4B Q4_K_M directly in Termux on a OnePlus 8 Pro and Samsung Galaxy S26 using the specialized XHToken llama.cpp fork.
This 2.6 GB model is attractive for private, offline phone AI because it supports reasoning, coding, translation, tool use and agentic workflows. Published scores include 90.7 on AIME 2026, 65.1 on BFCL-V4, 54.6 on MCP-Atlas and 14.2 on MCP-Mark.
The OnePlus CPU achieved 12 prompt and 4.6 generation tokens/s. It even solved a second-order differential equation, although Vulkan crashed—likely because of its old Adreno 650 driver.
The S26 CPU reached 37 prompt and 14 generation tokens/s. Vulkan on its Adreno 840 reached about 36 prompt and 20 generation tokens/s. Its 16K-context web server delivered 33 prompt and 15 generation tokens/s.
A capable reasoning and tool-oriented AI can now run privately and offline on a phone, without cloud inference or NPU execution.
I compiled Spark-X2.5-4B Q4_K_M directly in Termux on a OnePlus 8 Pro and Samsung Galaxy S26 using the specialized XHToken llama.cpp fork.
This 2.6 GB model is attractive for private, offline phone AI because it supports reasoning, coding, translation, tool use and agentic workflows. Published scores include 90.7 on AIME 2026, 65.1 on BFCL-V4, 54.6 on MCP-Atlas and 14.2 on MCP-Mark.
The OnePlus CPU achieved 12 prompt and 4.6 generation tokens/s. It even solved a second-order differential equation, although Vulkan crashed—likely because of its old Adreno 650 driver.
The S26 CPU reached 37 prompt and 14 generation tokens/s. Vulkan on its Adreno 840 reached about 36 prompt and 20 generation tokens/s. Its 16K-context web server delivered 33 prompt and 15 generation tokens/s.
A capable reasoning and tool-oriented AI can now run privately and offline on a phone, without cloud inference or NPU execution.
- 1 reply
Local AI on Phones: Spark-X2.5 on OnePlus 8 Pro and Galaxy S26
🔥 2
2
#7 opened 9 days ago
by Javedalam
liked a
Space 10 days ago
liked 2
models 13 days ago
updated a
collection 13 days ago
updated a
collection 20 days ago
liked a
Space 20 days ago
updated a
collection 22 days ago
liked a
Space 22 days ago
updated a
collection 25 days ago
liked a
Space 25 days ago
liked a
model 25 days ago
liked a
Space 25 days ago