Qwen for Janas-LLM
Collection
37 tok/s from Qwen3-Next-80B on a 32 GB laptop; 24 without drafts vs 2.8 for llama.cpp. Qwen models converted for Janas-LLM. • 10 items • Updated
Qwen3-Embedding-0.6B for Janas-LLM
An embedding model, for janas-server --embedding-model.
These are the model's weights converted to JNS, the format of Janas-LLM, the inference engine in C of Janas, for ordinary computers, with or without a GPU. The files are read by Janas-LLM only.
Get it
Janas-LLM for Linux x86-64 (Ubuntu 22.04, Debian 12 and later), then the model:
curl -LO https://github.com/prabanta-dev/janas/releases/latest/download/janas-linux-x86_64.tar.gz
tar xf janas-linux-x86_64.tar.gz && cd janas
./janas-get qwen3-embedding-0.6b
./janas-server <chat-model.jns> --embedding-model ~/.local/share/janas/models/qwen3-embedding-0.6b-q8.jns
janas-get downloads the files of this repository and checks them against the fingerprints below; janas-chat with no model shows the catalog and downloads the one you choose. Building Janas-LLM from its sources instead: prabanta-dev/janas.
Files
| File | Size | SHA-256 | Converted from |
|---|---|---|---|
qwen3-embedding-0.6b-q8.jns |
0.64 GB | 1e8eb8cbeba7a1a657354d259c5730bb79f6087160a9ca8da901bd08bdbe943f |
Qwen/Qwen3-Embedding-0.6B-GGUF Qwen3-Embedding-0.6B-Q8_0.gguf (catalog name qwen3-embedding-0.6b: Qwen3-Embedding-0.6B, for janas-server --embedding-model) |
What was changed
These files are a modified work of the original model, as the Apache License 2.0 requires to be stated. Nothing was retrained or pruned: each file is a GGUF file quantized by the people named above, rewritten by Janas-LLM's gguf2jns in the order Janas reads it, with the metadata carried over.
Licence and attribution
Licensed under the Apache License 2.0, as the original model: see LICENSE.
- Model: Qwen/Qwen3-Embedding-0.6B, by Alibaba Cloud (the Qwen team).
- Quantized GGUF: Qwen/Qwen3-Embedding-0.6B-GGUF, by its authors.
- Converted to JNS by the Janas project with Janas-LLM (prabanta-dev/janas, GPL-3.0-or-later; the licence of the engine does not apply to these files).
The original repository carries no LICENSE file; its card declares Apache 2.0. LICENSE here is the licence's text as the Apache Software Foundation publishes it.