Instructions to use VextLabsinc/juwel-emerald with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use VextLabsinc/juwel-emerald with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="VextLabsinc/juwel-emerald")# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("VextLabsinc/juwel-emerald", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use VextLabsinc/juwel-emerald with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "VextLabsinc/juwel-emerald" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "VextLabsinc/juwel-emerald", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/VextLabsinc/juwel-emerald
- SGLang
How to use VextLabsinc/juwel-emerald with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "VextLabsinc/juwel-emerald" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "VextLabsinc/juwel-emerald", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "VextLabsinc/juwel-emerald" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "VextLabsinc/juwel-emerald", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use VextLabsinc/juwel-emerald with Docker Model Runner:
docker model run hf.co/VextLabsinc/juwel-emerald
File size: 3,744 Bytes
9265080 4806bfc 9265080 4806bfc 9265080 4806bfc 9265080 4806bfc 9265080 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 | ---
license: apache-2.0
language:
- en
library_name: transformers
pipeline_tag: text-generation
tags:
- juwel
- juwel-emerald
- vext-base
- vision-language
- cip
---
# JUWEL Emerald
> **JUWEL Emerald** (internal lineage: Vext-Base-v9) β the efficient, general-purpose Vext Labs
> base. Emerald is the May birthstone: evergreen. ~32B, vision-capable, the base most of the GEM
> specialist adapters are trained against. Released under Apache-2.0 as part of the JUWEL open
> archive.
## At a glance
| Field | Value |
|---|---|
| Public name | JUWEL Emerald |
| HF repo | `VextLabsinc/juwel-emerald` |
| Internal lineage | Theron-Base v9 (Qwen3-VL-32B + CIP additive) |
| Parameters | ~32B |
| Precision | BF16 (no quantization) |
| Source | 14 safetensors shards, ~67 GB |
| Release license | Apache-2.0 |
| Hardware floor | 1x H100 80GB (BF16) |
## What this is, honestly
JUWEL Emerald is the dense, efficient general base in the Vext lineage β Qwen3-VL-32B with a CIP
additive step. It is the base the GEM specialist fleet loads on top of. It is released as open
weights because it is a strong, useful base and because the community feedback loop on it feeds
how we build forward.
## Intended use
- General reasoning / language / vision baseline at ~32B.
- Base for the GEM specialist adapters (`VextLabsinc/gem-*`) and for your own domain fine-tunes.
- Self-hosted deployment without depending on Vext-hosted inference.
## Out of scope
- Not a substitute for a licensed professional in any regulated domain.
- No deliberate refusal training β apply your own safety policy at the human-to-model boundary.
- Quantized inference if quality is the goal β trained/validated in BF16.
## Architecture / training (outcome-level)
- Derived from Qwen3-VL-32B; capability added via CIP (organic upscale + LoRA on new layers,
then merged). We describe CIP at the outcome level only; the recipe is proprietary.
- No teacher distillation β training examples are curated primary sources. Raw corpus stays
proprietary; a data card describing source families ships with the release.
## Evaluation
- **Status:** pending β numbers published only when reproducible on our stack (named harness,
date, method), per our benchmark-audit-trail discipline. Do not treat internal rubrics as
public leaderboards. Headline lineage note: v9 beat the retired v8 by a wide margin on
GSM8K / MMLU-Pro at one-third the footprint (audit trail: https://vextlabs.ai/transparency).
## Weights β download (Cloudflare R2, public, BF16)
> Weights live on Cloudflare R2, not inside this HF repo. Download them locally, then load from the local dir.
```bash
BASE=https://pub-a6ae0476e46849f98f1746a61dc4c106.r2.dev/juwel-emerald
mkdir -p juwel-emerald && cd juwel-emerald
for f in config.json model.safetensors.index.json tokenizer.json tokenizer_config.json generation_config.json; do curl -sO $BASE/$f; done
for i in $(seq -w 1 14); do curl -O $BASE/model-000$i-of-00014.safetensors; done
```
## How to load
```python
from transformers import AutoModelForCausalLM, AutoTokenizer
import torch
model = AutoModelForCausalLM.from_pretrained("./juwel-emerald", torch_dtype=torch.bfloat16, device_map="auto")
tokenizer = AutoTokenizer.from_pretrained("./juwel-emerald")
```
Load a GEM specialist on top (download its adapter from R2 first β see the GEM's card β then):
```python
from peft import PeftModel
model = PeftModel.from_pretrained(model, "./gem-ruby") # code specialist, downloaded from R2
```
## License / attribution
Derived from **Qwen3-VL-32B** (Alibaba Cloud). Preserve the base license + `NOTICE`. JUWEL Emerald
is released under **Apache-2.0**. Do not imply Alibaba/Qwen endorsement. Contact: info@vextlabs.ai.
|