README.md

---
license: mit
base_model: deepseek-ai/DeepSeek-V4-Flash-0731
tags: [gguf, rocmfpx, strix-halo, mixed-precision, quantization]
---

# DeepSeek-V4-Flash-0731 for Strix Halo

**82/92 quality in one 98.29 GB GGUF file.**

Built for 128 GB AMD Strix Halo systems. It loads unsplit on the Radeon 8060S
iGPU and needs no sidecar files.

## Quality

| Test | Score |
|---|---:|
| Full 92-question evaluation | **82/92** |
| COMPSEC-17 | **17/17** |

The full score matches the published reference. This file averages 2.766 bits
per model weight, about 4% less than the 2.88-bit reference.

None of the 92 test questions were used while preparing this file. The
published reference used 75 of them during its own preparation. Both results
used the same grader and reasoning allowance.

## Quality or speed

| Mode | Options | Decode speed | COMPSEC-17 |
|---|---|---:|---:|
| **Quality** (default) | No extra flags | 18.1 tok/s | **17/17** |
| **Faster** | `--ds4-expert-top-k 4 --ds4-fused-decode` | **22.3 tok/s** | 16/17 |

Quality mode is the recommended setting. Faster mode is 23% quicker but misses
one additional COMPSEC question. The full 82/92 evaluation was run only in
quality mode.

The current DSpark helper model makes this file slower overall, so it is not
recommended yet.

## Download

`DeepSeek-V4-Flash-0731-ROCMFPX-MIX-STRIX.gguf`

- Size: 98,294,917,184 bytes
- One file, no sidecars
- SHA-256: `7c0789d190fdd2acad93255825822ca276f29d13f9410f2ac65f5f7a542b0a38`

## Run

```bash
dflash_server DeepSeek-V4-Flash-0731-ROCMFPX-MIX-STRIX.gguf \
  --target-device hip:0 \
  --max-ctx 8192
```

Use the normal automatic memory settings on Strix Halo. If the machine also
has a discrete GPU, expose only the iGPU with `HIP_VISIBLE_DEVICES`.

Until support reaches the main dflash release, use the
`feat/qtype106-down-surface` branch of `GeometricAGI/lucebox-hub`.

Artifact and evaluation by Geometric-AI. Mirrored byte-for-byte by Lucebox.