---
license: apache-2.0
base_model: AEON-7/Qwen3.8-27B-AEON-ULTIMATE-UNCENSORED-BF16
library_name: llama.cpp
pipeline_tag: text-generation
tags:
- gguf
- llama.cpp
- rocm
- rocmfpx
- amd
- strix-halo
- qwen3.8
- qwen35
- imatrix
- thinking
- uncensored
---

# Qwen3.8-27B AEON ULTIMATE — ROCmFPX iMatrix GGUF

ROCmFPX iMatrix quantizations of the full BF16 checkpoint published by
[Aeon / AEON-7](https://huggingface.co/AEON-7/Qwen3.8-27B-AEON-ULTIMATE-UNCENSORED-BF16).

## Attribution

The source weights are Aeon's `Qwen3.8-27B-AEON-ULTIMATE-UNCENSORED-BF16`,
pinned at Hub revision
`8f76e82ed7ef4de7735f5d4148fce7b643b00fae`. Aeon deserves attribution for the
BF16 model and its model work. This repository contains derived GGUF
quantizations produced by vmlinux with the ROCmFPX toolchain; it is not a new
training run or a claim of ownership of the source model.

The source model declares Apache 2.0 licensing. Review the source model card
and applicable terms before redistribution or deployment.

## Quantizations

| File | Preset | Size | SHA-256 |
| --- | --- | ---: | --- |
| `Qwen3.8-27B-AEON-ULTIMATE-UNCENSORED-ROCmFP4-iMatrix.gguf` | `Q4_0_ROCMFP4` | 17,735,469,440 bytes | `34c04aaec2399fab8179a921d0ea1e9d3b93da213201ab0ec2930ee1420307b0` |
| `Qwen3.8-27B-AEON-ULTIMATE-UNCENSORED-ROCmFP6-iMatrix.gguf` | `Q6_0_ROCMFPX` | 22,528,383,360 bytes | `d096fdd0ece150cefa793a8fdae55076b63d61d9e135571de6c73b016a641ba1` |
| `Qwen3.8-27B-AEON-ULTIMATE-UNCENSORED-ROCmFP8-iMatrix.gguf` | `Q8_0_ROCMFPX` | 28,193,397,120 bytes | `10eff5653c51e23a8a816761feea69b235c9003e80821759ecef41814843a761` |

All three use the same model-specific importance matrix:
`Qwen3.8-27B-AEON-ULTIMATE-iMatrix.imatrix.gguf`. The matrix was generated
from 339 chunks of 512 tokens using the shared calibration corpus, and each
quantizer consumed 496 entries.

## Runtime

These are experimental ROCmFPX tensor types and require a compatible
ROCmFPX-enabled llama.cpp build. Stock upstream llama.cpp will not load them.

Example ROCm0 invocation:

```bash
hf download vmlinux/Qwen3.8-27B-AEON-ULTIMATE-ROCmFPX-GGUF \
  Qwen3.8-27B-AEON-ULTIMATE-UNCENSORED-ROCmFP4-iMatrix.gguf \
  --local-dir ./Qwen3.8-27B-AEON-ULTIMATE-ROCmFPX

./llama-completion \
  -m ./Qwen3.8-27B-AEON-ULTIMATE-ROCmFPX/Qwen3.8-27B-AEON-ULTIMATE-UNCENSORED-ROCmFP4-iMatrix.gguf \
  -dev ROCm0 -ngl all -c 8192 -n 256 -p "Hello."
```

The GGUFs retain the native one-layer MTP head. Thinking is enabled by the
embedded Qwen template by default; pass the appropriate chat-template kwargs
when an application needs thinking disabled.

## Validation and provenance

All three files loaded and generated a short completion on ROCm0 with all
layers offloaded. Detailed public build information is in
[`BUILD_RESULTS.md`](BUILD_RESULTS.md), with exact hashes in
[`SHA256SUMS`](SHA256SUMS) and source/toolchain details in
[`PROVENANCE.md`](PROVENANCE.md).