---
tags:
- deco-g
- hmm
- constrained-decoding
- format-estimation
---

# Deco-G HMM Checkpoints

This repository hosts the HMM checkpoints used by Deco-G for the public GSM8K and SummEval experiments in [Decoupling Task-Solving and Output Formatting in LLM Generation](https://arxiv.org/abs/2510.03595).

The code release at https://github.com/haikangdeng/deco-g downloads these checkpoints automatically for Deco-G decoding. The checkpoints are organized by model-specific subfolder:

| Deco-G alias | Base model | Subfolder |
| --- | --- | --- |
| `llama8b` | `meta-llama/Llama-3.1-8B-Instruct` | `llama3.1-8b-instruct` |
| `qwen7b` | `Qwen/Qwen2.5-7B-Instruct` | `qwen2.5-7b-instruct` |
| `qwen3-8b` | `Qwen/Qwen3-8B` | `qwen3-8b` |

Each subfolder contains a `config.json` and `model.safetensors` compatible with Deco-G's `HMM` class.