README.md

metadata

license: apache-2.0
base_model: openai/gpt-oss-20b

gpt-oss-20b-WFP8-AFP8-KVFP8

• Introduction

  This model was quantized from openai/gpt-oss-20b using AMD-Quark with calibration samples from the Pile dataset.

• Quantization schemes

  • Quantized Layers: All linear (both attention linear and MoE linear) layers excluding lm_head
  • Weight: quantized using FP8 symmetric per-tensor scheme
  • Activation: quantized using FP8 symmetric per-tensor scheme
  • KV Cache: FP8 symmetric per-tensor

Deployment

This model supports deployment through the vLLM backend.

Evaluation

The quantization evaluation results are conducted in pseudo-quantization mode, which may slightly differ from the actual quantized inference accuracy. These results are provided for reference only.

Evaluation scores

Model name	Weight	Activation	KV cache	Exclude	gpqa_diamond_generative_n_shot (5)				gsm8k_platinum
					TP1	TP2	TP4	TP8	TP1	TP2	TP4	TP8
openai/gpt-oss-20b	MXFP4	BF16	BF16	"*bias lm_head"	0.5606	0.5303	0.5657	0.5606	0.9016	0.9024	0.9032	0.8966
amd/gpt-oss-20b-WFP8-AFP8-KVFP8	FP8	FP8	FP8		0.5354	0.4848	0.5505	0.5303	0.8991	0.9065	0.8999	0.9065

License

Modifications copyright(c) 2026 Advanced Micro Devices,Inc. All rights reserved.

Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License at

http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License.