UMSR-Reasoner-7B-INT8 / variant.json
NorthernTribe-Research's picture
Publish UMSR-Reasoner-7B int8 variant
2a204f9 verified
{
"dataset_id": "NorthernTribe-Research/UMSR-v1",
"description": "8-bit bitsandbytes runtime quantization profile.",
"materialized": false,
"name": "int8",
"published": true,
"quantization": "bnb_int8",
"repo_id": "NorthernTribe-Research/UMSR-Reasoner-7B-INT8",
"source_model_id": "NorthernTribe-Research/UMSR-Reasoner-7B"
}