Nulia
/

WeirdCompound-v1.7-24b-FP8-Dynamic

Text Generation

compressed-tensors

Model card Files Files and versions

WeirdCompound-v1.7-24b-FP8-Dynamic / README.md

Nulia's picture

Add files using upload-large-folder tool

6fe707e verified about 2 months ago

|

history blame contribute delete

298 Bytes

metadata

base_model:
  - FlareRebellion/WeirdCompound-v1.7-24b
pipeline_tag: text-generation
tags:
  - fp8

FP8-Dynamic quant of FlareRebellion/WeirdCompound-v1.7-24b using llm-compressor.