Hugging Face's logo

leon-se
/
Aria-sequential_mlp-FP8-dynamic

Image-Text-to-Text
Transformers
Safetensors
aria
image-to-text
conversational
custom_code
compressed-tensors
Model card Files
xet
Community
1
Leon commited on
Commit
ff24ae3
·
verified ·
1 Parent(s): 23cc088

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -0
README.md CHANGED
@@ -6,6 +6,7 @@ base_model:
6
  pipeline_tag: image-text-to-text
7
  ---
8
  # Aria-sequential_mlp-FP8-dynamic
 
9
 
10
  FP8-Dynamic quantization from [Aria-sequential_mlp](https://huggingface.co/rhymes-ai/Aria-sequential_mlp) made with [LLM Compressor](https://github.com/vllm-project/llm-compressor).
11
 
 
6
  pipeline_tag: image-text-to-text
7
  ---
8
  # Aria-sequential_mlp-FP8-dynamic
9
+ Warning: There is no inference code for transformers/vLLM yet!
10
 
11
  FP8-Dynamic quantization from [Aria-sequential_mlp](https://huggingface.co/rhymes-ai/Aria-sequential_mlp) made with [LLM Compressor](https://github.com/vllm-project/llm-compressor).
12