Update README.md

#1
by bmarie - opened
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -5,7 +5,7 @@ base_model:
5
  tags:
6
  - llmcompressor
7
  ---
8
- This is [allenai/Olmo-3-7B-Instruct](https://huggingface.co/allenai/Olmo-3-7B-Instruct) quantized with [LLM Compressor](https://github.com/vllm-project/llm-compressor) with FP8 Dynamic (W8A8). **Not Tested Yet**.
9
 
10
 
11
  - **Developed by:** [The Kaitchup](https://kaitchup.substack.com/)
 
5
  tags:
6
  - llmcompressor
7
  ---
8
+ This is [allenai/Olmo-3-7B-Instruct](https://huggingface.co/allenai/Olmo-3-7B-Instruct) quantized with [LLM Compressor](https://github.com/vllm-project/llm-compressor) with FP8 Dynamic (W8A8). The model is compatible with vLLM (tested: v0.11.2). Tested with an RTX 5090.
9
 
10
 
11
  - **Developed by:** [The Kaitchup](https://kaitchup.substack.com/)