RedHatAI
/

Llama-3.3-70B-Instruct-FP8-dynamic

Text Generation

text-generation-inference

compressed-tensors

Model card Files Files and versions

robgreenberg3 commited on Jun 9

Commit

f50dbad

·

verified ·

1 Parent(s): 565debb

Update README.md

Files changed (1) hide show

README.md +1 -0

README.md CHANGED Viewed

@@ -34,6 +34,7 @@ validated_on:
   - RHOAI 2.20
   - RHAIIS 3.0
   - RHELAI 1.5
 ---
 <h1 style="display: flex; align-items: center; gap: 10px; margin: 0;">
   Llama-3.3-70B-Instruct-FP8-dynamic

   - RHOAI 2.20
   - RHAIIS 3.0
   - RHELAI 1.5
+  - vLLM 0.8.4
 ---
 <h1 style="display: flex; align-items: center; gap: 10px; margin: 0;">
   Llama-3.3-70B-Instruct-FP8-dynamic