Update README.md
Browse files
README.md
CHANGED
|
@@ -27,6 +27,7 @@ license_link: https://choosealicense.com/licenses/mit/
|
|
| 27 |
validated_on:
|
| 28 |
- RHOAI 2.24
|
| 29 |
- RHAIIS 3.2.1
|
|
|
|
| 30 |
---
|
| 31 |
|
| 32 |
<h1 style="display: flex; align-items: center; gap: 10px; margin: 0;">
|
|
@@ -52,7 +53,7 @@ validated_on:
|
|
| 52 |
- **ModelCar Storage URI:** oci://registry.redhat.io/rhelai1/modelcar-deepseek-r1-0528-quantized-w4a16:1.5
|
| 53 |
- **Validated on RHOAI 2.24:** quay.io/modh/vllm:rhoai-2.24-cuda
|
| 54 |
- **Validated on RHAIIS 3.2.1:** http://registry.redhat.io/rhaiis/vllm-cuda-rhel9:3.2.1
|
| 55 |
-
|
| 56 |
|
| 57 |
### Model Optimizations
|
| 58 |
|
|
|
|
| 27 |
validated_on:
|
| 28 |
- RHOAI 2.24
|
| 29 |
- RHAIIS 3.2.1
|
| 30 |
+
- vLLM v0.10.0
|
| 31 |
---
|
| 32 |
|
| 33 |
<h1 style="display: flex; align-items: center; gap: 10px; margin: 0;">
|
|
|
|
| 53 |
- **ModelCar Storage URI:** oci://registry.redhat.io/rhelai1/modelcar-deepseek-r1-0528-quantized-w4a16:1.5
|
| 54 |
- **Validated on RHOAI 2.24:** quay.io/modh/vllm:rhoai-2.24-cuda
|
| 55 |
- **Validated on RHAIIS 3.2.1:** http://registry.redhat.io/rhaiis/vllm-cuda-rhel9:3.2.1
|
| 56 |
+
- **Validated on vLLM:** 0.10.0
|
| 57 |
|
| 58 |
### Model Optimizations
|
| 59 |
|