Update README.me
Browse files
README.md
CHANGED
|
@@ -190,15 +190,6 @@ docker run --rm -it \
|
|
| 190 |
--max-num-seqs 2
|
| 191 |
```
|
| 192 |
|
| 193 |
-
**Test Hardware:** NVIDIA Jetson AGX Orin, NVIDIA Jetson Orin Nano Super
|
| 194 |
-
|
| 195 |
-
> [!NOTE]
|
| 196 |
-
> `max_model_len`, `gpu_memory_utilization`, and `max_num_seqs` should be adapted to system specifications (i.e., available RAM).
|
| 197 |
-
|
| 198 |
-
```python
|
| 199 |
-
# Coming soon
|
| 200 |
-
```
|
| 201 |
-
|
| 202 |
### Transformers Inference
|
| 203 |
|
| 204 |
**Test Hardware:** NVIDIA A4 GPU
|
|
|
|
| 190 |
--max-num-seqs 2
|
| 191 |
```
|
| 192 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 193 |
### Transformers Inference
|
| 194 |
|
| 195 |
**Test Hardware:** NVIDIA A4 GPU
|