Update README.md
Browse files
README.md
CHANGED
|
@@ -94,7 +94,7 @@ docker run \
|
|
| 94 |
-e FRIENDLI_CONTAINER_SECRET="YOUR CONTAINER SECRET" \
|
| 95 |
registry.friendli.ai/trial \
|
| 96 |
--web-server-port 8000 \
|
| 97 |
-
--hf-model-name
|
| 98 |
--num-devices 2 # Use tensor parallelism degree 2
|
| 99 |
```
|
| 100 |
|
|
|
|
| 94 |
-e FRIENDLI_CONTAINER_SECRET="YOUR CONTAINER SECRET" \
|
| 95 |
registry.friendli.ai/trial \
|
| 96 |
--web-server-port 8000 \
|
| 97 |
+
--hf-model-name FriendliAI/Llama-2-70b-chat-hf-fp8 \
|
| 98 |
--num-devices 2 # Use tensor parallelism degree 2
|
| 99 |
```
|
| 100 |
|