Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
|
@@ -74,10 +74,8 @@ per-projection mixed-dtype dispatch were added to hipfire for this model.
|
|
| 74 |
## Usage (hipfire)
|
| 75 |
|
| 76 |
```
|
| 77 |
-
# Chat serving —
|
| 78 |
-
|
| 79 |
-
HIPFIRE_JINJA_CHAT=1 HIPFIRE_CHAT_TEMPLATE_FILE=chat_template.jinja \
|
| 80 |
-
hipfire serve --model MiniMax-M2.7.mq2-lloyd
|
| 81 |
# or a single raw forward (no chat template):
|
| 82 |
# examples/infer_minimax --model MiniMax-M2.7.mq2-lloyd --prompt "..."
|
| 83 |
```
|
|
|
|
| 74 |
## Usage (hipfire)
|
| 75 |
|
| 76 |
```
|
| 77 |
+
# Chat serving — the chat template is embedded in every tier:
|
| 78 |
+
HIPFIRE_JINJA_CHAT=1 hipfire serve --model MiniMax-M2.7.mq2-lloyd
|
|
|
|
|
|
|
| 79 |
# or a single raw forward (no chat template):
|
| 80 |
# examples/infer_minimax --model MiniMax-M2.7.mq2-lloyd --prompt "..."
|
| 81 |
```
|