Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
|
@@ -74,8 +74,11 @@ per-projection mixed-dtype dispatch were added to hipfire for this model.
|
|
| 74 |
## Usage (hipfire)
|
| 75 |
|
| 76 |
```
|
| 77 |
-
|
| 78 |
-
#
|
|
|
|
|
|
|
|
|
|
| 79 |
# examples/infer_minimax --model MiniMax-M2.7.mq2-lloyd --prompt "..."
|
| 80 |
```
|
| 81 |
|
|
|
|
| 74 |
## Usage (hipfire)
|
| 75 |
|
| 76 |
```
|
| 77 |
+
# Chat serving — these tiers were quantized before the chat-template auto-embed
|
| 78 |
+
# fix, so point the daemon at the bundled template (chat_template.jinja, in this repo):
|
| 79 |
+
HIPFIRE_JINJA_CHAT=1 HIPFIRE_CHAT_TEMPLATE_FILE=chat_template.jinja \
|
| 80 |
+
hipfire serve --model MiniMax-M2.7.mq2-lloyd
|
| 81 |
+
# or a single raw forward (no chat template):
|
| 82 |
# examples/infer_minimax --model MiniMax-M2.7.mq2-lloyd --prompt "..."
|
| 83 |
```
|
| 84 |
|