schuttdev commited on
Commit
c6b6c30
·
verified ·
1 Parent(s): 93f9405

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +5 -2
README.md CHANGED
@@ -74,8 +74,11 @@ per-projection mixed-dtype dispatch were added to hipfire for this model.
74
  ## Usage (hipfire)
75
 
76
  ```
77
- hipfire serve --model MiniMax-M2.7.mq2-lloyd
78
- # or a single forward:
 
 
 
79
  # examples/infer_minimax --model MiniMax-M2.7.mq2-lloyd --prompt "..."
80
  ```
81
 
 
74
  ## Usage (hipfire)
75
 
76
  ```
77
+ # Chat serving — these tiers were quantized before the chat-template auto-embed
78
+ # fix, so point the daemon at the bundled template (chat_template.jinja, in this repo):
79
+ HIPFIRE_JINJA_CHAT=1 HIPFIRE_CHAT_TEMPLATE_FILE=chat_template.jinja \
80
+ hipfire serve --model MiniMax-M2.7.mq2-lloyd
81
+ # or a single raw forward (no chat template):
82
  # examples/infer_minimax --model MiniMax-M2.7.mq2-lloyd --prompt "..."
83
  ```
84