schuttdev commited on
Commit
6eff477
·
verified ·
1 Parent(s): 7940cd4

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +2 -4
README.md CHANGED
@@ -74,10 +74,8 @@ per-projection mixed-dtype dispatch were added to hipfire for this model.
74
  ## Usage (hipfire)
75
 
76
  ```
77
- # Chat serving — these tiers were quantized before the chat-template auto-embed
78
- # fix, so point the daemon at the bundled template (chat_template.jinja, in this repo):
79
- HIPFIRE_JINJA_CHAT=1 HIPFIRE_CHAT_TEMPLATE_FILE=chat_template.jinja \
80
- hipfire serve --model MiniMax-M2.7.mq2-lloyd
81
  # or a single raw forward (no chat template):
82
  # examples/infer_minimax --model MiniMax-M2.7.mq2-lloyd --prompt "..."
83
  ```
 
74
  ## Usage (hipfire)
75
 
76
  ```
77
+ # Chat serving — the chat template is embedded in every tier:
78
+ HIPFIRE_JINJA_CHAT=1 hipfire serve --model MiniMax-M2.7.mq2-lloyd
 
 
79
  # or a single raw forward (no chat template):
80
  # examples/infer_minimax --model MiniMax-M2.7.mq2-lloyd --prompt "..."
81
  ```