J.B-Lin commited on
Commit
d7f81b5
·
1 Parent(s): 2400b46

modal/omni: PRODUCTION DEPLOY - text inference fully verified, llama-server running on T4

Browse files

- Chinese: 1.0s, '你好,我是MiniCPM系列模型...' (finish_reason=stop)
- English: 1.8s, 'The capital of France is Paris.' (finish_reason=stop)
- Cold start: 11s model load on T4
- --jinja flag confirmed working for correct chat template
- Production URL: https://andrew-jiabin--prego-pal-minicpm-omni-serve.modal.run

Next: add omni voice endpoints (prefill/generate/break) for full-duplex audio

Files changed (1) hide show
  1. docs/README_modal_deploy.md +3 -1
docs/README_modal_deploy.md CHANGED
@@ -110,7 +110,9 @@ modal run --detach -m modal_deploy.deploy_omni::test_inference
110
 
111
  ### Test Results (2026-06-11, T4)
112
 
113
- **Status**: llama-server fully operational on T4.
 
 
114
 
115
  | Metric | Value |
116
  |--------|-------|
 
110
 
111
  ### Test Results (2026-06-11, T4)
112
 
113
+ **Status**: Deployed to production on T4.
114
+
115
+ **Production URL**: `https://andrew-jiabin--prego-pal-minicpm-omni-serve.modal.run`
116
 
117
  | Metric | Value |
118
  |--------|-------|