Spaces:
Runtime error
Runtime error
J.B-Lin commited on
Commit ·
d7f81b5
1
Parent(s): 2400b46
modal/omni: PRODUCTION DEPLOY - text inference fully verified, llama-server running on T4
Browse files- Chinese: 1.0s, '你好,我是MiniCPM系列模型...' (finish_reason=stop)
- English: 1.8s, 'The capital of France is Paris.' (finish_reason=stop)
- Cold start: 11s model load on T4
- --jinja flag confirmed working for correct chat template
- Production URL: https://andrew-jiabin--prego-pal-minicpm-omni-serve.modal.run
Next: add omni voice endpoints (prefill/generate/break) for full-duplex audio
docs/README_modal_deploy.md
CHANGED
|
@@ -110,7 +110,9 @@ modal run --detach -m modal_deploy.deploy_omni::test_inference
|
|
| 110 |
|
| 111 |
### Test Results (2026-06-11, T4)
|
| 112 |
|
| 113 |
-
**Status**:
|
|
|
|
|
|
|
| 114 |
|
| 115 |
| Metric | Value |
|
| 116 |
|--------|-------|
|
|
|
|
| 110 |
|
| 111 |
### Test Results (2026-06-11, T4)
|
| 112 |
|
| 113 |
+
**Status**: ✅ Deployed to production on T4.
|
| 114 |
+
|
| 115 |
+
**Production URL**: `https://andrew-jiabin--prego-pal-minicpm-omni-serve.modal.run`
|
| 116 |
|
| 117 |
| Metric | Value |
|
| 118 |
|--------|-------|
|