BeFM / app_vllm.py

Commit History

Update prompt reference text and space emoji
97c12a9

Jn-Huang commited on

Align placeholder with default system prompt
d8ad02c

Jn-Huang commited on

Update default prompt text and appendix link
1002aec

Jn-Huang commited on

Update default prompt and fix chat interface inputs
d298fc0

Jn-Huang commited on

update messages
77a4a60

Jn-Huang commited on

Customize BeFM UI and defaults
58ffc70

Jn-Huang commited on

Switch to transformers version - vLLM uses too much memory on T4 GPU
fc3b3a2

Jn-Huang commited on

Switch to vLLM for faster inference with lazy loading and multi-turn fix
89babab

Jn-Huang commited on