MomsVoiceAI / inference_lfm.py

Commit History

fix prompt for short answer
942f441

sshtel commited on

fix to ui to visible
fbb26dd

sshtel commited on

perf: improve LFM2.5-Audio inference quality and reliability
4798cd4

sshtel Claude Sonnet 4.6 commited on

perf: warmup generation, async LFM loading, reduce max_new_tokens
871cd89

minhahwang Copilot commited on

perf: add torch.compile for LFM model on HF Space (20-60% faster inference)
52dd416

minhahwang Copilot commited on

fix: proper Mimi decode on HF Space β€” only disable dynamo on Windows, explicit device handling
5bb5f05

minhahwang Copilot commited on

fix: use Mimi streaming decoder for proper speech audio (not LFM detokenizer)
d397f1a

minhahwang Copilot commited on

fix: Play produces no sound β€” switch to streaming audio + system deps
373219a

minhahwang Copilot commited on

fix: correct LFM audio sample rate to 48kHz and normalize volume
60d60e5

minhahwang Copilot commited on

fix: audio decode normalization + warmup first 5 paragraphs
b714046

minhahwang Copilot commited on

feat: bounded pre-gen, cancellation, disk cache pruning, GPU lock
994d3d9

minhahwang Copilot commited on

refactor: runtime config, Q&A flow module, storage paths, and cleanup
397b4ac

minhahwang Copilot commited on

perf: 5 latency optimizations for TTS playback
68f1a16

minhahwang Copilot commited on

feat: enable FlashAttention-2 for all models via runtime install + SDPA fallback
c7cbd46

minhahwang Copilot commited on

feat: add LFM2.5-Audio end-to-end Q&A variant
c5bd25e

minhahwang Copilot commited on