kisan-sathi / src /llm.py

Commit History

perf: increase llama_cpp initialization and prefill timeouts to 120s for worst-case CPU performance
1dcacfe

sxandie commited on

perf: increase llama_cpp timeout thresholds to 60s for slow CPU architectures
d190d80

sxandie commited on

fix: improve mock backend conversation memory and history-aware responses
1207b92

sxandie commited on

fix: Update mock ledger parser regex to prevent matching rupees as dates and support dynamic items (e.g. cotton)
1c9f118

sxandie commited on

docs: Update README with enhancements; implement GGUF latency fallback, KV cache thread-safety lock, mock structured parser, start-from-scratch reset, mobile CSS responsiveness, and nudge parser fixes
ee1aa00

sxandie commited on

fix: resolve prefix repetition loop by yielding deltas only in stream
b4570fc

sxandie commited on

limit n_threads to 1 on HF Spaces to prevent repack scheduler crashes
c57ba18

sxandie commited on

mock to realtime local model execution with llama.cpp
cddb760

sxandie commited on

mock run working
fa6ab79

sxandie commited on