chore: add nosec B324 annotations to non-cryptographic MD5 usages and update temporary database path to use system temp directory

Remove LLMLingua: Kompress is the sole text compressor

Enhance /stats endpoint and add comprehensive benchmarks