CyberSecChatbot / llm_handler.py

Commit History

Add GPU support
bfa102d

Andrew McCracken Claude commited on

Revert to simpler configuration - optimizations caused slowdown
457c9e1

Andrew McCracken Claude commited on

Optimize for faster inference
8cfe5b7

Andrew McCracken Claude commited on

Increase threads to 8 for faster inference
3f2ee19

Andrew McCracken Claude commited on

Optimize for 8vCPU/32GB instance
b7fb901

Andrew McCracken Claude commited on

Optimize model parameters for faster CPU inference
6e83384

Andrew McCracken Claude commited on

Initial deployment to Spaces
2fb680d

Andrew McCracken commited on