Here is a unofficial Live Chat implementation.
#2
by
ikaganacar
- opened
Hey everyone! 👋
I’ve been experimenting with PaCoRe and wanted to share a fork I created that adapts the framework for interactive, daily usage on consumer hardware.
I implemented a terminal-based "Live Chat" tui (using rich) that visualizes the parallel reasoning branches in real-time before synthesizing the final answer. It’s tuned for efficiency with a lightweight configuration (2-4 branches).
I've tested this configuration on an NVIDIA RTX 5070 (12GB) using 8-bit quantization and it runs smoothly with a 9k context window.
Check it out here if you want to try running PaCoRe real-time: https://github.com/ikaganacar1/PaCoRe-LiveChat
Hope this is useful for anyone wanting to run this locally!