A newer version of the Gradio SDK is available: 6.20.0
Raspberry Pi Deployment Notes
These notes are the intended implementation path for the field appliance.
- Rotate the temporary setup password before field use.
- Install Python 3.11+,
llama.cpp, and the dependencies inrequirements.txt. - Copy this repository to the Pi.
- Run
python app.pyfor a quick manual test. - Install the llama.cpp prebuilt runtime and smoke model:
bash scripts/install_llama_cpp_pi.sh
- Add systemd services for:
llama-serveroutbush-ai- optional
kiwix-serve - hotspot/mDNS
- Configure the access point:
- SSID:
Outbush-AI - Local URL:
http://outbush.local
- SSID:
- Run
python scripts/pi_smoke_test.py http://127.0.0.1:7860on the Pi.
Ask mode is model-first: llama.cpp should provide the prose answer, while the app adds risk banners, sources, and compact safety anchors. If the text model is unavailable, the app says so instead of inventing a deterministic chat answer.