Final critical stability fixes: move to ephemeral disk, add auto-repair, and enable WAL mode

Fix database corruption issues and add maintenance UI

Add crawler control API and persistent storage support

Initial commit for Hugging Face Spaces deployment