Spaces:
Running
Running
File size: 1,724 Bytes
0c5452b 3b5fb7e 0c5452b 3b5fb7e 0c5452b ee3fd85 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 | ---
title: Wllama
emoji: 🦙
colorFrom: green
colorTo: pink
sdk: static
pinned: true
short_description: Run GGUF directly on your browser!
license: mit
header: mini
custom_headers:
cross-origin-embedder-policy: require-corp
cross-origin-opener-policy: same-origin
cross-origin-resource-policy: cross-origin
---
Check out the configuration reference at https://huggingface.co/docs/hub/spaces-config-reference
## Running locally / offline
Serve this folder with the COOP/COEP headers the Space uses (required for
multithreading + the model cache), then open the printed URL:
```bash
python3 serve.py # http://localhost:8000
```
What's offline-ready after one-time downloads:
- **VAD + TTS**: bundled locally (`vad/`, `piper/`, `voices/`, `onnx/`) — always work offline.
- **LLM model (GGUF)**: download once from the *Manage models* page; it is cached in the browser.
- **ASR (Whisper)**: use the **Voice modules → Install** button on the *Manage models* page.
It downloads the whisper model and runs the ONNX runtime from the local `asr/` folder,
so speech-to-text works fully offline after install.
## Voice-to-voice mode
Click **🎙 Voice** in the top bar for a full-screen voice interface:
- Hands-free: speak → transcribed (whisper) → answered (LLM) → read aloud (piper TTS).
- A neon audio visualizer reacts to the assistant's speech.
- Only sentences that have already been spoken are shown on screen, so faster
text generation stays hidden until it is actually said.
- On a new conversation the LLM invents a random personality for the assistant
and speaks its greeting.
- Click any spoken sentence (or any assistant bubble in normal chat) to
**regenerate** that reply.
|