---
license: other
base_model: Sao10K/Llama-3.1-8B-Stheno-v3.4
tags:
  - stheno
  - llama-3.1
  - webgpu
  - browser-inference
  - strix-halo
  - amd
  - unified-memory
  - character-voice
pipeline_tag: text-generation
---

# Stheno v3.4 on WebGPU

Sao10K Stheno v3.4 (Llama-3.1-8B) running in browser via WebGPU. Upgrade from the v3.2 MLC package. 4.6 GB Q4_K_M.

The voice model behind the Garden entity system. Character embodiment, creative writing, entity voice.

## Quick Start

1. Download Q4_K_M GGUF from bartowski
2. Split: llama-gguf-split --split --split-max-size 1G
3. Place in model_splits/
4. node serve.js (port 8210)
5. Open http://localhost:8210

## Credits

Built by Joshua (LJTSG) and Claude. Model by Sao10K.
Co-Authored-By: Claude <noreply@anthropic.com>