Upload 2698739/3030557/README.md with huggingface_hub
Browse files- 2698739/3030557/README.md +128 -0
2698739/3030557/README.md
ADDED
|
@@ -0,0 +1,128 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: other
|
| 3 |
+
tags:
|
| 4 |
+
- audio
|
| 5 |
+
- lora
|
| 6 |
+
- softly-spoken
|
| 7 |
+
- style
|
| 8 |
+
- whisper
|
| 9 |
+
---
|
| 10 |
+
|
| 11 |
+
# LTX-2.3 Whisper & Soft-Spoken Audio LoRA - v1.0 - 3030557
|
| 12 |
+
|
| 13 |
+
**Model Type**: LORA
|
| 14 |
+
|
| 15 |
+
**Base Model**: LTXV 2.3
|
| 16 |
+
|
| 17 |
+
**Trigger Words**: None
|
| 18 |
+
|
| 19 |
+
**Tags**: audio, lora, softly-spoken, style, whisper
|
| 20 |
+
|
| 21 |
+
## Gallery
|
| 22 |
+
|
| 23 |
+
<table>
|
| 24 |
+
<tr>
|
| 25 |
+
<td><video src="https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/1f6b20e4-9782-41e1-ac01-e30c2044badb/original=true/133688104.mp4" width="200" controls muted autoplay loop></video></td>
|
| 26 |
+
<td><video src="https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/420271c7-5ff5-4378-a996-4a1ec2d3890a/original=true/133688615.mp4" width="200" controls muted autoplay loop></video></td>
|
| 27 |
+
</tr>
|
| 28 |
+
</table>
|
| 29 |
+
|
| 30 |
+
## Description
|
| 31 |
+
|
| 32 |
+
### LTX-2.3 Whisper & Soft-Spoken Audio LoRA
|
| 33 |
+
|
| 34 |
+
**Base model:** LTX-2.3 · **Type:** Audio-style LoRA · **Rank:** 32
|
| 35 |
+
|
| 36 |
+
---
|
| 37 |
+
|
| 38 |
+
## What this does
|
| 39 |
+
|
| 40 |
+
LTX-2.3 can generate dialogue, multi-speaker scenes, and full dynamic range audio including screaming — but it cannot whisper. This LoRA adds two quiet vocal registers to the model:
|
| 41 |
+
|
| 42 |
+
- **Whispering** — devoiced, breathy, close-mic delivery
|
| 43 |
+
|
| 44 |
+
- **Soft-spoken** — voiced but low-volume, intimate, relaxed
|
| 45 |
+
|
| 46 |
+
The LoRA targets only the three attention modules that write to the audio branch `audio_attn1`, `audio_attn2`, `video_to_audio_attn`). Video output is provably unchanged — no visual fighting, no style drift.
|
| 47 |
+
|
| 48 |
+
---
|
| 49 |
+
|
| 50 |
+
## Usage
|
| 51 |
+
|
| 52 |
+
Load at strength **1.0**. The register is controlled entirely by the manner keyword in your prompt — no special strength tuning needed.
|
| 53 |
+
|
| 54 |
+
### Trigger words (none, use natural language)
|
| 55 |
+
|
| 56 |
+
| Whispering | `(woman, whispering)` | `(man, whispering quietly)` |
|
| 57 |
+
|
| 58 |
+
| Soft-spoken | `(woman, speaking softly)` | `(man, speaking softly)` |
|
| 59 |
+
|
| 60 |
+
> **Note:** Male whisper may requires the extra word `quietly` to tip the model over. `(man, whispering)` alone produces soft-spoken, not true whisper.
|
| 61 |
+
|
| 62 |
+
### Prompt format
|
| 63 |
+
|
| 64 |
+
Follow the LTX-2.3 dialogue caption style:
|
| 65 |
+
|
| 66 |
+
```
|
| 67 |
+
|
| 68 |
+
a [scene description], ([gender], [manner]): "[what they say]", intimate ASMR
|
| 69 |
+
|
| 70 |
+
```
|
| 71 |
+
|
| 72 |
+
**Examples:**
|
| 73 |
+
|
| 74 |
+
```
|
| 75 |
+
|
| 76 |
+
a woman sitting close to a microphone in warm dim lighting, (woman, whispering): "close your eyes and listen"
|
| 77 |
+
|
| 78 |
+
a man at a desk late at night, (man, speaking softly): "I've been thinking about this all day"
|
| 79 |
+
|
| 80 |
+
a woman doing a skincare routine, (woman, whispering quietly): "this is my favourite step"
|
| 81 |
+
|
| 82 |
+
```
|
| 83 |
+
|
| 84 |
+
### Without manner keywords
|
| 85 |
+
|
| 86 |
+
Using the LoRA without any manner keyword defaults to **soft-spoken** — a subtle volume-softening effect on whatever the base model would have generated. Useful as a gentle "quieter audio" modifier.
|
| 87 |
+
|
| 88 |
+
---
|
| 89 |
+
|
| 90 |
+
## What it can't do
|
| 91 |
+
|
| 92 |
+
- **No intra-clip register mixing.** You can't have one character whisper and another speak normally in the same clip. The register applies to the whole generation. For mixed-register dialogue, generate each part separately and cut them together.
|
| 93 |
+
|
| 94 |
+
- **No magic above the vocoder ceiling.** The audio chain passes through a mel spectrogram bottleneck. Breathy whisper HF energy gets partially smoothed. Expect intimate and quiet, not studio-crisp ASMR.
|
| 95 |
+
|
| 96 |
+
- **Video is untouched by design.** If you want the visuals to also feel ASMR (soft lighting, close-up framing), describe that in the scene prompt — the LoRA won't help or hurt.
|
| 97 |
+
|
| 98 |
+
---
|
| 99 |
+
|
| 100 |
+
## Training details
|
| 101 |
+
|
| 102 |
+
| | |
|
| 103 |
+
|
| 104 |
+
|---|---|
|
| 105 |
+
|
| 106 |
+
| Base model | LTX-2.3 dev |
|
| 107 |
+
|
| 108 |
+
| Steps | 2000 |
|
| 109 |
+
|
| 110 |
+
| Rank / Alpha | 32 / 32 |
|
| 111 |
+
|
| 112 |
+
| Target modules | audio\_attn1, audio\_attn2, video\_to\_audio\_attn |
|
| 113 |
+
|
| 114 |
+
| Training resolution | 192×192, 97 frames (~4s @ 24fps) |
|
| 115 |
+
|
| 116 |
+
| Dataset | 74 clips, 8 voices (4F / 4M), 2 registers each |
|
| 117 |
+
|
| 118 |
+
Clips were 4-second segments sourced from ASMR content across 8 speakers — 4 female (2 soft-spoken, 2 whisper) and 4 male (2 soft-spoken, 2 whisper). Captions used Whisper ASR transcription in `(gender, manner): "transcript", intimate ASMR` format.
|
| 119 |
+
|
| 120 |
+
---
|
| 121 |
+
|
| 122 |
+
Author: [plz12345](https://civitai.com/user/plz12345)
|
| 123 |
+
|
| 124 |
+
Model: [CivitAI Model Page](https://civitai.com/models/2698739?modelVersionId=3030557)
|
| 125 |
+
|
| 126 |
+
Archive: [CivArchive Page](https://civarchive.com/models/2698739?modelVersionId=3030557)
|
| 127 |
+
|
| 128 |
+
<!-- Version: 20260614_upload -->
|