Sentinel7 commited on
Commit
1934293
·
verified ·
1 Parent(s): 2e6efbb

Upload 2698739/3030557/README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. 2698739/3030557/README.md +128 -0
2698739/3030557/README.md ADDED
@@ -0,0 +1,128 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: other
3
+ tags:
4
+ - audio
5
+ - lora
6
+ - softly-spoken
7
+ - style
8
+ - whisper
9
+ ---
10
+
11
+ # LTX-2.3 Whisper & Soft-Spoken Audio LoRA - v1.0 - 3030557
12
+
13
+ **Model Type**: LORA
14
+
15
+ **Base Model**: LTXV 2.3
16
+
17
+ **Trigger Words**: None
18
+
19
+ **Tags**: audio, lora, softly-spoken, style, whisper
20
+
21
+ ## Gallery
22
+
23
+ <table>
24
+ <tr>
25
+ <td><video src="https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/1f6b20e4-9782-41e1-ac01-e30c2044badb/original=true/133688104.mp4" width="200" controls muted autoplay loop></video></td>
26
+ <td><video src="https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/420271c7-5ff5-4378-a996-4a1ec2d3890a/original=true/133688615.mp4" width="200" controls muted autoplay loop></video></td>
27
+ </tr>
28
+ </table>
29
+
30
+ ## Description
31
+
32
+ ### LTX-2.3 Whisper & Soft-Spoken Audio LoRA
33
+
34
+ **Base model:** LTX-2.3 · **Type:** Audio-style LoRA · **Rank:** 32
35
+
36
+ ---
37
+
38
+ ## What this does
39
+
40
+ LTX-2.3 can generate dialogue, multi-speaker scenes, and full dynamic range audio including screaming — but it cannot whisper. This LoRA adds two quiet vocal registers to the model:
41
+
42
+ - **Whispering** — devoiced, breathy, close-mic delivery
43
+
44
+ - **Soft-spoken** — voiced but low-volume, intimate, relaxed
45
+
46
+ The LoRA targets only the three attention modules that write to the audio branch `audio_attn1`, `audio_attn2`, `video_to_audio_attn`). Video output is provably unchanged — no visual fighting, no style drift.
47
+
48
+ ---
49
+
50
+ ## Usage
51
+
52
+ Load at strength **1.0**. The register is controlled entirely by the manner keyword in your prompt — no special strength tuning needed.
53
+
54
+ ### Trigger words (none, use natural language)
55
+
56
+ | Whispering | `(woman, whispering)` | `(man, whispering quietly)` |
57
+
58
+ | Soft-spoken | `(woman, speaking softly)` | `(man, speaking softly)` |
59
+
60
+ > **Note:** Male whisper may requires the extra word `quietly` to tip the model over. `(man, whispering)` alone produces soft-spoken, not true whisper.
61
+
62
+ ### Prompt format
63
+
64
+ Follow the LTX-2.3 dialogue caption style:
65
+
66
+ ```
67
+
68
+ a [scene description], ([gender], [manner]): "[what they say]", intimate ASMR
69
+
70
+ ```
71
+
72
+ **Examples:**
73
+
74
+ ```
75
+
76
+ a woman sitting close to a microphone in warm dim lighting, (woman, whispering): "close your eyes and listen"
77
+
78
+ a man at a desk late at night, (man, speaking softly): "I've been thinking about this all day"
79
+
80
+ a woman doing a skincare routine, (woman, whispering quietly): "this is my favourite step"
81
+
82
+ ```
83
+
84
+ ### Without manner keywords
85
+
86
+ Using the LoRA without any manner keyword defaults to **soft-spoken** — a subtle volume-softening effect on whatever the base model would have generated. Useful as a gentle "quieter audio" modifier.
87
+
88
+ ---
89
+
90
+ ## What it can't do
91
+
92
+ - **No intra-clip register mixing.** You can't have one character whisper and another speak normally in the same clip. The register applies to the whole generation. For mixed-register dialogue, generate each part separately and cut them together.
93
+
94
+ - **No magic above the vocoder ceiling.** The audio chain passes through a mel spectrogram bottleneck. Breathy whisper HF energy gets partially smoothed. Expect intimate and quiet, not studio-crisp ASMR.
95
+
96
+ - **Video is untouched by design.** If you want the visuals to also feel ASMR (soft lighting, close-up framing), describe that in the scene prompt — the LoRA won't help or hurt.
97
+
98
+ ---
99
+
100
+ ## Training details
101
+
102
+ | | |
103
+
104
+ |---|---|
105
+
106
+ | Base model | LTX-2.3 dev |
107
+
108
+ | Steps | 2000 |
109
+
110
+ | Rank / Alpha | 32 / 32 |
111
+
112
+ | Target modules | audio\_attn1, audio\_attn2, video\_to\_audio\_attn |
113
+
114
+ | Training resolution | 192×192, 97 frames (~4s @ 24fps) |
115
+
116
+ | Dataset | 74 clips, 8 voices (4F / 4M), 2 registers each |
117
+
118
+ Clips were 4-second segments sourced from ASMR content across 8 speakers — 4 female (2 soft-spoken, 2 whisper) and 4 male (2 soft-spoken, 2 whisper). Captions used Whisper ASR transcription in `(gender, manner): "transcript", intimate ASMR` format.
119
+
120
+ ---
121
+
122
+ Author: [plz12345](https://civitai.com/user/plz12345)
123
+
124
+ Model: [CivitAI Model Page](https://civitai.com/models/2698739?modelVersionId=3030557)
125
+
126
+ Archive: [CivArchive Page](https://civarchive.com/models/2698739?modelVersionId=3030557)
127
+
128
+ <!-- Version: 20260614_upload -->