mifinkelson commited on
Commit
604c3d4
·
verified ·
1 Parent(s): febc36a

Update model card examples

Browse files
Files changed (1) hide show
  1. README.md +11 -9
README.md CHANGED
@@ -50,8 +50,8 @@ pip install -e . # or: uv sync
50
  huggingface-cli download mifinkelson/scena scena.safetensors audio_vae.safetensors --local-dir ./checkpoints
51
  ```
52
 
53
- Two example reference voices (public LibriSpeech clips) ship with the repo under
54
- `examples/references/`, so this runs out of the box:
55
 
56
  ```python
57
  from ltx_pipelines.t2aud_ref_cond import T2AudRefCondPipeline
@@ -64,18 +64,20 @@ pipe = T2AudRefCondPipeline(
64
 
65
  refs = ["examples/references/reference_1.wav", "examples/references/reference_2.wav"]
66
 
67
- # Game-show buzzer
68
  pipe(
69
- prompt='The speaker from reference 1 fires: "Capital of France?" The speaker from reference 2 instantly: "Paris!" The speaker from reference 1: "Square root of eighty-one?" The speaker from reference 2: "Nine!" The speaker from reference 1: "Year of moon landing?" The speaker from reference 2: "Sixty-nine!" A loud, harsh game-show buzzer rings out — a sustained electronic BZZZZT.',
70
  ref_audio_paths=refs,
71
- duration=8.5,
72
- ).save("buzzer.wav")
 
73
 
74
- # Farm at sunrise — same two voices, a different scene
75
  pipe(
76
  prompt='A farm at sunrise: a rooster crows. Chickens cluck softly throughout. The speaker from reference 1 says with a yawn: "Way too early for this." The speaker from reference 2 chuckles: "Welcome to country life." The rooster crows again.',
77
  ref_audio_paths=refs,
78
- duration=6.5,
 
79
  ).save("farm.wav")
80
  ```
81
 
@@ -83,7 +85,7 @@ pipe(
83
  - Refer to speakers as **"the speaker from reference 1"**, **"reference 2"**, … matching the
84
  order of `ref_audio_paths`.
85
  - Put the spoken words **in quotes**; describe sound effects / ambience in plain prose
86
- (e.g. *"a loud, harsh game-show buzzer rings out"*, *"a roaring stadium crowd cheers"*).
87
  - Reference clips: clean single-speaker speech, up to ~20 s each — the more the better (any sample rate; mono or stereo).
88
  - You don't have to follow a strict turn-taking pattern; see the [demo page](https://finmickey.github.io/scena/) for more varied examples.
89
  - 60 inference steps, guidance ~7, and output durations up to ~20 s work best (the model was trained on ≤20 s scenes).
 
50
  huggingface-cli download mifinkelson/scena scena.safetensors audio_vae.safetensors --local-dir ./checkpoints
51
  ```
52
 
53
+ Two example reference voices ship with the repo under `examples/references/` — the same two voices
54
+ drive both examples below, so this runs out of the box:
55
 
56
  ```python
57
  from ltx_pipelines.t2aud_ref_cond import T2AudRefCondPipeline
 
64
 
65
  refs = ["examples/references/reference_1.wav", "examples/references/reference_2.wav"]
66
 
67
+ # A simple two-speaker dialogue
68
  pipe(
69
+ prompt='The speaker from reference 1 says: "The taxi drivers are on strike again." The speaker from reference 2 says: "What for?" The speaker from reference 1 says: "They want the government to reduce the price of the gasoline." The speaker from reference 2 says: "It is really a hot potato."',
70
  ref_audio_paths=refs,
71
+ duration=7.0,
72
+ seed=1,
73
+ ).save("dialogue.wav")
74
 
75
+ # Farm at sunrise — the same two voices in a scene with sound effects
76
  pipe(
77
  prompt='A farm at sunrise: a rooster crows. Chickens cluck softly throughout. The speaker from reference 1 says with a yawn: "Way too early for this." The speaker from reference 2 chuckles: "Welcome to country life." The rooster crows again.',
78
  ref_audio_paths=refs,
79
+ duration=8.0,
80
+ seed=1,
81
  ).save("farm.wav")
82
  ```
83
 
 
85
  - Refer to speakers as **"the speaker from reference 1"**, **"reference 2"**, … matching the
86
  order of `ref_audio_paths`.
87
  - Put the spoken words **in quotes**; describe sound effects / ambience in plain prose
88
+ (e.g. *"rain drums steadily on a tin roof"*, *"a roaring stadium crowd cheers"*).
89
  - Reference clips: clean single-speaker speech, up to ~20 s each — the more the better (any sample rate; mono or stereo).
90
  - You don't have to follow a strict turn-taking pattern; see the [demo page](https://finmickey.github.io/scena/) for more varied examples.
91
  - 60 inference steps, guidance ~7, and output durations up to ~20 s work best (the model was trained on ≤20 s scenes).