Add multilingual example alignments + corpus credits to landing page
Browse files- .gitattributes +4 -0
- README.md +25 -0
- assets/example_dutch.png +3 -0
- assets/example_english.png +3 -0
- assets/example_german.png +3 -0
- assets/example_hebrew.png +3 -0
- assets/examples/NOTICE +27 -0
- assets/examples/dutch_M40K1FS28A.phn +41 -0
- assets/examples/dutch_M40K1FS28A.wav +3 -0
- assets/examples/hebrew_phoneticlab_clip.wav +3 -0
- assets/examples/hebrew_phoneticlab_clip.wrd +5 -0
.gitattributes
CHANGED
|
@@ -1,3 +1,7 @@
|
|
| 1 |
*.fst filter=lfs diff=lfs merge=lfs -text
|
| 2 |
*.wav filter=lfs diff=lfs merge=lfs -text
|
| 3 |
assets/app_screen.jpeg filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
*.fst filter=lfs diff=lfs merge=lfs -text
|
| 2 |
*.wav filter=lfs diff=lfs merge=lfs -text
|
| 3 |
assets/app_screen.jpeg filter=lfs diff=lfs merge=lfs -text
|
| 4 |
+
assets/example_english.png filter=lfs diff=lfs merge=lfs -text
|
| 5 |
+
assets/example_dutch.png filter=lfs diff=lfs merge=lfs -text
|
| 6 |
+
assets/example_german.png filter=lfs diff=lfs merge=lfs -text
|
| 7 |
+
assets/example_hebrew.png filter=lfs diff=lfs merge=lfs -text
|
README.md
CHANGED
|
@@ -30,3 +30,28 @@ spectrogram · phoneme posteriors · Soft-DP path · contrastive score).
|
|
| 30 |
Example inputs are in `assets/` — the TIMIT sentence *"Don't ask me to carry an oily rag like that."*
|
| 31 |
in every supported format. The checkpoints are downloaded automatically from the weights repo on
|
| 32 |
first use (this runs on a free CPU Space, so the first alignment takes a moment to fetch a model).
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 30 |
Example inputs are in `assets/` — the TIMIT sentence *"Don't ask me to carry an oily rag like that."*
|
| 31 |
in every supported format. The checkpoints are downloaded automatically from the weights repo on
|
| 32 |
first use (this runs on a free CPU Space, so the first alignment takes a moment to fetch a model).
|
| 33 |
+
|
| 34 |
+
|
| 35 |
+
## Example alignments
|
| 36 |
+
|
| 37 |
+
The app's own output (waveform · spectrogram · phoneme posteriors · Soft-DP path ·
|
| 38 |
+
contrastive score) on real test utterances. Bundled inputs are in `assets/examples/`.
|
| 39 |
+
|
| 40 |
+
**English — TIMIT** (read speech, phoneme-level)
|
| 41 |
+
|
| 42 |
+

|
| 43 |
+
|
| 44 |
+
**Dutch — IFA** (zero-shot cross-lingual, phoneme-level)
|
| 45 |
+
|
| 46 |
+

|
| 47 |
+
|
| 48 |
+
**German — PHONDAT** (zero-shot; figure only — PHONDAT is licensed by BAS, not redistributed)
|
| 49 |
+
|
| 50 |
+

|
| 51 |
+
|
| 52 |
+
**Hebrew** (zero-shot, word-level, romanized transcript, no G2P model)
|
| 53 |
+
|
| 54 |
+

|
| 55 |
+
|
| 56 |
+
Example audio is for demonstration only and remains subject to each corpus's original
|
| 57 |
+
license — see `assets/examples/NOTICE`.
|
assets/example_dutch.png
ADDED
|
Git LFS Details
|
assets/example_english.png
ADDED
|
Git LFS Details
|
assets/example_german.png
ADDED
|
Git LFS Details
|
assets/example_hebrew.png
ADDED
|
Git LFS Details
|
assets/examples/NOTICE
ADDED
|
@@ -0,0 +1,27 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
FALCON demo — example audio credits and licenses
|
| 2 |
+
=================================================
|
| 3 |
+
|
| 4 |
+
The example utterances bundled in this repository are included solely to
|
| 5 |
+
demonstrate the aligner. Each clip remains subject to the original license of
|
| 6 |
+
the corpus it comes from; inclusion here does not grant any additional rights.
|
| 7 |
+
|
| 8 |
+
English — assets/fasw0sa2.{wav,phn,wrd,txt}
|
| 9 |
+
TIMIT Acoustic-Phonetic Continuous Speech Corpus (DARPA / NIST / LDC).
|
| 10 |
+
A single sentence, included for demonstration. TIMIT is distributed under
|
| 11 |
+
the LDC license; obtain your own copy for any further use.
|
| 12 |
+
|
| 13 |
+
Dutch — assets/examples/dutch_M40K1FS28A.{wav,phn}
|
| 14 |
+
IFA Spoken Language Corpus (R.J.J.H. van Son et al., Institute of Phonetic
|
| 15 |
+
Sciences, University of Amsterdam). Released under the GNU GPL v2 or later
|
| 16 |
+
("free as in speech").
|
| 17 |
+
http://www.fon.hum.uva.nl/IFA-SpokenLanguageCorpora/IFAcorpus/
|
| 18 |
+
|
| 19 |
+
Hebrew — assets/examples/hebrew_phoneticlab_clip.{wav,wrd}
|
| 20 |
+
Hebrew read-speech recording; word/phoneme annotations by the Speech,
|
| 21 |
+
Language and Deep Learning Lab. A short clipped excerpt, included for
|
| 22 |
+
demonstration and subject to its original license.
|
| 23 |
+
|
| 24 |
+
German — figure only (assets/example_german.png)
|
| 25 |
+
PHONDAT, licensed by the Bavarian Archive for Speech Signals (BAS). The
|
| 26 |
+
audio is NOT redistributed here; only the rendered alignment figure is
|
| 27 |
+
shown. Obtain PHONDAT from BAS to reproduce this example.
|
assets/examples/dutch_M40K1FS28A.phn
ADDED
|
@@ -0,0 +1,41 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
0 8295 sil
|
| 2 |
+
8295 8896 d
|
| 3 |
+
8896 10016 @
|
| 4 |
+
10016 10895 w
|
| 5 |
+
10895 12256 A
|
| 6 |
+
12256 13760 s
|
| 7 |
+
13760 14543 @
|
| 8 |
+
14543 16404 s
|
| 9 |
+
16404 17620 @n
|
| 10 |
+
17620 20339 O+
|
| 11 |
+
20339 20978 t
|
| 12 |
+
20978 21830 k
|
| 13 |
+
21830 22313 A
|
| 14 |
+
22313 23136 s
|
| 15 |
+
23136 24605 t
|
| 16 |
+
24605 26176 e
|
| 17 |
+
26176 28086 l
|
| 18 |
+
28086 30176 m
|
| 19 |
+
30176 31456 I
|
| 20 |
+
31456 32310 d
|
| 21 |
+
32310 33332 @
|
| 22 |
+
33332 34803 I
|
| 23 |
+
34803 35705 n
|
| 24 |
+
35705 36576 @
|
| 25 |
+
36576 38242 n
|
| 26 |
+
38242 38699 d
|
| 27 |
+
38699 39990 i
|
| 28 |
+
39990 41755 p
|
| 29 |
+
41755 42607 sil
|
| 30 |
+
42607 43296 E
|
| 31 |
+
43296 44806 n
|
| 32 |
+
44806 45276 d
|
| 33 |
+
45276 46496 O
|
| 34 |
+
46496 47559 N
|
| 35 |
+
47559 48487 k
|
| 36 |
+
48487 49298 @r
|
| 37 |
+
49298 50679 b
|
| 38 |
+
50679 52835 O
|
| 39 |
+
52835 56038 s
|
| 40 |
+
56038 63936 sil
|
| 41 |
+
63936 64562 sil
|
assets/examples/dutch_M40K1FS28A.wav
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:629495538d44f88350906cc69b1425df3dd0e8a057bccda5234bf23e0615138d
|
| 3 |
+
size 129168
|
assets/examples/hebrew_phoneticlab_clip.wav
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:b73c1975c809b85047d46266170b3278b0ae1c64c7234cf4856c4de000818160
|
| 3 |
+
size 54200
|
assets/examples/hebrew_phoneticlab_clip.wrd
ADDED
|
@@ -0,0 +1,5 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
800 5494 joshev
|
| 2 |
+
5494 8842 rosh
|
| 3 |
+
8842 13358 vadat
|
| 4 |
+
13358 17972 hxuts
|
| 5 |
+
17972 26278 vabitaxon
|