MLSpeech commited on
Commit
c98cee1
·
verified ·
1 Parent(s): d20e0b7

Add multilingual example alignments + corpus credits to landing page

Browse files
.gitattributes CHANGED
@@ -1,3 +1,7 @@
1
  *.fst filter=lfs diff=lfs merge=lfs -text
2
  *.wav filter=lfs diff=lfs merge=lfs -text
3
  assets/app_screen.jpeg filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
1
  *.fst filter=lfs diff=lfs merge=lfs -text
2
  *.wav filter=lfs diff=lfs merge=lfs -text
3
  assets/app_screen.jpeg filter=lfs diff=lfs merge=lfs -text
4
+ assets/example_english.png filter=lfs diff=lfs merge=lfs -text
5
+ assets/example_dutch.png filter=lfs diff=lfs merge=lfs -text
6
+ assets/example_german.png filter=lfs diff=lfs merge=lfs -text
7
+ assets/example_hebrew.png filter=lfs diff=lfs merge=lfs -text
README.md CHANGED
@@ -30,3 +30,28 @@ spectrogram · phoneme posteriors · Soft-DP path · contrastive score).
30
  Example inputs are in `assets/` — the TIMIT sentence *"Don't ask me to carry an oily rag like that."*
31
  in every supported format. The checkpoints are downloaded automatically from the weights repo on
32
  first use (this runs on a free CPU Space, so the first alignment takes a moment to fetch a model).
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
30
  Example inputs are in `assets/` — the TIMIT sentence *"Don't ask me to carry an oily rag like that."*
31
  in every supported format. The checkpoints are downloaded automatically from the weights repo on
32
  first use (this runs on a free CPU Space, so the first alignment takes a moment to fetch a model).
33
+
34
+
35
+ ## Example alignments
36
+
37
+ The app's own output (waveform · spectrogram · phoneme posteriors · Soft-DP path ·
38
+ contrastive score) on real test utterances. Bundled inputs are in `assets/examples/`.
39
+
40
+ **English — TIMIT** (read speech, phoneme-level)
41
+
42
+ ![English](https://huggingface.co/spaces/MLSpeech/FALCON/resolve/main/assets/example_english.png)
43
+
44
+ **Dutch — IFA** (zero-shot cross-lingual, phoneme-level)
45
+
46
+ ![Dutch](https://huggingface.co/spaces/MLSpeech/FALCON/resolve/main/assets/example_dutch.png)
47
+
48
+ **German — PHONDAT** (zero-shot; figure only — PHONDAT is licensed by BAS, not redistributed)
49
+
50
+ ![German](https://huggingface.co/spaces/MLSpeech/FALCON/resolve/main/assets/example_german.png)
51
+
52
+ **Hebrew** (zero-shot, word-level, romanized transcript, no G2P model)
53
+
54
+ ![Hebrew](https://huggingface.co/spaces/MLSpeech/FALCON/resolve/main/assets/example_hebrew.png)
55
+
56
+ Example audio is for demonstration only and remains subject to each corpus's original
57
+ license — see `assets/examples/NOTICE`.
assets/example_dutch.png ADDED

Git LFS Details

  • SHA256: ca910f1347aebf617fbbd056f35e42e7c4c6788873c882dc37f0db03a557b77f
  • Pointer size: 131 Bytes
  • Size of remote file: 808 kB
assets/example_english.png ADDED

Git LFS Details

  • SHA256: 0630a4f9eedfa7f9e22e0cdbd7cd527b46bf07926729db7b2307d5fa2239c943
  • Pointer size: 131 Bytes
  • Size of remote file: 774 kB
assets/example_german.png ADDED

Git LFS Details

  • SHA256: a69ef0ee4213018e396fb91db258a8b2db5117b007d3dbfe1ad85d52be655015
  • Pointer size: 131 Bytes
  • Size of remote file: 523 kB
assets/example_hebrew.png ADDED

Git LFS Details

  • SHA256: b99ed1e06389a920b08024abe2bb5135625274cfaaa8bcae2459f23fb46ae50c
  • Pointer size: 131 Bytes
  • Size of remote file: 569 kB
assets/examples/NOTICE ADDED
@@ -0,0 +1,27 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ FALCON demo — example audio credits and licenses
2
+ =================================================
3
+
4
+ The example utterances bundled in this repository are included solely to
5
+ demonstrate the aligner. Each clip remains subject to the original license of
6
+ the corpus it comes from; inclusion here does not grant any additional rights.
7
+
8
+ English — assets/fasw0sa2.{wav,phn,wrd,txt}
9
+ TIMIT Acoustic-Phonetic Continuous Speech Corpus (DARPA / NIST / LDC).
10
+ A single sentence, included for demonstration. TIMIT is distributed under
11
+ the LDC license; obtain your own copy for any further use.
12
+
13
+ Dutch — assets/examples/dutch_M40K1FS28A.{wav,phn}
14
+ IFA Spoken Language Corpus (R.J.J.H. van Son et al., Institute of Phonetic
15
+ Sciences, University of Amsterdam). Released under the GNU GPL v2 or later
16
+ ("free as in speech").
17
+ http://www.fon.hum.uva.nl/IFA-SpokenLanguageCorpora/IFAcorpus/
18
+
19
+ Hebrew — assets/examples/hebrew_phoneticlab_clip.{wav,wrd}
20
+ Hebrew read-speech recording; word/phoneme annotations by the Speech,
21
+ Language and Deep Learning Lab. A short clipped excerpt, included for
22
+ demonstration and subject to its original license.
23
+
24
+ German — figure only (assets/example_german.png)
25
+ PHONDAT, licensed by the Bavarian Archive for Speech Signals (BAS). The
26
+ audio is NOT redistributed here; only the rendered alignment figure is
27
+ shown. Obtain PHONDAT from BAS to reproduce this example.
assets/examples/dutch_M40K1FS28A.phn ADDED
@@ -0,0 +1,41 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ 0 8295 sil
2
+ 8295 8896 d
3
+ 8896 10016 @
4
+ 10016 10895 w
5
+ 10895 12256 A
6
+ 12256 13760 s
7
+ 13760 14543 @
8
+ 14543 16404 s
9
+ 16404 17620 @n
10
+ 17620 20339 O+
11
+ 20339 20978 t
12
+ 20978 21830 k
13
+ 21830 22313 A
14
+ 22313 23136 s
15
+ 23136 24605 t
16
+ 24605 26176 e
17
+ 26176 28086 l
18
+ 28086 30176 m
19
+ 30176 31456 I
20
+ 31456 32310 d
21
+ 32310 33332 @
22
+ 33332 34803 I
23
+ 34803 35705 n
24
+ 35705 36576 @
25
+ 36576 38242 n
26
+ 38242 38699 d
27
+ 38699 39990 i
28
+ 39990 41755 p
29
+ 41755 42607 sil
30
+ 42607 43296 E
31
+ 43296 44806 n
32
+ 44806 45276 d
33
+ 45276 46496 O
34
+ 46496 47559 N
35
+ 47559 48487 k
36
+ 48487 49298 @r
37
+ 49298 50679 b
38
+ 50679 52835 O
39
+ 52835 56038 s
40
+ 56038 63936 sil
41
+ 63936 64562 sil
assets/examples/dutch_M40K1FS28A.wav ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:629495538d44f88350906cc69b1425df3dd0e8a057bccda5234bf23e0615138d
3
+ size 129168
assets/examples/hebrew_phoneticlab_clip.wav ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b73c1975c809b85047d46266170b3278b0ae1c64c7234cf4856c4de000818160
3
+ size 54200
assets/examples/hebrew_phoneticlab_clip.wrd ADDED
@@ -0,0 +1,5 @@
 
 
 
 
 
 
1
+ 800 5494 joshev
2
+ 5494 8842 rosh
3
+ 8842 13358 vadat
4
+ 13358 17972 hxuts
5
+ 17972 26278 vabitaxon