orukeet / report /current-benchmark-values.tex
NathanRoll's picture
Prepare the Orukeet v0.1.0 model card, report, benchmark scores and citations
769e303 verified
Raw
History Blame Contribute Delete
875 Bytes
% Generated from audited r3 edit counts.
\newcommand{\LibriCleanParakeetWER}{1.53}
\newcommand{\LibriCleanOrukeetWER}{1.46}
\newcommand{\LibriOtherParakeetWER}{3.14}
\newcommand{\LibriOtherOrukeetWER}{2.86}
\newcommand{\FleursEnglishParakeetWER}{4.28}
\newcommand{\FleursEnglishOrukeetWER}{3.82}
\newcommand{\FleursPooledParakeetWER}{11.01}
\newcommand{\FleursPooledOrukeetWER}{9.85}
\newcommand{\DomainPooledParakeetWER}{16.72}
\newcommand{\DomainPooledOrukeetWER}{15.25}
\newcommand{\DomainEnglishParakeetWER}{9.51}
\newcommand{\DomainEnglishOrukeetWER}{8.84}
\newcommand{\FleursMacroParakeetWER}{11.07}
\newcommand{\FleursMacroOrukeetWER}{9.96}
\newcommand{\FleursWins}{23}
\newcommand{\StandardWins}{25}
\newcommand{\DomainWins}{36}
\newcommand{\DomainEnglishWins}{20}
\newcommand{\TestedWins}{61}
\newcommand{\TestedSplits}{74}
\newcommand{\FleursPooledReduction}{10.6}