trfms-integration
#23
by
eustlb HF Staff - opened
patrickvonplatenAdded from https://github.com/huggingface/transformers/pull/43769#issue-3901823756
Eval results (copied over from README):
| Dataset | Original (vllm) | This PR (trfms) | Δ |
|---|---|---|---|
| AMI (test) | 0.1708 | 0.1707 | -0.0001 |
| LibriSpeech (test.clean) | 0.0209 | 0.0209 | 0.0000 |
| FLEURS (en_us/test) | 0.1209 | 0.1228 | +0.0019 |
| FLEURS (fr_fr/test) | 0.0883 | 0.0887 | +0.0004 |
| FLEURS (de_de/test) | 0.0597 | 0.0597 | 0.0000 |
| FLEURS (hi_in/test) | 0.1718 | 0.1736 | +0.0018 |
Gotten from https://gist.github.com/eustlb/367f062f77a5971291fb5350763bea8d
eustlb changed pull request status to
open
Thanks a bunch @eustlb - I'll change the README a bit because I'm having trouble installed torchdecodec for datasets
patrickvonplaten changed pull request status to
merged
Got the following error with datasets
OSError: libavutil.so.59: cannot open shared object file: No such file or directory
FFmpeg version 6:
Traceback (most recent call last):
File "/usr/local/lib/python3.12/dist-packages/torchcodec/_core/ops.py", line 57, in load_torchcodec_shared_libraries
torch.ops.load_library(core_library_path)
File "/usr/local/lib/python3.12/dist-packages/torch/_ops.py", line 1392, in load_library
ctypes.CDLL(path)
File "/usr/lib/python3.12/ctypes/__init__.py", line 379, in __init__
self._handle = _dlopen(self._name, mode)
^^^^^^^^^^^^^^^^^^^^^^^^^
OSError: /usr/local/lib/python3.12/dist-packages/torchcodec/libtorchcodec_core6.so: undefined symbol: _ZN3c1013MessageLogger6streamB5cxx11Ev
FFmpeg version 5:
Traceback (most recent call last):
File "/usr/local/lib/python3.12/dist-packages/torchcodec/_core/ops.py", line 57, in load_torchcodec_shared_libraries
torch.ops.load_library(core_library_path)
File "/usr/local/lib/python3.12/dist-packages/torch/_ops.py", line 1392, in load_library
ctypes.CDLL(path)
File "/usr/lib/python3.12/ctypes/__init__.py", line 379, in __init__
self._handle = _dlopen(self._name, mode)
^^^^^^^^^^^^^^^^^^^^^^^^^
OSError: libavutil.so.57: cannot open shared object file: No such file or directory
FFmpeg version 4:
Traceback (most recent call last):
File "/usr/local/lib/python3.12/dist-packages/torchcodec/_core/ops.py", line 57, in load_torchcodec_shared_libraries
torch.ops.load_library(core_library_path)
File "/usr/local/lib/python3.12/dist-packages/torch/_ops.py", line 1392, in load_library
ctypes.CDLL(path)
File "/usr/lib/python3.12/ctypes/__init__.py", line 379, in __init__
self._handle = _dlopen(self._name, mode)
^^^^^^^^^^^^^^^^^^^^^^^^^
OSError: libavutil.so.56: cannot open shared object file: No such file or directory
[end of libtorchcodec loading traceback].