benjamin-paine

/

hey-buddy

like 10

HI team,

working very hard to train the my custom wake up word model using hey buddy,

got the ffmpeg error again and again , after doing everything

updating ffmpeg version, installing with cuda support, still not able to resolve this ffmpeg error.

error logs attached below

Generating train split: 100% 270/270 [00:00<00:00, 16008.57 examples/s]

Generating augmented samples: 0% 0/25000 [00:00<?, ?it/s]/usr/local/lib/python3.11/dist-packages/speechbrain/utils/torch_audio_backend.py:57: UserWarning: torchaudio._backend.list_audio_backends has been deprecated. This deprecation is part of a large refactoring effort to transition TorchAudio into a maintenance phase. The decoding and encoding capabilities of PyTorch for both audio and video are being consolidated into TorchCodec. Please see https://github.com/pytorch/audio/issues/3902 for more information. It will be removed from the 2.9 release.
available_backends = torchaudio.list_audio_backends()
2025-08-17 10:17:00,108 [speechbrain.utils.quirks] INFO (quirks.py:115) Applied quirks (see speechbrain.utils.quirks): [disable_jit_profiling, allow_tf32]
2025-08-17 10:17:00,108 [speechbrain.utils.quirks] INFO (quirks.py:115) Applied quirks (see speechbrain.utils.quirks): [disable_jit_profiling, allow_tf32]
2025-08-17 10:17:00,108 [speechbrain.utils.quirks] INFO (quirks.py:120) Excluded quirks specified by the SB_DISABLE_QUIRKS environment (comma-separated list): []
2025-08-17 10:17:00,108 [speechbrain.utils.quirks] INFO (quirks.py:120) Excluded quirks specified by the SB_DISABLE_QUIRKS environment (comma-separated list): []
Generating augmented samples: 0% 0/25000 [00:04<?, ?it/s]
Generating features: 0% 0/4 [14:18<?, ?batch/s]
concurrent.futures.process._RemoteTraceback:
"""
Traceback (most recent call last):
File "/usr/lib/python3.11/concurrent/futures/process.py", line 261, in _process_worker
r = call_item.fn(*call_item.args, **call_item.kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/heybuddy/dataset/features.py", line 445, in generate
samples = [
^
File "/usr/local/lib/python3.11/dist-packages/heybuddy/dataset/features.py", line 445, in
samples = [
^
File "/usr/local/lib/python3.11/dist-packages/tqdm/std.py", line 1181, in iter
for obj in iterable:
File "/usr/local/lib/python3.11/dist-packages/heybuddy/dataset/augmented.py", line 413, in call
batch_results = self.execute_augment_batch([
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/heybuddy/dataset/augmented.py", line 391, in execute_augment_batch
self.get_next_impulse_response(),
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/heybuddy/dataset/augmented.py", line 192, in get_next_impulse_response
return self.get_next_audio_dataset_waveform("impulse_response_dataset")
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/heybuddy/dataset/augmented.py", line 172, in get_next_audio_dataset_waveform
data = torch.from_numpy(next_dataset_dict["audio"]["array"]).to(self.device, dtype=torch.float32)
~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/datasets/features/_torchcodec.py", line 8, in getitem
y = self.get_all_samples().data.cpu().numpy()
^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/torchcodec/decoders/_audio_decoder.py", line 98, in get_all_samples
return self.get_samples_played_in_range()
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/torchcodec/decoders/_audio_decoder.py", line 127, in get_samples_played_in_range
frames, first_pts = core.get_frames_by_pts_in_range_audio(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/torch/_ops.py", line 829, in call
return self._op(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^
RuntimeError: The frame has 0 channels, expected 1. If you are hitting this, it may be because you are using a buggy FFmpeg version. FFmpeg4 is known to fail here in some valid scenarios. Try to upgrade FFmpeg?
"""

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "/usr/local/bin/heybuddy", line 8, in
sys.exit(main())
^^^^^^
File "/usr/local/lib/python3.11/dist-packages/click/core.py", line 1442, in call
return self.main(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/click/core.py", line 1363, in main
rv = self.invoke(ctx)
^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/click/core.py", line 1830, in invoke
return _process_result(sub_ctx.command.invoke(sub_ctx))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/click/core.py", line 1226, in invoke
return ctx.invoke(self.callback, **ctx.params)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/click/core.py", line 794, in invoke
return callback(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/heybuddy/main.py", line 345, in train
training, validation, testing = WakeWordTrainingDatasetIterator.all(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/heybuddy/dataset/training.py", line 814, in all
training = cls.default(
^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/heybuddy/dataset/training.py", line 364, in default
positive_features, adversarial_features = TrainingFeaturesGenerator.get_training_features(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/heybuddy/dataset/features.py", line 749, in get_training_features
positive_features = positive(
^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/heybuddy/dataset/features.py", line 532, in call
sample_feature_batches.append(future.result())
^^^^^^^^^^^^^^^
File "/usr/lib/python3.11/concurrent/futures/_base.py", line 456, in result
return self.__get_result()
^^^^^^^^^^^^^^^^^^^
File "/usr/lib/python3.11/concurrent/futures/_base.py", line 401, in __get_result
raise self._exception
RuntimeError: The frame has 0 channels, expected 1. If you are hitting this, it may be because you are using a buggy FFmpeg version. FFmpeg4 is known to fail here in some valid scenarios. Try to upgrade FFmpeg?