RuntimeError: Failed to import transformers.generation.utils because of the following error: register_pytree_node() got an unexpected keyword argument 'flatten_with_keys_fn'

#2
by sreesdas - opened

Traceback (most recent call last):
File "/Users/sree/miniconda3/lib/python3.12/site-packages/transformers/utils/import_utils.py", line 1968, in _get_module
return importlib.import_module("." + module_name, self.name)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/Users/sree/miniconda3/lib/python3.12/importlib/init.py", line 90, in import_module
return _bootstrap._gcd_import(name[level:], package, level)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "", line 1387, in _gcd_import
File "", line 1360, in _find_and_load
File "", line 1331, in _find_and_load_unlocked
File "", line 935, in _load_unlocked
File "", line 995, in exec_module
File "", line 488, in _call_with_frames_removed
File "/Users/sree/miniconda3/lib/python3.12/site-packages/transformers/generation/utils.py", line 30, in
from transformers.generation.candidate_generator import AssistantVocabTranslatorCache
File "/Users/sree/miniconda3/lib/python3.12/site-packages/transformers/generation/candidate_generator.py", line 29, in
from ..cache_utils import DynamicCache
File "/Users/sree/miniconda3/lib/python3.12/site-packages/transformers/cache_utils.py", line 589, in
torch.utils._pytree.register_pytree_node(
TypeError: register_pytree_node() got an unexpected keyword argument 'flatten_with_keys_fn'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "/Users/sree/miniconda3/lib/python3.12/site-packages/transformers/utils/import_utils.py", line 1968, in _get_module
return importlib.import_module("." + module_name, self.name)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/Users/sree/miniconda3/lib/python3.12/importlib/init.py", line 90, in import_module
return _bootstrap._gcd_import(name[level:], package, level)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "", line 1387, in _gcd_import
File "", line 1360, in _find_and_load
File "", line 1331, in _find_and_load_unlocked
File "", line 935, in _load_unlocked
File "", line 995, in exec_module
File "", line 488, in _call_with_frames_removed
File "/Users/sree/miniconda3/lib/python3.12/site-packages/transformers/models/auto/processing_auto.py", line 32, in
from .auto_factory import _LazyAutoMapping
File "/Users/sree/miniconda3/lib/python3.12/site-packages/transformers/models/auto/auto_factory.py", line 40, in
from ...generation import GenerationMixin
File "", line 1412, in _handle_fromlist
File "/Users/sree/miniconda3/lib/python3.12/site-packages/transformers/utils/import_utils.py", line 1956, in getattr
module = self._get_module(self._class_to_module[name])
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/Users/sree/miniconda3/lib/python3.12/site-packages/transformers/utils/import_utils.py", line 1970, in _get_module
raise RuntimeError(
RuntimeError: Failed to import transformers.generation.utils because of the following error (look up to see its traceback):
register_pytree_node() got an unexpected keyword argument 'flatten_with_keys_fn'

The above exception was the direct cause of the following exception:

sreesdas changed discussion title from RuntimeError: Failed to import transformers.generation.utils because of the following error to RuntimeError: Failed to import transformers.generation.utils because of the following error: register_pytree_node() got an unexpected keyword argument 'flatten_with_keys_fn'
sreesdas changed discussion status to closed

Sign up or log in to comment