optimum/pr_2484/en/utils/normalized_config.md

Normalized Configurations

Model configuration classes in 🤗 Transformers are not standardized. Although Transformers implements an attribute_map attribute that mitigates the issue to some extent, it does not make it easy to reason on common configuration attributes in the code. NormalizedConfig classes try to fix that by allowing access to the configuration attribute they wrap in a standardized way.

Base class[[optimum.utils.NormalizedConfig]]

While it is possible to create NormalizedConfig subclasses for common use-cases, it is also possible to overwrite the original attribute name -> normalized attribute name mapping directly using the with_args() class method.

optimum.utils.NormalizedConfig[[optimum.utils.NormalizedConfig]]

optimum.utils.NormalizedConfig(config: typing.Union[ForwardRef('PretrainedConfig'), typing.Dict], allow_new: bool = False, **kwargs)

Source

Parameters:

config (PretrainedConfig) : The config to normalize.

Handles the normalization of PretrainedConfig attribute names, allowing to access attributes in a general way.

Existing normalized configurations[[optimum.utils.NormalizedTextConfig]]

optimum.utils.NormalizedTextConfig[[optimum.utils.NormalizedTextConfig]]

optimum.utils.NormalizedTextConfig(config: typing.Union[ForwardRef('PretrainedConfig'), typing.Dict], allow_new: bool = False, **kwargs)

Source

optimum.utils.NormalizedSeq2SeqConfig[[optimum.utils.NormalizedSeq2SeqConfig]]

optimum.utils.NormalizedSeq2SeqConfig(config: typing.Union[ForwardRef('PretrainedConfig'), typing.Dict], allow_new: bool = False, **kwargs)

Source

optimum.utils.NormalizedVisionConfig[[optimum.utils.NormalizedVisionConfig]]

optimum.utils.NormalizedVisionConfig(config: typing.Union[ForwardRef('PretrainedConfig'), typing.Dict], allow_new: bool = False, **kwargs)

Source

optimum.utils.NormalizedTextAndVisionConfig[[optimum.utils.NormalizedTextAndVisionConfig]]

optimum.utils.NormalizedTextAndVisionConfig(config: typing.Union[ForwardRef('PretrainedConfig'), typing.Dict], allow_new: bool = False, **kwargs)

Source