cgg507

/

Behemoth-R1-123B-v2-aqlm

like 0

• "torch.BFloat16Storage",
• "torch.bfloat16",
• "__builtin__.set",
• "transformers.models.mistral.modeling_mistral.MistralRotaryEmbedding",
• "torch._utils._rebuild_tensor_v2",
• "transformers.models.mistral.configuration_mistral.MistralConfig",
• "collections.OrderedDict",
• "src.aq.QuantizedWeight",
• "torch.IntStorage",
• "torch._utils._rebuild_parameter",
• "src.aq.QuantizedLinear",
• "transformers.models.mistral.modeling_mistral.MistralRMSNorm",
• "torch.nn.modules.activation.SiLU",
• "transformers.models.mistral.modeling_mistral.MistralMLP",
• "transformers.models.mistral.modeling_mistral.MistralDecoderLayer",
• "transformers.models.mistral.modeling_mistral.MistralAttention"

How to fix it?