YAML Metadata Warning:empty or missing yaml metadata in repo card
Check out the documentation for more information.
BitsAndBytesConfig(
load_in_16bit=True,
bnb_16bit_use_double_quant=False,
bnb_16bit_compute_dtype=torch.float16,
bnb_16bit_quant_type="fp16"
)
Total parameters: 9,241,705,984
- Downloads last month
- 1