Spaces:

1c1
/

7cpc

Runtime error

7cpc / 8-bit

Create 8-bit

437761f verified 4 months ago

108 Bytes

	model = AutoModelForCausalLM.from_pretrained(
	model_name,
	device_map="auto",
	load_in_8bit=True
	)