Hugging Face's logo

USTC-KnowledgeComputingLab
/
Llama3-KALE-LM-Chem-8B

Text Generation
PyTorch
English
llama
KALE-LM
science
chemistry
conversational
Model card Files
xet
Community
4
KnowledgeComputingLab commited on
Commit
40ceb07
·
verified ·
1 Parent(s): e81c954

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -54,7 +54,7 @@ device = "cuda" # the device to load the model onto
54
 
55
  model = AutoModelForCausalLM.from_pretrained(
56
  "USTC-KnowledgeComputingLab/Llama3-KALE-LM-Chem-8B",
57
- torch_dtype=torch.float16,
58
  device_map="auto"
59
  )
60
  tokenizer = AutoTokenizer.from_pretrained("USTC-KnowledgeComputingLab/Llama3-KALE-LM-Chem-8B")
 
54
 
55
  model = AutoModelForCausalLM.from_pretrained(
56
  "USTC-KnowledgeComputingLab/Llama3-KALE-LM-Chem-8B",
57
+ torch_dtype="auto",
58
  device_map="auto"
59
  )
60
  tokenizer = AutoTokenizer.from_pretrained("USTC-KnowledgeComputingLab/Llama3-KALE-LM-Chem-8B")