File size: 1,549 Bytes
caa4d98
 
c455f07
caa4d98
8484418
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
추론 시 lm-eval-harness 의 ARC 기본 prompt 형식 사용 (Question: {q}\nAnswer: {a})

[추론 예시]

```python
from transformers import AutoModelForCausalLM, AutoTokenizer                                                                                                          
                                                                                                                                                                        
model_id = "torchtorchkimtorch/up_model"                                                                                           
 
tokenizer = AutoTokenizer.from_pretrained(model_id)                                                                                                                   
model = AutoModelForCausalLM.from_pretrained(model_id)    
                                                                                                                                                                      
prompt = "Question: What do cells break down to produce energy?\nAnswer:"                                                                                             
inputs = tokenizer(prompt, return_tensors="pt")                                                                                                                       
outputs = model.generate(**inputs, max_new_tokens=512, do_sample=False)                                                                                               
print(tokenizer.decode(outputs[0], skip_special_tokens=True))
```