KnutJaegersberg commited on
Commit
9ccba2d
·
verified ·
1 Parent(s): 3100280

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +11 -0
README.md CHANGED
@@ -5,5 +5,16 @@ license_link: LICENSE
5
  ---
6
 
7
 
 
 
 
 
 
 
 
 
 
 
 
8
  4-bit params: {'load_in_4bit': True, 'bnb_4bit_compute_dtype':
9
  torch.float16, 'bnb_4bit_quant_type': 'nf4', 'bnb_4bit_use_double_quant': True}
 
5
  ---
6
 
7
 
8
+ # Prompt Format:
9
+
10
+ ```
11
+ ### Instruction: {question}
12
+
13
+ ### Response: {response}
14
+ ```
15
+
16
+
17
+ Use these options to load with bnb:
18
+
19
  4-bit params: {'load_in_4bit': True, 'bnb_4bit_compute_dtype':
20
  torch.float16, 'bnb_4bit_quant_type': 'nf4', 'bnb_4bit_use_double_quant': True}