mss6 commited on
Commit
e62ca53
·
verified ·
1 Parent(s): 112b6d0

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +17 -192
README.md CHANGED
@@ -4,6 +4,15 @@ tags: []
4
  ---
5
  # Sample code
6
  ```python
 
 
 
 
 
 
 
 
 
7
  from transformers import (
8
  AutoModelForCausalLM,
9
  AutoTokenizer,
@@ -69,197 +78,13 @@ with open(f"/content/drive/MyDrive/{jsonl_id}-outputs.jsonl", 'w', encoding='utf
69
  f.write('\n')
70
 
71
  ```
72
- # Model Card for Model ID
73
-
74
- <!-- Provide a quick summary of what the model is/does. -->
75
-
76
-
77
-
78
- ## Model Details
79
-
80
- ### Model Description
81
-
82
- <!-- Provide a longer summary of what this model is. -->
83
-
84
- This is the model card of a 🤗 transformers model that has been pushed on the Hub. This model card has been automatically generated.
85
-
86
- - **Developed by:** [More Information Needed]
87
- - **Funded by [optional]:** [More Information Needed]
88
- - **Shared by [optional]:** [More Information Needed]
89
- - **Model type:** [More Information Needed]
90
- - **Language(s) (NLP):** [More Information Needed]
91
- - **License:** [More Information Needed]
92
- - **Finetuned from model [optional]:** [More Information Needed]
93
-
94
- ### Model Sources [optional]
95
-
96
- <!-- Provide the basic links for the model. -->
97
-
98
- - **Repository:** [More Information Needed]
99
- - **Paper [optional]:** [More Information Needed]
100
- - **Demo [optional]:** [More Information Needed]
101
-
102
- ## Uses
103
-
104
- <!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
105
-
106
- ### Direct Use
107
-
108
- <!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
109
-
110
- [More Information Needed]
111
-
112
- ### Downstream Use [optional]
113
-
114
- <!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
115
-
116
- [More Information Needed]
117
-
118
- ### Out-of-Scope Use
119
-
120
- <!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
121
-
122
- [More Information Needed]
123
-
124
- ## Bias, Risks, and Limitations
125
-
126
- <!-- This section is meant to convey both technical and sociotechnical limitations. -->
127
-
128
- [More Information Needed]
129
-
130
- ### Recommendations
131
-
132
- <!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
133
-
134
- Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
135
-
136
- ## How to Get Started with the Model
137
-
138
- Use the code below to get started with the model.
139
-
140
- [More Information Needed]
141
-
142
- ## Training Details
143
-
144
- ### Training Data
145
-
146
- <!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
147
-
148
- [More Information Needed]
149
-
150
- ### Training Procedure
151
-
152
- <!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
153
-
154
- #### Preprocessing [optional]
155
-
156
- [More Information Needed]
157
-
158
-
159
- #### Training Hyperparameters
160
-
161
- - **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
162
-
163
- #### Speeds, Sizes, Times [optional]
164
-
165
- <!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
166
-
167
- [More Information Needed]
168
-
169
- ## Evaluation
170
-
171
- <!-- This section describes the evaluation protocols and provides the results. -->
172
-
173
- ### Testing Data, Factors & Metrics
174
-
175
- #### Testing Data
176
-
177
- <!-- This should link to a Dataset Card if possible. -->
178
-
179
- [More Information Needed]
180
-
181
- #### Factors
182
-
183
- <!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
184
-
185
- [More Information Needed]
186
-
187
- #### Metrics
188
-
189
- <!-- These are the evaluation metrics being used, ideally with a description of why. -->
190
-
191
- [More Information Needed]
192
-
193
- ### Results
194
-
195
- [More Information Needed]
196
-
197
- #### Summary
198
-
199
-
200
-
201
- ## Model Examination [optional]
202
-
203
- <!-- Relevant interpretability work for the model goes here -->
204
-
205
- [More Information Needed]
206
-
207
- ## Environmental Impact
208
-
209
- <!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
210
-
211
- Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
212
-
213
- - **Hardware Type:** [More Information Needed]
214
- - **Hours used:** [More Information Needed]
215
- - **Cloud Provider:** [More Information Needed]
216
- - **Compute Region:** [More Information Needed]
217
- - **Carbon Emitted:** [More Information Needed]
218
-
219
- ## Technical Specifications [optional]
220
-
221
- ### Model Architecture and Objective
222
-
223
- [More Information Needed]
224
-
225
- ### Compute Infrastructure
226
-
227
- [More Information Needed]
228
-
229
- #### Hardware
230
-
231
- [More Information Needed]
232
-
233
- #### Software
234
-
235
- [More Information Needed]
236
-
237
- ## Citation [optional]
238
-
239
- <!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
240
-
241
- **BibTeX:**
242
-
243
- [More Information Needed]
244
-
245
- **APA:**
246
-
247
- [More Information Needed]
248
-
249
- ## Glossary [optional]
250
-
251
- <!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
252
-
253
- [More Information Needed]
254
-
255
- ## More Information [optional]
256
-
257
- [More Information Needed]
258
-
259
- ## Model Card Authors [optional]
260
-
261
- [More Information Needed]
262
 
263
- ## Model Card Contact
264
 
265
- [More Information Needed]
 
 
 
 
 
 
4
  ---
5
  # Sample code
6
  ```python
7
+
8
+ !pip install -U bitsandbytes
9
+ !pip install -U transformers
10
+ !pip install -U accelerate
11
+ !pip install -U datasets
12
+ !pip install -U peft
13
+
14
+ !pip install ipywidgets --upgrade
15
+
16
  from transformers import (
17
  AutoModelForCausalLM,
18
  AutoTokenizer,
 
78
  f.write('\n')
79
 
80
  ```
81
+ ## Datasets
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
82
 
83
+ ### Instruction tuning
84
 
85
+ The models have been fine-tuned on the following datasets.
86
+
87
+ | Language | Dataset | url |
88
+ |:---|:---|:---|
89
+ |Japanese| ichikara-instruction | [ichikara-instruction](https://liat-aip.sakura.ne.jp/wp/llm%E3%81%AE%E3%81%9F%E3%82%81%E3%81%AE%E6%97%A5%E6%9C%AC%E8%AA%9E%E3%82%A4%E3%83%B3%E3%82%B9%E3%83%88%E3%83%A9%E3%82%AF%E3%82%B7%E3%83%A7%E3%83%B3%E3%83%87%E3%83%BC%E3%82%BF%E4%BD%9C%E6%88%90/llm%E3%81%AE%E3%81%9F%E3%82%81%E3%81%AE%E6%97%A5%E6%9C%AC%E8%AA%9E%E3%82%A4%E3%83%B3%E3%82%B9%E3%83%88%E3%83%A9%E3%82%AF%E3%82%B7%E3%83%A7%E3%83%B3%E3%83%87%E3%83%BC%E3%82%BF-%E5%85%AC%E9%96%8B/) |
90
+ | | Synthesized data from Elyza-tasks-100| [Elyza-tasks-100](https://huggingface.co/datasets/elyza/ELYZA-tasks-100)|