Update README.md
Browse files
README.md
CHANGED
|
@@ -169,16 +169,6 @@ and stick to more traditional fare. Yarr!</s>
|
|
| 169 |
|
| 170 |
[More Information Needed]
|
| 171 |
|
| 172 |
-
## Environmental Impact
|
| 173 |
-
|
| 174 |
-
Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
|
| 175 |
-
|
| 176 |
-
- **Hardware Type:** [More Information Needed]
|
| 177 |
-
- **Hours used:** [More Information Needed]
|
| 178 |
-
- **Cloud Provider:** [More Information Needed]
|
| 179 |
-
- **Compute Region:** [More Information Needed]
|
| 180 |
-
- **Carbon Emitted:** [More Information Needed]
|
| 181 |
-
|
| 182 |
## Technical Specifications [optional]
|
| 183 |
|
| 184 |
### Model Architecture and Objective
|
|
@@ -211,7 +201,6 @@ Carbon emissions can be estimated using the [Machine Learning Impact calculator]
|
|
| 211 |
|
| 212 |
[More Information Needed]
|
| 213 |
|
| 214 |
-
## More Information [optional]
|
| 215 |
|
| 216 |
[More Information Needed]
|
| 217 |
|
|
@@ -235,4 +224,8 @@ The following `bitsandbytes` quantization config was used during training:
|
|
| 235 |
|
| 236 |
- PEFT 0.6.3.dev0
|
| 237 |
|
| 238 |
-
-->
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 169 |
|
| 170 |
[More Information Needed]
|
| 171 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 172 |
## Technical Specifications [optional]
|
| 173 |
|
| 174 |
### Model Architecture and Objective
|
|
|
|
| 201 |
|
| 202 |
[More Information Needed]
|
| 203 |
|
|
|
|
| 204 |
|
| 205 |
[More Information Needed]
|
| 206 |
|
|
|
|
| 224 |
|
| 225 |
- PEFT 0.6.3.dev0
|
| 226 |
|
| 227 |
+
-->
|
| 228 |
+
## More Information [optional]
|
| 229 |
+
|
| 230 |
+
[Zephyr-7B-β](https://arxiv.org/abs/2305.18290) is a fine-tuned version of [mistralai/Mistral-7B-v0.1](https://huggingface.co/mistralai/Mistral-7B-v0.1)
|
| 231 |
+
[Zephyr-7B technical report](https://arxiv.org/abs/2310.16944).
|