Fix non-ASCII characters in README
Browse files
README.md
CHANGED
|
@@ -8,9 +8,9 @@ tags:
|
|
| 8 |
|
| 9 |
[](https://doi.org/10.5281/zenodo.20279247)
|
| 10 |
|
| 11 |
-
# Mistral 7B Instruct v0.3
|
| 12 |
|
| 13 |
-
> **14.20 GB
|
| 14 |
|
| 15 |
## Use it in 2 lines
|
| 16 |
|
|
@@ -53,7 +53,7 @@ model = BigSmallStreamingModel.from_pretrained(
|
|
| 53 |
)
|
| 54 |
```
|
| 55 |
|
| 56 |
-
Uses up to ~12
|
| 57 |
|
| 58 |
## Stream straight from the Hub (no disk)
|
| 59 |
|
|
@@ -91,8 +91,8 @@ See [github.com/wpferrell/Bigsmall](https://github.com/wpferrell/Bigsmall) for t
|
|
| 91 |
|
| 92 |
## License
|
| 93 |
|
| 94 |
-
- **Model weights:** apache-2.0
|
| 95 |
-
- **BigSmall format:** [Elastic License 2.0](https://github.com/wpferrell/Bigsmall/blob/main/LICENSE)
|
| 96 |
- **Commercial SaaS licensing:** wpferrell@gmail.com
|
| 97 |
|
| 98 |
## Citation
|
|
|
|
| 8 |
|
| 9 |
[](https://doi.org/10.5281/zenodo.20279247)
|
| 10 |
|
| 11 |
+
# Mistral 7B Instruct v0.3 -- Lossless Compressed
|
| 12 |
|
| 13 |
+
> **14.20 GB - 8.87 GB (38% smaller). Bit-identical weights. Drop-in replacement.**
|
| 14 |
|
| 15 |
## Use it in 2 lines
|
| 16 |
|
|
|
|
| 53 |
)
|
| 54 |
```
|
| 55 |
|
| 56 |
+
Uses up to ~12- less VRAM than standard loading by streaming layers on demand.
|
| 57 |
|
| 58 |
## Stream straight from the Hub (no disk)
|
| 59 |
|
|
|
|
| 91 |
|
| 92 |
## License
|
| 93 |
|
| 94 |
+
- **Model weights:** apache-2.0 -- same as [mistralai/Mistral-7B-Instruct-v0.3](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.3).
|
| 95 |
+
- **BigSmall format:** [Elastic License 2.0](https://github.com/wpferrell/Bigsmall/blob/main/LICENSE) -- free for personal, research, and commercial use.
|
| 96 |
- **Commercial SaaS licensing:** wpferrell@gmail.com
|
| 97 |
|
| 98 |
## Citation
|