Update README.md
Browse files
README.md
CHANGED
|
@@ -1,99 +1,14 @@
|
|
| 1 |
-
---
|
| 2 |
-
language:
|
| 3 |
-
- en
|
| 4 |
-
|
| 5 |
-
|
| 6 |
-
-
|
| 7 |
-
|
| 8 |
-
-
|
| 9 |
-
-
|
| 10 |
-
|
| 11 |
-
|
| 12 |
-
-
|
| 13 |
-
|
| 14 |
-
|
| 15 |
-
base_model: "google/gemma-2b"
|
| 16 |
-
---
|
| 17 |
-
|
| 18 |
-
# Gemma 2B Quantized 4-bit
|
| 19 |
-
|
| 20 |
-
This repository contains a 4-bit quantized version of the [Gemma 2B](https://huggingface.co/google/gemma-2b) model.
|
| 21 |
-
|
| 22 |
-
## Files
|
| 23 |
-
|
| 24 |
-
- `config.json`: Model configuration.
|
| 25 |
-
- `generation_config.json`: Generation parameters.
|
| 26 |
-
- `model.safetensors`: Quantized model weights.
|
| 27 |
-
- `special_tokens_map.json`: Special tokens mapping.
|
| 28 |
-
- `tokenizer_config.json`: Tokenizer configuration.
|
| 29 |
-
- `tokenizer.json`: Tokenizer vocabulary.
|
| 30 |
-
|
| 31 |
-
## Usage
|
| 32 |
-
|
| 33 |
-
You can load this model using the Hugging Face Transformers library:
|
| 34 |
-
|
| 35 |
-
```python
|
| 36 |
-
from transformers import AutoModelForCausalLM, AutoTokenizer
|
| 37 |
-
|
| 38 |
-
model = AutoModelForCausalLM.from_pretrained("your-username/gemma-2b-quantized-4bit")
|
| 39 |
-
tokenizer = AutoTokenizer.from_pretrained("your-username/gemma-2b-quantized-4bit")
|
| 40 |
-
```
|
| 41 |
-
|
| 42 |
-
## License
|
| 43 |
-
|
| 44 |
-
This model is licensed under the Apache 2.0 License. See [LICENSE](./LICENSE) for details.
|
| 45 |
-
|
| 46 |
-
## Credits
|
| 47 |
-
|
| 48 |
-
- Original model: [Gemma 2B](https://huggingface.co/google/gemma-2b)
|
| 49 |
-
- Quantization: 4-bit
|
| 50 |
-
```
|
| 51 |
-
|
| 52 |
-
```text:LICENSE
|
| 53 |
-
Apache License
|
| 54 |
-
Version 2.0, January 2004
|
| 55 |
-
http://www.apache.org/licenses/
|
| 56 |
-
|
| 57 |
-
TERMS AND CONDITIONS FOR USE, REPRODUCTION, AND DISTRIBUTION
|
| 58 |
-
|
| 59 |
-
Licensed under the Apache License, Version 2.0 (the "License");
|
| 60 |
-
you may not use this file except in compliance with the License.
|
| 61 |
-
You may obtain a copy of the License at
|
| 62 |
-
|
| 63 |
-
http://www.apache.org/licenses/LICENSE-2.0
|
| 64 |
-
|
| 65 |
-
Unless required by applicable law or agreed to in writing, software
|
| 66 |
-
distributed under the License is distributed on an "AS IS" BASIS,
|
| 67 |
-
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
|
| 68 |
-
See the License for the specific language governing permissions and
|
| 69 |
-
limitations under the License.
|
| 70 |
-
```
|
| 71 |
-
|
| 72 |
-
```gitignore
|
| 73 |
-
# System files
|
| 74 |
-
.DS_Store
|
| 75 |
-
Thumbs.db
|
| 76 |
-
|
| 77 |
-
# Python cache
|
| 78 |
-
__pycache__/
|
| 79 |
-
*.pyc
|
| 80 |
-
|
| 81 |
-
# Jupyter Notebook checkpoints
|
| 82 |
-
.ipynb_checkpoints/
|
| 83 |
-
|
| 84 |
-
# VSCode settings
|
| 85 |
-
.vscode/
|
| 86 |
-
|
| 87 |
-
# Large files (remove if you want to include model weights in git)
|
| 88 |
-
*.safetensors
|
| 89 |
-
```
|
| 90 |
-
|
| 91 |
-
---
|
| 92 |
-
|
| 93 |
-
**What to do next:**
|
| 94 |
-
- Fill in the placeholders in `README.md` (thumbnail, datasets, etc.).
|
| 95 |
-
- If you want to include `model.safetensors` in your GitHub repo, remove `*.safetensors` from `.gitignore`.
|
| 96 |
-
- Initialize git, commit, and push to GitHub.
|
| 97 |
-
- You’re now ready to upload to Hugging Face!
|
| 98 |
-
|
| 99 |
-
Let me know if you want any further customization or help with the git/Hugging Face steps!
|
|
|
|
| 1 |
+
---
|
| 2 |
+
language:
|
| 3 |
+
- en
|
| 4 |
+
library_name: transformers
|
| 5 |
+
pipeline_tag: text-generation
|
| 6 |
+
base_model: google/gemma-2b
|
| 7 |
+
tags:
|
| 8 |
+
- gemma
|
| 9 |
+
- quantization
|
| 10 |
+
- 4bit
|
| 11 |
+
- text-generation
|
| 12 |
+
- causal-lm
|
| 13 |
+
license: apache-2.0
|
| 14 |
+
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|