Update README.md
Browse files
README.md
CHANGED
|
@@ -29,6 +29,17 @@ This model is a fine-tuned version of google/gemma-3-1b-it using the Unsloth fra
|
|
| 29 |
- **Base model:** google/gemma-3-1b-it
|
| 30 |
- **Fine-tuning method:** LoRA with rank 128
|
| 31 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 32 |
## Intended Use
|
| 33 |
|
| 34 |
Title and tag generation.
|
|
@@ -99,16 +110,6 @@ outputs = model.generate(inputs, max_new_tokens=256, temperature=0.7, do_sample=
|
|
| 99 |
response = tokenizer.decode(outputs[0][inputs.shape[-1]:], skip_special_tokens=True)
|
| 100 |
print(response)
|
| 101 |
```
|
| 102 |
-
## GGUF Quantized Versions
|
| 103 |
-
|
| 104 |
-
Quantized GGUF versions are available in the `gguf/` directory for use with llama.cpp:
|
| 105 |
-
|
| 106 |
-
- `TiTan-Gemma3-1B-f16.gguf` (2489.6 MB) - 16-bit float (original precision, largest file)
|
| 107 |
-
- `TiTan-Gemma3-1B-q3_k_m.gguf` (850.9 MB) - 3-bit quantization (medium quality)
|
| 108 |
-
- `TiTan-Gemma3-1B-q4_k_m.gguf` (966.7 MB) - 4-bit quantization (medium, recommended for most use cases)
|
| 109 |
-
- `TiTan-Gemma3-1B-q5_k_m.gguf` (1027.9 MB) - 5-bit quantization (medium, good quality)
|
| 110 |
-
- `TiTan-Gemma3-1B-q6_k.gguf` (1270.9 MB) - 6-bit quantization (high quality)
|
| 111 |
-
- `TiTan-Gemma3-1B-q8_0.gguf` (1325.8 MB) - 8-bit quantization (very high quality)
|
| 112 |
|
| 113 |
### Using with llama.cpp
|
| 114 |
|
|
|
|
| 29 |
- **Base model:** google/gemma-3-1b-it
|
| 30 |
- **Fine-tuning method:** LoRA with rank 128
|
| 31 |
|
| 32 |
+
## GGUF Quantized Versions
|
| 33 |
+
|
| 34 |
+
Quantized GGUF versions are available at [theprint/TiTan-Gemma3-1B-GGUF](https://huggingface.co/theprint/TiTan-Gemma3-1B-GGUF) for use with llama.cpp:
|
| 35 |
+
|
| 36 |
+
- `TiTan-Gemma3-1B-f16.gguf` (2489.6 MB) - 16-bit float (original precision, largest file)
|
| 37 |
+
- `TiTan-Gemma3-1B-q3_k_m.gguf` (850.9 MB) - 3-bit quantization (medium quality)
|
| 38 |
+
- `TiTan-Gemma3-1B-q4_k_m.gguf` (966.7 MB) - 4-bit quantization (medium, recommended for most use cases)
|
| 39 |
+
- `TiTan-Gemma3-1B-q5_k_m.gguf` (1027.9 MB) - 5-bit quantization (medium, good quality)
|
| 40 |
+
- `TiTan-Gemma3-1B-q6_k.gguf` (1270.9 MB) - 6-bit quantization (high quality)
|
| 41 |
+
- `TiTan-Gemma3-1B-q8_0.gguf` (1325.8 MB) - 8-bit quantization (very high quality)
|
| 42 |
+
|
| 43 |
## Intended Use
|
| 44 |
|
| 45 |
Title and tag generation.
|
|
|
|
| 110 |
response = tokenizer.decode(outputs[0][inputs.shape[-1]:], skip_special_tokens=True)
|
| 111 |
print(response)
|
| 112 |
```
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 113 |
|
| 114 |
### Using with llama.cpp
|
| 115 |
|