theprint commited on
Commit
63c9a30
·
verified ·
1 Parent(s): dcb95bd

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +11 -10
README.md CHANGED
@@ -29,6 +29,17 @@ This model is a fine-tuned version of google/gemma-3-1b-it using the Unsloth fra
29
  - **Base model:** google/gemma-3-1b-it
30
  - **Fine-tuning method:** LoRA with rank 128
31
 
 
 
 
 
 
 
 
 
 
 
 
32
  ## Intended Use
33
 
34
  Title and tag generation.
@@ -99,16 +110,6 @@ outputs = model.generate(inputs, max_new_tokens=256, temperature=0.7, do_sample=
99
  response = tokenizer.decode(outputs[0][inputs.shape[-1]:], skip_special_tokens=True)
100
  print(response)
101
  ```
102
- ## GGUF Quantized Versions
103
-
104
- Quantized GGUF versions are available in the `gguf/` directory for use with llama.cpp:
105
-
106
- - `TiTan-Gemma3-1B-f16.gguf` (2489.6 MB) - 16-bit float (original precision, largest file)
107
- - `TiTan-Gemma3-1B-q3_k_m.gguf` (850.9 MB) - 3-bit quantization (medium quality)
108
- - `TiTan-Gemma3-1B-q4_k_m.gguf` (966.7 MB) - 4-bit quantization (medium, recommended for most use cases)
109
- - `TiTan-Gemma3-1B-q5_k_m.gguf` (1027.9 MB) - 5-bit quantization (medium, good quality)
110
- - `TiTan-Gemma3-1B-q6_k.gguf` (1270.9 MB) - 6-bit quantization (high quality)
111
- - `TiTan-Gemma3-1B-q8_0.gguf` (1325.8 MB) - 8-bit quantization (very high quality)
112
 
113
  ### Using with llama.cpp
114
 
 
29
  - **Base model:** google/gemma-3-1b-it
30
  - **Fine-tuning method:** LoRA with rank 128
31
 
32
+ ## GGUF Quantized Versions
33
+
34
+ Quantized GGUF versions are available at [theprint/TiTan-Gemma3-1B-GGUF](https://huggingface.co/theprint/TiTan-Gemma3-1B-GGUF) for use with llama.cpp:
35
+
36
+ - `TiTan-Gemma3-1B-f16.gguf` (2489.6 MB) - 16-bit float (original precision, largest file)
37
+ - `TiTan-Gemma3-1B-q3_k_m.gguf` (850.9 MB) - 3-bit quantization (medium quality)
38
+ - `TiTan-Gemma3-1B-q4_k_m.gguf` (966.7 MB) - 4-bit quantization (medium, recommended for most use cases)
39
+ - `TiTan-Gemma3-1B-q5_k_m.gguf` (1027.9 MB) - 5-bit quantization (medium, good quality)
40
+ - `TiTan-Gemma3-1B-q6_k.gguf` (1270.9 MB) - 6-bit quantization (high quality)
41
+ - `TiTan-Gemma3-1B-q8_0.gguf` (1325.8 MB) - 8-bit quantization (very high quality)
42
+
43
  ## Intended Use
44
 
45
  Title and tag generation.
 
110
  response = tokenizer.decode(outputs[0][inputs.shape[-1]:], skip_special_tokens=True)
111
  print(response)
112
  ```
 
 
 
 
 
 
 
 
 
 
113
 
114
  ### Using with llama.cpp
115