Spaces:
Running
Running
Update README.md
Browse files
README.md
CHANGED
|
@@ -22,6 +22,9 @@ Tools to enhance LLM quantizations and merging
|
|
| 22 |
# [lm_head_remover.py](https://huggingface.co/spaces/Naphula/model_tools/blob/main/lm_head_remover.py)
|
| 23 |
- This script will load a "fat" 18.9GB model (default Gemma 9B), force it to tie the weights (deduplicating the lm_head), and re-save it. This will drop the file size to ~17.2GB and make it compatible with the others.
|
| 24 |
|
|
|
|
|
|
|
|
|
|
| 25 |
# [folder_content_combiner_anyfiles.py](https://huggingface.co/spaces/Naphula/model_tools/blob/main/folder_content_combiner_anyfiles.py)
|
| 26 |
- Combines all files in the script's current directory into a single output file, sorted alphabetically.
|
| 27 |
|
|
|
|
| 22 |
# [lm_head_remover.py](https://huggingface.co/spaces/Naphula/model_tools/blob/main/lm_head_remover.py)
|
| 23 |
- This script will load a "fat" 18.9GB model (default Gemma 9B), force it to tie the weights (deduplicating the lm_head), and re-save it. This will drop the file size to ~17.2GB and make it compatible with the others.
|
| 24 |
|
| 25 |
+
# [model_index_json_generator.py](https://huggingface.co/spaces/Naphula/model_tools/blob/main/model_index_json_generator.py)
|
| 26 |
+
- Generates a missing `model.safetensors.index.json` file. Useful for cases where safetensors may have been sharded at the wrong size.
|
| 27 |
+
|
| 28 |
# [folder_content_combiner_anyfiles.py](https://huggingface.co/spaces/Naphula/model_tools/blob/main/folder_content_combiner_anyfiles.py)
|
| 29 |
- Combines all files in the script's current directory into a single output file, sorted alphabetically.
|
| 30 |
|