Collections

Discover the best community collections!

Collections trending this week
GPT-Generated Unified Format (GGUF)
GPT-Generated Unified Format (GGUF) is a single-file binary format used to store and run large language models efficiently on consumer hardware.
i1 (llama.cpp and HuggingFace Community)
In the context of local LLMs, quantization and file naming conventions, i1 designates a model quantized using an importance matrix (imatrix).
Meta-Llama
Collection by
29 days ago
4-bit Quantization
4-bit in LLMs means compressing model weights from 16-bit to 4-bit precision. This cuts the model's memory size by about 75%.
Instruct
Instructing LLMs means fine-tuning or prompting a base model with explicit directions or tasks so that it acts as a helpful assistant.
Heretic-Abliteration
Heretic is an open-source command-line tool that automates abliteration, the process of mathematically removing safety alignment from AI open-weights.
GPT-Generated Unified Format (GGUF)
GPT-Generated Unified Format (GGUF) is a single-file binary format used to store and run large language models efficiently on consumer hardware.
i1 (llama.cpp and HuggingFace Community)
In the context of local LLMs, quantization and file naming conventions, i1 designates a model quantized using an importance matrix (imatrix).
4-bit Quantization
4-bit in LLMs means compressing model weights from 16-bit to 4-bit precision. This cuts the model's memory size by about 75%.
Instruct
Instructing LLMs means fine-tuning or prompting a base model with explicit directions or tasks so that it acts as a helpful assistant.
Heretic-Abliteration
Heretic is an open-source command-line tool that automates abliteration, the process of mathematically removing safety alignment from AI open-weights.
Meta-Llama
Collection by
29 days ago