QuantFactory/LLama-3.1-Hyper-Stock-GGUF

This is quantized version of bunnycore/LLama-3.1-Hyper-Stock created using llama.cpp

Original Model Card

merge

This is a merge of pre-trained language models created using mergekit.

Merge Details

Merge Method

This model was merged using the Model Stock merge method using unsloth/Meta-Llama-3.1-8B as a base.

Models Merged

The following models were included in the merge:

• Replete-AI/Replete-LLM-V2-Llama-3.1-8b
• bunnycore/Synesthesia-3.1-task_arithmetic
• bunnycore/HyperLlama-3.1-8B
• Dampfinchen/Llama-3.1-8B-Ultra-Instruct
• bunnycore/MegaHyperLlama3.1
• Orenguteng/Llama-3.1-8B-Lexi-Uncensored-V2
• bunnycore/HyperLexi-8B-breadcrumbs

Configuration

The following YAML configuration was used to produce this model:

models:
  - model: Replete-AI/Replete-LLM-V2-Llama-3.1-8b
  - model: Dampfinchen/Llama-3.1-8B-Ultra-Instruct
  - model: Orenguteng/Llama-3.1-8B-Lexi-Uncensored-V2
  - model: bunnycore/HyperLlama-3.1-8B
  - model: bunnycore/HyperLexi-8B-breadcrumbs
  - model: bunnycore/MegaHyperLlama3.1
  - model: bunnycore/Synesthesia-3.1-task_arithmetic
merge_method: model_stock
base_model: unsloth/Meta-Llama-3.1-8B
dtype: bfloat16