Instructions to use Edens-Gate/Edens-Gate_Kyne-r1-22b-exl2 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Edens-Gate/Edens-Gate_Kyne-r1-22b-exl2 with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("Edens-Gate/Edens-Gate_Kyne-r1-22b-exl2", dtype="auto") - Notebooks
- Google Colab
- Kaggle
exl2 quant (measurement.json in main branch)
check revisions for quants
merge
This is a merge of pre-trained language models created using mergekit.
Merge Details
Merge Method
This model was merged using the SLERP merge method.
Models Merged
The following models were included in the merge:
Configuration
The following YAML configuration was used to produce this model:
base_model: NewEden-Staging/Kyne-22b
dtype: bfloat16
merge_method: slerp
parameters:
t:
- value: 0.5
slices:
- sources:
- layer_range: [0, 56]
model: NewEden-Staging/Kyne-22b
- layer_range: [0, 56]
model: TheDrummer/UnslopSmall-22B-v1
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support