Hugging Face's logo

virtuous7373
/
Mira-Demeter

Safetensors
GGUF
gemma3
mergekit
Merge
Lambent
Model card Files
xet
Community
Mira-Demeter
File size: 3,016 Bytes 
fcf981b
 
26d55d5
fcf981b
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
5b90f85
fcf981b
 
 
5b90f85
fcf981b
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
 
---
base_model:
  - Lambent/Mira-v1.21-27B-rlvr
tags:
  - gguf
  - mergekit
  - merge
  - Lambent
---

<div align="center">
<h1 style="font-size: 1.2em; font-weight: bold;">
  All credits go to:</h1>
  <h1 style="font-size: 1.2em; font-weight: bold;">  <a href="https://huggingface.co/Lambent">Lambent</a> for the wonderful model series. They did all the work, I just ran a few commands.</h1>
</div>
<div align="center">
<img src="https://upload.wikimedia.org/wikipedia/commons/thumb/a/a2/Demeter_Altemps_Inv8546.jpg/500px-Demeter_Altemps_Inv8546.jpg" width="200" alt="Aphrodite">
</div>
<div align="center">    
<h1 style="font-size: 1.23em; font-weight: bold;">
<a href="https://web.archive.org/web/20251008221112if_/https://uh.edu/~cldue/texts/demeter.html">Homeric Hymn to Demeter</a></h1>
</h1>
  </div>
### 📖 Overview [Files will be uploaded in 2 1/2 hours, give or take.]

This is a merge of pre-trained language models created using [mergekit](https://github.com/arcee-ai/mergekit. It utilizes custom merge methods.

### The Recipe [Is it any good?]

ϻira Dεmeter| Methods: [Karcher, MagStock, MagVar, CABS]

<details>
<summary><b>View Configuration</b></summary>

```yaml
# https://huggingface.co/Lambent
name: Mira-Aphrodite-v19-freckles

merge_method: magstock

models:
    - model: ./Ingredients/Lambent_Mira-v1.8.1a-27B
      parameters:
          weight: 0.5
          density: 0.5
          epsilon: 0.4
    - model: ./Ingredients/Mira-v14 # karcher
      parameters:
          weight: 0.5
          density: 0.5

base_model: ./Ingredients/Lambent_Mira-v1.8.1a-27B

dtype: bfloat16

parameters:
  rescale: true
  t_factor: 1.0

tokenizer:
  source: union

---
name: Mira-Aphrodite-v31

merge_method: magvar

base_model: ./Ingredients/Lambent_Mira-v1.21-27B-rlvr
models:
  - model: ./Ingredients/Lambent_Mira-v1.21-27B-rlvr
    parameters:
      weight: 0.40
  - model: ./Ingredients/Lambent_Mira-v1.20-27B-dpo
    parameters:
      weight: 0.20
  - model: ./Ingredients/Lambent_Mira-v1.19.3c-27B-dpo
    parameters:
      weight: 0.20
  - model: ./Ingredients/Lambent_Mira-v1.19-27B-dpo
    parameters:
      weight: 0.20

parameters:
  top_k: 0.45
  eps: 1e-6
  bond: 0.2

tokenizer:
  source: base

dtype: float32
out_dtype: bfloat16

---
name: Mira-Demeter

merge_method: cabs

base_model: ./Ingredients/Lambent_Mira-v1.21-27B-rlvr/

models:
  - model: ./Ingredients/Lambent_Mira-v1.21-27B-rlvr/
  - model: ./Ingredients/Mira-Aphrodite-v31/
    parameters:
      weight: 0.6
      n_val: 16
      m_val: 32
  - model: ./Ingredients/Mira-Aphrodite-v19-freckles/
    parameters:
      weight: 0.4
      n_val: 11
      m_val: 33


default_n_val: 8
default_m_val: 32

pruning_order:
  - ./Ingredients/Mira-Aphrodite-v31/
  - ./Ingredients/Mira-Aphrodite-v19-freckles/

# base_model: base

dtype: float32
out_dtype: bfloat16

tokenizer:
  source: union

```

## </details>

### A conversation snippet

<details>
<summary><b>View Conversation</b></summary>

```yaml
#
```
```
</details>
</div>
```