| --- |
| base_model: [] |
| library_name: transformers |
| tags: |
| - mergekit |
| - merge |
|
|
| --- |
| # NEW-Fuse-AIME-2 |
|
|
| This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit). |
|
|
| ## Merge Details |
| ### Merge Method |
|
|
| This model was merged using the [DARE TIES](https://arxiv.org/abs/2311.03099) merge method using /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 as a base. |
|
|
| ### Models Merged |
|
|
| The following models were included in the merge: |
| * /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| * /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| * /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| * /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| * /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
|
|
| ### Configuration |
|
|
| The following YAML configuration was used to produce this model: |
|
|
| ```yaml |
| base_model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| dtype: bfloat16 |
| merge_method: dare_ties |
| parameters: |
| int8_mask: 1.0 |
| normalize: 0.0 |
| slices: |
| - sources: |
| - layer_range: [0, 1] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 1.0 |
| weight: 0.2782315873972385 |
| - layer_range: [0, 1] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 1.0 |
| weight: 0.19635741093400924 |
| - layer_range: [0, 1] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 0.839041420919602 |
| weight: 0.1393051419022209 |
| - layer_range: [0, 1] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 0.9049838949212962 |
| weight: 0.007949192496240043 |
| - layer_range: [0, 1] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 0.6368696615921805 |
| weight: 0.03283807920340641 |
| - layer_range: [0, 1] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 1.0 |
| weight: 0.34339904488021705 |
| - sources: |
| - layer_range: [1, 2] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 0.8298629387880676 |
| weight: 0.012178045683612151 |
| - layer_range: [1, 2] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 1.0 |
| weight: 0.2742647165349933 |
| - layer_range: [1, 2] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 1.0 |
| weight: 0.3118824904882318 |
| - layer_range: [1, 2] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 1.0 |
| weight: 0.20820237912448977 |
| - layer_range: [1, 2] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 0.6882884993390114 |
| weight: 0.32931098839032225 |
| - layer_range: [1, 2] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 0.7541644143115471 |
| weight: 0.5283350552564068 |
| - sources: |
| - layer_range: [2, 3] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 1.0 |
| weight: 0.1475972757877593 |
| - layer_range: [2, 3] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 1.0 |
| weight: 0.36006129832521916 |
| - layer_range: [2, 3] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 0.6383637368643884 |
| weight: 0.2417455775856331 |
| - layer_range: [2, 3] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 0.9634617790683426 |
| weight: 0.30988574000828395 |
| - layer_range: [2, 3] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 1.0 |
| weight: 0.2123327378847143 |
| - layer_range: [2, 3] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 0.9745011611918509 |
| weight: 0.26417975152408857 |
| - sources: |
| - layer_range: [3, 4] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 1.0 |
| weight: 0.15769046109738702 |
| - layer_range: [3, 4] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 1.0 |
| weight: 0.1523214821495638 |
| - layer_range: [3, 4] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 1.0 |
| weight: 0.037213704935742886 |
| - layer_range: [3, 4] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 0.7497177917163473 |
| weight: 0.2861632132956589 |
| - layer_range: [3, 4] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 0.7215595383344846 |
| weight: 0.4606348758519766 |
| - layer_range: [3, 4] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 1.0 |
| weight: 0.0003362236275280678 |
| - sources: |
| - layer_range: [4, 5] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 0.6910337109786082 |
| weight: 0.24392684897607322 |
| - layer_range: [4, 5] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 0.9710965496454345 |
| weight: 0.012635998710707627 |
| - layer_range: [4, 5] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 0.4860547857824506 |
| weight: 0.23402390666045142 |
| - layer_range: [4, 5] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 0.7500944911682366 |
| weight: 0.2572776682722997 |
| - layer_range: [4, 5] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 1.0 |
| weight: 0.08365043313088268 |
| - layer_range: [4, 5] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 0.9810133262115704 |
| weight: 0.3613481642532599 |
| - sources: |
| - layer_range: [5, 6] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 0.6741956384738605 |
| weight: 0.37578743779124096 |
| - layer_range: [5, 6] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 0.9072174733548687 |
| weight: 0.07625416776300153 |
| - layer_range: [5, 6] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 0.8744591420309692 |
| weight: 0.408177109381669 |
| - layer_range: [5, 6] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 1.0 |
| weight: 0.2683692653545862 |
| - layer_range: [5, 6] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 1.0 |
| weight: 0.06686054697269289 |
| - layer_range: [5, 6] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 0.8449084919956413 |
| weight: 0.4488419163177444 |
| - sources: |
| - layer_range: [6, 7] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 1.0 |
| weight: 0.11629103922432293 |
| - layer_range: [6, 7] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 1.0 |
| weight: 0.09563282389416433 |
| - layer_range: [6, 7] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 0.9904373561782471 |
| weight: 0.11994247597890378 |
| - layer_range: [6, 7] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 0.9299436120275166 |
| weight: 0.22834226407956734 |
| - layer_range: [6, 7] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 1.0 |
| weight: 0.11512519202646376 |
| - layer_range: [6, 7] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 0.9445172175266126 |
| weight: 0.21318549805793088 |
| - sources: |
| - layer_range: [7, 8] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 1.0 |
| weight: 0.18798747602597987 |
| - layer_range: [7, 8] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 0.7452937123126001 |
| weight: 0.14746911601895424 |
| - layer_range: [7, 8] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 0.8204977104998925 |
| weight: 0.19134291787306087 |
| - layer_range: [7, 8] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 0.9737073791320208 |
| weight: 0.4983379958659422 |
| - layer_range: [7, 8] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 0.867081025278063 |
| weight: 0.05096153597806359 |
| - layer_range: [7, 8] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 0.8793745878128797 |
| weight: 0.23915742179684527 |
| - sources: |
| - layer_range: [8, 9] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 0.9908584743786936 |
| weight: 0.2900964369859359 |
| - layer_range: [8, 9] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 1.0 |
| weight: 0.6770121314397981 |
| - layer_range: [8, 9] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 1.0 |
| weight: 0.7421772684770622 |
| - layer_range: [8, 9] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 1.0 |
| weight: 0.1288360821322317 |
| - layer_range: [8, 9] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 1.0 |
| weight: 0.19588203535256857 |
| - layer_range: [8, 9] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 0.9647488315759917 |
| weight: 0.05954407329266449 |
| - sources: |
| - layer_range: [9, 10] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 1.0 |
| weight: 0.051952322557393654 |
| - layer_range: [9, 10] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 0.7705586830846688 |
| weight: 0.5733745872563619 |
| - layer_range: [9, 10] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 1.0 |
| weight: 0.1970853442522889 |
| - layer_range: [9, 10] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 0.8717807909710711 |
| weight: 0.0908833911515223 |
| - layer_range: [9, 10] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 0.7908247294988782 |
| weight: 0.1845905936365468 |
| - layer_range: [9, 10] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 0.8746886550244568 |
| weight: 0.12012453127168171 |
| - sources: |
| - layer_range: [10, 11] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 0.5901488666433586 |
| weight: 0.4132454940186627 |
| - layer_range: [10, 11] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 0.6564276215102214 |
| weight: 0.05482864296740633 |
| - layer_range: [10, 11] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 0.5363622563055074 |
| weight: 0.1806790978658725 |
| - layer_range: [10, 11] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 0.9962626071178531 |
| weight: 0.0641105089408362 |
| - layer_range: [10, 11] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 1.0 |
| weight: 0.11302650096438938 |
| - layer_range: [10, 11] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 0.935821018848516 |
| weight: 0.4976548707302226 |
| - sources: |
| - layer_range: [11, 12] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 1.0 |
| weight: 0.19900912406353574 |
| - layer_range: [11, 12] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 1.0 |
| weight: 0.20695001682401898 |
| - layer_range: [11, 12] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 0.9178868704524388 |
| weight: 0.485866085043937 |
| - layer_range: [11, 12] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 0.8777643958740872 |
| weight: 0.3914734004939914 |
| - layer_range: [11, 12] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 1.0 |
| weight: 0.03205146584371449 |
| - layer_range: [11, 12] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 1.0 |
| weight: 0.18556656278840403 |
| - sources: |
| - layer_range: [12, 13] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 1.0 |
| weight: 0.20656175990330095 |
| - layer_range: [12, 13] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 0.7968900729582112 |
| weight: 0.3317709752868623 |
| - layer_range: [12, 13] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 1.0 |
| weight: 0.27491910682117465 |
| - layer_range: [12, 13] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 0.9894580466554811 |
| weight: 0.036643107048087105 |
| - layer_range: [12, 13] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 1.0 |
| weight: 0.28862007087718894 |
| - layer_range: [12, 13] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 0.7487264086943679 |
| weight: 0.4032155957575983 |
| - sources: |
| - layer_range: [13, 14] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 1.0 |
| weight: 0.10288506772457816 |
| - layer_range: [13, 14] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 1.0 |
| weight: 0.25240385899016365 |
| - layer_range: [13, 14] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 1.0 |
| weight: 0.24112069713536738 |
| - layer_range: [13, 14] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 1.0 |
| weight: 0.17970681579851688 |
| - layer_range: [13, 14] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 0.9880840219872322 |
| weight: 0.09375379195324154 |
| - layer_range: [13, 14] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 1.0 |
| weight: 0.5146485259568411 |
| - sources: |
| - layer_range: [14, 15] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 0.8246319334241813 |
| weight: 0.37830969105567097 |
| - layer_range: [14, 15] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 1.0 |
| weight: 0.18310637878417466 |
| - layer_range: [14, 15] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 1.0 |
| weight: 0.1878731334364966 |
| - layer_range: [14, 15] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 0.9988962548231595 |
| weight: 0.068783579040219 |
| - layer_range: [14, 15] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 1.0 |
| weight: 0.059252156826440756 |
| - layer_range: [14, 15] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 1.0 |
| weight: 0.06399965153945208 |
| - sources: |
| - layer_range: [15, 16] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 0.7671711029056976 |
| weight: 0.08279825270344171 |
| - layer_range: [15, 16] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 1.0 |
| weight: 0.4832191061533638 |
| - layer_range: [15, 16] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 1.0 |
| weight: 0.43397801143478104 |
| - layer_range: [15, 16] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 0.9301793901319233 |
| weight: 0.060057556519650085 |
| - layer_range: [15, 16] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 1.0 |
| weight: 0.3291053018368783 |
| - layer_range: [15, 16] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 1.0 |
| weight: 0.09163179667175611 |
| - sources: |
| - layer_range: [16, 17] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 0.585335562539892 |
| weight: 0.23990667870923393 |
| - layer_range: [16, 17] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 0.9501246198992629 |
| weight: 0.14501212433260446 |
| - layer_range: [16, 17] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 0.8142622747372522 |
| weight: 0.17718360841131947 |
| - layer_range: [16, 17] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 0.9588318274545542 |
| weight: 0.48150382002080344 |
| - layer_range: [16, 17] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 1.0 |
| weight: 0.126230462170154 |
| - layer_range: [16, 17] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 0.4892312413786961 |
| weight: 0.24269527765600346 |
| - sources: |
| - layer_range: [17, 18] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 0.9709385013773042 |
| weight: 0.07104163819906398 |
| - layer_range: [17, 18] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 0.9907919866060557 |
| weight: 0.0007542843250286091 |
| - layer_range: [17, 18] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 0.9460559808768376 |
| weight: 0.2752973549458865 |
| - layer_range: [17, 18] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 0.9983533282926503 |
| weight: 0.15966873618588628 |
| - layer_range: [17, 18] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 0.6921736257955359 |
| weight: 0.0015923913647673538 |
| - layer_range: [17, 18] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 1.0 |
| weight: 0.31390324400321623 |
| - sources: |
| - layer_range: [18, 19] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 0.7207752757241536 |
| weight: 0.20938924032120507 |
| - layer_range: [18, 19] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 0.806331369611605 |
| weight: 0.014409611142731926 |
| - layer_range: [18, 19] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 1.0 |
| weight: 0.36097342241865993 |
| - layer_range: [18, 19] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 0.7531577043031259 |
| weight: 0.09689525515688532 |
| - layer_range: [18, 19] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 1.0 |
| weight: 0.6318999013401043 |
| - layer_range: [18, 19] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 0.7670284456767872 |
| weight: 0.08004223909034286 |
| - sources: |
| - layer_range: [19, 20] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 1.0 |
| weight: 0.15219459605986607 |
| - layer_range: [19, 20] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 0.7917787133894402 |
| weight: 0.18033705157266788 |
| - layer_range: [19, 20] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 0.8590518812159822 |
| weight: 0.24947137503137812 |
| - layer_range: [19, 20] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 1.0 |
| weight: 0.054118308616569924 |
| - layer_range: [19, 20] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 0.9244409534965156 |
| weight: 0.04720723246789843 |
| - layer_range: [19, 20] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 1.0 |
| weight: 0.32589512367293716 |
| - sources: |
| - layer_range: [20, 21] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 0.8974635885630745 |
| weight: 0.4724663033132477 |
| - layer_range: [20, 21] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 1.0 |
| weight: 0.11510664715241947 |
| - layer_range: [20, 21] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 0.9235295631691169 |
| weight: 0.042695431127009076 |
| - layer_range: [20, 21] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 1.0 |
| weight: 0.11133339509681325 |
| - layer_range: [20, 21] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 1.0 |
| weight: 0.4454395094657316 |
| - layer_range: [20, 21] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 0.7815707892292135 |
| weight: 0.3716666021599484 |
| - sources: |
| - layer_range: [21, 22] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 1.0 |
| weight: 0.20445075642606872 |
| - layer_range: [21, 22] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 1.0 |
| weight: 0.08520193692835092 |
| - layer_range: [21, 22] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 0.7772131139869718 |
| weight: 0.005731024920312133 |
| - layer_range: [21, 22] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 0.6351582798252953 |
| weight: 0.2567372966508105 |
| - layer_range: [21, 22] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 0.9992444948886876 |
| weight: 0.0809572690618752 |
| - layer_range: [21, 22] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 1.0 |
| weight: 0.4178172190398364 |
| - sources: |
| - layer_range: [22, 23] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 0.9964683534245098 |
| weight: 0.23152496012989637 |
| - layer_range: [22, 23] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 1.0 |
| weight: 0.019642782853222324 |
| - layer_range: [22, 23] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 1.0 |
| weight: 0.19345821213830322 |
| - layer_range: [22, 23] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 0.8259775627246622 |
| weight: 0.1710965828934345 |
| - layer_range: [22, 23] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 0.9655374347532074 |
| weight: 0.1304630777907399 |
| - layer_range: [22, 23] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 0.45493316692535235 |
| weight: 0.07600846212926438 |
| - sources: |
| - layer_range: [23, 24] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 0.6721109403298298 |
| weight: 0.2356891503907223 |
| - layer_range: [23, 24] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 1.0 |
| weight: 0.10387151135694028 |
| - layer_range: [23, 24] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 0.7836152755374957 |
| weight: 0.07899479075913782 |
| - layer_range: [23, 24] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 0.7825729304855489 |
| weight: 0.24000742240862422 |
| - layer_range: [23, 24] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 0.9821688259769421 |
| weight: 0.2354263414935049 |
| - layer_range: [23, 24] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 1.0 |
| weight: 0.21874627666822238 |
| - sources: |
| - layer_range: [24, 25] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 0.9392645214321065 |
| weight: 0.19031861752847407 |
| - layer_range: [24, 25] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 1.0 |
| weight: 0.16765974328240574 |
| - layer_range: [24, 25] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 0.9550931808653395 |
| weight: 0.0393875764308524 |
| - layer_range: [24, 25] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 0.98045839892385 |
| weight: 0.5243868032740402 |
| - layer_range: [24, 25] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 0.9441593866734689 |
| weight: 0.03683392304225987 |
| - layer_range: [24, 25] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 0.8671662108560604 |
| weight: 0.2053450649145078 |
| - sources: |
| - layer_range: [25, 26] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 1.0 |
| weight: 0.09710053670860862 |
| - layer_range: [25, 26] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 0.9523988152047644 |
| weight: 0.11779751921107934 |
| - layer_range: [25, 26] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 1.0 |
| weight: 0.5430552965743557 |
| - layer_range: [25, 26] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 1.0 |
| weight: 0.25258751641790106 |
| - layer_range: [25, 26] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 1.0 |
| weight: 0.20005994269627547 |
| - layer_range: [25, 26] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 0.9541301284421821 |
| weight: 0.34044100626643836 |
| - sources: |
| - layer_range: [26, 27] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 1.0 |
| weight: 0.28336897808636863 |
| - layer_range: [26, 27] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 0.7840965294605414 |
| weight: 0.12993902081988035 |
| - layer_range: [26, 27] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 0.8777576583284323 |
| weight: 0.35922131109052746 |
| - layer_range: [26, 27] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 0.8085516370560839 |
| weight: 0.5589123218741695 |
| - layer_range: [26, 27] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 1.0 |
| weight: 0.2878091149491125 |
| - layer_range: [26, 27] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 1.0 |
| weight: 0.5738334493450006 |
| - sources: |
| - layer_range: [27, 28] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 0.6925825193976535 |
| weight: 0.21465740887083135 |
| - layer_range: [27, 28] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 0.7151740929979256 |
| weight: 0.2411662207956331 |
| - layer_range: [27, 28] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 1.0 |
| weight: 0.0601582880630152 |
| - layer_range: [27, 28] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 1.0 |
| weight: 0.27109660295620275 |
| - layer_range: [27, 28] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 0.67885599604793 |
| weight: 0.5739501338116965 |
| - layer_range: [27, 28] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 1.0 |
| weight: 0.37288477352244037 |
| - sources: |
| - layer_range: [28, 29] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 0.7117475160844768 |
| weight: 0.026680088358767312 |
| - layer_range: [28, 29] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 1.0 |
| weight: 0.43206913052299967 |
| - layer_range: [28, 29] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 0.6825346935306619 |
| weight: 0.3848004265440627 |
| - layer_range: [28, 29] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 1.0 |
| weight: 0.1174486809204486 |
| - layer_range: [28, 29] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 1.0 |
| weight: 0.03446883068163623 |
| - layer_range: [28, 29] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 1.0 |
| weight: 0.17279716303611553 |
| - sources: |
| - layer_range: [29, 30] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 0.6310034358888048 |
| weight: 0.12510510698935506 |
| - layer_range: [29, 30] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 1.0 |
| weight: 0.12123624320328882 |
| - layer_range: [29, 30] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 1.0 |
| weight: 0.21813157440017286 |
| - layer_range: [29, 30] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 0.7177540094279146 |
| weight: 0.1353882392476031 |
| - layer_range: [29, 30] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 1.0 |
| weight: 0.1881689886549915 |
| - layer_range: [29, 30] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 0.7305809384923427 |
| weight: 0.376818424193501 |
| - sources: |
| - layer_range: [30, 31] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 0.8993640320922442 |
| weight: 0.10196945523086967 |
| - layer_range: [30, 31] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 1.0 |
| weight: 0.5034086235375271 |
| - layer_range: [30, 31] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 0.6942204155040704 |
| weight: 0.1338853027545463 |
| - layer_range: [30, 31] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 1.0 |
| weight: 0.5028174851551407 |
| - layer_range: [30, 31] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 0.8843818959138889 |
| weight: 0.18100811409305972 |
| - layer_range: [30, 31] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 1.0 |
| weight: 0.16104353135766042 |
| - sources: |
| - layer_range: [31, 32] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 0.7904228187317733 |
| weight: 0.43698500576059274 |
| - layer_range: [31, 32] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 1.0 |
| weight: 0.5936095539512497 |
| - layer_range: [31, 32] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 1.0 |
| weight: 0.14769236332694313 |
| - layer_range: [31, 32] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 1.0 |
| weight: 0.32773931635626724 |
| - layer_range: [31, 32] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 1.0 |
| weight: 0.011977893279050605 |
| - layer_range: [31, 32] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 0.951087230384274 |
| weight: 0.13846355395798557 |
| - sources: |
| - layer_range: [32, 33] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 1.0 |
| weight: 0.5405192410937041 |
| - layer_range: [32, 33] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 1.0 |
| weight: 0.43111899126718234 |
| - layer_range: [32, 33] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 0.9551387881134268 |
| weight: 0.22687281842086082 |
| - layer_range: [32, 33] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 0.873842693623591 |
| weight: 0.16884088867211666 |
| - layer_range: [32, 33] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 1.0 |
| weight: 0.28988835450802036 |
| - layer_range: [32, 33] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 0.9628483492164649 |
| weight: 0.28613172963789724 |
| - sources: |
| - layer_range: [33, 34] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 0.9660432462038945 |
| weight: 0.1794102626672678 |
| - layer_range: [33, 34] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 1.0 |
| weight: 0.5677260098192384 |
| - layer_range: [33, 34] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 0.8606352805654085 |
| weight: 0.31532457675577374 |
| - layer_range: [33, 34] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 1.0 |
| weight: 0.02959242060013658 |
| - layer_range: [33, 34] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 1.0 |
| weight: 0.24939191288685683 |
| - layer_range: [33, 34] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 1.0 |
| weight: 0.3425950191564526 |
| - sources: |
| - layer_range: [34, 35] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 0.6721312070848626 |
| weight: 0.12024261675706371 |
| - layer_range: [34, 35] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 1.0 |
| weight: 0.019202127824589216 |
| - layer_range: [34, 35] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 1.0 |
| weight: 0.30326296676546083 |
| - layer_range: [34, 35] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 1.0 |
| weight: 0.16136044813224878 |
| - layer_range: [34, 35] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 0.8758256653555511 |
| weight: 0.10297032302601486 |
| - layer_range: [34, 35] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 1.0 |
| weight: 0.10140112186794767 |
| - sources: |
| - layer_range: [35, 36] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 0.8213652326986552 |
| weight: 0.025122172830659414 |
| - layer_range: [35, 36] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 1.0 |
| weight: 0.07105756794027786 |
| - layer_range: [35, 36] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 1.0 |
| weight: 0.18392576209300893 |
| - layer_range: [35, 36] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 1.0 |
| weight: 0.20689669056513565 |
| - layer_range: [35, 36] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 0.9855597569074632 |
| weight: 0.014505769298279403 |
| - layer_range: [35, 36] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 0.944905419404809 |
| weight: 0.15640978099711594 |
| - sources: |
| - layer_range: [36, 37] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 0.9435305974227193 |
| weight: 0.21865101700794948 |
| - layer_range: [36, 37] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 1.0 |
| weight: 0.3665913818417759 |
| - layer_range: [36, 37] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 1.0 |
| weight: 0.2326236606988492 |
| - layer_range: [36, 37] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 1.0 |
| weight: 0.31748463039847885 |
| - layer_range: [36, 37] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 0.6510288624800707 |
| weight: 0.2794996180603957 |
| - layer_range: [36, 37] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 0.7756816509977775 |
| weight: 0.39386186811472035 |
| - sources: |
| - layer_range: [37, 38] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 0.8471466862455088 |
| weight: 0.1054419594045002 |
| - layer_range: [37, 38] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 0.9616794829960454 |
| weight: 0.043352142042583044 |
| - layer_range: [37, 38] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 1.0 |
| weight: 0.31957748249992324 |
| - layer_range: [37, 38] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 1.0 |
| weight: 0.02782699112527924 |
| - layer_range: [37, 38] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 0.8172565934314691 |
| weight: 0.1277490198636007 |
| - layer_range: [37, 38] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 0.8572198669303388 |
| weight: 0.22670446700028396 |
| - sources: |
| - layer_range: [38, 39] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 0.7108000073584617 |
| weight: 0.14925746902562262 |
| - layer_range: [38, 39] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 0.7947544560681823 |
| weight: 0.0711535777774904 |
| - layer_range: [38, 39] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 1.0 |
| weight: 0.0827474861731709 |
| - layer_range: [38, 39] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 1.0 |
| weight: 0.21147448956539472 |
| - layer_range: [38, 39] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 1.0 |
| weight: 0.22620021391358253 |
| - layer_range: [38, 39] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 0.9110748174290368 |
| weight: 0.6500310835503815 |
| - sources: |
| - layer_range: [39, 40] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 1.0 |
| weight: 0.0020954267426730594 |
| - layer_range: [39, 40] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 0.7974646792001101 |
| weight: 0.31506886844439824 |
| - layer_range: [39, 40] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 1.0 |
| weight: 0.15473405497359374 |
| - layer_range: [39, 40] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 0.8730840189168834 |
| weight: 0.11377520350754662 |
| - layer_range: [39, 40] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 1.0 |
| weight: 0.22172514394701104 |
| - layer_range: [39, 40] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 1.0 |
| weight: 0.045832021359076935 |
| - sources: |
| - layer_range: [40, 41] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 1.0 |
| weight: 0.40617426548358937 |
| - layer_range: [40, 41] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 0.7293174204491722 |
| weight: 0.18765270592674677 |
| - layer_range: [40, 41] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 1.0 |
| weight: 0.07782987965295007 |
| - layer_range: [40, 41] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 0.5964778321159088 |
| weight: 0.3882928650086385 |
| - layer_range: [40, 41] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 1.0 |
| weight: 0.2931422056675209 |
| - layer_range: [40, 41] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 0.9163024077820021 |
| weight: 0.22943743711338963 |
| - sources: |
| - layer_range: [41, 42] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 0.9632090369890876 |
| weight: 0.102078915644014 |
| - layer_range: [41, 42] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 0.6623465226007259 |
| weight: 0.15912099272885613 |
| - layer_range: [41, 42] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 1.0 |
| weight: 0.2555144977628281 |
| - layer_range: [41, 42] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 1.0 |
| weight: 0.22493138386177133 |
| - layer_range: [41, 42] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 0.7965620645278113 |
| weight: 0.3488203269613851 |
| - layer_range: [41, 42] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 0.511154852086326 |
| weight: 0.08526320902249696 |
| - sources: |
| - layer_range: [42, 43] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 1.0 |
| weight: 0.6366405856168433 |
| - layer_range: [42, 43] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 1.0 |
| weight: 0.30068502897912774 |
| - layer_range: [42, 43] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 0.9537313606839656 |
| weight: 0.17094172082484585 |
| - layer_range: [42, 43] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 0.9584256353781965 |
| weight: 0.10215932540697358 |
| - layer_range: [42, 43] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 0.9741621393637496 |
| weight: 0.397153527257189 |
| - layer_range: [42, 43] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 0.944947078669692 |
| weight: 0.02182087356037161 |
| - sources: |
| - layer_range: [43, 44] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 0.6589519722788534 |
| weight: 0.24922615456400055 |
| - layer_range: [43, 44] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 0.7355957820471619 |
| weight: 0.47067521934612006 |
| - layer_range: [43, 44] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 1.0 |
| weight: 0.17869005019437223 |
| - layer_range: [43, 44] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 1.0 |
| weight: 0.029740284638674896 |
| - layer_range: [43, 44] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 0.9066172053744459 |
| weight: 0.4690665585114081 |
| - layer_range: [43, 44] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 1.0 |
| weight: 0.26857497847644474 |
| - sources: |
| - layer_range: [44, 45] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 0.7322189781528857 |
| weight: 0.04220887442606691 |
| - layer_range: [44, 45] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 1.0 |
| weight: 0.3927460815806082 |
| - layer_range: [44, 45] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 1.0 |
| weight: 0.1776425311464363 |
| - layer_range: [44, 45] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 0.9111422043244886 |
| weight: 0.07019459222990815 |
| - layer_range: [44, 45] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 0.8927447142902996 |
| weight: 0.3203847503770507 |
| - layer_range: [44, 45] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 1.0 |
| weight: 0.3062471241146648 |
| - sources: |
| - layer_range: [45, 46] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 1.0 |
| weight: 0.018248569758602007 |
| - layer_range: [45, 46] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 1.0 |
| weight: 0.47581471574830314 |
| - layer_range: [45, 46] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 1.0 |
| weight: 0.1402055666753047 |
| - layer_range: [45, 46] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 1.0 |
| weight: 0.01690887852775419 |
| - layer_range: [45, 46] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 1.0 |
| weight: 0.18114560999104787 |
| - layer_range: [45, 46] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 0.9328123915780923 |
| weight: 0.06302157151314448 |
| - sources: |
| - layer_range: [46, 47] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 0.8273736951212698 |
| weight: 0.14670372972572973 |
| - layer_range: [46, 47] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 1.0 |
| weight: 0.5117048774533038 |
| - layer_range: [46, 47] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 0.9859786039118714 |
| weight: 0.013636747101578778 |
| - layer_range: [46, 47] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 1.0 |
| weight: 0.2014433972478546 |
| - layer_range: [46, 47] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 0.9937470311597871 |
| weight: 0.01735028806980282 |
| - layer_range: [46, 47] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 0.7810778382468737 |
| weight: 0.07828387109196101 |
| - sources: |
| - layer_range: [47, 48] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 0.7883109207887593 |
| weight: 0.02129674787906119 |
| - layer_range: [47, 48] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 1.0 |
| weight: 0.12692348389073616 |
| - layer_range: [47, 48] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 0.9682184167024662 |
| weight: 0.03941603422714035 |
| - layer_range: [47, 48] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 1.0 |
| weight: 0.044210621164719355 |
| - layer_range: [47, 48] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 1.0 |
| weight: 0.14971915383704015 |
| - layer_range: [47, 48] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 0.5972169931826233 |
| weight: 0.05602522459520403 |
| - sources: |
| - layer_range: [48, 49] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 1.0 |
| weight: 0.028867226889573883 |
| - layer_range: [48, 49] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 1.0 |
| weight: 0.31826427696469695 |
| - layer_range: [48, 49] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 1.0 |
| weight: 0.062101442235530574 |
| - layer_range: [48, 49] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 0.8580212133028511 |
| weight: 0.14925021642324868 |
| - layer_range: [48, 49] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 1.0 |
| weight: 0.2997249902505159 |
| - layer_range: [48, 49] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 1.0 |
| weight: 0.4567488915611886 |
| - sources: |
| - layer_range: [49, 50] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 0.3887546798623643 |
| weight: 0.22250851848434627 |
| - layer_range: [49, 50] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 1.0 |
| weight: 0.29918010727072736 |
| - layer_range: [49, 50] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 1.0 |
| weight: 0.0006963799120076053 |
| - layer_range: [49, 50] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 1.0 |
| weight: 0.5196794348046012 |
| - layer_range: [49, 50] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 1.0 |
| weight: 0.16886829950429177 |
| - layer_range: [49, 50] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 1.0 |
| weight: 0.21169831684759394 |
| - sources: |
| - layer_range: [50, 51] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 0.9263984426155888 |
| weight: 0.46208117066898613 |
| - layer_range: [50, 51] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 1.0 |
| weight: 0.26513336920610525 |
| - layer_range: [50, 51] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 0.9842480696543732 |
| weight: 0.2606511991191279 |
| - layer_range: [50, 51] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 0.8321555646679069 |
| weight: 0.260037744419943 |
| - layer_range: [50, 51] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 1.0 |
| weight: 0.3362202749259709 |
| - layer_range: [50, 51] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 0.7799505656336573 |
| weight: 0.2148809629948658 |
| - sources: |
| - layer_range: [51, 52] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 0.9456014782497077 |
| weight: 0.2684329744931154 |
| - layer_range: [51, 52] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 0.9218159685802345 |
| weight: 0.04447382443778326 |
| - layer_range: [51, 52] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 1.0 |
| weight: 0.12634547595280862 |
| - layer_range: [51, 52] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 1.0 |
| weight: 0.0345938092305072 |
| - layer_range: [51, 52] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 1.0 |
| weight: 0.17063364496157324 |
| - layer_range: [51, 52] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 1.0 |
| weight: 0.050232899418394705 |
| - sources: |
| - layer_range: [52, 53] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 1.0 |
| weight: 0.08075549628007361 |
| - layer_range: [52, 53] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 0.7558578759683025 |
| weight: 0.22688105172640147 |
| - layer_range: [52, 53] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 0.9132175305169759 |
| weight: 0.6284259023072631 |
| - layer_range: [52, 53] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 1.0 |
| weight: 0.16826756744339957 |
| - layer_range: [52, 53] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 1.0 |
| weight: 0.22804881825097434 |
| - layer_range: [52, 53] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 0.984122045513045 |
| weight: 0.27033565277425947 |
| - sources: |
| - layer_range: [53, 54] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 0.9255767405080507 |
| weight: 0.37663767730586784 |
| - layer_range: [53, 54] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 0.7234368969266856 |
| weight: 0.1658160463398735 |
| - layer_range: [53, 54] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 0.8532059590120992 |
| weight: 0.43706964196670706 |
| - layer_range: [53, 54] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 1.0 |
| weight: 0.04771119856381902 |
| - layer_range: [53, 54] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 1.0 |
| weight: 0.5919569102221742 |
| - layer_range: [53, 54] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 1.0 |
| weight: 0.22963281435189492 |
| - sources: |
| - layer_range: [54, 55] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 1.0 |
| weight: 0.3475997473426404 |
| - layer_range: [54, 55] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 0.8161329387790792 |
| weight: 0.03648533113218805 |
| - layer_range: [54, 55] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 0.9028789366865357 |
| weight: 0.3371401502028399 |
| - layer_range: [54, 55] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 1.0 |
| weight: 0.5021778754503483 |
| - layer_range: [54, 55] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 0.6278797730584087 |
| weight: 0.037325139532396634 |
| - layer_range: [54, 55] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 1.0 |
| weight: 0.3936120888548632 |
| - sources: |
| - layer_range: [55, 56] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 0.7388750662277602 |
| weight: 0.2151193971005742 |
| - layer_range: [55, 56] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 1.0 |
| weight: 0.5399766405483633 |
| - layer_range: [55, 56] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 1.0 |
| weight: 0.10442143666781545 |
| - layer_range: [55, 56] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 0.8263488485859503 |
| weight: 0.06485929066641631 |
| - layer_range: [55, 56] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 0.743026202579836 |
| weight: 0.014638125069511204 |
| - layer_range: [55, 56] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 0.8227894425909675 |
| weight: 0.11892832059734368 |
| - sources: |
| - layer_range: [56, 57] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 1.0 |
| weight: 0.38393582684841193 |
| - layer_range: [56, 57] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 1.0 |
| weight: 0.24201730267713273 |
| - layer_range: [56, 57] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 1.0 |
| weight: 0.26007076742470825 |
| - layer_range: [56, 57] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 1.0 |
| weight: 0.08422385804581514 |
| - layer_range: [56, 57] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 1.0 |
| weight: 0.0036992660024722512 |
| - layer_range: [56, 57] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 0.7514939139207344 |
| weight: 0.3451997072846399 |
| - sources: |
| - layer_range: [57, 58] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 1.0 |
| weight: 0.33871613921258287 |
| - layer_range: [57, 58] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 1.0 |
| weight: 0.048182597743439665 |
| - layer_range: [57, 58] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 1.0 |
| weight: 0.011651172527993914 |
| - layer_range: [57, 58] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 0.8160849831431859 |
| weight: 0.11424646832766437 |
| - layer_range: [57, 58] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 1.0 |
| weight: 0.3931983123342998 |
| - layer_range: [57, 58] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 0.7171727264220018 |
| weight: 0.10929452652254812 |
| - sources: |
| - layer_range: [58, 59] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 1.0 |
| weight: 0.22497978384478687 |
| - layer_range: [58, 59] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 0.7768256950509063 |
| weight: 0.10479639369472392 |
| - layer_range: [58, 59] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 1.0 |
| weight: 0.145637724965138 |
| - layer_range: [58, 59] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 1.0 |
| weight: 0.12241569680355846 |
| - layer_range: [58, 59] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 0.883279950825221 |
| weight: 0.5532199243057724 |
| - layer_range: [58, 59] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 1.0 |
| weight: 0.06739967651517345 |
| - sources: |
| - layer_range: [59, 60] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 0.8844073333555544 |
| weight: 0.1938231280257878 |
| - layer_range: [59, 60] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 0.7891270799908772 |
| weight: 0.16010268470615255 |
| - layer_range: [59, 60] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 1.0 |
| weight: 0.4343278594861103 |
| - layer_range: [59, 60] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 1.0 |
| weight: 0.389752137962742 |
| - layer_range: [59, 60] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 0.9016217999214565 |
| weight: 0.2505204090631463 |
| - layer_range: [59, 60] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 1.0 |
| weight: 0.1977767156949726 |
| - sources: |
| - layer_range: [60, 61] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 1.0 |
| weight: 0.2543523020344591 |
| - layer_range: [60, 61] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 0.9662968003254059 |
| weight: 0.18615431697974158 |
| - layer_range: [60, 61] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 0.9113337809225843 |
| weight: 0.07920949500135421 |
| - layer_range: [60, 61] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 1.0 |
| weight: 0.11878279057630278 |
| - layer_range: [60, 61] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 0.7952742674123203 |
| weight: 0.16118019976313275 |
| - layer_range: [60, 61] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 1.0 |
| weight: 0.031103198183016406 |
| - sources: |
| - layer_range: [61, 62] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 1.0 |
| weight: 0.05410447775552422 |
| - layer_range: [61, 62] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 0.9104633681153931 |
| weight: 0.30571810831172763 |
| - layer_range: [61, 62] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 0.9154645628329681 |
| weight: 0.27927303553096483 |
| - layer_range: [61, 62] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 1.0 |
| weight: 0.0761595032045365 |
| - layer_range: [61, 62] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 0.869901125974021 |
| weight: 0.22816111210614895 |
| - layer_range: [61, 62] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 0.7806001258108655 |
| weight: 0.09188340518847221 |
| - sources: |
| - layer_range: [62, 63] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 1.0 |
| weight: 0.09551963768037755 |
| - layer_range: [62, 63] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 0.8646175386347293 |
| weight: 0.24410971068987242 |
| - layer_range: [62, 63] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 0.895326932093959 |
| weight: 0.47378092599141397 |
| - layer_range: [62, 63] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 1.0 |
| weight: 0.18318460294204425 |
| - layer_range: [62, 63] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 0.6660708817741321 |
| weight: 0.18328269352991441 |
| - layer_range: [62, 63] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 0.8814742970830101 |
| weight: 0.5453905534189657 |
| - sources: |
| - layer_range: [63, 64] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 0.7504478590156137 |
| weight: 0.36513314401521524 |
| - layer_range: [63, 64] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 1.0 |
| weight: 0.3744076494258641 |
| - layer_range: [63, 64] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 1.0 |
| weight: 0.026651943167621095 |
| - layer_range: [63, 64] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 0.9059698105875248 |
| weight: 0.1505532240067479 |
| - layer_range: [63, 64] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 1.0 |
| weight: 0.04263662107328934 |
| - layer_range: [63, 64] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 1.0 |
| weight: 0.3274436147282644 |
| ``` |
|
|
