| --- |
| base_model: [] |
| library_name: transformers |
| tags: |
| - mergekit |
| - merge |
|
|
| --- |
| # NEW-Fuse-AIME-1 |
|
|
| This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit). |
|
|
| ## Merge Details |
| ### Merge Method |
|
|
| This model was merged using the [DARE TIES](https://arxiv.org/abs/2311.03099) merge method using /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 as a base. |
|
|
| ### Models Merged |
|
|
| The following models were included in the merge: |
| * /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| * /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| * /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| * /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| * /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
|
|
| ### Configuration |
|
|
| The following YAML configuration was used to produce this model: |
|
|
| ```yaml |
| base_model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| dtype: bfloat16 |
| merge_method: dare_ties |
| parameters: |
| int8_mask: 1.0 |
| normalize: 0.0 |
| slices: |
| - sources: |
| - layer_range: [0, 1] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 1.0 |
| weight: 0.35244033843752853 |
| - layer_range: [0, 1] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 1.0 |
| weight: 0.06565483579026653 |
| - layer_range: [0, 1] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 0.8248923599361199 |
| weight: 0.38461070968524835 |
| - layer_range: [0, 1] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 0.8592460452699369 |
| weight: 0.2709388464832553 |
| - layer_range: [0, 1] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 0.6541749263416319 |
| weight: 0.33556129068833057 |
| - layer_range: [0, 1] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 0.9426661206524789 |
| weight: 0.0053235629152804664 |
| - sources: |
| - layer_range: [1, 2] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 0.9488748922395204 |
| weight: 0.14826464617072407 |
| - layer_range: [1, 2] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 0.9131099463854294 |
| weight: 0.0500716728672521 |
| - layer_range: [1, 2] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 1.0 |
| weight: 0.03528639404457212 |
| - layer_range: [1, 2] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 1.0 |
| weight: 0.2726030572249115 |
| - layer_range: [1, 2] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 1.0 |
| weight: 0.12239211353380436 |
| - layer_range: [1, 2] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 0.9635154239911565 |
| weight: 0.21170102977920005 |
| - sources: |
| - layer_range: [2, 3] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 1.0 |
| weight: 0.36980377431194145 |
| - layer_range: [2, 3] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 0.9379968946209096 |
| weight: 0.4105923892761978 |
| - layer_range: [2, 3] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 0.9581657977584064 |
| weight: 0.22436197906860517 |
| - layer_range: [2, 3] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 0.8304501761634047 |
| weight: 0.319948178020794 |
| - layer_range: [2, 3] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 0.9871664200736995 |
| weight: 0.2330494583171301 |
| - layer_range: [2, 3] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 0.6729079463501024 |
| weight: 0.019625987153301827 |
| - sources: |
| - layer_range: [3, 4] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 0.9485863817976715 |
| weight: 0.34558356909458027 |
| - layer_range: [3, 4] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 1.0 |
| weight: 0.06796959970262986 |
| - layer_range: [3, 4] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 0.8683263873836304 |
| weight: 0.23631196193757625 |
| - layer_range: [3, 4] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 1.0 |
| weight: 0.12897658747785207 |
| - layer_range: [3, 4] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 0.8873304359583831 |
| weight: 0.09356346904417376 |
| - layer_range: [3, 4] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 0.9199000783393735 |
| weight: 0.32323945110304375 |
| - sources: |
| - layer_range: [4, 5] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 1.0 |
| weight: 0.22626532519457837 |
| - layer_range: [4, 5] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 0.9303308151499403 |
| weight: 0.22866449319501092 |
| - layer_range: [4, 5] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 1.0 |
| weight: 0.012114770324266916 |
| - layer_range: [4, 5] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 0.8262691273376455 |
| weight: 0.1880770093616853 |
| - layer_range: [4, 5] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 1.0 |
| weight: 0.6580148272567256 |
| - layer_range: [4, 5] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 1.0 |
| weight: 0.006053164452560877 |
| - sources: |
| - layer_range: [5, 6] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 0.8963288717396416 |
| weight: 0.19450243612974277 |
| - layer_range: [5, 6] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 0.791368227831232 |
| weight: 0.02572381859402889 |
| - layer_range: [5, 6] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 0.6409267202920192 |
| weight: 0.33005762288513496 |
| - layer_range: [5, 6] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 0.8230620681157153 |
| weight: 0.2788608064344805 |
| - layer_range: [5, 6] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 1.0 |
| weight: 0.34794277506374116 |
| - layer_range: [5, 6] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 0.8603238495904307 |
| weight: 0.21702807973364863 |
| - sources: |
| - layer_range: [6, 7] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 0.9209955445213542 |
| weight: 0.08974446616116238 |
| - layer_range: [6, 7] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 0.8932160714427164 |
| weight: 0.3104783993545368 |
| - layer_range: [6, 7] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 0.9414970547144341 |
| weight: 0.06504213911605598 |
| - layer_range: [6, 7] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 1.0 |
| weight: 0.057654213441167196 |
| - layer_range: [6, 7] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 0.9821945836928729 |
| weight: 0.15808303028309914 |
| - layer_range: [6, 7] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 0.7467053899439082 |
| weight: 0.33525672482486385 |
| - sources: |
| - layer_range: [7, 8] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 1.0 |
| weight: 0.1780233459840618 |
| - layer_range: [7, 8] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 0.6637198537771577 |
| weight: 0.350440019875121 |
| - layer_range: [7, 8] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 1.0 |
| weight: 0.051708884503478325 |
| - layer_range: [7, 8] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 0.9018872471355386 |
| weight: 0.28677118290764636 |
| - layer_range: [7, 8] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 0.9108709485880905 |
| weight: 0.1265598944346814 |
| - layer_range: [7, 8] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 1.0 |
| weight: 0.041086328510648196 |
| - sources: |
| - layer_range: [8, 9] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 0.9344819873448885 |
| weight: 0.14958159570120846 |
| - layer_range: [8, 9] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 0.8950475774498431 |
| weight: 0.12770736183473413 |
| - layer_range: [8, 9] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 1.0 |
| weight: 0.29231444574882387 |
| - layer_range: [8, 9] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 1.0 |
| weight: 0.2836375863562878 |
| - layer_range: [8, 9] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 0.8016409115061408 |
| weight: 0.5444344731114215 |
| - layer_range: [8, 9] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 1.0 |
| weight: 0.1491478960761252 |
| - sources: |
| - layer_range: [9, 10] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 0.9317774796610699 |
| weight: 0.17259642691510574 |
| - layer_range: [9, 10] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 1.0 |
| weight: 0.4891275526164048 |
| - layer_range: [9, 10] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 1.0 |
| weight: 0.06226032047681976 |
| - layer_range: [9, 10] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 0.7193472375209293 |
| weight: 0.021179331761708137 |
| - layer_range: [9, 10] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 0.9493623767409787 |
| weight: 0.2293855220751523 |
| - layer_range: [9, 10] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 0.8858649669962416 |
| weight: 0.29222706340856736 |
| - sources: |
| - layer_range: [10, 11] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 0.6979571275513518 |
| weight: 0.023735569803217782 |
| - layer_range: [10, 11] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 0.9236270062825293 |
| weight: 0.16859473651635182 |
| - layer_range: [10, 11] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 1.0 |
| weight: 0.18526269676326299 |
| - layer_range: [10, 11] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 0.9350660069572695 |
| weight: 0.0029221621280073606 |
| - layer_range: [10, 11] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 0.9895653552801078 |
| weight: 0.2058759130527274 |
| - layer_range: [10, 11] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 1.0 |
| weight: 0.06466413527070317 |
| - sources: |
| - layer_range: [11, 12] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 1.0 |
| weight: 0.6279945130814091 |
| - layer_range: [11, 12] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 1.0 |
| weight: 0.24256131069766823 |
| - layer_range: [11, 12] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 1.0 |
| weight: 0.2447996601710355 |
| - layer_range: [11, 12] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 1.0 |
| weight: 0.017408971387654848 |
| - layer_range: [11, 12] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 1.0 |
| weight: 0.20639036292982904 |
| - layer_range: [11, 12] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 0.7736379676309147 |
| weight: 0.33620172015889555 |
| - sources: |
| - layer_range: [12, 13] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 1.0 |
| weight: 0.3818620713241046 |
| - layer_range: [12, 13] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 0.7539315797503614 |
| weight: 0.12629217690057457 |
| - layer_range: [12, 13] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 0.8631011351825837 |
| weight: 0.07024936053875813 |
| - layer_range: [12, 13] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 0.9243050506620795 |
| weight: 0.16603356264453165 |
| - layer_range: [12, 13] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 1.0 |
| weight: 0.7064439770108553 |
| - layer_range: [12, 13] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 0.9707078804463223 |
| weight: 0.1917727733034922 |
| - sources: |
| - layer_range: [13, 14] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 0.9035937491248339 |
| weight: 0.20684942933884876 |
| - layer_range: [13, 14] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 1.0 |
| weight: 0.04062045229132705 |
| - layer_range: [13, 14] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 1.0 |
| weight: 0.09652371545953004 |
| - layer_range: [13, 14] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 0.7204498418796482 |
| weight: 0.1395997755690292 |
| - layer_range: [13, 14] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 1.0 |
| weight: 0.134725400133938 |
| - layer_range: [13, 14] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 0.962863472735488 |
| weight: 0.19544068754739274 |
| - sources: |
| - layer_range: [14, 15] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 0.8560543604546618 |
| weight: 0.1596539163235574 |
| - layer_range: [14, 15] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 1.0 |
| weight: 0.1721068557847252 |
| - layer_range: [14, 15] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 0.9711858017304653 |
| weight: 0.42200633908888024 |
| - layer_range: [14, 15] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 0.9378240211471923 |
| weight: 0.03138822797552815 |
| - layer_range: [14, 15] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 1.0 |
| weight: 0.15825350887621872 |
| - layer_range: [14, 15] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 1.0 |
| weight: 0.09871857447169267 |
| - sources: |
| - layer_range: [15, 16] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 1.0 |
| weight: 0.38430635558799175 |
| - layer_range: [15, 16] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 1.0 |
| weight: 0.2015475291011739 |
| - layer_range: [15, 16] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 1.0 |
| weight: 0.14445591261752855 |
| - layer_range: [15, 16] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 0.8603795951417006 |
| weight: 0.2961618979486625 |
| - layer_range: [15, 16] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 0.8580174053646074 |
| weight: 0.14301069206654715 |
| - layer_range: [15, 16] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 0.9717109204302016 |
| weight: 0.13328672591584922 |
| - sources: |
| - layer_range: [16, 17] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 1.0 |
| weight: 0.11107527593944753 |
| - layer_range: [16, 17] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 0.9560507181369473 |
| weight: 0.07368367503319825 |
| - layer_range: [16, 17] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 1.0 |
| weight: 0.46261433358045856 |
| - layer_range: [16, 17] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 0.7924646357268611 |
| weight: 0.11061801788303605 |
| - layer_range: [16, 17] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 0.8444385710697626 |
| weight: 0.10305302346005583 |
| - layer_range: [16, 17] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 1.0 |
| weight: 0.0033179983310088756 |
| - sources: |
| - layer_range: [17, 18] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 1.0 |
| weight: 0.11885485419792863 |
| - layer_range: [17, 18] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 1.0 |
| weight: 0.27503497205951427 |
| - layer_range: [17, 18] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 1.0 |
| weight: 0.11605870572277832 |
| - layer_range: [17, 18] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 1.0 |
| weight: 0.027617068554572383 |
| - layer_range: [17, 18] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 1.0 |
| weight: 0.16306758931309295 |
| - layer_range: [17, 18] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 1.0 |
| weight: 0.22889893069371342 |
| - sources: |
| - layer_range: [18, 19] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 1.0 |
| weight: 0.25063161498642306 |
| - layer_range: [18, 19] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 1.0 |
| weight: 0.049954748105031685 |
| - layer_range: [18, 19] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 0.6586200195059745 |
| weight: 0.24754329216230073 |
| - layer_range: [18, 19] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 0.7097504913960737 |
| weight: 0.2550043425392273 |
| - layer_range: [18, 19] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 0.8834084153180433 |
| weight: 0.38978515412037573 |
| - layer_range: [18, 19] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 1.0 |
| weight: 0.1950877626598588 |
| - sources: |
| - layer_range: [19, 20] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 1.0 |
| weight: 0.261038844209231 |
| - layer_range: [19, 20] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 0.9706444430350814 |
| weight: 0.1268925466636987 |
| - layer_range: [19, 20] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 0.7007460424648342 |
| weight: 0.20228947344196918 |
| - layer_range: [19, 20] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 1.0 |
| weight: 0.076790678467687 |
| - layer_range: [19, 20] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 1.0 |
| weight: 0.11955356146006063 |
| - layer_range: [19, 20] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 1.0 |
| weight: 0.2229078913547204 |
| - sources: |
| - layer_range: [20, 21] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 0.9185448618625446 |
| weight: 0.05165852000790261 |
| - layer_range: [20, 21] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 1.0 |
| weight: 0.3417497799332185 |
| - layer_range: [20, 21] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 1.0 |
| weight: 0.0017734187865023343 |
| - layer_range: [20, 21] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 1.0 |
| weight: 0.15065291883212018 |
| - layer_range: [20, 21] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 1.0 |
| weight: 0.02092694750775584 |
| - layer_range: [20, 21] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 0.8221087620644192 |
| weight: 0.015352026000658103 |
| - sources: |
| - layer_range: [21, 22] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 1.0 |
| weight: 0.49113340525127774 |
| - layer_range: [21, 22] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 1.0 |
| weight: 0.10078126487271136 |
| - layer_range: [21, 22] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 1.0 |
| weight: 0.13522916547535774 |
| - layer_range: [21, 22] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 0.8463870815251355 |
| weight: 0.01017440107626627 |
| - layer_range: [21, 22] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 0.8904244483414491 |
| weight: 0.16213203359513373 |
| - layer_range: [21, 22] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 0.8744143758375571 |
| weight: 0.09177625364256652 |
| - sources: |
| - layer_range: [22, 23] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 1.0 |
| weight: 0.038138234981707264 |
| - layer_range: [22, 23] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 0.5807219363288547 |
| weight: 0.3143909820843033 |
| - layer_range: [22, 23] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 1.0 |
| weight: 0.16364838395099435 |
| - layer_range: [22, 23] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 0.9739944185674109 |
| weight: 0.26398466553894406 |
| - layer_range: [22, 23] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 1.0 |
| weight: 0.21289922167960806 |
| - layer_range: [22, 23] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 0.909420234746683 |
| weight: 0.06118470770696044 |
| - sources: |
| - layer_range: [23, 24] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 1.0 |
| weight: 0.016238586669195365 |
| - layer_range: [23, 24] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 1.0 |
| weight: 0.0674191127475775 |
| - layer_range: [23, 24] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 1.0 |
| weight: 0.08924636330686106 |
| - layer_range: [23, 24] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 1.0 |
| weight: 0.18865926192306698 |
| - layer_range: [23, 24] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 0.9057614959272517 |
| weight: 0.14952753666206495 |
| - layer_range: [23, 24] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 1.0 |
| weight: 0.025478952600610005 |
| - sources: |
| - layer_range: [24, 25] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 0.8204927776970573 |
| weight: 0.36995116785406174 |
| - layer_range: [24, 25] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 0.934168195510422 |
| weight: 0.20509317839001168 |
| - layer_range: [24, 25] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 1.0 |
| weight: 0.3427482412645266 |
| - layer_range: [24, 25] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 1.0 |
| weight: 0.03706819006697437 |
| - layer_range: [24, 25] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 1.0 |
| weight: 0.18794113071293173 |
| - layer_range: [24, 25] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 0.682543816882643 |
| weight: 0.2640077319659903 |
| - sources: |
| - layer_range: [25, 26] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 1.0 |
| weight: 0.26904173102605095 |
| - layer_range: [25, 26] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 0.8187927395574907 |
| weight: 0.06746446492300981 |
| - layer_range: [25, 26] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 1.0 |
| weight: 0.4684163299580099 |
| - layer_range: [25, 26] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 1.0 |
| weight: 0.17036632853867986 |
| - layer_range: [25, 26] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 0.6500524858575425 |
| weight: 0.36960464654343594 |
| - layer_range: [25, 26] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 1.0 |
| weight: 0.2791067328283276 |
| - sources: |
| - layer_range: [26, 27] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 1.0 |
| weight: 0.10502658708408241 |
| - layer_range: [26, 27] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 0.7698269154741941 |
| weight: 0.33073559939362185 |
| - layer_range: [26, 27] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 1.0 |
| weight: 0.020727132033309892 |
| - layer_range: [26, 27] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 1.0 |
| weight: 0.20792079652234302 |
| - layer_range: [26, 27] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 1.0 |
| weight: 0.4639379292226603 |
| - layer_range: [26, 27] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 0.7762185845243367 |
| weight: 0.08584305195533527 |
| - sources: |
| - layer_range: [27, 28] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 0.7400954357615026 |
| weight: 0.3367454373266633 |
| - layer_range: [27, 28] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 1.0 |
| weight: 0.571205975367094 |
| - layer_range: [27, 28] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 0.9044090673153418 |
| weight: 0.037137091677969525 |
| - layer_range: [27, 28] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 1.0 |
| weight: 0.09801558194237756 |
| - layer_range: [27, 28] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 1.0 |
| weight: 0.058024268735814066 |
| - layer_range: [27, 28] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 0.903086579972829 |
| weight: 0.10193817509394704 |
| - sources: |
| - layer_range: [28, 29] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 1.0 |
| weight: 0.4929574585773262 |
| - layer_range: [28, 29] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 1.0 |
| weight: 0.28060867977109183 |
| - layer_range: [28, 29] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 1.0 |
| weight: 0.026590892728238696 |
| - layer_range: [28, 29] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 1.0 |
| weight: 0.19141198034510415 |
| - layer_range: [28, 29] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 0.5960927165572599 |
| weight: 0.114412400199558 |
| - layer_range: [28, 29] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 0.9588873226257536 |
| weight: 0.23210466929877763 |
| - sources: |
| - layer_range: [29, 30] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 0.6540253815457119 |
| weight: 0.26676253628350277 |
| - layer_range: [29, 30] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 0.6064521456724821 |
| weight: 0.32731913275227376 |
| - layer_range: [29, 30] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 1.0 |
| weight: 0.37939168265170087 |
| - layer_range: [29, 30] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 0.9044341556516037 |
| weight: 0.20490518434022081 |
| - layer_range: [29, 30] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 0.858245861387603 |
| weight: 0.17917087234350287 |
| - layer_range: [29, 30] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 1.0 |
| weight: 0.6882844641154083 |
| - sources: |
| - layer_range: [30, 31] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 1.0 |
| weight: 0.007150508817157786 |
| - layer_range: [30, 31] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 0.9563254040190147 |
| weight: 0.09103575098086883 |
| - layer_range: [30, 31] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 1.0 |
| weight: 0.43790175373766804 |
| - layer_range: [30, 31] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 0.9486698828297574 |
| weight: 0.0818669239466478 |
| - layer_range: [30, 31] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 1.0 |
| weight: 0.39833013977879245 |
| - layer_range: [30, 31] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 0.7181908348870916 |
| weight: 0.24121561497284677 |
| - sources: |
| - layer_range: [31, 32] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 1.0 |
| weight: 0.10882054979448666 |
| - layer_range: [31, 32] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 0.7543537234549338 |
| weight: 0.12479083340438962 |
| - layer_range: [31, 32] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 1.0 |
| weight: 0.0708097726950752 |
| - layer_range: [31, 32] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 1.0 |
| weight: 0.333948814242619 |
| - layer_range: [31, 32] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 0.8977007951960791 |
| weight: 0.10298756332912873 |
| - layer_range: [31, 32] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 0.4794089660108718 |
| weight: 0.21087998893169188 |
| - sources: |
| - layer_range: [32, 33] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 0.9370115576544044 |
| weight: 0.02842206610649345 |
| - layer_range: [32, 33] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 1.0 |
| weight: 0.25557990331445146 |
| - layer_range: [32, 33] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 1.0 |
| weight: 0.06247100876710021 |
| - layer_range: [32, 33] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 1.0 |
| weight: 0.3388392565514537 |
| - layer_range: [32, 33] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 1.0 |
| weight: 0.3756061798577917 |
| - layer_range: [32, 33] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 1.0 |
| weight: 0.10009126737493823 |
| - sources: |
| - layer_range: [33, 34] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 0.9556503508646775 |
| weight: 0.3970244378117722 |
| - layer_range: [33, 34] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 1.0 |
| weight: 0.19285762221371153 |
| - layer_range: [33, 34] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 1.0 |
| weight: 0.9020002055955054 |
| - layer_range: [33, 34] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 0.8420359869052865 |
| weight: 0.05429678307661277 |
| - layer_range: [33, 34] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 0.8067384349045997 |
| weight: 0.11235997530357353 |
| - layer_range: [33, 34] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 1.0 |
| weight: 0.14904022052788152 |
| - sources: |
| - layer_range: [34, 35] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 0.9434911210556413 |
| weight: 0.2548247050531814 |
| - layer_range: [34, 35] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 0.9719378514337645 |
| weight: 0.15819291099062346 |
| - layer_range: [34, 35] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 1.0 |
| weight: 0.04398329584656263 |
| - layer_range: [34, 35] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 0.6918354532568436 |
| weight: 0.0854102139896491 |
| - layer_range: [34, 35] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 1.0 |
| weight: 0.22535807455552204 |
| - layer_range: [34, 35] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 1.0 |
| weight: 0.35693881247164805 |
| - sources: |
| - layer_range: [35, 36] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 0.9319467891271266 |
| weight: 0.29058568002907836 |
| - layer_range: [35, 36] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 0.7952244776117314 |
| weight: 0.17910477728880925 |
| - layer_range: [35, 36] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 0.7956790509562062 |
| weight: 0.1438684581908245 |
| - layer_range: [35, 36] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 0.825456233455119 |
| weight: 0.21040956342605738 |
| - layer_range: [35, 36] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 1.0 |
| weight: 0.2711380048826145 |
| - layer_range: [35, 36] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 1.0 |
| weight: 0.1213323922087308 |
| - sources: |
| - layer_range: [36, 37] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 1.0 |
| weight: 0.10540127798604942 |
| - layer_range: [36, 37] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 1.0 |
| weight: 0.30234245332173515 |
| - layer_range: [36, 37] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 1.0 |
| weight: 0.48360309114201594 |
| - layer_range: [36, 37] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 0.5199760376551235 |
| weight: 0.15791172185500307 |
| - layer_range: [36, 37] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 0.8229819309620275 |
| weight: 0.20292181858545125 |
| - layer_range: [36, 37] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 1.0 |
| weight: 0.130673858806438 |
| - sources: |
| - layer_range: [37, 38] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 1.0 |
| weight: 0.3389908967120333 |
| - layer_range: [37, 38] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 0.8098832799175976 |
| weight: 0.032729969813799886 |
| - layer_range: [37, 38] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 1.0 |
| weight: 0.06556489588048102 |
| - layer_range: [37, 38] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 0.9606585552315425 |
| weight: 0.39112937866501835 |
| - layer_range: [37, 38] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 1.0 |
| weight: 0.10151217876708106 |
| - layer_range: [37, 38] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 0.9147776170708031 |
| weight: 0.3361818039402313 |
| - sources: |
| - layer_range: [38, 39] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 1.0 |
| weight: 0.07553646917615456 |
| - layer_range: [38, 39] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 1.0 |
| weight: 0.18713681607621746 |
| - layer_range: [38, 39] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 0.8066647125365156 |
| weight: 0.1377407178430086 |
| - layer_range: [38, 39] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 0.7942981092851459 |
| weight: 0.15258533005989686 |
| - layer_range: [38, 39] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 0.9317818891985491 |
| weight: 0.1917799304294585 |
| - layer_range: [38, 39] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 1.0 |
| weight: 0.014887699641953689 |
| - sources: |
| - layer_range: [39, 40] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 1.0 |
| weight: 0.20840025067571885 |
| - layer_range: [39, 40] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 0.9782399449646568 |
| weight: 0.2328438946903973 |
| - layer_range: [39, 40] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 0.8995390693540155 |
| weight: 0.03203001507470046 |
| - layer_range: [39, 40] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 0.931359822067464 |
| weight: 0.23927051033346863 |
| - layer_range: [39, 40] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 1.0 |
| weight: 0.32001222942808727 |
| - layer_range: [39, 40] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 1.0 |
| weight: 0.10925837419057471 |
| - sources: |
| - layer_range: [40, 41] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 1.0 |
| weight: 0.41651154278513103 |
| - layer_range: [40, 41] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 1.0 |
| weight: 0.15562043474854753 |
| - layer_range: [40, 41] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 1.0 |
| weight: 0.010757564378272605 |
| - layer_range: [40, 41] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 0.8076181360972706 |
| weight: 0.32394761313424586 |
| - layer_range: [40, 41] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 0.9479478932638606 |
| weight: 0.21045149780131678 |
| - layer_range: [40, 41] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 1.0 |
| weight: 0.05057244982605083 |
| - sources: |
| - layer_range: [41, 42] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 0.8236658041251139 |
| weight: 0.21321322044720487 |
| - layer_range: [41, 42] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 0.9543216813136639 |
| weight: 0.11263172588937082 |
| - layer_range: [41, 42] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 0.9709605318433385 |
| weight: 0.3523451529485697 |
| - layer_range: [41, 42] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 1.0 |
| weight: 0.3040953041306902 |
| - layer_range: [41, 42] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 1.0 |
| weight: 0.17186154702391532 |
| - layer_range: [41, 42] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 0.9068299422142455 |
| weight: 0.05240246428051881 |
| - sources: |
| - layer_range: [42, 43] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 1.0 |
| weight: 0.09508672685600689 |
| - layer_range: [42, 43] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 1.0 |
| weight: 0.22133149029323637 |
| - layer_range: [42, 43] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 0.7669173526006674 |
| weight: 0.08057282883798367 |
| - layer_range: [42, 43] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 1.0 |
| weight: 0.0913965000724602 |
| - layer_range: [42, 43] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 0.5634995238181923 |
| weight: 0.013003111064234352 |
| - layer_range: [42, 43] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 1.0 |
| weight: 0.0463173781438628 |
| - sources: |
| - layer_range: [43, 44] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 0.7737123104466118 |
| weight: 0.17942861257500786 |
| - layer_range: [43, 44] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 1.0 |
| weight: 0.29415458383167614 |
| - layer_range: [43, 44] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 1.0 |
| weight: 0.4348355267146788 |
| - layer_range: [43, 44] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 1.0 |
| weight: 0.18303269950667883 |
| - layer_range: [43, 44] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 0.9713390697352875 |
| weight: 0.22507337047150916 |
| - layer_range: [43, 44] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 0.8137903764931057 |
| weight: 0.04079562353601332 |
| - sources: |
| - layer_range: [44, 45] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 1.0 |
| weight: 0.047062104611051064 |
| - layer_range: [44, 45] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 1.0 |
| weight: 0.16846088469030315 |
| - layer_range: [44, 45] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 0.7880602717133516 |
| weight: 0.2789583731212955 |
| - layer_range: [44, 45] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 1.0 |
| weight: 0.32352529491682286 |
| - layer_range: [44, 45] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 0.8949399037061117 |
| weight: 0.2545484290147384 |
| - layer_range: [44, 45] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 1.0 |
| weight: 0.09517685873313844 |
| - sources: |
| - layer_range: [45, 46] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 0.8358580272764898 |
| weight: 0.2855837708760959 |
| - layer_range: [45, 46] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 1.0 |
| weight: 0.41479888008593596 |
| - layer_range: [45, 46] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 1.0 |
| weight: 0.2550535659664166 |
| - layer_range: [45, 46] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 1.0 |
| weight: 0.28139845163428256 |
| - layer_range: [45, 46] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 0.8980539982908744 |
| weight: 0.12713384155889973 |
| - layer_range: [45, 46] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 1.0 |
| weight: 0.004351098386697783 |
| - sources: |
| - layer_range: [46, 47] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 1.0 |
| weight: 0.38857173097398257 |
| - layer_range: [46, 47] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 1.0 |
| weight: 0.14163401231091394 |
| - layer_range: [46, 47] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 0.8868499716013419 |
| weight: 0.25483408300091354 |
| - layer_range: [46, 47] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 0.8490612361146361 |
| weight: 0.3838493668524031 |
| - layer_range: [46, 47] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 1.0 |
| weight: 0.2134383937085923 |
| - layer_range: [46, 47] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 1.0 |
| weight: 0.29351791671961525 |
| - sources: |
| - layer_range: [47, 48] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 0.7592788632718213 |
| weight: 0.21580100444026937 |
| - layer_range: [47, 48] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 1.0 |
| weight: 0.11563748273172356 |
| - layer_range: [47, 48] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 0.8238278678209028 |
| weight: 0.12046149405569524 |
| - layer_range: [47, 48] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 0.7027924239196756 |
| weight: 0.08545622694966344 |
| - layer_range: [47, 48] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 1.0 |
| weight: 0.11400029849999294 |
| - layer_range: [47, 48] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 1.0 |
| weight: 0.1385923431877603 |
| - sources: |
| - layer_range: [48, 49] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 1.0 |
| weight: 0.26847461441506426 |
| - layer_range: [48, 49] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 0.9989059042448725 |
| weight: 0.02755706551909709 |
| - layer_range: [48, 49] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 1.0 |
| weight: 0.29454458599205624 |
| - layer_range: [48, 49] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 1.0 |
| weight: 0.21027571525323657 |
| - layer_range: [48, 49] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 1.0 |
| weight: 0.05698290419859764 |
| - layer_range: [48, 49] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 0.7984875107617855 |
| weight: 0.008106935637840706 |
| - sources: |
| - layer_range: [49, 50] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 1.0 |
| weight: 0.06730944082274636 |
| - layer_range: [49, 50] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 1.0 |
| weight: 0.056144623361766885 |
| - layer_range: [49, 50] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 0.9456462618822497 |
| weight: 0.14816750915525348 |
| - layer_range: [49, 50] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 0.9456887334985299 |
| weight: 0.010656517207506516 |
| - layer_range: [49, 50] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 1.0 |
| weight: 0.18034550821096046 |
| - layer_range: [49, 50] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 1.0 |
| weight: 0.2614189069253616 |
| - sources: |
| - layer_range: [50, 51] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 1.0 |
| weight: 0.09036514284084263 |
| - layer_range: [50, 51] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 1.0 |
| weight: 0.2793847527781395 |
| - layer_range: [50, 51] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 0.7823494966044564 |
| weight: 0.1918617933005795 |
| - layer_range: [50, 51] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 1.0 |
| weight: 0.06742144092010083 |
| - layer_range: [50, 51] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 1.0 |
| weight: 0.08939312333251181 |
| - layer_range: [50, 51] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 0.833744405837781 |
| weight: 0.2569366887908943 |
| - sources: |
| - layer_range: [51, 52] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 1.0 |
| weight: 0.204580104229255 |
| - layer_range: [51, 52] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 0.5650841458103742 |
| weight: 0.05931790715471086 |
| - layer_range: [51, 52] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 0.778532619712101 |
| weight: 0.19801357088299154 |
| - layer_range: [51, 52] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 0.8282432512063711 |
| weight: 0.3503101423420888 |
| - layer_range: [51, 52] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 1.0 |
| weight: 0.16037771860597982 |
| - layer_range: [51, 52] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 1.0 |
| weight: 0.056630800646782664 |
| - sources: |
| - layer_range: [52, 53] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 0.8102173034683241 |
| weight: 0.17436162327079358 |
| - layer_range: [52, 53] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 1.0 |
| weight: 0.053046951706820056 |
| - layer_range: [52, 53] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 1.0 |
| weight: 0.27843953938291616 |
| - layer_range: [52, 53] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 1.0 |
| weight: 0.15918211869367555 |
| - layer_range: [52, 53] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 0.8007638182050225 |
| weight: 0.032818586693711294 |
| - layer_range: [52, 53] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 1.0 |
| weight: 0.17033249682303778 |
| - sources: |
| - layer_range: [53, 54] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 1.0 |
| weight: 0.09624555984301572 |
| - layer_range: [53, 54] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 0.5571652220837998 |
| weight: 0.04953328492569409 |
| - layer_range: [53, 54] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 1.0 |
| weight: 0.041116739637920924 |
| - layer_range: [53, 54] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 1.0 |
| weight: 0.17225873901498326 |
| - layer_range: [53, 54] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 0.5226491226347826 |
| weight: 0.2782408228603738 |
| - layer_range: [53, 54] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 1.0 |
| weight: 0.3032589409329551 |
| - sources: |
| - layer_range: [54, 55] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 0.9304345418952316 |
| weight: 0.032364817446169286 |
| - layer_range: [54, 55] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 1.0 |
| weight: 0.39179869867982725 |
| - layer_range: [54, 55] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 0.8150966766025997 |
| weight: 0.02288042804967988 |
| - layer_range: [54, 55] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 1.0 |
| weight: 0.1789626519265678 |
| - layer_range: [54, 55] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 0.8910058256154507 |
| weight: 0.20471189803004364 |
| - layer_range: [54, 55] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 1.0 |
| weight: 0.13970624095073508 |
| - sources: |
| - layer_range: [55, 56] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 0.8053976349102374 |
| weight: 0.2840366733935171 |
| - layer_range: [55, 56] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 0.9537785616138238 |
| weight: 0.04358059246606438 |
| - layer_range: [55, 56] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 1.0 |
| weight: 0.24477013102149628 |
| - layer_range: [55, 56] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 0.9585712571206357 |
| weight: 0.37102592178522487 |
| - layer_range: [55, 56] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 0.8998251608652412 |
| weight: 0.39569695763453694 |
| - layer_range: [55, 56] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 1.0 |
| weight: 0.14637293332966364 |
| - sources: |
| - layer_range: [56, 57] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 0.898055237651287 |
| weight: 0.057788054342290326 |
| - layer_range: [56, 57] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 1.0 |
| weight: 0.24981253173887333 |
| - layer_range: [56, 57] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 0.7804588723814723 |
| weight: 0.44130754723160515 |
| - layer_range: [56, 57] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 0.8842003107758944 |
| weight: 0.0008712317185377572 |
| - layer_range: [56, 57] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 1.0 |
| weight: 0.11582432992359575 |
| - layer_range: [56, 57] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 0.8776343698470468 |
| weight: 0.12743969299538765 |
| - sources: |
| - layer_range: [57, 58] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 1.0 |
| weight: 0.01377373448756325 |
| - layer_range: [57, 58] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 0.925005411207583 |
| weight: 0.31944303509866195 |
| - layer_range: [57, 58] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 0.8762567459720589 |
| weight: 0.2990916989904438 |
| - layer_range: [57, 58] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 1.0 |
| weight: 0.30495949216462254 |
| - layer_range: [57, 58] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 0.8839795316361178 |
| weight: 0.24258010470545116 |
| - layer_range: [57, 58] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 1.0 |
| weight: 0.12604448444251193 |
| - sources: |
| - layer_range: [58, 59] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 0.724670014865185 |
| weight: 0.24511684858463265 |
| - layer_range: [58, 59] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 1.0 |
| weight: 0.4349914719295033 |
| - layer_range: [58, 59] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 1.0 |
| weight: 0.2026461684035123 |
| - layer_range: [58, 59] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 1.0 |
| weight: 0.2051083755305495 |
| - layer_range: [58, 59] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 1.0 |
| weight: 0.08276720148098043 |
| - layer_range: [58, 59] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 0.9009273902277648 |
| weight: 0.1254339189305163 |
| - sources: |
| - layer_range: [59, 60] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 0.9466214229369014 |
| weight: 0.3403510978774423 |
| - layer_range: [59, 60] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 1.0 |
| weight: 0.17569006036341767 |
| - layer_range: [59, 60] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 1.0 |
| weight: 0.019809874547022877 |
| - layer_range: [59, 60] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 1.0 |
| weight: 0.057565875154789975 |
| - layer_range: [59, 60] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 0.8381886677136565 |
| weight: 0.0737289532231587 |
| - layer_range: [59, 60] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 0.892209341014166 |
| weight: 0.24307087184793097 |
| - sources: |
| - layer_range: [60, 61] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 0.9951552547915052 |
| weight: 0.19712510079989057 |
| - layer_range: [60, 61] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 1.0 |
| weight: 0.5619165612671431 |
| - layer_range: [60, 61] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 0.8781048804500454 |
| weight: 0.26190386780513264 |
| - layer_range: [60, 61] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 0.7316121364951871 |
| weight: 0.13798543588037673 |
| - layer_range: [60, 61] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 1.0 |
| weight: 0.28118540067796494 |
| - layer_range: [60, 61] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 0.9768004959403602 |
| weight: 0.10847809141549553 |
| - sources: |
| - layer_range: [61, 62] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 1.0 |
| weight: 0.007750679801211385 |
| - layer_range: [61, 62] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 1.0 |
| weight: 0.08089462228857118 |
| - layer_range: [61, 62] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 0.8393212930792688 |
| weight: 0.22937555333464804 |
| - layer_range: [61, 62] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 0.9793604094050525 |
| weight: 0.07184083460820315 |
| - layer_range: [61, 62] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 0.9182862858497272 |
| weight: 0.4506195904381331 |
| - layer_range: [61, 62] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 1.0 |
| weight: 0.16547976349593468 |
| - sources: |
| - layer_range: [62, 63] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 1.0 |
| weight: 0.4665122813434508 |
| - layer_range: [62, 63] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 0.851187623811185 |
| weight: 0.061043514475124655 |
| - layer_range: [62, 63] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 1.0 |
| weight: 0.565587088161311 |
| - layer_range: [62, 63] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 1.0 |
| weight: 0.11058276936579046 |
| - layer_range: [62, 63] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 1.0 |
| weight: 0.18513626419830287 |
| - layer_range: [62, 63] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 0.9388107295104234 |
| weight: 0.4570799451538212 |
| - sources: |
| - layer_range: [63, 64] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046 |
| parameters: |
| density: 0.9948294171948843 |
| weight: 0.03137695207967589 |
| - layer_range: [63, 64] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316 |
| parameters: |
| density: 0.6675709065596998 |
| weight: 0.3221447497043656 |
| - layer_range: [63, 64] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087 |
| parameters: |
| density: 0.9587013647644738 |
| weight: 0.10573015996836115 |
| - layer_range: [63, 64] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 |
| parameters: |
| density: 1.0 |
| weight: 0.12008206027963769 |
| - layer_range: [63, 64] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842 |
| parameters: |
| density: 1.0 |
| weight: 0.0765927728276577 |
| - layer_range: [63, 64] |
| model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121 |
| parameters: |
| density: 1.0 |
| weight: 0.3810624649836515 |
| ``` |
|
|
