Hugging Face's logo

Biscotto58
/
MistralNemoMegaV0

Safetensors
GGUF
conversational
Model card Files
xet
 Community
Biscotto58 commited on
Commit
df8344b
·
verified ·
1 Parent(s): e4b0d2c

Upload Full Merged Model

Browse files
This view is limited to 50 files because it contains too many changes.   See raw diff
Files changed (50) hide show
  1. model/README.md +44 -0
  2. model/config.json +26 -0
  3. model/mergekit_config.yml +15 -0
  4. model/model-00001-of-00052.safetensors +3 -0
  5. model/model-00002-of-00052.safetensors +3 -0
  6. model/model-00003-of-00052.safetensors +3 -0
  7. model/model-00004-of-00052.safetensors +3 -0
  8. model/model-00005-of-00052.safetensors +3 -0
  9. model/model-00006-of-00052.safetensors +3 -0
  10. model/model-00007-of-00052.safetensors +3 -0
  11. model/model-00008-of-00052.safetensors +3 -0
  12. model/model-00009-of-00052.safetensors +3 -0
  13. model/model-00010-of-00052.safetensors +3 -0
  14. model/model-00011-of-00052.safetensors +3 -0
  15. model/model-00012-of-00052.safetensors +3 -0
  16. model/model-00013-of-00052.safetensors +3 -0
  17. model/model-00014-of-00052.safetensors +3 -0
  18. model/model-00015-of-00052.safetensors +3 -0
  19. model/model-00016-of-00052.safetensors +3 -0
  20. model/model-00017-of-00052.safetensors +3 -0
  21. model/model-00018-of-00052.safetensors +3 -0
  22. model/model-00019-of-00052.safetensors +3 -0
  23. model/model-00020-of-00052.safetensors +3 -0
  24. model/model-00021-of-00052.safetensors +3 -0
  25. model/model-00022-of-00052.safetensors +3 -0
  26. model/model-00023-of-00052.safetensors +3 -0
  27. model/model-00024-of-00052.safetensors +3 -0
  28. model/model-00025-of-00052.safetensors +3 -0
  29. model/model-00026-of-00052.safetensors +3 -0
  30. model/model-00027-of-00052.safetensors +3 -0
  31. model/model-00028-of-00052.safetensors +3 -0
  32. model/model-00029-of-00052.safetensors +3 -0
  33. model/model-00030-of-00052.safetensors +3 -0
  34. model/model-00031-of-00052.safetensors +3 -0
  35. model/model-00032-of-00052.safetensors +3 -0
  36. model/model-00033-of-00052.safetensors +3 -0
  37. model/model-00034-of-00052.safetensors +3 -0
  38. model/model-00035-of-00052.safetensors +3 -0
  39. model/model-00036-of-00052.safetensors +3 -0
  40. model/model-00037-of-00052.safetensors +3 -0
  41. model/model-00038-of-00052.safetensors +3 -0
  42. model/model-00039-of-00052.safetensors +3 -0
  43. model/model-00040-of-00052.safetensors +3 -0
  44. model/model-00041-of-00052.safetensors +3 -0
  45. model/model-00042-of-00052.safetensors +3 -0
  46. model/model-00043-of-00052.safetensors +3 -0
  47. model/model-00044-of-00052.safetensors +3 -0
  48. model/model-00045-of-00052.safetensors +3 -0
  49. model/model-00046-of-00052.safetensors +3 -0
  50. model/model-00047-of-00052.safetensors +3 -0
model/README.md ADDED
@@ -0,0 +1,44 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: []
3
+ library_name: transformers
4
+ tags:
5
+ - mergekit
6
+ - merge
7
+
8
+ ---
9
+ # final_merge_output
10
+
11
+ This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
12
+
13
+ ## Merge Details
14
+ ### Merge Method
15
+
16
+ This model was merged using the [DARE TIES](https://arxiv.org/abs/2311.03099) merge method using /teamspace/studios/this_studio/work_dir/intermediate_stages/stage5_smart_prose as a base.
17
+
18
+ ### Models Merged
19
+
20
+ The following models were included in the merge:
21
+ * /teamspace/studios/this_studio/work_dir/intermediate_stages/stage6_controlled_chaos
22
+
23
+ ### Configuration
24
+
25
+ The following YAML configuration was used to produce this model:
26
+
27
+ ```yaml
28
+ base_model: /teamspace/studios/this_studio/work_dir/intermediate_stages/stage5_smart_prose
29
+ dtype: float16
30
+ merge_method: dare_ties
31
+ models:
32
+ - model: /teamspace/studios/this_studio/work_dir/intermediate_stages/stage5_smart_prose
33
+ parameters:
34
+ weight: 0.5
35
+ - model: /teamspace/studios/this_studio/work_dir/intermediate_stages/stage6_controlled_chaos
36
+ parameters:
37
+ weight: 0.5
38
+ name: FINAL_Unhinged_Genius_12B
39
+ parameters:
40
+ density: 0.6
41
+ int8_mask: true
42
+ weight: 0.5
43
+
44
+ ```
model/config.json ADDED
@@ -0,0 +1,26 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "architectures": [
3
+ "MistralForCausalLM"
4
+ ],
5
+ "attention_dropout": 0.0,
6
+ "bos_token_id": 1,
7
+ "dtype": "float16",
8
+ "eos_token_id": 15,
9
+ "head_dim": 128,
10
+ "hidden_act": "silu",
11
+ "hidden_size": 5120,
12
+ "initializer_range": 0.02,
13
+ "intermediate_size": 14336,
14
+ "max_position_embeddings": 1024000,
15
+ "model_type": "mistral",
16
+ "num_attention_heads": 32,
17
+ "num_hidden_layers": 40,
18
+ "num_key_value_heads": 8,
19
+ "rms_norm_eps": 1e-05,
20
+ "rope_theta": 1000000.0,
21
+ "sliding_window": null,
22
+ "tie_word_embeddings": false,
23
+ "transformers_version": "4.57.3",
24
+ "use_cache": true,
25
+ "vocab_size": 131072
26
+ }
model/mergekit_config.yml ADDED
@@ -0,0 +1,15 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ base_model: /teamspace/studios/this_studio/work_dir/intermediate_stages/stage5_smart_prose
2
+ dtype: float16
3
+ merge_method: dare_ties
4
+ models:
5
+ - model: /teamspace/studios/this_studio/work_dir/intermediate_stages/stage5_smart_prose
6
+ parameters:
7
+ weight: 0.5
8
+ - model: /teamspace/studios/this_studio/work_dir/intermediate_stages/stage6_controlled_chaos
9
+ parameters:
10
+ weight: 0.5
11
+ name: FINAL_Unhinged_Genius_12B
12
+ parameters:
13
+ density: 0.6
14
+ int8_mask: true
15
+ weight: 0.5
model/model-00001-of-00052.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:95f602cdaec54218c27ac394f025c0a799f6e0443a102cdc006c99f54c21887b
3
+ size 1342177408
model/model-00002-of-00052.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c02630ba8b8ec21f14b169db6195b6b412be4c8691c77c60aaab41d57db5412b
3
+ size 1342177416
model/model-00003-of-00052.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:243c470c8d6aa74ce928101fa350abf241569f828de0a5a921cf6c7a9f22b423
3
+ size 492852016
model/model-00004-of-00052.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9f23391ce45196a5b2bc47fdd0f6c4452f4818837da20cd815061e94eb220f19
3
+ size 503337888
model/model-00005-of-00052.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f419c406298fe5b179d78d66fc147997b2ac747f6dac843245205765c515040c
3
+ size 387984064
model/model-00006-of-00052.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2b1b9406afd14b546afcd8428b30850554fad8e44ccb761527562dad38f48406
3
+ size 398480304
model/model-00007-of-00052.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:622de7cb5c1cdd115fe822bed0b339882c6cb76b6cbfd00f42ca3dfe1e0235ba
3
+ size 398480304
model/model-00008-of-00052.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:999791219d74e6afa7c78c68ab5a7103e99304dbb36a3d0ec5e9feb2871dac2d
3
+ size 492841680
model/model-00009-of-00052.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7fbdfb46382793e5e1bc78f99c9d20fceee63ae8eef74a0bb93090e1fe8c56a5
3
+ size 503337896
model/model-00010-of-00052.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e784b2609f43ed0c30ead4d38cc6e4867a6ced5d4bd565839affff88c6da9b94
3
+ size 387984064
model/model-00011-of-00052.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:60b34b3989d6ec191cbe015e1d811b6b05da9c842bde13b612f4500ee24c9ea9
3
+ size 398480304
model/model-00012-of-00052.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bebd2d3f43392c8972b27e878ace9ac1597053422d0a759dcd03ba761b3a2a0f
3
+ size 398480304
model/model-00013-of-00052.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9c8659af61554d04fe4fdbba0b36b25cdfba7307449f578c2a4e2cfec6b35e89
3
+ size 492841680
model/model-00014-of-00052.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1812491f4d85180105bb0d1f9b7933279db3281bb4574decda434391369900ef
3
+ size 503337896
model/model-00015-of-00052.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:494825b99b848ec94e5e7073b92fd0f814fe37037944c98bedab680ab675a540
3
+ size 387984064
model/model-00016-of-00052.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:90a65cccf7c87802deddb031a752d5a2216e06ebc2e0f82c314bab6f3f6b7fbf
3
+ size 398480304
model/model-00017-of-00052.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6d1e3608f655693b1c7b68130c461b265a16ccbbe46242c76a47d7befd9a6711
3
+ size 398480304
model/model-00018-of-00052.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:910ce1536f029cf09ff80e1e65da9eb2e5305f3461bf5395f8ffe50a441847e8
3
+ size 492841672
model/model-00019-of-00052.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9f7f1f3726e1a8df9377ca808fc2868ee3f8f207c289ca8f65a947b1b59e8496
3
+ size 503337896
model/model-00020-of-00052.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7ecc2d88d56737e56315228988b8db1c64e24344fffb8b0ea351002b9e6cf3c0
3
+ size 387984064
model/model-00021-of-00052.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:732ff17aeba7a33bc5a07fad2ade2f8fa2163849a42f3bc6bd77d421f4ad4ef7
3
+ size 398480304
model/model-00022-of-00052.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cffb91b8c2368aa41b98e1d1c847f08e287c0bf6b79422c9f22fcbf83142025c
3
+ size 398480304
model/model-00023-of-00052.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ea089942edccf218030ccf2ef6fb99d87652f818ecbe4c6fa4c3c64a9d965982
3
+ size 492841680
model/model-00024-of-00052.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1e18b56ad956cc8423e6dccbcbbc4f45a7c322c5df31ae70d980636fbadd72dc
3
+ size 503337896
model/model-00025-of-00052.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9f228683f0edf78a434d12cfb16281bce059f4d5406d729ef7ec130d06541bde
3
+ size 387984064
model/model-00026-of-00052.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f3835438793a67b2afdf261705fe4649933868acbd04b35c398cab1dd2ec577c
3
+ size 398480304
model/model-00027-of-00052.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:45df52eaa6b3103801461e96346e7ef2c2bc99e4d8496c158be0b36fa8ad1132
3
+ size 398480304
model/model-00028-of-00052.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:155520414c308b7abcc301e65011ab4a69c2a9e601215bbd52f5e2ca36e33636
3
+ size 492841680
model/model-00029-of-00052.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8adece8cb226122aed3de93d9baa0cef7520f71574ea641ce969858f701fdcc6
3
+ size 503337896
model/model-00030-of-00052.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:78a19c3374a38dce77130d893e393efee26aff18ce9a4835639c0f50499e6336
3
+ size 387984064
model/model-00031-of-00052.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:44558530baad7cac57480584f9760f27f4785895eb888d733b66e1d3c26cdb99
3
+ size 398480304
model/model-00032-of-00052.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:781a404605cedf7230e0de4a8fe3bf2b96024cf72871c481e43a02a01daaa0ec
3
+ size 398480296
model/model-00033-of-00052.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:66383dd4b003699ba453797f0ae47b6e1cd156c8ede7d1d583d48523b2cc7909
3
+ size 492841680
model/model-00034-of-00052.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:390044bb9c65d1895508a486f8e2daf56c0b21f6534a7bb4b31470652234b786
3
+ size 503337896
model/model-00035-of-00052.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ec79a99e17c81a102623ca5650eff7b89fc90f401bb04a07a31ddbaced3d3e34
3
+ size 387984064
model/model-00036-of-00052.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4eb9b0b87eb9679d88d70a3585f201602d880974d9e8e45a2281a20dcebdc1e2
3
+ size 398480304
model/model-00037-of-00052.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f98a5166c4452fb34ded199665004b7b6d34edfcbe18f178d32a442d8129a274
3
+ size 398480304
model/model-00038-of-00052.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d9af1b8027740fda954f13574eab26b6993ed23a79400b37bad70b7aa343c6c8
3
+ size 492841680
model/model-00039-of-00052.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2b279954a399129e12d58dc5ba22ef41d5f745d7d3ce47969b776cb67fa263de
3
+ size 503337896
model/model-00040-of-00052.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3ec4caf783cc487f627ca0a0bf4ff9c6816f0e65616fee58c5b64e989399b73f
3
+ size 387984064
model/model-00041-of-00052.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:84b974c093c3578148a903dfe23a2f94f32e0124ddc0e4c5f6f29b285264c9f2
3
+ size 398480304
model/model-00042-of-00052.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ba892b2ebdec9e408524776f0823e97e797250ed59d1724f85f15642c6679d51
3
+ size 398480304
model/model-00043-of-00052.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3d115e637ece6e3aa1e5fe47878fc21db04800e3ec33df23d5140f44fb3b6502
3
+ size 492841680
model/model-00044-of-00052.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:da6a52fc6648be7e7849f017c981c131d4cfa00402be033fbf3365068423c688
3
+ size 503337896
model/model-00045-of-00052.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c1c1e4c948fd2d36db92163c5bc79a2f750090c7e82885f4037b4d1a88bcc192
3
+ size 387984064
model/model-00046-of-00052.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:683a73ff28d4ac5fc8bff788e5a4171b34d80d86d734ceb2b290bbfc7478ee51
3
+ size 398480296
model/model-00047-of-00052.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:177c7e7837593b21a8b0bcfe3e7d0794bc60bab44240cf087dfd2693d4edf619
3
+ size 398480296