RIEP-75 / pruning_map.txt
PakNin's picture
Upload folder using huggingface_hub
473dee9 verified
Raw
History Blame Contribute Delete
1.76 kB
Pruned Experts by Original Layer (Target layer, Expert ID):
Layer 0: [0, 1, 2, 3, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15]
Layer 1: [0, 1, 2, 6, 7, 8, 9, 10, 11, 12, 13, 15]
Layer 2: [0, 2, 4, 7, 9, 10, 11, 13, 15]
Layer 3: [0, 1, 2, 3, 4, 5, 7, 8, 9, 10, 11, 12, 13, 14]
Layer 4: [0, 1, 2, 3, 5, 6, 8, 11, 12, 14, 15]
Layer 5: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15]
Layer 6: [2, 3, 4, 5, 8, 11, 12, 14, 15]
Layer 7: [0, 2, 3, 4, 5, 6, 8, 9, 11, 12, 14, 15]
Layer 8: [0, 1, 2, 4, 7, 8, 9, 11, 13, 15]
Layer 9: [1, 2, 3, 5, 6, 7, 8, 9, 10, 12, 13, 14, 15]
Layer 10: [0, 3, 4, 5, 7, 8, 9, 10, 11, 12, 13, 14, 15]
Layer 11: [1, 2, 3, 4, 5, 7, 8, 9, 10, 11, 12, 13, 15]
Layer 12: [0, 1, 2, 3, 4, 5, 7, 8, 9, 11, 13, 14, 15]
Layer 13: [0, 1, 4, 5, 6, 7, 8, 9, 10, 12, 15]
Layer 14: [0, 1, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15]
Layer 15: [0, 2, 3, 5, 6, 7, 8, 9, 11, 13, 15]
Layer 16: [0, 2, 4, 6, 7, 8, 9, 10, 11, 13, 14, 15]
Layer 17: [0, 1, 2, 3, 5, 6, 8, 9, 10, 11, 12, 13, 14, 15]
Layer 18: [0, 1, 2, 3, 6, 7, 8, 9, 11, 12, 13, 15]
Layer 19: [0, 1, 2, 3, 6, 8, 9, 11, 12, 13, 15]
Layer 20: [0, 3, 4, 8, 9, 10, 11, 15]
Layer 21: [0, 1, 2, 3, 5, 6, 7, 8, 9, 10, 11, 12, 13]
Layer 22: [0, 1, 2, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13]
Layer 23: [0, 1, 2, 4, 6, 7, 8, 10, 11, 13, 15]
Layer 24: [0, 1, 2, 3, 4, 6, 7, 8, 10, 12, 13, 14, 15]
Layer 25: [1, 2, 3, 4, 5, 6, 7, 8, 12, 13, 14, 15]
Layer 26: [0, 1, 3, 4, 5, 6, 7, 9, 10, 11, 13, 14, 15]
Layer 27: [0, 1, 2, 3, 6, 7, 8, 11, 14]
Layer 28: [0, 1, 2, 3, 5, 6, 8, 9, 14, 15]
Layer 29: [0, 2, 3, 5, 7, 8, 9, 10, 11, 12, 13, 14, 15]
Layer 30: [0, 2, 4, 5, 6, 8, 9, 13, 14]
Layer 31: [0, 1, 2, 3, 4, 5, 6, 8, 9, 11, 12, 13, 14, 15]