RIEP-50 / pruning_map.txt
PakNin's picture
Upload folder using huggingface_hub
b8b877f verified
Raw
History Blame Contribute Delete
1.33 kB
Pruned Experts by Original Layer (Target layer, Expert ID):
Layer 0: [0, 1, 2, 3, 6, 7, 9, 10, 11, 13, 15]
Layer 1: [0, 2, 6, 9, 11, 13, 15]
Layer 2: [0, 9]
Layer 3: [0, 2, 3, 5, 12]
Layer 4: [0, 1, 2, 3, 11, 12, 14]
Layer 5: [0, 1, 2, 3, 5, 6, 8, 10, 11, 14]
Layer 6: [2, 3, 4, 8, 11, 12, 14]
Layer 7: [0, 2, 4, 5, 6, 8, 9, 11, 14, 15]
Layer 8: [0, 2, 9, 11, 13, 15]
Layer 9: [1, 2, 3, 5, 7, 8, 9, 10, 12, 13, 14, 15]
Layer 10: [0, 3, 5, 9, 10, 11, 12, 14]
Layer 11: [1, 2, 3, 4, 5, 7, 9, 10, 13]
Layer 12: [1, 2, 3, 4, 7, 8, 9, 13]
Layer 13: [0, 1, 4, 5, 6, 7, 8, 9, 10, 12, 15]
Layer 14: [0, 1, 4, 5, 6, 7, 8, 9, 10, 15]
Layer 15: [2, 5, 6, 8, 9, 11, 13, 15]
Layer 16: [0, 4, 6, 8, 9, 10, 13, 15]
Layer 17: [0, 8, 9, 10, 11, 13, 15]
Layer 18: [0, 1, 2, 6, 11, 13, 15]
Layer 19: [1, 2, 8, 9, 11, 12, 13, 15]
Layer 20: [0, 3, 4, 8, 9, 10, 11]
Layer 21: [0, 1, 2, 3, 5, 7, 8, 10, 11, 12, 13]
Layer 22: [2, 5, 7, 10, 11, 12, 13]
Layer 23: [1, 4, 6, 7, 8, 11, 13, 15]
Layer 24: [0, 2, 4, 6, 8, 10, 12, 13, 15]
Layer 25: [1, 3, 5, 6, 7, 13, 14]
Layer 26: [0, 1, 5, 6, 7, 9, 10, 13, 14]
Layer 27: [1, 3, 6, 7, 8, 14]
Layer 28: [0, 2, 3, 5, 8, 14, 15]
Layer 29: [0, 2, 3, 5, 12, 13, 14, 15]
Layer 30: [0, 2, 4, 5, 6, 8, 13, 14]
Layer 31: [0, 3, 5, 6, 11, 13, 14]