File size: 1,763 Bytes
473dee9
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
Pruned Experts by Original Layer (Target layer, Expert ID):
  Layer  0: [0, 1, 2, 3, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15]
  Layer  1: [0, 1, 2, 6, 7, 8, 9, 10, 11, 12, 13, 15]
  Layer  2: [0, 2, 4, 7, 9, 10, 11, 13, 15]
  Layer  3: [0, 1, 2, 3, 4, 5, 7, 8, 9, 10, 11, 12, 13, 14]
  Layer  4: [0, 1, 2, 3, 5, 6, 8, 11, 12, 14, 15]
  Layer  5: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15]
  Layer  6: [2, 3, 4, 5, 8, 11, 12, 14, 15]
  Layer  7: [0, 2, 3, 4, 5, 6, 8, 9, 11, 12, 14, 15]
  Layer  8: [0, 1, 2, 4, 7, 8, 9, 11, 13, 15]
  Layer  9: [1, 2, 3, 5, 6, 7, 8, 9, 10, 12, 13, 14, 15]
  Layer 10: [0, 3, 4, 5, 7, 8, 9, 10, 11, 12, 13, 14, 15]
  Layer 11: [1, 2, 3, 4, 5, 7, 8, 9, 10, 11, 12, 13, 15]
  Layer 12: [0, 1, 2, 3, 4, 5, 7, 8, 9, 11, 13, 14, 15]
  Layer 13: [0, 1, 4, 5, 6, 7, 8, 9, 10, 12, 15]
  Layer 14: [0, 1, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15]
  Layer 15: [0, 2, 3, 5, 6, 7, 8, 9, 11, 13, 15]
  Layer 16: [0, 2, 4, 6, 7, 8, 9, 10, 11, 13, 14, 15]
  Layer 17: [0, 1, 2, 3, 5, 6, 8, 9, 10, 11, 12, 13, 14, 15]
  Layer 18: [0, 1, 2, 3, 6, 7, 8, 9, 11, 12, 13, 15]
  Layer 19: [0, 1, 2, 3, 6, 8, 9, 11, 12, 13, 15]
  Layer 20: [0, 3, 4, 8, 9, 10, 11, 15]
  Layer 21: [0, 1, 2, 3, 5, 6, 7, 8, 9, 10, 11, 12, 13]
  Layer 22: [0, 1, 2, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13]
  Layer 23: [0, 1, 2, 4, 6, 7, 8, 10, 11, 13, 15]
  Layer 24: [0, 1, 2, 3, 4, 6, 7, 8, 10, 12, 13, 14, 15]
  Layer 25: [1, 2, 3, 4, 5, 6, 7, 8, 12, 13, 14, 15]
  Layer 26: [0, 1, 3, 4, 5, 6, 7, 9, 10, 11, 13, 14, 15]
  Layer 27: [0, 1, 2, 3, 6, 7, 8, 11, 14]
  Layer 28: [0, 1, 2, 3, 5, 6, 8, 9, 14, 15]
  Layer 29: [0, 2, 3, 5, 7, 8, 9, 10, 11, 12, 13, 14, 15]
  Layer 30: [0, 2, 4, 5, 6, 8, 9, 13, 14]
  Layer 31: [0, 1, 2, 3, 4, 5, 6, 8, 9, 11, 12, 13, 14, 15]