File size: 884 Bytes
931b0c7
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
Pruned Experts by Original Layer (Target layer, Expert ID):
  Layer  0: [0, 2, 9, 13, 15]
  Layer  2: [0]
  Layer  3: [0, 4]
  Layer  4: [0, 2, 4, 5, 12]
  Layer  5: [0, 1, 2, 3, 6, 8, 11, 14]
  Layer  6: [2, 3, 8, 11]
  Layer  7: [1, 2]
  Layer  8: [9, 11, 15]
  Layer  9: [8, 11, 12]
  Layer 10: [5, 9, 12, 14]
  Layer 11: [0, 3, 4, 7, 9, 10]
  Layer 12: [3, 6, 7, 8, 9, 13]
  Layer 13: [4, 7, 8, 10]
  Layer 14: [1, 5, 7]
  Layer 15: [1, 2, 7, 15]
  Layer 16: [6, 7, 9, 13, 15]
  Layer 17: [0, 8, 11, 12, 13]
  Layer 18: [6, 11]
  Layer 19: [2, 3, 8, 12, 15]
  Layer 20: [0, 7]
  Layer 21: [2, 3, 7, 8, 10, 11, 13]
  Layer 22: [1, 2, 5, 7, 10, 11]
  Layer 23: [4, 8, 10, 11]
  Layer 24: [2, 4, 10, 12]
  Layer 25: [1, 2, 3, 14]
  Layer 26: [1, 7]
  Layer 27: [1, 6, 7, 13, 14]
  Layer 28: [0, 2, 4, 6, 8, 15]
  Layer 29: [0, 1, 2, 5, 11, 13, 15]
  Layer 30: [14]
  Layer 31: [3, 5]