dqy08 commited on
Commit
7dcedf1
·
1 Parent(s): 432625b

Update .gitignore to remove specific public directory exclusions and add .specstory file pattern.

Browse files
.cursorindexingignore ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+
2
+ # Don't index SpecStory auto-save files, but allow explicit context inclusion via @ references
3
+ .specstory/**
.dockerignore CHANGED
@@ -19,13 +19,10 @@ dist/
19
  # --- 项目特定配置 ---
20
  # 忽略所有数据,防止误传大文件
21
  data/*
22
- # 白名单:只保留 GLTR 演示数据
23
  !data/demo/
24
  data/demo/*
25
  !data/demo/public/
26
- data/demo/public/*
27
- !data/demo/public/GLTR demo/
28
- !data/demo/public/GLTR demo/**
29
 
30
  # 忽略临时文件和日志
31
  notes.md
 
19
  # --- 项目特定配置 ---
20
  # 忽略所有数据,防止误传大文件
21
  data/*
22
+ # 白名单:只保留public文件夹
23
  !data/demo/
24
  data/demo/*
25
  !data/demo/public/
 
 
 
26
 
27
  # 忽略临时文件和日志
28
  notes.md
.gitignore CHANGED
@@ -23,8 +23,6 @@ data/*
23
  !data/demo/
24
  data/demo/*
25
  !data/demo/public/
26
- data/demo/public/*
27
- !data/demo/public/GLTR demo/
28
 
29
  # 忽略临时笔记和 HuggingFace 缓存
30
  notes.md
@@ -37,3 +35,4 @@ notes.md
37
  .vscode/
38
  *.swp
39
  *.log
 
 
23
  !data/demo/
24
  data/demo/*
25
  !data/demo/public/
 
 
26
 
27
  # 忽略临时笔记和 HuggingFace 缓存
28
  notes.md
 
35
  .vscode/
36
  *.swp
37
  *.log
38
+ .specstory
data/demo/public/功能测试/Python代码_qwen2.5.json ADDED
The diff for this file is too large to render. See raw diff
 
data/demo/public/功能测试/bpe不完整分词特性 最小测试_qwen2.5.json ADDED
@@ -0,0 +1,1124 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "request": {
3
+ "text": "2017年1月13日 18:43\n 北京",
4
+ "model": "Qwen2.5-0.5B"
5
+ },
6
+ "result": {
7
+ "bpe_strings": [
8
+ {
9
+ "offset": [
10
+ 0,
11
+ 1
12
+ ],
13
+ "raw": "2",
14
+ "real_topk": [
15
+ 0,
16
+ 0.002414703369140625
17
+ ],
18
+ "pred_topk": [
19
+ [
20
+ "Human",
21
+ 0.390625
22
+ ],
23
+ [
24
+ "import",
25
+ 0.05084228515625
26
+ ],
27
+ [
28
+ "#",
29
+ 0.04150390625
30
+ ],
31
+ [
32
+ "def",
33
+ 0.0163726806640625
34
+ ],
35
+ [
36
+ "The",
37
+ 0.0136871337890625
38
+ ],
39
+ [
40
+ "class",
41
+ 0.0130615234375
42
+ ],
43
+ [
44
+ "from",
45
+ 0.01285552978515625
46
+ ],
47
+ [
48
+ "public",
49
+ 0.01099395751953125
50
+ ],
51
+ [
52
+ "以下",
53
+ 0.01099395751953125
54
+ ],
55
+ [
56
+ "I",
57
+ 0.00732421875
58
+ ]
59
+ ]
60
+ },
61
+ {
62
+ "offset": [
63
+ 1,
64
+ 2
65
+ ],
66
+ "raw": "0",
67
+ "real_topk": [
68
+ 0,
69
+ 0.28515625
70
+ ],
71
+ "pred_topk": [
72
+ [
73
+ ".",
74
+ 0.28955078125
75
+ ],
76
+ [
77
+ "0",
78
+ 0.28515625
79
+ ],
80
+ [
81
+ "2",
82
+ 0.0362548828125
83
+ ],
84
+ [
85
+ "5",
86
+ 0.032989501953125
87
+ ],
88
+ [
89
+ "3",
90
+ 0.03173828125
91
+ ],
92
+ [
93
+ "4",
94
+ 0.0300445556640625
95
+ ],
96
+ [
97
+ "1",
98
+ 0.029815673828125
99
+ ],
100
+ [
101
+ "6",
102
+ 0.024139404296875
103
+ ],
104
+ [
105
+ "8",
106
+ 0.023773193359375
107
+ ],
108
+ [
109
+ "、",
110
+ 0.023040771484375
111
+ ]
112
+ ]
113
+ },
114
+ {
115
+ "offset": [
116
+ 2,
117
+ 3
118
+ ],
119
+ "raw": "1",
120
+ "real_topk": [
121
+ 0,
122
+ 0.440673828125
123
+ ],
124
+ "pred_topk": [
125
+ [
126
+ "1",
127
+ 0.440673828125
128
+ ],
129
+ [
130
+ "2",
131
+ 0.2286376953125
132
+ ],
133
+ [
134
+ "0",
135
+ 0.11859130859375
136
+ ],
137
+ [
138
+ ".",
139
+ 0.08544921875
140
+ ],
141
+ [
142
+ "、",
143
+ 0.01776123046875
144
+ ],
145
+ [
146
+ "4",
147
+ 0.0081329345703125
148
+ ],
149
+ [
150
+ "3",
151
+ 0.0075225830078125
152
+ ],
153
+ [
154
+ "5",
155
+ 0.007068634033203125
156
+ ],
157
+ [
158
+ "9",
159
+ 0.007068634033203125
160
+ ],
161
+ [
162
+ "7",
163
+ 0.006237030029296875
164
+ ]
165
+ ]
166
+ },
167
+ {
168
+ "offset": [
169
+ 3,
170
+ 4
171
+ ],
172
+ "raw": "7",
173
+ "real_topk": [
174
+ 0,
175
+ 0.1258544921875
176
+ ],
177
+ "pred_topk": [
178
+ [
179
+ "9",
180
+ 0.1541748046875
181
+ ],
182
+ [
183
+ "8",
184
+ 0.144775390625
185
+ ],
186
+ [
187
+ "7",
188
+ 0.1258544921875
189
+ ],
190
+ [
191
+ "6",
192
+ 0.11279296875
193
+ ],
194
+ [
195
+ "5",
196
+ 0.10107421875
197
+ ],
198
+ [
199
+ "4",
200
+ 0.09063720703125
201
+ ],
202
+ [
203
+ "3",
204
+ 0.08514404296875
205
+ ],
206
+ [
207
+ "2",
208
+ 0.06842041015625
209
+ ],
210
+ [
211
+ "0",
212
+ 0.054107666015625
213
+ ],
214
+ [
215
+ "1",
216
+ 0.052459716796875
217
+ ]
218
+ ]
219
+ },
220
+ {
221
+ "offset": [
222
+ 4,
223
+ 5
224
+ ],
225
+ "raw": "年",
226
+ "real_topk": [
227
+ 0,
228
+ 0.72998046875
229
+ ],
230
+ "pred_topk": [
231
+ [
232
+ "年",
233
+ 0.72998046875
234
+ ],
235
+ [
236
+ "[token#74577]",
237
+ 0.047393798828125
238
+ ],
239
+ [
240
+ "-",
241
+ 0.036346435546875
242
+ ],
243
+ [
244
+ ".",
245
+ 0.0194549560546875
246
+ ],
247
+ [
248
+ "年度",
249
+ 0.00919342041015625
250
+ ],
251
+ [
252
+ "/",
253
+ 0.00817108154296875
254
+ ],
255
+ [
256
+ "年的",
257
+ 0.00710296630859375
258
+ ],
259
+ [
260
+ "[token#198]",
261
+ 0.00531768798828125
262
+ ],
263
+ [
264
+ "年中国",
265
+ 0.0048828125
266
+ ],
267
+ [
268
+ "年上半年",
269
+ 0.004108428955078125
270
+ ]
271
+ ]
272
+ },
273
+ {
274
+ "offset": [
275
+ 5,
276
+ 6
277
+ ],
278
+ "raw": "1",
279
+ "real_topk": [
280
+ 0,
281
+ 0.232177734375
282
+ ],
283
+ "pred_topk": [
284
+ [
285
+ "1",
286
+ 0.232177734375
287
+ ],
288
+ [
289
+ ",",
290
+ 0.07659912109375
291
+ ],
292
+ [
293
+ "3",
294
+ 0.06103515625
295
+ ],
296
+ [
297
+ "7",
298
+ 0.0560302734375
299
+ ],
300
+ [
301
+ "9",
302
+ 0.0526123046875
303
+ ],
304
+ [
305
+ "5",
306
+ 0.051422119140625
307
+ ],
308
+ [
309
+ "6",
310
+ 0.04644775390625
311
+ ],
312
+ [
313
+ "4",
314
+ 0.04571533203125
315
+ ],
316
+ [
317
+ "8",
318
+ 0.0394287109375
319
+ ],
320
+ [
321
+ "2",
322
+ 0.03912353515625
323
+ ]
324
+ ]
325
+ },
326
+ {
327
+ "offset": [
328
+ 6,
329
+ 7
330
+ ],
331
+ "raw": "月",
332
+ "real_topk": [
333
+ 0,
334
+ 0.223388671875
335
+ ],
336
+ "pred_topk": [
337
+ [
338
+ "2",
339
+ 0.278076171875
340
+ ],
341
+ [
342
+ "0",
343
+ 0.245361328125
344
+ ],
345
+ [
346
+ "1",
347
+ 0.223388671875
348
+ ],
349
+ [
350
+ "月",
351
+ 0.223388671875
352
+ ],
353
+ [
354
+ "-",
355
+ 0.01094818115234375
356
+ ],
357
+ [
358
+ "月至",
359
+ 0.0029010772705078125
360
+ ],
361
+ [
362
+ "—",
363
+ 0.0024814605712890625
364
+ ],
365
+ [
366
+ "~",
367
+ 0.002040863037109375
368
+ ],
369
+ [
370
+ "月份",
371
+ 0.00173187255859375
372
+ ],
373
+ [
374
+ "至",
375
+ 0.0016794204711914062
376
+ ]
377
+ ]
378
+ },
379
+ {
380
+ "offset": [
381
+ 7,
382
+ 8
383
+ ],
384
+ "raw": "1",
385
+ "real_topk": [
386
+ 0,
387
+ 0.40771484375
388
+ ],
389
+ "pred_topk": [
390
+ [
391
+ "1",
392
+ 0.40771484375
393
+ ],
394
+ [
395
+ "2",
396
+ 0.180908203125
397
+ ],
398
+ [
399
+ ",",
400
+ 0.11956787109375
401
+ ],
402
+ [
403
+ "3",
404
+ 0.058746337890625
405
+ ],
406
+ [
407
+ "8",
408
+ 0.0288543701171875
409
+ ],
410
+ [
411
+ "5",
412
+ 0.0281829833984375
413
+ ],
414
+ [
415
+ ",",
416
+ 0.0242919921875
417
+ ],
418
+ [
419
+ "7",
420
+ 0.021942138671875
421
+ ],
422
+ [
423
+ "9",
424
+ 0.0217742919921875
425
+ ],
426
+ [
427
+ "4",
428
+ 0.021270751953125
429
+ ]
430
+ ]
431
+ },
432
+ {
433
+ "offset": [
434
+ 8,
435
+ 9
436
+ ],
437
+ "raw": "3",
438
+ "real_topk": [
439
+ 0,
440
+ 0.044952392578125
441
+ ],
442
+ "pred_topk": [
443
+ [
444
+ "日",
445
+ 0.250732421875
446
+ ],
447
+ [
448
+ "日起",
449
+ 0.201416015625
450
+ ],
451
+ [
452
+ "0",
453
+ 0.06536865234375
454
+ ],
455
+ [
456
+ "8",
457
+ 0.059539794921875
458
+ ],
459
+ [
460
+ "5",
461
+ 0.058624267578125
462
+ ],
463
+ [
464
+ "2",
465
+ 0.05419921875
466
+ ],
467
+ [
468
+ "1",
469
+ 0.051727294921875
470
+ ],
471
+ [
472
+ "6",
473
+ 0.050140380859375
474
+ ],
475
+ [
476
+ "7",
477
+ 0.045654296875
478
+ ],
479
+ [
480
+ "3",
481
+ 0.044952392578125
482
+ ]
483
+ ]
484
+ },
485
+ {
486
+ "offset": [
487
+ 9,
488
+ 10
489
+ ],
490
+ "raw": "日",
491
+ "real_topk": [
492
+ 0,
493
+ 0.82373046875
494
+ ],
495
+ "pred_topk": [
496
+ [
497
+ "日",
498
+ 0.82373046875
499
+ ],
500
+ [
501
+ "日至",
502
+ 0.0345458984375
503
+ ],
504
+ [
505
+ "日上午",
506
+ 0.027313232421875
507
+ ],
508
+ [
509
+ "日下午",
510
+ 0.025665283203125
511
+ ],
512
+ [
513
+ "日晚",
514
+ 0.0182037353515625
515
+ ],
516
+ [
517
+ "日起",
518
+ 0.016693115234375
519
+ ],
520
+ [
521
+ "日消息",
522
+ 0.006488800048828125
523
+ ],
524
+ [
525
+ "-",
526
+ 0.005908966064453125
527
+ ],
528
+ [
529
+ "日凌晨",
530
+ 0.005214691162109375
531
+ ],
532
+ [
533
+ "号",
534
+ 0.005130767822265625
535
+ ]
536
+ ]
537
+ },
538
+ {
539
+ "offset": [
540
+ 10,
541
+ 11
542
+ ],
543
+ "raw": " ",
544
+ "real_topk": [
545
+ 0,
546
+ 0.00901031494140625
547
+ ],
548
+ "pred_topk": [
549
+ [
550
+ ",",
551
+ 0.54443359375
552
+ ],
553
+ [
554
+ ",",
555
+ 0.12060546875
556
+ ],
557
+ [
558
+ "1",
559
+ 0.0275421142578125
560
+ ],
561
+ [
562
+ ",在",
563
+ 0.017242431640625
564
+ ],
565
+ [
566
+ "[token#198]",
567
+ 0.016448974609375
568
+ ],
569
+ [
570
+ "2",
571
+ 0.01261138916015625
572
+ ],
573
+ [
574
+ ",《",
575
+ 0.0122222900390625
576
+ ],
577
+ [
578
+ "[token#220]",
579
+ 0.00901031494140625
580
+ ],
581
+ [
582
+ "-",
583
+ 0.00859832763671875
584
+ ],
585
+ [
586
+ "是",
587
+ 0.008270263671875
588
+ ]
589
+ ]
590
+ },
591
+ {
592
+ "offset": [
593
+ 11,
594
+ 12
595
+ ],
596
+ "raw": "1",
597
+ "real_topk": [
598
+ 0,
599
+ 0.325927734375
600
+ ],
601
+ "pred_topk": [
602
+ [
603
+ "1",
604
+ 0.325927734375
605
+ ],
606
+ [
607
+ "2",
608
+ 0.2071533203125
609
+ ],
610
+ [
611
+ "0",
612
+ 0.16015625
613
+ ],
614
+ [
615
+ "中国",
616
+ 0.0185394287109375
617
+ ],
618
+ [
619
+ "[token#220]",
620
+ 0.016357421875
621
+ ],
622
+ [
623
+ "9",
624
+ 0.0146636962890625
625
+ ],
626
+ [
627
+ "8",
628
+ 0.012542724609375
629
+ ],
630
+ [
631
+ "7",
632
+ 0.009033203125
633
+ ],
634
+ [
635
+ "3",
636
+ 0.0086822509765625
637
+ ],
638
+ [
639
+ "《",
640
+ 0.0082855224609375
641
+ ]
642
+ ]
643
+ },
644
+ {
645
+ "offset": [
646
+ 12,
647
+ 13
648
+ ],
649
+ "raw": "8",
650
+ "real_topk": [
651
+ 0,
652
+ 0.084228515625
653
+ ],
654
+ "pred_topk": [
655
+ [
656
+ "0",
657
+ 0.10980224609375
658
+ ],
659
+ [
660
+ "5",
661
+ 0.1031494140625
662
+ ],
663
+ [
664
+ "4",
665
+ 0.1015625
666
+ ],
667
+ [
668
+ "7",
669
+ 0.1015625
670
+ ],
671
+ [
672
+ "1",
673
+ 0.0999755859375
674
+ ],
675
+ [
676
+ "6",
677
+ 0.0999755859375
678
+ ],
679
+ [
680
+ "2",
681
+ 0.091064453125
682
+ ],
683
+ [
684
+ "3",
685
+ 0.091064453125
686
+ ],
687
+ [
688
+ "8",
689
+ 0.084228515625
690
+ ],
691
+ [
692
+ "9",
693
+ 0.07318115234375
694
+ ]
695
+ ]
696
+ },
697
+ {
698
+ "offset": [
699
+ 13,
700
+ 14
701
+ ],
702
+ "raw": ":",
703
+ "real_topk": [
704
+ 0,
705
+ 0.90234375
706
+ ],
707
+ "pred_topk": [
708
+ [
709
+ ":",
710
+ 0.90234375
711
+ ],
712
+ [
713
+ "时",
714
+ 0.0301666259765625
715
+ ],
716
+ [
717
+ ":",
718
+ 0.0135955810546875
719
+ ],
720
+ [
721
+ "[token#220]",
722
+ 0.0087127685546875
723
+ ],
724
+ [
725
+ "点",
726
+ 0.006175994873046875
727
+ ],
728
+ [
729
+ "[token#10236]",
730
+ 0.004413604736328125
731
+ ],
732
+ [
733
+ "3",
734
+ 0.00203704833984375
735
+ ],
736
+ [
737
+ "0",
738
+ 0.00202178955078125
739
+ ],
740
+ [
741
+ "9",
742
+ 0.0019741058349609375
743
+ ],
744
+ [
745
+ "8",
746
+ 0.00186920166015625
747
+ ]
748
+ ]
749
+ },
750
+ {
751
+ "offset": [
752
+ 14,
753
+ 15
754
+ ],
755
+ "raw": "4",
756
+ "real_topk": [
757
+ 0,
758
+ 0.1529541015625
759
+ ],
760
+ "pred_topk": [
761
+ [
762
+ "0",
763
+ 0.2156982421875
764
+ ],
765
+ [
766
+ "3",
767
+ 0.176025390625
768
+ ],
769
+ [
770
+ "1",
771
+ 0.1602783203125
772
+ ],
773
+ [
774
+ "4",
775
+ 0.1529541015625
776
+ ],
777
+ [
778
+ "2",
779
+ 0.14599609375
780
+ ],
781
+ [
782
+ "5",
783
+ 0.14599609375
784
+ ],
785
+ [
786
+ "[token#220]",
787
+ 0.0012331008911132812
788
+ ],
789
+ [
790
+ "6",
791
+ 0.0004100799560546875
792
+ ],
793
+ [
794
+ "9",
795
+ 0.0003426074981689453
796
+ ],
797
+ [
798
+ "8",
799
+ 0.00027298927307128906
800
+ ]
801
+ ]
802
+ },
803
+ {
804
+ "offset": [
805
+ 15,
806
+ 16
807
+ ],
808
+ "raw": "3",
809
+ "real_topk": [
810
+ 0,
811
+ 0.0994873046875
812
+ ],
813
+ "pred_topk": [
814
+ [
815
+ "0",
816
+ 0.1181640625
817
+ ],
818
+ [
819
+ "5",
820
+ 0.10589599609375
821
+ ],
822
+ [
823
+ "3",
824
+ 0.0994873046875
825
+ ],
826
+ [
827
+ "7",
828
+ 0.0994873046875
829
+ ],
830
+ [
831
+ "8",
832
+ 0.0994873046875
833
+ ],
834
+ [
835
+ "2",
836
+ 0.09796142578125
837
+ ],
838
+ [
839
+ "6",
840
+ 0.096435546875
841
+ ],
842
+ [
843
+ "1",
844
+ 0.094970703125
845
+ ],
846
+ [
847
+ "4",
848
+ 0.094970703125
849
+ ],
850
+ [
851
+ "9",
852
+ 0.092041015625
853
+ ]
854
+ ]
855
+ },
856
+ {
857
+ "offset": [
858
+ 16,
859
+ 17
860
+ ],
861
+ "raw": "\n",
862
+ "real_topk": [
863
+ 0,
864
+ 0.283447265625
865
+ ],
866
+ "pred_topk": [
867
+ [
868
+ "[token#198]",
869
+ 0.283447265625
870
+ ],
871
+ [
872
+ ":",
873
+ 0.200927734375
874
+ ],
875
+ [
876
+ "[token#60596]",
877
+ 0.09564208984375
878
+ ],
879
+ [
880
+ "[token#220]",
881
+ 0.064208984375
882
+ ],
883
+ [
884
+ "[token#10236]",
885
+ 0.0257568359375
886
+ ],
887
+ [
888
+ "[token#715]",
889
+ 0.0170135498046875
890
+ ],
891
+ [
892
+ "[token#271]",
893
+ 0.0157470703125
894
+ ],
895
+ [
896
+ " |",
897
+ 0.01422119140625
898
+ ],
899
+ [
900
+ "[token#18137]",
901
+ 0.0120697021484375
902
+ ],
903
+ [
904
+ "[token#6567]",
905
+ 0.0108184814453125
906
+ ]
907
+ ]
908
+ },
909
+ {
910
+ "offset": [
911
+ 17,
912
+ 30
913
+ ],
914
+ "raw": " ",
915
+ "real_topk": [
916
+ 0,
917
+ 1.9669532775878906e-05
918
+ ],
919
+ "pred_topk": [
920
+ [
921
+ "2",
922
+ 0.09002685546875
923
+ ],
924
+ [
925
+ "1",
926
+ 0.0489501953125
927
+ ],
928
+ [
929
+ "【",
930
+ 0.026824951171875
931
+ ],
932
+ [
933
+ "[",
934
+ 0.0231170654296875
935
+ ],
936
+ [
937
+ "[token#220]",
938
+ 0.0222320556640625
939
+ ],
940
+ [
941
+ "来源",
942
+ 0.022064208984375
943
+ ],
944
+ [
945
+ "0",
946
+ 0.0143585205078125
947
+ ],
948
+ [
949
+ "作者",
950
+ 0.0123748779296875
951
+ ],
952
+ [
953
+ "在",
954
+ 0.0083770751953125
955
+ ],
956
+ [
957
+ "(",
958
+ 0.007389068603515625
959
+ ]
960
+ ]
961
+ },
962
+ {
963
+ "offset": [
964
+ 30,
965
+ 32
966
+ ],
967
+ "raw": " 北",
968
+ "real_topk": [
969
+ 0,
970
+ 0.0006041526794433594
971
+ ],
972
+ "pred_topk": [
973
+ [
974
+ "[token#220]",
975
+ 0.36572265625
976
+ ],
977
+ [
978
+ "[token#60596]",
979
+ 0.12841796875
980
+ ],
981
+ [
982
+ "[token#8908]",
983
+ 0.03680419921875
984
+ ],
985
+ [
986
+ "[token#10236]",
987
+ 0.0345458984375
988
+ ],
989
+ [
990
+ "[token#6567]",
991
+ 0.027984619140625
992
+ ],
993
+ [
994
+ " 文",
995
+ 0.02691650390625
996
+ ],
997
+ [
998
+ "[token#98313]",
999
+ 0.0247039794921875
1000
+ ],
1001
+ [
1002
+ "[token#33424]",
1003
+ 0.0235748291015625
1004
+ ],
1005
+ [
1006
+ " 发",
1007
+ 0.01751708984375
1008
+ ],
1009
+ [
1010
+ "[token#18137]",
1011
+ 0.01418304443359375
1012
+ ]
1013
+ ]
1014
+ },
1015
+ {
1016
+ "offset": [
1017
+ 31,
1018
+ 32
1019
+ ],
1020
+ "raw": "北",
1021
+ "real_topk": [
1022
+ 0,
1023
+ 0.71826171875
1024
+ ],
1025
+ "pred_topk": [
1026
+ [
1027
+ "[token#245]",
1028
+ 0.71826171875
1029
+ ],
1030
+ [
1031
+ "[token#119]",
1032
+ 0.11016845703125
1033
+ ],
1034
+ [
1035
+ "[token#118]",
1036
+ 0.060821533203125
1037
+ ],
1038
+ [
1039
+ "[token#227]",
1040
+ 0.053680419921875
1041
+ ],
1042
+ [
1043
+ "[token#244]",
1044
+ 0.0223846435546875
1045
+ ],
1046
+ [
1047
+ "[token#123]",
1048
+ 0.01274871826171875
1049
+ ],
1050
+ [
1051
+ "[token#117]",
1052
+ 0.00583648681640625
1053
+ ],
1054
+ [
1055
+ "[token#230]",
1056
+ 0.004993438720703125
1057
+ ],
1058
+ [
1059
+ "[token#122]",
1060
+ 0.0015230178833007812
1061
+ ],
1062
+ [
1063
+ "[token#94]",
1064
+ 0.001476287841796875
1065
+ ]
1066
+ ]
1067
+ },
1068
+ {
1069
+ "offset": [
1070
+ 32,
1071
+ 33
1072
+ ],
1073
+ "raw": "京",
1074
+ "real_topk": [
1075
+ 0,
1076
+ 0.91015625
1077
+ ],
1078
+ "pred_topk": [
1079
+ [
1080
+ "京",
1081
+ 0.91015625
1082
+ ],
1083
+ [
1084
+ "方",
1085
+ 0.0139312744140625
1086
+ ],
1087
+ [
1088
+ "青",
1089
+ 0.01003265380859375
1090
+ ],
1091
+ [
1092
+ "大",
1093
+ 0.0043487548828125
1094
+ ],
1095
+ [
1096
+ "交",
1097
+ 0.00325775146484375
1098
+ ],
1099
+ [
1100
+ "斗",
1101
+ 0.0030841827392578125
1102
+ ],
1103
+ [
1104
+ "美",
1105
+ 0.0023651123046875
1106
+ ],
1107
+ [
1108
+ "极",
1109
+ 0.0022735595703125
1110
+ ],
1111
+ [
1112
+ "新",
1113
+ 0.00222015380859375
1114
+ ],
1115
+ [
1116
+ "川",
1117
+ 0.00197601318359375
1118
+ ]
1119
+ ]
1120
+ }
1121
+ ],
1122
+ "originalText": "2017年1月13日 18:43\n 北京"
1123
+ }
1124
+ }
data/demo/public/功能测试/中英文对比_qwen2.5.json ADDED
The diff for this file is too large to render. See raw diff
 
data/demo/public/功能测试/独生子女心理群像9K字5Ktoken(最大文章)_qwen2.5.json ADDED
The diff for this file is too large to render. See raw diff
 
data/demo/public/功能测试/超长文件名 若需要显示完整名称,可结合使用:设置最小高度,允许换行,但确保所有 header 高度一致。_qwen2.5.json ADDED
@@ -0,0 +1,1123 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "request": {
3
+ "text": "2017年1月13日 18:43\n 北京",
4
+ "model": "Qwen2.5-0.5B"
5
+ },
6
+ "result": {
7
+ "bpe_strings": [
8
+ {
9
+ "offset": [
10
+ 0,
11
+ 1
12
+ ],
13
+ "raw": "2",
14
+ "real_topk": [
15
+ 0,
16
+ 0.002414703369140625
17
+ ],
18
+ "pred_topk": [
19
+ [
20
+ "Human",
21
+ 0.390625
22
+ ],
23
+ [
24
+ "import",
25
+ 0.05084228515625
26
+ ],
27
+ [
28
+ "#",
29
+ 0.04150390625
30
+ ],
31
+ [
32
+ "def",
33
+ 0.0163726806640625
34
+ ],
35
+ [
36
+ "The",
37
+ 0.0136871337890625
38
+ ],
39
+ [
40
+ "class",
41
+ 0.0130615234375
42
+ ],
43
+ [
44
+ "from",
45
+ 0.01285552978515625
46
+ ],
47
+ [
48
+ "public",
49
+ 0.01099395751953125
50
+ ],
51
+ [
52
+ "以下",
53
+ 0.01099395751953125
54
+ ],
55
+ [
56
+ "I",
57
+ 0.00732421875
58
+ ]
59
+ ]
60
+ },
61
+ {
62
+ "offset": [
63
+ 1,
64
+ 2
65
+ ],
66
+ "raw": "0",
67
+ "real_topk": [
68
+ 0,
69
+ 0.28515625
70
+ ],
71
+ "pred_topk": [
72
+ [
73
+ ".",
74
+ 0.28955078125
75
+ ],
76
+ [
77
+ "0",
78
+ 0.28515625
79
+ ],
80
+ [
81
+ "2",
82
+ 0.0362548828125
83
+ ],
84
+ [
85
+ "5",
86
+ 0.032989501953125
87
+ ],
88
+ [
89
+ "3",
90
+ 0.03173828125
91
+ ],
92
+ [
93
+ "4",
94
+ 0.0300445556640625
95
+ ],
96
+ [
97
+ "1",
98
+ 0.029815673828125
99
+ ],
100
+ [
101
+ "6",
102
+ 0.024139404296875
103
+ ],
104
+ [
105
+ "8",
106
+ 0.023773193359375
107
+ ],
108
+ [
109
+ "、",
110
+ 0.023040771484375
111
+ ]
112
+ ]
113
+ },
114
+ {
115
+ "offset": [
116
+ 2,
117
+ 3
118
+ ],
119
+ "raw": "1",
120
+ "real_topk": [
121
+ 0,
122
+ 0.440673828125
123
+ ],
124
+ "pred_topk": [
125
+ [
126
+ "1",
127
+ 0.440673828125
128
+ ],
129
+ [
130
+ "2",
131
+ 0.2286376953125
132
+ ],
133
+ [
134
+ "0",
135
+ 0.11859130859375
136
+ ],
137
+ [
138
+ ".",
139
+ 0.08544921875
140
+ ],
141
+ [
142
+ "、",
143
+ 0.01776123046875
144
+ ],
145
+ [
146
+ "4",
147
+ 0.0081329345703125
148
+ ],
149
+ [
150
+ "3",
151
+ 0.0075225830078125
152
+ ],
153
+ [
154
+ "5",
155
+ 0.007068634033203125
156
+ ],
157
+ [
158
+ "9",
159
+ 0.007068634033203125
160
+ ],
161
+ [
162
+ "7",
163
+ 0.006237030029296875
164
+ ]
165
+ ]
166
+ },
167
+ {
168
+ "offset": [
169
+ 3,
170
+ 4
171
+ ],
172
+ "raw": "7",
173
+ "real_topk": [
174
+ 0,
175
+ 0.1258544921875
176
+ ],
177
+ "pred_topk": [
178
+ [
179
+ "9",
180
+ 0.1541748046875
181
+ ],
182
+ [
183
+ "8",
184
+ 0.144775390625
185
+ ],
186
+ [
187
+ "7",
188
+ 0.1258544921875
189
+ ],
190
+ [
191
+ "6",
192
+ 0.11279296875
193
+ ],
194
+ [
195
+ "5",
196
+ 0.10107421875
197
+ ],
198
+ [
199
+ "4",
200
+ 0.09063720703125
201
+ ],
202
+ [
203
+ "3",
204
+ 0.08514404296875
205
+ ],
206
+ [
207
+ "2",
208
+ 0.06842041015625
209
+ ],
210
+ [
211
+ "0",
212
+ 0.054107666015625
213
+ ],
214
+ [
215
+ "1",
216
+ 0.052459716796875
217
+ ]
218
+ ]
219
+ },
220
+ {
221
+ "offset": [
222
+ 4,
223
+ 5
224
+ ],
225
+ "raw": "年",
226
+ "real_topk": [
227
+ 0,
228
+ 0.72998046875
229
+ ],
230
+ "pred_topk": [
231
+ [
232
+ "年",
233
+ 0.72998046875
234
+ ],
235
+ [
236
+ " �",
237
+ 0.047393798828125
238
+ ],
239
+ [
240
+ "-",
241
+ 0.036346435546875
242
+ ],
243
+ [
244
+ ".",
245
+ 0.0194549560546875
246
+ ],
247
+ [
248
+ "年度",
249
+ 0.00919342041015625
250
+ ],
251
+ [
252
+ "/",
253
+ 0.00817108154296875
254
+ ],
255
+ [
256
+ "年的",
257
+ 0.00710296630859375
258
+ ],
259
+ [
260
+ "\n",
261
+ 0.00531768798828125
262
+ ],
263
+ [
264
+ "年中国",
265
+ 0.0048828125
266
+ ],
267
+ [
268
+ "年上半年",
269
+ 0.004108428955078125
270
+ ]
271
+ ]
272
+ },
273
+ {
274
+ "offset": [
275
+ 5,
276
+ 6
277
+ ],
278
+ "raw": "1",
279
+ "real_topk": [
280
+ 0,
281
+ 0.232177734375
282
+ ],
283
+ "pred_topk": [
284
+ [
285
+ "1",
286
+ 0.232177734375
287
+ ],
288
+ [
289
+ ",",
290
+ 0.07659912109375
291
+ ],
292
+ [
293
+ "3",
294
+ 0.06103515625
295
+ ],
296
+ [
297
+ "7",
298
+ 0.0560302734375
299
+ ],
300
+ [
301
+ "9",
302
+ 0.0526123046875
303
+ ],
304
+ [
305
+ "5",
306
+ 0.051422119140625
307
+ ],
308
+ [
309
+ "6",
310
+ 0.04644775390625
311
+ ],
312
+ [
313
+ "4",
314
+ 0.04571533203125
315
+ ],
316
+ [
317
+ "8",
318
+ 0.0394287109375
319
+ ],
320
+ [
321
+ "2",
322
+ 0.03912353515625
323
+ ]
324
+ ]
325
+ },
326
+ {
327
+ "offset": [
328
+ 6,
329
+ 7
330
+ ],
331
+ "raw": "月",
332
+ "real_topk": [
333
+ 0,
334
+ 0.223388671875
335
+ ],
336
+ "pred_topk": [
337
+ [
338
+ "2",
339
+ 0.278076171875
340
+ ],
341
+ [
342
+ "0",
343
+ 0.245361328125
344
+ ],
345
+ [
346
+ "1",
347
+ 0.223388671875
348
+ ],
349
+ [
350
+ "月",
351
+ 0.223388671875
352
+ ],
353
+ [
354
+ "-",
355
+ 0.01094818115234375
356
+ ],
357
+ [
358
+ "月至",
359
+ 0.0029010772705078125
360
+ ],
361
+ [
362
+ "—",
363
+ 0.0024814605712890625
364
+ ],
365
+ [
366
+ "~",
367
+ 0.002040863037109375
368
+ ],
369
+ [
370
+ "月份",
371
+ 0.00173187255859375
372
+ ],
373
+ [
374
+ "至",
375
+ 0.0016794204711914062
376
+ ]
377
+ ]
378
+ },
379
+ {
380
+ "offset": [
381
+ 7,
382
+ 8
383
+ ],
384
+ "raw": "1",
385
+ "real_topk": [
386
+ 0,
387
+ 0.40771484375
388
+ ],
389
+ "pred_topk": [
390
+ [
391
+ "1",
392
+ 0.40771484375
393
+ ],
394
+ [
395
+ "2",
396
+ 0.180908203125
397
+ ],
398
+ [
399
+ ",",
400
+ 0.11956787109375
401
+ ],
402
+ [
403
+ "3",
404
+ 0.058746337890625
405
+ ],
406
+ [
407
+ "8",
408
+ 0.0288543701171875
409
+ ],
410
+ [
411
+ "5",
412
+ 0.0281829833984375
413
+ ],
414
+ [
415
+ ",",
416
+ 0.0242919921875
417
+ ],
418
+ [
419
+ "7",
420
+ 0.021942138671875
421
+ ],
422
+ [
423
+ "9",
424
+ 0.0217742919921875
425
+ ],
426
+ [
427
+ "4",
428
+ 0.021270751953125
429
+ ]
430
+ ]
431
+ },
432
+ {
433
+ "offset": [
434
+ 8,
435
+ 9
436
+ ],
437
+ "raw": "3",
438
+ "real_topk": [
439
+ 0,
440
+ 0.044952392578125
441
+ ],
442
+ "pred_topk": [
443
+ [
444
+ "日",
445
+ 0.250732421875
446
+ ],
447
+ [
448
+ "日起",
449
+ 0.201416015625
450
+ ],
451
+ [
452
+ "0",
453
+ 0.06536865234375
454
+ ],
455
+ [
456
+ "8",
457
+ 0.059539794921875
458
+ ],
459
+ [
460
+ "5",
461
+ 0.058624267578125
462
+ ],
463
+ [
464
+ "2",
465
+ 0.05419921875
466
+ ],
467
+ [
468
+ "1",
469
+ 0.051727294921875
470
+ ],
471
+ [
472
+ "6",
473
+ 0.050140380859375
474
+ ],
475
+ [
476
+ "7",
477
+ 0.045654296875
478
+ ],
479
+ [
480
+ "3",
481
+ 0.044952392578125
482
+ ]
483
+ ]
484
+ },
485
+ {
486
+ "offset": [
487
+ 9,
488
+ 10
489
+ ],
490
+ "raw": "日",
491
+ "real_topk": [
492
+ 0,
493
+ 0.82373046875
494
+ ],
495
+ "pred_topk": [
496
+ [
497
+ "日",
498
+ 0.82373046875
499
+ ],
500
+ [
501
+ "日至",
502
+ 0.0345458984375
503
+ ],
504
+ [
505
+ "日上午",
506
+ 0.027313232421875
507
+ ],
508
+ [
509
+ "日下午",
510
+ 0.025665283203125
511
+ ],
512
+ [
513
+ "日晚",
514
+ 0.0182037353515625
515
+ ],
516
+ [
517
+ "日起",
518
+ 0.016693115234375
519
+ ],
520
+ [
521
+ "日消息",
522
+ 0.006488800048828125
523
+ ],
524
+ [
525
+ "-",
526
+ 0.005908966064453125
527
+ ],
528
+ [
529
+ "日凌晨",
530
+ 0.005214691162109375
531
+ ],
532
+ [
533
+ "号",
534
+ 0.005130767822265625
535
+ ]
536
+ ]
537
+ },
538
+ {
539
+ "offset": [
540
+ 10,
541
+ 11
542
+ ],
543
+ "raw": " ",
544
+ "real_topk": [
545
+ 0,
546
+ 0.00901031494140625
547
+ ],
548
+ "pred_topk": [
549
+ [
550
+ ",",
551
+ 0.54443359375
552
+ ],
553
+ [
554
+ ",",
555
+ 0.12060546875
556
+ ],
557
+ [
558
+ "1",
559
+ 0.0275421142578125
560
+ ],
561
+ [
562
+ ",在",
563
+ 0.017242431640625
564
+ ],
565
+ [
566
+ "\n",
567
+ 0.016448974609375
568
+ ],
569
+ [
570
+ "2",
571
+ 0.01261138916015625
572
+ ],
573
+ [
574
+ ",《",
575
+ 0.0122222900390625
576
+ ],
577
+ [
578
+ " ",
579
+ 0.00901031494140625
580
+ ],
581
+ [
582
+ "-",
583
+ 0.00859832763671875
584
+ ],
585
+ [
586
+ "是",
587
+ 0.008270263671875
588
+ ]
589
+ ]
590
+ },
591
+ {
592
+ "offset": [
593
+ 11,
594
+ 12
595
+ ],
596
+ "raw": "1",
597
+ "real_topk": [
598
+ 0,
599
+ 0.325927734375
600
+ ],
601
+ "pred_topk": [
602
+ [
603
+ "1",
604
+ 0.325927734375
605
+ ],
606
+ [
607
+ "2",
608
+ 0.2071533203125
609
+ ],
610
+ [
611
+ "0",
612
+ 0.16015625
613
+ ],
614
+ [
615
+ "中国",
616
+ 0.0185394287109375
617
+ ],
618
+ [
619
+ " ",
620
+ 0.016357421875
621
+ ],
622
+ [
623
+ "9",
624
+ 0.0146636962890625
625
+ ],
626
+ [
627
+ "8",
628
+ 0.012542724609375
629
+ ],
630
+ [
631
+ "7",
632
+ 0.009033203125
633
+ ],
634
+ [
635
+ "3",
636
+ 0.0086822509765625
637
+ ],
638
+ [
639
+ "《",
640
+ 0.0082855224609375
641
+ ]
642
+ ]
643
+ },
644
+ {
645
+ "offset": [
646
+ 12,
647
+ 13
648
+ ],
649
+ "raw": "8",
650
+ "real_topk": [
651
+ 0,
652
+ 0.084228515625
653
+ ],
654
+ "pred_topk": [
655
+ [
656
+ "0",
657
+ 0.10980224609375
658
+ ],
659
+ [
660
+ "5",
661
+ 0.1031494140625
662
+ ],
663
+ [
664
+ "4",
665
+ 0.1015625
666
+ ],
667
+ [
668
+ "7",
669
+ 0.1015625
670
+ ],
671
+ [
672
+ "1",
673
+ 0.0999755859375
674
+ ],
675
+ [
676
+ "6",
677
+ 0.0999755859375
678
+ ],
679
+ [
680
+ "2",
681
+ 0.091064453125
682
+ ],
683
+ [
684
+ "3",
685
+ 0.091064453125
686
+ ],
687
+ [
688
+ "8",
689
+ 0.084228515625
690
+ ],
691
+ [
692
+ "9",
693
+ 0.07318115234375
694
+ ]
695
+ ]
696
+ },
697
+ {
698
+ "offset": [
699
+ 13,
700
+ 14
701
+ ],
702
+ "raw": ":",
703
+ "real_topk": [
704
+ 0,
705
+ 0.90234375
706
+ ],
707
+ "pred_topk": [
708
+ [
709
+ ":",
710
+ 0.90234375
711
+ ],
712
+ [
713
+ "时",
714
+ 0.0301666259765625
715
+ ],
716
+ [
717
+ ":",
718
+ 0.0135955810546875
719
+ ],
720
+ [
721
+ " ",
722
+ 0.0087127685546875
723
+ ],
724
+ [
725
+ "点",
726
+ 0.006175994873046875
727
+ ],
728
+ [
729
+ " �",
730
+ 0.004413604736328125
731
+ ],
732
+ [
733
+ "3",
734
+ 0.00203704833984375
735
+ ],
736
+ [
737
+ "0",
738
+ 0.00202178955078125
739
+ ],
740
+ [
741
+ "9",
742
+ 0.0019741058349609375
743
+ ],
744
+ [
745
+ "8",
746
+ 0.00186920166015625
747
+ ]
748
+ ]
749
+ },
750
+ {
751
+ "offset": [
752
+ 14,
753
+ 15
754
+ ],
755
+ "raw": "4",
756
+ "real_topk": [
757
+ 0,
758
+ 0.1529541015625
759
+ ],
760
+ "pred_topk": [
761
+ [
762
+ "0",
763
+ 0.2156982421875
764
+ ],
765
+ [
766
+ "3",
767
+ 0.176025390625
768
+ ],
769
+ [
770
+ "1",
771
+ 0.1602783203125
772
+ ],
773
+ [
774
+ "4",
775
+ 0.1529541015625
776
+ ],
777
+ [
778
+ "2",
779
+ 0.14599609375
780
+ ],
781
+ [
782
+ "5",
783
+ 0.14599609375
784
+ ],
785
+ [
786
+ " ",
787
+ 0.0012331008911132812
788
+ ],
789
+ [
790
+ "6",
791
+ 0.0004100799560546875
792
+ ],
793
+ [
794
+ "9",
795
+ 0.0003426074981689453
796
+ ],
797
+ [
798
+ "8",
799
+ 0.00027298927307128906
800
+ ]
801
+ ]
802
+ },
803
+ {
804
+ "offset": [
805
+ 15,
806
+ 16
807
+ ],
808
+ "raw": "3",
809
+ "real_topk": [
810
+ 0,
811
+ 0.0994873046875
812
+ ],
813
+ "pred_topk": [
814
+ [
815
+ "0",
816
+ 0.1181640625
817
+ ],
818
+ [
819
+ "5",
820
+ 0.10589599609375
821
+ ],
822
+ [
823
+ "3",
824
+ 0.0994873046875
825
+ ],
826
+ [
827
+ "7",
828
+ 0.0994873046875
829
+ ],
830
+ [
831
+ "8",
832
+ 0.0994873046875
833
+ ],
834
+ [
835
+ "2",
836
+ 0.09796142578125
837
+ ],
838
+ [
839
+ "6",
840
+ 0.096435546875
841
+ ],
842
+ [
843
+ "1",
844
+ 0.094970703125
845
+ ],
846
+ [
847
+ "4",
848
+ 0.094970703125
849
+ ],
850
+ [
851
+ "9",
852
+ 0.092041015625
853
+ ]
854
+ ]
855
+ },
856
+ {
857
+ "offset": [
858
+ 16,
859
+ 17
860
+ ],
861
+ "raw": "\n",
862
+ "real_topk": [
863
+ 0,
864
+ 0.283447265625
865
+ ],
866
+ "pred_topk": [
867
+ [
868
+ "\n",
869
+ 0.283447265625
870
+ ],
871
+ [
872
+ ":",
873
+ 0.200927734375
874
+ ],
875
+ [
876
+ " �",
877
+ 0.09564208984375
878
+ ],
879
+ [
880
+ " ",
881
+ 0.064208984375
882
+ ],
883
+ [
884
+ " �",
885
+ 0.0257568359375
886
+ ],
887
+ [
888
+ " \n",
889
+ 0.0170135498046875
890
+ ],
891
+ [
892
+ "\n\n",
893
+ 0.0157470703125
894
+ ],
895
+ [
896
+ " |",
897
+ 0.01422119140625
898
+ ],
899
+ [
900
+ " �",
901
+ 0.0120697021484375
902
+ ],
903
+ [
904
+ " �",
905
+ 0.0108184814453125
906
+ ]
907
+ ]
908
+ },
909
+ {
910
+ "offset": [
911
+ 17,
912
+ 30
913
+ ],
914
+ "raw": " ",
915
+ "real_topk": [
916
+ 0,
917
+ 1.9669532775878906e-05
918
+ ],
919
+ "pred_topk": [
920
+ [
921
+ "2",
922
+ 0.09002685546875
923
+ ],
924
+ [
925
+ "1",
926
+ 0.0489501953125
927
+ ],
928
+ [
929
+ "【",
930
+ 0.026824951171875
931
+ ],
932
+ [
933
+ "[",
934
+ 0.0231170654296875
935
+ ],
936
+ [
937
+ " ",
938
+ 0.0222320556640625
939
+ ],
940
+ [
941
+ "来源",
942
+ 0.022064208984375
943
+ ],
944
+ [
945
+ "0",
946
+ 0.0143585205078125
947
+ ],
948
+ [
949
+ "作者",
950
+ 0.0123748779296875
951
+ ],
952
+ [
953
+ "在",
954
+ 0.0083770751953125
955
+ ],
956
+ [
957
+ "(",
958
+ 0.007389068603515625
959
+ ]
960
+ ]
961
+ },
962
+ {
963
+ "offset": [
964
+ 30,
965
+ 32
966
+ ],
967
+ "raw": " 北",
968
+ "real_topk": [
969
+ 0,
970
+ 0.0006041526794433594
971
+ ],
972
+ "pred_topk": [
973
+ [
974
+ " ",
975
+ 0.36572265625
976
+ ],
977
+ [
978
+ " �",
979
+ 0.12841796875
980
+ ],
981
+ [
982
+ " �",
983
+ 0.03680419921875
984
+ ],
985
+ [
986
+ " �",
987
+ 0.0345458984375
988
+ ],
989
+ [
990
+ " �",
991
+ 0.027984619140625
992
+ ],
993
+ [
994
+ " 文",
995
+ 0.02691650390625
996
+ ],
997
+ [
998
+ " �",
999
+ 0.0247039794921875
1000
+ ],
1001
+ [
1002
+ " �",
1003
+ 0.0235748291015625
1004
+ ],
1005
+ [
1006
+ " 发",
1007
+ 0.01751708984375
1008
+ ],
1009
+ [
1010
+ " �",
1011
+ 0.01418304443359375
1012
+ ]
1013
+ ]
1014
+ },
1015
+ {
1016
+ "offset": [
1017
+ 31,
1018
+ 32
1019
+ ],
1020
+ "raw": "北",
1021
+ "real_topk": [
1022
+ 0,
1023
+ 0.71826171875
1024
+ ],
1025
+ "pred_topk": [
1026
+ [
1027
+ "�",
1028
+ 0.71826171875
1029
+ ],
1030
+ [
1031
+ "�",
1032
+ 0.11016845703125
1033
+ ],
1034
+ [
1035
+ "�",
1036
+ 0.060821533203125
1037
+ ],
1038
+ [
1039
+ "�",
1040
+ 0.053680419921875
1041
+ ],
1042
+ [
1043
+ "�",
1044
+ 0.0223846435546875
1045
+ ],
1046
+ [
1047
+ "�",
1048
+ 0.01274871826171875
1049
+ ],
1050
+ [
1051
+ "�",
1052
+ 0.00583648681640625
1053
+ ],
1054
+ [
1055
+ "�",
1056
+ 0.004993438720703125
1057
+ ],
1058
+ [
1059
+ "�",
1060
+ 0.0015230178833007812
1061
+ ],
1062
+ [
1063
+ "�",
1064
+ 0.001476287841796875
1065
+ ]
1066
+ ]
1067
+ },
1068
+ {
1069
+ "offset": [
1070
+ 32,
1071
+ 33
1072
+ ],
1073
+ "raw": "京",
1074
+ "real_topk": [
1075
+ 0,
1076
+ 0.91015625
1077
+ ],
1078
+ "pred_topk": [
1079
+ [
1080
+ "京",
1081
+ 0.91015625
1082
+ ],
1083
+ [
1084
+ "方",
1085
+ 0.0139312744140625
1086
+ ],
1087
+ [
1088
+ "青",
1089
+ 0.01003265380859375
1090
+ ],
1091
+ [
1092
+ "大",
1093
+ 0.0043487548828125
1094
+ ],
1095
+ [
1096
+ "交",
1097
+ 0.00325775146484375
1098
+ ],
1099
+ [
1100
+ "斗",
1101
+ 0.0030841827392578125
1102
+ ],
1103
+ [
1104
+ "美",
1105
+ 0.0023651123046875
1106
+ ],
1107
+ [
1108
+ "极",
1109
+ 0.0022735595703125
1110
+ ],
1111
+ [
1112
+ "新",
1113
+ 0.00222015380859375
1114
+ ],
1115
+ [
1116
+ "川",
1117
+ 0.00197601318359375
1118
+ ]
1119
+ ]
1120
+ }
1121
+ ]
1122
+ }
1123
+ }