dqy08 commited on
Commit
31e2d98
·
1 Parent(s): d78cfd6

更新介绍内容;主页介绍HTML增加渲染效果,构建时准备内容

Browse files
README.md CHANGED
@@ -1,10 +1,16 @@
1
  ---
2
- title: InfoRadar – Visualize Text Information Density
3
  emoji: 📡
4
- colorFrom: blue
5
  colorTo: red
6
  sdk: docker
7
- short_description: analyzes text to visualize token-level information density
 
 
 
 
 
 
8
  app_port: 7860
9
  pinned: false
10
  license: apache-2.0
 
1
  ---
2
+ title: InfoRadar – Analyze & Visualize Text Information Density
3
  emoji: 📡
4
+ colorFrom: gray
5
  colorTo: red
6
  sdk: docker
7
+ short_description: Visualize token-level information density to help find key content.
8
+ tags:
9
+ - nlp
10
+ - text-analysis
11
+ - information
12
+ - visualization
13
+ - reading-tools
14
  app_port: 7860
15
  pinned: false
16
  license: apache-2.0
client/src/content/home.en.html CHANGED
@@ -1,15 +1,6 @@
1
  <!-- 简介 / Hero(始终可见) -->
2
- <div class="intro-brief">
3
- <p>
4
- Tired of low-quality articles? Struggling to find key points in long texts?
5
- Want to skip redundancy and fluff at a glance?
6
- Or just curious about the information-theoretic nature of language?
7
- </p>
8
-
9
- <p>Try <strong>InfoRadar</strong>. InfoRadar uses large language models to analyze text information density and
10
- visualizes where the important parts
11
- are.</p>
12
- <p>The color intensity of each token indicates how much information it carries. Try it yourself!</p>
13
  </div>
14
 
15
  <!-- 了解更多(默认折叠) -->
@@ -29,7 +20,7 @@
29
 
30
  <!-- 技术定义 -->
31
  <div class="intro-block intro-technical">
32
- <h4>Information Theory Perspective</h4>
33
  <p>In our implementation, the information content of each token comes from how difficult it is for the LLM to
34
  predict that token from left to right.</p>
35
  <p>
@@ -52,9 +43,9 @@
52
  </p>
53
  <p>Therefore, the gap between current results and reader perception mainly comes from two aspects:</p>
54
  <ul>
55
- <li><strong>Model capability vs reader:</strong> The model's understanding and knowledge may be less than,
56
- or exceed, the reader's. Imagine comparing a state-of-the-art LLM with a ten-year-old reader.</li>
57
- <li><strong>Model context vs reader:</strong> The model only has the text read so far as context, much less
58
  than the reader's. This project uses base models without instruction tuning or prompts (which actually
59
  gives the best results).</li>
60
  </ul>
 
1
  <!-- 简介 / Hero(始终可见) -->
2
+ <div class="intro-brief" style="--intro-rgb: 255, 71, 64">
3
+ <span class="intro-token" style="--a:0.38">T</span><span class="intro-token" style="--a:0.38">ired</span><span class="intro-token" style="--a:0.02"> of</span><span class="intro-token" style="--a:0.58"> redundancy</span><span class="intro-token" style="--a:0.20"> and</span><span class="intro-token" style="--a:0.69"> fl</span><span class="intro-token" style="--a:0.03">uff</span><span class="intro-token" style="--a:0.11">?</span><span class="intro-token" style="--a:0.14"> Want</span><span class="intro-token" style="--a:0.69"> key</span><span class="intro-token" style="--a:0.40"> points</span><span class="intro-token" style="--a:0.40"> at</span><span class="intro-token" style="--a:0.04"> a</span><span class="intro-token" style="--a:0.00"> glance</span><span class="intro-token" style="--a:0.05">?</span><span class="intro-token" style="--a:0.31"> Or</span><span class="intro-token" style="--a:0.18"> simply</span><span class="intro-token" style="--a:0.31"> curious</span><span class="intro-token" style="--a:0.04"> about</span><span class="intro-token" style="--a:0.08"> the</span><span class="intro-token" style="--a:0.33"> information</span><span class="intro-token" style="--a:0.57">-the</span><span class="intro-token" style="--a:0.01">oret</span><span class="intro-token" style="--a:0.00">ic</span><span class="intro-token" style="--a:0.26"> nature</span><span class="intro-token" style="--a:0.00"> of</span><span class="intro-token" style="--a:0.30"> language</span><span class="intro-token" style="--a:0.23">?</span><br><br><span class="intro-token" style="--a:0.32">Try</span><span class="intro-token" style="--a:0.47"> Info</span><span class="intro-token" style="--a:0.29">R</span><span class="intro-token" style="--a:0.21">adar</span><span class="intro-token" style="--a:0.15">.</span><span class="intro-token" style="--a:0.20"> Info</span><span class="intro-token" style="--a:0.00">R</span><span class="intro-token" style="--a:0.00">adar</span><span class="intro-token" style="--a:0.26"> uses</span><span class="intro-token" style="--a:0.37"> large</span><span class="intro-token" style="--a:0.08"> language</span><span class="intro-token" style="--a:0.00"> models</span><span class="intro-token" style="--a:0.04"> to</span><span class="intro-token" style="--a:0.21"> analyze</span><span class="intro-token" style="--a:0.17"> text</span><span class="intro-token" style="--a:0.44"> information</span><span class="intro-token" style="--a:0.33"> density</span><span class="intro-token" style="--a:0.06"> and</span><span class="intro-token" style="--a:0.40"> visual</span><span class="intro-token" style="--a:0.33">izes</span><span class="intro-token" style="--a:0.43"> where</span><span class="intro-token" style="--a:0.10"> the</span><span class="intro-token" style="--a:0.29"> important</span><span class="intro-token" style="--a:0.13"> parts</span><span class="intro-token" style="--a:0.04"> are</span><span class="intro-token" style="--a:0.11">.</span><br><br><span class="intro-token" style="--a:0.18">The</span><span class="intro-token" style="--a:0.44"> color</span><span class="intro-token" style="--a:0.33"> intensity</span><span class="intro-token" style="--a:0.04"> of</span><span class="intro-token" style="--a:0.12"> each</span><span class="intro-token" style="--a:0.27"> token</span><span class="intro-token" style="--a:0.22"> indicates</span><span class="intro-token" style="--a:0.09"> how</span><span class="intro-token" style="--a:0.07"> much</span><span class="intro-token" style="--a:0.05"> information</span><span class="intro-token" style="--a:0.05"> it</span><span class="intro-token" style="--a:0.08"> carries</span><span class="intro-token" style="--a:0.05">.</span><span class="intro-token" style="--a:0.47"> Try</span><span class="intro-token" style="--a:0.08"> it</span><span class="intro-token" style="--a:0.13"> yourself</span><span class="intro-token" style="--a:0.17">!</span>
 
 
 
 
 
 
 
 
 
4
  </div>
5
 
6
  <!-- 了解更多(默认折叠) -->
 
20
 
21
  <!-- 技术定义 -->
22
  <div class="intro-block intro-technical">
23
+ <h4>Information-Theoretic Perspective</h4>
24
  <p>In our implementation, the information content of each token comes from how difficult it is for the LLM to
25
  predict that token from left to right.</p>
26
  <p>
 
43
  </p>
44
  <p>Therefore, the gap between current results and reader perception mainly comes from two aspects:</p>
45
  <ul>
46
+ <li><strong>Model capability vs human reader:</strong> The model's understanding and knowledge may be generally less than,
47
+ or possibly exceed, the reader's. Imagine comparing a state-of-the-art LLM with a ten-year-old reader.</li>
48
+ <li><strong>Model context vs human reader:</strong> The model only has the text read so far as context, much less
49
  than the reader's. This project uses base models without instruction tuning or prompts (which actually
50
  gives the best results).</li>
51
  </ul>
client/src/content/home.zh.html CHANGED
@@ -1,8 +1,6 @@
1
  <!-- 简介 / Hero(始终可见) -->
2
- <div class="intro-brief">
3
- <p>受够了低质量文章?文章太长找不到重点?想一眼跳过冗余、废话?或者只是好奇文字的信息论奥秘?</p>
4
- <p>试试 <strong>InfoRadar(信息雷达)</strong>吧。它使用大语言模型分析文本的信息密度,可视化展示哪里更重要。</p>
5
- <p>每个字的颜色深浅,表示它承载的信息量大小。自己试试吧!</p>
6
  </div>
7
 
8
  <!-- 了解更多(默认折叠) -->
@@ -36,7 +34,7 @@
36
  <p>对于一个想象中的理想模型(它的包含了上下文的知识量和阅读者一致),那么它评估出的结果应该和阅读者的主观感受是完全一致的。</p>
37
  <p>所以,目前的实际结果和阅读者主观感受之间的差距,主要来自两个方面:</p>
38
  <ul>
39
- <li><strong>模型能力和阅读者的差异:</strong>模型的理解能力和知识量可能不如阅读者,也有可能过剩,想象一下目前的SOTA大模型和一个十岁孩子阅读者相比。</li>
40
  <li><strong>模型上下文和阅读者的差异:</strong>模型只有文章已读部分作为上下文,远小于��读者。项目使用没有instruct微调的base模型,也没有任何提示词(其实这样效果已经是最好了)。
41
  </li>
42
  </ul>
 
1
  <!-- 简介 / Hero(始终可见) -->
2
+ <div class="intro-brief" style="--intro-rgb: 255, 71, 64">
3
+ <span class="intro-token" style="--a:0.70">想</span><span class="intro-token" style="--a:0.57">一眼</span><span class="intro-token" style="--a:0.53"></span><span class="intro-token" style="--a:0.19"></span><span class="intro-token" style="--a:0.53"></span><span class="intro-token" style="--a:0.03"></span><span class="intro-token" style="--a:0.32"></span><span class="intro-token" style="--a:0.40">废话</span><span class="intro-token" style="--a:0.12">,</span><span class="intro-token" style="--a:0.33">找到</span><span class="intro-token" style="--a:0.30">文章</span><span class="intro-token" style="--a:0.20">的关键</span><span class="intro-token" style="--a:0.06">点</span><span class="intro-token" style="--a:0.40"></span><span class="intro-token" style="--a:0.32">或者</span><span class="intro-token" style="--a:0.34">只是</span><span class="intro-token" style="--a:0.38">好奇</span><span class="intro-token" style="--a:0.38">文字</span><span class="intro-token" style="--a:0.44">的信息</span><span class="intro-token" style="--a:0.51"></span><span class="intro-token" style="--a:0.49"></span><span class="intro-token" style="--a:0.02"></span><span class="intro-token" style="--a:0.16">?</span><br><br><span class="intro-token" style="--a:0.56">试试</span><span class="intro-token" style="--a:0.70"> Info</span><span class="intro-token" style="--a:0.27">R</span><span class="intro-token" style="--a:0.29">adar</span><span class="intro-token" style="--a:0.25">(</span><span class="intro-token" style="--a:0.10">信息</span><span class="intro-token" style="--a:0.00">雷达</span><span class="intro-token" style="--a:0.04">)</span><span class="intro-token" style="--a:0.16">吧</span><span class="intro-token" style="--a:0.10">。</span><span class="intro-token" style="--a:0.09">它</span><span class="intro-token" style="--a:0.26">使用</span><span class="intro-token" style="--a:0.36">大</span><span class="intro-token" style="--a:0.03">语言</span><span class="intro-token" style="--a:0.00">模型</span><span class="intro-token" style="--a:0.17">分析</span><span class="intro-token" style="--a:0.10">文本</span><span class="intro-token" style="--a:0.39">的信息</span><span class="intro-token" style="--a:0.12">密度</span><span class="intro-token" style="--a:0.04">,</span><span class="intro-token" style="--a:0.57">可视化</span><span class="intro-token" style="--a:0.30">展示</span><span class="intro-token" style="--a:0.54">哪里</span><span class="intro-token" style="--a:0.33">更重要</span><span class="intro-token" style="--a:0.17">。</span><br><br><span class="intro-token" style="--a:0.44">每个</span><span class="intro-token" style="--a:0.26">字</span><span class="intro-token" style="--a:0.37">的颜色</span><span class="intro-token" style="--a:0.16">深</span><span class="intro-token" style="--a:0.00">浅</span><span class="intro-token" style="--a:0.17">,</span><span class="intro-token" style="--a:0.14">表示</span><span class="intro-token" style="--a:0.16">它</span><span class="intro-token" style="--a:0.37">承载</span><span class="intro-token" style="--a:0.02">的信息</span><span class="intro-token" style="--a:0.01">量</span><span class="intro-token" style="--a:0.15">大小</span><span class="intro-token" style="--a:0.04">。</span><span class="intro-token" style="--a:0.52">自己</span><span class="intro-token" style="--a:0.20">试试</span><span class="intro-token" style="--a:0.11">吧</span><span class="intro-token" style="--a:0.11">!</span>
 
 
4
  </div>
5
 
6
  <!-- 了解更多(默认折叠) -->
 
34
  <p>对于一个想象中的理想模型(它的包含了上下文的知识量和阅读者一致),那么它评估出的结果应该和阅读者的主观感受是完全一致的。</p>
35
  <p>所以,目前的实际结果和阅读者主观感受之间的差距,主要来自两个方面:</p>
36
  <ul>
37
+ <li><strong>模型能力和阅读者的差异:</strong>模型的理解能力和知识量可能不如阅读者,也有可能过剩,想象一下目前的SOTA大模型和一个十岁孩子阅读者相比。</li>
38
  <li><strong>模型上下文和阅读者的差异:</strong>模型只有文章已读部分作为上下文,远小于��读者。项目使用没有instruct微调的base模型,也没有任何提示词(其实这样效果已经是最好了)。
39
  </li>
40
  </ul>
client/src/css/start.scss CHANGED
@@ -380,6 +380,11 @@ select {
380
  }
381
  }
382
 
 
 
 
 
 
383
  // 首页“了解更多”折叠区:将 <summary> 做成明显的 CTA(避免像普通链接/原文样式)
384
  .intro-more {
385
  margin-top: 10px;
 
380
  }
381
  }
382
 
383
+ .intro-brief .intro-token {
384
+ background-color: rgba(var(--intro-rgb), var(--a, 0));
385
+ border-radius: 6px;
386
+ }
387
+
388
  // 首页“了解更多”折叠区:将 <summary> 做成明显的 CTA(避免像普通链接/原文样式)
389
  .intro-more {
390
  margin-top: 10px;
client/src/package.json CHANGED
@@ -5,6 +5,8 @@
5
  "main": "webpack.config.js",
6
  "scripts": {
7
  "test": "echo \"Error: no test specified\" && exit 1",
 
 
8
  "wp": "npm run build:dev",
9
  "ww": "npm run watch",
10
  "stats": "webpack --mode production --json --profile > stats.json",
 
5
  "main": "webpack.config.js",
6
  "scripts": {
7
  "test": "echo \"Error: no test specified\" && exit 1",
8
+ "prebuild": "node scripts/updateIntroHTML.js",
9
+ "prebuild:dev": "node scripts/updateIntroHTML.js",
10
  "wp": "npm run build:dev",
11
  "ww": "npm run watch",
12
  "stats": "webpack --mode production --json --profile > stats.json",
client/src/scripts/updateIntroHTML.js ADDED
@@ -0,0 +1,165 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ /**
2
+ * 构建时脚本:从JSON生成带颜色的HTML
3
+ */
4
+
5
+ const fs = require('fs');
6
+ const path = require('path');
7
+
8
+ // 文件路径配置
9
+ const paths = {
10
+ en: {
11
+ json: path.resolve(__dirname, '../../../data/demo/public/InfoRadar-intro.json'),
12
+ html: path.resolve(__dirname, '../content/home.en.html')
13
+ },
14
+ zh: {
15
+ json: path.resolve(__dirname, '../../../data/demo/public/CN/InfoRadar-介绍.json'),
16
+ html: path.resolve(__dirname, '../content/home.zh.html')
17
+ }
18
+ };
19
+
20
+ // ==========================================
21
+ // 颜色计算逻辑(从 SurprisalColorConfig.ts 复制)
22
+ // ==========================================
23
+
24
+ const TOKEN_SURPRISAL_MAX = 18;
25
+
26
+ /**
27
+ * 计算 surprisal(信息量)
28
+ */
29
+ function calculateSurprisal(probability) {
30
+ return -Math.log2(Math.max(probability, Number.EPSILON));
31
+ }
32
+
33
+ /** RGB 部分,通过 CSS 变量复用 */
34
+ const INTRO_RGB = '255, 71, 64';
35
+
36
+ /** alpha 小数位数 */
37
+ const ALPHA_PRECISION = 2;
38
+
39
+ /**
40
+ * 根据 surprisal 计算 alpha(0–0.7),保留指定位数
41
+ */
42
+ function getTokenAlpha(surprisal) {
43
+ const normalizedValue = surprisal < 0 ? 0 :
44
+ surprisal >= TOKEN_SURPRISAL_MAX ? 1 :
45
+ surprisal / TOKEN_SURPRISAL_MAX;
46
+ const alpha = Math.max(0, Math.min(1, normalizedValue)) * 0.7;
47
+ return alpha.toFixed(ALPHA_PRECISION);
48
+ }
49
+
50
+ // ==========================================
51
+ // HTML 生成逻辑
52
+ // ==========================================
53
+
54
+ /**
55
+ * 转义HTML特殊字符
56
+ */
57
+ function escapeHtml(text) {
58
+ return text
59
+ .replace(/&/g, '&amp;')
60
+ .replace(/</g, '&lt;')
61
+ .replace(/>/g, '&gt;')
62
+ .replace(/"/g, '&quot;')
63
+ .replace(/'/g, '&#039;');
64
+ }
65
+
66
+ /**
67
+ * 从JSON生成带颜色的HTML(使用 CSS 变量 --intro-rgb,span 仅写 alpha)
68
+ */
69
+ function generateColoredHTML(jsonPath) {
70
+ try {
71
+ const content = fs.readFileSync(jsonPath, 'utf-8');
72
+ const data = JSON.parse(content);
73
+
74
+ let html = '';
75
+ for (const token of data.result.bpe_strings) {
76
+ const text = token.raw;
77
+ const prob = token.real_topk[1];
78
+ const surprisal = calculateSurprisal(prob);
79
+ const alpha = getTokenAlpha(surprisal);
80
+
81
+ const escapedText = escapeHtml(text);
82
+
83
+ if (text.includes('\n')) {
84
+ const parts = text.split(/(\n)/);
85
+ for (const part of parts) {
86
+ if (part === '\n') {
87
+ html += '<br>';
88
+ } else if (part) {
89
+ html += `<span class="intro-token" style="--a:${alpha}">${escapeHtml(part)}</span>`;
90
+ }
91
+ }
92
+ } else {
93
+ html += `<span class="intro-token" style="--a:${alpha}">${escapedText}</span>`;
94
+ }
95
+ }
96
+
97
+ return html;
98
+ } catch (error) {
99
+ console.error(`Failed to generate HTML from JSON: ${jsonPath}`, error);
100
+ return null;
101
+ }
102
+ }
103
+
104
+ /**
105
+ * 更新HTML文件中的intro-brief内容
106
+ */
107
+ function updateHTMLIntro(htmlPath, coloredHTML) {
108
+ try {
109
+ let html = fs.readFileSync(htmlPath, 'utf-8');
110
+
111
+ // 匹配 <div class="intro-brief" ...> 到 </div> 之间的内容
112
+ const regex = /(<div class="intro-brief"[^>]*>)([\s\S]*?)(<\/div>)/;
113
+
114
+ if (!regex.test(html)) {
115
+ console.error(`intro-brief not found in ${htmlPath}`);
116
+ return false;
117
+ }
118
+
119
+ // 替换为带颜色的HTML,容器上定义 CSS 变量供 span 复用
120
+ const replacement = `<div class="intro-brief" style="--intro-rgb: ${INTRO_RGB}">\n ${coloredHTML}\n</div>`;
121
+ html = html.replace(regex, replacement);
122
+
123
+ fs.writeFileSync(htmlPath, html, 'utf-8');
124
+ console.log(`✓ Updated ${path.basename(htmlPath)}`);
125
+ return true;
126
+ } catch (error) {
127
+ console.error(`Failed to update HTML file: ${htmlPath}`, error);
128
+ return false;
129
+ }
130
+ }
131
+
132
+ /**
133
+ * 主函数
134
+ */
135
+ function main() {
136
+ console.log('Generating colored intro HTML from JSON...\n');
137
+
138
+ let success = true;
139
+
140
+ // 生成并更新英文
141
+ const enHTML = generateColoredHTML(paths.en.json);
142
+ if (enHTML) {
143
+ success = updateHTMLIntro(paths.en.html, enHTML) && success;
144
+ } else {
145
+ success = false;
146
+ }
147
+
148
+ // 生成并更新中文
149
+ const zhHTML = generateColoredHTML(paths.zh.json);
150
+ if (zhHTML) {
151
+ success = updateHTMLIntro(paths.zh.html, zhHTML) && success;
152
+ } else {
153
+ success = false;
154
+ }
155
+
156
+ if (success) {
157
+ console.log('\n✓ All intro HTML files generated successfully');
158
+ } else {
159
+ console.error('\n✗ Some generation failed');
160
+ process.exit(1);
161
+ }
162
+ }
163
+
164
+ // 执行
165
+ main();
data/demo/public/CN/InfoRadar-了解更多.json ADDED
The diff for this file is too large to render. See raw diff
 
data/demo/public/CN/InfoRadar-介绍.json ADDED
@@ -0,0 +1,3455 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "request": {
3
+ "text": "想一眼跳过冗余、废话,找到文章的关键点?或者只是好奇文字的信息论奥秘?\n\n试试 InfoRadar(信息雷达)吧。它使用大语言模型分析文本的信息密度,可视化展示哪里更重要。\n\n每个字的颜色深浅,表示它承载的信息量大小。自己试试吧!"
4
+ },
5
+ "result": {
6
+ "model": "qwen3.0-0.6b",
7
+ "bpe_strings": [
8
+ {
9
+ "offset": [
10
+ 0,
11
+ 1
12
+ ],
13
+ "raw": "想",
14
+ "real_topk": [
15
+ 0,
16
+ 1.3709068298339844e-06
17
+ ],
18
+ "pred_topk": [
19
+ [
20
+ "Human",
21
+ 0.054840087890625
22
+ ],
23
+ [
24
+ "The",
25
+ 0.031982421875
26
+ ],
27
+ [
28
+ "What",
29
+ 0.023223876953125
30
+ ],
31
+ [
32
+ "#",
33
+ 0.022857666015625
34
+ ],
35
+ [
36
+ "以下",
37
+ 0.020172119140625
38
+ ],
39
+ [
40
+ "Given",
41
+ 0.016204833984375
42
+ ],
43
+ [
44
+ "@",
45
+ 0.01558685302734375
46
+ ],
47
+ [
48
+ "###",
49
+ 0.01419830322265625
50
+ ],
51
+ [
52
+ "import",
53
+ 0.00945281982421875
54
+ ],
55
+ [
56
+ "Find",
57
+ 0.00894927978515625
58
+ ]
59
+ ]
60
+ },
61
+ {
62
+ "offset": [
63
+ 1,
64
+ 3
65
+ ],
66
+ "raw": "一眼",
67
+ "real_topk": [
68
+ 0,
69
+ 3.5762786865234375e-05
70
+ ],
71
+ "pred_topk": [
72
+ [
73
+ "----------------------------------------------------------------------",
74
+ 0.020416259765625
75
+ ],
76
+ [
77
+ "\u0014",
78
+ 0.0199432373046875
79
+ ],
80
+ [
81
+ " ",
82
+ 0.01678466796875
83
+ ],
84
+ [
85
+ "''",
86
+ 0.016143798828125
87
+ ],
88
+ [
89
+ ":)",
90
+ 0.015655517578125
91
+ ],
92
+ [
93
+ "����",
94
+ 0.01318359375
95
+ ],
96
+ [
97
+ "................................................................",
98
+ 0.0098724365234375
99
+ ],
100
+ [
101
+ "||",
102
+ 0.00878143310546875
103
+ ],
104
+ [
105
+ "--",
106
+ 0.00844573974609375
107
+ ],
108
+ [
109
+ "\u0001",
110
+ 0.008056640625
111
+ ]
112
+ ]
113
+ },
114
+ {
115
+ "offset": [
116
+ 3,
117
+ 4
118
+ ],
119
+ "raw": "跳",
120
+ "real_topk": [
121
+ 0,
122
+ 8.606910705566406e-05
123
+ ],
124
+ "pred_topk": [
125
+ [
126
+ "就",
127
+ 0.25244140625
128
+ ],
129
+ [
130
+ "就能",
131
+ 0.0806884765625
132
+ ],
133
+ [
134
+ ",",
135
+ 0.050506591796875
136
+ ],
137
+ [
138
+ "就知道",
139
+ 0.03582763671875
140
+ ],
141
+ [
142
+ "就觉得",
143
+ 0.0294647216796875
144
+ ],
145
+ [
146
+ "就想",
147
+ 0.0290069580078125
148
+ ],
149
+ [
150
+ "就会",
151
+ 0.02789306640625
152
+ ],
153
+ [
154
+ "都",
155
+ 0.0261993408203125
156
+ ],
157
+ [
158
+ "就是",
159
+ 0.0261993408203125
160
+ ],
161
+ [
162
+ "就可以",
163
+ 0.01084136962890625
164
+ ]
165
+ ]
166
+ },
167
+ {
168
+ "offset": [
169
+ 4,
170
+ 5
171
+ ],
172
+ "raw": "过",
173
+ "real_topk": [
174
+ 0,
175
+ 0.036773681640625
176
+ ],
177
+ "pred_topk": [
178
+ [
179
+ "起来",
180
+ 0.11871337890625
181
+ ],
182
+ [
183
+ "到",
184
+ 0.0457763671875
185
+ ],
186
+ [
187
+ "的",
188
+ 0.042999267578125
189
+ ],
190
+ [
191
+ "起",
192
+ 0.042999267578125
193
+ ],
194
+ [
195
+ "过",
196
+ 0.036773681640625
197
+ ],
198
+ [
199
+ ",",
200
+ 0.0277557373046875
201
+ ],
202
+ [
203
+ "出来",
204
+ 0.02374267578125
205
+ ],
206
+ [
207
+ "一",
208
+ 0.02337646484375
209
+ ],
210
+ [
211
+ "脚",
212
+ 0.02178955078125
213
+ ],
214
+ [
215
+ "就",
216
+ 0.01849365234375
217
+ ]
218
+ ]
219
+ },
220
+ {
221
+ "offset": [
222
+ 5,
223
+ 6
224
+ ],
225
+ "raw": "冗",
226
+ "real_topk": [
227
+ 0,
228
+ 7.671117782592773e-05
229
+ ],
230
+ "pred_topk": [
231
+ [
232
+ ",",
233
+ 0.09454345703125
234
+ ],
235
+ [
236
+ "就",
237
+ 0.0181884765625
238
+ ],
239
+ [
240
+ "一个",
241
+ 0.014495849609375
242
+ ],
243
+ [
244
+ "\n",
245
+ 0.013946533203125
246
+ ],
247
+ [
248
+ "。",
249
+ 0.01383209228515625
250
+ ],
251
+ [
252
+ "所有",
253
+ 0.01300048828125
254
+ ],
255
+ [
256
+ "就是",
257
+ 0.0098876953125
258
+ ],
259
+ [
260
+ "1",
261
+ 0.00914764404296875
262
+ ],
263
+ [
264
+ "一",
265
+ 0.00865936279296875
266
+ ],
267
+ [
268
+ "很多",
269
+ 0.00782012939453125
270
+ ]
271
+ ]
272
+ },
273
+ {
274
+ "offset": [
275
+ 6,
276
+ 7
277
+ ],
278
+ "raw": "余",
279
+ "real_topk": [
280
+ 0,
281
+ 0.54345703125
282
+ ],
283
+ "pred_topk": [
284
+ [
285
+ "余",
286
+ 0.54345703125
287
+ ],
288
+ [
289
+ "长",
290
+ 0.41650390625
291
+ ],
292
+ [
293
+ "杂",
294
+ 0.01092529296875
295
+ ],
296
+ [
297
+ "员",
298
+ 0.0021190643310546875
299
+ ],
300
+ [
301
+ "繁",
302
+ 0.0019588470458984375
303
+ ],
304
+ [
305
+ "音",
306
+ 0.00109100341796875
307
+ ],
308
+ [
309
+ "多",
310
+ 0.0010242462158203125
311
+ ],
312
+ [
313
+ "耗",
314
+ 0.0008296966552734375
315
+ ],
316
+ [
317
+ "述",
318
+ 0.0007152557373046875
319
+ ],
320
+ [
321
+ "历",
322
+ 0.0006823539733886719
323
+ ]
324
+ ]
325
+ },
326
+ {
327
+ "offset": [
328
+ 7,
329
+ 8
330
+ ],
331
+ "raw": "、",
332
+ "real_topk": [
333
+ 0,
334
+ 0.0034465789794921875
335
+ ],
336
+ "pred_topk": [
337
+ [
338
+ "的",
339
+ 0.182373046875
340
+ ],
341
+ [
342
+ ",",
343
+ 0.0760498046875
344
+ ],
345
+ [
346
+ "数据",
347
+ 0.042327880859375
348
+ ],
349
+ [
350
+ "代码",
351
+ 0.041656494140625
352
+ ],
353
+ [
354
+ "步骤",
355
+ 0.029998779296875
356
+ ],
357
+ [
358
+ "计算",
359
+ 0.024871826171875
360
+ ],
361
+ [
362
+ "部分",
363
+ 0.0211181640625
364
+ ],
365
+ [
366
+ "信息",
367
+ 0.019378662109375
368
+ ],
369
+ [
370
+ "\n",
371
+ 0.01221466064453125
372
+ ],
373
+ [
374
+ "的部分",
375
+ 0.01129913330078125
376
+ ]
377
+ ]
378
+ },
379
+ {
380
+ "offset": [
381
+ 8,
382
+ 10
383
+ ],
384
+ "raw": "废话",
385
+ "real_topk": [
386
+ 0,
387
+ 0.0007781982421875
388
+ ],
389
+ "pred_topk": [
390
+ [
391
+ "重复",
392
+ 0.06842041015625
393
+ ],
394
+ [
395
+ "不",
396
+ 0.017578125
397
+ ],
398
+ [
399
+ "冗",
400
+ 0.0162506103515625
401
+ ],
402
+ [
403
+ "优化",
404
+ 0.01326751708984375
405
+ ],
406
+ [
407
+ "跳",
408
+ 0.01041412353515625
409
+ ],
410
+ [
411
+ "重",
412
+ 0.00884246826171875
413
+ ],
414
+ [
415
+ "浪费",
416
+ 0.00830078125
417
+ ],
418
+ [
419
+ "省",
420
+ 0.006671905517578125
421
+ ],
422
+ [
423
+ "逻辑",
424
+ 0.0059356689453125
425
+ ],
426
+ [
427
+ "空",
428
+ 0.0049591064453125
429
+ ]
430
+ ]
431
+ },
432
+ {
433
+ "offset": [
434
+ 10,
435
+ 11
436
+ ],
437
+ "raw": ",",
438
+ "real_topk": [
439
+ 0,
440
+ 0.126708984375
441
+ ],
442
+ "pred_topk": [
443
+ [
444
+ "、",
445
+ 0.26806640625
446
+ ],
447
+ [
448
+ ",",
449
+ 0.126708984375
450
+ ],
451
+ [
452
+ "和",
453
+ 0.120849609375
454
+ ],
455
+ [
456
+ "多",
457
+ 0.036865234375
458
+ ],
459
+ [
460
+ "的",
461
+ 0.034637451171875
462
+ ],
463
+ [
464
+ "等",
465
+ 0.034088134765625
466
+ ],
467
+ [
468
+ "太多",
469
+ 0.022705078125
470
+ ],
471
+ [
472
+ "少",
473
+ 0.0198822021484375
474
+ ],
475
+ [
476
+ "\n",
477
+ 0.01324462890625
478
+ ],
479
+ [
480
+ "一大堆",
481
+ 0.0107269287109375
482
+ ]
483
+ ]
484
+ },
485
+ {
486
+ "offset": [
487
+ 11,
488
+ 13
489
+ ],
490
+ "raw": "找到",
491
+ "real_topk": [
492
+ 0,
493
+ 0.0026988983154296875
494
+ ],
495
+ "pred_topk": [
496
+ [
497
+ "直接",
498
+ 0.09075927734375
499
+ ],
500
+ [
501
+ "然后",
502
+ 0.026824951171875
503
+ ],
504
+ [
505
+ "就",
506
+ 0.0208892822265625
507
+ ],
508
+ [
509
+ "直",
510
+ 0.013916015625
511
+ ],
512
+ [
513
+ "再",
514
+ 0.01287078857421875
515
+ ],
516
+ [
517
+ "就是",
518
+ 0.01209259033203125
519
+ ],
520
+ [
521
+ "把",
522
+ 0.01018524169921875
523
+ ],
524
+ [
525
+ "写",
526
+ 0.00926971435546875
527
+ ],
528
+ [
529
+ "只",
530
+ 0.00926971435546875
531
+ ],
532
+ [
533
+ "快速",
534
+ 0.007568359375
535
+ ]
536
+ ]
537
+ },
538
+ {
539
+ "offset": [
540
+ 13,
541
+ 15
542
+ ],
543
+ "raw": "文章",
544
+ "real_topk": [
545
+ 0,
546
+ 0.004669189453125
547
+ ],
548
+ "pred_topk": [
549
+ [
550
+ "最",
551
+ 0.07135009765625
552
+ ],
553
+ [
554
+ "问题",
555
+ 0.046783447265625
556
+ ],
557
+ [
558
+ "核心",
559
+ 0.04534912109375
560
+ ],
561
+ [
562
+ "关键",
563
+ 0.039398193359375
564
+ ],
565
+ [
566
+ "重点",
567
+ 0.03759765625
568
+ ],
569
+ [
570
+ "自己",
571
+ 0.0224456787109375
572
+ ],
573
+ [
574
+ "一个",
575
+ 0.019195556640625
576
+ ],
577
+ [
578
+ "最重要的",
579
+ 0.0172119140625
580
+ ],
581
+ [
582
+ "需要",
583
+ 0.01340484619140625
584
+ ],
585
+ [
586
+ "真正",
587
+ 0.01329803466796875
588
+ ]
589
+ ]
590
+ },
591
+ {
592
+ "offset": [
593
+ 15,
594
+ 18
595
+ ],
596
+ "raw": "的关键",
597
+ "real_topk": [
598
+ 0,
599
+ 0.02789306640625
600
+ ],
601
+ "pred_topk": [
602
+ [
603
+ "的",
604
+ 0.187744140625
605
+ ],
606
+ [
607
+ "的核心",
608
+ 0.173583984375
609
+ ],
610
+ [
611
+ "核心",
612
+ 0.07122802734375
613
+ ],
614
+ [
615
+ "的重点",
616
+ 0.07122802734375
617
+ ],
618
+ [
619
+ "最",
620
+ 0.02789306640625
621
+ ],
622
+ [
623
+ "的关键",
624
+ 0.02789306640625
625
+ ],
626
+ [
627
+ "重点",
628
+ 0.0250091552734375
629
+ ],
630
+ [
631
+ "主旨",
632
+ 0.01493072509765625
633
+ ],
634
+ [
635
+ "主题",
636
+ 0.0135955810546875
637
+ ],
638
+ [
639
+ "想要",
640
+ 0.01348876953125
641
+ ]
642
+ ]
643
+ },
644
+ {
645
+ "offset": [
646
+ 18,
647
+ 19
648
+ ],
649
+ "raw": "点",
650
+ "real_topk": [
651
+ 0,
652
+ 0.3486328125
653
+ ],
654
+ "pred_topk": [
655
+ [
656
+ "点",
657
+ 0.3486328125
658
+ ],
659
+ [
660
+ ",",
661
+ 0.08538818359375
662
+ ],
663
+ [
664
+ "句",
665
+ 0.055145263671875
666
+ ],
667
+ [
668
+ "信息",
669
+ 0.0526123046875
670
+ ],
671
+ [
672
+ "内容",
673
+ 0.0416259765625
674
+ ],
675
+ [
676
+ "。",
677
+ 0.03045654296875
678
+ ],
679
+ [
680
+ "所在",
681
+ 0.0248565673828125
682
+ ],
683
+ [
684
+ "和",
685
+ 0.021759033203125
686
+ ],
687
+ [
688
+ "。\n",
689
+ 0.02142333984375
690
+ ],
691
+ [
692
+ "字",
693
+ 0.02093505859375
694
+ ]
695
+ ]
696
+ },
697
+ {
698
+ "offset": [
699
+ 19,
700
+ 20
701
+ ],
702
+ "raw": "?",
703
+ "real_topk": [
704
+ 0,
705
+ 0.0007796287536621094
706
+ ],
707
+ "pred_topk": [
708
+ [
709
+ ",",
710
+ 0.36474609375
711
+ ],
712
+ [
713
+ "。",
714
+ 0.1221923828125
715
+ ],
716
+ [
717
+ "和",
718
+ 0.058624267578125
719
+ ],
720
+ [
721
+ "\n",
722
+ 0.05682373046875
723
+ ],
724
+ [
725
+ "。\n",
726
+ 0.055938720703125
727
+ ],
728
+ [
729
+ ",并",
730
+ 0.0299530029296875
731
+ ],
732
+ [
733
+ "\n\n",
734
+ 0.029022216796875
735
+ ],
736
+ [
737
+ "、",
738
+ 0.02642822265625
739
+ ],
740
+ [
741
+ "并",
742
+ 0.02642822265625
743
+ ],
744
+ [
745
+ "。\n\n",
746
+ 0.01459503173828125
747
+ ]
748
+ ]
749
+ },
750
+ {
751
+ "offset": [
752
+ 20,
753
+ 22
754
+ ],
755
+ "raw": "或者",
756
+ "real_topk": [
757
+ 0,
758
+ 0.0032978057861328125
759
+ ],
760
+ "pred_topk": [
761
+ [
762
+ " ",
763
+ 0.025543212890625
764
+ ],
765
+ [
766
+ "请",
767
+ 0.0245513916015625
768
+ ],
769
+ [
770
+ "用",
771
+ 0.0194244384765625
772
+ ],
773
+ [
774
+ "如何",
775
+ 0.017547607421875
776
+ ],
777
+ [
778
+ "怎么",
779
+ 0.014892578125
780
+ ],
781
+ [
782
+ "你",
783
+ 0.01215362548828125
784
+ ],
785
+ [
786
+ "这",
787
+ 0.01107025146484375
788
+ ],
789
+ [
790
+ "(",
791
+ 0.010986328125
792
+ ],
793
+ [
794
+ "这是",
795
+ 0.010894775390625
796
+ ],
797
+ [
798
+ "然后",
799
+ 0.010894775390625
800
+ ]
801
+ ]
802
+ },
803
+ {
804
+ "offset": [
805
+ 22,
806
+ 24
807
+ ],
808
+ "raw": "只是",
809
+ "real_topk": [
810
+ 0,
811
+ 0.0022029876708984375
812
+ ],
813
+ "pred_topk": [
814
+ [
815
+ "直接",
816
+ 0.037567138671875
817
+ ],
818
+ [
819
+ ",",
820
+ 0.03582763671875
821
+ ],
822
+ [
823
+ "找到",
824
+ 0.0214080810546875
825
+ ],
826
+ [
827
+ "你",
828
+ 0.020416259765625
829
+ ],
830
+ [
831
+ "用",
832
+ 0.020111083984375
833
+ ],
834
+ [
835
+ "在",
836
+ 0.0174713134765625
837
+ ],
838
+ [
839
+ "文章",
840
+ 0.01371002197265625
841
+ ],
842
+ [
843
+ "把",
844
+ 0.01371002197265625
845
+ ],
846
+ [
847
+ "有",
848
+ 0.01093292236328125
849
+ ],
850
+ [
851
+ "通过",
852
+ 0.01003265380859375
853
+ ]
854
+ ]
855
+ },
856
+ {
857
+ "offset": [
858
+ 24,
859
+ 26
860
+ ],
861
+ "raw": "好奇",
862
+ "real_topk": [
863
+ 0,
864
+ 0.0011377334594726562
865
+ ],
866
+ "pred_topk": [
867
+ [
868
+ "简单",
869
+ 0.055267333984375
870
+ ],
871
+ [
872
+ "想",
873
+ 0.04510498046875
874
+ ],
875
+ [
876
+ "单纯",
877
+ 0.0286712646484375
878
+ ],
879
+ [
880
+ "在",
881
+ 0.0265045166015625
882
+ ],
883
+ [
884
+ "简单的",
885
+ 0.02490234375
886
+ ],
887
+ [
888
+ "看",
889
+ 0.023040771484375
890
+ ],
891
+ [
892
+ "把",
893
+ 0.016082763671875
894
+ ],
895
+ [
896
+ "单纯的",
897
+ 0.01534271240234375
898
+ ],
899
+ [
900
+ "对",
901
+ 0.0132293701171875
902
+ ],
903
+ [
904
+ "快速",
905
+ 0.0132293701171875
906
+ ]
907
+ ]
908
+ },
909
+ {
910
+ "offset": [
911
+ 26,
912
+ 28
913
+ ],
914
+ "raw": "文字",
915
+ "real_topk": [
916
+ 0,
917
+ 0.0012331008911132812
918
+ ],
919
+ "pred_topk": [
920
+ [
921
+ ",",
922
+ 0.181640625
923
+ ],
924
+ [
925
+ "文章",
926
+ 0.11724853515625
927
+ ],
928
+ [
929
+ "?",
930
+ 0.06475830078125
931
+ ],
932
+ [
933
+ "作者",
934
+ 0.052032470703125
935
+ ],
936
+ [
937
+ ":",
938
+ 0.0189971923828125
939
+ ],
940
+ [
941
+ "、",
942
+ 0.0188446044921875
943
+ ],
944
+ [
945
+ "?\n",
946
+ 0.01389312744140625
947
+ ],
948
+ [
949
+ "这个",
950
+ 0.01378631591796875
951
+ ],
952
+ [
953
+ "为什么",
954
+ 0.0115203857421875
955
+ ],
956
+ [
957
+ "某个",
958
+ 0.0113372802734375
959
+ ]
960
+ ]
961
+ },
962
+ {
963
+ "offset": [
964
+ 28,
965
+ 31
966
+ ],
967
+ "raw": "的信息",
968
+ "real_topk": [
969
+ 0,
970
+ 0.00038743019104003906
971
+ ],
972
+ "pred_topk": [
973
+ [
974
+ "的",
975
+ 0.163818359375
976
+ ],
977
+ [
978
+ "背后",
979
+ 0.04205322265625
980
+ ],
981
+ [
982
+ "内容",
983
+ 0.02935791015625
984
+ ],
985
+ [
986
+ "本身",
987
+ 0.0263214111328125
988
+ ],
989
+ [
990
+ "背后的",
991
+ 0.023223876953125
992
+ ],
993
+ [
994
+ "怎么",
995
+ 0.0225067138671875
996
+ ],
997
+ [
998
+ "是否",
999
+ 0.021820068359375
1000
+ ],
1001
+ [
1002
+ "是什么",
1003
+ 0.021484375
1004
+ ],
1005
+ [
1006
+ "中",
1007
+ 0.0175323486328125
1008
+ ],
1009
+ [
1010
+ "里",
1011
+ 0.0164642333984375
1012
+ ]
1013
+ ]
1014
+ },
1015
+ {
1016
+ "offset": [
1017
+ 31,
1018
+ 32
1019
+ ],
1020
+ "raw": "论",
1021
+ "real_topk": [
1022
+ 0,
1023
+ 0.00011277198791503906
1024
+ ],
1025
+ "pred_topk": [
1026
+ [
1027
+ "?",
1028
+ 0.1612548828125
1029
+ ],
1030
+ [
1031
+ ",",
1032
+ 0.119873046875
1033
+ ],
1034
+ [
1035
+ "量",
1036
+ 0.056610107421875
1037
+ ],
1038
+ [
1039
+ "内容",
1040
+ 0.05487060546875
1041
+ ],
1042
+ [
1043
+ "?\n",
1044
+ 0.04693603515625
1045
+ ],
1046
+ [
1047
+ "吗",
1048
+ 0.04339599609375
1049
+ ],
1050
+ [
1051
+ "是什么",
1052
+ 0.03125
1053
+ ],
1054
+ [
1055
+ "结构",
1056
+ 0.0236053466796875
1057
+ ],
1058
+ [
1059
+ "。",
1060
+ 0.020660400390625
1061
+ ],
1062
+ [
1063
+ "?\n\n",
1064
+ 0.0189666748046875
1065
+ ]
1066
+ ]
1067
+ },
1068
+ {
1069
+ "offset": [
1070
+ 32,
1071
+ 33
1072
+ ],
1073
+ "raw": "奥",
1074
+ "real_topk": [
1075
+ 0,
1076
+ 0.00016546249389648438
1077
+ ],
1078
+ "pred_topk": [
1079
+ [
1080
+ "?",
1081
+ 0.08837890625
1082
+ ],
1083
+ [
1084
+ ",",
1085
+ 0.074462890625
1086
+ ],
1087
+ [
1088
+ "是什么",
1089
+ 0.051177978515625
1090
+ ],
1091
+ [
1092
+ "、",
1093
+ 0.048828125
1094
+ ],
1095
+ [
1096
+ "和",
1097
+ 0.03802490234375
1098
+ ],
1099
+ [
1100
+ "吗",
1101
+ 0.0335693359375
1102
+ ],
1103
+ [
1104
+ "?\n",
1105
+ 0.024169921875
1106
+ ],
1107
+ [
1108
+ "意义",
1109
+ 0.018829345703125
1110
+ ],
1111
+ [
1112
+ "的",
1113
+ 0.0174102783203125
1114
+ ],
1115
+ [
1116
+ "。",
1117
+ 0.0151214599609375
1118
+ ]
1119
+ ]
1120
+ },
1121
+ {
1122
+ "offset": [
1123
+ 33,
1124
+ 34
1125
+ ],
1126
+ "raw": "秘",
1127
+ "real_topk": [
1128
+ 0,
1129
+ 0.6875
1130
+ ],
1131
+ "pred_topk": [
1132
+ [
1133
+ "秘",
1134
+ 0.6875
1135
+ ],
1136
+ [
1137
+ "义",
1138
+ 0.1396484375
1139
+ ],
1140
+ [
1141
+ "妙",
1142
+ 0.129150390625
1143
+ ],
1144
+ [
1145
+ "数",
1146
+ 0.0159149169921875
1147
+ ],
1148
+ [
1149
+ "密",
1150
+ 0.003551483154296875
1151
+ ],
1152
+ [
1153
+ "卡",
1154
+ 0.00272369384765625
1155
+ ],
1156
+ [
1157
+ "术",
1158
+ 0.0012273788452148438
1159
+ ],
1160
+ [
1161
+ "尔",
1162
+ 0.0011262893676757812
1163
+ ],
1164
+ [
1165
+ "吗",
1166
+ 0.0008435249328613281
1167
+ ],
1168
+ [
1169
+ "层",
1170
+ 0.0007987022399902344
1171
+ ]
1172
+ ]
1173
+ },
1174
+ {
1175
+ "offset": [
1176
+ 34,
1177
+ 37
1178
+ ],
1179
+ "raw": "?\n\n",
1180
+ "real_topk": [
1181
+ 0,
1182
+ 0.05682373046875
1183
+ ],
1184
+ "pred_topk": [
1185
+ [
1186
+ "?",
1187
+ 0.400634765625
1188
+ ],
1189
+ [
1190
+ "?\n",
1191
+ 0.154541015625
1192
+ ],
1193
+ [
1194
+ ",",
1195
+ 0.09515380859375
1196
+ ],
1197
+ [
1198
+ "?\n\n",
1199
+ 0.05682373046875
1200
+ ],
1201
+ [
1202
+ "吗",
1203
+ 0.040924072265625
1204
+ ],
1205
+ [
1206
+ "。",
1207
+ 0.03448486328125
1208
+ ],
1209
+ [
1210
+ "呢",
1211
+ 0.01873779296875
1212
+ ],
1213
+ [
1214
+ "是什么",
1215
+ 0.015899658203125
1216
+ ],
1217
+ [
1218
+ "\n",
1219
+ 0.01541900634765625
1220
+ ],
1221
+ [
1222
+ "。\n",
1223
+ 0.01517486572265625
1224
+ ]
1225
+ ]
1226
+ },
1227
+ {
1228
+ "offset": [
1229
+ 37,
1230
+ 39
1231
+ ],
1232
+ "raw": "试试",
1233
+ "real_topk": [
1234
+ 0,
1235
+ 4.7087669372558594e-05
1236
+ ],
1237
+ "pred_topk": [
1238
+ [
1239
+ "要",
1240
+ 0.056243896484375
1241
+ ],
1242
+ [
1243
+ "阅读",
1244
+ 0.0411376953125
1245
+ ],
1246
+ [
1247
+ "你",
1248
+ 0.039276123046875
1249
+ ],
1250
+ [
1251
+ "文字",
1252
+ 0.035186767578125
1253
+ ],
1254
+ [
1255
+ "信息",
1256
+ 0.0269927978515625
1257
+ ],
1258
+ [
1259
+ "当然",
1260
+ 0.02203369140625
1261
+ ],
1262
+ [
1263
+ "在",
1264
+ 0.0210113525390625
1265
+ ],
1266
+ [
1267
+ "###",
1268
+ 0.02069091796875
1269
+ ],
1270
+ [
1271
+ "是",
1272
+ 0.016632080078125
1273
+ ],
1274
+ [
1275
+ "我",
1276
+ 0.01611328125
1277
+ ]
1278
+ ]
1279
+ },
1280
+ {
1281
+ "offset": [
1282
+ 39,
1283
+ 44
1284
+ ],
1285
+ "raw": " Info",
1286
+ "real_topk": [
1287
+ 0,
1288
+ 5.960464477539062e-07
1289
+ ],
1290
+ "pred_topk": [
1291
+ [
1292
+ "以下",
1293
+ 0.133056640625
1294
+ ],
1295
+ [
1296
+ "看",
1297
+ 0.11566162109375
1298
+ ],
1299
+ [
1300
+ "下面",
1301
+ 0.07464599609375
1302
+ ],
1303
+ [
1304
+ "用",
1305
+ 0.056365966796875
1306
+ ],
1307
+ [
1308
+ "这个",
1309
+ 0.04974365234375
1310
+ ],
1311
+ [
1312
+ "使用",
1313
+ 0.0452880859375
1314
+ ],
1315
+ [
1316
+ "这篇文章",
1317
+ 0.020416259765625
1318
+ ],
1319
+ [
1320
+ "阅读",
1321
+ 0.017730712890625
1322
+ ],
1323
+ [
1324
+ "“",
1325
+ 0.0164031982421875
1326
+ ],
1327
+ [
1328
+ "这",
1329
+ 0.0135955810546875
1330
+ ]
1331
+ ]
1332
+ },
1333
+ {
1334
+ "offset": [
1335
+ 44,
1336
+ 45
1337
+ ],
1338
+ "raw": "R",
1339
+ "real_topk": [
1340
+ 0,
1341
+ 0.0088653564453125
1342
+ ],
1343
+ "pred_topk": [
1344
+ [
1345
+ "Q",
1346
+ 0.050201416015625
1347
+ ],
1348
+ [
1349
+ "-",
1350
+ 0.033203125
1351
+ ],
1352
+ [
1353
+ " Gap",
1354
+ 0.03192138671875
1355
+ ],
1356
+ [
1357
+ "Gap",
1358
+ 0.0295257568359375
1359
+ ],
1360
+ [
1361
+ "seek",
1362
+ 0.02227783203125
1363
+ ],
1364
+ [
1365
+ "D",
1366
+ 0.0180511474609375
1367
+ ],
1368
+ [
1369
+ "Max",
1370
+ 0.0176239013671875
1371
+ ],
1372
+ [
1373
+ " =",
1374
+ 0.01461029052734375
1375
+ ],
1376
+ [
1377
+ "Seek",
1378
+ 0.0140533447265625
1379
+ ],
1380
+ [
1381
+ "N",
1382
+ 0.01259613037109375
1383
+ ]
1384
+ ]
1385
+ },
1386
+ {
1387
+ "offset": [
1388
+ 45,
1389
+ 49
1390
+ ],
1391
+ "raw": "adar",
1392
+ "real_topk": [
1393
+ 0,
1394
+ 0.00620269775390625
1395
+ ],
1396
+ "pred_topk": [
1397
+ [
1398
+ "at",
1399
+ 0.038604736328125
1400
+ ],
1401
+ [
1402
+ "ise",
1403
+ 0.0226898193359375
1404
+ ],
1405
+ [
1406
+ " ",
1407
+ 0.02252197265625
1408
+ ],
1409
+ [
1410
+ " 是",
1411
+ 0.021820068359375
1412
+ ],
1413
+ [
1414
+ "(",
1415
+ 0.020660400390625
1416
+ ],
1417
+ [
1418
+ "age",
1419
+ 0.0179443359375
1420
+ ],
1421
+ [
1422
+ "ater",
1423
+ 0.017669677734375
1424
+ ],
1425
+ [
1426
+ "er",
1427
+ 0.0166015625
1428
+ ],
1429
+ [
1430
+ "it",
1431
+ 0.0166015625
1432
+ ],
1433
+ [
1434
+ ",",
1435
+ 0.01476287841796875
1436
+ ]
1437
+ ]
1438
+ },
1439
+ {
1440
+ "offset": [
1441
+ 49,
1442
+ 50
1443
+ ],
1444
+ "raw": "(",
1445
+ "real_topk": [
1446
+ 0,
1447
+ 0.010772705078125
1448
+ ],
1449
+ "pred_topk": [
1450
+ [
1451
+ ",",
1452
+ 0.171142578125
1453
+ ],
1454
+ [
1455
+ " ",
1456
+ 0.07244873046875
1457
+ ],
1458
+ [
1459
+ " �",
1460
+ 0.04193115234375
1461
+ ],
1462
+ [
1463
+ "!",
1464
+ 0.034210205078125
1465
+ ],
1466
+ [
1467
+ " 的",
1468
+ 0.03369140625
1469
+ ],
1470
+ [
1471
+ "。",
1472
+ 0.03216552734375
1473
+ ],
1474
+ [
1475
+ " �",
1476
+ 0.027496337890625
1477
+ ],
1478
+ [
1479
+ " ,",
1480
+ 0.02484130859375
1481
+ ],
1482
+ [
1483
+ "\n\n",
1484
+ 0.0219268798828125
1485
+ ],
1486
+ [
1487
+ " �",
1488
+ 0.0212554931640625
1489
+ ]
1490
+ ]
1491
+ },
1492
+ {
1493
+ "offset": [
1494
+ 50,
1495
+ 52
1496
+ ],
1497
+ "raw": "信息",
1498
+ "real_topk": [
1499
+ 0,
1500
+ 0.1829833984375
1501
+ ],
1502
+ "pred_topk": [
1503
+ [
1504
+ "信息",
1505
+ 0.1829833984375
1506
+ ],
1507
+ [
1508
+ "https",
1509
+ 0.0662841796875
1510
+ ],
1511
+ [
1512
+ "http",
1513
+ 0.032806396484375
1514
+ ],
1515
+ [
1516
+ "Info",
1517
+ 0.02117919921875
1518
+ ],
1519
+ [
1520
+ "中文",
1521
+ 0.0162353515625
1522
+ ],
1523
+ [
1524
+ "一个",
1525
+ 0.01611328125
1526
+ ],
1527
+ [
1528
+ ")",
1529
+ 0.0159912109375
1530
+ ],
1531
+ [
1532
+ "info",
1533
+ 0.0121612548828125
1534
+ ],
1535
+ [
1536
+ "或",
1537
+ 0.01178741455078125
1538
+ ],
1539
+ [
1540
+ "英文",
1541
+ 0.011077880859375
1542
+ ]
1543
+ ]
1544
+ },
1545
+ {
1546
+ "offset": [
1547
+ 52,
1548
+ 54
1549
+ ],
1550
+ "raw": "雷达",
1551
+ "real_topk": [
1552
+ 0,
1553
+ 0.9560546875
1554
+ ],
1555
+ "pred_topk": [
1556
+ [
1557
+ "雷达",
1558
+ 0.9560546875
1559
+ ],
1560
+ [
1561
+ "拉",
1562
+ 0.0009136199951171875
1563
+ ],
1564
+ [
1565
+ "风暴",
1566
+ 0.00083160400390625
1567
+ ],
1568
+ [
1569
+ "之",
1570
+ 0.0007457733154296875
1571
+ ],
1572
+ [
1573
+ "猎",
1574
+ 0.0007114410400390625
1575
+ ],
1576
+ [
1577
+ "辐射",
1578
+ 0.000598907470703125
1579
+ ],
1580
+ [
1581
+ "迷",
1582
+ 0.000545501708984375
1583
+ ],
1584
+ [
1585
+ "网",
1586
+ 0.0005207061767578125
1587
+ ],
1588
+ [
1589
+ "警",
1590
+ 0.0005044937133789062
1591
+ ],
1592
+ [
1593
+ "战",
1594
+ 0.0004248619079589844
1595
+ ]
1596
+ ]
1597
+ },
1598
+ {
1599
+ "offset": [
1600
+ 54,
1601
+ 55
1602
+ ],
1603
+ "raw": ")",
1604
+ "real_topk": [
1605
+ 0,
1606
+ 0.470703125
1607
+ ],
1608
+ "pred_topk": [
1609
+ [
1610
+ ")",
1611
+ 0.470703125
1612
+ ],
1613
+ [
1614
+ "),",
1615
+ 0.333740234375
1616
+ ],
1617
+ [
1618
+ ")。",
1619
+ 0.07684326171875
1620
+ ],
1621
+ [
1622
+ ",",
1623
+ 0.03009033203125
1624
+ ],
1625
+ [
1626
+ ")\n\n",
1627
+ 0.0296173095703125
1628
+ ],
1629
+ [
1630
+ ")\n",
1631
+ 0.01715087890625
1632
+ ],
1633
+ [
1634
+ ")",
1635
+ 0.0048370361328125
1636
+ ],
1637
+ [
1638
+ " ",
1639
+ 0.0026702880859375
1640
+ ],
1641
+ [
1642
+ ")、",
1643
+ 0.002048492431640625
1644
+ ],
1645
+ [
1646
+ "!",
1647
+ 0.0019683837890625
1648
+ ]
1649
+ ]
1650
+ },
1651
+ {
1652
+ "offset": [
1653
+ 55,
1654
+ 56
1655
+ ],
1656
+ "raw": "吧",
1657
+ "real_topk": [
1658
+ 0,
1659
+ 0.05889892578125
1660
+ ],
1661
+ "pred_topk": [
1662
+ [
1663
+ "这个",
1664
+ 0.1307373046875
1665
+ ],
1666
+ [
1667
+ "工具",
1668
+ 0.059844970703125
1669
+ ],
1670
+ [
1671
+ "吧",
1672
+ 0.05889892578125
1673
+ ],
1674
+ [
1675
+ ":",
1676
+ 0.036865234375
1677
+ ],
1678
+ [
1679
+ "。\n",
1680
+ 0.02825927734375
1681
+ ],
1682
+ [
1683
+ "来",
1684
+ 0.02825927734375
1685
+ ],
1686
+ [
1687
+ "。\n\n",
1688
+ 0.02783203125
1689
+ ],
1690
+ [
1691
+ "算法",
1692
+ 0.0269775390625
1693
+ ],
1694
+ [
1695
+ "!",
1696
+ 0.0245513916015625
1697
+ ],
1698
+ [
1699
+ "软件",
1700
+ 0.0245513916015625
1701
+ ]
1702
+ ]
1703
+ },
1704
+ {
1705
+ "offset": [
1706
+ 56,
1707
+ 57
1708
+ ],
1709
+ "raw": "。",
1710
+ "real_topk": [
1711
+ 0,
1712
+ 0.183837890625
1713
+ ],
1714
+ "pred_topk": [
1715
+ [
1716
+ "!",
1717
+ 0.29833984375
1718
+ ],
1719
+ [
1720
+ ",",
1721
+ 0.1866455078125
1722
+ ],
1723
+ [
1724
+ "。",
1725
+ 0.183837890625
1726
+ ],
1727
+ [
1728
+ "!\n\n",
1729
+ 0.1114501953125
1730
+ ],
1731
+ [
1732
+ "。\n\n",
1733
+ 0.046478271484375
1734
+ ],
1735
+ [
1736
+ "。\n",
1737
+ 0.03912353515625
1738
+ ],
1739
+ [
1740
+ "\n\n",
1741
+ 0.0269012451171875
1742
+ ],
1743
+ [
1744
+ "\n",
1745
+ 0.01763916015625
1746
+ ],
1747
+ [
1748
+ ":",
1749
+ 0.01462554931640625
1750
+ ],
1751
+ [
1752
+ "?",
1753
+ 0.00914764404296875
1754
+ ]
1755
+ ]
1756
+ },
1757
+ {
1758
+ "offset": [
1759
+ 57,
1760
+ 58
1761
+ ],
1762
+ "raw": "它",
1763
+ "real_topk": [
1764
+ 0,
1765
+ 0.205810546875
1766
+ ],
1767
+ "pred_topk": [
1768
+ [
1769
+ "它",
1770
+ 0.205810546875
1771
+ ],
1772
+ [
1773
+ "这个",
1774
+ 0.06085205078125
1775
+ ],
1776
+ [
1777
+ "这",
1778
+ 0.0305938720703125
1779
+ ],
1780
+ [
1781
+ "它是",
1782
+ 0.028289794921875
1783
+ ],
1784
+ [
1785
+ "Info",
1786
+ 0.0257720947265625
1787
+ ],
1788
+ [
1789
+ "这是一个",
1790
+ 0.025360107421875
1791
+ ],
1792
+ [
1793
+ "信息",
1794
+ 0.0245819091796875
1795
+ ],
1796
+ [
1797
+ "这是一种",
1798
+ 0.01702880859375
1799
+ ],
1800
+ [
1801
+ "这是",
1802
+ 0.01538848876953125
1803
+ ],
1804
+ [
1805
+ "在",
1806
+ 0.01422882080078125
1807
+ ]
1808
+ ]
1809
+ },
1810
+ {
1811
+ "offset": [
1812
+ 58,
1813
+ 60
1814
+ ],
1815
+ "raw": "使用",
1816
+ "real_topk": [
1817
+ 0,
1818
+ 0.00958251953125
1819
+ ],
1820
+ "pred_topk": [
1821
+ [
1822
+ "是一个",
1823
+ 0.2432861328125
1824
+ ],
1825
+ [
1826
+ "能",
1827
+ 0.07421875
1828
+ ],
1829
+ [
1830
+ "是一款",
1831
+ 0.07421875
1832
+ ],
1833
+ [
1834
+ "是一种",
1835
+ 0.0718994140625
1836
+ ],
1837
+ [
1838
+ "可以帮助",
1839
+ 0.03973388671875
1840
+ ],
1841
+ [
1842
+ "是一",
1843
+ 0.0260467529296875
1844
+ ],
1845
+ [
1846
+ "能够",
1847
+ 0.023712158203125
1848
+ ],
1849
+ [
1850
+ "提供",
1851
+ 0.021942138671875
1852
+ ],
1853
+ [
1854
+ "通过",
1855
+ 0.0165557861328125
1856
+ ],
1857
+ [
1858
+ "是由",
1859
+ 0.01531219482421875
1860
+ ]
1861
+ ]
1862
+ },
1863
+ {
1864
+ "offset": [
1865
+ 60,
1866
+ 61
1867
+ ],
1868
+ "raw": "大",
1869
+ "real_topk": [
1870
+ 0,
1871
+ 0.0017652511596679688
1872
+ ],
1873
+ "pred_topk": [
1874
+ [
1875
+ "了",
1876
+ 0.0540771484375
1877
+ ],
1878
+ [
1879
+ "信息",
1880
+ 0.05322265625
1881
+ ],
1882
+ [
1883
+ "机器",
1884
+ 0.036590576171875
1885
+ ],
1886
+ [
1887
+ "自然",
1888
+ 0.03204345703125
1889
+ ],
1890
+ [
1891
+ "一种",
1892
+ 0.02593994140625
1893
+ ],
1894
+ [
1895
+ "人工智能",
1896
+ 0.0218505859375
1897
+ ],
1898
+ [
1899
+ "统计",
1900
+ 0.0177001953125
1901
+ ],
1902
+ [
1903
+ "一个",
1904
+ 0.0164947509765625
1905
+ ],
1906
+ [
1907
+ "文本",
1908
+ 0.0162353515625
1909
+ ],
1910
+ [
1911
+ "深度",
1912
+ 0.0158538818359375
1913
+ ]
1914
+ ]
1915
+ },
1916
+ {
1917
+ "offset": [
1918
+ 61,
1919
+ 63
1920
+ ],
1921
+ "raw": "语言",
1922
+ "real_topk": [
1923
+ 0,
1924
+ 0.6240234375
1925
+ ],
1926
+ "pred_topk": [
1927
+ [
1928
+ "语言",
1929
+ 0.6240234375
1930
+ ],
1931
+ [
1932
+ "模型",
1933
+ 0.1962890625
1934
+ ],
1935
+ [
1936
+ "牛",
1937
+ 0.0100860595703125
1938
+ ],
1939
+ [
1940
+ "容量",
1941
+ 0.0100860595703125
1942
+ ],
1943
+ [
1944
+ "牌",
1945
+ 0.0081024169921875
1946
+ ],
1947
+ [
1948
+ "写字",
1949
+ 0.0076141357421875
1950
+ ],
1951
+ [
1952
+ "文本",
1953
+ 0.006771087646484375
1954
+ ],
1955
+ [
1956
+ "篇",
1957
+ 0.005069732666015625
1958
+ ],
1959
+ [
1960
+ "神",
1961
+ 0.004108428955078125
1962
+ ],
1963
+ [
1964
+ "英",
1965
+ 0.0037403106689453125
1966
+ ]
1967
+ ]
1968
+ },
1969
+ {
1970
+ "offset": [
1971
+ 63,
1972
+ 65
1973
+ ],
1974
+ "raw": "模型",
1975
+ "real_topk": [
1976
+ 0,
1977
+ 0.99365234375
1978
+ ],
1979
+ "pred_topk": [
1980
+ [
1981
+ "模型",
1982
+ 0.99365234375
1983
+ ],
1984
+ [
1985
+ "大",
1986
+ 0.0005245208740234375
1987
+ ],
1988
+ [
1989
+ "AI",
1990
+ 0.00036025047302246094
1991
+ ],
1992
+ [
1993
+ "框架",
1994
+ 0.00032806396484375
1995
+ ],
1996
+ [
1997
+ "智能",
1998
+ 0.0002987384796142578
1999
+ ],
2000
+ [
2001
+ "生成",
2002
+ 0.00028514862060546875
2003
+ ],
2004
+ [
2005
+ "预",
2006
+ 0.00022900104522705078
2007
+ ],
2008
+ [
2009
+ "模",
2010
+ 0.00021851062774658203
2011
+ ],
2012
+ [
2013
+ "助手",
2014
+ 0.0001989603042602539
2015
+ ],
2016
+ [
2017
+ "能力",
2018
+ 0.000186920166015625
2019
+ ]
2020
+ ]
2021
+ },
2022
+ {
2023
+ "offset": [
2024
+ 65,
2025
+ 67
2026
+ ],
2027
+ "raw": "分析",
2028
+ "real_topk": [
2029
+ 0,
2030
+ 0.048065185546875
2031
+ ],
2032
+ "pred_topk": [
2033
+ [
2034
+ "来",
2035
+ 0.1961669921875
2036
+ ],
2037
+ [
2038
+ "(",
2039
+ 0.141357421875
2040
+ ],
2041
+ [
2042
+ ",",
2043
+ 0.05889892578125
2044
+ ],
2045
+ [
2046
+ "和",
2047
+ 0.05279541015625
2048
+ ],
2049
+ [
2050
+ "分析",
2051
+ 0.048065185546875
2052
+ ],
2053
+ [
2054
+ "对",
2055
+ 0.0335693359375
2056
+ ],
2057
+ [
2058
+ "生成",
2059
+ 0.0273895263671875
2060
+ ],
2061
+ [
2062
+ "进行",
2063
+ 0.0245513916015625
2064
+ ],
2065
+ [
2066
+ "从",
2067
+ 0.020355224609375
2068
+ ],
2069
+ [
2070
+ "、",
2071
+ 0.0156097412109375
2072
+ ]
2073
+ ]
2074
+ },
2075
+ {
2076
+ "offset": [
2077
+ 67,
2078
+ 69
2079
+ ],
2080
+ "raw": "文本",
2081
+ "real_topk": [
2082
+ 0,
2083
+ 0.1591796875
2084
+ ],
2085
+ "pred_topk": [
2086
+ [
2087
+ "文章",
2088
+ 0.29736328125
2089
+ ],
2090
+ [
2091
+ "文本",
2092
+ 0.1591796875
2093
+ ],
2094
+ [
2095
+ "你的",
2096
+ 0.03900146484375
2097
+ ],
2098
+ [
2099
+ "一篇文章",
2100
+ 0.029449462890625
2101
+ ],
2102
+ [
2103
+ "文字",
2104
+ 0.0255889892578125
2105
+ ],
2106
+ [
2107
+ "和",
2108
+ 0.0236663818359375
2109
+ ],
2110
+ [
2111
+ "你",
2112
+ 0.0222320556640625
2113
+ ],
2114
+ [
2115
+ "信息",
2116
+ 0.02154541015625
2117
+ ],
2118
+ [
2119
+ "文档",
2120
+ 0.0184326171875
2121
+ ],
2122
+ [
2123
+ "每",
2124
+ 0.01358795166015625
2125
+ ]
2126
+ ]
2127
+ },
2128
+ {
2129
+ "offset": [
2130
+ 69,
2131
+ 72
2132
+ ],
2133
+ "raw": "的信息",
2134
+ "real_topk": [
2135
+ 0,
2136
+ 0.0009860992431640625
2137
+ ],
2138
+ "pred_topk": [
2139
+ [
2140
+ ",",
2141
+ 0.46875
2142
+ ],
2143
+ [
2144
+ "并",
2145
+ 0.09979248046875
2146
+ ],
2147
+ [
2148
+ ",并",
2149
+ 0.09820556640625
2150
+ ],
2151
+ [
2152
+ "内容",
2153
+ 0.072998046875
2154
+ ],
2155
+ [
2156
+ "的",
2157
+ 0.037872314453125
2158
+ ],
2159
+ [
2160
+ "中的",
2161
+ 0.033416748046875
2162
+ ],
2163
+ [
2164
+ "信息",
2165
+ 0.0209197998046875
2166
+ ],
2167
+ [
2168
+ "、",
2169
+ 0.01554107666015625
2170
+ ],
2171
+ [
2172
+ "以",
2173
+ 0.00928497314453125
2174
+ ],
2175
+ [
2176
+ "和",
2177
+ 0.0081939697265625
2178
+ ]
2179
+ ]
2180
+ },
2181
+ {
2182
+ "offset": [
2183
+ 72,
2184
+ 74
2185
+ ],
2186
+ "raw": "密度",
2187
+ "real_topk": [
2188
+ 0,
2189
+ 0.11322021484375
2190
+ ],
2191
+ "pred_topk": [
2192
+ [
2193
+ "量",
2194
+ 0.371337890625
2195
+ ],
2196
+ [
2197
+ "熵",
2198
+ 0.11865234375
2199
+ ],
2200
+ [
2201
+ "密度",
2202
+ 0.11322021484375
2203
+ ],
2204
+ [
2205
+ "内容",
2206
+ 0.09991455078125
2207
+ ],
2208
+ [
2209
+ "含量",
2210
+ 0.06451416015625
2211
+ ],
2212
+ [
2213
+ ",",
2214
+ 0.031951904296875
2215
+ ],
2216
+ [
2217
+ "论",
2218
+ 0.01708984375
2219
+ ],
2220
+ [
2221
+ "流",
2222
+ 0.0106964111328125
2223
+ ],
2224
+ [
2225
+ "结构",
2226
+ 0.00989532470703125
2227
+ ],
2228
+ [
2229
+ "理论",
2230
+ 0.00974273681640625
2231
+ ]
2232
+ ]
2233
+ },
2234
+ {
2235
+ "offset": [
2236
+ 74,
2237
+ 75
2238
+ ],
2239
+ "raw": ",",
2240
+ "real_topk": [
2241
+ 0,
2242
+ 0.48828125
2243
+ ],
2244
+ "pred_topk": [
2245
+ [
2246
+ ",",
2247
+ 0.48828125
2248
+ ],
2249
+ [
2250
+ "和",
2251
+ 0.1466064453125
2252
+ ],
2253
+ [
2254
+ ",并",
2255
+ 0.144287109375
2256
+ ],
2257
+ [
2258
+ "、",
2259
+ 0.06207275390625
2260
+ ],
2261
+ [
2262
+ "。",
2263
+ 0.035919189453125
2264
+ ],
2265
+ [
2266
+ "并",
2267
+ 0.027984619140625
2268
+ ],
2269
+ [
2270
+ "(",
2271
+ 0.0228424072265625
2272
+ ],
2273
+ [
2274
+ "来",
2275
+ 0.01384735107421875
2276
+ ],
2277
+ [
2278
+ "与",
2279
+ 0.00595855712890625
2280
+ ],
2281
+ [
2282
+ "。\n\n",
2283
+ 0.005176544189453125
2284
+ ]
2285
+ ]
2286
+ },
2287
+ {
2288
+ "offset": [
2289
+ 75,
2290
+ 78
2291
+ ],
2292
+ "raw": "可视化",
2293
+ "real_topk": [
2294
+ 0,
2295
+ 3.5643577575683594e-05
2296
+ ],
2297
+ "pred_topk": [
2298
+ [
2299
+ "帮助",
2300
+ 0.07830810546875
2301
+ ],
2302
+ [
2303
+ "识别",
2304
+ 0.07586669921875
2305
+ ],
2306
+ [
2307
+ "找出",
2308
+ 0.0701904296875
2309
+ ],
2310
+ [
2311
+ "找到",
2312
+ 0.0316162109375
2313
+ ],
2314
+ [
2315
+ "将",
2316
+ 0.026641845703125
2317
+ ],
2318
+ [
2319
+ "然后",
2320
+ 0.0238800048828125
2321
+ ],
2322
+ [
2323
+ "自动",
2324
+ 0.0210723876953125
2325
+ ],
2326
+ [
2327
+ "以",
2328
+ 0.0186004638671875
2329
+ ],
2330
+ [
2331
+ "从而",
2332
+ 0.0171966552734375
2333
+ ],
2334
+ [
2335
+ "从",
2336
+ 0.01666259765625
2337
+ ]
2338
+ ]
2339
+ },
2340
+ {
2341
+ "offset": [
2342
+ 78,
2343
+ 80
2344
+ ],
2345
+ "raw": "展示",
2346
+ "real_topk": [
2347
+ 0,
2348
+ 0.004436492919921875
2349
+ ],
2350
+ "pred_topk": [
2351
+ [
2352
+ "出",
2353
+ 0.09637451171875
2354
+ ],
2355
+ [
2356
+ "信息",
2357
+ 0.049224853515625
2358
+ ],
2359
+ [
2360
+ "文章",
2361
+ 0.0455322265625
2362
+ ],
2363
+ [
2364
+ "地",
2365
+ 0.03955078125
2366
+ ],
2367
+ [
2368
+ "文本",
2369
+ 0.0360107421875
2370
+ ],
2371
+ [
2372
+ "并",
2373
+ 0.033843994140625
2374
+ ],
2375
+ [
2376
+ "各种",
2377
+ 0.0192718505859375
2378
+ ],
2379
+ [
2380
+ "关键",
2381
+ 0.018402099609375
2382
+ ],
2383
+ [
2384
+ "显示",
2385
+ 0.0166168212890625
2386
+ ],
2387
+ [
2388
+ "出来",
2389
+ 0.0157318115234375
2390
+ ]
2391
+ ]
2392
+ },
2393
+ {
2394
+ "offset": [
2395
+ 80,
2396
+ 82
2397
+ ],
2398
+ "raw": "哪里",
2399
+ "real_topk": [
2400
+ 0,
2401
+ 6.306171417236328e-05
2402
+ ],
2403
+ "pred_topk": [
2404
+ [
2405
+ "文章",
2406
+ 0.1353759765625
2407
+ ],
2408
+ [
2409
+ "文本",
2410
+ 0.1104736328125
2411
+ ],
2412
+ [
2413
+ "关键",
2414
+ 0.05731201171875
2415
+ ],
2416
+ [
2417
+ "信息",
2418
+ 0.055572509765625
2419
+ ],
2420
+ [
2421
+ "出",
2422
+ 0.04534912109375
2423
+ ],
2424
+ [
2425
+ "每个",
2426
+ 0.03424072265625
2427
+ ],
2428
+ [
2429
+ "不同",
2430
+ 0.022796630859375
2431
+ ],
2432
+ [
2433
+ "每",
2434
+ 0.0224456787109375
2435
+ ],
2436
+ [
2437
+ "关键词",
2438
+ 0.0204315185546875
2439
+ ],
2440
+ [
2441
+ "重要",
2442
+ 0.0181732177734375
2443
+ ]
2444
+ ]
2445
+ },
2446
+ {
2447
+ "offset": [
2448
+ 82,
2449
+ 85
2450
+ ],
2451
+ "raw": "更重要",
2452
+ "real_topk": [
2453
+ 0,
2454
+ 0.0026378631591796875
2455
+ ],
2456
+ "pred_topk": [
2457
+ [
2458
+ "是",
2459
+ 0.1968994140625
2460
+ ],
2461
+ [
2462
+ "有",
2463
+ 0.1396484375
2464
+ ],
2465
+ [
2466
+ "信息",
2467
+ 0.08209228515625
2468
+ ],
2469
+ [
2470
+ "最",
2471
+ 0.075927734375
2472
+ ],
2473
+ [
2474
+ "的信息",
2475
+ 0.0701904296875
2476
+ ],
2477
+ [
2478
+ "最重要",
2479
+ 0.037567138671875
2480
+ ],
2481
+ [
2482
+ "的",
2483
+ 0.027069091796875
2484
+ ],
2485
+ [
2486
+ "是最",
2487
+ 0.0231475830078125
2488
+ ],
2489
+ [
2490
+ "最有",
2491
+ 0.01494598388671875
2492
+ ],
2493
+ [
2494
+ "需要",
2495
+ 0.00949859619140625
2496
+ ]
2497
+ ]
2498
+ },
2499
+ {
2500
+ "offset": [
2501
+ 85,
2502
+ 88
2503
+ ],
2504
+ "raw": "。\n\n",
2505
+ "real_topk": [
2506
+ 0,
2507
+ 0.04656982421875
2508
+ ],
2509
+ "pred_topk": [
2510
+ [
2511
+ ",",
2512
+ 0.428466796875
2513
+ ],
2514
+ [
2515
+ "、",
2516
+ 0.240234375
2517
+ ],
2518
+ [
2519
+ "。",
2520
+ 0.11895751953125
2521
+ ],
2522
+ [
2523
+ "。\n\n",
2524
+ 0.04656982421875
2525
+ ],
2526
+ [
2527
+ "。\n",
2528
+ 0.0200347900390625
2529
+ ],
2530
+ [
2531
+ "?",
2532
+ 0.018524169921875
2533
+ ],
2534
+ [
2535
+ "哪里",
2536
+ 0.016357421875
2537
+ ],
2538
+ [
2539
+ "或",
2540
+ 0.0142059326171875
2541
+ ],
2542
+ [
2543
+ "(",
2544
+ 0.01273345947265625
2545
+ ],
2546
+ [
2547
+ "!",
2548
+ 0.006206512451171875
2549
+ ]
2550
+ ]
2551
+ },
2552
+ {
2553
+ "offset": [
2554
+ 88,
2555
+ 90
2556
+ ],
2557
+ "raw": "每个",
2558
+ "real_topk": [
2559
+ 0,
2560
+ 0.00038051605224609375
2561
+ ],
2562
+ "pred_topk": [
2563
+ [
2564
+ "###",
2565
+ 0.0660400390625
2566
+ ],
2567
+ [
2568
+ "Info",
2569
+ 0.03704833984375
2570
+ ],
2571
+ [
2572
+ "##",
2573
+ 0.032684326171875
2574
+ ],
2575
+ [
2576
+ "信息",
2577
+ 0.0302276611328125
2578
+ ],
2579
+ [
2580
+ "你",
2581
+ 0.0228118896484375
2582
+ ],
2583
+ [
2584
+ "#",
2585
+ 0.0221099853515625
2586
+ ],
2587
+ [
2588
+ "1",
2589
+ 0.0164337158203125
2590
+ ],
2591
+ [
2592
+ "在",
2593
+ 0.0142822265625
2594
+ ],
2595
+ [
2596
+ "它",
2597
+ 0.0138397216796875
2598
+ ],
2599
+ [
2600
+ "这个",
2601
+ 0.01320648193359375
2602
+ ]
2603
+ ]
2604
+ },
2605
+ {
2606
+ "offset": [
2607
+ 90,
2608
+ 91
2609
+ ],
2610
+ "raw": "字",
2611
+ "real_topk": [
2612
+ 0,
2613
+ 0.00963592529296875
2614
+ ],
2615
+ "pred_topk": [
2616
+ [
2617
+ "单词",
2618
+ 0.049713134765625
2619
+ ],
2620
+ [
2621
+ "信息",
2622
+ 0.043548583984375
2623
+ ],
2624
+ [
2625
+ "句子",
2626
+ 0.042205810546875
2627
+ ],
2628
+ [
2629
+ "词",
2630
+ 0.033905029296875
2631
+ ],
2632
+ [
2633
+ "文章",
2634
+ 0.02105712890625
2635
+ ],
2636
+ [
2637
+ "字母",
2638
+ 0.012969970703125
2639
+ ],
2640
+ [
2641
+ "关键词",
2642
+ 0.01171875
2643
+ ],
2644
+ [
2645
+ "文本",
2646
+ 0.01171875
2647
+ ],
2648
+ [
2649
+ "页面",
2650
+ 0.01136016845703125
2651
+ ],
2652
+ [
2653
+ "“",
2654
+ 0.00994873046875
2655
+ ]
2656
+ ]
2657
+ },
2658
+ {
2659
+ "offset": [
2660
+ 91,
2661
+ 94
2662
+ ],
2663
+ "raw": "的颜色",
2664
+ "real_topk": [
2665
+ 0,
2666
+ 0.0012521743774414062
2667
+ ],
2668
+ "pred_topk": [
2669
+ [
2670
+ "都",
2671
+ 0.184326171875
2672
+ ],
2673
+ [
2674
+ "的",
2675
+ 0.07806396484375
2676
+ ],
2677
+ [
2678
+ "、",
2679
+ 0.0733642578125
2680
+ ],
2681
+ [
2682
+ "都是",
2683
+ 0.0699462890625
2684
+ ],
2685
+ [
2686
+ "都有",
2687
+ 0.064697265625
2688
+ ],
2689
+ [
2690
+ "或",
2691
+ 0.02740478515625
2692
+ ],
2693
+ [
2694
+ ",",
2695
+ 0.0253448486328125
2696
+ ],
2697
+ [
2698
+ "在",
2699
+ 0.0166168212890625
2700
+ ],
2701
+ [
2702
+ "词",
2703
+ 0.0137786865234375
2704
+ ],
2705
+ [
2706
+ "都被",
2707
+ 0.0137786865234375
2708
+ ]
2709
+ ]
2710
+ },
2711
+ {
2712
+ "offset": [
2713
+ 94,
2714
+ 95
2715
+ ],
2716
+ "raw": "深",
2717
+ "real_topk": [
2718
+ 0,
2719
+ 0.05828857421875
2720
+ ],
2721
+ "pred_topk": [
2722
+ [
2723
+ "代表",
2724
+ 0.146484375
2725
+ ],
2726
+ [
2727
+ "深",
2728
+ 0.05828857421875
2729
+ ],
2730
+ [
2731
+ "都",
2732
+ 0.05145263671875
2733
+ ],
2734
+ [
2735
+ "表示",
2736
+ 0.046112060546875
2737
+ ],
2738
+ [
2739
+ "和",
2740
+ 0.040679931640625
2741
+ ],
2742
+ [
2743
+ "不同",
2744
+ 0.0394287109375
2745
+ ],
2746
+ [
2747
+ ",",
2748
+ 0.0293121337890625
2749
+ ],
2750
+ [
2751
+ "越",
2752
+ 0.0279693603515625
2753
+ ],
2754
+ [
2755
+ "都是",
2756
+ 0.0258636474609375
2757
+ ],
2758
+ [
2759
+ "、",
2760
+ 0.0211181640625
2761
+ ]
2762
+ ]
2763
+ },
2764
+ {
2765
+ "offset": [
2766
+ 95,
2767
+ 96
2768
+ ],
2769
+ "raw": "浅",
2770
+ "real_topk": [
2771
+ 0,
2772
+ 0.9951171875
2773
+ ],
2774
+ "pred_topk": [
2775
+ [
2776
+ "浅",
2777
+ 0.9951171875
2778
+ ],
2779
+ [
2780
+ "与",
2781
+ 0.0005855560302734375
2782
+ ],
2783
+ [
2784
+ "或",
2785
+ 0.0004634857177734375
2786
+ ],
2787
+ [
2788
+ "广",
2789
+ 0.0003724098205566406
2790
+ ],
2791
+ [
2792
+ "淡",
2793
+ 0.00022935867309570312
2794
+ ],
2795
+ [
2796
+ "淺",
2797
+ 0.00022590160369873047
2798
+ ],
2799
+ [
2800
+ "深",
2801
+ 0.00019931793212890625
2802
+ ],
2803
+ [
2804
+ "亮",
2805
+ 0.0001678466796875
2806
+ ],
2807
+ [
2808
+ "沉",
2809
+ 0.0001678466796875
2810
+ ],
2811
+ [
2812
+ "暗",
2813
+ 0.00012862682342529297
2814
+ ]
2815
+ ]
2816
+ },
2817
+ {
2818
+ "offset": [
2819
+ 96,
2820
+ 97
2821
+ ],
2822
+ "raw": ",",
2823
+ "real_topk": [
2824
+ 0,
2825
+ 0.050628662109375
2826
+ ],
2827
+ "pred_topk": [
2828
+ [
2829
+ "代表",
2830
+ 0.1767578125
2831
+ ],
2832
+ [
2833
+ "表示",
2834
+ 0.156005859375
2835
+ ],
2836
+ [
2837
+ ",",
2838
+ 0.050628662109375
2839
+ ],
2840
+ [
2841
+ "取决于",
2842
+ 0.045379638671875
2843
+ ],
2844
+ [
2845
+ "对应",
2846
+ 0.044677734375
2847
+ ],
2848
+ [
2849
+ "反映了",
2850
+ 0.04400634765625
2851
+ ],
2852
+ [
2853
+ "不同",
2854
+ 0.036468505859375
2855
+ ],
2856
+ [
2857
+ "和",
2858
+ 0.035919189453125
2859
+ ],
2860
+ [
2861
+ "反映",
2862
+ 0.032684326171875
2863
+ ],
2864
+ [
2865
+ "都",
2866
+ 0.026275634765625
2867
+ ]
2868
+ ]
2869
+ },
2870
+ {
2871
+ "offset": [
2872
+ 97,
2873
+ 99
2874
+ ],
2875
+ "raw": "表示",
2876
+ "real_topk": [
2877
+ 0,
2878
+ 0.0806884765625
2879
+ ],
2880
+ "pred_topk": [
2881
+ [
2882
+ "表示",
2883
+ 0.0806884765625
2884
+ ],
2885
+ [
2886
+ "代表",
2887
+ 0.06585693359375
2888
+ ],
2889
+ [
2890
+ "反映了",
2891
+ 0.0274505615234375
2892
+ ],
2893
+ [
2894
+ "从",
2895
+ 0.024993896484375
2896
+ ],
2897
+ [
2898
+ "说明",
2899
+ 0.024993896484375
2900
+ ],
2901
+ [
2902
+ "取决于",
2903
+ 0.0231170654296875
2904
+ ],
2905
+ [
2906
+ "对应",
2907
+ 0.0182952880859375
2908
+ ],
2909
+ [
2910
+ "反映",
2911
+ 0.0125732421875
2912
+ ],
2913
+ [
2914
+ "高",
2915
+ 0.01218414306640625
2916
+ ],
2917
+ [
2918
+ "越",
2919
+ 0.00978851318359375
2920
+ ]
2921
+ ]
2922
+ },
2923
+ {
2924
+ "offset": [
2925
+ 99,
2926
+ 100
2927
+ ],
2928
+ "raw": "它",
2929
+ "real_topk": [
2930
+ 0,
2931
+ 0.060150146484375
2932
+ ],
2933
+ "pred_topk": [
2934
+ [
2935
+ "信息",
2936
+ 0.16357421875
2937
+ ],
2938
+ [
2939
+ "其",
2940
+ 0.10723876953125
2941
+ ],
2942
+ [
2943
+ "该",
2944
+ 0.0703125
2945
+ ],
2946
+ [
2947
+ "它",
2948
+ 0.060150146484375
2949
+ ],
2950
+ [
2951
+ "它的",
2952
+ 0.035919189453125
2953
+ ],
2954
+ [
2955
+ "每个",
2956
+ 0.02178955078125
2957
+ ],
2958
+ [
2959
+ "它们",
2960
+ 0.021453857421875
2961
+ ],
2962
+ [
2963
+ "在",
2964
+ 0.0186309814453125
2965
+ ],
2966
+ [
2967
+ "文本",
2968
+ 0.017364501953125
2969
+ ],
2970
+ [
2971
+ "字",
2972
+ 0.016448974609375
2973
+ ]
2974
+ ]
2975
+ },
2976
+ {
2977
+ "offset": [
2978
+ 100,
2979
+ 102
2980
+ ],
2981
+ "raw": "承载",
2982
+ "real_topk": [
2983
+ 0,
2984
+ 0.0014190673828125
2985
+ ],
2986
+ "pred_topk": [
2987
+ [
2988
+ "在",
2989
+ 0.32373046875
2990
+ ],
2991
+ [
2992
+ "的重要性",
2993
+ 0.1787109375
2994
+ ],
2995
+ [
2996
+ "对",
2997
+ 0.052032470703125
2998
+ ],
2999
+ [
3000
+ "所",
3001
+ 0.0287322998046875
3002
+ ],
3003
+ [
3004
+ "包含",
3005
+ 0.0269927978515625
3006
+ ],
3007
+ [
3008
+ "的重要",
3009
+ 0.01715087890625
3010
+ ],
3011
+ [
3012
+ "提供的",
3013
+ 0.01422119140625
3014
+ ],
3015
+ [
3016
+ "有多少",
3017
+ 0.0119781494140625
3018
+ ],
3019
+ [
3020
+ "传达",
3021
+ 0.00977325439453125
3022
+ ],
3023
+ [
3024
+ "是否",
3025
+ 0.00917816162109375
3026
+ ]
3027
+ ]
3028
+ },
3029
+ {
3030
+ "offset": [
3031
+ 102,
3032
+ 105
3033
+ ],
3034
+ "raw": "的信息",
3035
+ "real_topk": [
3036
+ 0,
3037
+ 0.68408203125
3038
+ ],
3039
+ "pred_topk": [
3040
+ [
3041
+ "的信息",
3042
+ 0.68408203125
3043
+ ],
3044
+ [
3045
+ "了多少",
3046
+ 0.10992431640625
3047
+ ],
3048
+ [
3049
+ "了",
3050
+ 0.06878662109375
3051
+ ],
3052
+ [
3053
+ "的",
3054
+ 0.051910400390625
3055
+ ],
3056
+ [
3057
+ "着",
3058
+ 0.0168609619140625
3059
+ ],
3060
+ [
3061
+ "信息",
3062
+ 0.0144195556640625
3063
+ ],
3064
+ [
3065
+ "多少",
3066
+ 0.006916046142578125
3067
+ ],
3068
+ [
3069
+ "的知识",
3070
+ 0.005733489990234375
3071
+ ],
3072
+ [
3073
+ "的意义",
3074
+ 0.0031185150146484375
3075
+ ],
3076
+ [
3077
+ "的重要",
3078
+ 0.0028839111328125
3079
+ ]
3080
+ ]
3081
+ },
3082
+ {
3083
+ "offset": [
3084
+ 105,
3085
+ 106
3086
+ ],
3087
+ "raw": "量",
3088
+ "real_topk": [
3089
+ 0,
3090
+ 0.8857421875
3091
+ ],
3092
+ "pred_topk": [
3093
+ [
3094
+ "量",
3095
+ 0.8857421875
3096
+ ],
3097
+ [
3098
+ "密度",
3099
+ 0.030792236328125
3100
+ ],
3101
+ [
3102
+ "价值",
3103
+ 0.007312774658203125
3104
+ ],
3105
+ [
3106
+ "多少",
3107
+ 0.006977081298828125
3108
+ ],
3109
+ [
3110
+ "强度",
3111
+ 0.004871368408203125
3112
+ ],
3113
+ [
3114
+ "数量",
3115
+ 0.0031452178955078125
3116
+ ],
3117
+ [
3118
+ "值",
3119
+ 0.002864837646484375
3120
+ ],
3121
+ [
3122
+ "的",
3123
+ 0.002819061279296875
3124
+ ],
3125
+ [
3126
+ "重要",
3127
+ 0.0027751922607421875
3128
+ ],
3129
+ [
3130
+ "含量",
3131
+ 0.0021610260009765625
3132
+ ]
3133
+ ]
3134
+ },
3135
+ {
3136
+ "offset": [
3137
+ 106,
3138
+ 108
3139
+ ],
3140
+ "raw": "大小",
3141
+ "real_topk": [
3142
+ 0,
3143
+ 0.0728759765625
3144
+ ],
3145
+ "pred_topk": [
3146
+ [
3147
+ "。",
3148
+ 0.35302734375
3149
+ ],
3150
+ [
3151
+ "大小",
3152
+ 0.0728759765625
3153
+ ],
3154
+ [
3155
+ "。\n\n",
3156
+ 0.0673828125
3157
+ ],
3158
+ [
3159
+ ",",
3160
+ 0.0653076171875
3161
+ ],
3162
+ [
3163
+ "。\n",
3164
+ 0.04779052734375
3165
+ ],
3166
+ [
3167
+ "多少",
3168
+ 0.040863037109375
3169
+ ],
3170
+ [
3171
+ "有多",
3172
+ 0.03778076171875
3173
+ ],
3174
+ [
3175
+ "的",
3176
+ 0.035491943359375
3177
+ ],
3178
+ [
3179
+ ":",
3180
+ 0.030364990234375
3181
+ ],
3182
+ [
3183
+ "有多大",
3184
+ 0.024017333984375
3185
+ ]
3186
+ ]
3187
+ },
3188
+ {
3189
+ "offset": [
3190
+ 108,
3191
+ 109
3192
+ ],
3193
+ "raw": "。",
3194
+ "real_topk": [
3195
+ 0,
3196
+ 0.52978515625
3197
+ ],
3198
+ "pred_topk": [
3199
+ [
3200
+ "。",
3201
+ 0.52978515625
3202
+ ],
3203
+ [
3204
+ "。\n\n",
3205
+ 0.1470947265625
3206
+ ],
3207
+ [
3208
+ ",",
3209
+ 0.11822509765625
3210
+ ],
3211
+ [
3212
+ "。\n",
3213
+ 0.0775146484375
3214
+ ],
3215
+ [
3216
+ ":",
3217
+ 0.02679443359375
3218
+ ],
3219
+ [
3220
+ "\n\n",
3221
+ 0.0157470703125
3222
+ ],
3223
+ [
3224
+ ";",
3225
+ 0.0130615234375
3226
+ ],
3227
+ [
3228
+ "\n",
3229
+ 0.009857177734375
3230
+ ],
3231
+ [
3232
+ "(",
3233
+ 0.00843048095703125
3234
+ ],
3235
+ [
3236
+ ":\n\n",
3237
+ 0.005977630615234375
3238
+ ]
3239
+ ]
3240
+ },
3241
+ {
3242
+ "offset": [
3243
+ 109,
3244
+ 111
3245
+ ],
3246
+ "raw": "自己",
3247
+ "real_topk": [
3248
+ 0,
3249
+ 9.232759475708008e-05
3250
+ ],
3251
+ "pred_topk": [
3252
+ [
3253
+ "比如",
3254
+ 0.0638427734375
3255
+ ],
3256
+ [
3257
+ "例如",
3258
+ 0.022064208984375
3259
+ ],
3260
+ [
3261
+ "红色",
3262
+ 0.021728515625
3263
+ ],
3264
+ [
3265
+ "你",
3266
+ 0.0190277099609375
3267
+ ],
3268
+ [
3269
+ "深",
3270
+ 0.0178680419921875
3271
+ ],
3272
+ [
3273
+ "颜色",
3274
+ 0.0178680419921875
3275
+ ],
3276
+ [
3277
+ "信息",
3278
+ 0.0164031982421875
3279
+ ],
3280
+ [
3281
+ "如果",
3282
+ 0.0148162841796875
3283
+ ],
3284
+ [
3285
+ "最",
3286
+ 0.01458740234375
3287
+ ],
3288
+ [
3289
+ "高",
3290
+ 0.014251708984375
3291
+ ]
3292
+ ]
3293
+ },
3294
+ {
3295
+ "offset": [
3296
+ 111,
3297
+ 113
3298
+ ],
3299
+ "raw": "试试",
3300
+ "real_topk": [
3301
+ 0,
3302
+ 0.026519775390625
3303
+ ],
3304
+ "pred_topk": [
3305
+ [
3306
+ "动手",
3307
+ 0.0755615234375
3308
+ ],
3309
+ [
3310
+ "试试",
3311
+ 0.026519775390625
3312
+ ],
3313
+ [
3314
+ "输入",
3315
+ 0.0245208740234375
3316
+ ],
3317
+ [
3318
+ "选择",
3319
+ 0.0203399658203125
3320
+ ],
3321
+ [
3322
+ "写",
3323
+ 0.01971435546875
3324
+ ],
3325
+ [
3326
+ "随便",
3327
+ 0.018798828125
3328
+ ],
3329
+ [
3330
+ "设置",
3331
+ 0.0182342529296875
3332
+ ],
3333
+ [
3334
+ "先",
3335
+ 0.0182342529296875
3336
+ ],
3337
+ [
3338
+ "试",
3339
+ 0.017669677734375
3340
+ ],
3341
+ [
3342
+ "测试",
3343
+ 0.015838623046875
3344
+ ]
3345
+ ]
3346
+ },
3347
+ {
3348
+ "offset": [
3349
+ 113,
3350
+ 114
3351
+ ],
3352
+ "raw": "吧",
3353
+ "real_topk": [
3354
+ 0,
3355
+ 0.1336669921875
3356
+ ],
3357
+ "pred_topk": [
3358
+ [
3359
+ ",",
3360
+ 0.210205078125
3361
+ ],
3362
+ [
3363
+ "看",
3364
+ 0.146728515625
3365
+ ],
3366
+ [
3367
+ "吧",
3368
+ 0.1336669921875
3369
+ ],
3370
+ [
3371
+ "。",
3372
+ 0.06719970703125
3373
+ ],
3374
+ [
3375
+ "。\n\n",
3376
+ 0.055694580078125
3377
+ ],
3378
+ [
3379
+ "!",
3380
+ 0.04205322265625
3381
+ ],
3382
+ [
3383
+ "!\n\n",
3384
+ 0.0267333984375
3385
+ ],
3386
+ [
3387
+ "。\n",
3388
+ 0.0186614990234375
3389
+ ],
3390
+ [
3391
+ ":",
3392
+ 0.0180816650390625
3393
+ ],
3394
+ [
3395
+ "看看",
3396
+ 0.0164642333984375
3397
+ ]
3398
+ ]
3399
+ },
3400
+ {
3401
+ "offset": [
3402
+ 114,
3403
+ 115
3404
+ ],
3405
+ "raw": "!",
3406
+ "real_topk": [
3407
+ 0,
3408
+ 0.1365966796875
3409
+ ],
3410
+ "pred_topk": [
3411
+ [
3412
+ ",",
3413
+ 0.189697265625
3414
+ ],
3415
+ [
3416
+ "。\n\n",
3417
+ 0.16748046875
3418
+ ],
3419
+ [
3420
+ "。",
3421
+ 0.1409912109375
3422
+ ],
3423
+ [
3424
+ "!",
3425
+ 0.1365966796875
3426
+ ],
3427
+ [
3428
+ "!\n\n",
3429
+ 0.12841796875
3430
+ ],
3431
+ [
3432
+ "。\n",
3433
+ 0.067626953125
3434
+ ],
3435
+ [
3436
+ ":",
3437
+ 0.0260772705078125
3438
+ ],
3439
+ [
3440
+ "\n\n",
3441
+ 0.019989013671875
3442
+ ],
3443
+ [
3444
+ ":\n\n",
3445
+ 0.0139617919921875
3446
+ ],
3447
+ [
3448
+ ":\n",
3449
+ 0.01053619384765625
3450
+ ]
3451
+ ]
3452
+ }
3453
+ ]
3454
+ }
3455
+ }
data/demo/public/InfoRadar-intro.json ADDED
@@ -0,0 +1,3773 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "request": {
3
+ "text": "Tired of redundancy and fluff? Want key points at a glance? Or simply curious about the information-theoretic nature of language?\n\nTry InfoRadar. InfoRadar uses large language models to analyze text information density and visualizes where the important parts are.\n\nThe color intensity of each token indicates how much information it carries. Try it yourself!"
4
+ },
5
+ "result": {
6
+ "model": "qwen3.0-0.6b",
7
+ "bpe_strings": [
8
+ {
9
+ "offset": [
10
+ 0,
11
+ 1
12
+ ],
13
+ "raw": "T",
14
+ "real_topk": [
15
+ 0,
16
+ 0.001129150390625
17
+ ],
18
+ "pred_topk": [
19
+ [
20
+ "Human",
21
+ 0.054840087890625
22
+ ],
23
+ [
24
+ "The",
25
+ 0.031982421875
26
+ ],
27
+ [
28
+ "What",
29
+ 0.023223876953125
30
+ ],
31
+ [
32
+ "#",
33
+ 0.022857666015625
34
+ ],
35
+ [
36
+ "以下",
37
+ 0.020172119140625
38
+ ],
39
+ [
40
+ "Given",
41
+ 0.016204833984375
42
+ ],
43
+ [
44
+ "@",
45
+ 0.01558685302734375
46
+ ],
47
+ [
48
+ "###",
49
+ 0.01419830322265625
50
+ ],
51
+ [
52
+ "import",
53
+ 0.00945281982421875
54
+ ],
55
+ [
56
+ "Find",
57
+ 0.00894927978515625
58
+ ]
59
+ ]
60
+ },
61
+ {
62
+ "offset": [
63
+ 1,
64
+ 5
65
+ ],
66
+ "raw": "ired",
67
+ "real_topk": [
68
+ 0,
69
+ 0.0012292861938476562
70
+ ],
71
+ "pred_topk": [
72
+ [
73
+ "ính",
74
+ 0.03912353515625
75
+ ],
76
+ [
77
+ "ìm",
78
+ 0.016571044921875
79
+ ],
80
+ [
81
+ "ác",
82
+ 0.0111236572265625
83
+ ],
84
+ [
85
+ "ừ",
86
+ 0.0101318359375
87
+ ],
88
+ [
89
+ "rie",
90
+ 0.00959014892578125
91
+ ],
92
+ [
93
+ "urtle",
94
+ 0.00922393798828125
95
+ ],
96
+ [
97
+ "ic",
98
+ 0.0090789794921875
99
+ ],
100
+ [
101
+ "élé",
102
+ 0.00846099853515625
103
+ ],
104
+ [
105
+ "ổ",
106
+ 0.007354736328125
107
+ ],
108
+ [
109
+ "ất",
110
+ 0.007183074951171875
111
+ ]
112
+ ]
113
+ },
114
+ {
115
+ "offset": [
116
+ 5,
117
+ 8
118
+ ],
119
+ "raw": " of",
120
+ "real_topk": [
121
+ 0,
122
+ 0.7431640625
123
+ ],
124
+ "pred_topk": [
125
+ [
126
+ " of",
127
+ 0.7431640625
128
+ ],
129
+ [
130
+ "?",
131
+ 0.024658203125
132
+ ],
133
+ [
134
+ " to",
135
+ 0.024658203125
136
+ ],
137
+ [
138
+ " and",
139
+ 0.01495361328125
140
+ ],
141
+ [
142
+ "ness",
143
+ 0.01404571533203125
144
+ ],
145
+ [
146
+ ",",
147
+ 0.01043701171875
148
+ ],
149
+ [
150
+ " or",
151
+ 0.00788116455078125
152
+ ],
153
+ [
154
+ "Of",
155
+ 0.007175445556640625
156
+ ],
157
+ [
158
+ " from",
159
+ 0.006633758544921875
160
+ ],
161
+ [
162
+ " Of",
163
+ 0.005809783935546875
164
+ ]
165
+ ]
166
+ },
167
+ {
168
+ "offset": [
169
+ 8,
170
+ 19
171
+ ],
172
+ "raw": " redundancy",
173
+ "real_topk": [
174
+ 0,
175
+ 2.968311309814453e-05
176
+ ],
177
+ "pred_topk": [
178
+ [
179
+ " the",
180
+ 0.158935546875
181
+ ],
182
+ [
183
+ " being",
184
+ 0.0421142578125
185
+ ],
186
+ [
187
+ " waiting",
188
+ 0.0284881591796875
189
+ ],
190
+ [
191
+ " having",
192
+ 0.022186279296875
193
+ ],
194
+ [
195
+ " using",
196
+ 0.0170135498046875
197
+ ],
198
+ [
199
+ " your",
200
+ 0.0159912109375
201
+ ],
202
+ [
203
+ " getting",
204
+ 0.012451171875
205
+ ],
206
+ [
207
+ " dealing",
208
+ 0.01116180419921875
209
+ ],
210
+ [
211
+ " a",
212
+ 0.010986328125
213
+ ],
214
+ [
215
+ " working",
216
+ 0.010986328125
217
+ ]
218
+ ]
219
+ },
220
+ {
221
+ "offset": [
222
+ 19,
223
+ 23
224
+ ],
225
+ "raw": " and",
226
+ "real_topk": [
227
+ 0,
228
+ 0.0302886962890625
229
+ ],
230
+ "pred_topk": [
231
+ [
232
+ "?",
233
+ 0.50439453125
234
+ ],
235
+ [
236
+ ",",
237
+ 0.241943359375
238
+ ],
239
+ [
240
+ "?\n",
241
+ 0.061187744140625
242
+ ],
243
+ [
244
+ " in",
245
+ 0.059295654296875
246
+ ],
247
+ [
248
+ "?\n\n",
249
+ 0.03594970703125
250
+ ],
251
+ [
252
+ " and",
253
+ 0.0302886962890625
254
+ ],
255
+ [
256
+ ".",
257
+ 0.007480621337890625
258
+ ],
259
+ [
260
+ " among",
261
+ 0.00490570068359375
262
+ ],
263
+ [
264
+ " for",
265
+ 0.0029296875
266
+ ],
267
+ [
268
+ " while",
269
+ 0.0028839111328125
270
+ ]
271
+ ]
272
+ },
273
+ {
274
+ "offset": [
275
+ 23,
276
+ 26
277
+ ],
278
+ "raw": " fl",
279
+ "real_topk": [
280
+ 0,
281
+ 4.827976226806641e-06
282
+ ],
283
+ "pred_topk": [
284
+ [
285
+ " un",
286
+ 0.07135009765625
287
+ ],
288
+ [
289
+ " complexity",
290
+ 0.047515869140625
291
+ ],
292
+ [
293
+ " ineff",
294
+ 0.041290283203125
295
+ ],
296
+ [
297
+ " unclear",
298
+ 0.03643798828125
299
+ ],
300
+ [
301
+ " lack",
302
+ 0.03265380859375
303
+ ],
304
+ [
305
+ " stress",
306
+ 0.022796630859375
307
+ ],
308
+ [
309
+ " repet",
310
+ 0.0147247314453125
311
+ ],
312
+ [
313
+ " unnecessary",
314
+ 0.01383209228515625
315
+ ],
316
+ [
317
+ " complicated",
318
+ 0.01201629638671875
319
+ ],
320
+ [
321
+ " cumbersome",
322
+ 0.0116424560546875
323
+ ]
324
+ ]
325
+ },
326
+ {
327
+ "offset": [
328
+ 26,
329
+ 29
330
+ ],
331
+ "raw": "uff",
332
+ "real_topk": [
333
+ 0,
334
+ 0.54638671875
335
+ ],
336
+ "pred_topk": [
337
+ [
338
+ "uff",
339
+ 0.54638671875
340
+ ],
341
+ [
342
+ "uk",
343
+ 0.1640625
344
+ ],
345
+ [
346
+ "abb",
347
+ 0.0594482421875
348
+ ],
349
+ [
350
+ "ak",
351
+ 0.0576171875
352
+ ],
353
+ [
354
+ "acc",
355
+ 0.045562744140625
356
+ ],
357
+ [
358
+ "ab",
359
+ 0.03387451171875
360
+ ],
361
+ [
362
+ "ound",
363
+ 0.01245880126953125
364
+ ],
365
+ [
366
+ "ailing",
367
+ 0.006214141845703125
368
+ ],
369
+ [
370
+ "apping",
371
+ 0.0061187744140625
372
+ ],
373
+ [
374
+ "abby",
375
+ 0.005035400390625
376
+ ]
377
+ ]
378
+ },
379
+ {
380
+ "offset": [
381
+ 29,
382
+ 30
383
+ ],
384
+ "raw": "?",
385
+ "real_topk": [
386
+ 0,
387
+ 0.1287841796875
388
+ ],
389
+ "pred_topk": [
390
+ [
391
+ " in",
392
+ 0.51708984375
393
+ ],
394
+ [
395
+ "?",
396
+ 0.1287841796875
397
+ ],
398
+ [
399
+ "ing",
400
+ 0.0987548828125
401
+ ],
402
+ [
403
+ "iness",
404
+ 0.0987548828125
405
+ ],
406
+ [
407
+ "?\n",
408
+ 0.0438232421875
409
+ ],
410
+ [
411
+ ",",
412
+ 0.0116119384765625
413
+ ],
414
+ [
415
+ "?\n\n",
416
+ 0.008758544921875
417
+ ],
418
+ [
419
+ "ness",
420
+ 0.008758544921875
421
+ ],
422
+ [
423
+ " that",
424
+ 0.0076141357421875
425
+ ],
426
+ [
427
+ ".",
428
+ 0.0040130615234375
429
+ ]
430
+ ]
431
+ },
432
+ {
433
+ "offset": [
434
+ 30,
435
+ 35
436
+ ],
437
+ "raw": " Want",
438
+ "real_topk": [
439
+ 0,
440
+ 0.08154296875
441
+ ],
442
+ "pred_topk": [
443
+ [
444
+ " Want",
445
+ 0.08154296875
446
+ ],
447
+ [
448
+ " You",
449
+ 0.04296875
450
+ ],
451
+ [
452
+ " Look",
453
+ 0.03912353515625
454
+ ],
455
+ [
456
+ " Find",
457
+ 0.029541015625
458
+ ],
459
+ [
460
+ " If",
461
+ 0.0281829833984375
462
+ ],
463
+ [
464
+ " Get",
465
+ 0.026885986328125
466
+ ],
467
+ [
468
+ " The",
469
+ 0.02606201171875
470
+ ],
471
+ [
472
+ " This",
473
+ 0.0237274169921875
474
+ ],
475
+ [
476
+ " We",
477
+ 0.0233612060546875
478
+ ],
479
+ [
480
+ " Here",
481
+ 0.019989013671875
482
+ ]
483
+ ]
484
+ },
485
+ {
486
+ "offset": [
487
+ 35,
488
+ 39
489
+ ],
490
+ "raw": " key",
491
+ "real_topk": [
492
+ 0,
493
+ 4.5299530029296875e-06
494
+ ],
495
+ "pred_topk": [
496
+ [
497
+ " to",
498
+ 0.446533203125
499
+ ],
500
+ [
501
+ " a",
502
+ 0.1920166015625
503
+ ],
504
+ [
505
+ " something",
506
+ 0.099609375
507
+ ],
508
+ [
509
+ " some",
510
+ 0.041534423828125
511
+ ],
512
+ [
513
+ " more",
514
+ 0.0229339599609375
515
+ ],
516
+ [
517
+ " an",
518
+ 0.0152740478515625
519
+ ],
520
+ [
521
+ " your",
522
+ 0.01171112060546875
523
+ ],
524
+ [
525
+ "ing",
526
+ 0.0106658935546875
527
+ ],
528
+ [
529
+ " the",
530
+ 0.0081787109375
531
+ ],
532
+ [
533
+ " things",
534
+ 0.0074462890625
535
+ ]
536
+ ]
537
+ },
538
+ {
539
+ "offset": [
540
+ 39,
541
+ 46
542
+ ],
543
+ "raw": " points",
544
+ "real_topk": [
545
+ 0,
546
+ 0.0008654594421386719
547
+ ],
548
+ "pred_topk": [
549
+ [
550
+ " take",
551
+ 0.1400146484375
552
+ ],
553
+ [
554
+ "notes",
555
+ 0.0548095703125
556
+ ],
557
+ [
558
+ " insights",
559
+ 0.053955078125
560
+ ],
561
+ [
562
+ " details",
563
+ 0.051483154296875
564
+ ],
565
+ [
566
+ ",",
567
+ 0.03948974609375
568
+ ],
569
+ [
570
+ " information",
571
+ 0.0343017578125
572
+ ],
573
+ [
574
+ " terms",
575
+ 0.033782958984375
576
+ ],
577
+ [
578
+ " results",
579
+ 0.022491455078125
580
+ ],
581
+ [
582
+ " things",
583
+ 0.0221405029296875
584
+ ],
585
+ [
586
+ " performance",
587
+ 0.0201568603515625
588
+ ]
589
+ ]
590
+ },
591
+ {
592
+ "offset": [
593
+ 46,
594
+ 49
595
+ ],
596
+ "raw": " at",
597
+ "real_topk": [
598
+ 0,
599
+ 0.0007548332214355469
600
+ ],
601
+ "pred_topk": [
602
+ [
603
+ " in",
604
+ 0.2666015625
605
+ ],
606
+ [
607
+ " that",
608
+ 0.1112060546875
609
+ ],
610
+ [
611
+ " out",
612
+ 0.0826416015625
613
+ ],
614
+ [
615
+ " to",
616
+ 0.0706787109375
617
+ ],
618
+ [
619
+ ",",
620
+ 0.055023193359375
621
+ ],
622
+ [
623
+ " and",
624
+ 0.0533447265625
625
+ ],
626
+ [
627
+ "?",
628
+ 0.039642333984375
629
+ ],
630
+ [
631
+ " for",
632
+ 0.0255889892578125
633
+ ],
634
+ [
635
+ " just",
636
+ 0.01678466796875
637
+ ],
638
+ [
639
+ "?\n",
640
+ 0.0165252685546875
641
+ ]
642
+ ]
643
+ },
644
+ {
645
+ "offset": [
646
+ 49,
647
+ 51
648
+ ],
649
+ "raw": " a",
650
+ "real_topk": [
651
+ 0,
652
+ 0.47216796875
653
+ ],
654
+ "pred_topk": [
655
+ [
656
+ " a",
657
+ 0.47216796875
658
+ ],
659
+ [
660
+ " your",
661
+ 0.264892578125
662
+ ],
663
+ [
664
+ " the",
665
+ 0.1138916015625
666
+ ],
667
+ [
668
+ " every",
669
+ 0.09149169921875
670
+ ],
671
+ [
672
+ " their",
673
+ 0.00812530517578125
674
+ ],
675
+ [
676
+ " work",
677
+ 0.006526947021484375
678
+ ],
679
+ [
680
+ " speed",
681
+ 0.00441741943359375
682
+ ],
683
+ [
684
+ " ",
685
+ 0.003131866455078125
686
+ ],
687
+ [
688
+ " each",
689
+ 0.003131866455078125
690
+ ],
691
+ [
692
+ " just",
693
+ 0.00255584716796875
694
+ ]
695
+ ]
696
+ },
697
+ {
698
+ "offset": [
699
+ 51,
700
+ 58
701
+ ],
702
+ "raw": " glance",
703
+ "real_topk": [
704
+ 0,
705
+ 0.9375
706
+ ],
707
+ "pred_topk": [
708
+ [
709
+ " glance",
710
+ 0.9375
711
+ ],
712
+ [
713
+ " moment",
714
+ 0.01515960693359375
715
+ ],
716
+ [
717
+ " click",
718
+ 0.01198577880859375
719
+ ],
720
+ [
721
+ " time",
722
+ 0.01009368896484375
723
+ ],
724
+ [
725
+ " Gl",
726
+ 0.0022525787353515625
727
+ ],
728
+ [
729
+ " fast",
730
+ 0.0014543533325195312
731
+ ],
732
+ [
733
+ " high",
734
+ 0.0010156631469726562
735
+ ],
736
+ [
737
+ " glimpse",
738
+ 0.0008959770202636719
739
+ ],
740
+ [
741
+ " minimum",
742
+ 0.0007786750793457031
743
+ ],
744
+ [
745
+ " minute",
746
+ 0.0007662773132324219
747
+ ]
748
+ ]
749
+ },
750
+ {
751
+ "offset": [
752
+ 58,
753
+ 59
754
+ ],
755
+ "raw": "?",
756
+ "real_topk": [
757
+ 0,
758
+ 0.386474609375
759
+ ],
760
+ "pred_topk": [
761
+ [
762
+ "?",
763
+ 0.386474609375
764
+ ],
765
+ [
766
+ " to",
767
+ 0.1561279296875
768
+ ],
769
+ [
770
+ "?\n",
771
+ 0.0947265625
772
+ ],
773
+ [
774
+ " for",
775
+ 0.0548095703125
776
+ ],
777
+ [
778
+ "?\n\n",
779
+ 0.05230712890625
780
+ ],
781
+ [
782
+ " that",
783
+ 0.033233642578125
784
+ ],
785
+ [
786
+ " in",
787
+ 0.0267181396484375
788
+ ],
789
+ [
790
+ " instead",
791
+ 0.0192413330078125
792
+ ],
793
+ [
794
+ " and",
795
+ 0.018646240234375
796
+ ],
797
+ [
798
+ ",",
799
+ 0.01751708984375
800
+ ]
801
+ ]
802
+ },
803
+ {
804
+ "offset": [
805
+ 59,
806
+ 62
807
+ ],
808
+ "raw": " Or",
809
+ "real_topk": [
810
+ 0,
811
+ 0.004077911376953125
812
+ ],
813
+ "pred_topk": [
814
+ [
815
+ " Look",
816
+ 0.1019287109375
817
+ ],
818
+ [
819
+ " Then",
820
+ 0.08062744140625
821
+ ],
822
+ [
823
+ " This",
824
+ 0.04052734375
825
+ ],
826
+ [
827
+ " You",
828
+ 0.039276123046875
829
+ ],
830
+ [
831
+ " The",
832
+ 0.0380859375
833
+ ],
834
+ [
835
+ " If",
836
+ 0.03411865234375
837
+ ],
838
+ [
839
+ " Want",
840
+ 0.03411865234375
841
+ ],
842
+ [
843
+ " Get",
844
+ 0.03155517578125
845
+ ],
846
+ [
847
+ " Use",
848
+ 0.0261688232421875
849
+ ],
850
+ [
851
+ " Here",
852
+ 0.0249786376953125
853
+ ]
854
+ ]
855
+ },
856
+ {
857
+ "offset": [
858
+ 62,
859
+ 69
860
+ ],
861
+ "raw": " simply",
862
+ "real_topk": [
863
+ 0,
864
+ 0.04095458984375
865
+ ],
866
+ "pred_topk": [
867
+ [
868
+ " just",
869
+ 0.228515625
870
+ ],
871
+ [
872
+ " want",
873
+ 0.06646728515625
874
+ ],
875
+ [
876
+ " a",
877
+ 0.055999755859375
878
+ ],
879
+ [
880
+ " need",
881
+ 0.047149658203125
882
+ ],
883
+ [
884
+ " do",
885
+ 0.04095458984375
886
+ ],
887
+ [
888
+ " simply",
889
+ 0.04095458984375
890
+ ],
891
+ [
892
+ " maybe",
893
+ 0.036163330078125
894
+ ],
895
+ [
896
+ " are",
897
+ 0.03240966796875
898
+ ],
899
+ [
900
+ ",",
901
+ 0.020599365234375
902
+ ],
903
+ [
904
+ " something",
905
+ 0.0178985595703125
906
+ ]
907
+ ]
908
+ },
909
+ {
910
+ "offset": [
911
+ 69,
912
+ 77
913
+ ],
914
+ "raw": " curious",
915
+ "real_topk": [
916
+ 0,
917
+ 0.0036563873291015625
918
+ ],
919
+ "pred_topk": [
920
+ [
921
+ " want",
922
+ 0.323974609375
923
+ ],
924
+ [
925
+ " a",
926
+ 0.11920166015625
927
+ ],
928
+ [
929
+ " to",
930
+ 0.0689697265625
931
+ ],
932
+ [
933
+ " need",
934
+ 0.04815673828125
935
+ ],
936
+ [
937
+ " have",
938
+ 0.02008056640625
939
+ ],
940
+ [
941
+ " do",
942
+ 0.0156402587890625
943
+ ],
944
+ [
945
+ " more",
946
+ 0.01538848876953125
947
+ ],
948
+ [
949
+ " looking",
950
+ 0.01337432861328125
951
+ ],
952
+ [
953
+ " get",
954
+ 0.0131683349609375
955
+ ],
956
+ [
957
+ ",",
958
+ 0.01256561279296875
959
+ ]
960
+ ]
961
+ },
962
+ {
963
+ "offset": [
964
+ 77,
965
+ 83
966
+ ],
967
+ "raw": " about",
968
+ "real_topk": [
969
+ 0,
970
+ 0.48046875
971
+ ],
972
+ "pred_topk": [
973
+ [
974
+ " about",
975
+ 0.48046875
976
+ ],
977
+ [
978
+ " to",
979
+ 0.156005859375
980
+ ],
981
+ [
982
+ "?",
983
+ 0.0875244140625
984
+ ],
985
+ [
986
+ " as",
987
+ 0.047576904296875
988
+ ],
989
+ [
990
+ " what",
991
+ 0.033721923828125
992
+ ],
993
+ [
994
+ " and",
995
+ 0.0250701904296875
996
+ ],
997
+ [
998
+ " of",
999
+ 0.0224761962890625
1000
+ ],
1001
+ [
1002
+ " how",
1003
+ 0.022125244140625
1004
+ ],
1005
+ [
1006
+ ",",
1007
+ 0.0175018310546875
1008
+ ],
1009
+ [
1010
+ " on",
1011
+ 0.0142822265625
1012
+ ]
1013
+ ]
1014
+ },
1015
+ {
1016
+ "offset": [
1017
+ 83,
1018
+ 87
1019
+ ],
1020
+ "raw": " the",
1021
+ "real_topk": [
1022
+ 0,
1023
+ 0.235107421875
1024
+ ],
1025
+ "pred_topk": [
1026
+ [
1027
+ " the",
1028
+ 0.235107421875
1029
+ ],
1030
+ [
1031
+ " how",
1032
+ 0.09503173828125
1033
+ ],
1034
+ [
1035
+ " what",
1036
+ 0.07171630859375
1037
+ ],
1038
+ [
1039
+ " a",
1040
+ 0.06951904296875
1041
+ ],
1042
+ [
1043
+ " your",
1044
+ 0.060394287109375
1045
+ ],
1046
+ [
1047
+ " some",
1048
+ 0.0184173583984375
1049
+ ],
1050
+ [
1051
+ " something",
1052
+ 0.01812744140625
1053
+ ],
1054
+ [
1055
+ " our",
1056
+ 0.0160064697265625
1057
+ ],
1058
+ [
1059
+ " all",
1060
+ 0.01551055908203125
1061
+ ],
1062
+ [
1063
+ " why",
1064
+ 0.0150299072265625
1065
+ ]
1066
+ ]
1067
+ },
1068
+ {
1069
+ "offset": [
1070
+ 87,
1071
+ 99
1072
+ ],
1073
+ "raw": " information",
1074
+ "real_topk": [
1075
+ 0,
1076
+ 0.002574920654296875
1077
+ ],
1078
+ "pred_topk": [
1079
+ [
1080
+ " subject",
1081
+ 0.047088623046875
1082
+ ],
1083
+ [
1084
+ " topic",
1085
+ 0.045654296875
1086
+ ],
1087
+ [
1088
+ " world",
1089
+ 0.038421630859375
1090
+ ],
1091
+ [
1092
+ " latest",
1093
+ 0.032867431640625
1094
+ ],
1095
+ [
1096
+ " key",
1097
+ 0.0190277099609375
1098
+ ],
1099
+ [
1100
+ " industry",
1101
+ 0.0122833251953125
1102
+ ],
1103
+ [
1104
+ " topics",
1105
+ 0.0122833251953125
1106
+ ],
1107
+ [
1108
+ " most",
1109
+ 0.01190948486328125
1110
+ ],
1111
+ [
1112
+ " content",
1113
+ 0.01100921630859375
1114
+ ],
1115
+ [
1116
+ " process",
1117
+ 0.01050567626953125
1118
+ ]
1119
+ ]
1120
+ },
1121
+ {
1122
+ "offset": [
1123
+ 99,
1124
+ 103
1125
+ ],
1126
+ "raw": "-the",
1127
+ "real_topk": [
1128
+ 0,
1129
+ 3.802776336669922e-05
1130
+ ],
1131
+ "pred_topk": [
1132
+ [
1133
+ " you",
1134
+ 0.315673828125
1135
+ ],
1136
+ [
1137
+ "?",
1138
+ 0.09625244140625
1139
+ ],
1140
+ [
1141
+ " in",
1142
+ 0.0849609375
1143
+ ],
1144
+ [
1145
+ " that",
1146
+ 0.059295654296875
1147
+ ],
1148
+ [
1149
+ " we",
1150
+ 0.053985595703125
1151
+ ],
1152
+ [
1153
+ " on",
1154
+ 0.032745361328125
1155
+ ],
1156
+ [
1157
+ " presented",
1158
+ 0.021820068359375
1159
+ ],
1160
+ [
1161
+ " available",
1162
+ 0.0175323486328125
1163
+ ],
1164
+ [
1165
+ " contained",
1166
+ 0.0169830322265625
1167
+ ],
1168
+ [
1169
+ " and",
1170
+ 0.01430511474609375
1171
+ ]
1172
+ ]
1173
+ },
1174
+ {
1175
+ "offset": [
1176
+ 103,
1177
+ 107
1178
+ ],
1179
+ "raw": "oret",
1180
+ "real_topk": [
1181
+ 0,
1182
+ 0.8212890625
1183
+ ],
1184
+ "pred_topk": [
1185
+ [
1186
+ "oret",
1187
+ 0.8212890625
1188
+ ],
1189
+ [
1190
+ "ory",
1191
+ 0.102783203125
1192
+ ],
1193
+ [
1194
+ "oretical",
1195
+ 0.0643310546875
1196
+ ],
1197
+ [
1198
+ "or",
1199
+ 0.0028705596923828125
1200
+ ],
1201
+ [
1202
+ "ories",
1203
+ 0.0013561248779296875
1204
+ ],
1205
+ [
1206
+ "ology",
1207
+ 0.0009036064147949219
1208
+ ],
1209
+ [
1210
+ "ological",
1211
+ 0.00067138671875
1212
+ ],
1213
+ [
1214
+ "o",
1215
+ 0.0005564689636230469
1216
+ ],
1217
+ [
1218
+ "orem",
1219
+ 0.0004987716674804688
1220
+ ],
1221
+ [
1222
+ "ore",
1223
+ 0.0004687309265136719
1224
+ ]
1225
+ ]
1226
+ },
1227
+ {
1228
+ "offset": [
1229
+ 107,
1230
+ 109
1231
+ ],
1232
+ "raw": "ic",
1233
+ "real_topk": [
1234
+ 0,
1235
+ 0.98828125
1236
+ ],
1237
+ "pred_topk": [
1238
+ [
1239
+ "ic",
1240
+ 0.98828125
1241
+ ],
1242
+ [
1243
+ "ically",
1244
+ 0.005695343017578125
1245
+ ],
1246
+ [
1247
+ "ical",
1248
+ 0.0015811920166015625
1249
+ ],
1250
+ [
1251
+ "ics",
1252
+ 0.0015087127685546875
1253
+ ],
1254
+ [
1255
+ "ial",
1256
+ 0.0006098747253417969
1257
+ ],
1258
+ [
1259
+ "al",
1260
+ 0.0002791881561279297
1261
+ ],
1262
+ [
1263
+ "ropic",
1264
+ 0.0002791881561279297
1265
+ ],
1266
+ [
1267
+ "ica",
1268
+ 0.00018596649169921875
1269
+ ],
1270
+ [
1271
+ "ician",
1272
+ 0.00017750263214111328
1273
+ ],
1274
+ [
1275
+ "ian",
1276
+ 0.00016415119171142578
1277
+ ]
1278
+ ]
1279
+ },
1280
+ {
1281
+ "offset": [
1282
+ 109,
1283
+ 116
1284
+ ],
1285
+ "raw": " nature",
1286
+ "real_topk": [
1287
+ 0,
1288
+ 0.0105743408203125
1289
+ ],
1290
+ "pred_topk": [
1291
+ [
1292
+ " foundations",
1293
+ 0.31396484375
1294
+ ],
1295
+ [
1296
+ " approach",
1297
+ 0.051239013671875
1298
+ ],
1299
+ [
1300
+ " foundation",
1301
+ 0.029205322265625
1302
+ ],
1303
+ [
1304
+ " framework",
1305
+ 0.0249786376953125
1306
+ ],
1307
+ [
1308
+ " basis",
1309
+ 0.0203857421875
1310
+ ],
1311
+ [
1312
+ " definition",
1313
+ 0.0191497802734375
1314
+ ],
1315
+ [
1316
+ " approaches",
1317
+ 0.0185546875
1318
+ ],
1319
+ [
1320
+ " perspective",
1321
+ 0.016632080078125
1322
+ ],
1323
+ [
1324
+ " aspects",
1325
+ 0.014007568359375
1326
+ ],
1327
+ [
1328
+ " under",
1329
+ 0.0116119384765625
1330
+ ]
1331
+ ]
1332
+ },
1333
+ {
1334
+ "offset": [
1335
+ 116,
1336
+ 119
1337
+ ],
1338
+ "raw": " of",
1339
+ "real_topk": [
1340
+ 0,
1341
+ 0.9853515625
1342
+ ],
1343
+ "pred_topk": [
1344
+ [
1345
+ " of",
1346
+ 0.9853515625
1347
+ ],
1348
+ [
1349
+ " and",
1350
+ 0.0030879974365234375
1351
+ ],
1352
+ [
1353
+ " behind",
1354
+ 0.002681732177734375
1355
+ ],
1356
+ [
1357
+ "\n",
1358
+ 0.0018148422241210938
1359
+ ],
1360
+ [
1361
+ "?",
1362
+ 0.001190185546875
1363
+ ],
1364
+ [
1365
+ " underlying",
1366
+ 0.0007567405700683594
1367
+ ],
1368
+ [
1369
+ ",",
1370
+ 0.00042438507080078125
1371
+ ],
1372
+ [
1373
+ " that",
1374
+ 0.0002963542938232422
1375
+ ],
1376
+ [
1377
+ " under",
1378
+ 0.0002455711364746094
1379
+ ],
1380
+ [
1381
+ " (",
1382
+ 0.00023806095123291016
1383
+ ]
1384
+ ]
1385
+ },
1386
+ {
1387
+ "offset": [
1388
+ 119,
1389
+ 128
1390
+ ],
1391
+ "raw": " language",
1392
+ "real_topk": [
1393
+ 0,
1394
+ 0.004779815673828125
1395
+ ],
1396
+ "pred_topk": [
1397
+ [
1398
+ " the",
1399
+ 0.10882568359375
1400
+ ],
1401
+ [
1402
+ " your",
1403
+ 0.043975830078125
1404
+ ],
1405
+ [
1406
+ " information",
1407
+ 0.025848388671875
1408
+ ],
1409
+ [
1410
+ " machine",
1411
+ 0.0228118896484375
1412
+ ],
1413
+ [
1414
+ " data",
1415
+ 0.0207672119140625
1416
+ ],
1417
+ [
1418
+ " a",
1419
+ 0.0164337158203125
1420
+ ],
1421
+ [
1422
+ " statistical",
1423
+ 0.01593017578125
1424
+ ],
1425
+ [
1426
+ " quantum",
1427
+ 0.0140533447265625
1428
+ ],
1429
+ [
1430
+ " many",
1431
+ 0.0134124755859375
1432
+ ],
1433
+ [
1434
+ " our",
1435
+ 0.0124053955078125
1436
+ ]
1437
+ ]
1438
+ },
1439
+ {
1440
+ "offset": [
1441
+ 128,
1442
+ 131
1443
+ ],
1444
+ "raw": "?\n\n",
1445
+ "real_topk": [
1446
+ 0,
1447
+ 0.016571044921875
1448
+ ],
1449
+ "pred_topk": [
1450
+ [
1451
+ "?",
1452
+ 0.63134765625
1453
+ ],
1454
+ [
1455
+ " and",
1456
+ 0.07659912109375
1457
+ ],
1458
+ [
1459
+ "?\n",
1460
+ 0.059661865234375
1461
+ ],
1462
+ [
1463
+ ",",
1464
+ 0.03851318359375
1465
+ ],
1466
+ [
1467
+ " processing",
1468
+ 0.02093505859375
1469
+ ],
1470
+ [
1471
+ "?\n\n",
1472
+ 0.016571044921875
1473
+ ],
1474
+ [
1475
+ " learning",
1476
+ 0.0110321044921875
1477
+ ],
1478
+ [
1479
+ " in",
1480
+ 0.0078277587890625
1481
+ ],
1482
+ [
1483
+ " models",
1484
+ 0.006191253662109375
1485
+ ],
1486
+ [
1487
+ " acquisition",
1488
+ 0.00521087646484375
1489
+ ]
1490
+ ]
1491
+ },
1492
+ {
1493
+ "offset": [
1494
+ 131,
1495
+ 134
1496
+ ],
1497
+ "raw": "Try",
1498
+ "real_topk": [
1499
+ 0,
1500
+ 0.00353240966796875
1501
+ ],
1502
+ "pred_topk": [
1503
+ [
1504
+ "The",
1505
+ 0.07318115234375
1506
+ ],
1507
+ [
1508
+ "In",
1509
+ 0.05029296875
1510
+ ],
1511
+ [
1512
+ "This",
1513
+ 0.05029296875
1514
+ ],
1515
+ [
1516
+ "I",
1517
+ 0.030517578125
1518
+ ],
1519
+ [
1520
+ "We",
1521
+ 0.028656005859375
1522
+ ],
1523
+ [
1524
+ "If",
1525
+ 0.0245208740234375
1526
+ ],
1527
+ [
1528
+ "##",
1529
+ 0.0196990966796875
1530
+ ],
1531
+ [
1532
+ "Here",
1533
+ 0.0190887451171875
1534
+ ],
1535
+ [
1536
+ "Then",
1537
+ 0.0179443359375
1538
+ ],
1539
+ [
1540
+ "You",
1541
+ 0.01534271240234375
1542
+ ]
1543
+ ]
1544
+ },
1545
+ {
1546
+ "offset": [
1547
+ 134,
1548
+ 139
1549
+ ],
1550
+ "raw": " Info",
1551
+ "real_topk": [
1552
+ 0,
1553
+ 0.0002390146255493164
1554
+ ],
1555
+ "pred_topk": [
1556
+ [
1557
+ " this",
1558
+ 0.2386474609375
1559
+ ],
1560
+ [
1561
+ " the",
1562
+ 0.1640625
1563
+ ],
1564
+ [
1565
+ " our",
1566
+ 0.114501953125
1567
+ ],
1568
+ [
1569
+ " out",
1570
+ 0.041473388671875
1571
+ ],
1572
+ [
1573
+ " these",
1574
+ 0.039581298828125
1575
+ ],
1576
+ [
1577
+ " one",
1578
+ 0.03179931640625
1579
+ ],
1580
+ [
1581
+ " reading",
1582
+ 0.0247650146484375
1583
+ ],
1584
+ [
1585
+ " a",
1586
+ 0.021514892578125
1587
+ ],
1588
+ [
1589
+ " The",
1590
+ 0.0147857666015625
1591
+ ],
1592
+ [
1593
+ " using",
1594
+ 0.010009765625
1595
+ ]
1596
+ ]
1597
+ },
1598
+ {
1599
+ "offset": [
1600
+ 139,
1601
+ 140
1602
+ ],
1603
+ "raw": "R",
1604
+ "real_topk": [
1605
+ 0,
1606
+ 0.00589752197265625
1607
+ ],
1608
+ "pred_topk": [
1609
+ [
1610
+ "Q",
1611
+ 0.1260986328125
1612
+ ],
1613
+ [
1614
+ "Sci",
1615
+ 0.040313720703125
1616
+ ],
1617
+ [
1618
+ "Talk",
1619
+ 0.03289794921875
1620
+ ],
1621
+ [
1622
+ "T",
1623
+ 0.0233306884765625
1624
+ ],
1625
+ [
1626
+ "B",
1627
+ 0.0160369873046875
1628
+ ],
1629
+ [
1630
+ "S",
1631
+ 0.01554107666015625
1632
+ ],
1633
+ [
1634
+ "Learn",
1635
+ 0.01483154296875
1636
+ ],
1637
+ [
1638
+ "Quest",
1639
+ 0.01415252685546875
1640
+ ],
1641
+ [
1642
+ "L",
1643
+ 0.01248931884765625
1644
+ ],
1645
+ [
1646
+ "M",
1647
+ 0.0121002197265625
1648
+ ]
1649
+ ]
1650
+ },
1651
+ {
1652
+ "offset": [
1653
+ 140,
1654
+ 144
1655
+ ],
1656
+ "raw": "adar",
1657
+ "real_topk": [
1658
+ 0,
1659
+ 0.025390625
1660
+ ],
1661
+ "pred_topk": [
1662
+ [
1663
+ "ise",
1664
+ 0.049713134765625
1665
+ ],
1666
+ [
1667
+ "ogue",
1668
+ 0.038116455078125
1669
+ ],
1670
+ [
1671
+ "ush",
1672
+ 0.0274658203125
1673
+ ],
1674
+ [
1675
+ "adar",
1676
+ 0.025390625
1677
+ ],
1678
+ [
1679
+ ",",
1680
+ 0.024993896484375
1681
+ ],
1682
+ [
1683
+ "apid",
1684
+ 0.01947021484375
1685
+ ],
1686
+ [
1687
+ "ite",
1688
+ 0.0191650390625
1689
+ ],
1690
+ [
1691
+ "hythm",
1692
+ 0.0188751220703125
1693
+ ],
1694
+ [
1695
+ "age",
1696
+ 0.018585205078125
1697
+ ],
1698
+ [
1699
+ "ough",
1700
+ 0.0164031982421875
1701
+ ]
1702
+ ]
1703
+ },
1704
+ {
1705
+ "offset": [
1706
+ 144,
1707
+ 145
1708
+ ],
1709
+ "raw": ".",
1710
+ "real_topk": [
1711
+ 0,
1712
+ 0.066650390625
1713
+ ],
1714
+ "pred_topk": [
1715
+ [
1716
+ ",",
1717
+ 0.2476806640625
1718
+ ],
1719
+ [
1720
+ "'s",
1721
+ 0.092529296875
1722
+ ],
1723
+ [
1724
+ ".\n\n",
1725
+ 0.0816650390625
1726
+ ],
1727
+ [
1728
+ ".",
1729
+ 0.066650390625
1730
+ ],
1731
+ [
1732
+ "\n\n",
1733
+ 0.06561279296875
1734
+ ],
1735
+ [
1736
+ "!\n\n",
1737
+ 0.060699462890625
1738
+ ],
1739
+ [
1740
+ "’s",
1741
+ 0.050323486328125
1742
+ ],
1743
+ [
1744
+ " for",
1745
+ 0.03350830078125
1746
+ ],
1747
+ [
1748
+ ":",
1749
+ 0.0261077880859375
1750
+ ],
1751
+ [
1752
+ "!",
1753
+ 0.0245208740234375
1754
+ ]
1755
+ ]
1756
+ },
1757
+ {
1758
+ "offset": [
1759
+ 145,
1760
+ 150
1761
+ ],
1762
+ "raw": " Info",
1763
+ "real_topk": [
1764
+ 0,
1765
+ 0.02935791015625
1766
+ ],
1767
+ "pred_topk": [
1768
+ [
1769
+ " It",
1770
+ 0.1217041015625
1771
+ ],
1772
+ [
1773
+ " A",
1774
+ 0.061187744140625
1775
+ ],
1776
+ [
1777
+ " The",
1778
+ 0.06024169921875
1779
+ ],
1780
+ [
1781
+ " We",
1782
+ 0.04547119140625
1783
+ ],
1784
+ [
1785
+ " Learn",
1786
+ 0.032745361328125
1787
+ ],
1788
+ [
1789
+ " Our",
1790
+ 0.03125
1791
+ ],
1792
+ [
1793
+ " This",
1794
+ 0.02935791015625
1795
+ ],
1796
+ [
1797
+ " Info",
1798
+ 0.02935791015625
1799
+ ],
1800
+ [
1801
+ " Get",
1802
+ 0.025115966796875
1803
+ ],
1804
+ [
1805
+ " Read",
1806
+ 0.021820068359375
1807
+ ]
1808
+ ]
1809
+ },
1810
+ {
1811
+ "offset": [
1812
+ 150,
1813
+ 151
1814
+ ],
1815
+ "raw": "R",
1816
+ "real_topk": [
1817
+ 0,
1818
+ 0.99462890625
1819
+ ],
1820
+ "pred_topk": [
1821
+ [
1822
+ "R",
1823
+ 0.99462890625
1824
+ ],
1825
+ [
1826
+ " Radar",
1827
+ 0.0011281967163085938
1828
+ ],
1829
+ [
1830
+ "Rad",
1831
+ 0.0005764961242675781
1832
+ ],
1833
+ [
1834
+ " radar",
1835
+ 0.00025582313537597656
1836
+ ],
1837
+ [
1838
+ " R",
1839
+ 0.00020551681518554688
1840
+ ],
1841
+ [
1842
+ "RAD",
1843
+ 0.00018143653869628906
1844
+ ],
1845
+ [
1846
+ "Radio",
1847
+ 0.00014352798461914062
1848
+ ],
1849
+ [
1850
+ "-R",
1851
+ 9.864568710327148e-05
1852
+ ],
1853
+ [
1854
+ "Reader",
1855
+ 8.302927017211914e-05
1856
+ ],
1857
+ [
1858
+ "Rail",
1859
+ 6.67572021484375e-05
1860
+ ]
1861
+ ]
1862
+ },
1863
+ {
1864
+ "offset": [
1865
+ 151,
1866
+ 155
1867
+ ],
1868
+ "raw": "adar",
1869
+ "real_topk": [
1870
+ 0,
1871
+ 1
1872
+ ],
1873
+ "pred_topk": [
1874
+ [
1875
+ "adar",
1876
+ 1
1877
+ ],
1878
+ [
1879
+ "at",
1880
+ 3.0219554901123047e-05
1881
+ ],
1882
+ [
1883
+ "ader",
1884
+ 9.238719940185547e-06
1885
+ ],
1886
+ [
1887
+ "ater",
1888
+ 6.973743438720703e-06
1889
+ ],
1890
+ [
1891
+ "ider",
1892
+ 6.318092346191406e-06
1893
+ ],
1894
+ [
1895
+ "aptor",
1896
+ 5.781650543212891e-06
1897
+ ],
1898
+ [
1899
+ "azor",
1900
+ 2.682209014892578e-06
1901
+ ],
1902
+ [
1903
+ "ac",
1904
+ 2.6226043701171875e-06
1905
+ ],
1906
+ [
1907
+ "ation",
1908
+ 2.3245811462402344e-06
1909
+ ],
1910
+ [
1911
+ "ar",
1912
+ 2.2649765014648438e-06
1913
+ ]
1914
+ ]
1915
+ },
1916
+ {
1917
+ "offset": [
1918
+ 155,
1919
+ 160
1920
+ ],
1921
+ "raw": " uses",
1922
+ "real_topk": [
1923
+ 0,
1924
+ 0.0094146728515625
1925
+ ],
1926
+ "pred_topk": [
1927
+ [
1928
+ " is",
1929
+ 0.482666015625
1930
+ ],
1931
+ [
1932
+ " provides",
1933
+ 0.03961181640625
1934
+ ],
1935
+ [
1936
+ " offers",
1937
+ 0.026397705078125
1938
+ ],
1939
+ [
1940
+ "'s",
1941
+ 0.0240325927734375
1942
+ ],
1943
+ [
1944
+ " has",
1945
+ 0.019012451171875
1946
+ ],
1947
+ [
1948
+ " will",
1949
+ 0.0157623291015625
1950
+ ],
1951
+ [
1952
+ ",",
1953
+ 0.01369476318359375
1954
+ ],
1955
+ [
1956
+ "’s",
1957
+ 0.012664794921875
1958
+ ],
1959
+ [
1960
+ " brings",
1961
+ 0.0120849609375
1962
+ ],
1963
+ [
1964
+ " delivers",
1965
+ 0.0110015869140625
1966
+ ]
1967
+ ]
1968
+ },
1969
+ {
1970
+ "offset": [
1971
+ 160,
1972
+ 166
1973
+ ],
1974
+ "raw": " large",
1975
+ "real_topk": [
1976
+ 0,
1977
+ 0.0013360977172851562
1978
+ ],
1979
+ "pred_topk": [
1980
+ [
1981
+ " the",
1982
+ 0.159423828125
1983
+ ],
1984
+ [
1985
+ " a",
1986
+ 0.07891845703125
1987
+ ],
1988
+ [
1989
+ " machine",
1990
+ 0.06854248046875
1991
+ ],
1992
+ [
1993
+ " information",
1994
+ 0.047119140625
1995
+ ],
1996
+ [
1997
+ " AI",
1998
+ 0.045654296875
1999
+ ],
2000
+ [
2001
+ " data",
2002
+ 0.040924072265625
2003
+ ],
2004
+ [
2005
+ " natural",
2006
+ 0.023681640625
2007
+ ],
2008
+ [
2009
+ " advanced",
2010
+ 0.0225982666015625
2011
+ ],
2012
+ [
2013
+ " an",
2014
+ 0.01873779296875
2015
+ ],
2016
+ [
2017
+ " artificial",
2018
+ 0.0184478759765625
2019
+ ]
2020
+ ]
2021
+ },
2022
+ {
2023
+ "offset": [
2024
+ 166,
2025
+ 175
2026
+ ],
2027
+ "raw": " language",
2028
+ "real_topk": [
2029
+ 0,
2030
+ 0.246826171875
2031
+ ],
2032
+ "pred_topk": [
2033
+ [
2034
+ " language",
2035
+ 0.246826171875
2036
+ ],
2037
+ [
2038
+ "-scale",
2039
+ 0.1644287109375
2040
+ ],
2041
+ [
2042
+ " amounts",
2043
+ 0.12408447265625
2044
+ ],
2045
+ [
2046
+ " datasets",
2047
+ 0.039031982421875
2048
+ ],
2049
+ [
2050
+ ",",
2051
+ 0.036102294921875
2052
+ ],
2053
+ [
2054
+ " volumes",
2055
+ 0.0313720703125
2056
+ ],
2057
+ [
2058
+ " data",
2059
+ 0.029022216796875
2060
+ ],
2061
+ [
2062
+ " collections",
2063
+ 0.020904541015625
2064
+ ],
2065
+ [
2066
+ " quantities",
2067
+ 0.0190277099609375
2068
+ ],
2069
+ [
2070
+ " scale",
2071
+ 0.01873779296875
2072
+ ]
2073
+ ]
2074
+ },
2075
+ {
2076
+ "offset": [
2077
+ 175,
2078
+ 182
2079
+ ],
2080
+ "raw": " models",
2081
+ "real_topk": [
2082
+ 0,
2083
+ 0.982421875
2084
+ ],
2085
+ "pred_topk": [
2086
+ [
2087
+ " models",
2088
+ 0.982421875
2089
+ ],
2090
+ [
2091
+ " model",
2092
+ 0.00836944580078125
2093
+ ],
2094
+ [
2095
+ " programs",
2096
+ 0.0009098052978515625
2097
+ ],
2098
+ [
2099
+ " and",
2100
+ 0.0007662773132324219
2101
+ ],
2102
+ [
2103
+ "-model",
2104
+ 0.0006155967712402344
2105
+ ],
2106
+ [
2107
+ " platforms",
2108
+ 0.00045752525329589844
2109
+ ],
2110
+ [
2111
+ " AI",
2112
+ 0.00037932395935058594
2113
+ ],
2114
+ [
2115
+ " understanding",
2116
+ 0.0003046989440917969
2117
+ ],
2118
+ [
2119
+ " arts",
2120
+ 0.0003046989440917969
2121
+ ],
2122
+ [
2123
+ " modeling",
2124
+ 0.0002818107604980469
2125
+ ]
2126
+ ]
2127
+ },
2128
+ {
2129
+ "offset": [
2130
+ 182,
2131
+ 185
2132
+ ],
2133
+ "raw": " to",
2134
+ "real_topk": [
2135
+ 0,
2136
+ 0.497802734375
2137
+ ],
2138
+ "pred_topk": [
2139
+ [
2140
+ " to",
2141
+ 0.497802734375
2142
+ ],
2143
+ [
2144
+ " (",
2145
+ 0.16162109375
2146
+ ],
2147
+ [
2148
+ " like",
2149
+ 0.08251953125
2150
+ ],
2151
+ [
2152
+ ",",
2153
+ 0.04486083984375
2154
+ ],
2155
+ [
2156
+ " and",
2157
+ 0.044158935546875
2158
+ ],
2159
+ [
2160
+ " trained",
2161
+ 0.044158935546875
2162
+ ],
2163
+ [
2164
+ " such",
2165
+ 0.0167694091796875
2166
+ ],
2167
+ [
2168
+ " for",
2169
+ 0.01134490966796875
2170
+ ],
2171
+ [
2172
+ " with",
2173
+ 0.010009765625
2174
+ ],
2175
+ [
2176
+ " as",
2177
+ 0.009552001953125
2178
+ ]
2179
+ ]
2180
+ },
2181
+ {
2182
+ "offset": [
2183
+ 185,
2184
+ 193
2185
+ ],
2186
+ "raw": " analyze",
2187
+ "real_topk": [
2188
+ 0,
2189
+ 0.02435302734375
2190
+ ],
2191
+ "pred_topk": [
2192
+ [
2193
+ " generate",
2194
+ 0.10577392578125
2195
+ ],
2196
+ [
2197
+ " provide",
2198
+ 0.09478759765625
2199
+ ],
2200
+ [
2201
+ " extract",
2202
+ 0.050750732421875
2203
+ ],
2204
+ [
2205
+ " answer",
2206
+ 0.042724609375
2207
+ ],
2208
+ [
2209
+ " produce",
2210
+ 0.042724609375
2211
+ ],
2212
+ [
2213
+ " create",
2214
+ 0.038909912109375
2215
+ ],
2216
+ [
2217
+ " help",
2218
+ 0.030303955078125
2219
+ ],
2220
+ [
2221
+ " automatically",
2222
+ 0.02435302734375
2223
+ ],
2224
+ [
2225
+ " analyze",
2226
+ 0.02435302734375
2227
+ ],
2228
+ [
2229
+ " give",
2230
+ 0.0186767578125
2231
+ ]
2232
+ ]
2233
+ },
2234
+ {
2235
+ "offset": [
2236
+ 193,
2237
+ 198
2238
+ ],
2239
+ "raw": " text",
2240
+ "real_topk": [
2241
+ 0,
2242
+ 0.05267333984375
2243
+ ],
2244
+ "pred_topk": [
2245
+ [
2246
+ " and",
2247
+ 0.147705078125
2248
+ ],
2249
+ [
2250
+ " your",
2251
+ 0.11151123046875
2252
+ ],
2253
+ [
2254
+ " the",
2255
+ 0.10809326171875
2256
+ ],
2257
+ [
2258
+ " text",
2259
+ 0.05267333984375
2260
+ ],
2261
+ [
2262
+ ",",
2263
+ 0.029541015625
2264
+ ],
2265
+ [
2266
+ " news",
2267
+ 0.0281982421875
2268
+ ],
2269
+ [
2270
+ " a",
2271
+ 0.0212860107421875
2272
+ ],
2273
+ [
2274
+ " texts",
2275
+ 0.019989013671875
2276
+ ],
2277
+ [
2278
+ " thousands",
2279
+ 0.0160675048828125
2280
+ ],
2281
+ [
2282
+ " documents",
2283
+ 0.01557159423828125
2284
+ ]
2285
+ ]
2286
+ },
2287
+ {
2288
+ "offset": [
2289
+ 198,
2290
+ 210
2291
+ ],
2292
+ "raw": " information",
2293
+ "real_topk": [
2294
+ 0,
2295
+ 0.0003924369812011719
2296
+ ],
2297
+ "pred_topk": [
2298
+ [
2299
+ " and",
2300
+ 0.391845703125
2301
+ ],
2302
+ [
2303
+ ",",
2304
+ 0.18798828125
2305
+ ],
2306
+ [
2307
+ " for",
2308
+ 0.08746337890625
2309
+ ],
2310
+ [
2311
+ " in",
2312
+ 0.049041748046875
2313
+ ],
2314
+ [
2315
+ ".",
2316
+ 0.043975830078125
2317
+ ],
2318
+ [
2319
+ " data",
2320
+ 0.023529052734375
2321
+ ],
2322
+ [
2323
+ " from",
2324
+ 0.0211029052734375
2325
+ ],
2326
+ [
2327
+ " to",
2328
+ 0.0207672119140625
2329
+ ],
2330
+ [
2331
+ " on",
2332
+ 0.01593017578125
2333
+ ],
2334
+ [
2335
+ " content",
2336
+ 0.01543426513671875
2337
+ ]
2338
+ ]
2339
+ },
2340
+ {
2341
+ "offset": [
2342
+ 210,
2343
+ 218
2344
+ ],
2345
+ "raw": " density",
2346
+ "real_topk": [
2347
+ 0,
2348
+ 0.0027561187744140625
2349
+ ],
2350
+ "pred_topk": [
2351
+ [
2352
+ " and",
2353
+ 0.256103515625
2354
+ ],
2355
+ [
2356
+ ",",
2357
+ 0.1962890625
2358
+ ],
2359
+ [
2360
+ ".",
2361
+ 0.076904296875
2362
+ ],
2363
+ [
2364
+ " for",
2365
+ 0.0504150390625
2366
+ ],
2367
+ [
2368
+ " in",
2369
+ 0.045196533203125
2370
+ ],
2371
+ [
2372
+ "-the",
2373
+ 0.036895751953125
2374
+ ],
2375
+ [
2376
+ " to",
2377
+ 0.0241851806640625
2378
+ ],
2379
+ [
2380
+ " content",
2381
+ 0.0241851806640625
2382
+ ],
2383
+ [
2384
+ " on",
2385
+ 0.019744873046875
2386
+ ],
2387
+ [
2388
+ " about",
2389
+ 0.0188446044921875
2390
+ ]
2391
+ ]
2392
+ },
2393
+ {
2394
+ "offset": [
2395
+ 218,
2396
+ 222
2397
+ ],
2398
+ "raw": " and",
2399
+ "real_topk": [
2400
+ 0,
2401
+ 0.35888671875
2402
+ ],
2403
+ "pred_topk": [
2404
+ [
2405
+ " and",
2406
+ 0.35888671875
2407
+ ],
2408
+ [
2409
+ ",",
2410
+ 0.266845703125
2411
+ ],
2412
+ [
2413
+ ".",
2414
+ 0.1259765625
2415
+ ],
2416
+ [
2417
+ " (",
2418
+ 0.036102294921875
2419
+ ],
2420
+ [
2421
+ " in",
2422
+ 0.0290069580078125
2423
+ ],
2424
+ [
2425
+ " for",
2426
+ 0.0218963623046875
2427
+ ],
2428
+ [
2429
+ " to",
2430
+ 0.0212249755859375
2431
+ ],
2432
+ [
2433
+ ".\n\n",
2434
+ 0.01413726806640625
2435
+ ],
2436
+ [
2437
+ " across",
2438
+ 0.008575439453125
2439
+ ],
2440
+ [
2441
+ " at",
2442
+ 0.00688934326171875
2443
+ ]
2444
+ ]
2445
+ },
2446
+ {
2447
+ "offset": [
2448
+ 222,
2449
+ 229
2450
+ ],
2451
+ "raw": " visual",
2452
+ "real_topk": [
2453
+ 0,
2454
+ 0.0007801055908203125
2455
+ ],
2456
+ "pred_topk": [
2457
+ [
2458
+ " provide",
2459
+ 0.084716796875
2460
+ ],
2461
+ [
2462
+ " identify",
2463
+ 0.055572509765625
2464
+ ],
2465
+ [
2466
+ " extract",
2467
+ 0.044647216796875
2468
+ ],
2469
+ [
2470
+ " generate",
2471
+ 0.03643798828125
2472
+ ],
2473
+ [
2474
+ " summarize",
2475
+ 0.01861572265625
2476
+ ],
2477
+ [
2478
+ " provides",
2479
+ 0.0172119140625
2480
+ ],
2481
+ [
2482
+ " create",
2483
+ 0.01519012451171875
2484
+ ],
2485
+ [
2486
+ " produce",
2487
+ 0.0147247314453125
2488
+ ],
2489
+ [
2490
+ " the",
2491
+ 0.01146697998046875
2492
+ ],
2493
+ [
2494
+ " highlight",
2495
+ 0.01129150390625
2496
+ ]
2497
+ ]
2498
+ },
2499
+ {
2500
+ "offset": [
2501
+ 229,
2502
+ 233
2503
+ ],
2504
+ "raw": "izes",
2505
+ "real_topk": [
2506
+ 0,
2507
+ 0.0028228759765625
2508
+ ],
2509
+ "pred_topk": [
2510
+ [
2511
+ " content",
2512
+ 0.142578125
2513
+ ],
2514
+ [
2515
+ " information",
2516
+ 0.09063720703125
2517
+ ],
2518
+ [
2519
+ " complexity",
2520
+ 0.073974609375
2521
+ ],
2522
+ [
2523
+ "ize",
2524
+ 0.0333251953125
2525
+ ],
2526
+ [
2527
+ " similarity",
2528
+ 0.0259552001953125
2529
+ ],
2530
+ [
2531
+ "ise",
2532
+ 0.0232696533203125
2533
+ ],
2534
+ [
2535
+ " imagery",
2536
+ 0.01456451416015625
2537
+ ],
2538
+ [
2539
+ " style",
2540
+ 0.01389312744140625
2541
+ ],
2542
+ [
2543
+ " text",
2544
+ 0.01226043701171875
2545
+ ],
2546
+ [
2547
+ " data",
2548
+ 0.0118865966796875
2549
+ ]
2550
+ ]
2551
+ },
2552
+ {
2553
+ "offset": [
2554
+ 233,
2555
+ 239
2556
+ ],
2557
+ "raw": " where",
2558
+ "real_topk": [
2559
+ 0,
2560
+ 0.00045108795166015625
2561
+ ],
2562
+ "pred_topk": [
2563
+ [
2564
+ " it",
2565
+ 0.33984375
2566
+ ],
2567
+ [
2568
+ " the",
2569
+ 0.2607421875
2570
+ ],
2571
+ [
2572
+ " key",
2573
+ 0.04974365234375
2574
+ ],
2575
+ [
2576
+ " that",
2577
+ 0.0321044921875
2578
+ ],
2579
+ [
2580
+ " this",
2581
+ 0.02703857421875
2582
+ ],
2583
+ [
2584
+ " how",
2585
+ 0.0200958251953125
2586
+ ],
2587
+ [
2588
+ " its",
2589
+ 0.018585205078125
2590
+ ],
2591
+ [
2592
+ " results",
2593
+ 0.0169219970703125
2594
+ ],
2595
+ [
2596
+ " data",
2597
+ 0.01181793212890625
2598
+ ],
2599
+ [
2600
+ " information",
2601
+ 0.00994873046875
2602
+ ]
2603
+ ]
2604
+ },
2605
+ {
2606
+ "offset": [
2607
+ 239,
2608
+ 243
2609
+ ],
2610
+ "raw": " the",
2611
+ "real_topk": [
2612
+ 0,
2613
+ 0.1798095703125
2614
+ ],
2615
+ "pred_topk": [
2616
+ [
2617
+ " the",
2618
+ 0.1798095703125
2619
+ ],
2620
+ [
2621
+ " it",
2622
+ 0.10736083984375
2623
+ ],
2624
+ [
2625
+ " information",
2626
+ 0.07037353515625
2627
+ ],
2628
+ [
2629
+ " key",
2630
+ 0.0631103515625
2631
+ ],
2632
+ [
2633
+ " that",
2634
+ 0.03594970703125
2635
+ ],
2636
+ [
2637
+ " and",
2638
+ 0.03485107421875
2639
+ ],
2640
+ [
2641
+ " language",
2642
+ 0.0298004150390625
2643
+ ],
2644
+ [
2645
+ " words",
2646
+ 0.0293426513671875
2647
+ ],
2648
+ [
2649
+ " text",
2650
+ 0.0271453857421875
2651
+ ],
2652
+ [
2653
+ " you",
2654
+ 0.016204833984375
2655
+ ]
2656
+ ]
2657
+ },
2658
+ {
2659
+ "offset": [
2660
+ 243,
2661
+ 253
2662
+ ],
2663
+ "raw": " important",
2664
+ "real_topk": [
2665
+ 0,
2666
+ 0.005664825439453125
2667
+ ],
2668
+ "pred_topk": [
2669
+ [
2670
+ " most",
2671
+ 0.1846923828125
2672
+ ],
2673
+ [
2674
+ " information",
2675
+ 0.16552734375
2676
+ ],
2677
+ [
2678
+ " text",
2679
+ 0.123046875
2680
+ ],
2681
+ [
2682
+ " key",
2683
+ 0.045257568359375
2684
+ ],
2685
+ [
2686
+ " data",
2687
+ 0.0238494873046875
2688
+ ],
2689
+ [
2690
+ " gaps",
2691
+ 0.02239990234375
2692
+ ],
2693
+ [
2694
+ " language",
2695
+ 0.0188751220703125
2696
+ ],
2697
+ [
2698
+ " words",
2699
+ 0.0133819580078125
2700
+ ],
2701
+ [
2702
+ " main",
2703
+ 0.01026153564453125
2704
+ ],
2705
+ [
2706
+ " word",
2707
+ 0.00994110107421875
2708
+ ]
2709
+ ]
2710
+ },
2711
+ {
2712
+ "offset": [
2713
+ 253,
2714
+ 259
2715
+ ],
2716
+ "raw": " parts",
2717
+ "real_topk": [
2718
+ 0,
2719
+ 0.102783203125
2720
+ ],
2721
+ "pred_topk": [
2722
+ [
2723
+ " information",
2724
+ 0.32666015625
2725
+ ],
2726
+ [
2727
+ " parts",
2728
+ 0.102783203125
2729
+ ],
2730
+ [
2731
+ " bits",
2732
+ 0.087890625
2733
+ ],
2734
+ [
2735
+ " points",
2736
+ 0.0838623046875
2737
+ ],
2738
+ [
2739
+ " words",
2740
+ 0.030853271484375
2741
+ ],
2742
+ [
2743
+ " stuff",
2744
+ 0.0240325927734375
2745
+ ],
2746
+ [
2747
+ " things",
2748
+ 0.0233001708984375
2749
+ ],
2750
+ [
2751
+ " data",
2752
+ 0.021881103515625
2753
+ ],
2754
+ [
2755
+ " is",
2756
+ 0.021209716796875
2757
+ ],
2758
+ [
2759
+ " content",
2760
+ 0.017578125
2761
+ ]
2762
+ ]
2763
+ },
2764
+ {
2765
+ "offset": [
2766
+ 259,
2767
+ 263
2768
+ ],
2769
+ "raw": " are",
2770
+ "real_topk": [
2771
+ 0,
2772
+ 0.5048828125
2773
+ ],
2774
+ "pred_topk": [
2775
+ [
2776
+ " are",
2777
+ 0.5048828125
2778
+ ],
2779
+ [
2780
+ " of",
2781
+ 0.425048828125
2782
+ ],
2783
+ [
2784
+ " lie",
2785
+ 0.0157318115234375
2786
+ ],
2787
+ [
2788
+ " go",
2789
+ 0.004947662353515625
2790
+ ],
2791
+ [
2792
+ " stand",
2793
+ 0.00334930419921875
2794
+ ],
2795
+ [
2796
+ " fall",
2797
+ 0.0030975341796875
2798
+ ],
2799
+ [
2800
+ " reside",
2801
+ 0.0030975341796875
2802
+ ],
2803
+ [
2804
+ " (",
2805
+ 0.0029087066650390625
2806
+ ],
2807
+ [
2808
+ " and",
2809
+ 0.0026912689208984375
2810
+ ],
2811
+ [
2812
+ " in",
2813
+ 0.002338409423828125
2814
+ ]
2815
+ ]
2816
+ },
2817
+ {
2818
+ "offset": [
2819
+ 263,
2820
+ 266
2821
+ ],
2822
+ "raw": ".\n\n",
2823
+ "real_topk": [
2824
+ 0,
2825
+ 0.1385498046875
2826
+ ],
2827
+ "pred_topk": [
2828
+ [
2829
+ ".",
2830
+ 0.3427734375
2831
+ ],
2832
+ [
2833
+ ".\n\n",
2834
+ 0.1385498046875
2835
+ ],
2836
+ [
2837
+ " in",
2838
+ 0.130126953125
2839
+ ],
2840
+ [
2841
+ ",",
2842
+ 0.111328125
2843
+ ],
2844
+ [
2845
+ " located",
2846
+ 0.047882080078125
2847
+ ],
2848
+ [
2849
+ " and",
2850
+ 0.021240234375
2851
+ ],
2852
+ [
2853
+ " within",
2854
+ 0.0121002197265625
2855
+ ],
2856
+ [
2857
+ ".\n",
2858
+ 0.0119171142578125
2859
+ ],
2860
+ [
2861
+ " found",
2862
+ 0.01119232177734375
2863
+ ],
2864
+ [
2865
+ " hidden",
2866
+ 0.01119232177734375
2867
+ ]
2868
+ ]
2869
+ },
2870
+ {
2871
+ "offset": [
2872
+ 266,
2873
+ 269
2874
+ ],
2875
+ "raw": "The",
2876
+ "real_topk": [
2877
+ 0,
2878
+ 0.041107177734375
2879
+ ],
2880
+ "pred_topk": [
2881
+ [
2882
+ "##",
2883
+ 0.09405517578125
2884
+ ],
2885
+ [
2886
+ "#",
2887
+ 0.08837890625
2888
+ ],
2889
+ [
2890
+ "Info",
2891
+ 0.048797607421875
2892
+ ],
2893
+ [
2894
+ "The",
2895
+ 0.041107177734375
2896
+ ],
2897
+ [
2898
+ "###",
2899
+ 0.027374267578125
2900
+ ],
2901
+ [
2902
+ "This",
2903
+ 0.026123046875
2904
+ ],
2905
+ [
2906
+ "In",
2907
+ 0.015594482421875
2908
+ ],
2909
+ [
2910
+ "You",
2911
+ 0.01398468017578125
2912
+ ],
2913
+ [
2914
+ "A",
2915
+ 0.01177215576171875
2916
+ ],
2917
+ [
2918
+ "If",
2919
+ 0.01177215576171875
2920
+ ]
2921
+ ]
2922
+ },
2923
+ {
2924
+ "offset": [
2925
+ 269,
2926
+ 275
2927
+ ],
2928
+ "raw": " color",
2929
+ "real_topk": [
2930
+ 0,
2931
+ 0.0003719329833984375
2932
+ ],
2933
+ "pred_topk": [
2934
+ [
2935
+ " information",
2936
+ 0.051849365234375
2937
+ ],
2938
+ [
2939
+ " Info",
2940
+ 0.03509521484375
2941
+ ],
2942
+ [
2943
+ " model",
2944
+ 0.0345458984375
2945
+ ],
2946
+ [
2947
+ " key",
2948
+ 0.0264892578125
2949
+ ],
2950
+ [
2951
+ " language",
2952
+ 0.0252685546875
2953
+ ],
2954
+ [
2955
+ " text",
2956
+ 0.01763916015625
2957
+ ],
2958
+ [
2959
+ " first",
2960
+ 0.014862060546875
2961
+ ],
2962
+ [
2963
+ " main",
2964
+ 0.01194000244140625
2965
+ ],
2966
+ [
2967
+ " following",
2968
+ 0.0112152099609375
2969
+ ],
2970
+ [
2971
+ " article",
2972
+ 0.00989532470703125
2973
+ ]
2974
+ ]
2975
+ },
2976
+ {
2977
+ "offset": [
2978
+ 275,
2979
+ 285
2980
+ ],
2981
+ "raw": " intensity",
2982
+ "real_topk": [
2983
+ 0,
2984
+ 0.002841949462890625
2985
+ ],
2986
+ "pred_topk": [
2987
+ [
2988
+ " of",
2989
+ 0.2366943359375
2990
+ ],
2991
+ [
2992
+ "-coded",
2993
+ 0.036865234375
2994
+ ],
2995
+ [
2996
+ " scheme",
2997
+ 0.035736083984375
2998
+ ],
2999
+ [
3000
+ " and",
3001
+ 0.035186767578125
3002
+ ],
3003
+ [
3004
+ " code",
3005
+ 0.034637451171875
3006
+ ],
3007
+ [
3008
+ " coding",
3009
+ 0.02783203125
3010
+ ],
3011
+ [
3012
+ " palette",
3013
+ 0.02783203125
3014
+ ],
3015
+ [
3016
+ ",",
3017
+ 0.0234375
3018
+ ],
3019
+ [
3020
+ " blue",
3021
+ 0.0223541259765625
3022
+ ],
3023
+ [
3024
+ " red",
3025
+ 0.0191192626953125
3026
+ ]
3027
+ ]
3028
+ },
3029
+ {
3030
+ "offset": [
3031
+ 285,
3032
+ 288
3033
+ ],
3034
+ "raw": " of",
3035
+ "real_topk": [
3036
+ 0,
3037
+ 0.47265625
3038
+ ],
3039
+ "pred_topk": [
3040
+ [
3041
+ " of",
3042
+ 0.47265625
3043
+ ],
3044
+ [
3045
+ " in",
3046
+ 0.09906005859375
3047
+ ],
3048
+ [
3049
+ " is",
3050
+ 0.038787841796875
3051
+ ],
3052
+ [
3053
+ " and",
3054
+ 0.0279541015625
3055
+ ],
3056
+ [
3057
+ ",",
3058
+ 0.0242767333984375
3059
+ ],
3060
+ [
3061
+ " (",
3062
+ 0.0169525146484375
3063
+ ],
3064
+ [
3065
+ " on",
3066
+ 0.01279449462890625
3067
+ ],
3068
+ [
3069
+ " values",
3070
+ 0.010772705078125
3071
+ ],
3072
+ [
3073
+ " distribution",
3074
+ 0.0098114013671875
3075
+ ],
3076
+ [
3077
+ " gradient",
3078
+ 0.0096588134765625
3079
+ ]
3080
+ ]
3081
+ },
3082
+ {
3083
+ "offset": [
3084
+ 288,
3085
+ 293
3086
+ ],
3087
+ "raw": " each",
3088
+ "real_topk": [
3089
+ 0,
3090
+ 0.126220703125
3091
+ ],
3092
+ "pred_topk": [
3093
+ [
3094
+ " a",
3095
+ 0.28466796875
3096
+ ],
3097
+ [
3098
+ " the",
3099
+ 0.2286376953125
3100
+ ],
3101
+ [
3102
+ " each",
3103
+ 0.126220703125
3104
+ ],
3105
+ [
3106
+ " an",
3107
+ 0.060577392578125
3108
+ ],
3109
+ [
3110
+ " text",
3111
+ 0.024871826171875
3112
+ ],
3113
+ [
3114
+ " pixels",
3115
+ 0.0184783935546875
3116
+ ],
3117
+ [
3118
+ " words",
3119
+ 0.01531982421875
3120
+ ],
3121
+ [
3122
+ " every",
3123
+ 0.01174163818359375
3124
+ ],
3125
+ [
3126
+ " red",
3127
+ 0.0075836181640625
3128
+ ],
3129
+ [
3130
+ " letters",
3131
+ 0.00690460205078125
3132
+ ]
3133
+ ]
3134
+ },
3135
+ {
3136
+ "offset": [
3137
+ 293,
3138
+ 299
3139
+ ],
3140
+ "raw": " token",
3141
+ "real_topk": [
3142
+ 0,
3143
+ 0.0081939697265625
3144
+ ],
3145
+ "pred_topk": [
3146
+ [
3147
+ " word",
3148
+ 0.1751708984375
3149
+ ],
3150
+ [
3151
+ " pixel",
3152
+ 0.16455078125
3153
+ ],
3154
+ [
3155
+ " letter",
3156
+ 0.060546875
3157
+ ],
3158
+ [
3159
+ " character",
3160
+ 0.056854248046875
3161
+ ],
3162
+ [
3163
+ " cell",
3164
+ 0.02484130859375
3165
+ ],
3166
+ [
3167
+ " point",
3168
+ 0.0212554931640625
3169
+ ],
3170
+ [
3171
+ " text",
3172
+ 0.018463134765625
3173
+ ],
3174
+ [
3175
+ " image",
3176
+ 0.0160369873046875
3177
+ ],
3178
+ [
3179
+ " dot",
3180
+ 0.0160369873046875
3181
+ ],
3182
+ [
3183
+ " node",
3184
+ 0.01415252685546875
3185
+ ]
3186
+ ]
3187
+ },
3188
+ {
3189
+ "offset": [
3190
+ 299,
3191
+ 309
3192
+ ],
3193
+ "raw": " indicates",
3194
+ "real_topk": [
3195
+ 0,
3196
+ 0.0204620361328125
3197
+ ],
3198
+ "pred_topk": [
3199
+ [
3200
+ " in",
3201
+ 0.35693359375
3202
+ ],
3203
+ [
3204
+ " is",
3205
+ 0.249267578125
3206
+ ],
3207
+ [
3208
+ " (",
3209
+ 0.037628173828125
3210
+ ],
3211
+ [
3212
+ " can",
3213
+ 0.0228271484375
3214
+ ],
3215
+ [
3216
+ " of",
3217
+ 0.020782470703125
3218
+ ],
3219
+ [
3220
+ " indicates",
3221
+ 0.0204620361328125
3222
+ ],
3223
+ [
3224
+ ",",
3225
+ 0.0201416015625
3226
+ ],
3227
+ [
3228
+ " represents",
3229
+ 0.0198211669921875
3230
+ ],
3231
+ [
3232
+ " within",
3233
+ 0.01202392578125
3234
+ ],
3235
+ [
3236
+ " depends",
3237
+ 0.01061248779296875
3238
+ ]
3239
+ ]
3240
+ },
3241
+ {
3242
+ "offset": [
3243
+ 309,
3244
+ 313
3245
+ ],
3246
+ "raw": " how",
3247
+ "real_topk": [
3248
+ 0,
3249
+ 0.2125244140625
3250
+ ],
3251
+ "pred_topk": [
3252
+ [
3253
+ " the",
3254
+ 0.45703125
3255
+ ],
3256
+ [
3257
+ " how",
3258
+ 0.2125244140625
3259
+ ],
3260
+ [
3261
+ " its",
3262
+ 0.2060546875
3263
+ ],
3264
+ [
3265
+ " their",
3266
+ 0.01690673828125
3267
+ ],
3268
+ [
3269
+ " information",
3270
+ 0.01180267333984375
3271
+ ],
3272
+ [
3273
+ " a",
3274
+ 0.0104217529296875
3275
+ ],
3276
+ [
3277
+ " whether",
3278
+ 0.010101318359375
3279
+ ],
3280
+ [
3281
+ " that",
3282
+ 0.00557708740234375
3283
+ ],
3284
+ [
3285
+ " what",
3286
+ 0.005321502685546875
3287
+ ],
3288
+ [
3289
+ " which",
3290
+ 0.00484466552734375
3291
+ ]
3292
+ ]
3293
+ },
3294
+ {
3295
+ "offset": [
3296
+ 313,
3297
+ 318
3298
+ ],
3299
+ "raw": " much",
3300
+ "real_topk": [
3301
+ 0,
3302
+ 0.298828125
3303
+ ],
3304
+ "pred_topk": [
3305
+ [
3306
+ " much",
3307
+ 0.298828125
3308
+ ],
3309
+ [
3310
+ " important",
3311
+ 0.243896484375
3312
+ ],
3313
+ [
3314
+ " likely",
3315
+ 0.058837890625
3316
+ ],
3317
+ [
3318
+ " many",
3319
+ 0.0391845703125
3320
+ ],
3321
+ [
3322
+ " informative",
3323
+ 0.035125732421875
3324
+ ],
3325
+ [
3326
+ " dense",
3327
+ 0.028228759765625
3328
+ ],
3329
+ [
3330
+ " relevant",
3331
+ 0.0206451416015625
3332
+ ],
3333
+ [
3334
+ " probable",
3335
+ 0.018218994140625
3336
+ ],
3337
+ [
3338
+ " often",
3339
+ 0.017669677734375
3340
+ ],
3341
+ [
3342
+ " \"",
3343
+ 0.0123291015625
3344
+ ]
3345
+ ]
3346
+ },
3347
+ {
3348
+ "offset": [
3349
+ 318,
3350
+ 330
3351
+ ],
3352
+ "raw": " information",
3353
+ "real_topk": [
3354
+ 0,
3355
+ 0.412353515625
3356
+ ],
3357
+ "pred_topk": [
3358
+ [
3359
+ " information",
3360
+ 0.412353515625
3361
+ ],
3362
+ [
3363
+ " it",
3364
+ 0.09637451171875
3365
+ ],
3366
+ [
3367
+ " the",
3368
+ 0.09197998046875
3369
+ ],
3370
+ [
3371
+ " of",
3372
+ 0.08642578125
3373
+ ],
3374
+ [
3375
+ " that",
3376
+ 0.022186279296875
3377
+ ],
3378
+ [
3379
+ " important",
3380
+ 0.013885498046875
3381
+ ],
3382
+ [
3383
+ " importance",
3384
+ 0.013885498046875
3385
+ ],
3386
+ [
3387
+ " text",
3388
+ 0.013671875
3389
+ ],
3390
+ [
3391
+ " a",
3392
+ 0.012451171875
3393
+ ],
3394
+ [
3395
+ " its",
3396
+ 0.0085601806640625
3397
+ ]
3398
+ ]
3399
+ },
3400
+ {
3401
+ "offset": [
3402
+ 330,
3403
+ 333
3404
+ ],
3405
+ "raw": " it",
3406
+ "real_topk": [
3407
+ 0,
3408
+ 0.37841796875
3409
+ ],
3410
+ "pred_topk": [
3411
+ [
3412
+ " it",
3413
+ 0.37841796875
3414
+ ],
3415
+ [
3416
+ " the",
3417
+ 0.15771484375
3418
+ ],
3419
+ [
3420
+ " is",
3421
+ 0.13916015625
3422
+ ],
3423
+ [
3424
+ " that",
3425
+ 0.059844970703125
3426
+ ],
3427
+ [
3428
+ " they",
3429
+ 0.029632568359375
3430
+ ],
3431
+ [
3432
+ " this",
3433
+ 0.0269775390625
3434
+ ],
3435
+ [
3436
+ " density",
3437
+ 0.024566650390625
3438
+ ],
3439
+ [
3440
+ " a",
3441
+ 0.0210113525390625
3442
+ ],
3443
+ [
3444
+ " about",
3445
+ 0.019439697265625
3446
+ ],
3447
+ [
3448
+ " each",
3449
+ 0.017425537109375
3450
+ ]
3451
+ ]
3452
+ },
3453
+ {
3454
+ "offset": [
3455
+ 333,
3456
+ 341
3457
+ ],
3458
+ "raw": " carries",
3459
+ "real_topk": [
3460
+ 0,
3461
+ 0.2242431640625
3462
+ ],
3463
+ "pred_topk": [
3464
+ [
3465
+ " contains",
3466
+ 0.311279296875
3467
+ ],
3468
+ [
3469
+ " carries",
3470
+ 0.2242431640625
3471
+ ],
3472
+ [
3473
+ " provides",
3474
+ 0.08380126953125
3475
+ ],
3476
+ [
3477
+ " con",
3478
+ 0.0716552734375
3479
+ ],
3480
+ [
3481
+ " holds",
3482
+ 0.051605224609375
3483
+ ],
3484
+ [
3485
+ " has",
3486
+ 0.045562744140625
3487
+ ],
3488
+ [
3489
+ " contributes",
3490
+ 0.038360595703125
3491
+ ],
3492
+ [
3493
+ " enc",
3494
+ 0.0175628662109375
3495
+ ],
3496
+ [
3497
+ " is",
3498
+ 0.0170135498046875
3499
+ ],
3500
+ [
3501
+ " can",
3502
+ 0.012451171875
3503
+ ]
3504
+ ]
3505
+ },
3506
+ {
3507
+ "offset": [
3508
+ 341,
3509
+ 342
3510
+ ],
3511
+ "raw": ".",
3512
+ "real_topk": [
3513
+ 0,
3514
+ 0.420654296875
3515
+ ],
3516
+ "pred_topk": [
3517
+ [
3518
+ ".",
3519
+ 0.420654296875
3520
+ ],
3521
+ [
3522
+ ",",
3523
+ 0.1263427734375
3524
+ ],
3525
+ [
3526
+ ".\n\n",
3527
+ 0.07904052734375
3528
+ ],
3529
+ [
3530
+ " in",
3531
+ 0.059661865234375
3532
+ ],
3533
+ [
3534
+ " about",
3535
+ 0.049468994140625
3536
+ ],
3537
+ [
3538
+ " (",
3539
+ 0.02301025390625
3540
+ ],
3541
+ [
3542
+ " with",
3543
+ 0.021270751953125
3544
+ ],
3545
+ [
3546
+ " within",
3547
+ 0.019073486328125
3548
+ ],
3549
+ [
3550
+ " and",
3551
+ 0.0184783935546875
3552
+ ],
3553
+ [
3554
+ ":",
3555
+ 0.016571044921875
3556
+ ]
3557
+ ]
3558
+ },
3559
+ {
3560
+ "offset": [
3561
+ 342,
3562
+ 346
3563
+ ],
3564
+ "raw": " Try",
3565
+ "real_topk": [
3566
+ 0,
3567
+ 0.00023102760314941406
3568
+ ],
3569
+ "pred_topk": [
3570
+ [
3571
+ " The",
3572
+ 0.2200927734375
3573
+ ],
3574
+ [
3575
+ " For",
3576
+ 0.061126708984375
3577
+ ],
3578
+ [
3579
+ " This",
3580
+ 0.041351318359375
3581
+ ],
3582
+ [
3583
+ " A",
3584
+ 0.037078857421875
3585
+ ],
3586
+ [
3587
+ " Tokens",
3588
+ 0.0364990234375
3589
+ ],
3590
+ [
3591
+ " In",
3592
+ 0.034820556640625
3593
+ ],
3594
+ [
3595
+ " Red",
3596
+ 0.024688720703125
3597
+ ],
3598
+ [
3599
+ " We",
3600
+ 0.0221405029296875
3601
+ ],
3602
+ [
3603
+ " If",
3604
+ 0.017791748046875
3605
+ ],
3606
+ [
3607
+ " It",
3608
+ 0.0169677734375
3609
+ ]
3610
+ ]
3611
+ },
3612
+ {
3613
+ "offset": [
3614
+ 346,
3615
+ 349
3616
+ ],
3617
+ "raw": " it",
3618
+ "real_topk": [
3619
+ 0,
3620
+ 0.260498046875
3621
+ ],
3622
+ "pred_topk": [
3623
+ [
3624
+ " it",
3625
+ 0.260498046875
3626
+ ],
3627
+ [
3628
+ " the",
3629
+ 0.1351318359375
3630
+ ],
3631
+ [
3632
+ " this",
3633
+ 0.105224609375
3634
+ ],
3635
+ [
3636
+ " Info",
3637
+ 0.08453369140625
3638
+ ],
3639
+ [
3640
+ " a",
3641
+ 0.02423095703125
3642
+ ],
3643
+ [
3644
+ " to",
3645
+ 0.0231170654296875
3646
+ ],
3647
+ [
3648
+ " our",
3649
+ 0.020721435546875
3650
+ ],
3651
+ [
3652
+ " changing",
3653
+ 0.016143798828125
3654
+ ],
3655
+ [
3656
+ " out",
3657
+ 0.01446533203125
3658
+ ],
3659
+ [
3660
+ " using",
3661
+ 0.01424407958984375
3662
+ ]
3663
+ ]
3664
+ },
3665
+ {
3666
+ "offset": [
3667
+ 349,
3668
+ 358
3669
+ ],
3670
+ "raw": " yourself",
3671
+ "real_topk": [
3672
+ 0,
3673
+ 0.103515625
3674
+ ],
3675
+ "pred_topk": [
3676
+ [
3677
+ " out",
3678
+ 0.2091064453125
3679
+ ],
3680
+ [
3681
+ " for",
3682
+ 0.1845703125
3683
+ ],
3684
+ [
3685
+ " here",
3686
+ 0.1068115234375
3687
+ ],
3688
+ [
3689
+ " yourself",
3690
+ 0.103515625
3691
+ ],
3692
+ [
3693
+ " now",
3694
+ 0.057159423828125
3695
+ ],
3696
+ [
3697
+ " on",
3698
+ 0.044525146484375
3699
+ ],
3700
+ [
3701
+ " in",
3702
+ 0.0357666015625
3703
+ ],
3704
+ [
3705
+ "!\n\n",
3706
+ 0.032562255859375
3707
+ ],
3708
+ [
3709
+ " free",
3710
+ 0.0291900634765625
3711
+ ],
3712
+ [
3713
+ " today",
3714
+ 0.022735595703125
3715
+ ]
3716
+ ]
3717
+ },
3718
+ {
3719
+ "offset": [
3720
+ 358,
3721
+ 359
3722
+ ],
3723
+ "raw": "!",
3724
+ "real_topk": [
3725
+ 0,
3726
+ 0.052703857421875
3727
+ ],
3728
+ "pred_topk": [
3729
+ [
3730
+ "!\n\n",
3731
+ 0.162353515625
3732
+ ],
3733
+ [
3734
+ ".\n\n",
3735
+ 0.10986328125
3736
+ ],
3737
+ [
3738
+ " here",
3739
+ 0.093994140625
3740
+ ],
3741
+ [
3742
+ "!",
3743
+ 0.052703857421875
3744
+ ],
3745
+ [
3746
+ ".",
3747
+ 0.05029296875
3748
+ ],
3749
+ [
3750
+ ":",
3751
+ 0.0465087890625
3752
+ ],
3753
+ [
3754
+ " by",
3755
+ 0.0465087890625
3756
+ ],
3757
+ [
3758
+ " at",
3759
+ 0.0404052734375
3760
+ ],
3761
+ [
3762
+ ",",
3763
+ 0.032989501953125
3764
+ ],
3765
+ [
3766
+ " and",
3767
+ 0.032989501953125
3768
+ ]
3769
+ ]
3770
+ }
3771
+ ]
3772
+ }
3773
+ }
data/demo/public/InfoRadar-learn-more.json ADDED
The diff for this file is too large to render. See raw diff