diff --git "a/precomputed/example_visualization.html" "b/precomputed/example_visualization.html"
--- "a/precomputed/example_visualization.html"
+++ "b/precomputed/example_visualization.html"
@@ -279,11 +279,11 @@
     <div id="tooltip"></div>
         <div class="header">
             <div class="meta">
-                <div>Model A: RWKV7-G1C-1.5B</div>
+                <div>Model A: RWKV7-G1D-1.5B</div>
                 <div>Model B: Qwen3-1.7B-Base</div>
-                <div>RWKV Compression: 9.35%</div>
+                <div>RWKV Compression: 9.34%</div>
                 <div>Qwen Compression: 9.47%</div>
-                <div style="color: #64ff64">Avg Delta: -0.12%</div>
+                <div style="color: #64ff64">Avg Delta: -0.13%</div>
             </div>
             <div class="legend">
                 <div class="legend-row">
@@ -316,7 +316,7 @@
         </div>
     
     <div class="content"></div>
-    <script id="render-model" type="application/json">{"text": "The Bitter Lesson\nRich Sutton\nMarch 13, 2019\nThe biggest lesson that can be read from 70 years of AI research is that general methods that leverage computation are ultimately the most effective, and by a large margin. The ultimate reason for this is Moore's law, or rather its generalization of continued exponentially falling cost per unit of computation. Most AI research has been conducted as if the computation available to the agent were constant (in which case leveraging human knowledge would be one of the only ways to improve performance) but, over a slightly longer time than a typical research project, massively more computation inevitably becomes available. Seeking an improvement that makes a difference in the shorter term, researchers seek to leverage their human knowledge of the domain, but the only thing that matters in the long run is the leveraging of computation. These two need not run counter to each other, but in practice they tend to. Time spent on one is time not spent on the other. There are psychological commitments to investment in one approach or the other. And the human-knowledge approach tends to complicate methods in ways that make them less suited to taking advantage of general methods leveraging computation.  There were many examples of AI researchers' belated learning of this bitter lesson, and it is instructive to review some of the most prominent.\n\nIn computer chess, the methods that defeated the world champion, Kasparov, in 1997, were based on massive, deep search. At the time, this was looked upon with dismay by the majority of computer-chess researchers who had pursued methods that leveraged human understanding of the special structure of chess. When a simpler, search-based approach with special hardware and software proved vastly more effective, these human-knowledge-based chess researchers were not good losers. They said that ``brute force\" search may have won this time, but it was not a general strategy, and anyway it was not how people played chess. These researchers wanted methods based on human input to win and were disappointed when they did not.\n\nA similar pattern of research progress was seen in computer Go, only delayed by a further 20 years. Enormous initial efforts went into avoiding search by taking advantage of human knowledge, or of the special features of the game, but all those efforts proved irrelevant, or worse, once search was applied effectively at scale. Also important was the use of learning by self play to learn a value function (as it was in many other games and even in chess, although learning did not play a big role in the 1997 program that first beat a world champion). Learning by self play, and learning in general, is like search in that it enables massive computation to be brought to bear. Search and learning are the two most important classes of techniques for utilizing massive amounts of computation in AI research. In computer Go, as in computer chess, researchers' initial effort was directed towards utilizing human understanding (so that less search was needed) and only much later was much greater success had by embracing search and learning.\n\nIn speech recognition, there was an early competition, sponsored by DARPA, in the 1970s. Entrants included a host of special methods that took advantage of human knowledge---knowledge of words, of phonemes, of the human vocal tract, etc. On the other side were newer methods that were more statistical in nature and did much more computation, based on hidden Markov models (HMMs). Again, the statistical methods won out over the human-knowledge-based methods. This led to a major change in all of natural language processing, gradually over decades, where statistics and computation came to dominate the field. The recent rise of deep learning in speech recognition is the most recent step in this consistent direction. Deep learning methods rely even less on human knowledge, and use even more computation, together with learning on huge training sets, to produce dramatically better speech recognition systems. As in the games, researchers always tried to make systems that worked the way the researchers thought their own minds worked---they tried to put that knowledge in their systems---but it proved ultimately counterproductive, and a colossal waste of researcher's time, when, through Moore's law, massive computation became available and a means was found to put it to good use.\n\nIn computer vision, there has been a similar pattern. Early methods conceived of vision as searching for edges, or generalized cylinders, or in terms of SIFT features. But today all this is discarded. Modern deep-learning neural networks use only the notions of convolution and certain kinds of invariances, and perform much better.\n\nThis is a big lesson. As a field, we still have not thoroughly learned it, as we are continuing to make the same kind of mistakes. To see this, and to effectively resist it, we have to understand the appeal of these mistakes. We have to learn the bitter lesson that building in how we think we think does not work in the long run. The bitter lesson is based on the historical observations that 1) AI researchers have often tried to build knowledge into their agents, 2) this always helps in the short term, and is personally satisfying to the researcher, but 3) in the long run it plateaus and even inhibits further progress, and 4) breakthrough progress eventually arrives by an opposing approach based on scaling computation by search and learning. The eventual success is tinged with bitterness, and often incompletely digested, because it is success over a favored, human-centric approach.\n\nOne thing that should be learned from the bitter lesson is the great power of general purpose methods, of methods that continue to scale with increased computation even as the available computation becomes very great. The two methods that seem to scale arbitrarily in this way are search and learning.\n\nThe second general point to be learned from the bitter lesson is that the actual contents of minds are tremendously, irredeemably complex; we should stop trying to find simple ways to think about the contents of minds, such as simple ways to think about space, objects, multiple agents, or symmetries. All these are part of the arbitrary, intrinsically-complex, outside world. They are not what should be built in, as their complexity is endless; instead we should build in only the meta-methods that can find and capture this arbitrary complexity. Essential to these methods is that they can find good approximations, but the search for them should be by our methods, not by us. We want AI agents that can discover like we can, not which contain what we have discovered. Building in our discoveries only makes it harder to see how the discovering process can be done.\n", "tokens": [{"byte_start": 0, "byte_end": 3, "display": {"text": "The", "kind": "normal"}, "is_word": true, "word_id": 0, "word_key": "the", "bytes_hex": "54 68 65", "compression": {"rwkv": "18.88% 18.88% 18.88%", "qwen": "33.67% 33.67% 33.67%"}, "model_tokens": {"rwkv": [[6699, "The", "normal", 0.042899858206510544]], "qwen": [[785, "The", "normal", 0.003693073522299528]]}, "loss": {"rwkv": 18.879017136632918, "qwen": 33.67067739459524}, "topk": {"rwkv": [6699, 1, 0.042899858206510544, [[6699, 0.0429, "The", false], [36, 0.03942, "#", false], [34579, 0.034861, "https", false], [24281, 0.033229, "User", false], [1136, 0.024944, "In", false], [82, 0.021996, "Q", false], [520, 0.019054, "**", false], [6833, 0.016743, "You", false], [41, 0.016161, "(", false], [640, 0.013639, "20", false]]], "qwen": [785, 30, 0.003693073522299528, [[262, 0.036306, "   ", false], [286, 0.025112, "       ", false], [198, 0.021214, "\n", false], [310, 0.014187, "           ", false], [220, 0.012878, " ", false], [197, 0.01252, "\t", false], [16, 0.011983, "1", false], [2, 0.009983, "#", false], [256, 0.008925, "  ", false], [17, 0.008681, "2", false]]]}, "raw_delta": -0.8202238082885742, "tuned_delta": -0.8134115304814763}, {"byte_start": 3, "byte_end": 10, "display": {"text": " Bitter", "kind": "normal"}, "is_word": true, "word_id": 1, "word_key": " bitter", "bytes_hex": "20 42 69 74 74 65 72", "compression": {"rwkv": "40.86% 40.86% 40.86% 40.86% 7.94% 7.94% 7.94%", "qwen": "62.88% 62.88% 17.53% 17.53% 17.53% 17.53% 17.53%"}, "model_tokens": {"rwkv": [[19523, " Bit", "normal", 0.00011405753321014345], [8795, "ter", "normal", 0.269989937543869]], "qwen": [[425, " B", "normal", 0.00093627575552091], [3248, "itter", "normal", 0.007752551697194576]]}, "loss": {"rwkv": 26.74862875755346, "qwen": 30.485520618743337}, "topk": {"rwkv": [19523, 1466, 0.00011405753321014345, [[45010, 0.009286, " United", false], [331, 0.008995, " `", false], [45242, 0.00894, " author", false], [52569, 0.008428, " problem", false], [32224, 0.007787, " text", false], [32355, 0.007727, " user", false], [38499, 0.006905, " first", false], [31894, 0.006823, " role", false], [269, 0.006501, " \"", false], [59725, 0.005522, " following", false]]], "qwen": [425, 134, 0.00093627575552091, [[2701, 0.032689, " following", false], [4226, 0.024054, " answer", false], [1156, 0.015003, " first", false], [4396, 0.011983, " correct", false], [1565, 0.011463, " `", false], [729, 0.010951, " function", false], [1887, 0.009331, " main", false], [2790, 0.008723, " total", false], [1372, 0.008478, " number", false], [3491, 0.00806, " problem", false]]]}, "raw_delta": -0.20721728461129324, "tuned_delta": -0.2004050068041953}, {"byte_start": 10, "byte_end": 17, "display": {"text": " Lesson", "kind": "normal"}, "is_word": true, "word_id": 2, "word_key": " lesson", "bytes_hex": "20 4c 65 73 73 6f 6e", "compression": {"rwkv": "21.19% 21.19% 21.19% 21.19% 21.19% 1.33% 1.33%", "qwen": "16.49% 16.49% 16.49% 16.49% 16.49% 16.49% 16.49%"}, "model_tokens": {"rwkv": [[29273, " Less", "normal", 0.002819134620949626], [2098, "on", "normal", 0.862823486328125]], "qwen": [[48915, " Lesson", "normal", 0.0016589945880696177]]}, "loss": {"rwkv": 15.515311657997762, "qwen": 16.491920054712242}, "topk": {"rwkv": [29273, 33, 0.002819134620949626, [[37496, 0.220171, " Truth", false], [29584, 0.086906, " Pill", false], [26939, 0.068227, "root", false], [19826, 0.025358, " End", false], [29694, 0.024754, " Root", false], [44502, 0.023103, " Legacy", false], [44014, 0.020099, " Battle", false], [20979, 0.018973, " Tas", false], [37421, 0.01042, " Sweet", false], [21265, 0.010109, " and", false]]], "qwen": [48915, 78, 0.0016589945880696177, [[3972, 0.086547, " End", false], [18854, 0.033914, " Root", false], [2090, 0.0327, "ness", false], [2888, 0.032286, "root", false], [29098, 0.030777, " Truth", false], [34136, 0.021435, " Pill", false], [57981, 0.019807, " Taste", false], [323, 0.016665, " and", false], [26589, 0.016409, " Sweet", false], [55835, 0.013012, " Harvest", false]]]}, "raw_delta": -0.054154668535504956, "tuned_delta": -0.047342390728407006}, {"byte_start": 17, "byte_end": 18, "display": {"text": "\n", "kind": "control"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "0a", "compression": {"rwkv": "35.64%", "qwen": "26.29%"}, "model_tokens": {"rwkv": [[11, "\n", "control", 0.13636964559555054]], "qwen": [[198, "\n", "control", 0.2327895313501358]]}, "loss": {"rwkv": 35.64471145946364, "qwen": 26.286273362980776}, "topk": {"rwkv": [11, 3, 0.13636964559555054, [[59, 0.294613, ":", false], [4706, 0.293591, " of", false], [11, 0.13637, "\n", false], [261, 0.051103, "\n\n", false], [4596, 0.025621, " in", false], [30917, 0.014934, " from", false], [21700, 0.012708, " for", false], [275, 0.011549, " (", false], [22897, 0.008473, " –", false], [4089, 0.007539, " Of", false]]], "qwen": [198, 2, 0.2327895313501358, [[315, 0.281083, " of", false], [198, 0.23279, "\n", false], [25, 0.055722, ":", false], [271, 0.051887, "\n\n", false], [320, 0.027106, " (", false], [374, 0.02522, " is", false], [304, 0.019353, " in", false], [553, 0.013985, " by", false], [504, 0.013709, " from", false], [11, 0.013458, ",", false]]]}, "raw_delta": 0.5189419984817505, "tuned_delta": 0.5257542762888484}, {"byte_start": 18, "byte_end": 22, "display": {"text": "Rich", "kind": "normal"}, "is_word": true, "word_id": 3, "word_key": "rich", "bytes_hex": "52 69 63 68", "compression": {"rwkv": "44.24% 44.24% 44.24% 44.24%", "qwen": "39.68% 39.68% 39.68% 39.68%"}, "model_tokens": {"rwkv": [[24100, "Rich", "normal", 5.4560925491387025e-05]], "qwen": [[27177, "Rich", "normal", 0.00015063985483720899]]}, "loss": {"rwkv": 44.23889090225922, "qwen": 39.67690060330372}, "topk": {"rwkv": [24100, 1680, 5.4560925491387025e-05, [[6699, 0.11052, "The", false], [1136, 0.047807, "In", false], [894, 0.037772, "By", false], [66, 0.034661, "A", false], [1782, 0.027586, "by", false], [74, 0.018155, "I", false], [24242, 0.016693, "This", false], [24327, 0.016148, "When", false], [35, 0.015776, "\"", false], [1141, 0.013615, "It", false]]], "qwen": [27177, 744, 0.00015063985483720899, [[785, 0.164658, "The", false], [32, 0.037296, "A", false], [1359, 0.026936, "By", false], [1694, 0.024776, "by", false], [16, 0.017683, "1", false], [641, 0.01757, "In", false], [33, 0.01526, "B", false], [40, 0.012698, "I", false], [4498, 0.009365, "When", false], [25020, 0.00897, "Chapter", false]]]}, "raw_delta": 0.25297045707702637, "tuned_delta": 0.2597827348841243}, {"byte_start": 22, "byte_end": 29, "display": {"text": " Sutton", "kind": "normal"}, "is_word": true, "word_id": 4, "word_key": " sutton", "bytes_hex": "20 53 75 74 74 6f 6e", "compression": {"rwkv": "26.73% 26.73% 26.73% 26.73% 26.73% 26.73% 26.73%", "qwen": "23.54% 23.54% 23.54% 23.54% 23.54% 23.54% 23.54%"}, "model_tokens": {"rwkv": [[44940, " Sutton", "normal", 3.048103826586157e-05]], "qwen": [[73013, " Sutton", "normal", 0.00010748509521363303]]}, "loss": {"rwkv": 26.728501873612494, "qwen": 23.54210068043684}, "topk": {"rwkv": [44940, 2535, 3.048103826586157e-05, [[26269, 0.099625, "mond", false], [21265, 0.066275, " and", false], [4596, 0.065472, " in", false], [1941, 0.055792, "ie", false], [46787, 0.039394, " people", false], [45, 0.03481, ",", false], [1858, 0.018226, "es", false], [19712, 0.017766, " Dad", false], [2030, 0.016569, "ly", false], [8795, 0.014406, "ter", false]]], "qwen": [73013, 761, 0.00010748509521363303, [[6712, 0.07193, "elle", false], [323, 0.065119, " and", false], [645, 0.064316, "ie", false], [12388, 0.06407, "mond", false], [288, 0.034253, "es", false], [32521, 0.028727, " Dad", false], [304, 0.027695, " in", false], [11, 0.024138, ",", false], [1933, 0.020337, "land", false], [2347, 0.01703, "ards", false]]]}, "raw_delta": 0.17669160025460395, "tuned_delta": 0.1835038780617019}, {"byte_start": 29, "byte_end": 30, "display": {"text": "\n", "kind": "control"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "0a", "compression": {"rwkv": "39.17%", "qwen": "18.95%"}, "model_tokens": {"rwkv": [[11, "\n", "control", 0.11564382910728455]], "qwen": [[198, "\n", "control", 0.349587619304657]]}, "loss": {"rwkv": 39.16691614913396, "qwen": 18.95342543052871}, "topk": {"rwkv": [11, 2, 0.11564382910728455, [[45, 0.227389, ",", false], [11, 0.115644, "\n", false], [4600, 0.084435, " is", false], [21265, 0.056511, " and", false], [460, 0.0564, "'s", false], [28309, 0.041, "’s", false], [22748, 0.034217, " was", false], [21800, 0.026608, " has", false], [59, 0.023176, ":", false], [275, 0.013377, " (", false]]], "qwen": [198, 1, 0.349587619304657, [[198, 0.349588, "\n", false], [11, 0.156176, ",", false], [323, 0.072967, " and", false], [594, 0.045174, "'s", false], [271, 0.036277, "\n\n", false], [320, 0.024252, " (", false], [374, 0.018142, " is", false], [748, 0.015414, "’s", false], [25, 0.013219, ":", false], [702, 0.013153, " has", false]]]}, "raw_delta": 1.1208739280700684, "tuned_delta": 1.1276862058771664}, {"byte_start": 30, "byte_end": 35, "display": {"text": "March", "kind": "normal"}, "is_word": true, "word_id": 5, "word_key": "march", "bytes_hex": "4d 61 72 63 68", "compression": {"rwkv": "15.89% 15.89% 15.89% 15.89% 15.89%", "qwen": "30.01% 30.01% 30.01% 30.01% 30.01%"}, "model_tokens": {"rwkv": [[33258, "March", "normal", 0.012115908786654472]], "qwen": [[27523, "March", "normal", 0.00024377863155677915]]}, "loss": {"rwkv": 15.892187559792486, "qwen": 30.005352182529908}, "topk": {"rwkv": [33258, 10, 0.012115908786654472, [[6699, 0.063861, "The", false], [1136, 0.025809, "In", false], [66, 0.024897, "A", false], [58067, 0.021498, "Published", false], [41, 0.015199, "(", false], [640, 0.013741, "20", false], [74, 0.013632, "I", false], [32908, 0.012517, "April", false], [35, 0.012323, "\"", false], [33258, 0.012116, "March", false]]], "qwen": [27523, 510, 0.00024377863155677915, [[785, 0.081713, "The", false], [16, 0.039271, "1", false], [32, 0.029568, "A", false], [1986, 0.018435, "This", false], [25020, 0.017801, "Chapter", false], [17, 0.015555, "2", false], [33, 0.014165, "B", false], [15, 0.011578, "0", false], [50, 0.010767, "S", false], [2082, 0.009907, "An", false]]]}, "raw_delta": -0.7826000213623047, "tuned_delta": -0.7757877435552067}, {"byte_start": 35, "byte_end": 38, "display": {"text": " 13", "kind": "normal"}, "is_word": true, "word_id": 6, "word_key": " 13", "bytes_hex": "20 31 33", "compression": {"rwkv": "21.88% 21.88% 21.88%", "qwen": "0.97% 20.04% 48.62%"}, "model_tokens": {"rwkv": [[3486, " 13", "normal", 0.026340743526816368]], "qwen": [[220, " ", "normal", 0.947685718536377], [16, "1", "normal", 0.32922863960266113], [18, "3", "normal", 0.0674586296081543]]}, "loss": {"rwkv": 21.884631805151592, "qwen": 23.209212465823803}, "topk": {"rwkv": [3486, 21, 0.026340743526816368, [[3493, 0.095413, " 20", false], [3492, 0.044164, " 19", false], [284, 0.043171, " 1", false], [3495, 0.030764, " 22", false], [3488, 0.030227, " 15", false], [3504, 0.030168, " 31", false], [3503, 0.030056, " 30", false], [3485, 0.02991, " 12", false], [3491, 0.029421, " 18", false], [3502, 0.029191, " 29", false]]], "qwen": [220, 1, 0.947685718536377, [[220, 0.947686, " ", false], [11, 0.008321, ",", false], [315, 0.005407, " of", false], [287, 0.003772, "ing", false], [198, 0.003389, "\n", false], [374, 0.001193, " is", false], [4102, 0.001136, " ", false], [68, 0.000797, "e", false], [64, 0.000787, "a", false], [278, 0.000753, "al", false]]]}, "raw_delta": -0.07345034802953394, "tuned_delta": -0.066638070222436}, {"byte_start": 38, "byte_end": 39, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "0.99%", "qwen": "1.07%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.9466378092765808]], "qwen": [[11, ",", "normal", 0.9425589442253113]]}, "loss": {"rwkv": 0.9906200689697776, "qwen": 1.0668151685550242}, "topk": {"rwkv": [45, 1, 0.9466378092765808, [[45, 0.946638, ",", false], [2209, 0.031083, "th", false], [3493, 0.007097, " 20", false], [11, 0.004076, "\n", false], [46, 0.001755, "-", false], [261, 0.001278, "\n\n", false], [9815, 0.001254, "–", false], [280, 0.000902, " -", false], [22897, 0.00071, " –", false], [47, 0.000483, ".", false]]], "qwen": [11, 1, 0.9425589442253113, [[11, 0.942559, ",", false], [339, 0.020566, "th", false], [220, 0.012831, " ", false], [198, 0.006914, "\n", false], [12, 0.00258, "-", false], [481, 0.002276, " -", false], [345, 0.001089, ",\n", false], [271, 0.001017, "\n\n", false], [13, 0.000906, ".", false], [15, 0.000865, "0", false]]]}, "raw_delta": -0.004225153475999832, "tuned_delta": 0.0025871243310981147}, {"byte_start": 39, "byte_end": 42, "display": {"text": " 20", "kind": "normal"}, "is_word": true, "word_id": 7, "word_key": " 20", "bytes_hex": "20 32 30", "compression": {"rwkv": "0.64% 0.64% 0.64%", "qwen": "0.09% 1.65% 0.01%"}, "model_tokens": {"rwkv": [[3493, " 20", "normal", 0.8995802402496338]], "qwen": [[220, " ", "normal", 0.9952646493911743], [17, "2", "normal", 0.9127693772315979], [15, "0", "normal", 0.9992802739143372]]}, "loss": {"rwkv": 0.6369320147153829, "qwen": 0.5815180772308782}, "topk": {"rwkv": [3493, 1, 0.8995802402496338, [[3493, 0.89958, " 20", false], [3492, 0.089947, " 19", false], [3491, 0.006623, " 18", false], [3490, 0.000682, " 17", false], [11, 0.000537, "\n", false], [640, 0.000404, "20", false], [3489, 0.000126, " 16", false], [3488, 9.9e-05, " 15", false], [639, 9.4e-05, "19", false], [3485, 9.1e-05, " 12", false]]], "qwen": [220, 1, 0.9952646493911743, [[220, 0.995265, " ", false], [17, 0.001133, "2", false], [4102, 0.000583, " ", false], [16, 0.000191, "1", false], [198, 7.9e-05, "\n", false], [715, 7e-05, " \n", false], [279, 5.3e-05, " the", false], [378, 5.2e-05, "\\xe2\\x80", true], [15585, 4.5e-05, " Chapter", false], [576, 3.2e-05, " The", false]]]}, "raw_delta": 0.0030728011624887564, "tuned_delta": 0.009885078969586703}, {"byte_start": 42, "byte_end": 44, "display": {"text": "19", "kind": "normal"}, "is_word": true, "word_id": 8, "word_key": "19", "bytes_hex": "31 39", "compression": {"rwkv": "25.22% 25.22%", "qwen": "10.29% 37.86%"}, "model_tokens": {"rwkv": [[639, "19", "normal", 0.06140715628862381]], "qwen": [[16, "1", "normal", 0.5653393268585205], [24, "9", "normal", 0.12255670875310898]]}, "loss": {"rwkv": 25.218985578039494, "qwen": 24.070560140541627}, "topk": {"rwkv": [639, 3, 0.06140715628862381, [[640, 0.072187, "20", false], [638, 0.061581, "18", false], [639, 0.061407, "19", false], [641, 0.060283, "21", false], [637, 0.058121, "17", false], [634, 0.056087, "14", false], [636, 0.056072, "16", false], [633, 0.054648, "13", false], [644, 0.05315, "24", false], [643, 0.05269, "23", false]]], "qwen": [16, 1, 0.5653393268585205, [[16, 0.565339, "1", false], [15, 0.273209, "0", false], [17, 0.160743, "2", false], [18, 0.000155, "3", false], [19, 7.8e-05, "4", false], [20, 7.4e-05, "5", false], [24, 5.4e-05, "9", false], [220, 5e-05, " ", false], [21, 5e-05, "6", false], [198, 4.7e-05, "\n", false]]]}, "raw_delta": 0.06368222832679749, "tuned_delta": 0.07049450613389543}, {"byte_start": 44, "byte_end": 45, "display": {"text": "\n", "kind": "control"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "0a", "compression": {"rwkv": "9.30%", "qwen": "5.68%"}, "model_tokens": {"rwkv": [[11, "\n", "control", 0.5939339399337769]], "qwen": [[198, "\n", "control", 0.7300056219100952]]}, "loss": {"rwkv": 9.298620380729647, "qwen": 5.675256033267606}, "topk": {"rwkv": [11, 1, 0.5939339399337769, [[11, 0.593934, "\n", false], [261, 0.259138, "\n\n", false], [45, 0.026202, ",", false], [4424, 0.012756, " at", false], [280, 0.011274, " -", false], [359, 0.010376, " |", false], [22907, 0.007756, " •", false], [4932, 0.003107, " ·", false], [22898, 0.002874, " —", false], [275, 0.002616, " (", false]]], "qwen": [198, 1, 0.7300056219100952, [[198, 0.730006, "\n", false], [271, 0.076219, "\n\n", false], [220, 0.029873, " ", false], [11, 0.020279, ",", false], [481, 0.015444, " -", false], [760, 0.012802, " |", false], [7288, 0.010354, " •", false], [151643, 0.009148, "\u003c|endoftext|\u003e", false], [9592, 0.007784, " ·", false], [553, 0.007227, " by", false]]]}, "raw_delta": 0.20092198252677917, "tuned_delta": 0.20773426033387712}, {"byte_start": 45, "byte_end": 48, "display": {"text": "The", "kind": "normal"}, "is_word": true, "word_id": 9, "word_key": "the", "bytes_hex": "54 68 65", "compression": {"rwkv": "15.12% 15.12% 15.12%", "qwen": "15.35% 15.35% 15.35%"}, "model_tokens": {"rwkv": [[6699, "The", "normal", 0.08124649524688721]], "qwen": [[785, "The", "normal", 0.07778266817331314]]}, "loss": {"rwkv": 15.121998800984576, "qwen": 15.351697396288186}, "topk": {"rwkv": [6699, 1, 0.08124649524688721, [[6699, 0.081246, "The", false], [1136, 0.037119, "In", false], [74, 0.028632, "I", false], [66, 0.025413, "A", false], [33427, 0.02382, "Share", false], [1141, 0.019597, "It", false], [35, 0.019504, "\"", false], [24327, 0.017262, "When", false], [24242, 0.014833, "This", false], [853, 0.014376, "As", false]]], "qwen": [785, 1, 0.07778266817331314, [[785, 0.077783, "The", false], [16, 0.045669, "1", false], [1986, 0.029479, "This", false], [641, 0.02658, "In", false], [17, 0.021241, "2", false], [15949, 0.019793, "Abstract", false], [32, 0.017704, "A", false], [37155, 0.013513, "Introduction", false], [18, 0.013196, "3", false], [25020, 0.011838, "Chapter", false]]]}, "raw_delta": -0.012737194697062248, "tuned_delta": -0.005924916889964302}, {"byte_start": 48, "byte_end": 56, "display": {"text": " biggest", "kind": "normal"}, "is_word": true, "word_id": 10, "word_key": " biggest", "bytes_hex": "20 62 69 67 67 65 73 74", "compression": {"rwkv": "15.00% 15.00% 15.00% 15.00% 15.00% 15.00% 15.00% 15.00%", "qwen": "17.46% 17.46% 17.46% 17.46% 17.46% 17.46% 17.46% 17.46%"}, "model_tokens": {"rwkv": [[51039, " biggest", "normal", 0.001282040379010141]], "qwen": [[8538, " biggest", "normal", 0.00043262317194603384]]}, "loss": {"rwkv": 15.004591977995565, "qwen": 17.460315051400524}, "topk": {"rwkv": [51039, 81, 0.001282040379010141, [[19523, 0.103541, " Bit", false], [45315, 0.022804, " bitter", false], [39831, 0.016756, " story", false], [46430, 0.011978, " lesson", false], [31461, 0.009805, " most", false], [59725, 0.008755, " following", false], [38499, 0.008056, " first", false], [32512, 0.00648, " year", false], [47014, 0.005905, " recent", false], [40213, 0.005767, " world", false]]], "qwen": [8538, 212, 0.00043262317194603384, [[425, 0.396047, " B", false], [2701, 0.017174, " following", false], [1156, 0.01285, " first", false], [5795, 0.009658, " goal", false], [3491, 0.009548, " problem", false], [2311, 0.009273, " book", false], [17755, 0.005431, " lesson", false], [22079, 0.00476, " Problem", false], [220, 0.004692, " ", false], [1429, 0.004305, " most", false]]]}, "raw_delta": -0.13617420196533203, "tuned_delta": -0.12936192415823408}, {"byte_start": 56, "byte_end": 63, "display": {"text": " lesson", "kind": "normal"}, "is_word": true, "word_id": 11, "word_key": " lesson", "bytes_hex": "20 6c 65 73 73 6f 6e", "compression": {"rwkv": "2.82% 2.82% 2.82% 2.82% 2.82% 2.82% 2.82%", "qwen": "4.68% 4.68% 4.68% 4.68% 4.68% 4.68% 4.68%"}, "model_tokens": {"rwkv": [[46430, " lesson", "normal", 0.3380398750305176]], "qwen": [[17755, " lesson", "normal", 0.16280625760555267]]}, "loss": {"rwkv": 2.8177637517362566, "qwen": 4.676378416939369}, "topk": {"rwkv": [46430, 1, 0.3380398750305176, [[46430, 0.33804, " lesson", false], [52569, 0.051829, " problem", false], [59281, 0.038835, " challenge", false], [52245, 0.028713, " mistake", false], [47009, 0.023961, " reason", false], [39941, 0.015194, " thing", false], [56739, 0.015088, " obstacle", false], [31887, 0.012712, " risk", false], [52127, 0.012405, " lessons", false], [32187, 0.010845, " take", false]]], "qwen": [17755, 1, 0.16280625760555267, [[17755, 0.162806, " lesson", false], [3491, 0.111456, " problem", false], [8645, 0.099703, " challenge", false], [16523, 0.061177, " mistake", false], [88374, 0.031043, " takeaway", false], [3166, 0.025807, " thing", false], [6672, 0.023547, " difference", false], [4265, 0.012921, " issue", false], [12761, 0.011748, " surprise", false], [323, 0.009962, " and", false]]]}, "raw_delta": -0.10306348119463238, "tuned_delta": -0.09625120338753443}, {"byte_start": 63, "byte_end": 68, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 12, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"rwkv": "9.19% 9.19% 9.19% 9.19% 9.19%", "qwen": "9.58% 9.58% 9.58% 9.58% 9.58%"}, "model_tokens": {"rwkv": [[32227, " that", "normal", 0.07774458825588226]], "qwen": [[429, " that", "normal", 0.0701269581913948]]}, "loss": {"rwkv": 9.185909830660195, "qwen": 9.584716960092944}, "topk": {"rwkv": [32227, 3, 0.07774458825588226, [[308, 0.393357, " I", false], [4706, 0.081389, " of", false], [32227, 0.077745, " that", false], [4858, 0.059863, " we", false], [30917, 0.041948, " from", false], [4596, 0.041863, " in", false], [4811, 0.034549, " to", false], [22799, 0.027075, " you", false], [52112, 0.024619, " learned", false], [21700, 0.019025, " for", false]]], "qwen": [429, 5, 0.0701269581913948, [[358, 0.284519, " I", false], [315, 0.126414, " of", false], [304, 0.088273, " in", false], [582, 0.079642, " we", false], [429, 0.070127, " that", false], [504, 0.051129, " from", false], [374, 0.033558, " is", false], [498, 0.0333, " you", false], [311, 0.024325, " to", false], [9498, 0.018782, " learned", false]]]}, "raw_delta": -0.022114562988281183, "tuned_delta": -0.015302285181183237}, {"byte_start": 68, "byte_end": 72, "display": {"text": " can", "kind": "normal"}, "is_word": true, "word_id": 13, "word_key": " can", "bytes_hex": "20 63 61 6e", "compression": {"rwkv": "14.02% 14.02% 14.02% 14.02%", "qwen": "15.66% 15.66% 15.66% 15.66%"}, "model_tokens": {"rwkv": [[21413, " can", "normal", 0.04433293640613556]], "qwen": [[646, " can", "normal", 0.031018095090985298]]}, "loss": {"rwkv": 14.018374664887876, "qwen": 15.658581805299024}, "topk": {"rwkv": [21413, 3, 0.04433293640613556, [[308, 0.316461, " I", false], [22590, 0.069035, " the", false], [21413, 0.044333, " can", false], [4858, 0.040848, " we", false], [332, 0.018387, " a", false], [21273, 0.016779, " any", false], [22799, 0.016497, " you", false], [4677, 0.014884, " my", false], [21800, 0.010821, " has", false], [30383, 0.010286, " came", false]]], "qwen": [646, 4, 0.031018095090985298, [[358, 0.439486, " I", false], [582, 0.078553, " we", false], [498, 0.037389, " you", false], [646, 0.031018, " can", false], [264, 0.028214, " a", false], [279, 0.026695, " the", false], [5662, 0.014207, " machine", false], [12677, 0.013768, " humans", false], [46069, 0.012944, " Rein", false], [4041, 0.011765, " comes", false]]]}, "raw_delta": -0.09095239639282227, "tuned_delta": -0.08414011858572432}, {"byte_start": 72, "byte_end": 75, "display": {"text": " be", "kind": "normal"}, "is_word": true, "word_id": 14, "word_key": " be", "bytes_hex": "20 62 65", "compression": {"rwkv": "0.77% 0.77% 0.77%", "qwen": "0.73% 0.73% 0.73%"}, "model_tokens": {"rwkv": [[4435, " be", "normal", 0.8795601725578308]], "qwen": [[387, " be", "normal", 0.8855698108673096]]}, "loss": {"rwkv": 0.76901469057802, "qwen": 0.7305084468570671}, "topk": {"rwkv": [4435, 1, 0.8795601725578308, [[4435, 0.87956, " be", false], [30482, 0.057494, " come", false], [30789, 0.008311, " ever", false], [39903, 0.006853, " teach", false], [31073, 0.005149, " help", false], [56896, 0.004265, " possibly", false], [461, 0.003229, "'t", false], [21265, 0.002258, " and", false], [28310, 0.001992, "’t", false], [45846, 0.001047, " emerge", false]]], "qwen": [387, 1, 0.8855698108673096, [[387, 0.88557, " be", false], [2525, 0.048234, " come", false], [1492, 0.009508, " help", false], [3512, 0.005803, " ever", false], [4538, 0.003257, " teach", false], [10767, 0.002551, " possibly", false], [2297, 0.002033, " change", false], [32944, 0.001749, " emerge", false], [1281, 0.001438, " make", false], [944, 0.001403, "'t", false]]]}, "raw_delta": 0.002135239541530609, "tuned_delta": 0.008947517348628555}, {"byte_start": 75, "byte_end": 80, "display": {"text": " read", "kind": "normal"}, "is_word": true, "word_id": 15, "word_key": " read", "bytes_hex": "20 72 65 61 64", "compression": {"rwkv": "28.18% 28.18% 28.18% 28.18% 28.18%", "qwen": "32.52% 32.52% 32.52% 32.52% 32.52%"}, "model_tokens": {"rwkv": [[31834, " read", "normal", 0.0003959299356210977]], "qwen": [[1349, " read", "normal", 0.00012139618047513068]]}, "loss": {"rwkv": 28.177637517362562, "qwen": 32.519972434549345}, "topk": {"rwkv": [31834, 24, 0.0003959299356210977, [[52112, 0.720202, " learned", false], [38297, 0.084884, " drawn", false], [39887, 0.053843, " taken", false], [47512, 0.035506, " taught", false], [21762, 0.024501, " gle", false], [46418, 0.018943, " learnt", false], [51438, 0.013609, " derived", false], [59697, 0.010225, " extracted", false], [46071, 0.006341, " gained", false], [50937, 0.001521, " applied", false]]], "qwen": [1349, 49, 0.00012139618047513068, [[9498, 0.829011, " learned", false], [49250, 0.066563, " learnt", false], [14764, 0.019995, " drawn", false], [15599, 0.019093, " taught", false], [4429, 0.013984, " taken", false], [14257, 0.008978, " derived", false], [18163, 0.006738, " gained", false], [94016, 0.005617, " glean", false], [27432, 0.004285, " extracted", false], [9251, 0.001362, " applied", false]]]}, "raw_delta": -0.2407901763916016, "tuned_delta": -0.23397789858450366}, {"byte_start": 80, "byte_end": 85, "display": {"text": " from", "kind": "normal"}, "is_word": true, "word_id": 16, "word_key": " from", "bytes_hex": "20 66 72 6f 6d", "compression": {"rwkv": "2.58% 2.58% 2.58% 2.58% 2.58%", "qwen": "1.74% 1.74% 1.74% 1.74% 1.74%"}, "model_tokens": {"rwkv": [[30917, " from", "normal", 0.4888441562652588]], "qwen": [[504, " from", "normal", 0.6165587902069092]]}, "loss": {"rwkv": 2.5782538328386746, "qwen": 1.7442240749686408}, "topk": {"rwkv": [30917, 1, 0.4888441562652588, [[30917, 0.488844, " from", false], [31162, 0.342525, " into", false], [4596, 0.067018, " in", false], [51035, 0.036986, " between", false], [22249, 0.020543, " out", false], [4450, 0.005106, " by", false], [22218, 0.004304, " off", false], [4712, 0.00384, " on", false], [37598, 0.002959, " about", false], [4424, 0.00199, " at", false]]], "qwen": [504, 1, 0.6165587902069092, [[504, 0.616559, " from", false], [304, 0.120954, " in", false], [1119, 0.042574, " into", false], [700, 0.032714, " out", false], [911, 0.024167, " about", false], [1588, 0.015949, " here", false], [374, 0.013519, " is", false], [1007, 0.01317, " off", false], [389, 0.011411, " on", false], [1948, 0.010526, " between", false]]]}, "raw_delta": 0.046248430013656625, "tuned_delta": 0.053060707820754574}, {"byte_start": 85, "byte_end": 88, "display": {"text": " 70", "kind": "normal"}, "is_word": true, "word_id": 17, "word_key": " 70", "bytes_hex": "20 37 30", "compression": {"rwkv": "63.12% 63.12% 63.12%", "qwen": "94.00% 66.29% 22.98%"}, "model_tokens": {"rwkv": [[3543, " 70", "normal", 2.7480899007059634e-05]], "qwen": [[220, " ", "normal", 0.005448168609291315], [22, "7", "normal", 0.025329088792204857], [15, "0", "normal", 0.2796103358268738]]}, "loss": {"rwkv": 63.11790803889214, "qwen": 61.08993448195813}, "topk": {"rwkv": [3543, 1798, 2.7480899007059634e-05, [[22590, 0.502495, " the", false], [32234, 0.09232, " this", false], [332, 0.020958, " a", false], [22248, 0.007679, " our", false], [39936, 0.007478, " these", false], [51929, 0.006543, " history", false], [21256, 0.006136, " all", false], [4677, 0.005875, " my", false], [50018, 0.00543, " Bitcoin", false], [37494, 0.004859, " Trump", false]]], "qwen": [220, 15, 0.005448168609291315, [[279, 0.268288, " the", false], [419, 0.195308, " this", false], [73013, 0.057031, " Sutton", false], [1493, 0.041197, " these", false], [678, 0.032129, " all", false], [576, 0.020956, " The", false], [264, 0.020694, " a", false], [894, 0.015734, " any", false], [847, 0.015447, " my", false], [1039, 0.013623, " our", false]]]}, "raw_delta": 0.11245473225911458, "tuned_delta": 0.11926701006621253}, {"byte_start": 88, "byte_end": 94, "display": {"text": " years", "kind": "normal"}, "is_word": true, "word_id": 18, "word_key": " years", "bytes_hex": "20 79 65 61 72 73", "compression": {"rwkv": "1.04% 1.04% 1.04% 1.04% 1.04% 1.04%", "qwen": "2.10% 2.10% 2.10% 2.10% 2.10% 2.10%"}, "model_tokens": {"rwkv": [[40237, " years", "normal", 0.7099425792694092]], "qwen": [[1635, " years", "normal", 0.49800431728363037]]}, "loss": {"rwkv": 1.0390503834527445, "qwen": 2.0953538514617325}, "topk": {"rwkv": [40237, 1, 0.7099425792694092, [[40237, 0.709943, " years", false], [49, 0.095774, "0", false], [46, 0.028637, "-", false], [38, 0.020527, "%", false], [44, 0.01886, "+", false], [45, 0.013827, ",", false], [620, 0.0086, "00", false], [37583, 0.007094, " Years", false], [116, 0.006678, "s", false], [52442, 0.006124, " percent", false]]], "qwen": [1635, 1, 0.49800431728363037, [[1635, 0.498004, " years", false], [15, 0.166918, "0", false], [11, 0.063044, ",", false], [10, 0.057261, "+", false], [82, 0.035846, "s", false], [4, 0.020973, "%", false], [594, 0.014383, "'s", false], [748, 0.011282, "’s", false], [3526, 0.011117, " million", false], [4666, 0.00788, "-year", false]]]}, "raw_delta": -0.058573901653289795, "tuned_delta": -0.051761623846191845}, {"byte_start": 94, "byte_end": 97, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 19, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "0.45% 0.45% 0.45%", "qwen": "0.21% 0.21% 0.21%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.9283893704414368]], "qwen": [[315, " of", "normal", 0.9662426114082336]]}, "loss": {"rwkv": 0.44614592735824055, "qwen": 0.20642770791094583}, "topk": {"rwkv": [4706, 1, 0.9283893704414368, [[4706, 0.928389, " of", false], [4596, 0.020701, " in", false], [21240, 0.012154, " ago", false], [39690, 0.003084, " since", false], [40, 0.002812, "'", false], [37634, 0.002506, " after", false], [9820, 0.002282, "’", false], [21265, 0.002265, " and", false], [40218, 0.002198, " worth", false], [4712, 0.002055, " on", false]]], "qwen": [315, 1, 0.9662426114082336, [[315, 0.966243, " of", false], [304, 0.005526, " in", false], [5802, 0.004527, " worth", false], [198, 0.002633, "\n", false], [4134, 0.002496, " ago", false], [527, 0.00184, "’", false], [323, 0.001746, " and", false], [6, 0.001554, "'", false], [320, 0.001478, " (", false], [374, 0.000932, " is", false]]]}, "raw_delta": 0.01329280063509941, "tuned_delta": 0.020105078442197357}, {"byte_start": 97, "byte_end": 100, "display": {"text": " AI", "kind": "normal"}, "is_word": true, "word_id": 20, "word_key": " ai", "bytes_hex": "20 41 49", "compression": {"rwkv": "29.12% 29.12% 29.12%", "qwen": "18.81% 18.81% 18.81%"}, "model_tokens": {"rwkv": [[3609, " AI", "normal", 0.007846316322684288]], "qwen": [[15235, " AI", "normal", 0.04373104125261307]]}, "loss": {"rwkv": 29.116892101274647, "qwen": 18.813326929947113}, "topk": {"rwkv": [3609, 11, 0.007846316322684288, [[51929, 0.062812, " history", false], [22590, 0.057853, " the", false], [54830, 0.04225, " American", false], [320, 0.027267, " U", false], [4273, 0.021134, " US", false], [57103, 0.016071, " research", false], [22747, 0.014788, " war", false], [39750, 0.013998, " space", false], [56077, 0.012379, " economic", false], [61979, 0.011823, " experience", false]]], "qwen": [15235, 3, 0.04373104125261307, [[3412, 0.184863, " research", false], [71278, 0.146839, " reinforcement", false], [15235, 0.043731, " AI", false], [5662, 0.039956, " machine", false], [3139, 0.035446, " experience", false], [975, 0.034034, " work", false], [6366, 0.015723, " computer", false], [3738, 0.015547, " human", false], [279, 0.013831, " the", false], [20443, 0.012459, " artificial", false]]]}, "raw_delta": 0.5713509718577066, "tuned_delta": 0.5781632496648045}, {"byte_start": 100, "byte_end": 109, "display": {"text": " research", "kind": "normal"}, "is_word": true, "word_id": 21, "word_key": " research", "bytes_hex": "20 72 65 73 65 61 72 63 68", "compression": {"rwkv": "2.02% 2.02% 2.02% 2.02% 2.02% 2.02% 2.02% 2.02% 2.02%", "qwen": "0.93% 0.93% 0.93% 0.93% 0.93% 0.93% 0.93% 0.93% 0.93%"}, "model_tokens": {"rwkv": [[57103, " research", "normal", 0.3593689203262329]], "qwen": [[3412, " research", "normal", 0.6299545168876648]]}, "loss": {"rwkv": 2.019397355410984, "qwen": 0.925945037653647}, "topk": {"rwkv": [57103, 1, 0.3593689203262329, [[57103, 0.359369, " research", false], [4600, 0.238561, " is", false], [63469, 0.07371, " development", false], [51929, 0.056524, " history", false], [56950, 0.056204, " progress", false], [21265, 0.01426, " and", false], [45, 0.010467, ",", false], [32499, 0.010087, " work", false], [47160, 0.008995, " safety", false], [4596, 0.005423, " in", false]]], "qwen": [3412, 1, 0.6299545168876648, [[3412, 0.629955, " research", false], [374, 0.16431, " is", false], [3840, 0.03876, " history", false], [3139, 0.016074, " experience", false], [323, 0.013818, " and", false], [4401, 0.013259, " development", false], [198, 0.012023, "\n", false], [5098, 0.008429, " progress", false], [11, 0.00837, ",", false], [975, 0.006823, " work", false]]]}, "raw_delta": 0.06063387129041885, "tuned_delta": 0.0674461490975168}, {"byte_start": 109, "byte_end": 112, "display": {"text": " is", "kind": "normal"}, "is_word": true, "word_id": 22, "word_key": " is", "bytes_hex": "20 69 73", "compression": {"rwkv": "1.30% 1.30% 1.30%", "qwen": "1.30% 1.30% 1.30%"}, "model_tokens": {"rwkv": [[4600, " is", "normal", 0.8060591220855713]], "qwen": [[374, " is", "normal", 0.8059275150299072]]}, "loss": {"rwkv": 1.2973453940285682, "qwen": 1.2969914859798395}, "topk": {"rwkv": [4600, 1, 0.8060591220855713, [[4600, 0.806059, " is", false], [45, 0.044589, ",", false], [21265, 0.026232, " and", false], [59, 0.01182, ":", false], [4596, 0.007152, " in", false], [22074, 0.006711, " may", false], [275, 0.006328, " (", false], [64, 0.006295, "?", false], [11, 0.004805, "\n", false], [39021, 0.00433, " might", false]]], "qwen": [374, 1, 0.8059275150299072, [[374, 0.805928, " is", false], [323, 0.036311, " and", false], [11, 0.033098, ",", false], [198, 0.017596, "\n", false], [304, 0.013902, " in", false], [25, 0.01129, ":", false], [320, 0.008696, " (", false], [389, 0.0061, " on", false], [13, 0.003515, ".", false], [429, 0.002065, " that", false]]]}, "raw_delta": 1.9624829292297363e-05, "tuned_delta": 0.006831902636390244}, {"byte_start": 112, "byte_end": 117, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 23, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"rwkv": "1.66% 1.66% 1.66% 1.66% 1.66%", "qwen": "2.50% 2.50% 2.50% 2.50% 2.50%"}, "model_tokens": {"rwkv": [[32227, " that", "normal", 0.6279953718185425]], "qwen": [[429, " that", "normal", 0.500173807144165]]}, "loss": {"rwkv": 1.6624806135243915, "qwen": 2.4987466833014254}, "topk": {"rwkv": [32227, 1, 0.6279953718185425, [[32227, 0.627995, " that", false], [32234, 0.132264, " this", false], [22187, 0.043316, " not", false], [22590, 0.033378, " the", false], [59, 0.032646, ":", false], [332, 0.010925, " a", false], [21835, 0.009721, " how", false], [4811, 0.006884, " to", false], [45, 0.006842, ",", false], [22226, 0.006081, " one", false]]], "qwen": [429, 1, 0.500173807144165, [[429, 0.500174, " that", false], [279, 0.096222, " the", false], [419, 0.095586, " this", false], [25, 0.052095, ":", false], [537, 0.02853, " not", false], [1246, 0.021607, " how", false], [311, 0.019934, " to", false], [825, 0.013768, " one", false], [11, 0.011314, ",", false], [4658, 0.010545, " probably", false]]]}, "raw_delta": -0.04637243747711181, "tuned_delta": -0.03956015967001386}, {"byte_start": 117, "byte_end": 125, "display": {"text": " general", "kind": "normal"}, "is_word": true, "word_id": 24, "word_key": " general", "bytes_hex": "20 67 65 6e 65 72 61 6c", "compression": {"rwkv": "15.22% 15.22% 15.22% 15.22% 15.22% 15.22% 15.22% 15.22%", "qwen": "13.08% 13.08% 13.08% 13.08% 13.08% 13.08% 13.08% 13.08%"}, "model_tokens": {"rwkv": [[51832, " general", "normal", 0.0011662570759654045]], "qwen": [[4586, " general", "normal", 0.0030250304844230413]]}, "loss": {"rwkv": 15.215924259375784, "qwen": 13.076304223365101}, "topk": {"rwkv": [51832, 97, 0.0011662570759654045, [[22590, 0.111152, " the", false], [4601, 0.090176, " it", false], [4858, 0.058285, " we", false], [3609, 0.0475, " AI", false], [39934, 0.03984, " there", false], [45, 0.030388, ",", false], [22799, 0.025292, " you", false], [4588, 0.019248, " if", false], [52167, 0.017457, " machine", false], [269, 0.01679, " \"", false]]], "qwen": [4586, 48, 0.0030250304844230413, [[279, 0.099251, " the", false], [432, 0.067776, " it", false], [1052, 0.061612, " there", false], [582, 0.054925, " we", false], [498, 0.053064, " you", false], [264, 0.028246, " a", false], [12677, 0.0213, " humans", false], [6832, 0.019795, " learning", false], [421, 0.018688, " if", false], [902, 0.017065, " no", false]]]}, "raw_delta": 0.11864572763442993, "tuned_delta": 0.12545800544152788}, {"byte_start": 125, "byte_end": 133, "display": {"text": " methods", "kind": "normal"}, "is_word": true, "word_id": 25, "word_key": " methods", "bytes_hex": "20 6d 65 74 68 6f 64 73", "compression": {"rwkv": "13.53% 13.53% 13.53% 13.53% 13.53% 13.53% 13.53% 13.53%", "qwen": "9.43% 9.43% 9.43% 9.43% 9.43% 9.43% 9.43% 9.43%"}, "model_tokens": {"rwkv": [[52224, " methods", "normal", 0.0024896995164453983]], "qwen": [[5413, " methods", "normal", 0.015259837731719017]]}, "loss": {"rwkv": 13.52526600833403, "qwen": 9.42830712328745}, "topk": {"rwkv": [52224, 21, 0.0024896995164453983, [[64452, 0.350111, " intelligence", false], [3609, 0.227883, " AI", false], [46, 0.094399, "-", false], [61594, 0.090246, " artificial", false], [52610, 0.030009, " purpose", false], [45, 0.028176, ",", false], [7933, 0.014389, "ity", false], [7919, 0.013123, "ist", false], [38720, 0.013118, " human", false], [63659, 0.013008, " intelligent", false]]], "qwen": [5413, 11, 0.015259837731719017, [[2022, 0.265766, "ization", false], [11229, 0.17726, " intelligence", false], [58238, 0.089942, "-purpose", false], [3491, 0.04714, " problem", false], [15235, 0.046259, " AI", false], [4849, 0.044556, "izing", false], [7428, 0.026199, " purpose", false], [6832, 0.025554, " learning", false], [7923, 0.019115, "isation", false], [6540, 0.018468, " knowledge", false]]]}, "raw_delta": 0.22718364000320435, "tuned_delta": 0.2339959178103023}, {"byte_start": 133, "byte_end": 138, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 26, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"rwkv": "11.67% 11.67% 11.67% 11.67% 11.67%", "qwen": "10.81% 10.81% 10.81% 10.81% 10.81%"}, "model_tokens": {"rwkv": [[32227, " that", "normal", 0.03920616954565048]], "qwen": [[429, " that", "normal", 0.049904197454452515]]}, "loss": {"rwkv": 11.6655419321881, "qwen": 10.811737501632706}, "topk": {"rwkv": [32227, 7, 0.03920616954565048, [[21286, 0.157716, " are", false], [21700, 0.11325, " for", false], [4706, 0.076352, " of", false], [21265, 0.056481, " and", false], [21556, 0.048066, " don", false], [21413, 0.047191, " can", false], [32227, 0.039206, " that", false], [4491, 0.037971, " do", false], [32475, 0.036844, " will", false], [46999, 0.030144, " rarely", false]]], "qwen": [429, 4, 0.049904197454452515, [[525, 0.289964, " are", false], [369, 0.190641, " for", false], [315, 0.055679, " of", false], [429, 0.049904, " that", false], [653, 0.046371, " do", false], [323, 0.030326, " and", false], [11, 0.025965, ",", false], [311, 0.023332, " to", false], [1513, 0.022734, " don", false], [614, 0.017888, " have", false]]]}, "raw_delta": 0.04734497070312493, "tuned_delta": 0.05415724851022288}, {"byte_start": 138, "byte_end": 147, "display": {"text": " leverage", "kind": "normal"}, "is_word": true, "word_id": 27, "word_key": " leverage", "bytes_hex": "20 6c 65 76 65 72 61 67 65", "compression": {"rwkv": "14.28% 14.28% 14.28% 14.28% 14.28% 14.28% 14.28% 14.28% 14.28%", "qwen": "14.46% 14.46% 14.46% 14.46% 14.46% 14.46% 14.46% 14.46% 14.46%"}, "model_tokens": {"rwkv": [[56540, " leverage", "normal", 0.0008020471432246268]], "qwen": [[32064, " leverage", "normal", 0.0007328909123316407]]}, "loss": {"rwkv": 14.276669675463701, "qwen": 14.464046684497074}, "topk": {"rwkv": [56540, 80, 0.0008020471432246268, [[32499, 0.446017, " work", false], [21286, 0.063173, " are", false], [31967, 0.036409, " seem", false], [21413, 0.030896, " can", false], [31059, 0.02524, " have", false], [45185, 0.020623, " appear", false], [31324, 0.016966, " look", false], [39740, 0.016139, " solve", false], [37730, 0.015608, " apply", false], [53051, 0.013037, " succeed", false]]], "qwen": [32064, 95, 0.0007328909123316407, [[975, 0.316427, " work", false], [646, 0.150735, " can", false], [525, 0.097766, " are", false], [3796, 0.039363, " apply", false], [614, 0.021262, " have", false], [11625, 0.01701, " solve", false], [5452, 0.016156, " scale", false], [653, 0.015514, " do", false], [686, 0.013696, " will", false], [2138, 0.012736, " allow", false]]]}, "raw_delta": -0.01039038764105904, "tuned_delta": -0.003578109833961093}, {"byte_start": 147, "byte_end": 159, "display": {"text": " computation", "kind": "normal"}, "is_word": true, "word_id": 28, "word_key": " computation", "bytes_hex": "20 63 6f 6d 70 75 74 61 74 69 6f 6e", "compression": {"rwkv": "8.88% 8.88% 8.88% 8.88% 8.88% 8.88% 8.88% 8.88% 8.88% 8.88% 8.88% 8.88%", "qwen": "11.05% 11.05% 11.05% 11.05% 11.05% 11.05% 11.05% 11.05% 11.05% 11.05% 11.05% 11.05%"}, "model_tokens": {"rwkv": [[63370, " computation", "normal", 0.0026856723707169294]], "qwen": [[34447, " computation", "normal", 0.0006424598395824432]]}, "loss": {"rwkv": 8.875955817969208, "qwen": 11.04594404885318}, "topk": {"rwkv": [63370, 61, 0.0026856723707169294, [[22590, 0.127826, " the", false], [30597, 0.049276, " deep", false], [332, 0.03404, " a", false], [63885, 0.032688, " statistical", false], [52167, 0.031758, " machine", false], [30579, 0.03025, " data", false], [38864, 0.026816, " large", false], [3609, 0.02405, " AI", false], [52195, 0.022373, " massive", false], [38720, 0.022351, " human", false]]], "qwen": [34447, 201, 0.0006424598395824432, [[279, 0.123796, " the", false], [3738, 0.062438, " human", false], [264, 0.041242, " a", false], [821, 0.029322, " data", false], [4867, 0.02503, " prior", false], [7947, 0.023999, " domain", false], [28464, 0.021281, " statistical", false], [3460, 0.021071, " large", false], [6540, 0.018823, " knowledge", false], [3139, 0.015167, " experience", false]]]}, "raw_delta": -0.12032969792683927, "tuned_delta": -0.11351742011974132}, {"byte_start": 159, "byte_end": 163, "display": {"text": " are", "kind": "normal"}, "is_word": true, "word_id": 29, "word_key": " are", "bytes_hex": "20 61 72 65", "compression": {"rwkv": "9.65% 9.65% 9.65% 9.65%", "qwen": "5.74% 5.74% 5.74% 5.74%"}, "model_tokens": {"rwkv": [[21286, " are", "normal", 0.11706499755382538]], "qwen": [[525, " are", "normal", 0.2796705365180969]]}, "loss": {"rwkv": 9.650840849696678, "qwen": 5.744374248312017}, "topk": {"rwkv": [21286, 3, 0.11706499755382538, [[21265, 0.154963, " and", false], [4811, 0.123492, " to", false], [21286, 0.117065, " are", false], [39339, 0.060181, " power", false], [45, 0.048517, ",", false], [32475, 0.0384, " will", false], [21413, 0.038377, " can", false], [4596, 0.037718, " in", false], [31059, 0.025289, " have", false], [4491, 0.017289, " do", false]]], "qwen": [525, 1, 0.2796705365180969, [[525, 0.279671, " are", false], [323, 0.119331, " and", false], [311, 0.113936, " to", false], [2355, 0.060554, " power", false], [11, 0.03411, ",", false], [614, 0.030285, " have", false], [653, 0.027643, " do", false], [646, 0.026449, " can", false], [304, 0.024634, " in", false], [369, 0.016129, " for", false]]]}, "raw_delta": 0.21662050485610962, "tuned_delta": 0.22343278266320757}, {"byte_start": 163, "byte_end": 174, "display": {"text": " ultimately", "kind": "normal"}, "is_word": true, "word_id": 30, "word_key": " ultimately", "bytes_hex": "20 75 6c 74 69 6d 61 74 65 6c 79", "compression": {"rwkv": "9.02% 9.02% 9.02% 9.02% 9.02% 9.02% 9.02% 9.02% 9.02% 9.02% 9.02%", "qwen": "11.04% 11.04% 11.04% 11.04% 11.04% 11.04% 11.04% 11.04% 11.04% 11.04% 11.04%"}, "model_tokens": {"rwkv": [[62676, " ultimately", "normal", 0.00403135409578681]], "qwen": [[13653, " ultimately", "normal", 0.0011913263006135821]]}, "loss": {"rwkv": 9.01684400555602, "qwen": 11.037744906263184}, "topk": {"rwkv": [62676, 47, 0.00403135409578681, [[22187, 0.12203, " not", false], [22590, 0.071863, " the", false], [57492, 0.0477, " unlikely", false], [31458, 0.043964, " more", false], [46439, 0.032607, " likely", false], [21660, 0.027185, " far", false], [31466, 0.026087, " much", false], [39171, 0.025426, " often", false], [332, 0.020936, " a", false], [45145, 0.020156, " almost", false]]], "qwen": [13653, 98, 0.0011913263006135821, [[537, 0.088327, " not", false], [803, 0.087442, " more", false], [279, 0.065257, " the", false], [1753, 0.050196, " much", false], [3041, 0.048153, " far", false], [2664, 0.031781, " better", false], [7565, 0.028479, " essential", false], [16353, 0.026478, " superior", false], [3545, 0.024984, " often", false], [1602, 0.021899, " very", false]]]}, "raw_delta": -0.11206254092129794, "tuned_delta": -0.1052502631142}, {"byte_start": 174, "byte_end": 178, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 31, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "11.62% 11.62% 11.62% 11.62%", "qwen": "14.63% 14.63% 14.63% 14.63%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.07608481496572495]], "qwen": [[279, " the", "normal", 0.03898989409208298]]}, "loss": {"rwkv": 11.623275475912058, "qwen": 14.627363081809944}, "topk": {"rwkv": [22590, 3, 0.07608481496572495, [[31458, 0.109516, " more", false], [45781, 0.091171, " doomed", false], [22590, 0.076085, " the", false], [52140, 0.068525, " limited", false], [22187, 0.049502, " not", false], [31277, 0.041809, " less", false], [45301, 0.041013, " better", false], [38606, 0.038385, " going", false], [53247, 0.026486, " useless", false], [31466, 0.02359, " much", false]]], "qwen": [279, 7, 0.03898989409208298, [[803, 0.130619, " more", false], [7199, 0.071714, " limited", false], [16353, 0.06177, " superior", false], [2664, 0.047314, " better", false], [57637, 0.042213, " doomed", false], [537, 0.039317, " not", false], [279, 0.03899, " the", false], [1753, 0.037011, " much", false], [2686, 0.036432, " less", false], [37179, 0.020377, " inferior", false]]]}, "raw_delta": -0.16658198833465576, "tuned_delta": -0.1597697105275578}, {"byte_start": 178, "byte_end": 183, "display": {"text": " most", "kind": "normal"}, "is_word": true, "word_id": 32, "word_key": " most", "bytes_hex": "20 6d 6f 73 74", "compression": {"rwkv": "3.51% 3.51% 3.51% 3.51% 3.51%", "qwen": "4.69% 4.69% 4.69% 4.69% 4.69%"}, "model_tokens": {"rwkv": [[31461, " most", "normal", 0.37471139430999756]], "qwen": [[1429, " most", "normal", 0.272220253944397]]}, "loss": {"rwkv": 3.508115870911639, "qwen": 4.692884144744052}, "topk": {"rwkv": [31461, 1, 0.37471139430999756, [[31461, 0.374711, " most", false], [30273, 0.141316, " best", false], [31581, 0.11312, " only", false], [22752, 0.067529, " way", false], [21952, 0.059258, " key", false], [31580, 0.030902, " ones", false], [31637, 0.019826, " path", false], [38879, 0.010458, " least", false], [39523, 0.009677, " right", false], [31209, 0.009004, " keys", false]]], "qwen": [1429, 1, 0.272220253944397, [[1429, 0.27222, " most", false], [1172, 0.173044, " only", false], [1850, 0.172389, " best", false], [1376, 0.117854, " key", false], [1616, 0.056885, " way", false], [6894, 0.021108, " keys", false], [6174, 0.015336, " ones", false], [1815, 0.009391, " path", false], [25648, 0.007474, " fastest", false], [2530, 0.006102, " source", false]]]}, "raw_delta": -0.0656975030899048, "tuned_delta": -0.05888522528280685}, {"byte_start": 183, "byte_end": 193, "display": {"text": " effective", "kind": "normal"}, "is_word": true, "word_id": 33, "word_key": " effective", "bytes_hex": "20 65 66 66 65 63 74 69 76 65", "compression": {"rwkv": "3.80% 3.80% 3.80% 3.80% 3.80% 3.80% 3.80% 3.80% 3.80% 3.80%", "qwen": "2.96% 2.96% 2.96% 2.96% 2.96% 2.96% 2.96% 2.96% 2.96% 2.96%"}, "model_tokens": {"rwkv": [[59593, " effective", "normal", 0.11952142417430878]], "qwen": [[7373, " effective", "normal", 0.19383913278579712]]}, "loss": {"rwkv": 3.803981064843946, "qwen": 2.9588353158245524}, "topk": {"rwkv": [59593, 2, 0.11952142417430878, [[56900, 0.427487, " powerful", false], [59593, 0.119521, " effective", false], [59829, 0.100486, " important", false], [60274, 0.085096, " promising", false], [47687, 0.061325, " useful", false], [62603, 0.030542, " successful", false], [57516, 0.024352, " valuable", false], [56290, 0.015909, " fruitful", false], [59594, 0.012587, " efficient", false], [47129, 0.011052, " robust", false]]], "qwen": [7373, 2, 0.19383913278579712, [[7988, 0.240876, " powerful", false], [7373, 0.193839, " effective", false], [6849, 0.174028, " successful", false], [2989, 0.117221, " important", false], [5390, 0.059075, " useful", false], [15172, 0.055521, " valuable", false], [25383, 0.031705, " promising", false], [11050, 0.013268, " efficient", false], [88584, 0.011966, " fruitful", false], [21765, 0.011342, " robust", false]]]}, "raw_delta": 0.04686483144760132, "tuned_delta": 0.05367710925469927}, {"byte_start": 193, "byte_end": 194, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "50.44%", "qwen": "51.54%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.06067642942070961]], "qwen": [[11, ",", "normal", 0.057391125708818436]]}, "loss": {"rwkv": 50.43797115607899, "qwen": 51.53785610270818}, "topk": {"rwkv": [45, 3, 0.06067642942070961, [[47, 0.351136, ".", false], [22752, 0.202953, " way", false], [45, 0.060676, ",", false], [21700, 0.040878, " for", false], [21265, 0.036058, " and", false], [55532, 0.035508, " approach", false], [31580, 0.027537, " ones", false], [4424, 0.025718, " at", false], [32448, 0.021524, " ways", false], [4596, 0.019647, " in", false]]], "qwen": [11, 5, 0.057391125708818436, [[13, 0.32337, ".", false], [1616, 0.101312, " way", false], [624, 0.098027, ".\n", false], [6174, 0.05969, " ones", false], [11, 0.057391, ",", false], [369, 0.041388, " for", false], [323, 0.03413, " and", false], [5413, 0.033294, " methods", false], [5486, 0.026549, " approach", false], [19827, 0.023389, " approaches", false]]]}, "raw_delta": -0.06099057197570801, "tuned_delta": -0.05417829416861006}, {"byte_start": 194, "byte_end": 198, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 34, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"rwkv": "5.67% 5.67% 5.67% 5.67%", "qwen": "4.75% 4.75% 4.75% 4.75%"}, "model_tokens": {"rwkv": [[21265, " and", "normal", 0.28434309363365173]], "qwen": [[323, " and", "normal", 0.3485313057899475]]}, "loss": {"rwkv": 5.670749550369216, "qwen": 4.751999956303438}, "topk": {"rwkv": [21265, 1, 0.28434309363365173, [[21265, 0.284343, " and", false], [21400, 0.137567, " but", false], [40187, 0.086356, " while", false], [30788, 0.076157, " even", false], [22187, 0.033326, " not", false], [53339, 0.020322, " whereas", false], [62461, 0.017092, " regardless", false], [4423, 0.016463, " as", false], [51018, 0.015708, " because", false], [61953, 0.014199, " especially", false]]], "qwen": [323, 1, 0.3485313057899475, [[323, 0.348531, " and", false], [714, 0.111823, " but", false], [1393, 0.062869, " while", false], [1496, 0.038513, " even", false], [537, 0.027169, " not", false], [1576, 0.026478, " because", false], [15484, 0.023397, " regardless", false], [518, 0.020713, " at", false], [438, 0.019853, " as", false], [5310, 0.019235, " especially", false]]]}, "raw_delta": 0.05094629526138306, "tuned_delta": 0.057758573068481006}, {"byte_start": 198, "byte_end": 201, "display": {"text": " by", "kind": "normal"}, "is_word": true, "word_id": 35, "word_key": " by", "bytes_hex": "20 62 79", "compression": {"rwkv": "39.26% 39.26% 39.26%", "qwen": "40.06% 40.06% 40.06%"}, "model_tokens": {"rwkv": [[4450, " by", "normal", 0.0014676237478852272]], "qwen": [[553, " by", "normal", 0.0012753555784001946]]}, "loss": {"rwkv": 39.26084160752517, "qwen": 40.06201992019205}, "topk": {"rwkv": [4450, 59, 0.0014676237478852272, [[32227, 0.416345, " that", false], [22590, 0.07295, " the", false], [32232, 0.026392, " they", false], [4858, 0.014864, " we", false], [4601, 0.012604, " it", false], [39944, 0.010843, " those", false], [4788, 0.010553, " so", false], [39171, 0.009927, " often", false], [32239, 0.009589, " thus", false], [31461, 0.009535, " most", false]]], "qwen": [553, 73, 0.0012753555784001946, [[429, 0.410987, " that", false], [279, 0.063035, " the", false], [4586, 0.027629, " general", false], [419, 0.023899, " this", false], [304, 0.018764, " in", false], [807, 0.014569, " they", false], [5413, 0.0122, " methods", false], [525, 0.009973, " are", false], [264, 0.009383, " a", false], [1846, 0.008567, " those", false]]]}, "raw_delta": -0.04442675908406546, "tuned_delta": -0.03761448127696751}, {"byte_start": 201, "byte_end": 203, "display": {"text": " a", "kind": "normal"}, "is_word": true, "word_id": 36, "word_key": " a", "bytes_hex": "20 61", "compression": {"rwkv": "24.80% 24.80%", "qwen": "34.47% 34.47%"}, "model_tokens": {"rwkv": [[332, " a", "normal", 0.06361158192157745]], "qwen": [[264, " a", "normal", 0.021862488240003586]]}, "loss": {"rwkv": 24.796321015279055, "qwen": 34.47124158587966}, "topk": {"rwkv": [332, 3, 0.06361158192157745, [[21660, 0.370053, " far", false], [59695, 0.091128, " extension", false], [332, 0.063612, " a", false], [55856, 0.028193, " contrast", false], [21265, 0.023882, " and", false], [22590, 0.023564, " the", false], [22190, 0.02293, " now", false], [63617, 0.022857, " implication", false], [32227, 0.022389, " that", false], [51832, 0.020622, " general", false]]], "qwen": [264, 10, 0.021862488240003586, [[3041, 0.264678, " far", false], [8894, 0.082611, " extension", false], [429, 0.061582, " that", false], [4586, 0.046859, " general", false], [76482, 0.036838, " leveraging", false], [419, 0.034214, " this", false], [44378, 0.027155, " inference", false], [12872, 0.023993, " contrast", false], [323, 0.022239, " and", false], [264, 0.021862, " a", false]]]}, "raw_delta": -0.5364915132522583, "tuned_delta": -0.5296792354451604}, {"byte_start": 203, "byte_end": 209, "display": {"text": " large", "kind": "normal"}, "is_word": true, "word_id": 37, "word_key": " large", "bytes_hex": "20 6c 61 72 67 65", "compression": {"rwkv": "5.17% 5.17% 5.17% 5.17% 5.17% 5.17%", "qwen": "5.14% 5.14% 5.14% 5.14% 5.14% 5.14%"}, "model_tokens": {"rwkv": [[38864, " large", "normal", 0.17874637246131897]], "qwen": [[3460, " large", "normal", 0.18076620995998383]]}, "loss": {"rwkv": 5.16590021151647, "qwen": 5.141256172539397}, "topk": {"rwkv": [38864, 2, 0.17874637246131897, [[32470, 0.390515, " wide", false], [38864, 0.178746, " large", false], [31323, 0.087808, " long", false], [31118, 0.057719, " huge", false], [32386, 0.041865, " very", false], [63870, 0.041224, " significant", false], [22031, 0.031242, " lot", false], [64313, 0.023689, " considerable", false], [63893, 0.020013, " substantial", false], [21357, 0.017858, " big", false]]], "qwen": [3460, 2, 0.18076620995998383, [[6884, 0.310814, " wide", false], [3460, 0.180766, " large", false], [1293, 0.126867, " long", false], [1602, 0.068904, " very", false], [6765, 0.045274, " huge", false], [8168, 0.035746, " factor", false], [5089, 0.029993, " significant", false], [11924, 0.013267, " substantial", false], [4745, 0.012768, " margin", false], [23839, 0.012653, " considerable", false]]]}, "raw_delta": 0.0013665556907653809, "tuned_delta": 0.008178833497863327}, {"byte_start": 209, "byte_end": 216, "display": {"text": " margin", "kind": "normal"}, "is_word": true, "word_id": 38, "word_key": " margin", "bytes_hex": "20 6d 61 72 67 69 6e", "compression": {"rwkv": "0.23% 0.23% 0.23% 0.23% 0.23% 0.23% 0.23%", "qwen": "0.44% 0.44% 0.44% 0.44% 0.44% 0.44% 0.44%"}, "model_tokens": {"rwkv": [[46513, " margin", "normal", 0.9159622192382812]], "qwen": [[4745, " margin", "normal", 0.8445775508880615]]}, "loss": {"rwkv": 0.2251695140896384, "qwen": 0.43517526410812457}, "topk": {"rwkv": [46513, 1, 0.9159622192382812, [[46513, 0.915962, " margin", false], [39189, 0.016767, " order", false], [45950, 0.016394, " factor", false], [45157, 0.015507, " amount", false], [45690, 0.005538, " degree", false], [56024, 0.004976, " distance", false], [45865, 0.0031, " enough", false], [61863, 0.002332, " difference", false], [59977, 0.001892, " magnitude", false], [52208, 0.001749, " measure", false]]], "qwen": [4745, 1, 0.8445775508880615, [[4745, 0.844578, " margin", false], [8168, 0.082189, " factor", false], [8381, 0.016987, " degree", false], [3311, 0.01442, " amount", false], [12818, 0.003955, " extent", false], [14501, 0.003616, " stretch", false], [6629, 0.002516, " measure", false], [2990, 0.00228, " lead", false], [198, 0.001796, "\n", false], [323, 0.001686, " and", false]]]}, "raw_delta": -0.01164519148213523, "tuned_delta": -0.004832913675037283}, {"byte_start": 216, "byte_end": 217, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "2.40%", "qwen": "8.42%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.8767408132553101]], "qwen": [[13, ".", "normal", 0.6270043849945068]]}, "loss": {"rwkv": 2.3950991889758177, "qwen": 8.418156274529066}, "topk": {"rwkv": [47, 1, 0.8767408132553101, [[47, 0.876741, ".", false], [45, 0.05573, ",", false], [59, 0.011253, ":", false], [11, 0.006385, "\n", false], [275, 0.005561, " (", false], [22590, 0.005173, " the", false], [60, 0.004561, ";", false], [261, 0.003498, "\n\n", false], [31601, 0.002554, " over", false], [9816, 0.002534, "—", false]]], "qwen": [13, 1, 0.6270043849945068, [[13, 0.627004, ".", false], [624, 0.202733, ".\n", false], [11, 0.082328, ",", false], [320, 0.014542, " (", false], [382, 0.012179, ".\n\n", false], [198, 0.007495, "\n", false], [916, 0.006018, " over", false], [279, 0.004519, " the", false], [25, 0.003771, ":", false], [304, 0.002041, " in", false]]]}, "raw_delta": -0.3339892029762268, "tuned_delta": -0.3271769251691289}, {"byte_start": 217, "byte_end": 221, "display": {"text": " The", "kind": "normal"}, "is_word": true, "word_id": 39, "word_key": " the", "bytes_hex": "20 54 68 65", "compression": {"rwkv": "11.83% 11.83% 11.83% 11.83%", "qwen": "10.77% 10.77% 10.77% 10.77%"}, "model_tokens": {"rwkv": [[20996, " The", "normal", 0.07323290407657623]], "qwen": [[576, " The", "normal", 0.09180492162704468]]}, "loss": {"rwkv": 11.834607757292277, "qwen": 10.766514878566642}, "topk": {"rwkv": [20996, 3, 0.07323290407657623, [[11, 0.266959, "\n", false], [261, 0.082016, "\n\n", false], [20996, 0.073233, " The", false], [29894, 0.054, " This", false], [3913, 0.030268, " In", false], [19555, 0.026516, " But", false], [29889, 0.025946, " That", false], [3918, 0.021274, " It", false], [37451, 0.013413, " There", false], [3908, 0.011189, " If", false]]], "qwen": [576, 2, 0.09180492162704468, [[1096, 0.102863, " This", false], [576, 0.091805, " The", false], [758, 0.053598, " In", false], [1084, 0.031458, " It", false], [358, 0.028216, " I", false], [2619, 0.027395, " There", false], [1205, 0.024915, " We", false], [1988, 0.020156, " But", false], [2938, 0.018816, " That", false], [1752, 0.018054, " For", false]]]}, "raw_delta": 0.05922764539718628, "tuned_delta": 0.06603992320428423}, {"byte_start": 221, "byte_end": 230, "display": {"text": " ultimate", "kind": "normal"}, "is_word": true, "word_id": 40, "word_key": " ultimate", "bytes_hex": "20 75 6c 74 69 6d 61 74 65", "compression": {"rwkv": "14.15% 14.15% 14.15% 14.15% 14.15% 14.15% 14.15% 14.15% 14.15%", "qwen": "12.07% 12.07% 12.07% 12.07% 12.07% 12.07% 12.07% 12.07% 12.07%"}, "model_tokens": {"rwkv": [[57481, " ultimate", "normal", 0.0008589974022470415]], "qwen": [[16724, " ultimate", "normal", 0.0024230415001511574]]}, "loss": {"rwkv": 14.151435730942087, "qwen": 12.068007323696538}, "topk": {"rwkv": [57481, 209, 0.0008589974022470415, [[31461, 0.033656, " most", false], [39193, 0.02649, " other", false], [3609, 0.023725, " AI", false], [47205, 0.019348, " second", false], [30273, 0.015292, " best", false], [31581, 0.015138, " only", false], [47009, 0.013005, " reason", false], [38478, 0.012109, " field", false], [51039, 0.011445, " biggest", false], [51929, 0.011165, " history", false]]], "qwen": [16724, 62, 0.0024230415001511574, [[1429, 0.049734, " most", false], [1850, 0.027735, " best", false], [17755, 0.025101, " lesson", false], [2874, 0.023272, " reason", false], [2070, 0.020655, " field", false], [2086, 0.019784, " second", false], [8538, 0.014146, " biggest", false], [1008, 0.013724, " other", false], [18366, 0.012607, " lessons", false], [1172, 0.012375, " only", false]]]}, "raw_delta": 0.11552980211046004, "tuned_delta": 0.122342079917558}, {"byte_start": 230, "byte_end": 237, "display": {"text": " reason", "kind": "normal"}, "is_word": true, "word_id": 41, "word_key": " reason", "bytes_hex": "20 72 65 61 73 6f 6e", "compression": {"rwkv": "10.10% 10.10% 10.10% 10.10% 10.10% 10.10% 10.10%", "qwen": "10.78% 10.78% 10.78% 10.78% 10.78% 10.78% 10.78%"}, "model_tokens": {"rwkv": [[47009, " reason", "normal", 0.019715681672096252]], "qwen": [[2874, " reason", "normal", 0.015219236724078655]]}, "loss": {"rwkv": 10.103695738368575, "qwen": 10.782071477116876}, "topk": {"rwkv": [47009, 6, 0.019715681672096252, [[46430, 0.154506, " lesson", false], [30985, 0.082545, " goal", false], [32223, 0.031375, " test", false], [53052, 0.03054, " success", false], [39365, 0.021524, " proof", false], [47009, 0.019716, " reason", false], [57009, 0.017534, " question", false], [3609, 0.014529, " AI", false], [51668, 0.013045, " example", false], [51708, 0.011656, " failure", false]]], "qwen": [2874, 8, 0.015219236724078655, [[5795, 0.197554, " goal", false], [17755, 0.12357, " lesson", false], [4586, 0.046748, " general", false], [2393, 0.02311, " success", false], [9213, 0.020597, " aim", false], [3110, 0.016128, " example", false], [11064, 0.015232, " proof", false], [2874, 0.015219, " reason", false], [1273, 0.013686, " test", false], [1714, 0.013036, " method", false]]]}, "raw_delta": -0.03761713845389236, "tuned_delta": -0.030804860646794417}, {"byte_start": 237, "byte_end": 241, "display": {"text": " for", "kind": "normal"}, "is_word": true, "word_id": 42, "word_key": " for", "bytes_hex": "20 66 6f 72", "compression": {"rwkv": "5.81% 5.81% 5.81% 5.81%", "qwen": "3.90% 3.90% 3.90% 3.90%"}, "model_tokens": {"rwkv": [[21700, " for", "normal", 0.2717321515083313]], "qwen": [[369, " for", "normal", 0.4208017885684967]]}, "loss": {"rwkv": 5.811637737956029, "qwen": 3.902460211788234}, "topk": {"rwkv": [21700, 1, 0.2717321515083313, [[21700, 0.271732, " for", false], [32227, 0.246116, " that", false], [22763, 0.123408, " why", false], [4600, 0.074132, " is", false], [4858, 0.050634, " we", false], [4811, 0.040644, " to", false], [3609, 0.033742, " AI", false], [22590, 0.018906, " the", false], [32234, 0.016893, " this", false], [45290, 0.010477, " behind", false]]], "qwen": [369, 1, 0.4208017885684967, [[369, 0.420802, " for", false], [374, 0.30178, " is", false], [429, 0.070091, " that", false], [3170, 0.062996, " why", false], [4815, 0.032831, " behind", false], [419, 0.018419, " this", false], [582, 0.010519, " we", false], [11, 0.010184, ",", false], [1660, 0.004257, " being", false], [30, 0.004198, "?", false]]]}, "raw_delta": 0.10586728155612946, "tuned_delta": 0.1126795593632274}, {"byte_start": 241, "byte_end": 246, "display": {"text": " this", "kind": "normal"}, "is_word": true, "word_id": 43, "word_key": " this", "bytes_hex": "20 74 68 69 73", "compression": {"rwkv": "2.97% 2.97% 2.97% 2.97% 2.97%", "qwen": "0.38% 0.38% 0.38% 0.38% 0.38%"}, "model_tokens": {"rwkv": [[32234, " this", "normal", 0.43986979126930237]], "qwen": [[419, " this", "normal", 0.8994473218917847]]}, "loss": {"rwkv": 2.9727407580817506, "qwen": 0.3822233529835437}, "topk": {"rwkv": [32234, 1, 0.43986979126930237, [[32234, 0.43987, " this", false], [22590, 0.250503, " the", false], [32227, 0.071996, " that", false], [3609, 0.04231, " AI", false], [53052, 0.019094, " success", false], [22248, 0.009629, " our", false], [51708, 0.006295, " failure", false], [21256, 0.005968, " all", false], [56950, 0.005446, " progress", false], [56768, 0.004808, " optimism", false]]], "qwen": [419, 1, 0.8994473218917847, [[419, 0.899447, " this", false], [429, 0.043323, " that", false], [279, 0.018447, " the", false], [3170, 0.004849, " why", false], [4586, 0.002428, " general", false], [1039, 0.00165, " our", false], [2393, 0.001436, " success", false], [862, 0.000959, " their", false], [678, 0.000934, " all", false], [1667, 0.000867, " using", false]]]}, "raw_delta": 0.14364878684282303, "tuned_delta": 0.15046106464992098}, {"byte_start": 246, "byte_end": 249, "display": {"text": " is", "kind": "normal"}, "is_word": true, "word_id": 44, "word_key": " is", "bytes_hex": "20 69 73", "compression": {"rwkv": "1.75% 1.75% 1.75%", "qwen": "1.48% 1.48% 1.48%"}, "model_tokens": {"rwkv": [[4600, " is", "normal", 0.7480615377426147]], "qwen": [[374, " is", "normal", 0.7817800045013428]]}, "loss": {"rwkv": 1.7493616625362591, "qwen": 1.4798559807788028}, "topk": {"rwkv": [4600, 1, 0.7480615377426147, [[4600, 0.748062, " is", false], [45, 0.02602, ",", false], [53052, 0.014849, " success", false], [31291, 0.013671, " lies", false], [61735, 0.013175, " conclusion", false], [21800, 0.011121, " has", false], [46430, 0.010631, " lesson", false], [22748, 0.009861, " was", false], [47092, 0.007855, " result", false], [30808, 0.006959, " fact", false]]], "qwen": [374, 1, 0.7817800045013428, [[374, 0.78178, " is", false], [11, 0.022543, ",", false], [15448, 0.01882, " lies", false], [16688, 0.012301, " conclusion", false], [646, 0.009791, " can", false], [702, 0.009129, " has", false], [4977, 0.009058, " seems", false], [21930, 0.008822, " observation", false], [17755, 0.00673, " lesson", false], [1102, 0.006493, " result", false]]]}, "raw_delta": 0.014944568276405334, "tuned_delta": 0.02175684608350328}, {"byte_start": 249, "byte_end": 255, "display": {"text": " Moore", "kind": "normal"}, "is_word": true, "word_id": 45, "word_key": " moore", "bytes_hex": "20 4d 6f 6f 72 65", "compression": {"rwkv": "20.01% 20.01% 20.01% 20.01% 20.01% 20.01%", "qwen": "21.22% 21.22% 21.22% 21.22% 21.22% 21.22%"}, "model_tokens": {"rwkv": [[37045, " Moore", "normal", 0.0012756389332935214]], "qwen": [[20219, " Moore", "normal", 0.0008584775496274233]]}, "loss": {"rwkv": 20.00612263732742, "qwen": 21.22069134830696}, "topk": {"rwkv": [37045, 31, 0.0012756389332935214, [[32227, 0.621272, " that", false], [22590, 0.076811, " the", false], [51018, 0.037897, " because", false], [47284, 0.035105, " simple", false], [22187, 0.018704, " not", false], [47285, 0.016552, " simply", false], [332, 0.014953, " a", false], [45, 0.00715, ",", false], [56937, 0.005276, " probably", false], [4706, 0.00506, " of", false]]], "qwen": [20219, 42, 0.0008584775496274233, [[429, 0.652205, " that", false], [279, 0.065473, " the", false], [1576, 0.041846, " because", false], [4285, 0.032524, " simple", false], [537, 0.023759, " not", false], [4936, 0.023078, " simply", false], [264, 0.008186, " a", false], [54480, 0.007306, " computational", false], [11, 0.004318, ",", false], [4658, 0.003951, " probably", false]]]}, "raw_delta": -0.06734999020894361, "tuned_delta": -0.06053771240184566}, {"byte_start": 255, "byte_end": 257, "display": {"text": "'s", "kind": "normal"}, "is_word": true, "word_id": 46, "word_key": "'s", "bytes_hex": "27 73", "compression": {"rwkv": "5.74% 5.74%", "qwen": "8.29% 8.29%"}, "model_tokens": {"rwkv": [[460, "'s", "normal", 0.5282162427902222]], "qwen": [[594, "'s", "normal", 0.3989563584327698]]}, "loss": {"rwkv": 5.741193644162623, "qwen": 8.285607095725963}, "topk": {"rwkv": [460, 1, 0.5282162427902222, [[460, 0.528216, "'s", false], [28309, 0.46234, "’s", false], [116, 0.005702, "s", false], [45, 0.000566, ",", false], [21265, 0.000547, " and", false], [46, 0.000208, "-", false], [47, 0.00019, ".", false], [9819, 0.00018, "‘", false], [9222, 0.000141, "´s", false], [2496, 0.000139, "â", false]]], "qwen": [594, 2, 0.3989563584327698, [[748, 0.59176, "’s", false], [594, 0.398956, "'s", false], [527, 0.000957, "’", false], [17744, 0.000841, " ’", false], [42641, 0.000839, "‘s", false], [8835, 0.000813, "â", false], [75151, 0.000435, "’", false], [6, 0.000403, "'", false], [7506, 0.000396, " Law", false], [45149, 0.000378, "\u0026apos", false]]]}, "raw_delta": -0.1410922408103943, "tuned_delta": -0.13427996300329634}, {"byte_start": 257, "byte_end": 261, "display": {"text": " law", "kind": "normal"}, "is_word": true, "word_id": 47, "word_key": " law", "bytes_hex": "20 6c 61 77", "compression": {"rwkv": "4.68% 4.68% 4.68% 4.68%", "qwen": "3.23% 3.23% 3.23% 3.23%"}, "model_tokens": {"rwkv": [[21988, " law", "normal", 0.3533293604850769]], "qwen": [[2329, " law", "normal", 0.4886452555656433]]}, "loss": {"rwkv": 4.684532237261526, "qwen": 3.228564198816081}, "topk": {"rwkv": [21988, 2, 0.3533293604850769, [[20267, 0.642091, " Law", false], [21988, 0.353329, " law", false], [29262, 0.000371, " Laws", false], [21265, 0.000363, " and", false], [45958, 0.000352, " famous", false], [275, 0.00031, " (", false], [31259, 0.000296, " laws", false], [47205, 0.000141, " second", false], [31907, 0.00014, " rule", false], [53127, 0.000114, " theorem", false]]], "qwen": [2329, 2, 0.4886452555656433, [[7506, 0.505915, " Law", false], [2329, 0.488645, " law", false], [40989, 0.000736, " Laws", false], [198, 0.000675, "\n", false], [220, 0.000285, " ", false], [6872, 0.000245, " laws", false], [576, 0.000243, " The", false], [19915, 0.000168, "law", false], [323, 0.000159, " and", false], [57817, 0.000148, " theorem", false]]]}, "raw_delta": 0.08073601126670837, "tuned_delta": 0.08754828907380632}, {"byte_start": 261, "byte_end": 262, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "13.95%", "qwen": "17.39%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.4555496573448181]], "qwen": [[11, ",", "normal", 0.3811791241168976]]}, "loss": {"rwkv": 13.947930571094469, "qwen": 17.393237517997758}, "topk": {"rwkv": [45, 1, 0.4555496573448181, [[45, 0.45555, ",", false], [59, 0.19357, ":", false], [47, 0.152266, ".", false], [21265, 0.036946, " and", false], [275, 0.02117, " (", false], [9816, 0.020039, "—", false], [60, 0.016138, ";", false], [280, 0.015936, " -", false], [22898, 0.011543, " —", false], [43274, 0.010162, "—the", false]]], "qwen": [11, 1, 0.3811791241168976, [[11, 0.381179, ",", false], [25, 0.18403, ":", false], [13, 0.177942, ".", false], [323, 0.043685, " and", false], [624, 0.030055, ".\n", false], [26, 0.021415, ";", false], [481, 0.018391, " -", false], [1959, 0.016107, " —", false], [320, 0.014172, " (", false], [1177, 0.012551, " --", false]]]}, "raw_delta": -0.19104838371276855, "tuned_delta": -0.1842361059056706}, {"byte_start": 262, "byte_end": 265, "display": {"text": " or", "kind": "normal"}, "is_word": true, "word_id": 48, "word_key": " or", "bytes_hex": "20 6f 72", "compression": {"rwkv": "27.99% 27.99% 27.99%", "qwen": "26.33% 26.33% 26.33%"}, "model_tokens": {"rwkv": [[4715, " or", "normal", 0.009487173520028591]], "qwen": [[476, " or", "normal", 0.012534013018012047]]}, "loss": {"rwkv": 27.989786600580146, "qwen": 26.325031803135847}, "topk": {"rwkv": [4715, 7, 0.009487173520028591, [[40186, 0.592524, " which", false], [21400, 0.111305, " but", false], [21265, 0.072742, " and", false], [22590, 0.068198, " the", false], [332, 0.018299, " a", false], [32227, 0.011187, " that", false], [4715, 0.009487, " or", false], [4596, 0.007715, " in", false], [340, 0.007089, " i", false], [4423, 0.006845, " as", false]]], "qwen": [476, 8, 0.012534013018012047, [[892, 0.639171, " which", false], [279, 0.084171, " the", false], [323, 0.051258, " and", false], [714, 0.029083, " but", false], [429, 0.024328, " that", false], [264, 0.018037, " a", false], [438, 0.014398, " as", false], [476, 0.012534, " or", false], [304, 0.011276, " in", false], [600, 0.007726, " i", false]]]}, "raw_delta": 0.09231360753377271, "tuned_delta": 0.09912588534087066}, {"byte_start": 265, "byte_end": 272, "display": {"text": " rather", "kind": "normal"}, "is_word": true, "word_id": 49, "word_key": " rather", "bytes_hex": "20 72 61 74 68 65 72", "compression": {"rwkv": "5.88% 5.88% 5.88% 5.88% 5.88% 5.88% 5.88%", "qwen": "5.90% 5.90% 5.90% 5.90% 5.90% 5.90% 5.90%"}, "model_tokens": {"rwkv": [[47001, " rather", "normal", 0.10157662630081177]], "qwen": [[4751, " rather", "normal", 0.10114416480064392]]}, "loss": {"rwkv": 5.877050110764192, "qwen": 5.902705008482897}, "topk": {"rwkv": [47001, 4, 0.10157662630081177, [[22590, 0.254918, " the", false], [31458, 0.173784, " more", false], [4424, 0.107072, " at", false], [47001, 0.101577, " rather", false], [45, 0.044326, ",", false], [4596, 0.028851, " in", false], [52448, 0.016574, " perhaps", false], [332, 0.014606, " a", false], [32227, 0.012853, " that", false], [32074, 0.012437, " some", false]]], "qwen": [4751, 3, 0.10114416480064392, [[279, 0.211004, " the", false], [803, 0.133768, " more", false], [4751, 0.101144, " rather", false], [518, 0.099381, " at", false], [304, 0.062929, " in", false], [11, 0.049104, ",", false], [438, 0.029579, " as", false], [894, 0.023234, " any", false], [4936, 0.020661, " simply", false], [311, 0.016255, " to", false]]]}, "raw_delta": -0.0014226096017019851, "tuned_delta": 0.005389668205395962}, {"byte_start": 272, "byte_end": 276, "display": {"text": " its", "kind": "normal"}, "is_word": true, "word_id": 50, "word_key": " its", "bytes_hex": "20 69 74 73", "compression": {"rwkv": "10.07% 10.07% 10.07% 10.07%", "qwen": "14.29% 14.29% 14.29% 14.29%"}, "model_tokens": {"rwkv": [[21902, " its", "normal", 0.10618513822555542]], "qwen": [[1181, " its", "normal", 0.041973281651735306]]}, "loss": {"rwkv": 10.073505412457116, "qwen": 14.294952864439173}, "topk": {"rwkv": [21902, 3, 0.10618513822555542, [[22590, 0.334039, " the", false], [45, 0.293064, ",", false], [21902, 0.106185, " its", false], [32227, 0.043044, " that", false], [332, 0.041547, " a", false], [37045, 0.018252, " Moore", false], [21835, 0.012895, " how", false], [31458, 0.009965, " more", false], [32464, 0.008125, " what", false], [4419, 0.00613, " an", false]]], "qwen": [1181, 3, 0.041973281651735306, [[11, 0.411784, ",", false], [279, 0.324031, " the", false], [1181, 0.041973, " its", false], [264, 0.025174, " a", false], [429, 0.020966, " that", false], [20219, 0.015413, " Moore", false], [458, 0.008091, " an", false], [25, 0.007787, ":", false], [1128, 0.007512, " what", false], [1039, 0.007394, " our", false]]]}, "raw_delta": -0.2340867519378662, "tuned_delta": -0.22727447413076826}, {"byte_start": 276, "byte_end": 291, "display": {"text": " generalization", "kind": "normal"}, "is_word": true, "word_id": 51, "word_key": " generalization", "bytes_hex": "20 67 65 6e 65 72 61 6c 69 7a 61 74 69 6f 6e", "compression": {"rwkv": "6.84% 6.84% 6.84% 6.84% 6.84% 6.84% 6.84% 6.84% 6.84% 6.84% 6.84% 6.84% 6.84% 6.84% 6.84%", "qwen": "10.66% 10.66% 10.66% 10.66% 10.66% 10.66% 10.66% 10.66% 0.43% 0.43% 0.43% 0.43% 0.43% 0.43% 0.43%"}, "model_tokens": {"rwkv": [[65135, " generalization", "normal", 0.0033424135763198137]], "qwen": [[4586, " general", "normal", 0.008826144970953465], [2022, "ization", "normal", 0.8470881581306458]]}, "loss": {"rwkv": 6.8377733708799795, "qwen": 5.886180447042385}, "topk": {"rwkv": [65135, 51, 0.0033424135763198137, [[21458, 0.062054, " cor", false], [52046, 0.035293, " inverse", false], [60588, 0.032354, " successor", false], [45606, 0.030206, " cousin", false], [45828, 0.019559, " effect", false], [63563, 0.017444, " exponential", false], [63774, 0.016843, " predecessor", false], [61841, 0.014664, " derivative", false], [31458, 0.014381, " more", false], [59695, 0.013763, " extension", false]]], "qwen": [4586, 20, 0.008826144970953465, [[1829, 0.076741, " cor", false], [9931, 0.057388, " reverse", false], [27949, 0.054086, " inverse", false], [33565, 0.046774, " successor", false], [14002, 0.029152, " opposite", false], [13578, 0.021762, " equivalent", false], [94240, 0.0146, " converse", false], [31805, 0.014345, " derivative", false], [3265, 0.014272, " close", false], [27397, 0.013097, " twin", false]]]}, "raw_delta": 0.05276751617590583, "tuned_delta": 0.05957979398300378}, {"byte_start": 291, "byte_end": 294, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 52, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "31.00% 31.00% 31.00%", "qwen": "37.00% 37.00% 37.00%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.0058032008819282055]], "qwen": [[315, " of", "normal", 0.0021232785657048225]]}, "loss": {"rwkv": 30.99540126909882, "qwen": 36.99787668920725}, "topk": {"rwkv": [4706, 17, 0.0058032008819282055, [[45, 0.235499, ",", false], [4811, 0.196786, " to", false], [116, 0.141131, "s", false], [59, 0.092738, ":", false], [47, 0.070911, ".", false], [32227, 0.061995, " that", false], [38848, 0.012189, " known", false], [4596, 0.012153, " in", false], [31162, 0.011911, " into", false], [37045, 0.011705, " Moore", false]]], "qwen": [315, 30, 0.0021232785657048225, [[11, 0.267544, ",", false], [25, 0.208771, ":", false], [311, 0.197383, " to", false], [13, 0.064783, ".", false], [429, 0.057587, " that", false], [481, 0.015406, " -", false], [892, 0.011045, " which", false], [624, 0.010519, ".\n", false], [320, 0.009481, " (", false], [369, 0.009388, " for", false]]]}, "raw_delta": -0.3328479131062827, "tuned_delta": -0.3260356352991848}, {"byte_start": 294, "byte_end": 304, "display": {"text": " continued", "kind": "normal"}, "is_word": true, "word_id": 53, "word_key": " continued", "bytes_hex": "20 63 6f 6e 74 69 6e 75 65 64", "compression": {"rwkv": "11.89% 11.89% 11.89% 11.89% 11.89% 11.89% 11.89% 11.89% 11.89% 11.89%", "qwen": "12.88% 12.88% 12.88% 12.88% 12.88% 12.88% 12.88% 12.88% 12.88% 12.88%"}, "model_tokens": {"rwkv": [[59392, " continued", "normal", 0.0013789260992780328]], "qwen": [[8570, " continued", "normal", 0.0007931358413770795]]}, "loss": {"rwkv": 11.890963032327, "qwen": 12.875180187205157}, "topk": {"rwkv": [59392, 62, 0.0013789260992780328, [[22590, 0.22372, " the", false], [37045, 0.108114, " Moore", false], [269, 0.037126, " \"", false], [63563, 0.036785, " exponential", false], [32227, 0.031767, " that", false], [332, 0.026251, " a", false], [32234, 0.020092, " this", false], [52805, 0.012149, " scaling", false], [4601, 0.011999, " it", false], [59346, 0.009946, " computing", false]]], "qwen": [8570, 110, 0.0007931358413770795, [[279, 0.276562, " the", false], [330, 0.038808, " \"", false], [20219, 0.037563, " Moore", false], [1036, 0.017845, " “", false], [429, 0.017202, " that", false], [71161, 0.014851, " Denn", false], [1128, 0.014283, " what", false], [58755, 0.013923, " exponential", false], [1246, 0.011885, " how", false], [24231, 0.011763, " computing", false]]]}, "raw_delta": -0.05457658767700191, "tuned_delta": -0.04776430986990396}, {"byte_start": 304, "byte_end": 318, "display": {"text": " exponentially", "kind": "normal"}, "is_word": true, "word_id": 54, "word_key": " exponentially", "bytes_hex": "20 65 78 70 6f 6e 65 6e 74 69 61 6c 6c 79", "compression": {"rwkv": "8.78% 8.78% 8.78% 8.78% 8.78% 8.78% 8.78% 8.78% 8.78% 8.78% 8.78% 8.78% 8.78% 8.78%", "qwen": "7.29% 7.29% 7.29% 7.29% 7.29% 7.29% 7.29% 7.29% 7.29% 7.29% 7.29% 7.29% 7.29% 7.29%"}, "model_tokens": {"rwkv": [[64911, " exponentially", "normal", 0.001094610895961523]], "qwen": [[74151, " exponentially", "normal", 0.003478133585304022]]}, "loss": {"rwkv": 8.775321398264342, "qwen": 7.292385021382192}, "topk": {"rwkv": [64911, 43, 0.001094610895961523, [[63563, 0.583153, " exponential", false], [46132, 0.056675, " growth", false], [64423, 0.051582, " improvements", false], [63621, 0.040157, " improvement", false], [56950, 0.0204, " progress", false], [59847, 0.0174, " increases", false], [52805, 0.012919, " scaling", false], [56045, 0.012031, " doubling", false], [37045, 0.01099, " Moore", false], [62329, 0.010753, " polynomial", false]]], "qwen": [74151, 35, 0.003478133585304022, [[58755, 0.241755, " exponential", false], [29016, 0.077583, " technological", false], [15673, 0.073068, " improvement", false], [5098, 0.061303, " progress", false], [18142, 0.050694, " improvements", false], [12703, 0.032734, " increases", false], [26943, 0.02385, " scaling", false], [6513, 0.023342, " growth", false], [5263, 0.022613, " increase", false], [54480, 0.017393, " computational", false]]]}, "raw_delta": 0.08223145348685132, "tuned_delta": 0.08904373129394927}, {"byte_start": 318, "byte_end": 326, "display": {"text": " falling", "kind": "normal"}, "is_word": true, "word_id": 55, "word_key": " falling", "bytes_hex": "20 66 61 6c 6c 69 6e 67", "compression": {"rwkv": "11.76% 11.76% 11.76% 11.76% 11.76% 11.76% 11.76% 11.76%", "qwen": "16.79% 16.79% 16.79% 16.79% 16.79% 16.79% 16.79% 16.79%"}, "model_tokens": {"rwkv": [[51709, " falling", "normal", 0.0053382678888738155]], "qwen": [[15679, " falling", "normal", 0.0005811915034428239]]}, "loss": {"rwkv": 11.76416366349887, "qwen": 16.79484215747727}, "topk": {"rwkv": [51709, 18, 0.0053382678888738155, [[62092, 0.350551, " increasing", false], [46, 0.123141, "-", false], [51876, 0.103164, " growing", false], [61816, 0.070991, " decreasing", false], [45961, 0.036304, " faster", false], [46132, 0.029162, " growth", false], [47122, 0.027614, " rising", false], [64230, 0.026467, " accelerating", false], [59832, 0.024295, " improving", false], [52805, 0.018596, " scaling", false]]], "qwen": [15679, 81, 0.0005811915034428239, [[7703, 0.346143, " increasing", false], [18392, 0.14817, " improving", false], [68641, 0.054102, " accelerating", false], [7826, 0.047504, " growing", false], [10596, 0.044581, " faster", false], [43549, 0.021275, " decreasing", false], [4937, 0.01972, " fast", false], [2664, 0.016937, " better", false], [16062, 0.016582, " rising", false], [11048, 0.015995, " rapid", false]]]}, "raw_delta": -0.27896004915237427, "tuned_delta": -0.27214777134527635}, {"byte_start": 326, "byte_end": 331, "display": {"text": " cost", "kind": "normal"}, "is_word": true, "word_id": 56, "word_key": " cost", "bytes_hex": "20 63 6f 73 74", "compression": {"rwkv": "8.06% 8.06% 8.06% 8.06% 8.06%", "qwen": "8.69% 8.69% 8.69% 8.69% 8.69%"}, "model_tokens": {"rwkv": [[30510, " cost", "normal", 0.10748551785945892]], "qwen": [[2783, " cost", "normal", 0.08987583220005035]]}, "loss": {"rwkv": 8.058804329965694, "qwen": 8.689806956154829}, "topk": {"rwkv": [30510, 2, 0.10748551785945892, [[38124, 0.475063, " costs", false], [30510, 0.107486, " cost", false], [56353, 0.039009, " hardware", false], [45860, 0.035803, " energy", false], [46900, 0.030953, " prices", false], [62659, 0.019605, " transistor", false], [22278, 0.019514, " per", false], [59346, 0.015789, " computing", false], [32343, 0.015119, " unit", false], [52805, 0.015016, " scaling", false]]], "qwen": [2783, 3, 0.08987583220005035, [[7049, 0.392977, " costs", false], [7576, 0.101625, " prices", false], [2783, 0.089876, " cost", false], [817, 0.047729, " per", false], [54480, 0.031836, " computational", false], [11773, 0.027092, " hardware", false], [34447, 0.025031, " computation", false], [24231, 0.023069, " computing", false], [304, 0.013094, " in", false], [4982, 0.012892, " unit", false]]]}, "raw_delta": -0.03499021530151364, "tuned_delta": -0.028177937494415693}, {"byte_start": 331, "byte_end": 335, "display": {"text": " per", "kind": "normal"}, "is_word": true, "word_id": 57, "word_key": " per", "bytes_hex": "20 70 65 72", "compression": {"rwkv": "4.23% 4.23% 4.23% 4.23%", "qwen": "9.24% 9.24% 9.24% 9.24%"}, "model_tokens": {"rwkv": [[22278, " per", "normal", 0.3929365873336792]], "qwen": [[817, " per", "normal", 0.12882518768310547]]}, "loss": {"rwkv": 4.226645627604385, "qwen": 9.239104709507004}, "topk": {"rwkv": [22278, 1, 0.3929365873336792, [[22278, 0.392937, " per", false], [4706, 0.118182, " of", false], [47, 0.103298, ".", false], [45, 0.05669, ",", false], [21700, 0.048948, " for", false], [45644, 0.042036, " curves", false], [46, 0.034306, "-", false], [21265, 0.02705, " and", false], [4811, 0.024121, " to", false], [48, 0.023223, "/", false]]], "qwen": [817, 2, 0.12882518768310547, [[315, 0.442599, " of", false], [817, 0.128825, " per", false], [13, 0.073923, ".", false], [323, 0.053048, " and", false], [369, 0.040947, " for", false], [11, 0.03493, ",", false], [304, 0.031386, " in", false], [624, 0.021357, ".\n", false], [311, 0.016775, " to", false], [448, 0.014182, " with", false]]]}, "raw_delta": -0.2779497504234314, "tuned_delta": -0.2711374726163335}, {"byte_start": 335, "byte_end": 340, "display": {"text": " unit", "kind": "normal"}, "is_word": true, "word_id": 58, "word_key": " unit", "bytes_hex": "20 75 6e 69 74", "compression": {"rwkv": "4.56% 4.56% 4.56% 4.56% 4.56%", "qwen": "5.21% 5.21% 5.21% 5.21% 5.21%"}, "model_tokens": {"rwkv": [[32343, " unit", "normal", 0.28328123688697815]], "qwen": [[4982, " unit", "normal", 0.23570650815963745]]}, "loss": {"rwkv": 4.564777277812735, "qwen": 5.212341403323332}, "topk": {"rwkv": [32343, 1, 0.28328123688697815, [[32343, 0.283281, " unit", false], [63370, 0.103766, " computation", false], [62659, 0.094895, " transistor", false], [3806, 0.059207, " FL", false], [21365, 0.051343, " bit", false], [60096, 0.046842, " operation", false], [64862, 0.036226, " computational", false], [59346, 0.024277, " computing", false], [51266, 0.020999, " compute", false], [63750, 0.01967, " performance", false]]], "qwen": [4982, 1, 0.23570650815963745, [[4982, 0.235707, " unit", false], [2699, 0.213193, " bit", false], [34447, 0.047026, " computation", false], [97941, 0.026785, " transistor", false], [54480, 0.023907, " computational", false], [5068, 0.020639, " performance", false], [5666, 0.017223, " operation", false], [24231, 0.016224, " computing", false], [22302, 0.01419, " capability", false], [8692, 0.013948, " processing", false]]]}, "raw_delta": -0.03590857982635498, "tuned_delta": -0.029096302019257034}, {"byte_start": 340, "byte_end": 343, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 59, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "3.24% 3.24% 3.24%", "qwen": "1.60% 1.60% 1.60%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.5804001688957214]], "qwen": [[315, " of", "normal", 0.766579270362854]]}, "loss": {"rwkv": 3.240428314496695, "qwen": 1.5978879427888404}, "topk": {"rwkv": [4706, 1, 0.5804001688957214, [[4706, 0.5804, " of", false], [47, 0.096078, ".", false], [32251, 0.067929, " time", false], [45, 0.040464, ",", false], [63370, 0.034276, " computation", false], [63750, 0.011853, " performance", false], [59346, 0.010538, " computing", false], [275, 0.008544, " (", false], [62378, 0.007364, " processing", false], [21700, 0.006696, " for", false]]], "qwen": [315, 1, 0.766579270362854, [[315, 0.766579, " of", false], [13, 0.030388, ".", false], [34447, 0.024931, " computation", false], [11, 0.01643, ",", false], [8692, 0.010762, " processing", false], [304, 0.010713, " in", false], [624, 0.007539, ".\n", false], [5666, 0.007468, " operation", false], [5068, 0.005944, " performance", false], [24231, 0.00588, " computing", false]]]}, "raw_delta": 0.09108177820841472, "tuned_delta": 0.09789405601551267}, {"byte_start": 343, "byte_end": 355, "display": {"text": " computation", "kind": "normal"}, "is_word": true, "word_id": 60, "word_key": " computation", "bytes_hex": "20 63 6f 6d 70 75 74 61 74 69 6f 6e", "compression": {"rwkv": "1.73% 1.73% 1.73% 1.73% 1.73% 1.73% 1.73% 1.73% 1.73% 1.73% 1.73% 1.73%", "qwen": "1.75% 1.75% 1.75% 1.75% 1.75% 1.75% 1.75% 1.75% 1.75% 1.75% 1.75% 1.75%"}, "model_tokens": {"rwkv": [[63370, " computation", "normal", 0.3179873824119568]], "qwen": [[34447, " computation", "normal", 0.31194689869880676]]}, "loss": {"rwkv": 1.725880297938457, "qwen": 1.750653682200866}, "topk": {"rwkv": [63370, 1, 0.3179873824119568, [[63370, 0.317987, " computation", false], [59346, 0.170855, " computing", false], [51266, 0.07422, " compute", false], [63750, 0.058217, " performance", false], [64862, 0.055939, " computational", false], [62378, 0.037202, " processing", false], [39339, 0.022773, " power", false], [61654, 0.018283, " capability", false], [63637, 0.016022, " information", false], [55686, 0.014014, " capacity", false]]], "qwen": [34447, 1, 0.31194689869880676, [[34447, 0.311947, " computation", false], [24231, 0.198532, " computing", false], [8692, 0.090849, " processing", false], [54480, 0.064271, " computational", false], [5068, 0.040201, " performance", false], [11773, 0.022831, " hardware", false], [6366, 0.01754, " computer", false], [882, 0.015558, " time", false], [12564, 0.013179, " compute", false], [1995, 0.011198, " information", false]]]}, "raw_delta": -0.0013737281163533482, "tuned_delta": 0.005438549690744599}, {"byte_start": 355, "byte_end": 356, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "9.51%", "qwen": "12.53%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.5904151797294617]], "qwen": [[13, ".", "normal", 0.4991952180862427]]}, "loss": {"rwkv": 9.509952662109866, "qwen": 12.529050053861804}, "topk": {"rwkv": [47, 1, 0.5904151797294617, [[47, 0.590415, ".", false], [45, 0.16497, ",", false], [275, 0.038461, " (", false], [31601, 0.028613, " over", false], [21265, 0.020798, " and", false], [59, 0.019654, ":", false], [4811, 0.012148, " to", false], [4423, 0.008016, " as", false], [60, 0.007556, ";", false], [4596, 0.007541, " in", false]]], "qwen": [13, 1, 0.4991952180862427, [[13, 0.499195, ".", false], [624, 0.12854, ".\n", false], [11, 0.104222, ",", false], [320, 0.03919, " (", false], [25, 0.023488, ":", false], [323, 0.020868, " and", false], [2355, 0.01891, " power", false], [311, 0.014753, " to", false], [429, 0.010954, " that", false], [304, 0.008801, " in", false]]]}, "raw_delta": -0.16741430759429932, "tuned_delta": -0.16060202978720137}, {"byte_start": 356, "byte_end": 361, "display": {"text": " Most", "kind": "normal"}, "is_word": true, "word_id": 61, "word_key": " most", "bytes_hex": "20 4d 6f 73 74", "compression": {"rwkv": "22.20% 22.20% 22.20% 22.20% 22.20%", "qwen": "19.99% 19.99% 19.99% 19.99% 19.99%"}, "model_tokens": {"rwkv": [[29425, " Most", "normal", 0.0021446184255182743]], "qwen": [[7496, " Most", "normal", 0.003920088987797499]]}, "loss": {"rwkv": 22.2039783636817, "qwen": 19.98724410174221}, "topk": {"rwkv": [29425, 54, 0.0021446184255182743, [[11, 0.166315, "\n", false], [20996, 0.101058, " The", false], [29894, 0.086412, " This", false], [261, 0.052696, "\n\n", false], [19555, 0.041636, " But", false], [3913, 0.034679, " In", false], [37045, 0.031991, " Moore", false], [3918, 0.028541, " It", false], [3641, 0.025945, " As", false], [3908, 0.023022, " If", false]]], "qwen": [7496, 44, 0.003920088987797499, [[1096, 0.116306, " This", false], [576, 0.11264, " The", false], [758, 0.047365, " In", false], [1084, 0.041821, " It", false], [1634, 0.034852, " As", false], [1416, 0.023749, " If", false], [1752, 0.019009, " For", false], [1205, 0.018853, " We", false], [2619, 0.018818, " There", false], [1988, 0.016239, " But", false]]]}, "raw_delta": 0.12292184829711905, "tuned_delta": 0.129734126104217}, {"byte_start": 361, "byte_end": 364, "display": {"text": " AI", "kind": "normal"}, "is_word": true, "word_id": 62, "word_key": " ai", "bytes_hex": "20 41 49", "compression": {"rwkv": "12.59% 12.59% 12.59%", "qwen": "13.88% 13.88% 13.88%"}, "model_tokens": {"rwkv": [[3609, " AI", "normal", 0.12543030083179474]], "qwen": [[15235, " AI", "normal", 0.0993504747748375]]}, "loss": {"rwkv": 12.586011424421944, "qwen": 13.880539169353877}, "topk": {"rwkv": [3609, 2, 0.12543030083179474, [[4706, 0.279112, " of", false], [3609, 0.12543, " AI", false], [46787, 0.058213, " people", false], [39193, 0.042456, " other", false], [52224, 0.027284, " methods", false], [57103, 0.023109, " research", false], [52167, 0.010994, " machine", false], [63843, 0.010884, " researchers", false], [47539, 0.008619, " things", false], [61559, 0.008595, " algorithms", false]]], "qwen": [15235, 2, 0.0993504747748375, [[315, 0.255866, " of", false], [15235, 0.09935, " AI", false], [5413, 0.047656, " methods", false], [1008, 0.034763, " other", false], [25185, 0.032398, " algorithms", false], [5662, 0.026303, " machine", false], [4586, 0.025553, " general", false], [3412, 0.024496, " research", false], [1251, 0.021594, " people", false], [5322, 0.020916, " problems", false]]]}, "raw_delta": -0.07178386052449548, "tuned_delta": -0.06497158271739753}, {"byte_start": 364, "byte_end": 373, "display": {"text": " research", "kind": "normal"}, "is_word": true, "word_id": 63, "word_key": " research", "bytes_hex": "20 72 65 73 65 61 72 63 68", "compression": {"rwkv": "2.86% 2.86% 2.86% 2.86% 2.86% 2.86% 2.86% 2.86% 2.86%", "qwen": "3.05% 3.05% 3.05% 3.05% 3.05% 3.05% 3.05% 3.05% 3.05%"}, "model_tokens": {"rwkv": [[57103, " research", "normal", 0.23859712481498718]], "qwen": [[3412, " research", "normal", 0.21799854934215546]]}, "loss": {"rwkv": 2.8647264809318607, "qwen": 3.0522353433308953}, "topk": {"rwkv": [57103, 1, 0.23859712481498718, [[57103, 0.238597, " research", false], [63843, 0.191868, " researchers", false], [52224, 0.075318, " methods", false], [53087, 0.068953, " systems", false], [62633, 0.027066, " techniques", false], [32499, 0.024939, " work", false], [56950, 0.022083, " progress", false], [61559, 0.0195, " algorithms", false], [64251, 0.01941, " applications", false], [56939, 0.01644, " problems", false]]], "qwen": [3412, 1, 0.21799854934215546, [[3412, 0.217999, " research", false], [11811, 0.166973, " researchers", false], [5413, 0.156672, " methods", false], [25185, 0.064499, " algorithms", false], [12538, 0.055351, " techniques", false], [19827, 0.037726, " approaches", false], [5942, 0.036706, " systems", false], [5322, 0.027952, " problems", false], [8357, 0.013111, " applications", false], [374, 0.012034, " is", false]]]}, "raw_delta": -0.010397699144151479, "tuned_delta": -0.003585421337053532}, {"byte_start": 373, "byte_end": 377, "display": {"text": " has", "kind": "normal"}, "is_word": true, "word_id": 64, "word_key": " has", "bytes_hex": "20 68 61 73", "compression": {"rwkv": "7.11% 7.11% 7.11% 7.11%", "qwen": "7.36% 7.36% 7.36% 7.36%"}, "model_tokens": {"rwkv": [[21800, " has", "normal", 0.20657171308994293]], "qwen": [[702, " has", "normal", 0.19522716104984283]]}, "loss": {"rwkv": 7.114853473134048, "qwen": 7.364920009609059}, "topk": {"rwkv": [21800, 1, 0.20657171308994293, [[21800, 0.206572, " has", false], [4600, 0.105078, " is", false], [45, 0.050277, ",", false], [4596, 0.042143, " in", false], [39971, 0.033257, " today", false], [32227, 0.026531, " that", false], [31601, 0.024923, " over", false], [56952, 0.023245, " projects", false], [51566, 0.022102, " efforts", false], [39690, 0.015486, " since", false]]], "qwen": [702, 1, 0.19522716104984283, [[702, 0.195227, " has", false], [374, 0.139316, " is", false], [3351, 0.06346, " today", false], [304, 0.046102, " in", false], [11, 0.03967, ",", false], [916, 0.022977, " over", false], [23497, 0.017717, " focuses", false], [429, 0.016171, " that", false], [15689, 0.014485, " papers", false], [323, 0.014132, " and", false]]]}, "raw_delta": -0.013866633176803589, "tuned_delta": -0.007054355369705642}, {"byte_start": 377, "byte_end": 382, "display": {"text": " been", "kind": "normal"}, "is_word": true, "word_id": 65, "word_key": " been", "bytes_hex": "20 62 65 65 6e", "compression": {"rwkv": "3.97% 3.97% 3.97% 3.97% 3.97%", "qwen": "4.25% 4.25% 4.25% 4.25% 4.25%"}, "model_tokens": {"rwkv": [[30259, " been", "normal", 0.3345584273338318]], "qwen": [[1012, " been", "normal", 0.30757519602775574]]}, "loss": {"rwkv": 3.9730468899481215, "qwen": 4.252472262284453}, "topk": {"rwkv": [30259, 1, 0.3345584273338318, [[30259, 0.334558, " been", false], [51770, 0.178606, " focused", false], [45953, 0.023122, " failed", false], [40013, 0.018836, " tried", false], [22187, 0.018363, " not", false], [39887, 0.016863, " taken", false], [56255, 0.013689, " followed", false], [64300, 0.012627, " concentrated", false], [51960, 0.009653, " ignored", false], [56500, 0.00906, " involved", false]]], "qwen": [1012, 1, 0.30757519602775574, [[1012, 0.307575, " been", false], [10735, 0.185736, " focused", false], [8110, 0.022109, " followed", false], [37526, 0.018622, " concentrated", false], [537, 0.016617, " not", false], [4429, 0.015635, " taken", false], [6679, 0.014515, " tried", false], [7391, 0.009086, " spent", false], [1030, 0.008749, " had", false], [264, 0.008633, " a", false]]]}, "raw_delta": -0.015494632720947282, "tuned_delta": -0.008682354913849336}, {"byte_start": 382, "byte_end": 392, "display": {"text": " conducted", "kind": "normal"}, "is_word": true, "word_id": 66, "word_key": " conducted", "bytes_hex": "20 63 6f 6e 64 75 63 74 65 64", "compression": {"rwkv": "6.79% 6.79% 6.79% 6.79% 6.79% 6.79% 6.79% 6.79% 6.79% 6.79%", "qwen": "7.16% 7.16% 7.16% 7.16% 7.16% 7.16% 7.16% 7.16% 7.16% 7.16%"}, "model_tokens": {"rwkv": [[59355, " conducted", "normal", 0.022922122851014137]], "qwen": [[13075, " conducted", "normal", 0.01887700892984867]]}, "loss": {"rwkv": 6.790810641684377, "qwen": 7.159032376487684}, "topk": {"rwkv": [59355, 10, 0.022922122851014137, [[51770, 0.127945, " focused", false], [30666, 0.056939, " done", false], [51459, 0.031672, " devoted", false], [45796, 0.031477, " driven", false], [4712, 0.031178, " on", false], [37810, 0.030026, " based", false], [37598, 0.027128, " about", false], [4596, 0.027122, " in", false], [332, 0.02537, " a", false], [59355, 0.022922, " conducted", false]]], "qwen": [13075, 9, 0.01887700892984867, [[10735, 0.150755, " focused", false], [28229, 0.042238, " devoted", false], [304, 0.040494, " in", false], [911, 0.038982, " about", false], [16227, 0.037951, " driven", false], [3118, 0.033625, " based", false], [2814, 0.030086, " done", false], [264, 0.019769, " a", false], [13075, 0.018877, " conducted", false], [389, 0.018383, " on", false]]]}, "raw_delta": -0.02041854858398434, "tuned_delta": -0.013606270776886396}, {"byte_start": 392, "byte_end": 395, "display": {"text": " as", "kind": "normal"}, "is_word": true, "word_id": 67, "word_key": " as", "bytes_hex": "20 61 73", "compression": {"rwkv": "32.12% 32.12% 32.12%", "qwen": "28.91% 28.91% 28.91%"}, "model_tokens": {"rwkv": [[4423, " as", "normal", 0.0048525515012443066]], "qwen": [[438, " as", "normal", 0.008154122158885002]]}, "loss": {"rwkv": 32.122506769793326, "qwen": 28.909395033008668}, "topk": {"rwkv": [4423, 17, 0.0048525515012443066, [[4712, 0.237606, " on", false], [4596, 0.212274, " in", false], [32487, 0.124406, " with", false], [40085, 0.097255, " using", false], [4450, 0.071916, " by", false], [47806, 0.041384, " within", false], [40062, 0.027717, " under", false], [4424, 0.027633, " at", false], [31601, 0.01447, " over", false], [45202, 0.009548, " around", false]]], "qwen": [438, 16, 0.008154122158885002, [[304, 0.233193, " in", false], [389, 0.124188, " on", false], [553, 0.121443, " by", false], [448, 0.089342, " with", false], [1212, 0.067534, " under", false], [2878, 0.056427, " within", false], [1667, 0.0494, " using", false], [518, 0.029888, " at", false], [916, 0.023816, " over", false], [2163, 0.015385, " around", false]]]}, "raw_delta": 0.17817274729410815, "tuned_delta": 0.1849850251012061}, {"byte_start": 395, "byte_end": 398, "display": {"text": " if", "kind": "normal"}, "is_word": true, "word_id": 68, "word_key": " if", "bytes_hex": "20 69 66", "compression": {"rwkv": "9.67% 9.67% 9.67%", "qwen": "11.76% 11.76% 11.76%"}, "model_tokens": {"rwkv": [[4588, " if", "normal", 0.20092779397964478]], "qwen": [[421, " if", "normal", 0.14144553244113922]]}, "loss": {"rwkv": 9.674322214294481, "qwen": 11.757006318845464}, "topk": {"rwkv": [4588, 2, 0.20092779397964478, [[332, 0.297691, " a", false], [4588, 0.200928, " if", false], [4419, 0.121153, " an", false], [47544, 0.060705, " though", false], [31633, 0.059267, " part", false], [22590, 0.017067, " the", false], [269, 0.012854, " \"", false], [50937, 0.007616, " applied", false], [32074, 0.007003, " some", false], [57103, 0.006216, " research", false]]], "qwen": [421, 2, 0.14144553244113922, [[264, 0.3322, " a", false], [421, 0.141446, " if", false], [458, 0.093673, " an", false], [949, 0.070602, " part", false], [3498, 0.029649, " though", false], [279, 0.018577, " the", false], [2987, 0.010033, " either", false], [330, 0.009308, " \"", false], [11017, 0.007624, " follows", false], [9251, 0.005406, " applied", false]]]}, "raw_delta": -0.11548852920532227, "tuned_delta": -0.10867625139822432}, {"byte_start": 398, "byte_end": 402, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 69, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "7.82% 7.82% 7.82% 7.82%", "qwen": "8.42% 8.42% 8.42% 8.42%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.17570608854293823]], "qwen": [[279, " the", "normal", 0.1544894278049469]]}, "loss": {"rwkv": 7.819294411068111, "qwen": 8.420062594724723}, "topk": {"rwkv": [22590, 1, 0.17570608854293823, [[22590, 0.175706, " the", false], [32234, 0.097432, " this", false], [4858, 0.084455, " we", false], [4601, 0.07834, " it", false], [39934, 0.066234, " there", false], [37045, 0.047923, " Moore", false], [3609, 0.040152, " AI", false], [63370, 0.025332, " computation", false], [22226, 0.024791, " one", false], [51832, 0.016371, " general", false]]], "qwen": [279, 1, 0.1544894278049469, [[279, 0.154489, " the", false], [432, 0.100706, " it", false], [1052, 0.094937, " there", false], [419, 0.078101, " this", false], [582, 0.064453, " we", false], [34447, 0.05836, " computation", false], [20219, 0.025845, " Moore", false], [24231, 0.023952, " computing", false], [264, 0.020418, " a", false], [429, 0.016013, " that", false]]]}, "raw_delta": -0.03331366181373596, "tuned_delta": -0.026501384006638016}, {"byte_start": 402, "byte_end": 414, "display": {"text": " computation", "kind": "normal"}, "is_word": true, "word_id": 70, "word_key": " computation", "bytes_hex": "20 63 6f 6d 70 75 74 61 74 69 6f 6e", "compression": {"rwkv": "7.04% 7.04% 7.04% 7.04% 7.04% 7.04% 7.04% 7.04% 7.04% 7.04% 7.04% 7.04%", "qwen": "8.09% 8.09% 8.09% 8.09% 8.09% 8.09% 8.09% 8.09% 8.09% 8.09% 8.09% 8.09%"}, "model_tokens": {"rwkv": [[63370, " computation", "normal", 0.009298537857830524]], "qwen": [[34447, " computation", "normal", 0.004578007850795984]]}, "loss": {"rwkv": 7.044409379340641, "qwen": 8.094858629573698}, "topk": {"rwkv": [63370, 16, 0.009298537857830524, [[30510, 0.170258, " cost", false], [31581, 0.04631, " only", false], [30985, 0.029842, " goal", false], [52569, 0.029432, " problem", false], [64862, 0.027141, " computational", false], [40213, 0.023945, " world", false], [56353, 0.015904, " hardware", false], [57481, 0.015429, " ultimate", false], [38124, 0.013962, " costs", false], [31356, 0.012465, " main", false]]], "qwen": [34447, 29, 0.004578007850795984, [[2783, 0.218788, " cost", false], [3853, 0.04936, " future", false], [3491, 0.035279, " problem", false], [16724, 0.026408, " ultimate", false], [1879, 0.024884, " world", false], [1172, 0.024796, " only", false], [7049, 0.019743, " costs", false], [54480, 0.016114, " computational", false], [11773, 0.013483, " hardware", false], [6366, 0.01246, " computer", false]]]}, "raw_delta": -0.05824927488962813, "tuned_delta": -0.05143699708253018}, {"byte_start": 414, "byte_end": 424, "display": {"text": " available", "kind": "normal"}, "is_word": true, "word_id": 71, "word_key": " available", "bytes_hex": "20 61 76 61 69 6c 61 62 6c 65", "compression": {"rwkv": "7.04% 7.04% 7.04% 7.04% 7.04% 7.04% 7.04% 7.04% 7.04% 7.04%", "qwen": "4.96% 4.96% 4.96% 4.96% 4.96% 4.96% 4.96% 4.96% 4.96% 4.96%"}, "model_tokens": {"rwkv": [[59206, " available", "normal", 0.02023669332265854]], "qwen": [[2500, " available", "normal", 0.06380987167358398]]}, "loss": {"rwkv": 7.044409379340641, "qwen": 4.962595936959651}, "topk": {"rwkv": [59206, 9, 0.02023669332265854, [[22748, 0.228598, " was", false], [4600, 0.096069, " is", false], [32462, 0.082066, " were", false], [30510, 0.071212, " cost", false], [40219, 0.054905, " would", false], [38128, 0.033527, " could", false], [46342, 0.025016, " itself", false], [4706, 0.022061, " of", false], [59206, 0.020237, " available", false], [52569, 0.018384, " problem", false]]], "qwen": [2500, 4, 0.06380987167358398, [[2783, 0.125413, " cost", false], [374, 0.093354, " is", false], [572, 0.089454, " was", false], [2500, 0.06381, " available", false], [7049, 0.047193, " costs", false], [8039, 0.035703, " budget", false], [1033, 0.034068, " were", false], [315, 0.025528, " of", false], [686, 0.024158, " will", false], [3491, 0.023169, " problem", false]]]}, "raw_delta": 0.1154402494430542, "tuned_delta": 0.12225252725015215}, {"byte_start": 424, "byte_end": 427, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 72, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "7.42% 7.42% 7.42%", "qwen": "4.65% 4.65% 4.65%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.29217150807380676]], "qwen": [[311, " to", "normal", 0.4611510634422302]]}, "loss": {"rwkv": 7.420111212905475, "qwen": 4.652869514643304}, "topk": {"rwkv": [4811, 1, 0.29217150807380676, [[4811, 0.292172, " to", false], [22748, 0.146888, " was", false], [32462, 0.124536, " were", false], [4600, 0.088177, " is", false], [21700, 0.083984, " for", false], [40219, 0.042249, " would", false], [4596, 0.036748, " in", false], [4712, 0.027233, " on", false], [39971, 0.021978, " today", false], [4424, 0.015371, " at", false]]], "qwen": [311, 1, 0.4611510634422302, [[311, 0.461151, " to", false], [572, 0.094041, " was", false], [3351, 0.084702, " today", false], [374, 0.061872, " is", false], [1033, 0.057448, " were", false], [304, 0.032404, " in", false], [1035, 0.02982, " would", false], [369, 0.024711, " for", false], [518, 0.024061, " at", false], [686, 0.020078, " will", false]]]}, "raw_delta": 0.1534484624862671, "tuned_delta": 0.16026074029336504}, {"byte_start": 427, "byte_end": 431, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 73, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "11.62% 11.62% 11.62% 11.62%", "qwen": "11.27% 11.27% 11.27% 11.27%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.07531214505434036]], "qwen": [[279, " the", "normal", 0.08203161507844925]]}, "loss": {"rwkv": 11.623275475912058, "qwen": 11.273987311142236}, "topk": {"rwkv": [22590, 4, 0.07531214505434036, [[63843, 0.200434, " researchers", false], [3609, 0.139668, " AI", false], [4835, 0.098905, " us", false], [22590, 0.075312, " the", false], [39740, 0.054488, " solve", false], [4601, 0.054387, " it", false], [332, 0.043404, " a", false], [46227, 0.031346, " humans", false], [4419, 0.025295, " an", false], [4491, 0.016731, " do", false]]], "qwen": [279, 3, 0.08203161507844925, [[601, 0.346554, " us", false], [432, 0.134368, " it", false], [279, 0.082032, " the", false], [264, 0.0735, " a", false], [11811, 0.03848, " researchers", false], [15235, 0.035806, " AI", false], [458, 0.03419, " an", false], [11625, 0.03216, " solve", false], [12677, 0.024675, " humans", false], [1105, 0.008507, " them", false]]]}, "raw_delta": 0.019368648529052734, "tuned_delta": 0.02618092633615068}, {"byte_start": 431, "byte_end": 437, "display": {"text": " agent", "kind": "normal"}, "is_word": true, "word_id": 74, "word_key": " agent", "bytes_hex": "20 61 67 65 6e 74", "compression": {"rwkv": "15.03% 15.03% 15.03% 15.03% 15.03% 15.03%", "qwen": "15.32% 15.32% 15.32% 15.32% 15.32% 15.32%"}, "model_tokens": {"rwkv": [[37636, " agent", "normal", 0.006844471208751202]], "qwen": [[8315, " agent", "normal", 0.006113724783062935]]}, "loss": {"rwkv": 15.028073342593368, "qwen": 15.320276165975551}, "topk": {"rwkv": [37636, 17, 0.006844471208751202, [[3609, 0.240651, " AI", false], [62496, 0.198258, " researcher", false], [63843, 0.14876, " researchers", false], [57103, 0.036901, " research", false], [52569, 0.02812, " problem", false], [59113, 0.023327, " algorithm", false], [47487, 0.017573, " system", false], [52581, 0.015724, " project", false], [38478, 0.014995, " field", false], [40213, 0.01417, " world", false]]], "qwen": [8315, 19, 0.006113724783062935, [[31085, 0.271469, " researcher", false], [15235, 0.14507, " AI", false], [2070, 0.099388, " field", false], [11811, 0.054255, " researchers", false], [3738, 0.051663, " human", false], [3412, 0.025836, " research", false], [5662, 0.024803, " machine", false], [1879, 0.024768, " world", false], [1849, 0.021812, " system", false], [12111, 0.016211, " algorithm", false]]]}, "raw_delta": -0.01620316505432129, "tuned_delta": -0.009390887247223343}, {"byte_start": 437, "byte_end": 442, "display": {"text": " were", "kind": "normal"}, "is_word": true, "word_id": 75, "word_key": " were", "bytes_hex": "20 77 65 72 65", "compression": {"rwkv": "6.48% 6.48% 6.48% 6.48% 6.48%", "qwen": "6.27% 6.27% 6.27% 6.27% 6.27%"}, "model_tokens": {"rwkv": [[32462, " were", "normal", 0.1658431589603424]], "qwen": [[1033, " were", "normal", 0.17594511806964874]]}, "loss": {"rwkv": 6.48085662899339, "qwen": 6.2670065216045385}, "topk": {"rwkv": [32462, 3, 0.1658431589603424, [[22748, 0.255732, " was", false], [4600, 0.196697, " is", false], [32462, 0.165843, " were", false], [40219, 0.083737, " would", false], [38128, 0.035155, " could", false], [32475, 0.018554, " will", false], [4596, 0.016928, " in", false], [275, 0.014465, " (", false], [21265, 0.013386, " and", false], [45, 0.011112, ",", false]]], "qwen": [1033, 3, 0.17594511806964874, [[374, 0.26816, " is", false], [572, 0.215074, " was", false], [1033, 0.175945, " were", false], [1035, 0.044511, " would", false], [686, 0.039311, " will", false], [1410, 0.025966, " could", false], [518, 0.021568, " at", false], [304, 0.018258, " in", false], [702, 0.016137, " has", false], [320, 0.014433, " (", false]]]}, "raw_delta": 0.011858367919921897, "tuned_delta": 0.018670645727019843}, {"byte_start": 442, "byte_end": 451, "display": {"text": " constant", "kind": "normal"}, "is_word": true, "word_id": 76, "word_key": " constant", "bytes_hex": "20 63 6f 6e 73 74 61 6e 74", "compression": {"rwkv": "7.42% 7.42% 7.42% 7.42% 7.42% 7.42% 7.42% 7.42% 7.42%", "qwen": "8.21% 8.21% 8.21% 8.21% 8.21% 8.21% 8.21% 8.21% 8.21%"}, "model_tokens": {"rwkv": [[55836, " constant", "normal", 0.024332519620656967]], "qwen": [[6783, " constant", "normal", 0.01665637083351612]]}, "loss": {"rwkv": 7.420111212905476, "qwen": 8.205253098838568}, "topk": {"rwkv": [55836, 8, 0.024332519620656967, [[38501, 0.163635, " fixed", false], [56447, 0.137836, " infinite", false], [60706, 0.110061, " unlimited", false], [332, 0.051199, " a", false], [30911, 0.050012, " free", false], [63507, 0.032124, " effectively", false], [22590, 0.029119, " the", false], [55836, 0.024333, " constant", false], [52140, 0.019532, " limited", false], [22187, 0.018872, " not", false]]], "qwen": [6783, 8, 0.01665637083351612, [[23809, 0.144194, " infinite", false], [26764, 0.115091, " unlimited", false], [7199, 0.090128, " limited", false], [8356, 0.073454, " fixed", false], [264, 0.065811, " a", false], [1910, 0.037812, " free", false], [650, 0.032257, " un", false], [6783, 0.016656, " constant", false], [91559, 0.01608, " limitless", false], [537, 0.01543, " not", false]]]}, "raw_delta": -0.04353751076592344, "tuned_delta": -0.03672523295882549}, {"byte_start": 451, "byte_end": 453, "display": {"text": " (", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "20 28", "compression": {"rwkv": "30.43% 30.43%", "qwen": "29.14% 29.14%"}, "model_tokens": {"rwkv": [[275, " (", "normal", 0.03355303779244423]], "qwen": [[320, " (", "normal", 0.03947778046131134]]}, "loss": {"rwkv": 30.43184851875157, "qwen": 29.142595625040475}, "topk": {"rwkv": [275, 6, 0.03355303779244423, [[45, 0.4971, ",", false], [47, 0.24006, ".", false], [60, 0.042901, ";", false], [4715, 0.035257, " or", false], [21265, 0.034475, " and", false], [275, 0.033553, " (", false], [31601, 0.022237, " over", false], [4596, 0.014619, " in", false], [59, 0.007182, ":", false], [21700, 0.006532, " for", false]]], "qwen": [320, 5, 0.03947778046131134, [[11, 0.466767, ",", false], [13, 0.157859, ".", false], [476, 0.118998, " or", false], [323, 0.048784, " and", false], [320, 0.039478, " (", false], [624, 0.024425, ".\n", false], [304, 0.023464, " in", false], [26, 0.020988, ";", false], [916, 0.012563, " over", false], [25, 0.008847, ":", false]]]}, "raw_delta": 0.07149136066436768, "tuned_delta": 0.07830363847146563}, {"byte_start": 453, "byte_end": 455, "display": {"text": "in", "kind": "normal"}, "is_word": true, "word_id": 77, "word_key": "in", "bytes_hex": "69 6e", "compression": {"rwkv": "28.32% 28.32%", "qwen": "31.87% 31.87%"}, "model_tokens": {"rwkv": [[1950, "in", "normal", 0.04373638704419136]], "qwen": [[258, "in", "normal", 0.029175065457820892]]}, "loss": {"rwkv": 28.318525704949376, "qwen": 31.869503092109046}, "topk": {"rwkv": [1950, 4, 0.04373638704419136, [[2101, 0.257472, "or", false], [7005, 0.071489, "and", false], [106, 0.046254, "i", false], [1950, 0.043736, "in", false], [36003, 0.033586, "which", false], [102, 0.028551, "e", false], [98, 0.028039, "a", false], [1751, 0.023873, "as", false], [8801, 0.020484, "the", false], [1752, 0.0195, "at", false]]], "qwen": [258, 7, 0.029175065457820892, [[269, 0.199894, "or", false], [72, 0.072016, "i", false], [437, 0.065276, "and", false], [300, 0.051478, "as", false], [68, 0.049405, "e", false], [8206, 0.038289, "which", false], [258, 0.029175, "in", false], [4535, 0.027088, "though", false], [1782, 0.021445, "the", false], [1958, 0.018568, "for", false]]]}, "raw_delta": -0.19690799713134766, "tuned_delta": -0.1900957193242497}, {"byte_start": 455, "byte_end": 461, "display": {"text": " which", "kind": "normal"}, "is_word": true, "word_id": 78, "word_key": " which", "bytes_hex": "20 77 68 69 63 68", "compression": {"rwkv": "17.00% 17.00% 17.00% 17.00% 17.00% 17.00%", "qwen": "7.09% 7.09% 7.09% 7.09% 7.09% 7.09%"}, "model_tokens": {"rwkv": [[40186, " which", "normal", 0.003479801584035158]], "qwen": [[892, " which", "normal", 0.09437352418899536]]}, "loss": {"rwkv": 17.000507968808748, "qwen": 7.0947379523325065}, "topk": {"rwkv": [40186, 36, 0.003479801584035158, [[22590, 0.17294, " the", false], [39920, 0.087623, " terms", false], [30808, 0.077476, " fact", false], [32074, 0.054629, " some", false], [62293, 0.044473, " particular", false], [32251, 0.039697, " time", false], [332, 0.036635, " a", false], [56901, 0.03394, " practice", false], [39193, 0.032499, " other", false], [55856, 0.029396, " contrast", false]]], "qwen": [892, 3, 0.09437352418899536, [[279, 0.158246, " the", false], [2097, 0.094419, " fact", false], [892, 0.094374, " which", false], [3793, 0.060052, " terms", false], [6588, 0.042931, " practice", false], [264, 0.037449, " a", false], [37555, 0.036592, "dependent", false], [1045, 0.031777, " some", false], [1008, 0.031536, " other", false], [12872, 0.027771, " contrast", false]]]}, "raw_delta": 0.54929252465566, "tuned_delta": 0.556104802462758}, {"byte_start": 461, "byte_end": 466, "display": {"text": " case", "kind": "normal"}, "is_word": true, "word_id": 79, "word_key": " case", "bytes_hex": "20 63 61 73 65", "compression": {"rwkv": "0.19% 0.19% 0.19% 0.19% 0.19%", "qwen": "0.09% 0.09% 0.09% 0.09% 0.09%"}, "model_tokens": {"rwkv": [[30405, " case", "normal", 0.9479021430015564]], "qwen": [[1142, " case", "normal", 0.9761645793914795]]}, "loss": {"rwkv": 0.19196015558703247, "qwen": 0.08700916041125867}, "topk": {"rwkv": [30405, 1, 0.9479021430015564, [[30405, 0.947902, " case", false], [22590, 0.008363, " the", false], [4601, 0.007453, " it", false], [4858, 0.002856, " we", false], [37970, 0.001525, " cases", false], [37045, 0.001407, " Moore", false], [39934, 0.001192, " there", false], [332, 0.00115, " a", false], [39631, 0.001035, " sense", false], [45, 0.001016, ",", false]]], "qwen": [1142, 1, 0.9761645793914795, [[1142, 0.976165, " case", false], [432, 0.004039, " it", false], [279, 0.00354, " the", false], [5048, 0.002521, " cases", false], [374, 0.000955, " is", false], [582, 0.000813, " we", false], [11, 0.000769, ",", false], [5530, 0.000749, " sense", false], [498, 0.000373, " you", false], [678, 0.000372, " all", false]]]}, "raw_delta": 0.005819718912243844, "tuned_delta": 0.01263199671934179}, {"byte_start": 466, "byte_end": 477, "display": {"text": " leveraging", "kind": "normal"}, "is_word": true, "word_id": 80, "word_key": " leveraging", "bytes_hex": "20 6c 65 76 65 72 61 67 69 6e 67", "compression": {"rwkv": "24.80% 24.80% 24.80% 24.80% 24.80% 24.80% 0.05% 0.05% 0.05% 0.05% 0.05%", "qwen": "13.60% 13.60% 13.60% 13.60% 13.60% 13.60% 13.60% 13.60% 13.60% 13.60% 13.60%"}, "model_tokens": {"rwkv": [[38888, " lever", "normal", 0.00026638750568963587], [33672, "aging", "normal", 0.9850167036056519]], "qwen": [[76482, " leveraging", "normal", 0.0002496717497706413]]}, "loss": {"rwkv": 13.550081541374894, "qwen": 13.59963599700304}, "topk": {"rwkv": [38888, 205, 0.00026638750568963587, [[22590, 0.229858, " the", false], [45, 0.136927, ",", false], [4601, 0.118349, " it", false], [4858, 0.043488, " we", false], [39934, 0.038344, " there", false], [22799, 0.021429, " you", false], [332, 0.018729, " a", false], [22226, 0.01543, " one", false], [3609, 0.014484, " AI", false], [21273, 0.01222, " any", false]]], "qwen": [76482, 226, 0.0002496717497706413, [[11, 0.249015, ",", false], [279, 0.172923, " the", false], [432, 0.080018, " it", false], [582, 0.052138, " we", false], [264, 0.025589, " a", false], [498, 0.025274, " you", false], [1052, 0.022696, " there", false], [825, 0.012884, " one", false], [1429, 0.012434, " most", false], [678, 0.010484, " all", false]]]}, "raw_delta": -0.0027478824962268167, "tuned_delta": 0.00406439531087113}, {"byte_start": 477, "byte_end": 483, "display": {"text": " human", "kind": "normal"}, "is_word": true, "word_id": 81, "word_key": " human", "bytes_hex": "20 68 75 6d 61 6e", "compression": {"rwkv": "16.91% 16.91% 16.91% 16.91% 16.91% 16.91%", "qwen": "20.96% 20.96% 20.96% 20.96% 20.96% 20.96%"}, "model_tokens": {"rwkv": [[38720, " human", "normal", 0.003654728177934885]], "qwen": [[3738, " human", "normal", 0.0009363950230181217]]}, "loss": {"rwkv": 16.90658251041754, "qwen": 20.959572955879473}, "topk": {"rwkv": [38720, 15, 0.003654728177934885, [[63370, 0.519924, " computation", false], [22590, 0.090481, " the", false], [4601, 0.033939, " it", false], [31458, 0.025397, " more", false], [51832, 0.023595, " general", false], [64862, 0.016014, " computational", false], [32227, 0.015802, " that", false], [3609, 0.010085, " AI", false], [32234, 0.009323, " this", false], [51266, 0.008186, " compute", false]]], "qwen": [3738, 62, 0.0009363950230181217, [[34447, 0.467746, " computation", false], [432, 0.120113, " it", false], [279, 0.068171, " the", false], [803, 0.032484, " more", false], [264, 0.021402, " a", false], [54480, 0.01602, " computational", false], [429, 0.011881, " that", false], [24231, 0.01097, " computing", false], [4586, 0.008736, " general", false], [374, 0.008231, " is", false]]]}, "raw_delta": -0.224745512008667, "tuned_delta": -0.21793323420156904}, {"byte_start": 483, "byte_end": 493, "display": {"text": " knowledge", "kind": "normal"}, "is_word": true, "word_id": 82, "word_key": " knowledge", "bytes_hex": "20 6b 6e 6f 77 6c 65 64 67 65", "compression": {"rwkv": "5.49% 5.49% 5.49% 5.49% 5.49% 5.49% 5.49% 5.49% 5.49% 5.49%", "qwen": "4.41% 4.41% 4.41% 4.41% 4.41% 4.41% 4.41% 4.41% 4.41% 4.41%"}, "model_tokens": {"rwkv": [[59943, " knowledge", "normal", 0.047155652195215225]], "qwen": [[6540, " knowledge", "normal", 0.08692403882741928]]}, "loss": {"rwkv": 5.4946393158857, "qwen": 4.405126212973418}, "topk": {"rwkv": [59943, 5, 0.047155652195215225, [[64452, 0.166918, " intelligence", false], [63370, 0.091577, " computation", false], [46, 0.08564, "-", false], [38853, 0.05131, " labor", false], [59943, 0.047156, " knowledge", false], [59917, 0.031137, " intuition", false], [59683, 0.027424, " expertise", false], [59304, 0.026105, " cognition", false], [4715, 0.022797, " or", false], [21265, 0.015386, " and", false]]], "qwen": [6540, 3, 0.08692403882741928, [[11229, 0.127482, " intelligence", false], [18726, 0.106964, " expertise", false], [6540, 0.086924, " knowledge", false], [34447, 0.051886, " computation", false], [9327, 0.038036, " labor", false], [56251, 0.029934, " intuition", false], [20017, 0.020528, " insight", false], [27597, 0.01394, " creativity", false], [6203, 0.01205, " expert", false], [23389, 0.011551, " wisdom", false]]]}, "raw_delta": 0.06041543483734131, "tuned_delta": 0.06722771264443926}, {"byte_start": 493, "byte_end": 499, "display": {"text": " would", "kind": "normal"}, "is_word": true, "word_id": 83, "word_key": " would", "bytes_hex": "20 77 6f 75 6c 64", "compression": {"rwkv": "7.70% 7.70% 7.70% 7.70% 7.70% 7.70%", "qwen": "4.58% 4.58% 4.58% 4.58% 4.58% 4.58%"}, "model_tokens": {"rwkv": [[40219, " would", "normal", 0.0777372196316719]], "qwen": [[1035, " would", "normal", 0.21791388094425201]]}, "loss": {"rwkv": 7.7018875880791, "qwen": 4.579520705536263}, "topk": {"rwkv": [40219, 3, 0.0777372196316719, [[4600, 0.275333, " is", false], [21265, 0.135334, " and", false], [40219, 0.077737, " would", false], [4811, 0.046703, " to", false], [22748, 0.043284, " was", false], [45, 0.03747, ",", false], [4715, 0.032001, " or", false], [4706, 0.027182, " of", false], [4596, 0.022298, " in", false], [51019, 0.021557, " becomes", false]]], "qwen": [1035, 1, 0.21791388094425201, [[1035, 0.217914, " would", false], [374, 0.210744, " is", false], [323, 0.095186, " and", false], [311, 0.050285, " to", false], [11, 0.038354, ",", false], [476, 0.036735, " or", false], [572, 0.023529, " was", false], [304, 0.022526, " in", false], [4566, 0.020117, " via", false], [911, 0.017185, " about", false]]]}, "raw_delta": 0.17314078410466507, "tuned_delta": 0.17995306191176302}, {"byte_start": 499, "byte_end": 502, "display": {"text": " be", "kind": "normal"}, "is_word": true, "word_id": 84, "word_key": " be", "bytes_hex": "20 62 65", "compression": {"rwkv": "2.27% 2.27% 2.27%", "qwen": "2.55% 2.55% 2.55%"}, "model_tokens": {"rwkv": [[4435, " be", "normal", 0.6868736743927002]], "qwen": [[387, " be", "normal", 0.6547784805297852]]}, "loss": {"rwkv": 2.265951683687906, "qwen": 2.5455050039505354}, "topk": {"rwkv": [4435, 1, 0.6868736743927002, [[4435, 0.686874, " be", false], [31059, 0.081492, " have", false], [22187, 0.016735, " not", false], [39820, 0.01499, " still", false], [31358, 0.011541, " make", false], [45150, 0.009851, " always", false], [53056, 0.009584, " suffice", false], [31967, 0.007366, " seem", false], [31581, 0.006199, " only", false], [46439, 0.005892, " likely", false]]], "qwen": [387, 1, 0.6547784805297852, [[387, 0.654778, " be", false], [614, 0.071888, " have", false], [537, 0.016801, " not", false], [2058, 0.015372, " still", false], [76156, 0.012673, " suffice", false], [1281, 0.011296, " make", false], [2677, 0.010566, " always", false], [2803, 0.008881, " seem", false], [4658, 0.008868, " probably", false], [4363, 0.008818, " likely", false]]]}, "raw_delta": -0.015501727660497039, "tuned_delta": -0.008689449853399093}, {"byte_start": 502, "byte_end": 506, "display": {"text": " one", "kind": "normal"}, "is_word": true, "word_id": 85, "word_key": " one", "bytes_hex": "20 6f 6e 65", "compression": {"rwkv": "27.33% 27.33% 27.33% 27.33%", "qwen": "30.48% 30.48% 30.48% 30.48%"}, "model_tokens": {"rwkv": [[22226, " one", "normal", 0.0023129908367991447]], "qwen": [[825, " one", "normal", 0.0011593190720304847]]}, "loss": {"rwkv": 27.332308391841686, "qwen": 30.476583356024122}, "topk": {"rwkv": [22226, 48, 0.0023129908367991447, [[22590, 0.305541, " the", false], [332, 0.089714, " a", false], [31458, 0.050756, " more", false], [62606, 0.031313, " sufficient", false], [31461, 0.03089, " most", false], [52371, 0.02915, " optimal", false], [31466, 0.020339, " much", false], [4419, 0.019923, " an", false], [59829, 0.018657, " important", false], [4706, 0.014167, " of", false]]], "qwen": [825, 67, 0.0011593190720304847, [[279, 0.387049, " the", false], [803, 0.096544, " more", false], [264, 0.065433, " a", false], [22823, 0.037437, " optimal", false], [1429, 0.022295, " most", false], [458, 0.016741, " an", false], [1753, 0.01659, " much", false], [14016, 0.016242, " sufficient", false], [3041, 0.015432, " far", false], [2664, 0.014423, " better", false]]]}, "raw_delta": -0.1743556261062622, "tuned_delta": -0.16754334829916426}, {"byte_start": 506, "byte_end": 509, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 86, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "3.97% 3.97% 3.97%", "qwen": "4.45% 4.45% 4.45%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.5132889151573181]], "qwen": [[315, " of", "normal", 0.4768576920032501]]}, "loss": {"rwkv": 3.968350617028561, "qwen": 4.451538741005137}, "topk": {"rwkv": [4706, 1, 0.5132889151573181, [[4706, 0.513289, " of", false], [22752, 0.089701, " way", false], [39941, 0.080461, " thing", false], [55532, 0.035376, " approach", false], [460, 0.029679, "'s", false], [46713, 0.020422, " option", false], [56895, 0.019323, " possible", false], [46561, 0.014706, " method", false], [57260, 0.012746, " solution", false], [59593, 0.008126, " effective", false]]], "qwen": [315, 1, 0.4768576920032501, [[315, 0.476858, " of", false], [1616, 0.127351, " way", false], [2999, 0.081661, " option", false], [5486, 0.029032, " approach", false], [6291, 0.027137, " solution", false], [3204, 0.023123, " possible", false], [594, 0.022702, "'s", false], [1714, 0.017687, " method", false], [7373, 0.012969, " effective", false], [8282, 0.008211, " strategy", false]]]}, "raw_delta": -0.026793638865152986, "tuned_delta": -0.01998136105805504}, {"byte_start": 509, "byte_end": 513, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 87, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "0.27% 0.27% 0.27% 0.27%", "qwen": "0.27% 0.27% 0.27% 0.27%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.941115140914917]], "qwen": [[279, " the", "normal", 0.9428697228431702]]}, "loss": {"rwkv": 0.27407155241497183, "qwen": 0.26521777134132535}, "topk": {"rwkv": [22590, 1, 0.941115140914917, [[22590, 0.941115, " the", false], [21902, 0.008369, " its", false], [31370, 0.006666, " many", false], [52869, 0.006551, " several", false], [21674, 0.004541, " few", false], [22638, 0.004424, " two", false], [332, 0.004005, " a", false], [31581, 0.003391, " only", false], [45, 0.003109, ",", false], [32386, 0.002897, " very", false]]], "qwen": [279, 1, 0.9428697228431702, [[279, 0.94287, " the", false], [1181, 0.008991, " its", false], [1172, 0.008451, " only", false], [1657, 0.007163, " many", false], [1039, 0.006467, " our", false], [3807, 0.004442, " several", false], [264, 0.00355, " a", false], [697, 0.003538, " your", false], [2421, 0.002282, " few", false], [1378, 0.00215, " two", false]]]}, "raw_delta": 0.0004909578710794449, "tuned_delta": 0.007303235678177392}, {"byte_start": 513, "byte_end": 518, "display": {"text": " only", "kind": "normal"}, "is_word": true, "word_id": 88, "word_key": " only", "bytes_hex": "20 6f 6e 6c 79", "compression": {"rwkv": "11.72% 11.72% 11.72% 11.72% 11.72%", "qwen": "9.09% 9.09% 9.09% 9.09% 9.09%"}, "model_tokens": {"rwkv": [[31581, " only", "normal", 0.03869470953941345]], "qwen": [[1172, " only", "normal", 0.08046524226665497]]}, "loss": {"rwkv": 11.721897207222828, "qwen": 9.08872587431064}, "topk": {"rwkv": [31581, 4, 0.03869470953941345, [[31461, 0.453984, " most", false], [30273, 0.105875, " best", false], [21674, 0.07123, " few", false], [31581, 0.038695, " only", false], [31458, 0.03463, " more", false], [51039, 0.031086, " biggest", false], [31356, 0.024239, " main", false], [51718, 0.016087, " fastest", false], [38879, 0.012409, " least", false], [52555, 0.012332, " primary", false]]], "qwen": [1172, 4, 0.08046524226665497, [[1429, 0.287685, " most", false], [1850, 0.214394, " best", false], [2421, 0.089719, " few", false], [1172, 0.080465, " only", false], [1887, 0.038782, " main", false], [803, 0.03611, " more", false], [2664, 0.032344, " better", false], [6028, 0.021359, " primary", false], [1376, 0.015158, " key", false], [42049, 0.008197, " cheapest", false]]]}, "raw_delta": 0.14601402282714848, "tuned_delta": 0.15282630063424643}, {"byte_start": 518, "byte_end": 523, "display": {"text": " ways", "kind": "normal"}, "is_word": true, "word_id": 89, "word_key": " ways", "bytes_hex": "20 77 61 79 73", "compression": {"rwkv": "3.48% 3.48% 3.48% 3.48% 3.48%", "qwen": "6.60% 6.60% 6.60% 6.60% 6.60%"}, "model_tokens": {"rwkv": [[32448, " ways", "normal", 0.3810039460659027]], "qwen": [[5510, " ways", "normal", 0.16065028309822083]]}, "loss": {"rwkv": 3.4799382333942765, "qwen": 6.59501140337346}, "topk": {"rwkv": [32448, 1, 0.3810039460659027, [[32448, 0.381004, " ways", false], [59593, 0.073664, " effective", false], [47539, 0.066903, " things", false], [52373, 0.061294, " options", false], [56895, 0.026046, " possible", false], [52224, 0.023532, " methods", false], [47720, 0.01893, " viable", false], [52957, 0.017383, " sources", false], [60376, 0.014975, " remaining", false], [56212, 0.010934, " feasible", false]]], "qwen": [5510, 2, 0.16065028309822083, [[2606, 0.185292, " options", false], [5510, 0.16065, " ways", false], [7373, 0.121537, " effective", false], [30428, 0.061611, " viable", false], [5413, 0.035611, " methods", false], [3363, 0.030889, " means", false], [19827, 0.029106, " approaches", false], [3204, 0.028069, " possible", false], [2513, 0.027952, " things", false], [4586, 0.015256, " general", false]]]}, "raw_delta": -0.17273633480072023, "tuned_delta": -0.16592405699362228}, {"byte_start": 523, "byte_end": 526, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 90, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "1.17% 1.17% 1.17%", "qwen": "1.50% 1.50% 1.50%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.822160005569458]], "qwen": [[311, " to", "normal", 0.7796909809112549]]}, "loss": {"rwkv": 1.1740682298901068, "qwen": 1.4959401207549632}, "topk": {"rwkv": [4811, 1, 0.822160005569458, [[4811, 0.82216, " to", false], [4706, 0.047518, " of", false], [21700, 0.042885, " for", false], [4596, 0.017674, " in", false], [32227, 0.011956, " that", false], [22590, 0.008332, " the", false], [51791, 0.006823, " forward", false], [22799, 0.004743, " you", false], [4601, 0.004576, " it", false], [22226, 0.003303, " one", false]]], "qwen": [311, 1, 0.7796909809112549, [[311, 0.779691, " to", false], [315, 0.058685, " of", false], [429, 0.026445, " that", false], [582, 0.012324, " we", false], [458, 0.011095, " an", false], [369, 0.010228, " for", false], [498, 0.009548, " you", false], [4637, 0.009054, " forward", false], [701, 0.008555, "),", false], [279, 0.007961, " the", false]]]}, "raw_delta": -0.01784836749235788, "tuned_delta": -0.011036089685259935}, {"byte_start": 526, "byte_end": 534, "display": {"text": " improve", "kind": "normal"}, "is_word": true, "word_id": 91, "word_key": " improve", "bytes_hex": "20 69 6d 70 72 6f 76 65", "compression": {"rwkv": "3.01% 3.01% 3.01% 3.01% 3.01% 3.01% 3.01% 3.01%", "qwen": "3.96% 3.96% 3.96% 3.96% 3.96% 3.96% 3.96% 3.96%"}, "model_tokens": {"rwkv": [[51982, " improve", "normal", 0.2605814039707184]], "qwen": [[7269, " improve", "normal", 0.17285309731960297]]}, "loss": {"rwkv": 3.011485009668124, "qwen": 3.9568462317260016}, "topk": {"rwkv": [51982, 1, 0.2605814039707184, [[51982, 0.260581, " improve", false], [21751, 0.101416, " get", false], [31358, 0.07465, " make", false], [56433, 0.061593, " increase", false], [30938, 0.061472, " gain", false], [50848, 0.020946, " achieve", false], [37886, 0.018309, " boost", false], [39590, 0.01561, " scale", false], [56950, 0.013471, " progress", false], [46694, 0.013091, " obtain", false]]], "qwen": [7269, 1, 0.17285309731960297, [[7269, 0.172853, " improve", false], [1281, 0.086589, " make", false], [633, 0.077066, " get", false], [8722, 0.046208, " gain", false], [11075, 0.041978, " achieve", false], [32064, 0.035684, " leverage", false], [653, 0.034434, " do", false], [11625, 0.030462, " solve", false], [7949, 0.025845, " reduce", false], [11912, 0.017287, " advance", false]]]}, "raw_delta": -0.05242195725440979, "tuned_delta": -0.04560967944731184}, {"byte_start": 534, "byte_end": 546, "display": {"text": " performance", "kind": "normal"}, "is_word": true, "word_id": 92, "word_key": " performance", "bytes_hex": "20 70 65 72 66 6f 72 6d 61 6e 63 65", "compression": {"rwkv": "1.54% 1.54% 1.54% 1.54% 1.54% 1.54% 1.54% 1.54% 1.54% 1.54% 1.54% 1.54%", "qwen": "0.92% 0.92% 0.92% 0.92% 0.92% 0.92% 0.92% 0.92% 0.92% 0.92% 0.92% 0.92%"}, "model_tokens": {"rwkv": [[63750, " performance", "normal", 0.36216312646865845]], "qwen": [[5068, " performance", "normal", 0.5418747663497925]]}, "loss": {"rwkv": 1.5380293811560404, "qwen": 0.9208005767516142}, "topk": {"rwkv": [63750, 1, 0.36216312646865845, [[63750, 0.362163, " performance", false], [22590, 0.115907, " the", false], [499, 0.106016, ").", false], [497, 0.097226, "),", false], [42, 0.02909, ")", false], [37636, 0.027751, " agent", false], [21902, 0.024291, " its", false], [3609, 0.020041, " AI", false], [52738, 0.013462, " results", false], [4601, 0.012189, " it", false]]], "qwen": [5068, 1, 0.5418747663497925, [[5068, 0.541875, " performance", false], [279, 0.105896, " the", false], [458, 0.056244, " an", false], [6832, 0.034256, " learning", false], [264, 0.028226, " a", false], [701, 0.014869, "),", false], [8315, 0.01308, " agent", false], [3059, 0.012277, " results", false], [432, 0.011117, " it", false], [1181, 0.009955, " its", false]]]}, "raw_delta": 0.03422643244266509, "tuned_delta": 0.04103871024976304}, {"byte_start": 546, "byte_end": 547, "display": {"text": ")", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "29", "compression": {"rwkv": "51.57%", "qwen": "38.82%"}, "model_tokens": {"rwkv": [[42, ")", "normal", 0.05657018721103668]], "qwen": [[8, ")", "normal", 0.1161569133400917]]}, "loss": {"rwkv": 51.56507665677349, "qwen": 38.82316582572192}, "topk": {"rwkv": [42, 3, 0.05657018721103668, [[499, 0.430454, ").", false], [497, 0.355623, "),", false], [42, 0.05657, ")", false], [45, 0.036177, ",", false], [502, 0.024053, ");", false], [580, 0.012248, ".)", false], [4712, 0.00518, " on", false], [31601, 0.005171, " over", false], [45302, 0.003916, " beyond", false], [4424, 0.0038, " at", false]]], "qwen": [8, 3, 0.1161569133400917, [[701, 0.481042, "),", false], [568, 0.212925, ").", false], [8, 0.116157, ")", false], [11, 0.039897, ",", false], [4292, 0.036839, ").\n", false], [1215, 0.015695, ");", false], [11941, 0.009442, " significantly", false], [304, 0.008665, " in", false], [389, 0.006226, " on", false], [26, 0.005549, ";", false]]]}, "raw_delta": 0.7065615653991699, "tuned_delta": 0.7133738432062678}, {"byte_start": 547, "byte_end": 551, "display": {"text": " but", "kind": "normal"}, "is_word": true, "word_id": 93, "word_key": " but", "bytes_hex": "20 62 75 74", "compression": {"rwkv": "6.94% 6.94% 6.94% 6.94%", "qwen": "8.82% 8.82% 8.82% 8.82%"}, "model_tokens": {"rwkv": [[21400, " but", "normal", 0.21200789511203766]], "qwen": [[714, " but", "normal", 0.1414593905210495]]}, "loss": {"rwkv": 6.938743238650531, "qwen": 8.817312958699693}, "topk": {"rwkv": [21400, 2, 0.21200789511203766, [[4715, 0.268634, " or", false], [21400, 0.212008, " but", false], [21265, 0.205852, " and", false], [47001, 0.050304, " rather", false], [32465, 0.03564, " when", false], [40187, 0.026399, " while", false], [53339, 0.018525, " whereas", false], [280, 0.017921, " -", false], [40186, 0.01348, " which", false], [4788, 0.013205, " so", false]]], "qwen": [714, 3, 0.1414593905210495, [[476, 0.532945, " or", false], [323, 0.185605, " and", false], [714, 0.141459, " but", false], [4751, 0.02819, " rather", false], [1177, 0.011847, " --", false], [1959, 0.011388, " —", false], [481, 0.010769, " -", false], [1365, 0.006627, " –", false], [19853, 0.006069, " whereas", false], [448, 0.005423, " with", false]]]}, "raw_delta": -0.10417002439498901, "tuned_delta": -0.09735774658789106}, {"byte_start": 551, "byte_end": 552, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "70.44%", "qwen": "57.75%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.01995220221579075]], "qwen": [[11, ",", "normal", 0.04066253453493118]]}, "loss": {"rwkv": 70.44409379340641, "qwen": 57.75195044194827}, "topk": {"rwkv": [45, 9, 0.01995220221579075, [[4596, 0.165644, " in", false], [22590, 0.134208, " the", false], [32234, 0.132319, " this", false], [37045, 0.071398, " Moore", false], [32227, 0.064573, " that", false], [4601, 0.043005, " it", false], [4423, 0.035559, " as", false], [4858, 0.025092, " we", false], [45, 0.019952, ",", false], [39934, 0.010915, " there", false]]], "qwen": [11, 6, 0.04066253453493118, [[304, 0.159878, " in", false], [279, 0.15586, " the", false], [419, 0.107942, " this", false], [438, 0.055029, " as", false], [429, 0.041814, " that", false], [11, 0.040663, ",", false], [432, 0.035516, " it", false], [582, 0.022734, " we", false], [448, 0.02131, " with", false], [1052, 0.014629, " there", false]]]}, "raw_delta": 0.7038018703460693, "tuned_delta": 0.7106141481531673}, {"byte_start": 552, "byte_end": 557, "display": {"text": " over", "kind": "normal"}, "is_word": true, "word_id": 94, "word_key": " over", "bytes_hex": "20 6f 76 65 72", "compression": {"rwkv": "18.60% 18.60% 18.60% 18.60% 18.60%", "qwen": "16.27% 16.27% 16.27% 16.27% 16.27%"}, "model_tokens": {"rwkv": [[31601, " over", "normal", 0.005749056115746498]], "qwen": [[916, " over", "normal", 0.010989399626851082]]}, "loss": {"rwkv": 18.597240761459293, "qwen": 16.269359271746694}, "topk": {"rwkv": [31601, 20, 0.005749056115746498, [[4423, 0.306697, " as", false], [4596, 0.279336, " in", false], [4706, 0.039867, " of", false], [32487, 0.019551, " with", false], [47532, 0.017791, " thanks", false], [21700, 0.017655, " for", false], [4588, 0.015123, " if", false], [4450, 0.010108, " by", false], [4424, 0.009811, " at", false], [31296, 0.008821, " like", false]]], "qwen": [916, 16, 0.010989399626851082, [[438, 0.261753, " as", false], [304, 0.210697, " in", false], [448, 0.049432, " with", false], [2474, 0.032234, " since", false], [369, 0.026634, " for", false], [2661, 0.020306, " given", false], [315, 0.019959, " of", false], [4518, 0.019633, " instead", false], [553, 0.016233, " by", false], [9339, 0.015698, " thanks", false]]]}, "raw_delta": 0.1290851593017578, "tuned_delta": 0.13589743710885574}, {"byte_start": 557, "byte_end": 559, "display": {"text": " a", "kind": "normal"}, "is_word": true, "word_id": 95, "word_key": " a", "bytes_hex": "20 61", "compression": {"rwkv": "40.01% 40.01%", "qwen": "44.14% 44.14%"}, "model_tokens": {"rwkv": [[332, " a", "normal", 0.011928115971386433]], "qwen": [[264, " a", "normal", 0.007482042536139488]]}, "loss": {"rwkv": 40.01224527465484, "qwen": 44.1396999083741}, "topk": {"rwkv": [332, 5, 0.011928115971386433, [[22590, 0.634745, " the", false], [32251, 0.213319, " time", false], [3543, 0.026833, " 70", false], [51396, 0.01273, " decades", false], [332, 0.011928, " a", false], [32234, 0.009504, " this", false], [21265, 0.009421, " and", false], [21256, 0.005697, " all", false], [37045, 0.005559, " Moore", false], [31370, 0.005066, " many", false]]], "qwen": [264, 3, 0.007482042536139488, [[279, 0.658494, " the", false], [882, 0.28459, " time", false], [264, 0.007482, " a", false], [323, 0.004873, " and", false], [3213, 0.004735, " recent", false], [1657, 0.00455, " many", false], [220, 0.004311, " ", false], [10793, 0.00318, " decades", false], [1429, 0.002201, " most", false], [1293, 0.001318, " long", false]]]}, "raw_delta": -0.22887468338012695, "tuned_delta": -0.222062405573029}, {"byte_start": 559, "byte_end": 568, "display": {"text": " slightly", "kind": "normal"}, "is_word": true, "word_id": 96, "word_key": " slightly", "bytes_hex": "20 73 6c 69 67 68 74 6c 79", "compression": {"rwkv": "17.03% 17.03% 17.03% 17.03% 17.03% 17.03% 17.03% 17.03% 17.03%", "qwen": "18.33% 18.33% 18.33% 18.33% 18.33% 18.33% 18.33% 18.33% 18.33%"}, "model_tokens": {"rwkv": [[57245, " slightly", "normal", 0.00020650704391300678]], "qwen": [[10078, " slightly", "normal", 0.00010625468712532893]]}, "loss": {"rwkv": 17.03181645493915, "qwen": 18.333591357686608}, "topk": {"rwkv": [57245, 190, 0.00020650704391300678, [[3543, 0.239016, " 70", false], [46790, 0.11227, " period", false], [31323, 0.108441, " long", false], [32386, 0.043026, " very", false], [51158, 0.02978, " century", false], [32251, 0.026621, " time", false], [45674, 0.022224, " decade", false], [46470, 0.019944, " longer", false], [38864, 0.019049, " large", false], [32470, 0.018257, " wide", false]]], "qwen": [10078, 244, 0.00010625468712532893, [[4168, 0.154879, " period", false], [1293, 0.103377, " long", false], [9390, 0.074917, " span", false], [220, 0.070935, " ", false], [9294, 0.047748, " century", false], [3460, 0.046555, " large", false], [1602, 0.043272, " very", false], [2421, 0.028123, " few", false], [1753, 0.024449, " much", false], [6884, 0.024078, " wide", false]]]}, "raw_delta": -0.07218572828504777, "tuned_delta": -0.06537345047794982}, {"byte_start": 568, "byte_end": 575, "display": {"text": " longer", "kind": "normal"}, "is_word": true, "word_id": 97, "word_key": " longer", "bytes_hex": "20 6c 6f 6e 67 65 72", "compression": {"rwkv": "0.57% 0.57% 0.57% 0.57% 0.57% 0.57% 0.57%", "qwen": "1.14% 1.14% 1.14% 1.14% 1.14% 1.14% 1.14%"}, "model_tokens": {"rwkv": [[46470, " longer", "normal", 0.8021692633628845]], "qwen": [[5021, " longer", "normal", 0.6415794491767883]]}, "loss": {"rwkv": 0.5685844713324946, "qwen": 1.1433932558448097}, "topk": {"rwkv": [46470, 1, 0.8021692633628845, [[46470, 0.802169, " longer", false], [52888, 0.052562, " shorter", false], [46397, 0.037035, " larger", false], [31458, 0.022728, " more", false], [59513, 0.01249, " different", false], [40192, 0.011492, " wider", false], [51093, 0.010523, " broader", false], [31277, 0.00817, " less", false], [56189, 0.007297, " extended", false], [52932, 0.006176, " smaller", false]]], "qwen": [5021, 1, 0.6415794491767883, [[5021, 0.641579, " longer", false], [23327, 0.093429, " shorter", false], [803, 0.051857, " more", false], [2155, 0.041469, " different", false], [8131, 0.029925, " larger", false], [11577, 0.017777, " extended", false], [2686, 0.014145, " less", false], [9155, 0.013051, " smaller", false], [21864, 0.009469, " wider", false], [26829, 0.005714, " broader", false]]]}, "raw_delta": -0.031874167067664015, "tuned_delta": -0.02506188926056607}, {"byte_start": 575, "byte_end": 580, "display": {"text": " time", "kind": "normal"}, "is_word": true, "word_id": 98, "word_key": " time", "bytes_hex": "20 74 69 6d 65", "compression": {"rwkv": "3.02% 3.02% 3.02% 3.02% 3.02%", "qwen": "2.15% 2.15% 2.15% 2.15% 2.15%"}, "model_tokens": {"rwkv": [[32251, " time", "normal", 0.43485912680625916]], "qwen": [[882, " time", "normal", 0.551668107509613]]}, "loss": {"rwkv": 3.015007214357794, "qwen": 2.145318681147023}, "topk": {"rwkv": [32251, 1, 0.43485912680625916, [[32251, 0.434859, " time", false], [46790, 0.271965, " period", false], [39962, 0.122913, " times", false], [51940, 0.062867, " horizon", false], [57431, 0.016563, " timeline", false], [32219, 0.009269, " term", false], [51929, 0.008969, " history", false], [32091, 0.007466, " span", false], [62061, 0.005398, " historical", false], [46, 0.004116, "-", false]]], "qwen": [882, 1, 0.551668107509613, [[882, 0.551668, " time", false], [3039, 0.204437, " times", false], [4168, 0.095723, " period", false], [4647, 0.016563, " term", false], [69953, 0.015943, " timeframe", false], [34074, 0.01331, " horizon", false], [9390, 0.011896, " span", false], [3840, 0.010853, " history", false], [13656, 0.010749, " historical", false], [1651, 0.009354, " view", false]]]}, "raw_delta": 0.04822577238082884, "tuned_delta": 0.05503805018792679}, {"byte_start": 580, "byte_end": 585, "display": {"text": " than", "kind": "normal"}, "is_word": true, "word_id": 99, "word_key": " than", "bytes_hex": "20 74 68 61 6e", "compression": {"rwkv": "18.60% 18.60% 18.60% 18.60% 18.60%", "qwen": "18.76% 18.76% 18.76% 18.76% 18.76%"}, "model_tokens": {"rwkv": [[32226, " than", "normal", 0.005685923155397177]], "qwen": [[1091, " than", "normal", 0.005510401912033558]]}, "loss": {"rwkv": 18.597240761459293, "qwen": 18.759066116962142}, "topk": {"rwkv": [32226, 9, 0.005685923155397177, [[51940, 0.328289, " horizon", false], [38549, 0.187328, " frame", false], [46790, 0.140844, " period", false], [39590, 0.110924, " scale", false], [34478, 0.090608, "frame", false], [32091, 0.05368, " span", false], [46, 0.040753, "-", false], [45, 0.012135, ",", false], [32226, 0.005686, " than", false], [56485, 0.005533, " interval", false]]], "qwen": [1091, 9, 0.005510401912033558, [[34074, 0.294978, " horizon", false], [5452, 0.278795, " scale", false], [4168, 0.118818, " period", false], [4034, 0.117693, " frame", false], [9390, 0.071881, " span", false], [11, 0.034453, ",", false], [12934, 0.018418, "-scale", false], [3241, 0.006431, " window", false], [1091, 0.00551, " than", false], [46767, 0.005317, "-frame", false]]]}, "raw_delta": -0.00897350311279288, "tuned_delta": -0.002161225305694933}, {"byte_start": 585, "byte_end": 587, "display": {"text": " a", "kind": "normal"}, "is_word": true, "word_id": 100, "word_key": " a", "bytes_hex": "20 61", "compression": {"rwkv": "34.66% 34.66%", "qwen": "33.10% 33.10%"}, "model_tokens": {"rwkv": [[332, " a", "normal", 0.021150538697838783]], "qwen": [[264, " a", "normal", 0.025462068617343903]]}, "loss": {"rwkv": 34.658494146355956, "qwen": 33.09691532413615}, "topk": {"rwkv": [332, 9, 0.021150538697838783, [[37045, 0.21965, " Moore", false], [22590, 0.197804, " the", false], [32227, 0.092682, " that", false], [3543, 0.070862, " 70", false], [4858, 0.04632, " we", false], [4601, 0.03991, " it", false], [22799, 0.024802, " you", false], [32234, 0.02445, " this", false], [332, 0.021151, " a", false], [22226, 0.017678, " one", false]]], "qwen": [264, 9, 0.025462068617343903, [[20219, 0.190439, " Moore", false], [279, 0.189425, " the", false], [429, 0.086501, " that", false], [220, 0.058331, " ", false], [1429, 0.044907, " most", false], [582, 0.042566, " we", false], [358, 0.041866, " I", false], [1128, 0.027468, " what", false], [264, 0.025462, " a", false], [374, 0.022678, " is", false]]]}, "raw_delta": 0.08659231662750244, "tuned_delta": 0.09340459443460039}, {"byte_start": 587, "byte_end": 595, "display": {"text": " typical", "kind": "normal"}, "is_word": true, "word_id": 101, "word_key": " typical", "bytes_hex": "20 74 79 70 69 63 61 6c", "compression": {"rwkv": "6.16% 6.16% 6.16% 6.16% 6.16% 6.16% 6.16% 6.16%", "qwen": "2.64% 2.64% 2.64% 2.64% 2.64% 2.64% 2.64% 2.64%"}, "model_tokens": {"rwkv": [[53216, " typical", "normal", 0.06599000096321106]], "qwen": [[14260, " typical", "normal", 0.30994606018066406]]}, "loss": {"rwkv": 6.163858206923061, "qwen": 2.640485647564225}, "topk": {"rwkv": [53216, 5, 0.06599000096321106, [[38720, 0.209199, " human", false], [45674, 0.116659, " decade", false], [51158, 0.10654, " century", false], [47289, 0.068908, " single", false], [53216, 0.06599, " typical", false], [3543, 0.053326, " 70", false], [32512, 0.031714, " year", false], [62035, 0.027896, " generation", false], [21674, 0.02589, " few", false], [30923, 0.017613, " full", false]]], "qwen": [14260, 1, 0.30994606018066406, [[14260, 0.309946, " typical", false], [3175, 0.145236, " single", false], [3738, 0.103433, " human", false], [13212, 0.090959, " decade", false], [9471, 0.052553, " generation", false], [2421, 0.034489, " few", false], [9294, 0.033726, " century", false], [8338, 0.02265, " quarter", false], [6931, 0.017734, " career", false], [19031, 0.015397, " lifetime", false]]]}, "raw_delta": 0.19537726044654846, "tuned_delta": 0.2021895382536464}, {"byte_start": 595, "byte_end": 604, "display": {"text": " research", "kind": "normal"}, "is_word": true, "word_id": 102, "word_key": " research", "bytes_hex": "20 72 65 73 65 61 72 63 68", "compression": {"rwkv": "4.54% 4.54% 4.54% 4.54% 4.54% 4.54% 4.54% 4.54% 4.54%", "qwen": "4.11% 4.11% 4.11% 4.11% 4.11% 4.11% 4.11% 4.11% 4.11%"}, "model_tokens": {"rwkv": [[57103, " research", "normal", 0.10421806573867798]], "qwen": [[3412, " research", "normal", 0.12872017920017242]]}, "loss": {"rwkv": 4.539730488908413, "qwen": 4.107902594964088}, "topk": {"rwkv": [57103, 3, 0.10421806573867798, [[38720, 0.229688, " human", false], [3609, 0.140175, " AI", false], [57103, 0.104218, " research", false], [45418, 0.04138, " career", false], [56546, 0.030227, " lifetime", false], [46795, 0.023828, " person", false], [55427, 0.023593, " academic", false], [31293, 0.021054, " life", false], [56545, 0.013904, " lifespan", false], [37636, 0.013544, " agent", false]]], "qwen": [3412, 1, 0.12872017920017242, [[3412, 0.12872, " research", false], [15235, 0.117699, " AI", false], [14250, 0.113605, " academic", false], [29561, 0.081167, " PhD", false], [3738, 0.06284, " human", false], [5567, 0.053965, " paper", false], [6931, 0.045386, " career", false], [220, 0.019262, " ", false], [31085, 0.01882, " researcher", false], [2390, 0.015059, " project", false]]]}, "raw_delta": 0.023945622973971903, "tuned_delta": 0.03075790078106985}, {"byte_start": 604, "byte_end": 612, "display": {"text": " project", "kind": "normal"}, "is_word": true, "word_id": 103, "word_key": " project", "bytes_hex": "20 70 72 6f 6a 65 63 74", "compression": {"rwkv": "6.38% 6.38% 6.38% 6.38% 6.38% 6.38% 6.38% 6.38%", "qwen": "2.24% 2.24% 2.24% 2.24% 2.24% 2.24% 2.24% 2.24%"}, "model_tokens": {"rwkv": [[52581, " project", "normal", 0.05885995924472809]], "qwen": [[2390, " project", "normal", 0.3694009780883789]]}, "loss": {"rwkv": 6.37519048830328, "qwen": 2.2449068743387732}, "topk": {"rwkv": [52581, 3, 0.05885995924472809, [[45418, 0.593494, " career", false], [38172, 0.07236, " cycle", false], [52581, 0.05886, " project", false], [56546, 0.051646, " lifetime", false], [39227, 0.040984, " paper", false], [46790, 0.031334, " period", false], [31293, 0.02148, " life", false], [56545, 0.01112, " lifespan", false], [52580, 0.009882, " program", false], [32251, 0.00767, " time", false]]], "qwen": [2390, 1, 0.3694009780883789, [[2390, 0.369401, " project", false], [5567, 0.149084, " paper", false], [6931, 0.101524, " career", false], [2025, 0.099172, " program", false], [10775, 0.03564, " cycle", false], [2083, 0.016677, " team", false], [5041, 0.015622, " effort", false], [4168, 0.014426, " period", false], [4549, 0.013782, " article", false], [18402, 0.012573, " agenda", false]]]}, "raw_delta": 0.22903155535459518, "tuned_delta": 0.23584383316169313}, {"byte_start": 612, "byte_end": 613, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "5.04%", "qwen": "3.30%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.7592471837997437]], "qwen": [[11, ",", "normal", 0.832703709602356]]}, "loss": {"rwkv": 5.036752706228558, "qwen": 3.301560622637448}, "topk": {"rwkv": [45, 1, 0.7592471837997437, [[45, 0.759247, ",", false], [40219, 0.034909, " would", false], [38867, 0.031835, " lasts", false], [39751, 0.020074, " spans", false], [275, 0.019381, " (", false], [460, 0.009191, "'s", false], [21413, 0.009104, " can", false], [4600, 0.008786, " is", false], [39021, 0.007506, " might", false], [32091, 0.007048, " span", false]]], "qwen": [11, 1, 0.832703709602356, [[11, 0.832704, ",", false], [320, 0.039765, " (", false], [1035, 0.012515, " would", false], [39658, 0.008696, " lasts", false], [476, 0.008524, " or", false], [304, 0.005829, " in", false], [60861, 0.005639, " lifespan", false], [323, 0.005504, " and", false], [594, 0.005473, "'s", false], [44295, 0.004554, " spans", false]]]}, "raw_delta": 0.09621948003768921, "tuned_delta": 0.10303175784478716}, {"byte_start": 613, "byte_end": 623, "display": {"text": " massively", "kind": "normal"}, "is_word": true, "word_id": 104, "word_key": " massively", "bytes_hex": "20 6d 61 73 73 69 76 65 6c 79", "compression": {"rwkv": "16.00% 16.00% 16.00% 16.00% 16.00% 16.00% 16.00% 16.00% 16.00% 16.00%", "qwen": "16.97% 16.97% 16.97% 16.97% 16.97% 16.97% 16.97% 16.97% 16.97% 16.97%"}, "model_tokens": {"rwkv": [[59988, " massively", "normal", 0.0001402282650815323]], "qwen": [[63707, " massively", "normal", 8.201191667467356e-05]]}, "loss": {"rwkv": 16.004898109861934, "qwen": 16.967257989641936}, "topk": {"rwkv": [59988, 252, 0.0001402282650815323, [[22590, 0.265174, " the", false], [63370, 0.107127, " computation", false], [37045, 0.07915, " Moore", false], [32234, 0.077882, " this", false], [4858, 0.06875, " we", false], [4601, 0.033721, " it", false], [32227, 0.03158, " that", false], [39934, 0.021469, " there", false], [59346, 0.021017, " computing", false], [3609, 0.011785, " AI", false]]], "qwen": [63707, 349, 8.201191667467356e-05, [[279, 0.314859, " the", false], [419, 0.094283, " this", false], [34447, 0.08315, " computation", false], [20219, 0.059401, " Moore", false], [582, 0.056349, " we", false], [432, 0.035309, " it", false], [429, 0.026882, " that", false], [264, 0.017638, " a", false], [1052, 0.016266, " there", false], [58755, 0.015347, " exponential", false]]]}, "raw_delta": -0.053364562988281294, "tuned_delta": -0.046552285181183345}, {"byte_start": 623, "byte_end": 628, "display": {"text": " more", "kind": "normal"}, "is_word": true, "word_id": 105, "word_key": " more", "bytes_hex": "20 6d 6f 72 65", "compression": {"rwkv": "5.66% 5.66% 5.66% 5.66% 5.66%", "qwen": "5.55% 5.55% 5.55% 5.55% 5.55%"}, "model_tokens": {"rwkv": [[31458, " more", "normal", 0.20610319077968597]], "qwen": [[803, " more", "normal", 0.21473440527915955]]}, "loss": {"rwkv": 5.663705140989876, "qwen": 5.548436778945468}, "topk": {"rwkv": [31458, 2, 0.20610319077968597, [[56812, 0.237029, " parallel", false], [31458, 0.206103, " more", false], [62092, 0.103578, " increasing", false], [59846, 0.059932, " increased", false], [56418, 0.054901, " improved", false], [51178, 0.034374, " cheaper", false], [56900, 0.025037, " powerful", false], [51709, 0.017162, " falling", false], [45301, 0.016065, " better", false], [59832, 0.015711, " improving", false]]], "qwen": [803, 1, 0.21473440527915955, [[803, 0.214734, " more", false], [23048, 0.151313, " cheaper", false], [7703, 0.085892, " increasing", false], [7172, 0.07638, " increased", false], [15279, 0.059274, " parallel", false], [12944, 0.033619, " improved", false], [4722, 0.026703, " lower", false], [11046, 0.023342, " reduced", false], [17719, 0.021584, " reducing", false], [15679, 0.019332, " falling", false]]]}, "raw_delta": 0.006391835212707531, "tuned_delta": 0.013204113019805477}, {"byte_start": 628, "byte_end": 640, "display": {"text": " computation", "kind": "normal"}, "is_word": true, "word_id": 106, "word_key": " computation", "bytes_hex": "20 63 6f 6d 70 75 74 61 74 69 6f 6e", "compression": {"rwkv": "1.89% 1.89% 1.89% 1.89% 1.89% 1.89% 1.89% 1.89% 1.89% 1.89% 1.89% 1.89%", "qwen": "0.69% 0.69% 0.69% 0.69% 0.69% 0.69% 0.69% 0.69% 0.69% 0.69% 0.69% 0.69%"}, "model_tokens": {"rwkv": [[63370, " computation", "normal", 0.282296746969223]], "qwen": [[34447, " computation", "normal", 0.6322945952415466]]}, "loss": {"rwkv": 1.890249850123072, "qwen": 0.6888867195008749}, "topk": {"rwkv": [63370, 1, 0.282296746969223, [[63370, 0.282297, " computation", false], [59346, 0.145599, " computing", false], [51266, 0.081971, " compute", false], [56900, 0.05665, " powerful", false], [64862, 0.044771, " computational", false], [60406, 0.036414, " resources", false], [21265, 0.017269, " and", false], [59345, 0.014346, " computers", false], [39339, 0.014252, " power", false], [59593, 0.013287, " effective", false]]], "qwen": [34447, 1, 0.6322945952415466, [[34447, 0.632295, " computation", false], [24231, 0.092921, " computing", false], [54480, 0.077247, " computational", false], [7988, 0.025779, " powerful", false], [2355, 0.017244, " power", false], [4963, 0.011984, " resources", false], [12564, 0.009854, " compute", false], [374, 0.006309, " is", false], [6366, 0.005893, " computer", false], [82599, 0.005062, " computations", false]]]}, "raw_delta": 0.06661771734555563, "tuned_delta": 0.07342999515265358}, {"byte_start": 640, "byte_end": 651, "display": {"text": " inevitably", "kind": "normal"}, "is_word": true, "word_id": 107, "word_key": " inevitably", "bytes_hex": "20 69 6e 65 76 69 74 61 62 6c 79", "compression": {"rwkv": "19.06% 19.06% 19.06% 19.06% 19.06% 19.06% 19.06% 19.06% 19.06% 19.06% 19.06%", "qwen": "18.37% 18.37% 18.37% 18.37% 18.37% 18.37% 18.37% 18.37% 18.37% 18.37% 18.37%"}, "model_tokens": {"rwkv": [[62110, " inevitably", "normal", 9.090966159419622e-06]], "qwen": [[39505, " inevitably", "normal", 1.3586168279289268e-05]]}, "loss": {"rwkv": 19.05832937537977, "qwen": 18.37216081236056}, "topk": {"rwkv": [62110, 355, 9.090966159419622e-06, [[21800, 0.421011, " has", false], [4600, 0.297939, " is", false], [45283, 0.06459, " became", false], [51019, 0.042768, " becomes", false], [21265, 0.02565, " and", false], [22748, 0.025222, " was", false], [32475, 0.018119, " will", false], [22278, 0.014196, " per", false], [275, 0.011582, " (", false], [21413, 0.009964, " can", false]]], "qwen": [39505, 250, 1.3586168279289268e-05, [[374, 0.368706, " is", false], [9044, 0.210179, " becomes", false], [702, 0.163419, " has", false], [686, 0.063317, " will", false], [6116, 0.05747, " became", false], [646, 0.030104, " can", false], [572, 0.019347, " was", false], [1091, 0.017925, " than", false], [1035, 0.013141, " would", false], [320, 0.007676, " (", false]]]}, "raw_delta": 0.03804926438765088, "tuned_delta": 0.04486154219474883}, {"byte_start": 651, "byte_end": 659, "display": {"text": " becomes", "kind": "normal"}, "is_word": true, "word_id": 108, "word_key": " becomes", "bytes_hex": "20 62 65 63 6f 6d 65 73", "compression": {"rwkv": "0.75% 0.75% 0.75% 0.75% 0.75% 0.75% 0.75% 0.75%", "qwen": "0.36% 0.36% 0.36% 0.36% 0.36% 0.36% 0.36% 0.36%"}, "model_tokens": {"rwkv": [[51019, " becomes", "normal", 0.7124198079109192]], "qwen": [[9044, " becomes", "normal", 0.8512977361679077]]}, "loss": {"rwkv": 0.752871252417031, "qwen": 0.3629129528386432}, "topk": {"rwkv": [51019, 1, 0.7124198079109192, [[51019, 0.71242, " becomes", false], [45283, 0.086594, " became", false], [38087, 0.031446, " comes", false], [50956, 0.028445, " arrives", false], [45199, 0.011209, " arises", false], [21800, 0.010648, " has", false], [30965, 0.009399, " gets", false], [51586, 0.00758, " emerges", false], [4600, 0.006969, " is", false], [50935, 0.006698, " appears", false]]], "qwen": [9044, 1, 0.8512977361679077, [[9044, 0.851298, " becomes", false], [6116, 0.030535, " became", false], [29682, 0.015827, " arrives", false], [4041, 0.014727, " comes", false], [374, 0.00821, " is", false], [5221, 0.007622, " gets", false], [686, 0.007398, " will", false], [17066, 0.007118, " falls", false], [3635, 0.005005, " become", false], [3643, 0.00425, " makes", false]]]}, "raw_delta": 0.021623879671096802, "tuned_delta": 0.028436157478194748}, {"byte_start": 659, "byte_end": 669, "display": {"text": " available", "kind": "normal"}, "is_word": true, "word_id": 109, "word_key": " available", "bytes_hex": "20 61 76 61 69 6c 61 62 6c 65", "compression": {"rwkv": "0.11% 0.11% 0.11% 0.11% 0.11% 0.11% 0.11% 0.11% 0.11% 0.11%", "qwen": "0.05% 0.05% 0.05% 0.05% 0.05% 0.05% 0.05% 0.05% 0.05% 0.05%"}, "model_tokens": {"rwkv": [[59206, " available", "normal", 0.9419006705284119]], "qwen": [[2500, " available", "normal", 0.9704382419586182]]}, "loss": {"rwkv": 0.10830779420736235, "qwen": 0.054114593021693955}, "topk": {"rwkv": [59206, 1, 0.9419006705284119, [[59206, 0.941901, " available", false], [51178, 0.007159, " cheaper", false], [61551, 0.006993, " affordable", false], [56895, 0.006508, " possible", false], [38006, 0.005791, " cheap", false], [61519, 0.004354, " accessible", false], [31458, 0.003008, " more", false], [56212, 0.00228, " feasible", false], [30911, 0.00136, " free", false], [46042, 0.001245, " freely", false]]], "qwen": [2500, 1, 0.9704382419586182, [[2500, 0.970438, " available", false], [15614, 0.012816, " accessible", false], [3204, 0.003238, " possible", false], [42203, 0.000999, " feasible", false], [30268, 0.000741, " readily", false], [16637, 0.000601, " affordable", false], [264, 0.000533, " a", false], [13570, 0.000506, " widely", false], [25580, 0.000454, " freely", false], [518, 0.000437, " at", false]]]}, "raw_delta": 0.003005109168589115, "tuned_delta": 0.009817386975687062}, {"byte_start": 669, "byte_end": 670, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "9.16%", "qwen": "17.36%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.6006667017936707]], "qwen": [[13, ".", "normal", 0.3819284737110138]]}, "loss": {"rwkv": 9.157732193142833, "qwen": 17.357820915727263}, "topk": {"rwkv": [47, 1, 0.6006667017936707, [[47, 0.600667, ".", false], [45, 0.138485, ",", false], [4811, 0.059639, " to", false], [21265, 0.028398, " and", false], [4424, 0.022161, " at", false], [275, 0.020018, " (", false], [4423, 0.015792, " as", false], [21700, 0.012643, " for", false], [32226, 0.008136, " than", false], [4596, 0.007015, " in", false]]], "qwen": [13, 1, 0.3819284737110138, [[13, 0.381928, ".", false], [11, 0.185065, ",", false], [624, 0.141005, ".\n", false], [311, 0.064201, " to", false], [323, 0.06305, " and", false], [320, 0.031207, " (", false], [1091, 0.014719, " than", false], [369, 0.012568, " for", false], [518, 0.010692, " at", false], [1526, 0.007702, " through", false]]]}, "raw_delta": -0.4547094702720642, "tuned_delta": -0.4478971924649663}, {"byte_start": 670, "byte_end": 678, "display": {"text": " Seeking", "kind": "normal"}, "is_word": true, "word_id": 110, "word_key": " seeking", "bytes_hex": "20 53 65 65 6b 69 6e 67", "compression": {"rwkv": "39.45% 39.45% 39.45% 39.45% 39.45% 0.28% 0.28% 0.28%", "qwen": "25.58% 25.58% 25.58% 25.58% 25.58% 25.58% 25.58% 25.58%"}, "model_tokens": {"rwkv": [[29753, " Seek", "normal", 1.7630438378546387e-05], [7856, "ing", "normal", 0.9548249840736389]], "qwen": [[58705, " Seeking", "normal", 1.1795600585173815e-05]]}, "loss": {"rwkv": 24.759998279416834, "qwen": 25.580299629670897}, "topk": {"rwkv": [29753, 970, 1.7630438378546387e-05, [[11, 0.26325, "\n", false], [261, 0.09891, "\n\n", false], [29894, 0.090771, " This", false], [20996, 0.086266, " The", false], [3913, 0.029521, " In", false], [3918, 0.022613, " It", false], [3641, 0.01952, " As", false], [19417, 0.016243, " And", false], [19907, 0.015944, " For", false], [29898, 0.014289, " Thus", false]]], "qwen": [58705, 1520, 1.1795600585173815e-05, [[1096, 0.168432, " This", false], [576, 0.107964, " The", false], [1634, 0.050958, " As", false], [758, 0.048782, " In", false], [1084, 0.034836, " It", false], [1597, 0.029178, " And", false], [1752, 0.019607, " For", false], [14301, 0.016932, " Thus", false], [1416, 0.015635, " If", false], [1205, 0.013743, " We", false]]]}, "raw_delta": -0.04548716545104986, "tuned_delta": -0.03867488764395191}, {"byte_start": 678, "byte_end": 681, "display": {"text": " an", "kind": "normal"}, "is_word": true, "word_id": 111, "word_key": " an", "bytes_hex": "20 61 6e", "compression": {"rwkv": "26.67% 26.67% 26.67%", "qwen": "26.75% 26.75% 26.75%"}, "model_tokens": {"rwkv": [[4419, " an", "normal", 0.011890139430761337]], "qwen": [[458, " an", "normal", 0.011676748283207417]]}, "loss": {"rwkv": 26.67483018310323, "qwen": 26.750906708712392}, "topk": {"rwkv": [4419, 11, 0.011890139430761337, [[4811, 0.460297, " to", false], [332, 0.047182, " a", false], [22249, 0.046816, " out", false], [22590, 0.036943, " the", false], [51832, 0.034661, " general", false], [32448, 0.030482, " ways", false], [52224, 0.027021, " methods", false], [31458, 0.014, " more", false], [59943, 0.0139, " knowledge", false], [30789, 0.012148, " ever", false]]], "qwen": [458, 12, 0.011676748283207417, [[311, 0.346544, " to", false], [4586, 0.095296, " general", false], [264, 0.068085, " a", false], [279, 0.039555, " the", false], [5413, 0.029232, " methods", false], [501, 0.022304, " new", false], [5510, 0.022205, " ways", false], [2664, 0.02123, " better", false], [803, 0.018443, " more", false], [700, 0.015659, " out", false]]]}, "raw_delta": -0.004218578338623047, "tuned_delta": 0.0025936994684749}, {"byte_start": 681, "byte_end": 693, "display": {"text": " improvement", "kind": "normal"}, "is_word": true, "word_id": 112, "word_key": " improvement", "bytes_hex": "20 69 6d 70 72 6f 76 65 6d 65 6e 74", "compression": {"rwkv": "4.67% 4.67% 4.67% 4.67% 4.67% 4.67% 4.67% 4.67% 4.67% 4.67% 4.67% 4.67%", "qwen": "5.62% 5.62% 5.62% 5.62% 5.62% 5.62% 5.62% 5.62% 5.62% 5.62% 5.62% 5.62%"}, "model_tokens": {"rwkv": [[63621, " improvement", "normal", 0.04484521597623825]], "qwen": [[15673, " improvement", "normal", 0.023840148001909256]]}, "loss": {"rwkv": 4.672791554962626, "qwen": 5.61506586758611}, "topk": {"rwkv": [63621, 4, 0.04484521597623825, [[30729, 0.085599, " edge", false], [59093, 0.073196, " advantage", false], [3609, 0.058603, " AI", false], [63621, 0.044845, " improvement", false], [63277, 0.039292, " alternative", false], [52371, 0.033426, " optimal", false], [55532, 0.028973, " approach", false], [30789, 0.028312, " ever", false], [40077, 0.023218, " upper", false], [63560, 0.021643, " explanation", false]]], "qwen": [15673, 10, 0.023840148001909256, [[22823, 0.143534, " optimal", false], [10555, 0.058327, " alternative", false], [16148, 0.05473, " explanation", false], [7373, 0.047727, " effective", false], [8315, 0.041014, " agent", false], [12111, 0.034582, " algorithm", false], [4226, 0.030941, " answer", false], [5486, 0.029412, " approach", false], [11050, 0.024839, " efficient", false], [15673, 0.02384, " improvement", false]]]}, "raw_delta": -0.05225078264872235, "tuned_delta": -0.0454385048416244}, {"byte_start": 693, "byte_end": 698, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 113, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"rwkv": "12.40% 12.40% 12.40% 12.40% 12.40%", "qwen": "10.43% 10.43% 10.43% 10.43% 10.43%"}, "model_tokens": {"rwkv": [[32227, " that", "normal", 0.032112035900354385]], "qwen": [[429, " that", "normal", 0.05540107935667038]]}, "loss": {"rwkv": 12.398160507639528, "qwen": 10.4348555804452}, "topk": {"rwkv": [32227, 4, 0.032112035900354385, [[4596, 0.469001, " in", false], [4706, 0.139045, " of", false], [4450, 0.131876, " by", false], [32227, 0.032112, " that", false], [31601, 0.02905, " over", false], [4811, 0.022281, " to", false], [4712, 0.019134, " on", false], [30917, 0.015071, " from", false], [32487, 0.013487, " with", false], [53140, 0.011457, " through", false]]], "qwen": [429, 4, 0.05540107935667038, [[304, 0.462232, " in", false], [916, 0.084486, " over", false], [389, 0.059968, " on", false], [429, 0.055401, " that", false], [311, 0.045035, " to", false], [315, 0.032579, " of", false], [553, 0.02508, " by", false], [374, 0.018459, " is", false], [7797, 0.0181, " beyond", false], [504, 0.015775, " from", false]]]}, "raw_delta": 0.10886874198913576, "tuned_delta": 0.11568101979623371}, {"byte_start": 698, "byte_end": 704, "display": {"text": " makes", "kind": "normal"}, "is_word": true, "word_id": 114, "word_key": " makes", "bytes_hex": "20 6d 61 6b 65 73", "compression": {"rwkv": "15.31% 15.31% 15.31% 15.31% 15.31% 15.31%", "qwen": "16.07% 16.07% 16.07% 16.07% 16.07% 16.07%"}, "model_tokens": {"rwkv": [[38964, " makes", "normal", 0.006242791190743446]], "qwen": [[3643, " makes", "normal", 0.004769652150571346]]}, "loss": {"rwkv": 15.309849717766994, "qwen": 16.066458726462773}, "topk": {"rwkv": [38964, 22, 0.006242791190743446, [[4600, 0.252723, " is", false], [57102, 0.07049, " requires", false], [56540, 0.059995, " leverage", false], [21413, 0.058051, " can", false], [40219, 0.037393, " would", false], [31581, 0.023498, " only", false], [38278, 0.02306, " doesn", false], [22748, 0.022547, " was", false], [38087, 0.022197, " comes", false], [30659, 0.018177, " does", false]]], "qwen": [3643, 24, 0.004769652150571346, [[374, 0.189496, " is", false], [7460, 0.158147, " requires", false], [1558, 0.100576, " does", false], [646, 0.047346, " can", false], [3171, 0.046745, " doesn", false], [27505, 0.046031, " lever", false], [1035, 0.036799, " would", false], [33644, 0.034925, " relies", false], [4157, 0.025388, " cannot", false], [28405, 0.019711, " scales", false]]]}, "raw_delta": -0.041955312093098884, "tuned_delta": -0.035143034286000935}, {"byte_start": 704, "byte_end": 706, "display": {"text": " a", "kind": "normal"}, "is_word": true, "word_id": 115, "word_key": " a", "bytes_hex": "20 61", "compression": {"rwkv": "25.22% 25.22%", "qwen": "28.80% 28.80%"}, "model_tokens": {"rwkv": [[332, " a", "normal", 0.06123722717165947]], "qwen": [[264, " a", "normal", 0.041008658707141876]]}, "loss": {"rwkv": 25.218985578039494, "qwen": 28.799548280713836}, "topk": {"rwkv": [332, 4, 0.06123722717165947, [[22681, 0.24729, " use", false], [22590, 0.138152, " the", false], [4692, 0.078963, " no", false], [332, 0.061237, " a", false], [39631, 0.028202, " sense", false], [4601, 0.025453, " it", false], [4833, 0.023028, " up", false], [45301, 0.018984, " better", false], [4419, 0.018286, " an", false], [22799, 0.018174, " you", false]]], "qwen": [264, 4, 0.041008658707141876, [[990, 0.383282, " use", false], [902, 0.161169, " no", false], [279, 0.054144, " the", false], [264, 0.041009, " a", false], [2632, 0.038358, " little", false], [5530, 0.03482, " sense", false], [2664, 0.028742, " better", false], [1661, 0.016088, " good", false], [803, 0.015047, " more", false], [8811, 0.012346, " heavy", false]]]}, "raw_delta": -0.1985485553741455, "tuned_delta": -0.19173627756704756}, {"byte_start": 706, "byte_end": 717, "display": {"text": " difference", "kind": "normal"}, "is_word": true, "word_id": 116, "word_key": " difference", "bytes_hex": "20 64 69 66 66 65 72 65 6e 63 65", "compression": {"rwkv": "4.07% 4.07% 4.07% 4.07% 4.07% 4.07% 4.07% 4.07% 4.07% 4.07% 4.07%", "qwen": "4.66% 4.66% 4.66% 4.66% 4.66% 4.66% 4.66% 4.66% 4.66% 4.66% 4.66%"}, "model_tokens": {"rwkv": [[61863, " difference", "normal", 0.08304029703140259]], "qwen": [[6672, " difference", "normal", 0.05831332132220268]]}, "loss": {"rwkv": 4.072949422964226, "qwen": 4.659125709293158}, "topk": {"rwkv": [61863, 1, 0.08304029703140259, [[61863, 0.08304, " difference", false], [3483, 0.045044, " 10", false], [38594, 0.043563, " given", false], [39720, 0.036753, " small", false], [56587, 0.032025, " marginal", false], [52232, 0.028742, " million", false], [21357, 0.024198, " big", false], [284, 0.023078, " 1", false], [38864, 0.018719, " large", false], [63870, 0.018713, " significant", false]]], "qwen": [6672, 4, 0.05831332132220268, [[2613, 0.104232, " small", false], [3460, 0.064247, " large", false], [5089, 0.060479, " significant", false], [6672, 0.058313, " difference", false], [8131, 0.038904, " larger", false], [9155, 0.029102, " smaller", false], [3175, 0.028157, " single", false], [2409, 0.02704, " big", false], [11924, 0.025355, " substantial", false], [6765, 0.014296, " huge", false]]]}, "raw_delta": -0.03250451521439988, "tuned_delta": -0.02569223740730193}, {"byte_start": 717, "byte_end": 720, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 117, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "10.61% 10.61% 10.61%", "qwen": "9.94% 9.94% 9.94%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.17227482795715332]], "qwen": [[304, " in", "normal", 0.1915179193019867]]}, "loss": {"rwkv": 10.613576798206566, "qwen": 9.935203413982654}, "topk": {"rwkv": [4596, 1, 0.17227482795715332, [[4596, 0.172275, " in", false], [4811, 0.099177, " to", false], [4600, 0.082414, " is", false], [57102, 0.060526, " requires", false], [45, 0.058036, ",", false], [39971, 0.043282, " today", false], [4450, 0.04249, " by", false], [32487, 0.02478, " with", false], [32475, 0.024688, " will", false], [4712, 0.02167, " on", false]]], "qwen": [304, 1, 0.1915179193019867, [[304, 0.191518, " in", false], [374, 0.095014, " is", false], [311, 0.071833, " to", false], [916, 0.063177, " over", false], [389, 0.062715, " on", false], [7460, 0.046699, " requires", false], [979, 0.029425, " when", false], [11, 0.02619, ",", false], [518, 0.025189, " at", false], [369, 0.024353, " for", false]]]}, "raw_delta": 0.03761700789133704, "tuned_delta": 0.04442928569843499}, {"byte_start": 720, "byte_end": 724, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 118, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "4.90% 4.90% 4.90% 4.90%", "qwen": "6.17% 6.17% 6.17% 6.17%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.3356889486312866]], "qwen": [[279, " the", "normal", 0.2544078826904297]]}, "loss": {"rwkv": 4.895864518641745, "qwen": 6.171202403560686}, "topk": {"rwkv": [22590, 1, 0.3356889486312866, [[22590, 0.335689, " the", false], [332, 0.134776, " a", false], [39920, 0.060994, " terms", false], [32234, 0.047586, " this", false], [31835, 0.036979, " real", false], [56901, 0.025339, " practice", false], [4419, 0.01934, " an", false], [63750, 0.015461, " performance", false], [38720, 0.012588, " human", false], [3483, 0.011866, " 10", false]]], "qwen": [279, 1, 0.2544078826904297, [[279, 0.254408, " the", false], [264, 0.166713, " a", false], [5068, 0.083839, " performance", false], [419, 0.063061, " this", false], [6588, 0.04657, " practice", false], [3793, 0.026816, " terms", false], [458, 0.026541, " an", false], [1741, 0.026428, " such", false], [429, 0.022521, " that", false], [220, 0.018603, " ", false]]]}, "raw_delta": -0.07071974873542786, "tuned_delta": -0.06390747092832991}, {"byte_start": 724, "byte_end": 732, "display": {"text": " shorter", "kind": "normal"}, "is_word": true, "word_id": 119, "word_key": " shorter", "bytes_hex": "20 73 68 6f 72 74 65 72", "compression": {"rwkv": "16.70% 16.70% 16.70% 16.70% 16.70% 16.70% 16.70% 16.70%", "qwen": "12.48% 12.48% 12.48% 12.48% 12.48% 12.48% 12.48% 12.48%"}, "model_tokens": {"rwkv": [[52888, " shorter", "normal", 0.0006159772165119648]], "qwen": [[23327, " shorter", "normal", 0.003942768555134535]]}, "loss": {"rwkv": 16.69525022903732, "qwen": 12.479024600292085}, "topk": {"rwkv": [52888, 130, 0.0006159772165119648, [[31835, 0.182702, " real", false], [31323, 0.079204, " long", false], [40213, 0.075999, " world", false], [30807, 0.071733, " face", false], [31515, 0.050746, " next", false], [39675, 0.043867, " short", false], [32251, 0.027858, " time", false], [31503, 0.024328, " near", false], [38621, 0.019865, " grand", false], [46064, 0.017468, " future", false]]], "qwen": [23327, 38, 0.003942768555134535, [[2805, 0.128871, " short", false], [3143, 0.081736, " near", false], [882, 0.065915, " time", false], [1293, 0.049215, " long", false], [1790, 0.041966, " next", false], [1931, 0.032048, " real", false], [5068, 0.026856, " performance", false], [1879, 0.024192, " world", false], [3853, 0.015901, " future", false], [1482, 0.015439, " current", false]]]}, "raw_delta": 0.23379719257354736, "tuned_delta": 0.2406094703806453}, {"byte_start": 732, "byte_end": 737, "display": {"text": " term", "kind": "normal"}, "is_word": true, "word_id": 120, "word_key": " term", "bytes_hex": "20 74 65 72 6d", "compression": {"rwkv": "1.24% 1.24% 1.24% 1.24% 1.24%", "qwen": "2.21% 2.21% 2.21% 2.21% 2.21%"}, "model_tokens": {"rwkv": [[32219, " term", "normal", 0.7111608982086182]], "qwen": [[4647, " term", "normal", 0.5424668192863464]]}, "loss": {"rwkv": 1.2398160507639528, "qwen": 2.205982766520802}, "topk": {"rwkv": [32219, 1, 0.7111608982086182, [[32219, 0.711161, " term", false], [22418, 0.14106, " run", false], [32251, 0.058585, " time", false], [46, 0.044769, "-", false], [4715, 0.00477, " or", false], [51940, 0.004376, " horizon", false], [21265, 0.003106, " and", false], [39962, 0.002599, " times", false], [39920, 0.002574, " terms", false], [46064, 0.002298, " future", false]]], "qwen": [4647, 1, 0.5424668192863464, [[4647, 0.542467, " term", false], [882, 0.221836, " time", false], [1598, 0.063362, " run", false], [9663, 0.045174, "-term", false], [3039, 0.035426, " times", false], [69953, 0.024584, " timeframe", false], [4168, 0.010569, " period", false], [11, 0.008014, ",", false], [3793, 0.003769, " terms", false], [34074, 0.003366, " horizon", false]]]}, "raw_delta": -0.053575658798217775, "tuned_delta": -0.046763380991119825}, {"byte_start": 737, "byte_end": 738, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "41.42%", "qwen": "43.78%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.0992698073387146]], "qwen": [[11, ",", "normal", 0.08825676888227463]]}, "loss": {"rwkv": 41.42112715052297, "qwen": 43.776868109848834}, "topk": {"rwkv": [45, 2, 0.0992698073387146, [[4600, 0.300201, " is", false], [45, 0.09927, ",", false], [32475, 0.043108, " will", false], [275, 0.042912, " (", false], [22074, 0.037895, " may", false], [57102, 0.035026, " requires", false], [21413, 0.034717, " can", false], [4450, 0.03313, " by", false], [53356, 0.02019, " without", false], [40187, 0.016559, " while", false]]], "qwen": [11, 2, 0.08825676888227463, [[374, 0.300275, " is", false], [11, 0.088257, ",", false], [320, 0.058578, " (", false], [646, 0.038089, " can", false], [7460, 0.036124, " requires", false], [686, 0.034283, " will", false], [702, 0.026786, " has", false], [9044, 0.025306, " becomes", false], [1231, 0.024479, " may", false], [3363, 0.018381, " means", false]]]}, "raw_delta": -0.1306300163269043, "tuned_delta": -0.12381773851980635}, {"byte_start": 738, "byte_end": 750, "display": {"text": " researchers", "kind": "normal"}, "is_word": true, "word_id": 121, "word_key": " researchers", "bytes_hex": "20 72 65 73 65 61 72 63 68 65 72 73", "compression": {"rwkv": "5.17% 5.17% 5.17% 5.17% 5.17% 5.17% 5.17% 5.17% 5.17% 5.17% 5.17% 5.17%", "qwen": "6.27% 6.27% 6.27% 6.27% 6.27% 6.27% 6.27% 6.27% 6.27% 6.27% 6.27% 6.27%"}, "model_tokens": {"rwkv": [[63843, " researchers", "normal", 0.032304443418979645]], "qwen": [[11811, " researchers", "normal", 0.015444123186171055]]}, "loss": {"rwkv": 5.165900211516471, "qwen": 6.267497818710502}, "topk": {"rwkv": [63843, 7, 0.032304443418979645, [[40187, 0.060322, " while", false], [22590, 0.053017, " the", false], [21265, 0.052498, " and", false], [4858, 0.048534, " we", false], [21400, 0.038026, " but", false], [53356, 0.033706, " without", false], [63843, 0.032304, " researchers", false], [4450, 0.02973, " by", false], [22226, 0.028832, " one", false], [4715, 0.024818, " or", false]]], "qwen": [11811, 19, 0.015444123186171055, [[323, 0.06536, " and", false], [476, 0.056072, " or", false], [1741, 0.053032, " such", false], [4764, 0.039624, " however", false], [279, 0.035106, " the", false], [304, 0.032476, " in", false], [438, 0.029488, " as", false], [1393, 0.027959, " while", false], [1221, 0.025311, " then", false], [714, 0.025235, " but", false]]]}, "raw_delta": -0.06108554204305017, "tuned_delta": -0.05427326423595222}, {"byte_start": 750, "byte_end": 755, "display": {"text": " seek", "kind": "normal"}, "is_word": true, "word_id": 122, "word_key": " seek", "bytes_hex": "20 73 65 65 6b", "compression": {"rwkv": "21.75% 21.75% 21.75% 21.75% 21.75%", "qwen": "20.72% 20.72% 20.72% 20.72% 20.72%"}, "model_tokens": {"rwkv": [[31966, " seek", "normal", 0.0023929905146360397]], "qwen": [[5931, " seek", "normal", 0.003198388498276472]]}, "loss": {"rwkv": 21.7531361634039, "qwen": 20.72109751262683}, "topk": {"rwkv": [31966, 42, 0.0023929905146360397, [[31059, 0.200407, " have", false], [39171, 0.097985, " often", false], [32475, 0.072604, " will", false], [21286, 0.053174, " are", false], [32216, 0.051482, " tend", false], [21413, 0.028163, " can", false], [60687, 0.023802, " typically", false], [22074, 0.02272, " may", false], [47266, 0.015674, " should", false], [4596, 0.01533, " in", false]]], "qwen": [5931, 37, 0.003198388498276472, [[614, 0.303681, " have", false], [525, 0.074676, " are", false], [8376, 0.058613, " tend", false], [686, 0.058181, " will", false], [3545, 0.05436, " often", false], [646, 0.025166, " can", false], [1969, 0.024153, " must", false], [11136, 0.020928, " typically", false], [1265, 0.02013, " should", false], [1231, 0.017721, " may", false]]]}, "raw_delta": 0.057228374481201216, "tuned_delta": 0.06404065228829917}, {"byte_start": 755, "byte_end": 758, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 123, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "6.43% 6.43% 6.43%", "qwen": "7.10% 7.10% 7.10%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.3440851867198944]], "qwen": [[311, " to", "normal", 0.30715322494506836]]}, "loss": {"rwkv": 6.433893899797785, "qwen": 7.095706787932366}, "topk": {"rwkv": [4811, 1, 0.3440851867198944, [[4811, 0.344085, " to", false], [332, 0.096195, " a", false], [52224, 0.055507, " methods", false], [22249, 0.050156, " out", false], [4419, 0.033815, " an", false], [32448, 0.033691, " ways", false], [22590, 0.029939, " the", false], [64423, 0.024972, " improvements", false], [22168, 0.01294, " new", false], [45490, 0.012077, " clever", false]]], "qwen": [311, 1, 0.30715322494506836, [[311, 0.307153, " to", false], [264, 0.063881, " a", false], [5510, 0.056106, " ways", false], [5413, 0.046561, " methods", false], [18142, 0.034417, " improvements", false], [700, 0.029936, " out", false], [279, 0.022782, " the", false], [54920, 0.019494, " shortcuts", false], [9904, 0.01759, " solutions", false], [458, 0.01636, " an", false]]]}, "raw_delta": -0.03669869899749756, "tuned_delta": -0.029886421190399613}, {"byte_start": 758, "byte_end": 767, "display": {"text": " leverage", "kind": "normal"}, "is_word": true, "word_id": 124, "word_key": " leverage", "bytes_hex": "20 6c 65 76 65 72 61 67 65", "compression": {"rwkv": "4.16% 4.16% 4.16% 4.16% 4.16% 4.16% 4.16% 4.16% 4.16%", "qwen": "3.38% 3.38% 3.38% 3.38% 3.38% 3.38% 3.38% 3.38% 3.38%"}, "model_tokens": {"rwkv": [[56540, " leverage", "normal", 0.1254807859659195]], "qwen": [[32064, " leverage", "normal", 0.1850433498620987]]}, "loss": {"rwkv": 4.164028655343578, "qwen": 3.3806455308803502}, "topk": {"rwkv": [56540, 2, 0.1254807859659195, [[51982, 0.13554, " improve", false], [56540, 0.125481, " leverage", false], [51690, 0.057586, " exploit", false], [31358, 0.039699, " make", false], [30858, 0.037854, " find", false], [37730, 0.031517, " apply", false], [22681, 0.029507, " use", false], [4491, 0.018277, " do", false], [56433, 0.015888, " increase", false], [51456, 0.015743, " develop", false]]], "qwen": [32064, 1, 0.1850433498620987, [[32064, 0.185043, " leverage", false], [7269, 0.073056, " improve", false], [1477, 0.054696, " find", false], [32194, 0.050307, " exploit", false], [1936, 0.034749, " build", false], [1281, 0.033653, " make", false], [990, 0.031825, " use", false], [2225, 0.027895, " develop", false], [3796, 0.022643, " apply", false], [653, 0.016222, " do", false]]]}, "raw_delta": 0.04343998432159424, "tuned_delta": 0.05025226212869219}, {"byte_start": 767, "byte_end": 773, "display": {"text": " their", "kind": "normal"}, "is_word": true, "word_id": 125, "word_key": " their", "bytes_hex": "20 74 68 65 69 72", "compression": {"rwkv": "10.10% 10.10% 10.10% 10.10% 10.10% 10.10%", "qwen": "12.25% 12.25% 12.25% 12.25% 12.25% 12.25%"}, "model_tokens": {"rwkv": [[39931, " their", "normal", 0.03420735523104668]], "qwen": [[862, " their", "normal", 0.016973810270428658]]}, "loss": {"rwkv": 10.09698677705492, "qwen": 12.251136838983184}, "topk": {"rwkv": [39931, 6, 0.03420735523104668, [[22590, 0.205041, " the", false], [38720, 0.108449, " human", false], [32234, 0.10131, " this", false], [32227, 0.069373, " that", false], [32464, 0.039832, " what", false], [39931, 0.034207, " their", false], [56173, 0.028292, " existing", false], [63370, 0.022558, " computation", false], [57564, 0.020562, " whatever", false], [332, 0.019433, " a", false]]], "qwen": [862, 9, 0.016973810270428658, [[419, 0.2792, " this", false], [279, 0.185648, " the", false], [429, 0.078367, " that", false], [432, 0.056268, " it", false], [3738, 0.041902, " human", false], [34447, 0.036121, " computation", false], [6350, 0.028696, " existing", false], [1493, 0.018124, " these", false], [862, 0.016974, " their", false], [6540, 0.015419, " knowledge", false]]]}, "raw_delta": -0.1194514433542887, "tuned_delta": -0.11263916554719075}, {"byte_start": 773, "byte_end": 779, "display": {"text": " human", "kind": "normal"}, "is_word": true, "word_id": 126, "word_key": " human", "bytes_hex": "20 68 75 6d 61 6e", "compression": {"rwkv": "9.35% 9.35% 9.35% 9.35% 9.35% 9.35%", "qwen": "11.94% 11.94% 11.94% 11.94% 11.94% 11.94%"}, "model_tokens": {"rwkv": [[38720, " human", "normal", 0.044434621930122375]], "qwen": [[3738, " human", "normal", 0.01883947290480137]]}, "loss": {"rwkv": 9.345583109925249, "qwen": 11.937703473946366}, "topk": {"rwkv": [38720, 6, 0.044434621930122375, [[52140, 0.113674, " limited", false], [59943, 0.105212, " knowledge", false], [51372, 0.06775, " current", false], [56173, 0.065971, " existing", false], [22251, 0.065113, " own", false], [38720, 0.044435, " human", false], [39720, 0.019804, " small", false], [65034, 0.018496, " understanding", false], [22168, 0.015813, " new", false], [59206, 0.015753, " available", false]]], "qwen": [3738, 9, 0.01883947290480137, [[6540, 0.180166, " knowledge", false], [6350, 0.092155, " existing", false], [1482, 0.06157, " current", false], [1828, 0.058436, " own", false], [501, 0.031776, " new", false], [7199, 0.030736, " limited", false], [54480, 0.02952, " computational", false], [2500, 0.021754, " available", false], [3738, 0.018839, " human", false], [8660, 0.018359, " understanding", false]]]}, "raw_delta": -0.14373767375946045, "tuned_delta": -0.1369253959523625}, {"byte_start": 779, "byte_end": 789, "display": {"text": " knowledge", "kind": "normal"}, "is_word": true, "word_id": 127, "word_key": " knowledge", "bytes_hex": "20 6b 6e 6f 77 6c 65 64 67 65", "compression": {"rwkv": "0.54% 0.54% 0.54% 0.54% 0.54% 0.54% 0.54% 0.54% 0.54% 0.54%", "qwen": "1.12% 1.12% 1.12% 1.12% 1.12% 1.12% 1.12% 1.12% 1.12% 1.12%"}, "model_tokens": {"rwkv": [[59943, " knowledge", "normal", 0.7422951459884644]], "qwen": [[6540, " knowledge", "normal", 0.5378748774528503]]}, "loss": {"rwkv": 0.5353751128298887, "qwen": 1.1183219167583118}, "topk": {"rwkv": [59943, 1, 0.7422951459884644, [[59943, 0.742295, " knowledge", false], [64452, 0.024722, " intelligence", false], [46, 0.022086, "-", false], [59683, 0.020284, " expertise", false], [59917, 0.016536, " intuition", false], [65034, 0.016317, " understanding", false], [45346, 0.007841, " brains", false], [59305, 0.006956, " cognitive", false], [21265, 0.005012, " and", false], [61979, 0.004255, " experience", false]]], "qwen": [6540, 1, 0.5378748774528503, [[6540, 0.537875, " knowledge", false], [18726, 0.053629, " expertise", false], [56251, 0.046322, " intuition", false], [11229, 0.029525, " intelligence", false], [8660, 0.015324, " understanding", false], [6749, 0.015121, " ing", false], [4963, 0.01493, " resources", false], [7361, 0.013789, " skills", false], [24675, 0.009583, " cognitive", false], [20017, 0.008713, " insight", false]]]}, "raw_delta": -0.032325434684753414, "tuned_delta": -0.025513156877655468}, {"byte_start": 789, "byte_end": 792, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 128, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "19.54% 19.54% 19.54%", "qwen": "21.13% 21.13% 21.13%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.03891364485025406]], "qwen": [[315, " of", "normal", 0.029736023396253586]]}, "loss": {"rwkv": 19.536495345371375, "qwen": 21.13185227681502}, "topk": {"rwkv": [4706, 6, 0.03891364485025406, [[45, 0.179536, ",", false], [4811, 0.159807, " to", false], [47, 0.143745, ".", false], [21265, 0.102453, " and", false], [4596, 0.073458, " in", false], [4706, 0.038914, " of", false], [275, 0.027301, " (", false], [4450, 0.026804, " by", false], [4423, 0.02351, " as", false], [60, 0.021493, ";", false]]], "qwen": [315, 8, 0.029736023396253586, [[11, 0.156832, ",", false], [323, 0.11761, " and", false], [304, 0.102445, " in", false], [311, 0.089361, " to", false], [13, 0.086746, ".", false], [553, 0.039992, " by", false], [320, 0.033706, " (", false], [315, 0.029736, " of", false], [803, 0.025906, " more", false], [438, 0.024378, " as", false]]]}, "raw_delta": -0.08846537272135424, "tuned_delta": -0.08165309491425629}, {"byte_start": 792, "byte_end": 796, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 129, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "2.96% 2.96% 2.96% 2.96%", "qwen": "2.29% 2.29% 2.29% 2.29%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.5144108533859253]], "qwen": [[279, " the", "normal", 0.6019660830497742]]}, "loss": {"rwkv": 2.9586519393230692, "qwen": 2.2882684032718967}, "topk": {"rwkv": [22590, 1, 0.5144108533859253, [[22590, 0.514411, " the", false], [21835, 0.085591, " how", false], [32464, 0.056271, " what", false], [332, 0.05419, " a", false], [40186, 0.00926, " which", false], [32074, 0.0079, " some", false], [39931, 0.007887, " their", false], [3609, 0.007699, " AI", false], [4419, 0.007357, " an", false], [57564, 0.006749, " whatever", false]]], "qwen": [279, 1, 0.6019660830497742, [[279, 0.601966, " the", false], [1246, 0.100687, " how", false], [1128, 0.06234, " what", false], [264, 0.047222, " a", false], [458, 0.008219, " an", false], [7947, 0.007775, " domain", false], [3491, 0.007697, " problem", false], [5322, 0.007279, " problems", false], [15235, 0.006428, " AI", false], [3151, 0.005127, " specific", false]]]}, "raw_delta": 0.037173956632614136, "tuned_delta": 0.043986234439712085}, {"byte_start": 796, "byte_end": 803, "display": {"text": " domain", "kind": "normal"}, "is_word": true, "word_id": 130, "word_key": " domain", "bytes_hex": "20 64 6f 6d 61 69 6e", "compression": {"rwkv": "4.93% 4.93% 4.93% 4.93% 4.93% 4.93% 4.93%", "qwen": "6.36% 6.36% 6.36% 6.36% 6.36% 6.36% 6.36%"}, "model_tokens": {"rwkv": [[45775, " domain", "normal", 0.1481153666973114]], "qwen": [[7947, " domain", "normal", 0.08477343618869781]]}, "loss": {"rwkv": 4.931086565538449, "qwen": 6.357578236407423}, "topk": {"rwkv": [45775, 3, 0.1481153666973114, [[40213, 0.318396, " world", false], [52569, 0.204029, " problem", false], [45775, 0.148115, " domain", false], [32202, 0.06774, " task", false], [63536, 0.033772, " environment", false], [57074, 0.016185, " relevant", false], [60511, 0.013062, " situation", false], [56939, 0.011238, " problems", false], [57271, 0.010856, " specific", false], [62293, 0.010274, " particular", false]]], "qwen": [7947, 5, 0.08477343618869781, [[3491, 0.312582, " problem", false], [1879, 0.210592, " world", false], [4573, 0.120185, " environment", false], [3383, 0.095531, " task", false], [7947, 0.084773, " domain", false], [3151, 0.011941, " specific", false], [1849, 0.011441, " system", false], [8315, 0.010717, " agent", false], [5322, 0.007905, " problems", false], [1931, 0.006768, " real", false]]]}, "raw_delta": -0.07910149438040597, "tuned_delta": -0.07228921657330802}, {"byte_start": 803, "byte_end": 804, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "28.74%", "qwen": "28.85%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.20141513645648956]], "qwen": [[11, ",", "normal", 0.20195549726486206]]}, "loss": {"rwkv": 28.741190267709815, "qwen": 28.848632129270083}, "topk": {"rwkv": [45, 1, 0.20141513645648956, [[45, 0.201415, ",", false], [47, 0.186461, ".", false], [4811, 0.099614, " to", false], [4596, 0.097766, " in", false], [21265, 0.074774, " and", false], [32232, 0.05319, " they", false], [4706, 0.036784, " of", false], [275, 0.029072, " (", false], [60, 0.019469, ";", false], [4424, 0.016402, " at", false]]], "qwen": [11, 1, 0.20195549726486206, [[11, 0.201955, ",", false], [311, 0.127244, " to", false], [13, 0.126718, ".", false], [304, 0.109078, " in", false], [323, 0.086082, " and", false], [320, 0.048249, " (", false], [553, 0.0362, " by", false], [624, 0.020436, ".\n", false], [438, 0.017697, " as", false], [26, 0.017592, ";", false]]]}, "raw_delta": -0.005957841873168945, "tuned_delta": 0.0008544359339290016}, {"byte_start": 804, "byte_end": 808, "display": {"text": " but", "kind": "normal"}, "is_word": true, "word_id": 131, "word_key": " but", "bytes_hex": "20 62 75 74", "compression": {"rwkv": "6.13% 6.13% 6.13% 6.13%", "qwen": "6.62% 6.62% 6.62% 6.62%"}, "model_tokens": {"rwkv": [[21400, " but", "normal", 0.2584640085697174]], "qwen": [[714, " but", "normal", 0.23051802814006805]]}, "loss": {"rwkv": 6.128636160026358, "qwen": 6.615776481149479}, "topk": {"rwkv": [21400, 1, 0.2584640085697174, [[21400, 0.258464, " but", false], [21265, 0.133323, " and", false], [40186, 0.109656, " which", false], [40187, 0.035853, " while", false], [4715, 0.035489, " or", false], [47001, 0.020422, " rather", false], [4811, 0.020273, " to", false], [22590, 0.017851, " the", false], [4596, 0.016551, " in", false], [39171, 0.015592, " often", false]]], "qwen": [714, 1, 0.23051802814006805, [[714, 0.230518, " but", false], [323, 0.130085, " and", false], [892, 0.082421, " which", false], [1393, 0.053377, " while", false], [476, 0.041299, " or", false], [3545, 0.026077, " often", false], [19853, 0.024233, " whereas", false], [438, 0.01806, " as", false], [304, 0.015485, " in", false], [311, 0.014344, " to", false]]]}, "raw_delta": -0.027012795209884644, "tuned_delta": -0.020200517402786698}, {"byte_start": 808, "byte_end": 812, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 132, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "10.71% 10.71% 10.71% 10.71%", "qwen": "11.14% 11.14% 11.14% 11.14%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.09325040876865387]], "qwen": [[279, " the", "normal", 0.08452223241329193]]}, "loss": {"rwkv": 10.707502256597774, "qwen": 11.139142163950115}, "topk": {"rwkv": [22590, 3, 0.09325040876865387, [[4596, 0.121301, " in", false], [32234, 0.115149, " this", false], [22590, 0.09325, " the", false], [31601, 0.049496, " over", false], [32227, 0.048665, " that", false], [4423, 0.028924, " as", false], [4588, 0.027321, " if", false], [45, 0.026007, ",", false], [4601, 0.02485, " it", false], [32232, 0.022214, " they", false]]], "qwen": [279, 3, 0.08452223241329193, [[304, 0.141637, " in", false], [419, 0.093016, " this", false], [279, 0.084522, " the", false], [11, 0.068891, ",", false], [916, 0.061476, " over", false], [438, 0.060623, " as", false], [979, 0.027856, " when", false], [432, 0.024868, " it", false], [429, 0.024163, " that", false], [421, 0.023443, " if", false]]]}, "raw_delta": -0.02393519878387451, "tuned_delta": -0.017122920976776566}, {"byte_start": 812, "byte_end": 817, "display": {"text": " only", "kind": "normal"}, "is_word": true, "word_id": 133, "word_key": " only", "bytes_hex": "20 6f 6e 6c 79", "compression": {"rwkv": "11.95% 11.95% 11.95% 11.95% 11.95%", "qwen": "15.16% 15.16% 15.16% 15.16% 15.16%"}, "model_tokens": {"rwkv": [[31581, " only", "normal", 0.036760829389095306]], "qwen": [[1172, " only", "normal", 0.014963667839765549]]}, "loss": {"rwkv": 11.947318307361726, "qwen": 15.155981426244061}, "topk": {"rwkv": [31581, 3, 0.036760829389095306, [[31323, 0.074545, " long", false], [46470, 0.074233, " longer", false], [31581, 0.036761, " only", false], [31461, 0.031046, " most", false], [57481, 0.023711, " ultimate", false], [31835, 0.023311, " real", false], [31458, 0.021906, " more", false], [30510, 0.017557, " cost", false], [46397, 0.016233, " larger", false], [45305, 0.015073, " bigger", false]]], "qwen": [1172, 7, 0.014963667839765549, [[5021, 0.128067, " longer", false], [1293, 0.036176, " long", false], [803, 0.031229, " more", false], [16724, 0.0267, " ultimate", false], [2783, 0.025294, " cost", false], [3491, 0.017783, " problem", false], [1172, 0.014964, " only", false], [1429, 0.012337, " most", false], [882, 0.012052, " time", false], [8131, 0.011567, " larger", false]]]}, "raw_delta": -0.17792606353759766, "tuned_delta": -0.1711137857304997}, {"byte_start": 817, "byte_end": 823, "display": {"text": " thing", "kind": "normal"}, "is_word": true, "word_id": 134, "word_key": " thing", "bytes_hex": "20 74 68 69 6e 67", "compression": {"rwkv": "9.16% 9.16% 9.16% 9.16% 9.16% 9.16%", "qwen": "7.54% 7.54% 7.54% 7.54% 7.54% 7.54%"}, "model_tokens": {"rwkv": [[39941, " thing", "normal", 0.04688955843448639]], "qwen": [[3166, " thing", "normal", 0.08142250776290894]]}, "loss": {"rwkv": 9.157732193142833, "qwen": 7.538392281036371}, "topk": {"rwkv": [39941, 2, 0.04688955843448639, [[22752, 0.514989, " way", false], [39941, 0.04689, " thing", false], [31835, 0.023846, " real", false], [31323, 0.023323, " long", false], [47009, 0.020103, " reason", false], [59593, 0.018675, " effective", false], [56540, 0.010927, " leverage", false], [57075, 0.00951, " reliable", false], [51832, 0.009459, " general", false], [61863, 0.007388, " difference", false]]], "qwen": [3166, 2, 0.08142250776290894, [[1616, 0.515129, " way", false], [3166, 0.081423, " thing", false], [7373, 0.028958, " effective", false], [5510, 0.019747, " ways", false], [3900, 0.019326, " hope", false], [1931, 0.012952, " real", false], [15673, 0.011414, " improvement", false], [1714, 0.010554, " method", false], [5413, 0.007542, " methods", false], [1293, 0.00617, " long", false]]]}, "raw_delta": 0.0897952715555827, "tuned_delta": 0.09660754936268065}, {"byte_start": 823, "byte_end": 828, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 135, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"rwkv": "1.51% 1.51% 1.51% 1.51% 1.51%", "qwen": "1.79% 1.79% 1.79% 1.79% 1.79%"}, "model_tokens": {"rwkv": [[32227, " that", "normal", 0.6552863717079163]], "qwen": [[429, " that", "normal", 0.6083807945251465]]}, "loss": {"rwkv": 1.507503607178897, "qwen": 1.7923837317548124}, "topk": {"rwkv": [32227, 1, 0.6552863717079163, [[32227, 0.655286, " that", false], [32232, 0.087486, " they", false], [4858, 0.020379, " we", false], [32234, 0.018056, " this", false], [31458, 0.013291, " more", false], [52072, 0.009998, " keeping", false], [22799, 0.009636, " you", false], [62364, 0.009219, " preventing", false], [4811, 0.00837, " to", false], [59206, 0.008319, " available", false]]], "qwen": [429, 1, 0.6083807945251465, [[429, 0.608381, " that", false], [807, 0.079125, " they", false], [582, 0.034568, " we", false], [12677, 0.025728, " humans", false], [279, 0.016112, " the", false], [419, 0.013132, " this", false], [803, 0.011792, " more", false], [3738, 0.009933, " human", false], [311, 0.009811, " to", false], [264, 0.008783, " a", false]]]}, "raw_delta": -0.01579710841178894, "tuned_delta": -0.008984830604690994}, {"byte_start": 828, "byte_end": 836, "display": {"text": " matters", "kind": "normal"}, "is_word": true, "word_id": 136, "word_key": " matters", "bytes_hex": "20 6d 61 74 74 65 72 73", "compression": {"rwkv": "3.65% 3.65% 3.65% 3.65% 3.65% 3.65% 3.65% 3.65%", "qwen": "6.37% 6.37% 6.37% 6.37% 6.37% 6.37% 6.37% 6.37%"}, "model_tokens": {"rwkv": [[52201, " matters", "normal", 0.2002413272857666]], "qwen": [[12850, " matters", "normal", 0.05914688482880592]]}, "loss": {"rwkv": 3.6454818538087816, "qwen": 6.374303165313985}, "topk": {"rwkv": [52201, 1, 0.2002413272857666, [[52201, 0.200241, " matters", false], [21413, 0.10752, " can", false], [4600, 0.063897, " is", false], [32475, 0.057894, " will", false], [38964, 0.048575, " makes", false], [47008, 0.036153, " really", false], [460, 0.032411, "'s", false], [56540, 0.018865, " leverage", false], [21800, 0.018679, " has", false], [56925, 0.0171, " prevents", false]]], "qwen": [12850, 4, 0.05914688482880592, [[646, 0.182452, " can", false], [686, 0.080467, " will", false], [374, 0.078371, " is", false], [12850, 0.059147, " matters", false], [3643, 0.056159, " makes", false], [2167, 0.040223, " really", false], [702, 0.032976, " has", false], [12677, 0.023099, " humans", false], [9428, 0.021145, " truly", false], [594, 0.017699, "'s", false]]]}, "raw_delta": -0.15131798386573792, "tuned_delta": -0.14450570605863997}, {"byte_start": 836, "byte_end": 839, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 137, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "2.78% 2.78% 2.78%", "qwen": "4.64% 4.64% 4.64%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.6299585700035095]], "qwen": [[304, " in", "normal", 0.46231386065483093]]}, "loss": {"rwkv": 2.782541704839553, "qwen": 4.637731458395485}, "topk": {"rwkv": [4596, 1, 0.6299585700035095, [[4596, 0.629959, " in", false], [4600, 0.085142, " is", false], [21700, 0.077693, " for", false], [31601, 0.051625, " over", false], [31323, 0.046866, " long", false], [4811, 0.013684, " to", false], [4712, 0.008922, " on", false], [46470, 0.008658, " longer", false], [4424, 0.00819, " at", false], [32465, 0.006962, " when", false]]], "qwen": [304, 1, 0.46231386065483093, [[304, 0.462314, " in", false], [374, 0.248756, " is", false], [369, 0.083671, " for", false], [311, 0.033057, " to", false], [1293, 0.031607, " long", false], [916, 0.020673, " over", false], [979, 0.019231, " when", false], [438, 0.009893, " as", false], [518, 0.007377, " at", false], [911, 0.006492, " about", false]]]}, "raw_delta": -0.10287356376647949, "tuned_delta": -0.09606128595938154}, {"byte_start": 839, "byte_end": 843, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 138, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "0.15% 0.15% 0.15% 0.15%", "qwen": "0.45% 0.45% 0.45% 0.45%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.9667707681655884]], "qwen": [[279, " the", "normal", 0.9055376052856445]]}, "loss": {"rwkv": 0.15189507724203258, "qwen": 0.44735475489420745}, "topk": {"rwkv": [22590, 1, 0.9667707681655884, [[22590, 0.966771, " the", false], [332, 0.005655, " a", false], [56901, 0.00364, " practice", false], [39920, 0.003459, " terms", false], [32234, 0.002458, " this", false], [46470, 0.001478, " longer", false], [31323, 0.001396, " long", false], [32227, 0.001361, " that", false], [4419, 0.001138, " an", false], [3609, 0.000977, " AI", false]]], "qwen": [279, 1, 0.9055376052856445, [[279, 0.905538, " the", false], [3793, 0.022919, " terms", false], [264, 0.016748, " a", false], [419, 0.00897, " this", false], [15235, 0.003279, " AI", false], [1293, 0.00291, " long", false], [220, 0.002771, " ", false], [5021, 0.00245, " longer", false], [6588, 0.002284, " practice", false], [458, 0.002251, " an", false]]]}, "raw_delta": -0.016383763402700424, "tuned_delta": -0.009571485595602478}, {"byte_start": 843, "byte_end": 848, "display": {"text": " long", "kind": "normal"}, "is_word": true, "word_id": 139, "word_key": " long", "bytes_hex": "20 6c 6f 6e 67", "compression": {"rwkv": "2.07% 2.07% 2.07% 2.07% 2.07%", "qwen": "1.11% 1.11% 1.11% 1.11% 1.11%"}, "model_tokens": {"rwkv": [[31323, " long", "normal", 0.5633893609046936]], "qwen": [[1293, " long", "normal", 0.7342362403869629]]}, "loss": {"rwkv": 2.0710563575261483, "qwen": 1.1142093816195549}, "topk": {"rwkv": [31323, 1, 0.5633893609046936, [[31323, 0.563389, " long", false], [46470, 0.398091, " longer", false], [21616, 0.010027, " end", false], [32386, 0.003554, " very", false], [39675, 0.002814, " short", false], [52888, 0.001965, " shorter", false], [46536, 0.001792, " medium", false], [46397, 0.001467, " larger", false], [46064, 0.001347, " future", false], [51310, 0.00122, " context", false]]], "qwen": [1293, 1, 0.7342362403869629, [[1293, 0.734236, " long", false], [5021, 0.195004, " longer", false], [835, 0.021934, " end", false], [11051, 0.00635, " medium", false], [1602, 0.005318, " very", false], [2805, 0.003325, " short", false], [3853, 0.00324, " future", false], [3930, 0.002214, " limit", false], [8131, 0.001688, " larger", false], [2266, 0.001613, " context", false]]]}, "raw_delta": 0.05305886268615721, "tuned_delta": 0.05987114049325516}, {"byte_start": 848, "byte_end": 852, "display": {"text": " run", "kind": "normal"}, "is_word": true, "word_id": 140, "word_key": " run", "bytes_hex": "20 72 75 6e", "compression": {"rwkv": "3.28% 3.28% 3.28% 3.28%", "qwen": "5.04% 5.04% 5.04% 5.04%"}, "model_tokens": {"rwkv": [[22418, " run", "normal", 0.4829787611961365]], "qwen": [[1598, " run", "normal", 0.3270103633403778]]}, "loss": {"rwkv": 3.275650361393398, "qwen": 5.0393491068108025}, "topk": {"rwkv": [22418, 1, 0.4829787611961365, [[22418, 0.482979, " run", false], [32219, 0.480955, " term", false], [46, 0.024706, "-", false], [31057, 0.003415, " haul", false], [30941, 0.001865, " game", false], [27132, 0.001304, "term", false], [32186, 0.000337, " tail", false], [32398, 0.000332, " view", false], [8661, 0.000329, "run", false], [45, 0.000228, ",", false]]], "qwen": [1598, 2, 0.3270103633403778, [[4647, 0.632555, " term", false], [1598, 0.32701, " run", false], [9663, 0.027619, "-term", false], [22973, 0.003781, "-run", false], [37868, 0.001621, " haul", false], [4991, 0.00115, "term", false], [1809, 0.000715, " game", false], [11, 0.000508, ",", false], [882, 0.000435, " time", false], [1651, 0.000375, " view", false]]]}, "raw_delta": -0.09780022501945496, "tuned_delta": -0.090987947212357}, {"byte_start": 852, "byte_end": 855, "display": {"text": " is", "kind": "normal"}, "is_word": true, "word_id": 141, "word_key": " is", "bytes_hex": "20 69 73", "compression": {"rwkv": "0.39% 0.39% 0.39%", "qwen": "0.50% 0.50% 0.50%"}, "model_tokens": {"rwkv": [[4600, " is", "normal", 0.936878502368927]], "qwen": [[374, " is", "normal", 0.9206897020339966]]}, "loss": {"rwkv": 0.39331285701318575, "qwen": 0.49672136711353176}, "topk": {"rwkv": [4600, 1, 0.936878502368927, [[4600, 0.936879, " is", false], [21286, 0.023933, " are", false], [45, 0.015449, ",", false], [275, 0.005253, " (", false], [21700, 0.003535, " for", false], [4596, 0.002379, " in", false], [32475, 0.001735, " will", false], [37598, 0.000765, " about", false], [4601, 0.000624, " it", false], [9816, 0.000466, "—", false]]], "qwen": [374, 1, 0.9206897020339966, [[374, 0.92069, " is", false], [525, 0.025628, " are", false], [11, 0.016065, ",", false], [320, 0.009669, " (", false], [369, 0.004831, " for", false], [304, 0.00204, " in", false], [323, 0.002032, " and", false], [311, 0.001394, " to", false], [686, 0.00132, " will", false], [979, 0.001138, " when", false]]]}, "raw_delta": -0.005734185377756756, "tuned_delta": 0.0010780924293411912}, {"byte_start": 855, "byte_end": 859, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 142, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "5.28% 5.28% 5.28% 5.28%", "qwen": "8.19% 8.19% 8.19% 8.19%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.31015342473983765]], "qwen": [[279, " the", "normal", 0.16274243593215942]]}, "loss": {"rwkv": 5.283307034505481, "qwen": 8.185430426273081}, "topk": {"rwkv": [22590, 1, 0.31015342473983765, [[22590, 0.310153, " the", false], [21835, 0.154459, " how", false], [32227, 0.133807, " that", false], [53342, 0.053281, " whether", false], [32464, 0.040145, " what", false], [38888, 0.032387, " lever", false], [40186, 0.017139, " which", false], [63370, 0.012937, " computation", false], [332, 0.010343, " a", false], [59832, 0.009199, " improving", false]]], "qwen": [279, 1, 0.16274243593215942, [[279, 0.162742, " the", false], [76482, 0.093711, " leveraging", false], [311, 0.092522, " to", false], [34447, 0.065545, " computation", false], [1246, 0.045012, " how", false], [429, 0.041316, " that", false], [264, 0.034883, " a", false], [3425, 0.029197, " whether", false], [4586, 0.025029, " general", false], [1128, 0.024177, " what", false]]]}, "raw_delta": -0.1609278917312622, "tuned_delta": -0.15411561392416426}, {"byte_start": 859, "byte_end": 870, "display": {"text": " leveraging", "kind": "normal"}, "is_word": true, "word_id": 143, "word_key": " leveraging", "bytes_hex": "20 6c 65 76 65 72 61 67 69 6e 67", "compression": {"rwkv": "15.22% 15.22% 15.22% 15.22% 15.22% 15.22% 0.66% 0.66% 0.66% 0.66% 0.66%", "qwen": "9.31% 9.31% 9.31% 9.31% 9.31% 9.31% 9.31% 9.31% 9.31% 9.31% 9.31%"}, "model_tokens": {"rwkv": [[38888, " lever", "normal", 0.006403789389878511], [33672, "aging", "normal", 0.8337935209274292]], "qwen": [[76482, " leveraging", "normal", 0.0034172760788351297]]}, "loss": {"rwkv": 8.597381447058916, "qwen": 9.31015572616661}, "topk": {"rwkv": [38888, 29, 0.006403789389878511, [[50836, 0.068262, " ability", false], [30510, 0.058853, " cost", false], [45157, 0.052758, " amount", false], [63621, 0.02868, " improvement", false], [64264, 0.024005, " availability", false], [31830, 0.022715, " rate", false], [39984, 0.019811, " total", false], [63370, 0.018597, " computation", false], [51832, 0.017036, " general", false], [56540, 0.016799, " leverage", false]]], "qwen": [76482, 47, 0.0034172760788351297, [[5726, 0.169427, " ability", false], [990, 0.040495, " use", false], [4586, 0.040453, " general", false], [34447, 0.029547, " computation", false], [3311, 0.026409, " amount", false], [4401, 0.021444, " development", false], [54480, 0.017618, " computational", false], [4271, 0.015834, " quality", false], [15673, 0.014703, " improvement", false], [12111, 0.014498, " algorithm", false]]]}, "raw_delta": -0.0395245985551314, "tuned_delta": -0.03271232074803345}, {"byte_start": 870, "byte_end": 873, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 144, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "0.20% 0.20% 0.20%", "qwen": "0.09% 0.09% 0.09%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.9674352407455444]], "qwen": [[315, " of", "normal", 0.9853333830833435]]}, "loss": {"rwkv": 0.19959159908131818, "qwen": 0.08881744489753073}, "topk": {"rwkv": [4706, 1, 0.9674352407455444, [[4706, 0.967435, " of", false], [22590, 0.005601, " the", false], [32227, 0.004877, " that", false], [63370, 0.002936, " computation", false], [31458, 0.001439, " more", false], [59206, 0.001391, " available", false], [21265, 0.000786, " and", false], [38720, 0.000664, " human", false], [39339, 0.00058, " power", false], [51832, 0.000445, " general", false]]], "qwen": [315, 1, 0.9853333830833435, [[315, 0.985333, " of", false], [279, 0.002407, " the", false], [323, 0.002221, " and", false], [429, 0.000901, " that", false], [320, 0.000591, " (", false], [34447, 0.000498, " computation", false], [11, 0.000456, ",", false], [2355, 0.000411, " power", false], [476, 0.000368, " or", false], [862, 0.000324, " their", false]]]}, "raw_delta": 0.006142623412112395, "tuned_delta": 0.012954901219210342}, {"byte_start": 873, "byte_end": 885, "display": {"text": " computation", "kind": "normal"}, "is_word": true, "word_id": 145, "word_key": " computation", "bytes_hex": "20 63 6f 6d 70 75 74 61 74 69 6f 6e", "compression": {"rwkv": "1.70% 1.70% 1.70% 1.70% 1.70% 1.70% 1.70% 1.70% 1.70% 1.70% 1.70% 1.70%", "qwen": "1.52% 1.52% 1.52% 1.52% 1.52% 1.52% 1.52% 1.52% 1.52% 1.52% 1.52% 1.52%"}, "model_tokens": {"rwkv": [[63370, " computation", "normal", 0.3227907717227936]], "qwen": [[34447, " computation", "normal", 0.3631451427936554]]}, "loss": {"rwkv": 1.702398933340655, "qwen": 1.5222727248108976}, "topk": {"rwkv": [63370, 1, 0.3227907717227936, [[63370, 0.322791, " computation", false], [22590, 0.155447, " the", false], [31458, 0.045085, " more", false], [30789, 0.042523, " ever", false], [51832, 0.023977, " general", false], [64862, 0.02395, " computational", false], [52195, 0.019037, " massive", false], [59988, 0.018398, " massively", false], [38720, 0.017901, " human", false], [21256, 0.01767, " all", false]]], "qwen": [34447, 1, 0.3631451427936554, [[34447, 0.363145, " computation", false], [279, 0.183433, " the", false], [54480, 0.059844, " computational", false], [10951, 0.026548, " massive", false], [419, 0.025934, " this", false], [2500, 0.025503, " available", false], [803, 0.013521, " more", false], [3512, 0.012963, " ever", false], [74151, 0.012141, " exponentially", false], [678, 0.009145, " all", false]]]}, "raw_delta": 0.009988317886988327, "tuned_delta": 0.016800595694086273}, {"byte_start": 885, "byte_end": 886, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "6.76%", "qwen": "20.20%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.6834675073623657]], "qwen": [[13, ".", "normal", 0.3262180685997009]]}, "loss": {"rwkv": 6.762633004167015, "qwen": 20.201142364273302}, "topk": {"rwkv": [47, 1, 0.6834675073623657, [[47, 0.683468, ".", false], [45, 0.106577, ",", false], [32227, 0.027142, " that", false], [4811, 0.0244, " to", false], [21265, 0.020965, " and", false], [46342, 0.013853, " itself", false], [275, 0.012913, " (", false], [59206, 0.012757, " available", false], [4596, 0.010115, " in", false], [4423, 0.007591, " as", false]]], "qwen": [13, 2, 0.3262180685997009, [[624, 0.391796, ".\n", false], [13, 0.326218, ".", false], [11, 0.057867, ",", false], [5086, 0.030455, " itself", false], [311, 0.021595, " to", false], [382, 0.019031, ".\n\n", false], [304, 0.014615, " in", false], [320, 0.014332, " (", false], [2355, 0.011719, " power", false], [323, 0.011194, " and", false]]]}, "raw_delta": -0.7451891899108887, "tuned_delta": -0.7383769121037908}, {"byte_start": 886, "byte_end": 892, "display": {"text": " These", "kind": "normal"}, "is_word": true, "word_id": 146, "word_key": " these", "bytes_hex": "20 54 68 65 73 65", "compression": {"rwkv": "22.45% 22.45% 22.45% 22.45% 22.45% 22.45%", "qwen": "18.64% 18.64% 18.64% 18.64% 18.64% 18.64%"}, "model_tokens": {"rwkv": [[37453, " These", "normal", 0.0005640207673422992]], "qwen": [[4220, " These", "normal", 0.0020231707021594048]]}, "loss": {"rwkv": 22.448184555498845, "qwen": 18.64409600149811}, "topk": {"rwkv": [37453, 90, 0.0005640207673422992, [[11, 0.35836, "\n", false], [261, 0.163328, "\n\n", false], [20996, 0.068986, " The", false], [29894, 0.044332, " This", false], [3913, 0.022298, " In", false], [3908, 0.017672, " If", false], [3918, 0.016945, " It", false], [19417, 0.014108, " And", false], [3641, 0.012809, " As", false], [29889, 0.01057, " That", false]]], "qwen": [4220, 65, 0.0020231707021594048, [[1096, 0.122805, " This", false], [576, 0.101877, " The", false], [758, 0.053649, " In", false], [1084, 0.03342, " It", false], [151643, 0.031468, "\u003c|endoftext|\u003e", false], [1597, 0.031053, " And", false], [1634, 0.027537, " As", false], [2938, 0.021748, " That", false], [2055, 0.020372, " So", false], [1416, 0.020039, " If", false]]]}, "raw_delta": 0.21094346046447754, "tuned_delta": 0.2177557382715755}, {"byte_start": 892, "byte_end": 896, "display": {"text": " two", "kind": "normal"}, "is_word": true, "word_id": 147, "word_key": " two", "bytes_hex": "20 74 77 6f", "compression": {"rwkv": "10.28% 10.28% 10.28% 10.28%", "qwen": "9.48% 9.48% 9.48% 9.48%"}, "model_tokens": {"rwkv": [[22638, " two", "normal", 0.10358548164367676]], "qwen": [[1378, " two", "normal", 0.122063048183918]]}, "loss": {"rwkv": 10.284837693837336, "qwen": 9.482192512477472}, "topk": {"rwkv": [22638, 3, 0.10358548164367676, [[52127, 0.177598, " lessons", false], [21286, 0.11921, " are", false], [22638, 0.103585, " two", false], [30582, 0.0574, " days", false], [52738, 0.041505, " results", false], [56463, 0.026973, " insights", false], [64495, 0.024642, " observations", false], [47539, 0.022326, " things", false], [38735, 0.019816, " ideas", false], [38440, 0.016649, " facts", false]]], "qwen": [1378, 2, 0.122063048183918, [[18366, 0.141717, " lessons", false], [1378, 0.122063, " two", false], [2849, 0.100338, " days", false], [525, 0.08124, " are", false], [4586, 0.054305, " general", false], [23722, 0.028487, " observations", false], [25709, 0.026367, " insights", false], [6708, 0.024223, " ideas", false], [16170, 0.021039, " principles", false], [5413, 0.017733, " methods", false]]]}, "raw_delta": 0.04450809955596924, "tuned_delta": 0.05132037736306719}, {"byte_start": 896, "byte_end": 901, "display": {"text": " need", "kind": "normal"}, "is_word": true, "word_id": 148, "word_key": " need", "bytes_hex": "20 6e 65 65 64", "compression": {"rwkv": "40.35% 40.35% 40.35% 40.35% 40.35%", "qwen": "30.38% 30.38% 30.38% 30.38% 30.38%"}, "model_tokens": {"rwkv": [[31506, " need", "normal", 1.4027535144123249e-05]], "qwen": [[1184, " need", "normal", 0.00021952726820018142]]}, "loss": {"rwkv": 40.35037692486319, "qwen": 30.38328061814791}, "topk": {"rwkv": [31506, 1192, 1.4027535144123249e-05, [[52127, 0.192855, " lessons", false], [38440, 0.099095, " facts", false], [46853, 0.091607, " points", false], [47539, 0.058332, " things", false], [51703, 0.046305, " factors", false], [38735, 0.043452, " ideas", false], [64495, 0.034543, " observations", false], [56463, 0.026879, " insights", false], [62370, 0.025424, " principles", false], [47613, 0.017894, " trends", false]]], "qwen": [1184, 323, 0.00021952726820018142, [[18366, 0.094548, " lessons", false], [6708, 0.061324, " ideas", false], [9363, 0.049633, " factors", false], [2513, 0.046846, " things", false], [23722, 0.043611, " observations", false], [3501, 0.031732, " points", false], [16170, 0.03025, " principles", false], [525, 0.028089, " are", false], [12239, 0.026806, " statements", false], [13064, 0.024781, " facts", false]]]}, "raw_delta": 0.5526931762695311, "tuned_delta": 0.559505454076629}, {"byte_start": 901, "byte_end": 905, "display": {"text": " not", "kind": "normal"}, "is_word": true, "word_id": 149, "word_key": " not", "bytes_hex": "20 6e 6f 74", "compression": {"rwkv": "1.79% 1.79% 1.79% 1.79%", "qwen": "2.32% 2.32% 2.32% 2.32%"}, "model_tokens": {"rwkv": [[22187, " not", "normal", 0.6731085777282715]], "qwen": [[537, " not", "normal", 0.59713214635849]]}, "loss": {"rwkv": 1.7875188800076875, "qwen": 2.324618280146211}, "topk": {"rwkv": [22187, 1, 0.6731085777282715, [[22187, 0.673109, " not", false], [4811, 0.250734, " to", false], [111, 0.041981, "n", false], [30719, 0.014032, " each", false], [122, 0.004026, "y", false], [4435, 0.00157, " be", false], [39115, 0.001282, " never", false], [4692, 0.001246, " no", false], [31581, 0.000834, " only", false], [332, 0.000817, " a", false]]], "qwen": [537, 1, 0.59713214635849, [[537, 0.597132, " not", false], [311, 0.290475, " to", false], [77, 0.057425, "n", false], [1817, 0.022967, " each", false], [2581, 0.006973, " never", false], [387, 0.004935, " be", false], [1172, 0.002542, " only", false], [264, 0.002226, " a", false], [1045, 0.000731, " some", false], [279, 0.000689, " the", false]]]}, "raw_delta": -0.029783114790916443, "tuned_delta": -0.022970836983818497}, {"byte_start": 905, "byte_end": 909, "display": {"text": " run", "kind": "normal"}, "is_word": true, "word_id": 150, "word_key": " run", "bytes_hex": "20 72 75 6e", "compression": {"rwkv": "30.57% 30.57% 30.57% 30.57%", "qwen": "29.47% 29.47% 29.47% 29.47%"}, "model_tokens": {"rwkv": [[22418, " run", "normal", 0.0011447330471128225]], "qwen": [[1598, " run", "normal", 0.0014501496916636825]]}, "loss": {"rwkv": 30.572736706338382, "qwen": 29.467445055122692}, "topk": {"rwkv": [22418, 29, 0.0011447330471128225, [[4435, 0.718807, " be", false], [55824, 0.076826, " conflict", false], [51255, 0.034711, " compete", false], [63717, 0.022221, " necessarily", false], [61779, 0.01812, " contradict", false], [4559, 0.017774, " go", false], [45150, 0.012469, " always", false], [30788, 0.007615, " even", false], [21265, 0.004338, " and", false], [30482, 0.004144, " come", false]]], "qwen": [1598, 23, 0.0014501496916636825, [[387, 0.701583, " be", false], [2677, 0.060365, " always", false], [12055, 0.055626, " conflict", false], [728, 0.034565, " go", false], [14312, 0.01243, " necessarily", false], [42461, 0.012189, " contradict", false], [2525, 0.007426, " come", false], [614, 0.006855, " have", false], [20259, 0.006407, " compete", false], [2803, 0.005127, " seem", false]]]}, "raw_delta": 0.06129038333892822, "tuned_delta": 0.06810266114602617}, {"byte_start": 909, "byte_end": 917, "display": {"text": " counter", "kind": "normal"}, "is_word": true, "word_id": 151, "word_key": " counter", "bytes_hex": "20 63 6f 75 6e 74 65 72", "compression": {"rwkv": "7.19% 7.19% 7.19% 7.19% 7.19% 7.19% 7.19% 7.19%", "qwen": "8.42% 8.42% 8.42% 8.42% 8.42% 8.42% 8.42% 8.42%"}, "model_tokens": {"rwkv": [[51336, " counter", "normal", 0.04065746068954468]], "qwen": [[5546, " counter", "normal", 0.02388518676161766]]}, "loss": {"rwkv": 7.185297566927454, "qwen": 8.418343843107662}, "topk": {"rwkv": [51336, 5, 0.04065746068954468, [[4596, 0.675279, " in", false], [56812, 0.067954, " parallel", false], [57435, 0.060052, " together", false], [64301, 0.054258, " concurrently", false], [51336, 0.040657, " counter", false], [65167, 0.022262, " simultaneously", false], [4424, 0.00954, " at", false], [31162, 0.007022, " into", false], [31044, 0.004711, " hand", false], [61737, 0.004189, " concurrent", false]]], "qwen": [5546, 6, 0.02388518676161766, [[304, 0.442034, " in", false], [15279, 0.205334, " parallel", false], [1424, 0.089002, " hand", false], [78026, 0.040503, " concurrently", false], [3108, 0.029114, " side", false], [5546, 0.023885, " counter", false], [518, 0.021003, " at", false], [3786, 0.014364, " together", false], [1119, 0.01417, " into", false], [700, 0.013769, " out", false]]]}, "raw_delta": -0.06837460398674011, "tuned_delta": -0.06156232617964216}, {"byte_start": 917, "byte_end": 920, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 152, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "1.66% 1.66% 1.66%", "qwen": "2.00% 2.00% 2.00%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.7569184303283691]], "qwen": [[311, " to", "normal", 0.717501699924469]]}, "loss": {"rwkv": 1.6554362041450505, "qwen": 1.9956076760817911}, "topk": {"rwkv": [4811, 1, 0.7569184303283691, [[4811, 0.756918, " to", false], [45, 0.093039, ",", false], [60, 0.025643, ";", false], [46, 0.024212, "-", false], [59, 0.023289, ":", false], [47, 0.020251, ".", false], [21400, 0.005956, " but", false], [30719, 0.004391, " each", false], [61076, 0.004052, "productive", false], [9816, 0.003338, "—", false]]], "qwen": [311, 1, 0.717501699924469, [[311, 0.717502, " to", false], [11, 0.076769, ",", false], [13, 0.03808, ".", false], [26, 0.031395, ";", false], [304, 0.01582, " in", false], [25, 0.01469, ":", false], [624, 0.010889, ".\n", false], [396, 0.009218, "int", false], [20052, 0.006652, "-int", false], [1576, 0.006468, " because", false]]]}, "raw_delta": -0.01886311173439026, "tuned_delta": -0.012050833927292313}, {"byte_start": 920, "byte_end": 925, "display": {"text": " each", "kind": "normal"}, "is_word": true, "word_id": 153, "word_key": " each", "bytes_hex": "20 65 61 63 68", "compression": {"rwkv": "1.37% 1.37% 1.37% 1.37% 1.37%", "qwen": "1.14% 1.14% 1.14% 1.14% 1.14%"}, "model_tokens": {"rwkv": [[30719, " each", "normal", 0.6829179525375366]], "qwen": [[1817, " each", "normal", 0.7294825911521912]]}, "loss": {"rwkv": 1.373659828971425, "qwen": 1.1376362133851459}, "topk": {"rwkv": [30719, 1, 0.6829179525375366, [[30719, 0.682918, " each", false], [22226, 0.311998, " one", false], [22590, 0.001638, " the", false], [332, 0.00055, " a", false], [21273, 0.000302, " any", false], [50919, 0.000233, " another", false], [39193, 0.000183, " other", false], [45, 0.000171, ",", false], [38720, 0.000162, " human", false], [62643, 9.8e-05, " themselves", false]]], "qwen": [1817, 1, 0.7294825911521912, [[1817, 0.729483, " each", false], [825, 0.256977, " one", false], [279, 0.003538, " the", false], [264, 0.001226, " a", false], [5577, 0.000648, " themselves", false], [862, 0.000487, " their", false], [894, 0.000421, " any", false], [2987, 0.00039, " either", false], [1008, 0.000318, " other", false], [387, 0.000254, " be", false]]]}, "raw_delta": 0.013087928295135498, "tuned_delta": 0.019900206102233444}, {"byte_start": 925, "byte_end": 931, "display": {"text": " other", "kind": "normal"}, "is_word": true, "word_id": 154, "word_key": " other", "bytes_hex": "20 6f 74 68 65 72", "compression": {"rwkv": "0.02% 0.02% 0.02% 0.02% 0.02% 0.02%", "qwen": "0.01% 0.01% 0.01% 0.01% 0.01% 0.01%"}, "model_tokens": {"rwkv": [[39193, " other", "normal", 0.9946314096450806]], "qwen": [[1008, " other", "normal", 0.9954625964164734]]}, "loss": {"rwkv": 0.016235162241449132, "qwen": 0.013668722862061278}, "topk": {"rwkv": [39193, 1, 0.9946314096450806, [[39193, 0.994631, " other", false], [46, 0.001533, "-", false], [35297, 0.00111, "other", false], [50919, 0.000722, " another", false], [46726, 0.000481, " others", false], [45, 0.000451, ",", false], [47, 0.000124, ".", false], [11, 7.9e-05, "\n", false], [4596, 5.6e-05, " in", false], [4811, 5.5e-05, " to", false]]], "qwen": [1008, 1, 0.9954625964164734, [[1008, 0.995463, " other", false], [1575, 0.001111, "other", false], [2441, 0.0007, " another", false], [72472, 0.000452, "-other", false], [11, 0.000449, ",", false], [3800, 0.000196, " others", false], [13, 0.000177, ".", false], [26, 0.000133, ";", false], [198, 9.8e-05, "\n", false], [304, 9.2e-05, " in", false]]]}, "raw_delta": 0.00014231361759205663, "tuned_delta": 0.006954591424690003}, {"byte_start": 931, "byte_end": 932, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "16.70%", "qwen": "18.97%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.40005531907081604]], "qwen": [[11, ",", "normal", 0.34930193424224854]]}, "loss": {"rwkv": 16.69525022903732, "qwen": 18.968168643273927}, "topk": {"rwkv": [45, 1, 0.40005531907081604, [[45, 0.400055, ",", false], [47, 0.170716, ".", false], [59, 0.123235, ":", false], [60, 0.111635, ";", false], [21400, 0.021708, " but", false], [280, 0.016256, " -", false], [275, 0.015318, " (", false], [4596, 0.013061, " in", false], [51018, 0.010959, " because", false], [4424, 0.010684, " at", false]]], "qwen": [11, 1, 0.34930193424224854, [[11, 0.349302, ",", false], [13, 0.165296, ".", false], [26, 0.099456, ";", false], [25, 0.069394, ":", false], [624, 0.048078, ".\n", false], [304, 0.028062, " in", false], [438, 0.026407, " as", false], [323, 0.024873, " and", false], [1576, 0.023704, " because", false], [714, 0.02264, " but", false]]]}, "raw_delta": -0.1260373592376709, "tuned_delta": -0.11922508143057295}, {"byte_start": 932, "byte_end": 936, "display": {"text": " but", "kind": "normal"}, "is_word": true, "word_id": 155, "word_key": " but", "bytes_hex": "20 62 75 74", "compression": {"rwkv": "4.05% 4.05% 4.05% 4.05%", "qwen": "5.57% 5.57% 5.57% 5.57%"}, "model_tokens": {"rwkv": [[21400, " but", "normal", 0.40568724274635315]], "qwen": [[714, " but", "normal", 0.2908656597137451]]}, "loss": {"rwkv": 4.050535393120868, "qwen": 5.567422373730841}, "topk": {"rwkv": [21400, 1, 0.40568724274635315, [[21400, 0.405687, " but", false], [4423, 0.13807, " as", false], [21265, 0.073618, " and", false], [39690, 0.051904, " since", false], [51948, 0.048986, " however", false], [47544, 0.041975, " though", false], [51018, 0.040062, " because", false], [4596, 0.036325, " in", false], [4706, 0.024962, " of", false], [21700, 0.013681, " for", false]]], "qwen": [714, 1, 0.2908656597137451, [[714, 0.290866, " but", false], [323, 0.15414, " and", false], [438, 0.137591, " as", false], [4764, 0.078339, " however", false], [3498, 0.045718, " though", false], [315, 0.043956, " of", false], [304, 0.034507, " in", false], [1576, 0.03194, " because", false], [2474, 0.028332, " since", false], [369, 0.015484, " for", false]]]}, "raw_delta": -0.08411407470703125, "tuned_delta": -0.0773017968999333}, {"byte_start": 936, "byte_end": 939, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 156, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "18.97% 18.97% 18.97%", "qwen": "16.65% 16.65% 16.65%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.042716823518276215]], "qwen": [[304, " in", "normal", 0.06268417090177536]]}, "loss": {"rwkv": 18.972942595024126, "qwen": 16.64897829682268}, "topk": {"rwkv": [4596, 4, 0.042716823518276215, [[32232, 0.261203, " they", false], [4601, 0.094333, " it", false], [22590, 0.091475, " the", false], [4596, 0.042717, " in", false], [4588, 0.026218, " if", false], [39934, 0.02034, " there", false], [21700, 0.018338, " for", false], [21286, 0.016808, " are", false], [32465, 0.015484, " when", false], [45, 0.014644, ",", false]]], "qwen": [304, 3, 0.06268417090177536, [[807, 0.221437, " they", false], [279, 0.135123, " the", false], [304, 0.062684, " in", false], [432, 0.059239, " it", false], [421, 0.030862, " if", false], [1052, 0.027152, " there", false], [979, 0.017533, " when", false], [438, 0.017005, " as", false], [825, 0.016756, " one", false], [11, 0.015249, ",", false]]]}, "raw_delta": 0.12886794408162427, "tuned_delta": 0.13568022188872222}, {"byte_start": 939, "byte_end": 948, "display": {"text": " practice", "kind": "normal"}, "is_word": true, "word_id": 157, "word_key": " practice", "bytes_hex": "20 70 72 61 63 74 69 63 65", "compression": {"rwkv": "2.16% 2.16% 2.16% 2.16% 2.16% 2.16% 2.16% 2.16% 2.16%", "qwen": "3.59% 3.59% 3.59% 3.59% 3.59% 3.59% 3.59% 3.59% 3.59%"}, "model_tokens": {"rwkv": [[56901, " practice", "normal", 0.34190449118614197]], "qwen": [[6588, " practice", "normal", 0.16660629212856293]]}, "loss": {"rwkv": 2.1602855429977965, "qwen": 3.5909516491104214}, "topk": {"rwkv": [56901, 1, 0.34190449118614197, [[56901, 0.341904, " practice", false], [22590, 0.282249, " the", false], [30808, 0.042085, " fact", false], [31370, 0.036304, " many", false], [31461, 0.032995, " most", false], [39189, 0.023228, " order", false], [51832, 0.020892, " general", false], [332, 0.020123, " a", false], [32074, 0.01898, " some", false], [21273, 0.013227, " any", false]]], "qwen": [6588, 2, 0.16660629212856293, [[279, 0.245173, " the", false], [6588, 0.166606, " practice", false], [2097, 0.10056, " fact", false], [4586, 0.077328, " general", false], [1657, 0.065613, " many", false], [1429, 0.044612, " most", false], [1973, 0.030774, " order", false], [264, 0.029953, " a", false], [894, 0.020458, " any", false], [847, 0.018656, " my", false]]]}, "raw_delta": -0.07933297422197129, "tuned_delta": -0.07252069641487334}, {"byte_start": 948, "byte_end": 953, "display": {"text": " they", "kind": "normal"}, "is_word": true, "word_id": 158, "word_key": " they", "bytes_hex": "20 74 68 65 79", "compression": {"rwkv": "3.63% 3.63% 3.63% 3.63% 3.63%", "qwen": "3.45% 3.45% 3.45% 3.45% 3.45%"}, "model_tokens": {"rwkv": [[32232, " they", "normal", 0.36335521936416626]], "qwen": [[807, " they", "normal", 0.3845542073249817]]}, "loss": {"rwkv": 3.634915239739771, "qwen": 3.4468526409779168}, "topk": {"rwkv": [32232, 1, 0.36335521936416626, [[32232, 0.363355, " they", false], [45, 0.128599, ",", false], [22590, 0.101473, " the", false], [4601, 0.067015, " it", false], [39934, 0.029982, " there", false], [32234, 0.028763, " this", false], [31461, 0.018323, " most", false], [4858, 0.01745, " we", false], [63843, 0.016983, " researchers", false], [32227, 0.011772, " that", false]]], "qwen": [807, 1, 0.3845542073249817, [[807, 0.384554, " they", false], [11, 0.197659, ",", false], [279, 0.096124, " the", false], [432, 0.056831, " it", false], [1052, 0.02848, " there", false], [419, 0.017806, " this", false], [825, 0.012207, " one", false], [1429, 0.008678, " most", false], [11811, 0.008366, " researchers", false], [582, 0.007938, " we", false]]]}, "raw_delta": 0.01042840480804444, "tuned_delta": 0.017240682615142385}, {"byte_start": 953, "byte_end": 958, "display": {"text": " tend", "kind": "normal"}, "is_word": true, "word_id": 159, "word_key": " tend", "bytes_hex": "20 74 65 6e 64", "compression": {"rwkv": "11.16% 11.16% 11.16% 11.16% 11.16%", "qwen": "9.85% 9.85% 9.85% 9.85% 9.85%"}, "model_tokens": {"rwkv": [[32216, " tend", "normal", 0.04572746902704239]], "qwen": [[8376, " tend", "normal", 0.06506852805614471]]}, "loss": {"rwkv": 11.158344456875575, "qwen": 9.854740040906607}, "topk": {"rwkv": [32216, 5, 0.04572746902704239, [[4491, 0.270266, " do", false], [31059, 0.194253, " have", false], [39171, 0.153615, " often", false], [21286, 0.085817, " are", false], [32216, 0.045727, " tend", false], [31967, 0.019321, " seem", false], [21413, 0.018898, " can", false], [53248, 0.016968, " usually", false], [60523, 0.016233, " sometimes", false], [45145, 0.01229, " almost", false]]], "qwen": [8376, 3, 0.06506852805614471, [[653, 0.352733, " do", false], [3545, 0.258844, " often", false], [8376, 0.065069, " tend", false], [614, 0.053291, " have", false], [525, 0.047206, " are", false], [646, 0.021988, " can", false], [686, 0.017243, " will", false], [5990, 0.016247, " usually", false], [13814, 0.015728, " frequently", false], [4558, 0.013145, " almost", false]]]}, "raw_delta": 0.07228717803955076, "tuned_delta": 0.07909945584664871}, {"byte_start": 958, "byte_end": 961, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 160, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "0.12% 0.12% 0.12%", "qwen": "0.10% 0.10% 0.10%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.9806534647941589]], "qwen": [[311, " to", "normal", 0.9841543436050415]]}, "loss": {"rwkv": 0.11667303034532936, "qwen": 0.09601448775983339}, "topk": {"rwkv": [4811, 1, 0.9806534647941589, [[4811, 0.980653, " to", false], [22187, 0.011661, " not", false], [4491, 0.000946, " do", false], [47585, 0.000929, " toward", false], [53169, 0.000841, " towards", false], [4596, 0.000433, " in", false], [22418, 0.000303, " run", false], [21700, 0.0003, " for", false], [45, 0.000287, ",", false], [32227, 0.000162, " that", false]]], "qwen": [311, 1, 0.9841543436050415, [[311, 0.984154, " to", false], [537, 0.008721, " not", false], [653, 0.002119, " do", false], [6974, 0.000615, " towards", false], [8841, 0.000587, " toward", false], [11, 0.000378, ",", false], [320, 0.000358, " (", false], [304, 0.000216, " in", false], [13, 0.000197, ".", false], [2238, 0.000171, " too", false]]]}, "raw_delta": 0.0011455528438091278, "tuned_delta": 0.007957830650907074}, {"byte_start": 961, "byte_end": 962, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "26.91%", "qwen": "33.55%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.22228087484836578]], "qwen": [[13, ".", "normal", 0.15557077527046204]]}, "loss": {"rwkv": 26.909643829081247, "qwen": 33.55446226805783}, "topk": {"rwkv": [47, 1, 0.22228087484836578, [[47, 0.222281, ".", false], [4491, 0.173883, " do", false], [4435, 0.120531, " be", false], [22418, 0.069586, " run", false], [45, 0.050464, ",", false], [4559, 0.024905, " go", false], [51255, 0.019325, " compete", false], [55824, 0.019009, " conflict", false], [59, 0.018794, ":", false], [51233, 0.013472, " collide", false]]], "qwen": [13, 2, 0.15557077527046204, [[653, 0.266169, " do", false], [13, 0.155571, ".", false], [624, 0.094433, ".\n", false], [11, 0.067669, ",", false], [387, 0.065015, " be", false], [1598, 0.059061, " run", false], [12055, 0.045034, " conflict", false], [20259, 0.038881, " compete", false], [26, 0.013864, ";", false], [1576, 0.011937, " because", false]]]}, "raw_delta": -0.36846697330474854, "tuned_delta": -0.3616546954976506}, {"byte_start": 962, "byte_end": 967, "display": {"text": " Time", "kind": "normal"}, "is_word": true, "word_id": 161, "word_key": " time", "bytes_hex": "20 54 69 6d 65", "compression": {"rwkv": "30.88% 30.88% 30.88% 30.88% 30.88%", "qwen": "31.47% 31.47% 31.47% 31.47% 31.47%"}, "model_tokens": {"rwkv": [[29904, " Time", "normal", 0.00019742344738915563]], "qwen": [[4120, " Time", "normal", 0.00016235960356425494]]}, "loss": {"rwkv": 30.88269071902937, "qwen": 31.471297901954316}, "topk": {"rwkv": [29904, 213, 0.00019742344738915563, [[11, 0.383019, "\n", false], [261, 0.172982, "\n\n", false], [20996, 0.067902, " The", false], [3913, 0.02087, " In", false], [19907, 0.019633, " For", false], [29894, 0.018205, " This", false], [3918, 0.017027, " It", false], [3908, 0.01238, " If", false], [300, 0.011534, " A", false], [0, 0.010076, "[0]", false]]], "qwen": [4120, 388, 0.00016235960356425494, [[576, 0.118124, " The", false], [758, 0.058879, " In", false], [1752, 0.055984, " For", false], [1096, 0.052615, " This", false], [1084, 0.03124, " It", false], [362, 0.02583, " A", false], [2619, 0.022786, " There", false], [1634, 0.021489, " As", false], [1416, 0.021447, " If", false], [151643, 0.019918, "\u003c|endoftext|\u003e", false]]]}, "raw_delta": -0.03263931274414067, "tuned_delta": -0.025827034937042723}, {"byte_start": 967, "byte_end": 973, "display": {"text": " spent", "kind": "normal"}, "is_word": true, "word_id": 162, "word_key": " spent", "bytes_hex": "20 73 70 65 6e 74", "compression": {"rwkv": "8.41% 8.41% 8.41% 8.41% 8.41% 8.41%", "qwen": "10.61% 10.61% 10.61% 10.61% 10.61% 10.61%"}, "model_tokens": {"rwkv": [[39762, " spent", "normal", 0.06252438575029373]], "qwen": [[7391, " spent", "normal", 0.02930413745343685]]}, "loss": {"rwkv": 8.406328526013164, "qwen": 10.609899235855616}, "topk": {"rwkv": [39762, 4, 0.06252438575029373, [[21265, 0.300426, " and", false], [32475, 0.167387, " will", false], [4600, 0.110458, " is", false], [39762, 0.062524, " spent", false], [4811, 0.037565, " to", false], [46, 0.030385, "-", false], [62307, 0.026217, " permitting", false], [45, 0.020276, ",", false], [21800, 0.017755, " has", false], [21700, 0.012419, " for", false]]], "qwen": [7391, 5, 0.02930413745343685, [[323, 0.213747, " and", false], [374, 0.143557, " is", false], [311, 0.109366, " to", false], [11, 0.035483, ",", false], [7391, 0.029304, " spent", false], [686, 0.027268, " will", false], [369, 0.02348, " for", false], [1283, 0.022726, " after", false], [702, 0.021844, " has", false], [16982, 0.011835, " constraints", false]]]}, "raw_delta": -0.12219190597534184, "tuned_delta": -0.11537962816824389}, {"byte_start": 973, "byte_end": 976, "display": {"text": " on", "kind": "normal"}, "is_word": true, "word_id": 163, "word_key": " on", "bytes_hex": "20 6f 6e", "compression": {"rwkv": "9.06% 9.06% 9.06%", "qwen": "7.70% 7.70% 7.70%"}, "model_tokens": {"rwkv": [[4712, " on", "normal", 0.2206753045320511]], "qwen": [[389, " on", "normal", 0.2779558300971985]]}, "loss": {"rwkv": 9.063806734751624, "qwen": 7.696135485002118}, "topk": {"rwkv": [4712, 1, 0.2206753045320511, [[4712, 0.220675, " on", false], [4596, 0.052466, " in", false], [47629, 0.041477, " trying", false], [38888, 0.040557, " lever", false], [61857, 0.034945, " developing", false], [52834, 0.028379, " seeking", false], [59832, 0.022843, " improving", false], [56537, 0.020925, " learning", false], [62271, 0.018373, " optimizing", false], [60463, 0.016678, " searching", false]]], "qwen": [389, 1, 0.2779558300971985, [[389, 0.277956, " on", false], [304, 0.045176, " in", false], [6832, 0.044051, " learning", false], [11220, 0.035835, " developing", false], [18392, 0.032943, " improving", false], [4460, 0.031147, " trying", false], [76482, 0.024253, " leveraging", false], [10887, 0.023543, " seeking", false], [4752, 0.023109, " building", false], [553, 0.017318, " by", false]]]}, "raw_delta": 0.07583979765574134, "tuned_delta": 0.08265207546283929}, {"byte_start": 976, "byte_end": 980, "display": {"text": " one", "kind": "normal"}, "is_word": true, "word_id": 164, "word_key": " one", "bytes_hex": "20 6f 6e 65", "compression": {"rwkv": "20.85% 20.85% 20.85% 20.85%", "qwen": "16.67% 16.67% 16.67% 16.67%"}, "model_tokens": {"rwkv": [[22226, " one", "normal", 0.009733147919178009]], "qwen": [[825, " one", "normal", 0.024803495034575462]]}, "loss": {"rwkv": 20.851451762848296, "qwen": 16.666602218969846}, "topk": {"rwkv": [22226, 13, 0.009733147919178009, [[22590, 0.107259, " the", false], [38720, 0.068932, " human", false], [332, 0.041225, " a", false], [38888, 0.033646, " lever", false], [57103, 0.032885, " research", false], [59832, 0.024371, " improving", false], [45775, 0.02023, " domain", false], [45490, 0.016929, " clever", false], [61857, 0.015083, " developing", false], [55666, 0.010404, " building", false]]], "qwen": [825, 6, 0.024803495034575462, [[76482, 0.065829, " leveraging", false], [279, 0.063352, " the", false], [3738, 0.052422, " human", false], [264, 0.041404, " a", false], [4586, 0.038453, " general", false], [825, 0.024803, " one", false], [7947, 0.024309, " domain", false], [3412, 0.023295, " research", false], [6540, 0.019125, " knowledge", false], [11220, 0.01882, " developing", false]]]}, "raw_delta": 0.2320573329925537, "tuned_delta": 0.23886961079965166}, {"byte_start": 980, "byte_end": 983, "display": {"text": " is", "kind": "normal"}, "is_word": true, "word_id": 165, "word_key": " is", "bytes_hex": "20 69 73", "compression": {"rwkv": "11.41% 11.41% 11.41%", "qwen": "11.59% 11.59% 11.59%"}, "model_tokens": {"rwkv": [[4600, " is", "normal", 0.14982688426971436]], "qwen": [[374, " is", "normal", 0.14543162286281586]]}, "loss": {"rwkv": 11.411943194531839, "qwen": 11.589945954769224}, "topk": {"rwkv": [4600, 1, 0.14982688426971436, [[4600, 0.149827, " is", false], [21413, 0.054028, " can", false], [32475, 0.0332, " will", false], [39914, 0.030053, " tends", false], [4715, 0.026429, " or", false], [30659, 0.026088, " does", false], [4424, 0.022526, " at", false], [39941, 0.02052, " thing", false], [22074, 0.019107, " may", false], [38875, 0.018756, " leads", false]]], "qwen": [374, 1, 0.14543162286281586, [[374, 0.145432, " is", false], [3545, 0.093406, " often", false], [646, 0.040591, " can", false], [27236, 0.036611, " tends", false], [1231, 0.035747, " may", false], [686, 0.033684, " will", false], [315, 0.02875, " of", false], [476, 0.026719, " or", false], [5990, 0.022938, " usually", false], [11, 0.021252, ",", false]]]}, "raw_delta": -0.0098705689112345, "tuned_delta": -0.003058291104136554}, {"byte_start": 983, "byte_end": 988, "display": {"text": " time", "kind": "normal"}, "is_word": true, "word_id": 166, "word_key": " time", "bytes_hex": "20 74 69 6d 65", "compression": {"rwkv": "2.73% 2.73% 2.73% 2.73% 2.73%", "qwen": "5.03% 5.03% 5.03% 5.03% 5.03%"}, "model_tokens": {"rwkv": [[32251, " time", "normal", 0.46703463792800903]], "qwen": [[882, " time", "normal", 0.24824698269367218]]}, "loss": {"rwkv": 2.7332308391841686, "qwen": 5.025379923483627}, "topk": {"rwkv": [32251, 1, 0.46703463792800903, [[32251, 0.467035, " time", false], [62110, 0.107085, " inevitably", false], [332, 0.036899, " a", false], [39762, 0.029281, " spent", false], [39171, 0.025269, " often", false], [47768, 0.023742, " wasted", false], [46439, 0.017648, " likely", false], [63717, 0.017257, " necessarily", false], [31334, 0.01362, " lost", false], [53248, 0.012571, " usually", false]]], "qwen": [882, 1, 0.24824698269367218, [[882, 0.248247, " time", false], [3545, 0.205592, " often", false], [38828, 0.053793, " wasted", false], [5558, 0.037867, " lost", false], [4363, 0.029061, " likely", false], [5990, 0.02739, " usually", false], [7391, 0.022486, " spent", false], [264, 0.019575, " a", false], [518, 0.017265, " at", false], [537, 0.015288, " not", false]]]}, "raw_delta": -0.12710373401641845, "tuned_delta": -0.1202914562093205}, {"byte_start": 988, "byte_end": 992, "display": {"text": " not", "kind": "normal"}, "is_word": true, "word_id": 167, "word_key": " not", "bytes_hex": "20 6e 6f 74", "compression": {"rwkv": "3.03% 3.03% 3.03% 3.03%", "qwen": "2.82% 2.82% 2.82% 2.82%"}, "model_tokens": {"rwkv": [[22187, " not", "normal", 0.5121175646781921]], "qwen": [[537, " not", "normal", 0.5350255966186523]]}, "loss": {"rwkv": 3.029096033116476, "qwen": 2.819750688799506}, "topk": {"rwkv": [22187, 1, 0.5121175646781921, [[22187, 0.512118, " not", false], [39762, 0.14367, " spent", false], [31334, 0.11393, " lost", false], [47768, 0.061727, " wasted", false], [32227, 0.050621, " that", false], [30211, 0.031252, " away", false], [39887, 0.021947, " taken", false], [31277, 0.005023, " less", false], [63954, 0.004297, " unavailable", false], [57339, 0.002407, " subtract", false]]], "qwen": [537, 1, 0.5350255966186523, [[537, 0.535026, " not", false], [429, 0.126795, " that", false], [7391, 0.11351, " spent", false], [5558, 0.090603, " lost", false], [38828, 0.022851, " wasted", false], [4429, 0.022105, " taken", false], [13628, 0.007204, " missed", false], [2115, 0.005417, " left", false], [2686, 0.004425, " less", false], [369, 0.002363, " for", false]]]}, "raw_delta": 0.01160857081413269, "tuned_delta": 0.018420848621230636}, {"byte_start": 992, "byte_end": 998, "display": {"text": " spent", "kind": "normal"}, "is_word": true, "word_id": 168, "word_key": " spent", "bytes_hex": "20 73 70 65 6e 74", "compression": {"rwkv": "0.10% 0.10% 0.10% 0.10% 0.10% 0.10%", "qwen": "0.38% 0.38% 0.38% 0.38% 0.38% 0.38%"}, "model_tokens": {"rwkv": [[39762, " spent", "normal", 0.9668729305267334]], "qwen": [[7391, " spent", "normal", 0.8816502690315247]]}, "loss": {"rwkv": 0.10126338482802172, "qwen": 0.37858661859731446}, "topk": {"rwkv": [39762, 1, 0.9668729305267334, [[39762, 0.966873, " spent", false], [59206, 0.014805, " available", false], [4712, 0.003022, " on", false], [51459, 0.002833, " devoted", false], [56495, 0.00261, " invested", false], [32354, 0.001032, " used", false], [39761, 0.00096, " spend", false], [57278, 0.000623, " spending", false], [38594, 0.000493, " given", false], [22339, 0.000439, " put", false]]], "qwen": [7391, 1, 0.8816502690315247, [[7391, 0.88165, " spent", false], [2500, 0.076201, " available", false], [1660, 0.00788, " being", false], [27991, 0.003958, " invested", false], [8329, 0.002552, " spend", false], [4429, 0.00148, " taken", false], [38828, 0.001363, " wasted", false], [2115, 0.001313, " left", false], [18163, 0.001256, " gained", false], [28229, 0.001159, " devoted", false]]]}, "raw_delta": -0.015378065407276154, "tuned_delta": -0.008565787600178208}, {"byte_start": 998, "byte_end": 1001, "display": {"text": " on", "kind": "normal"}, "is_word": true, "word_id": 169, "word_key": " on", "bytes_hex": "20 6f 6e", "compression": {"rwkv": "0.17% 0.17% 0.17%", "qwen": "0.26% 0.26% 0.26%"}, "model_tokens": {"rwkv": [[4712, " on", "normal", 0.9720544219017029]], "qwen": [[389, " on", "normal", 0.9569395780563354]]}, "loss": {"rwkv": 0.17023989333406547, "qwen": 0.2645843802881575}, "topk": {"rwkv": [4712, 1, 0.9720544219017029, [[4712, 0.972054, " on", false], [22590, 0.00196, " the", false], [38888, 0.001756, " lever", false], [4596, 0.001621, " in", false], [38279, 0.001575, " doing", false], [61857, 0.001315, " developing", false], [59608, 0.001191, " elsewhere", false], [32487, 0.000941, " with", false], [59832, 0.000862, " improving", false], [59686, 0.000687, " exploring", false]]], "qwen": [389, 1, 0.9569395780563354, [[389, 0.95694, " on", false], [304, 0.005158, " in", false], [3730, 0.00416, " doing", false], [76482, 0.001945, " leveraging", false], [3238, 0.001614, " working", false], [18392, 0.001541, " improving", false], [33018, 0.001485, " pursuing", false], [279, 0.001283, " the", false], [17920, 0.001109, " elsewhere", false], [448, 0.000944, " with", false]]]}, "raw_delta": -0.005231569210688274, "tuned_delta": 0.0015807085964096726}, {"byte_start": 1001, "byte_end": 1005, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 170, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "0.12% 0.12% 0.12% 0.12%", "qwen": "0.17% 0.17% 0.17% 0.17%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.9732060432434082]], "qwen": [[279, " the", "normal", 0.9620660543441772]]}, "loss": {"rwkv": 0.12217647517293924, "qwen": 0.17435043544470694}, "topk": {"rwkv": [22590, 1, 0.9732060432434082, [[22590, 0.973206, " the", false], [50919, 0.012612, " another", false], [39193, 0.001309, " other", false], [59832, 0.001289, " improving", false], [38888, 0.00087, " lever", false], [332, 0.000539, " a", false], [30322, 0.000436, " both", false], [31458, 0.000396, " more", false], [45833, 0.000367, " either", false], [60522, 0.000298, " something", false]]], "qwen": [279, 1, 0.9620660543441772, [[279, 0.962066, " the", false], [2441, 0.015389, " another", false], [1008, 0.00288, " other", false], [34447, 0.001726, " computation", false], [2494, 0.001625, " something", false], [264, 0.00138, " a", false], [76482, 0.001128, " leveraging", false], [2176, 0.001003, " both", false], [2987, 0.000812, " either", false], [18392, 0.000755, " improving", false]]]}, "raw_delta": -0.00289313867688179, "tuned_delta": 0.003919139130216157}, {"byte_start": 1005, "byte_end": 1011, "display": {"text": " other", "kind": "normal"}, "is_word": true, "word_id": 171, "word_key": " other", "bytes_hex": "20 6f 74 68 65 72", "compression": {"rwkv": "0.02% 0.02% 0.02% 0.02% 0.02% 0.02%", "qwen": "0.02% 0.02% 0.02% 0.02% 0.02% 0.02%"}, "model_tokens": {"rwkv": [[39193, " other", "normal", 0.994212806224823]], "qwen": [[1008, " other", "normal", 0.994239330291748]]}, "loss": {"rwkv": 0.017427575287431274, "qwen": 0.017364419809424003}, "topk": {"rwkv": [39193, 1, 0.994212806224823, [[39193, 0.994213, " other", false], [31515, 0.001035, " next", false], [46726, 0.000568, " others", false], [45301, 0.000423, " better", false], [46405, 0.000405, " latter", false], [47205, 0.00036, " second", false], [31458, 0.000343, " more", false], [45961, 0.000133, " faster", false], [31323, 0.000117, " long", false], [46470, 8.1e-05, " longer", false]]], "qwen": [1008, 1, 0.994239330291748, [[1008, 0.994239, " other", false], [2086, 0.000546, " second", false], [2664, 0.000468, " better", false], [1790, 0.000465, " next", false], [15271, 0.000428, " latter", false], [3800, 0.000427, " others", false], [803, 0.000415, " more", false], [825, 0.000179, " one", false], [279, 0.00012, " the", false], [10555, 8e-05, " alternative", false]]]}, "raw_delta": 3.5020833214124405e-06, "tuned_delta": 0.006815779890419359}, {"byte_start": 1011, "byte_end": 1012, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "7.47%", "qwen": "22.39%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.6634242534637451]], "qwen": [[13, ".", "normal", 0.28900769352912903]]}, "loss": {"rwkv": 7.467073942101079, "qwen": 22.38525108738749}, "topk": {"rwkv": [47, 1, 0.6634242534637451, [[47, 0.663424, ".", false], [45, 0.265227, ",", false], [60, 0.017391, ";", false], [21265, 0.014958, " and", false], [275, 0.010842, " (", false], [59, 0.003363, ":", false], [9816, 0.002015, "—", false], [4596, 0.001724, " in", false], [280, 0.001724, " -", false], [34, 0.001508, "!", false]]], "qwen": [13, 2, 0.28900769352912903, [[624, 0.336423, ".\n", false], [13, 0.289008, ".", false], [11, 0.257568, ",", false], [26, 0.023685, ";", false], [323, 0.020717, " and", false], [382, 0.016234, ".\n\n", false], [320, 0.014207, " (", false], [25, 0.006255, ":", false], [481, 0.002701, " -", false], [1959, 0.002082, " —", false]]]}, "raw_delta": -0.8272393941879272, "tuned_delta": -0.8204271163808293}, {"byte_start": 1012, "byte_end": 1018, "display": {"text": " There", "kind": "normal"}, "is_word": true, "word_id": 172, "word_key": " there", "bytes_hex": "20 54 68 65 72 65", "compression": {"rwkv": "14.18% 14.18% 14.18% 14.18% 14.18% 14.18%", "qwen": "11.67% 11.67% 11.67% 11.67% 11.67% 11.67%"}, "model_tokens": {"rwkv": [[37451, " There", "normal", 0.009247321635484695]], "qwen": [[2619, " There", "normal", 0.020563559606671333]]}, "loss": {"rwkv": 14.182744217072491, "qwen": 11.674512690575982}, "topk": {"rwkv": [37451, 12, 0.009247321635484695, [[11, 0.371126, "\n", false], [261, 0.143507, "\n\n", false], [20996, 0.066017, " The", false], [29894, 0.030309, " This", false], [3913, 0.022195, " In", false], [19555, 0.018189, " But", false], [3918, 0.017084, " It", false], [19417, 0.016465, " And", false], [3908, 0.01514, " If", false], [3641, 0.009634, " As", false]]], "qwen": [2619, 11, 0.020563559606671333, [[576, 0.113834, " The", false], [1096, 0.077977, " This", false], [758, 0.055176, " In", false], [1084, 0.037365, " It", false], [151643, 0.031481, "\u003c|endoftext|\u003e", false], [1597, 0.026793, " And", false], [1752, 0.025339, " For", false], [362, 0.02348, " A", false], [1634, 0.023457, " As", false], [1416, 0.020591, " If", false]]]}, "raw_delta": 0.13908588886260986, "tuned_delta": 0.1458981666697078}, {"byte_start": 1018, "byte_end": 1022, "display": {"text": " are", "kind": "normal"}, "is_word": true, "word_id": 173, "word_key": " are", "bytes_hex": "20 61 72 65", "compression": {"rwkv": "5.95% 5.95% 5.95% 5.95%", "qwen": "4.50% 4.50% 4.50% 4.50%"}, "model_tokens": {"rwkv": [[21286, " are", "normal", 0.2637927234172821]], "qwen": [[525, " are", "normal", 0.36894965171813965]]}, "loss": {"rwkv": 5.952525925542842, "qwen": 4.495325255191915}, "topk": {"rwkv": [21286, 2, 0.2637927234172821, [[4600, 0.484624, " is", false], [21286, 0.263793, " are", false], [460, 0.11782, "'s", false], [32475, 0.023085, " will", false], [31059, 0.018096, " have", false], [21800, 0.017062, " has", false], [22074, 0.012414, " may", false], [22748, 0.006336, " was", false], [21413, 0.00609, " can", false], [21896, 0.003842, " isn", false]]], "qwen": [525, 2, 0.36894965171813965, [[374, 0.456053, " is", false], [525, 0.36895, " are", false], [594, 0.058748, "'s", false], [614, 0.019578, " have", false], [702, 0.015429, " has", false], [686, 0.010607, " will", false], [572, 0.008044, " was", false], [1231, 0.007163, " may", false], [646, 0.00578, " can", false], [258, 0.003887, "in", false]]]}, "raw_delta": 0.08080436289310455, "tuned_delta": 0.0876166407002025}, {"byte_start": 1022, "byte_end": 1036, "display": {"text": " psychological", "kind": "normal"}, "is_word": true, "word_id": 174, "word_key": " psychological", "bytes_hex": "20 70 73 79 63 68 6f 6c 6f 67 69 63 61 6c", "compression": {"rwkv": "14.25% 14.25% 14.25% 14.25% 14.25% 14.25% 14.25% 14.25% 14.25% 14.25% 14.25% 14.25% 14.25% 14.25%", "qwen": "13.97% 13.97% 13.97% 13.97% 13.97% 13.97% 13.97% 13.97% 13.97% 13.97% 13.97% 13.97% 13.97% 13.97%"}, "model_tokens": {"rwkv": [[64997, " psychological", "normal", 1.5554480341961607e-05]], "qwen": [[23187, " psychological", "normal", 1.9427410734351724e-05]]}, "loss": {"rwkv": 14.249833830209065, "qwen": 13.97459525266324}, "topk": {"rwkv": [64997, 1296, 1.5554480341961607e-05, [[31370, 0.119869, " many", false], [332, 0.068546, " a", false], [32074, 0.063486, " some", false], [61963, 0.057093, " exceptions", false], [22638, 0.042428, " two", false], [45, 0.032203, ",", false], [46844, 0.024617, " plenty", false], [39193, 0.023725, " other", false], [4706, 0.020746, " of", false], [4692, 0.020676, " no", false]]], "qwen": [23187, 1076, 1.9427410734351724e-05, [[1657, 0.127512, " many", false], [1378, 0.086523, " two", false], [264, 0.079205, " a", false], [1045, 0.068575, " some", false], [19585, 0.064439, " exceptions", false], [11, 0.03917, ",", false], [5510, 0.029527, " ways", false], [1083, 0.024977, " also", false], [1008, 0.022655, " other", false], [902, 0.021747, " no", false]]]}, "raw_delta": 0.015262467520577583, "tuned_delta": 0.02207474532767553}, {"byte_start": 1036, "byte_end": 1048, "display": {"text": " commitments", "kind": "normal"}, "is_word": true, "word_id": 175, "word_key": " commitments", "bytes_hex": "20 63 6f 6d 6d 69 74 6d 65 6e 74 73", "compression": {"rwkv": "12.21% 12.21% 12.21% 12.21% 12.21% 12.21% 12.21% 12.21% 12.21% 12.21% 12.21% 12.21%", "qwen": "14.92% 14.92% 14.92% 14.92% 14.92% 14.92% 14.92% 14.92% 14.92% 14.92% 14.92% 14.92%"}, "model_tokens": {"rwkv": [[63351, " commitments", "normal", 0.00029373785946518183]], "qwen": [[41256, " commitments", "normal", 4.8848836740944535e-05]]}, "loss": {"rwkv": 12.210309590857108, "qwen": 14.918037409382585}, "topk": {"rwkv": [63351, 101, 0.00029373785946518183, [[52654, 0.277342, " reasons", false], [21265, 0.234882, " and", false], [55600, 0.054081, " barriers", false], [45, 0.047591, ",", false], [51703, 0.036195, " factors", false], [45304, 0.032646, " biases", false], [2030, 0.024515, "ly", false], [62202, 0.018324, " mechanisms", false], [38124, 0.015978, " costs", false], [51565, 0.014705, " effects", false]]], "qwen": [41256, 380, 4.8848836740944535e-05, [[7966, 0.364535, " reasons", false], [323, 0.129478, " and", false], [29640, 0.075673, " barriers", false], [9363, 0.072835, " factors", false], [40841, 0.033968, " explanations", false], [11, 0.032794, ",", false], [49083, 0.028542, " biases", false], [13566, 0.018777, " aspects", false], [6239, 0.015736, " effects", false], [13388, 0.012311, " limits", false]]]}, "raw_delta": -0.15014831225077305, "tuned_delta": -0.1433360344436751}, {"byte_start": 1048, "byte_end": 1051, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 176, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "7.61% 7.61% 7.61%", "qwen": "5.65% 5.65% 5.65%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.2809022068977356]], "qwen": [[311, " to", "normal", 0.3906971216201782]]}, "loss": {"rwkv": 7.607962129687892, "qwen": 5.649489270047869}, "topk": {"rwkv": [4811, 2, 0.2809022068977356, [[32227, 0.298614, " that", false], [4811, 0.280902, " to", false], [21265, 0.071769, " and", false], [45, 0.050368, ",", false], [56500, 0.043278, " involved", false], [4596, 0.024711, " in", false], [4424, 0.017448, " at", false], [4712, 0.015997, " on", false], [4423, 0.015291, " as", false], [4706, 0.011158, " of", false]]], "qwen": [311, 1, 0.3906971216201782, [[311, 0.390697, " to", false], [429, 0.278774, " that", false], [323, 0.05839, " and", false], [11, 0.050985, ",", false], [304, 0.031427, " in", false], [320, 0.016949, " (", false], [518, 0.014043, " at", false], [389, 0.013031, " on", false], [1865, 0.012849, " made", false], [6398, 0.010115, " involved", false]]]}, "raw_delta": 0.10860079526901245, "tuned_delta": 0.1154130730761104}, {"byte_start": 1051, "byte_end": 1062, "display": {"text": " investment", "kind": "normal"}, "is_word": true, "word_id": 177, "word_key": " investment", "bytes_hex": "20 69 6e 76 65 73 74 6d 65 6e 74", "compression": {"rwkv": "13.32% 13.32% 13.32% 13.32% 13.32% 13.32% 13.32% 13.32% 13.32% 13.32% 13.32%", "qwen": "15.02% 15.02% 15.02% 15.02% 15.02% 15.02% 15.02% 15.02% 15.02% 15.02% 15.02%"}, "model_tokens": {"rwkv": [[62157, " investment", "normal", 0.00030096014961600304]], "qwen": [[9162, " investment", "normal", 0.00010466409003129229]]}, "loss": {"rwkv": 13.32033773548048, "qwen": 15.024939089071282}, "topk": {"rwkv": [62157, 244, 0.00030096014961600304, [[22590, 0.135269, " the", false], [30322, 0.086819, " both", false], [22226, 0.056053, " one", false], [38720, 0.045141, " human", false], [30719, 0.038305, " each", false], [39936, 0.031908, " these", false], [332, 0.02992, " a", false], [32234, 0.021508, " this", false], [38279, 0.019149, " doing", false], [45833, 0.016751, " either", false]]], "qwen": [9162, 575, 0.00010466409003129229, [[279, 0.175419, " the", false], [3738, 0.05676, " human", false], [825, 0.047213, " one", false], [264, 0.036088, " a", false], [3953, 0.027353, " particular", false], [2176, 0.026776, " both", false], [387, 0.023164, " be", false], [32064, 0.020483, " leverage", false], [3654, 0.019666, " certain", false], [2987, 0.01964, " either", false]]]}, "raw_delta": -0.0945231697776101, "tuned_delta": -0.08771089197051216}, {"byte_start": 1062, "byte_end": 1065, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 178, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "3.50% 3.50% 3.50%", "qwen": "3.51% 3.51% 3.51%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.5614700317382812]], "qwen": [[304, " in", "normal", 0.5578750967979431]]}, "loss": {"rwkv": 3.4987233250725183, "qwen": 3.508274453247622}, "topk": {"rwkv": [4596, 1, 0.5614700317382812, [[4596, 0.56147, " in", false], [4706, 0.051533, " of", false], [32227, 0.043854, " that", false], [56832, 0.037537, " patterns", false], [45, 0.035996, ",", false], [21265, 0.035165, " and", false], [62581, 0.022194, " strategies", false], [4712, 0.011891, " on", false], [59451, 0.011315, " decisions", false], [31162, 0.009878, " into", false]]], "qwen": [304, 1, 0.5578750967979431, [[304, 0.557875, " in", false], [429, 0.184454, " that", false], [11, 0.043663, ",", false], [315, 0.028122, " of", false], [323, 0.020908, " and", false], [14830, 0.016038, " strategies", false], [320, 0.009569, " (", false], [389, 0.007911, " on", false], [1865, 0.007348, " made", false], [311, 0.004942, " to", false]]]}, "raw_delta": -0.0005296270052592145, "tuned_delta": 0.006282650801838732}, {"byte_start": 1065, "byte_end": 1069, "display": {"text": " one", "kind": "normal"}, "is_word": true, "word_id": 179, "word_key": " one", "bytes_hex": "20 6f 6e 65", "compression": {"rwkv": "7.68% 7.68% 7.68% 7.68%", "qwen": "6.33% 6.33% 6.33% 6.33%"}, "model_tokens": {"rwkv": [[22226, " one", "normal", 0.18407844007015228]], "qwen": [[825, " one", "normal", 0.24557806551456451]]}, "loss": {"rwkv": 7.678406223481298, "qwen": 6.330457263368079}, "topk": {"rwkv": [22226, 1, 0.18407844007015228, [[22226, 0.184078, " one", false], [22590, 0.176663, " the", false], [38720, 0.072268, " human", false], [332, 0.044082, " a", false], [45833, 0.037982, " either", false], [57103, 0.031592, " research", false], [59943, 0.025865, " knowledge", false], [30322, 0.022138, " both", false], [39675, 0.02004, " short", false], [45775, 0.019728, " domain", false]]], "qwen": [825, 1, 0.24557806551456451, [[825, 0.245578, " one", false], [3738, 0.138559, " human", false], [279, 0.09495, " the", false], [2987, 0.048882, " either", false], [264, 0.036417, " a", false], [1817, 0.034237, " each", false], [3953, 0.033059, " particular", false], [6540, 0.031027, " knowledge", false], [2176, 0.030117, " both", false], [7947, 0.019244, " domain", false]]]}, "raw_delta": 0.07474616169929504, "tuned_delta": 0.081558439506393}, {"byte_start": 1069, "byte_end": 1078, "display": {"text": " approach", "kind": "normal"}, "is_word": true, "word_id": 180, "word_key": " approach", "bytes_hex": "20 61 70 70 72 6f 61 63 68", "compression": {"rwkv": "12.34% 12.34% 12.34% 12.34% 12.34% 12.34% 12.34% 12.34% 12.34%", "qwen": "9.74% 9.74% 9.74% 9.74% 9.74% 9.74% 9.74% 9.74% 9.74%"}, "model_tokens": {"rwkv": [[55532, " approach", "normal", 0.0020717489533126354]], "qwen": [[5486, " approach", "normal", 0.007759560830891132]]}, "loss": {"rwkv": 12.335543535378722, "qwen": 9.735846141263135}, "topk": {"rwkv": [55532, 32, 0.0020717489533126354, [[4715, 0.435058, " or", false], [31601, 0.133886, " over", false], [47717, 0.054148, " versus", false], [32227, 0.050833, " that", false], [47001, 0.042095, " rather", false], [45775, 0.034587, " domain", false], [30173, 0.032312, " area", false], [45, 0.020018, ",", false], [21265, 0.019722, " and", false], [59526, 0.013916, " direction", false]]], "qwen": [5486, 12, 0.007759560830891132, [[476, 0.472018, " or", false], [429, 0.140561, " that", false], [3082, 0.041787, " area", false], [11, 0.038737, ",", false], [916, 0.038003, " over", false], [315, 0.026333, " of", false], [518, 0.022409, " at", false], [323, 0.021068, " and", false], [4751, 0.020208, " rather", false], [7947, 0.008771, " domain", false]]]}, "raw_delta": 0.14415783352322054, "tuned_delta": 0.15097011133031848}, {"byte_start": 1078, "byte_end": 1081, "display": {"text": " or", "kind": "normal"}, "is_word": true, "word_id": 181, "word_key": " or", "bytes_hex": "20 6f 72", "compression": {"rwkv": "5.78% 5.78% 5.78%", "qwen": "6.65% 6.65% 6.65%"}, "model_tokens": {"rwkv": [[4715, " or", "normal", 0.3845385015010834]], "qwen": [[476, " or", "normal", 0.3309338688850403]]}, "loss": {"rwkv": 5.776415691059325, "qwen": 6.647437591430349}, "topk": {"rwkv": [4715, 1, 0.3845385015010834, [[4715, 0.384539, " or", false], [31601, 0.326132, " over", false], [47001, 0.062161, " rather", false], [32227, 0.047411, " that", false], [45, 0.035311, ",", false], [47717, 0.024547, " versus", false], [21265, 0.015737, " and", false], [4424, 0.011594, " at", false], [4811, 0.009684, " to", false], [4423, 0.008693, " as", false]]], "qwen": [476, 1, 0.3309338688850403, [[476, 0.330934, " or", false], [429, 0.311298, " that", false], [916, 0.093059, " over", false], [11, 0.073283, ",", false], [4751, 0.024069, " rather", false], [518, 0.022481, " at", false], [323, 0.018029, " and", false], [320, 0.017136, " (", false], [19041, 0.01512, " versus", false], [892, 0.009402, " which", false]]]}, "raw_delta": -0.048299709955851255, "tuned_delta": -0.041487432148753306}, {"byte_start": 1081, "byte_end": 1085, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 182, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "2.71% 2.71% 2.71% 2.71%", "qwen": "2.20% 2.20% 2.20% 2.20%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.5530426502227783]], "qwen": [[279, " the", "normal", 0.6140246987342834]]}, "loss": {"rwkv": 2.7120976110461466, "qwen": 2.198848039377469}, "topk": {"rwkv": [22590, 1, 0.5530426502227783, [[22590, 0.553043, " the", false], [50919, 0.422882, " another", false], [39193, 0.007173, " other", false], [46561, 0.001377, " method", false], [4811, 0.001187, " to", false], [332, 0.000966, " a", false], [4596, 0.000881, " in", false], [57317, 0.000701, " strategy", false], [60624, 0.000408, " technique", false], [47001, 0.000385, " rather", false]]], "qwen": [279, 1, 0.6140246987342834, [[279, 0.614025, " the", false], [2441, 0.35995, " another", false], [311, 0.006021, " to", false], [1008, 0.004131, " other", false], [304, 0.001888, " in", false], [1496, 0.00076, " even", false], [1714, 0.000687, " method", false], [14762, 0.000628, " technique", false], [264, 0.000546, " a", false], [8282, 0.000436, " strategy", false]]]}, "raw_delta": 0.02846059948205948, "tuned_delta": 0.03527287728915743}, {"byte_start": 1085, "byte_end": 1091, "display": {"text": " other", "kind": "normal"}, "is_word": true, "word_id": 183, "word_key": " other", "bytes_hex": "20 6f 74 68 65 72", "compression": {"rwkv": "0.00% 0.00% 0.00% 0.00% 0.00% 0.00%", "qwen": "0.01% 0.01% 0.01% 0.01% 0.01% 0.01%"}, "model_tokens": {"rwkv": [[39193, " other", "normal", 0.9986640214920044]], "qwen": [[1008, " other", "normal", 0.9981380701065063]]}, "loss": {"rwkv": 0.004012928520132201, "qwen": 0.0056014114668144314}, "topk": {"rwkv": [39193, 1, 0.9986640214920044, [[39193, 0.998664, " other", false], [31515, 0.000321, " next", false], [50919, 0.000249, " another", false], [46726, 0.000111, " others", false], [11, 3.2e-05, "\n", false], [22590, 2.9e-05, " the", false], [63469, 1.5e-05, " development", false], [261, 1.4e-05, "\n\n", false], [22226, 1.3e-05, " one", false], [46561, 1e-05, " method", false]]], "qwen": [1008, 1, 0.9981380701065063, [[1008, 0.998138, " other", false], [1790, 0.000309, " next", false], [2441, 0.000148, " another", false], [3800, 0.000101, " others", false], [198, 9.3e-05, "\n", false], [297, 3.4e-05, " o", false], [2086, 3.2e-05, " second", false], [320, 1.9e-05, " (", false], [279, 1.6e-05, " the", false], [1575, 1.5e-05, "other", false]]]}, "raw_delta": -8.808419806882738e-05, "tuned_delta": 0.0067241936090291195}, {"byte_start": 1091, "byte_end": 1092, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "26.21%", "qwen": "55.87%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.23775151371955872]], "qwen": [[13, ".", "normal", 0.04514032602310181]]}, "loss": {"rwkv": 26.205202891147184, "qwen": 55.86799229046926}, "topk": {"rwkv": [47, 2, 0.23775151371955872, [[45, 0.460443, ",", false], [47, 0.237752, ".", false], [32227, 0.135403, " that", false], [275, 0.023171, " (", false], [60, 0.021754, ";", false], [21265, 0.021542, " and", false], [59, 0.013131, ":", false], [4423, 0.008794, " as", false], [40186, 0.008579, " which", false], [21400, 0.007536, " but", false]]], "qwen": [13, 3, 0.04514032602310181, [[429, 0.454984, " that", false], [11, 0.318301, ",", false], [13, 0.04514, ".", false], [320, 0.032908, " (", false], [892, 0.01886, " which", false], [323, 0.018353, " and", false], [624, 0.01653, ".\n", false], [26, 0.014231, ";", false], [714, 0.009631, " but", false], [518, 0.005769, " at", false]]]}, "raw_delta": -1.6448543071746826, "tuned_delta": -1.6380420293675846}, {"byte_start": 1092, "byte_end": 1096, "display": {"text": " And", "kind": "normal"}, "is_word": true, "word_id": 184, "word_key": " and", "bytes_hex": "20 41 6e 64", "compression": {"rwkv": "15.36% 15.36% 15.36% 15.36%", "qwen": "15.35% 15.35% 15.35% 15.35%"}, "model_tokens": {"rwkv": [[19417, " And", "normal", 0.03317571058869362]], "qwen": [[1597, " And", "normal", 0.0332515574991703]]}, "loss": {"rwkv": 15.356812446962596, "qwen": 15.345106877788247}, "topk": {"rwkv": [19417, 6, 0.03317571058869362, [[11, 0.154904, "\n", false], [20996, 0.086452, " The", false], [37451, 0.084419, " There", false], [19555, 0.070547, " But", false], [261, 0.058148, "\n\n", false], [19417, 0.033176, " And", false], [3918, 0.028587, " It", false], [3913, 0.022443, " In", false], [29894, 0.018098, " This", false], [19907, 0.014312, " For", false]]], "qwen": [1597, 7, 0.0332515574991703, [[576, 0.096157, " The", false], [2619, 0.086248, " There", false], [758, 0.045308, " In", false], [1084, 0.041811, " It", false], [1988, 0.041437, " But", false], [1096, 0.038606, " This", false], [1597, 0.033252, " And", false], [1752, 0.025937, " For", false], [1205, 0.019243, " We", false], [362, 0.018521, " A", false]]]}, "raw_delta": 0.0006490945816040039, "tuned_delta": 0.007461372388701951}, {"byte_start": 1096, "byte_end": 1100, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 185, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "11.69% 11.69% 11.69% 11.69%", "qwen": "10.92% 10.92% 10.92% 10.92%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.07467221468687057]], "qwen": [[279, " the", "normal", 0.08881886303424835]]}, "loss": {"rwkv": 11.693719569705465, "qwen": 10.915593739900798}, "topk": {"rwkv": [22590, 3, 0.07467221468687057, [[39934, 0.192413, " there", false], [45, 0.120169, ",", false], [22590, 0.074672, " the", false], [4788, 0.050607, " so", false], [4601, 0.030876, " it", false], [4596, 0.028074, " in", false], [22797, 0.024982, " yet", false], [4706, 0.023448, " of", false], [30788, 0.016668, " even", false], [32234, 0.013587, " this", false]]], "qwen": [279, 3, 0.08881886303424835, [[1052, 0.102656, " there", false], [11, 0.094348, ",", false], [279, 0.088819, " the", false], [304, 0.047588, " in", false], [432, 0.04032, " it", false], [773, 0.035085, " so", false], [419, 0.03046, " this", false], [1496, 0.024501, " even", false], [421, 0.024116, " if", false], [438, 0.023613, " as", false]]]}, "raw_delta": 0.0431484580039978, "tuned_delta": 0.04996073581109575}, {"byte_start": 1100, "byte_end": 1106, "display": {"text": " human", "kind": "normal"}, "is_word": true, "word_id": 186, "word_key": " human", "bytes_hex": "20 68 75 6d 61 6e", "compression": {"rwkv": "13.81% 13.81% 13.81% 13.81% 13.81% 13.81%", "qwen": "14.69% 14.69% 14.69% 14.69% 14.69% 14.69%"}, "model_tokens": {"rwkv": [[38720, " human", "normal", 0.010223194025456905]], "qwen": [[3738, " human", "normal", 0.007529765367507935]]}, "loss": {"rwkv": 13.807042383507657, "qwen": 14.694123163902994}, "topk": {"rwkv": [38720, 10, 0.010223194025456905, [[64997, 0.019481, " psychological", false], [22638, 0.01442, " two", false], [30808, 0.014275, " fact", false], [31461, 0.012386, " most", false], [52738, 0.011637, " results", false], [30510, 0.011501, " cost", false], [57103, 0.011469, " research", false], [62157, 0.011287, " investment", false], [32251, 0.010544, " time", false], [38720, 0.010223, " human", false]]], "qwen": [3738, 22, 0.007529765367507935, [[803, 0.027121, " more", false], [1378, 0.022444, " two", false], [5021, 0.021849, " longer", false], [1850, 0.016703, " best", false], [2783, 0.014548, " cost", false], [1172, 0.01435, " only", false], [3412, 0.014166, " research", false], [2097, 0.013188, " fact", false], [7049, 0.011543, " costs", false], [1102, 0.011421, " result", false]]]}, "raw_delta": -0.049190203348795536, "tuned_delta": -0.042377925541697586}, {"byte_start": 1106, "byte_end": 1116, "display": {"text": "-knowledge", "kind": "normal"}, "is_word": true, "word_id": 187, "word_key": "-knowledge", "bytes_hex": "2d 6b 6e 6f 77 6c 65 64 67 65", "compression": {"rwkv": "72.70% 3.21% 3.21% 3.21% 3.21% 3.21% 3.21% 3.21% 3.21% 3.21%", "qwen": "70.27% 70.27% 0.00% 0.00% 0.00% 0.00% 0.00% 0.00% 0.00% 0.00%"}, "model_tokens": {"rwkv": [[46, "-", "normal", 0.017527049407362938], [58313, "knowledge", "normal", 0.20183789730072021]], "qwen": [[12646, "-k", "normal", 0.0004126753774471581], [51186, "nowledge", "normal", 0.9992349147796631]]}, "loss": {"rwkv": 10.158038325009212, "qwen": 14.05476201086571}, "topk": {"rwkv": [46, 7, 0.017527049407362938, [[59943, 0.168671, " knowledge", false], [31427, 0.049179, " mind", false], [37898, 0.0395, " brain", false], [57404, 0.02915, " tendency", false], [45775, 0.021283, " domain", false], [34889, 0.017687, "ities", false], [46, 0.017527, "-", false], [59324, 0.017209, " community", false], [32011, 0.016187, " side", false], [62418, 0.014331, " psychology", false]]], "qwen": [12646, 214, 0.0004126753774471581, [[6540, 0.142265, " knowledge", false], [8109, 0.11091, " brain", false], [3971, 0.089827, " mind", false], [8168, 0.021975, " factor", false], [2783, 0.01864, " cost", false], [49083, 0.017235, " biases", false], [30854, 0.015653, " tendency", false], [24675, 0.014819, " cognitive", false], [5726, 0.014369, " ability", false], [15470, 0.012073, " bias", false]]]}, "raw_delta": -0.2160802429018077, "tuned_delta": -0.20926796509470974}, {"byte_start": 1116, "byte_end": 1125, "display": {"text": " approach", "kind": "normal"}, "is_word": true, "word_id": 188, "word_key": " approach", "bytes_hex": "20 61 70 70 72 6f 61 63 68", "compression": {"rwkv": "2.04% 2.04% 2.04% 2.04% 2.04% 2.04% 2.04% 2.04% 2.04%", "qwen": "2.10% 2.10% 2.10% 2.10% 2.10% 2.10% 2.10% 2.10% 2.10%"}, "model_tokens": {"rwkv": [[55532, " approach", "normal", 0.35998377203941345]], "qwen": [[5486, " approach", "normal", 0.34987860918045044]]}, "loss": {"rwkv": 2.035051598476185, "qwen": 2.1042688826934364}, "topk": {"rwkv": [55532, 1, 0.35998377203941345, [[55532, 0.359984, " approach", false], [46, 0.173095, "-", false], [61590, 0.036053, " approaches", false], [38888, 0.033979, " lever", false], [56540, 0.020083, " leverage", false], [62157, 0.017658, " investment", false], [37810, 0.017458, " based", false], [52224, 0.014423, " methods", false], [39552, 0.014173, " route", false], [46561, 0.012351, " method", false]]], "qwen": [5486, 1, 0.34987860918045044, [[5486, 0.349879, " approach", false], [5980, 0.078859, "-based", false], [27505, 0.03808, " lever", false], [31405, 0.022445, "-driven", false], [3108, 0.021996, " side", false], [19827, 0.021535, " approaches", false], [3692, 0.017431, " component", false], [949, 0.016315, " part", false], [32064, 0.016224, " leverage", false], [3419, 0.011277, "-in", false]]]}, "raw_delta": -0.003838221232096359, "tuned_delta": 0.002974056575001588}, {"byte_start": 1125, "byte_end": 1131, "display": {"text": " tends", "kind": "normal"}, "is_word": true, "word_id": 189, "word_key": " tends", "bytes_hex": "20 74 65 6e 64 73", "compression": {"rwkv": "9.67% 9.67% 9.67% 9.67% 9.67% 9.67%", "qwen": "8.36% 8.36% 8.36% 8.36% 8.36% 8.36%"}, "model_tokens": {"rwkv": [[39914, " tends", "normal", 0.040529198944568634]], "qwen": [[27236, " tends", "normal", 0.061878807842731476]]}, "loss": {"rwkv": 9.674322214294481, "qwen": 8.363355794317577}, "topk": {"rwkv": [39914, 5, 0.040529198944568634, [[4600, 0.365949, " is", false], [21800, 0.121853, " has", false], [21413, 0.065631, " can", false], [45, 0.041615, ",", false], [39914, 0.040529, " tends", false], [4811, 0.027686, " to", false], [39620, 0.019351, " seems", false], [32475, 0.019217, " will", false], [22074, 0.019063, " may", false], [30659, 0.017191, " does", false]]], "qwen": [27236, 3, 0.061878807842731476, [[374, 0.292251, " is", false], [702, 0.086251, " has", false], [27236, 0.061879, " tends", false], [646, 0.058099, " can", false], [11, 0.045678, ",", false], [3545, 0.032364, " often", false], [7460, 0.022891, " requires", false], [686, 0.020688, " will", false], [311, 0.019517, " to", false], [1231, 0.018998, " may", false]]]}, "raw_delta": 0.07269541422526044, "tuned_delta": 0.07950769203235838}, {"byte_start": 1131, "byte_end": 1134, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 190, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "0.17% 0.17% 0.17%", "qwen": "0.15% 0.15% 0.15%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.9721744060516357]], "qwen": [[311, " to", "normal", 0.9761614203453064]]}, "loss": {"rwkv": 0.16950610069038416, "qwen": 0.1450348505328503}, "topk": {"rwkv": [4811, 1, 0.9721744060516357, [[4811, 0.972174, " to", false], [22187, 0.006662, " not", false], [47585, 0.004554, " toward", false], [45, 0.003081, ",", false], [53169, 0.002505, " towards", false], [31458, 0.001901, " more", false], [4596, 0.000837, " in", false], [4435, 0.000776, " be", false], [60048, 0.000554, " naturally", false], [275, 0.000543, " (", false]]], "qwen": [311, 1, 0.9761614203453064, [[311, 0.976161, " to", false], [537, 0.007941, " not", false], [11, 0.002714, ",", false], [8841, 0.001297, " toward", false], [6974, 0.001067, " towards", false], [387, 0.00085, " be", false], [803, 0.000807, " more", false], [1083, 0.00072, " also", false], [320, 0.000687, " (", false], [304, 0.000529, " in", false]]]}, "raw_delta": 0.0013569742441177368, "tuned_delta": 0.008169252051215683}, {"byte_start": 1134, "byte_end": 1145, "display": {"text": " complicate", "kind": "normal"}, "is_word": true, "word_id": 191, "word_key": " complicate", "bytes_hex": "20 63 6f 6d 70 6c 69 63 61 74 65", "compression": {"rwkv": "22.40% 22.40% 22.40% 22.40% 22.40% 22.40% 22.40% 22.40% 0.00% 0.00% 0.00%", "qwen": "35.72% 35.72% 35.72% 35.72% 35.72% 0.00% 0.00% 0.00% 0.00% 0.00% 0.00%"}, "model_tokens": {"rwkv": [[51259, " complic", "normal", 4.7833018470555544e-05], [7066, "ate", "normal", 0.9992563128471375]], "qwen": [[1367, " comp", "normal", 4.99966845382005e-05], [48795, "licate", "normal", 0.999305009841919]]}, "loss": {"rwkv": 16.293010951284803, "qwen": 16.23728544000862}, "topk": {"rwkv": [51259, 692, 4.7833018470555544e-05, [[4435, 0.406888, " be", false], [31059, 0.054153, " have", false], [32499, 0.027935, " work", false], [22770, 0.0231, " win", false], [56041, 0.020437, " dominate", false], [52724, 0.020006, " require", false], [40239, 0.019215, " yield", false], [32187, 0.019047, " take", false], [21751, 0.018426, " get", false], [52573, 0.01842, " produce", false]]], "qwen": [1367, 775, 4.99966845382005e-05, [[387, 0.36151, " be", false], [614, 0.042109, " have", false], [1373, 0.036102, " require", false], [975, 0.030456, " work", false], [633, 0.021392, " get", false], [3690, 0.017015, " fail", false], [1896, 0.015833, " take", false], [1281, 0.013949, " make", false], [5244, 0.013403, " focus", false], [7676, 0.013377, " suffer", false]]]}, "raw_delta": 0.0030900784821080206, "tuned_delta": 0.009902356289205968}, {"byte_start": 1145, "byte_end": 1153, "display": {"text": " methods", "kind": "normal"}, "is_word": true, "word_id": 192, "word_key": " methods", "bytes_hex": "20 6d 65 74 68 6f 64 73", "compression": {"rwkv": "13.45% 13.45% 13.45% 13.45% 13.45% 13.45% 13.45% 13.45%", "qwen": "18.08% 18.08% 18.08% 18.08% 18.08% 18.08% 18.08% 18.08%"}, "model_tokens": {"rwkv": [[52224, " methods", "normal", 0.002585840877145529]], "qwen": [[5413, " methods", "normal", 0.00032932707108557224]]}, "loss": {"rwkv": 13.454821914540624, "qwen": 18.075299213488297}, "topk": {"rwkv": [52224, 23, 0.002585840877145529, [[22590, 0.364631, " the", false], [47539, 0.175161, " things", false], [52201, 0.127036, " matters", false], [21265, 0.048037, " and", false], [332, 0.018183, " a", false], [47001, 0.017348, " rather", false], [3609, 0.017091, " AI", false], [57103, 0.01582, " research", false], [45, 0.01092, ",", false], [56939, 0.010376, " problems", false]]], "qwen": [5413, 156, 0.00032932707108557224, [[279, 0.495973, " the", false], [2513, 0.067816, " things", false], [323, 0.064714, " and", false], [12850, 0.032657, " matters", false], [4751, 0.024639, " rather", false], [11, 0.02087, ",", false], [3412, 0.010926, " research", false], [8129, 0.009122, " implementation", false], [264, 0.008041, " a", false], [4401, 0.005654, " development", false]]]}, "raw_delta": -0.2562136650085449, "tuned_delta": -0.24940138720144697}, {"byte_start": 1153, "byte_end": 1156, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 193, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "18.13% 18.13% 18.13%", "qwen": "22.10% 22.10% 22.10%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.04922133684158325]], "qwen": [[304, " in", "normal", 0.025293856859207153]]}, "loss": {"rwkv": 18.12761346950325, "qwen": 22.104454296729404}, "topk": {"rwkv": [4596, 5, 0.04922133684158325, [[45, 0.206047, ",", false], [32227, 0.165042, " that", false], [21265, 0.121133, " and", false], [47, 0.060437, ".", false], [4596, 0.049221, " in", false], [4811, 0.027976, " to", false], [31458, 0.027085, " more", false], [47001, 0.022692, " rather", false], [4450, 0.021479, " by", false], [4788, 0.018497, " so", false]]], "qwen": [304, 6, 0.025293856859207153, [[429, 0.390262, " that", false], [11, 0.095794, ",", false], [323, 0.070518, " and", false], [369, 0.041975, " for", false], [4751, 0.027086, " rather", false], [304, 0.025294, " in", false], [315, 0.022812, " of", false], [553, 0.022671, " by", false], [13, 0.020143, ".", false], [1576, 0.016294, " because", false]]]}, "raw_delta": -0.22052288055419922, "tuned_delta": -0.21371060274710127}, {"byte_start": 1156, "byte_end": 1161, "display": {"text": " ways", "kind": "normal"}, "is_word": true, "word_id": 194, "word_key": " ways", "bytes_hex": "20 77 61 79 73", "compression": {"rwkv": "2.65% 2.65% 2.65% 2.65% 2.65%", "qwen": "6.36% 6.36% 6.36% 6.36% 6.36%"}, "model_tokens": {"rwkv": [[32448, " ways", "normal", 0.48245781660079956]], "qwen": [[5510, " ways", "normal", 0.17169059813022614]]}, "loss": {"rwkv": 2.648697926632081, "qwen": 6.355292525555081}, "topk": {"rwkv": [32448, 1, 0.48245781660079956, [[32448, 0.482458, " ways", false], [332, 0.218262, " a", false], [32139, 0.037431, " such", false], [22590, 0.034056, " the", false], [4419, 0.014851, " an", false], [63667, 0.014297, " interesting", false], [39189, 0.009834, " order", false], [31458, 0.00621, " more", false], [22184, 0.006098, " non", false], [39920, 0.005212, " terms", false]]], "qwen": [5510, 2, 0.17169059813022614, [[279, 0.208881, " the", false], [5510, 0.171691, " ways", false], [264, 0.13501, " a", false], [1008, 0.060408, " other", false], [4586, 0.037049, " general", false], [1741, 0.024941, " such", false], [1657, 0.021943, " many", false], [1045, 0.018936, " some", false], [1973, 0.018058, " order", false], [458, 0.016294, " an", false]]]}, "raw_delta": -0.20553724765777587, "tuned_delta": -0.19872496985067792}, {"byte_start": 1161, "byte_end": 1166, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 195, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"rwkv": "0.19% 0.19% 0.19% 0.19% 0.19%", "qwen": "0.27% 0.27% 0.27% 0.27% 0.27%"}, "model_tokens": {"rwkv": [[32227, " that", "normal", 0.9489021301269531]], "qwen": [[429, " that", "normal", 0.9284818768501282]]}, "loss": {"rwkv": 0.18931850206977974, "qwen": 0.2676359078751071}, "topk": {"rwkv": [32227, 1, 0.9489021301269531, [[32227, 0.948902, " that", false], [40186, 0.009314, " which", false], [22590, 0.006739, " the", false], [22187, 0.003897, " not", false], [40185, 0.002885, " where", false], [4811, 0.001463, " to", false], [275, 0.001335, " (", false], [32232, 0.0012, " they", false], [4858, 0.000848, " we", false], [31458, 0.00081, " more", false]]], "qwen": [429, 1, 0.9284818768501282, [[429, 0.928482, " that", false], [279, 0.011645, " the", false], [537, 0.005787, " not", false], [892, 0.005376, " which", false], [34447, 0.004525, " computation", false], [304, 0.003858, " in", false], [1380, 0.002201, " where", false], [807, 0.002154, " they", false], [432, 0.001872, " it", false], [311, 0.001355, " to", false]]]}, "raw_delta": -0.0043428391218185425, "tuned_delta": 0.0024694386852794044}, {"byte_start": 1166, "byte_end": 1171, "display": {"text": " make", "kind": "normal"}, "is_word": true, "word_id": 196, "word_key": " make", "bytes_hex": "20 6d 61 6b 65", "compression": {"rwkv": "4.82% 4.82% 4.82% 4.82% 4.82%", "qwen": "6.13% 6.13% 6.13% 6.13% 6.13%"}, "model_tokens": {"rwkv": [[31358, " make", "normal", 0.2666682302951813]], "qwen": [[1281, " make", "normal", 0.18291719257831573]]}, "loss": {"rwkv": 4.818376015468999, "qwen": 6.12684367084774}, "topk": {"rwkv": [31358, 1, 0.2666682302951813, [[31358, 0.266668, " make", false], [21286, 0.100017, " are", false], [22590, 0.055263, " the", false], [47030, 0.037042, " reduce", false], [21413, 0.027687, " can", false], [56433, 0.018494, " increase", false], [32053, 0.017393, " slow", false], [4491, 0.014389, " do", false], [32216, 0.014172, " tend", false], [38900, 0.012649, " limit", false]]], "qwen": [1281, 1, 0.18291719257831573, [[1281, 0.182917, " make", false], [525, 0.147376, " are", false], [279, 0.042186, " the", false], [646, 0.036885, " can", false], [1367, 0.018263, " comp", false], [7949, 0.014246, " reduce", false], [653, 0.013098, " do", false], [11, 0.011434, ",", false], [1373, 0.01119, " require", false], [1231, 0.010123, " may", false]]]}, "raw_delta": -0.07255685329437256, "tuned_delta": -0.06574457548727461}, {"byte_start": 1171, "byte_end": 1176, "display": {"text": " them", "kind": "normal"}, "is_word": true, "word_id": 197, "word_key": " them", "bytes_hex": "20 74 68 65 6d", "compression": {"rwkv": "2.72% 2.72% 2.72% 2.72% 2.72%", "qwen": "2.85% 2.85% 2.85% 2.85% 2.85%"}, "model_tokens": {"rwkv": [[32229, " them", "normal", 0.4760078489780426]], "qwen": [[1105, " them", "normal", 0.4536651372909546]]}, "loss": {"rwkv": 2.7191420204254877, "qwen": 2.850750669106684}, "topk": {"rwkv": [32229, 1, 0.4760078489780426, [[32229, 0.476008, " them", false], [4601, 0.187452, " it", false], [22590, 0.060104, " the", false], [63370, 0.034974, " computation", false], [39931, 0.032946, " their", false], [38888, 0.017527, " lever", false], [332, 0.006952, " a", false], [51832, 0.004878, " general", false], [21700, 0.0046, " for", false], [52805, 0.004572, " scaling", false]]], "qwen": [1105, 1, 0.4536651372909546, [[1105, 0.453665, " them", false], [432, 0.178793, " it", false], [279, 0.064649, " the", false], [76482, 0.037198, " leveraging", false], [862, 0.026683, " their", false], [34447, 0.023364, " computation", false], [32064, 0.012587, " leverage", false], [990, 0.008797, " use", false], [4623, 0.00801, " further", false], [4586, 0.00795, " general", false]]]}, "raw_delta": -0.007297933101654053, "tuned_delta": -0.00048565529455610584}, {"byte_start": 1176, "byte_end": 1181, "display": {"text": " less", "kind": "normal"}, "is_word": true, "word_id": 198, "word_key": " less", "bytes_hex": "20 6c 65 73 73", "compression": {"rwkv": "3.89% 3.89% 3.89% 3.89% 3.89%", "qwen": "5.01% 5.01% 5.01% 5.01% 5.01%"}, "model_tokens": {"rwkv": [[31277, " less", "normal", 0.3414088487625122]], "qwen": [[2686, " less", "normal", 0.248989537358284]]}, "loss": {"rwkv": 3.888513977396034, "qwen": 5.014607360190208}, "topk": {"rwkv": [31277, 1, 0.3414088487625122, [[31277, 0.341409, " less", false], [46162, 0.242336, " harder", false], [31458, 0.095354, " more", false], [31048, 0.040034, " hard", false], [59516, 0.027589, " difficult", false], [40216, 0.012934, " worse", false], [31466, 0.012328, " much", false], [47313, 0.010268, " slower", false], [45819, 0.009206, " easier", false], [62699, 0.007235, " unsuitable", false]]], "qwen": [2686, 1, 0.248989537358284, [[2686, 0.24899, " less", false], [15750, 0.230981, " harder", false], [803, 0.126236, " more", false], [5000, 0.041384, " difficult", false], [2588, 0.036845, " hard", false], [3716, 0.024595, " comput", false], [28393, 0.021285, " slower", false], [1753, 0.014994, " much", false], [94649, 0.009414, " brittle", false], [10960, 0.00875, " worse", false]]]}, "raw_delta": -0.06244387626647946, "tuned_delta": -0.05563159845938151}, {"byte_start": 1181, "byte_end": 1188, "display": {"text": " suited", "kind": "normal"}, "is_word": true, "word_id": 199, "word_key": " suited", "bytes_hex": "20 73 75 69 74 65 64", "compression": {"rwkv": "15.30% 15.30% 15.30% 15.30% 15.30% 15.30% 15.30%", "qwen": "15.30% 15.30% 15.30% 15.30% 15.30% 15.30% 15.30%"}, "model_tokens": {"rwkv": [[47460, " suited", "normal", 0.0026653227396309376]], "qwen": [[31499, " suited", "normal", 0.002638147445395589]]}, "loss": {"rwkv": 15.296431795139677, "qwen": 15.296891234506983}, "topk": {"rwkv": [47460, 30, 0.0026653227396309376, [[59593, 0.247665, " effective", false], [30140, 0.200298, " amen", false], [51832, 0.090555, " general", false], [59594, 0.058597, " efficient", false], [46439, 0.031692, " likely", false], [47687, 0.030343, " useful", false], [47129, 0.019348, " robust", false], [57160, 0.018623, " scalable", false], [64862, 0.014894, " computational", false], [56900, 0.014498, " powerful", false]]], "qwen": [31499, 38, 0.002638147445395589, [[4586, 0.170988, " general", false], [7373, 0.162518, " effective", false], [3716, 0.074594, " comput", false], [68211, 0.073624, " scalable", false], [1079, 0.056863, " am", false], [11050, 0.039339, " efficient", false], [21765, 0.022776, " robust", false], [6707, 0.021299, " easily", false], [41829, 0.016703, " tract", false], [93748, 0.015319, " adaptable", false]]]}, "raw_delta": -2.54767281668844e-05, "tuned_delta": 0.0067868010789310625}, {"byte_start": 1188, "byte_end": 1191, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 200, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "1.39% 1.39% 1.39%", "qwen": "1.70% 1.70% 1.70%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.7933082580566406]], "qwen": [[311, " to", "normal", 0.7539805173873901]]}, "loss": {"rwkv": 1.3912708524197765, "qwen": 1.6975033396946884}, "topk": {"rwkv": [4811, 1, 0.7933082580566406, [[4811, 0.793308, " to", false], [21700, 0.183052, " for", false], [32226, 0.005246, " than", false], [4423, 0.003035, " as", false], [4596, 0.001965, " in", false], [45, 0.001945, ",", false], [53169, 0.001802, " towards", false], [275, 0.001107, " (", false], [4715, 0.001077, " or", false], [38869, 0.000978, " later", false]]], "qwen": [311, 1, 0.7539805173873901, [[311, 0.753981, " to", false], [369, 0.22766, " for", false], [1091, 0.004099, " than", false], [438, 0.001821, " as", false], [11, 0.001675, ",", false], [6974, 0.001194, " towards", false], [476, 0.000963, " or", false], [320, 0.000937, " (", false], [323, 0.000754, " and", false], [304, 0.000699, " in", false]]]}, "raw_delta": -0.016981134812037155, "tuned_delta": -0.010168857004939209}, {"byte_start": 1191, "byte_end": 1198, "display": {"text": " taking", "kind": "normal"}, "is_word": true, "word_id": 201, "word_key": " taking", "bytes_hex": "20 74 61 6b 69 6e 67", "compression": {"rwkv": "12.32% 12.32% 12.32% 12.32% 12.32% 12.32% 12.32%", "qwen": "12.58% 12.58% 12.58% 12.58% 12.58% 12.58% 12.58%"}, "model_tokens": {"rwkv": [[47497, " taking", "normal", 0.008337478153407574]], "qwen": [[4633, " taking", "normal", 0.007579374127089977]]}, "loss": {"rwkv": 12.317652971875635, "qwen": 12.578045761309482}, "topk": {"rwkv": [47497, 14, 0.008337478153407574, [[22590, 0.215376, " the", false], [38888, 0.089216, " lever", false], [63370, 0.040176, " computation", false], [37832, 0.03427, " being", false], [51832, 0.032545, " general", false], [56540, 0.030042, " leverage", false], [52805, 0.029928, " scaling", false], [31323, 0.027961, " long", false], [38864, 0.013585, " large", false], [46064, 0.013545, " future", false]]], "qwen": [4633, 19, 0.007579374127089977, [[279, 0.168114, " the", false], [32064, 0.113406, " leverage", false], [76482, 0.088211, " leveraging", false], [34447, 0.035141, " computation", false], [26943, 0.030086, " scaling", false], [70601, 0.021356, " exploiting", false], [4586, 0.02086, " general", false], [39661, 0.020574, " exploitation", false], [3460, 0.018556, " large", false], [990, 0.013438, " use", false]]]}, "raw_delta": -0.01443924222673687, "tuned_delta": -0.007626964419638923}, {"byte_start": 1198, "byte_end": 1208, "display": {"text": " advantage", "kind": "normal"}, "is_word": true, "word_id": 202, "word_key": " advantage", "bytes_hex": "20 61 64 76 61 6e 74 61 67 65", "compression": {"rwkv": "0.36% 0.36% 0.36% 0.36% 0.36% 0.36% 0.36% 0.36% 0.36% 0.36%", "qwen": "0.14% 0.14% 0.14% 0.14% 0.14% 0.14% 0.14% 0.14% 0.14% 0.14%"}, "model_tokens": {"rwkv": [[59093, " advantage", "normal", 0.8173016309738159]], "qwen": [[9423, " advantage", "normal", 0.9232712388038635]]}, "loss": {"rwkv": 0.36278708303604296, "qwen": 0.14396693232400448}, "topk": {"rwkv": [59093, 1, 0.8173016309738159, [[59093, 0.817302, " advantage", false], [30923, 0.156274, " full", false], [52204, 0.003589, " maximum", false], [22590, 0.002975, " the", false], [56540, 0.00246, " leverage", false], [52203, 0.002004, " maximal", false], [61544, 0.001446, " advantages", false], [30273, 0.000848, " best", false], [4712, 0.000576, " on", false], [51030, 0.00057, " benefit", false]]], "qwen": [9423, 1, 0.9232712388038635, [[9423, 0.923271, " advantage", false], [2480, 0.047825, " full", false], [279, 0.004137, " the", false], [22146, 0.001789, " advantages", false], [8760, 0.00139, " benefit", false], [54480, 0.001342, " computational", false], [389, 0.001265, " on", false], [32064, 0.00112, " leverage", false], [2664, 0.001028, " better", false], [7192, 0.00101, " maximum", false]]]}, "raw_delta": 0.012133965641260151, "tuned_delta": 0.0189462434483581}, {"byte_start": 1208, "byte_end": 1211, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 203, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "0.01% 0.01% 0.01%", "qwen": "0.02% 0.02% 0.02%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.9979395270347595]], "qwen": [[315, " of", "normal", 0.9961793422698975]]}, "loss": {"rwkv": 0.01238275086212222, "qwen": 0.02301089239628658}, "topk": {"rwkv": [4706, 1, 0.9979395270347595, [[4706, 0.99794, " of", false], [22590, 0.000441, " the", false], [45, 0.000125, ",", false], [4811, 0.000103, " to", false], [4715, 9e-05, " or", false], [275, 8.2e-05, " (", false], [4596, 7.7e-05, " in", false], [21265, 6e-05, " and", false], [47, 5.6e-05, ".", false], [30917, 4.5e-05, " from", false]]], "qwen": [315, 1, 0.9961793422698975, [[315, 0.996179, " of", false], [279, 0.000355, " the", false], [916, 0.000197, " over", false], [11, 0.000181, ",", false], [320, 0.000174, " (", false], [304, 0.000158, " in", false], [979, 0.000141, " when", false], [13, 0.00014, ".", false], [624, 0.000134, ".\n", false], [3716, 0.000128, " comput", false]]]}, "raw_delta": -0.0005893493071198463, "tuned_delta": 0.0062229284999781006}, {"byte_start": 1211, "byte_end": 1219, "display": {"text": " general", "kind": "normal"}, "is_word": true, "word_id": 204, "word_key": " general", "bytes_hex": "20 67 65 6e 65 72 61 6c", "compression": {"rwkv": "9.72% 9.72% 9.72% 9.72% 9.72% 9.72% 9.72% 9.72%", "qwen": "15.64% 15.64% 15.64% 15.64% 15.64% 15.64% 15.64% 15.64%"}, "model_tokens": {"rwkv": [[51832, " general", "normal", 0.013359642587602139]], "qwen": [[4586, " general", "normal", 0.0009715748601593077]]}, "loss": {"rwkv": 9.721284943490085, "qwen": 15.636542228590956}, "topk": {"rwkv": [51832, 14, 0.013359642587602139, [[22590, 0.285766, " the", false], [63370, 0.172331, " computation", false], [30789, 0.026133, " ever", false], [59846, 0.023588, " increased", false], [46064, 0.020285, " future", false], [37045, 0.019905, " Moore", false], [52195, 0.019188, " massive", false], [64862, 0.017139, " computational", false], [22168, 0.017077, " new", false], [31458, 0.016884, " more", false]]], "qwen": [4586, 78, 0.0009715748601593077, [[279, 0.377646, " the", false], [34447, 0.123759, " computation", false], [501, 0.036997, " new", false], [54480, 0.03647, " computational", false], [10951, 0.024283, " massive", false], [3853, 0.02029, " future", false], [7172, 0.017718, " increased", false], [74151, 0.014298, " exponentially", false], [264, 0.010983, " a", false], [419, 0.009906, " this", false]]]}, "raw_delta": -0.32801151275634766, "tuned_delta": -0.32119923494924973}, {"byte_start": 1219, "byte_end": 1227, "display": {"text": " methods", "kind": "normal"}, "is_word": true, "word_id": 205, "word_key": " methods", "bytes_hex": "20 6d 65 74 68 6f 64 73", "compression": {"rwkv": "3.17% 3.17% 3.17% 3.17% 3.17% 3.17% 3.17% 3.17%", "qwen": "3.72% 3.72% 3.72% 3.72% 3.72% 3.72% 3.72% 3.72%"}, "model_tokens": {"rwkv": [[52224, " methods", "normal", 0.24787652492523193]], "qwen": [[5413, " methods", "normal", 0.19181130826473236]]}, "loss": {"rwkv": 3.1699842207032884, "qwen": 3.722250340864776}, "topk": {"rwkv": [52224, 2, 0.24787652492523193, [[63370, 0.426793, " computation", false], [52224, 0.247877, " methods", false], [64862, 0.029014, " computational", false], [61590, 0.028862, " approaches", false], [46, 0.027003, "-", false], [7933, 0.022798, "ity", false], [41729, 0.020294, "izable", false], [59346, 0.014739, " computing", false], [45, 0.013567, ",", false], [62633, 0.013186, " techniques", false]]], "qwen": [5413, 2, 0.19181130826473236, [[58238, 0.214484, "-purpose", false], [5413, 0.191811, " methods", false], [34447, 0.178298, " computation", false], [18142, 0.0596, " improvements", false], [54480, 0.056473, " computational", false], [2022, 0.028061, "ization", false], [24231, 0.019293, " computing", false], [12538, 0.017913, " techniques", false], [11, 0.01274, ",", false], [15673, 0.012652, " improvement", false]]]}, "raw_delta": -0.030624136328697205, "tuned_delta": -0.02381185852159926}, {"byte_start": 1227, "byte_end": 1238, "display": {"text": " leveraging", "kind": "normal"}, "is_word": true, "word_id": 206, "word_key": " leveraging", "bytes_hex": "20 6c 65 76 65 72 61 67 69 6e 67", "compression": {"rwkv": "14.93% 14.93% 14.93% 14.93% 14.93% 14.93% 0.01% 0.01% 0.01% 0.01% 0.01%", "qwen": "9.42% 9.42% 9.42% 9.42% 9.42% 9.42% 9.42% 9.42% 9.42% 9.42% 9.42%"}, "model_tokens": {"rwkv": [[38888, " lever", "normal", 0.007065759040415287], [33672, "aging", "normal", 0.996137797832489]], "qwen": [[76482, " leveraging", "normal", 0.003186533460393548]]}, "loss": {"rwkv": 8.152277838796817, "qwen": 9.424768873398197}, "topk": {"rwkv": [38888, 12, 0.007065759040415287, [[47, 0.574232, ".", false], [32227, 0.112984, " that", false], [45, 0.08567, ",", false], [21265, 0.027397, " and", false], [4706, 0.023178, " of", false], [21700, 0.020117, " for", false], [275, 0.018586, " (", false], [37810, 0.011811, " based", false], [31296, 0.010404, " like", false], [4596, 0.010111, " in", false]]], "qwen": [76482, 22, 0.003186533460393548, [[624, 0.246874, ".\n", false], [13, 0.230331, ".", false], [429, 0.156389, " that", false], [11, 0.072402, ",", false], [315, 0.049732, " of", false], [323, 0.033619, " and", false], [369, 0.023689, " for", false], [382, 0.019129, ".\n\n", false], [320, 0.01717, " (", false], [304, 0.014904, " in", false]]]}, "raw_delta": -0.07056188583374028, "tuned_delta": -0.06374960802664233}, {"byte_start": 1238, "byte_end": 1250, "display": {"text": " computation", "kind": "normal"}, "is_word": true, "word_id": 207, "word_key": " computation", "bytes_hex": "20 63 6f 6d 70 75 74 61 74 69 6f 6e", "compression": {"rwkv": "0.18% 0.18% 0.18% 0.18% 0.18% 0.18% 0.18% 0.18% 0.18% 0.18% 0.18% 0.18%", "qwen": "0.25% 0.25% 0.25% 0.25% 0.25% 0.25% 0.25% 0.25% 0.25% 0.25% 0.25% 0.25%"}, "model_tokens": {"rwkv": [[63370, " computation", "normal", 0.8869796991348267]], "qwen": [[34447, " computation", "normal", 0.8454323410987854]]}, "loss": {"rwkv": 0.18124678298928526, "qwen": 0.25233207199651386}, "topk": {"rwkv": [63370, 1, 0.8869796991348267, [[63370, 0.88698, " computation", false], [22590, 0.013664, " the", false], [52195, 0.006323, " massive", false], [64862, 0.005682, " computational", false], [59346, 0.003375, " computing", false], [64298, 0.003025, " computations", false], [31458, 0.00287, " more", false], [38864, 0.002594, " large", false], [30789, 0.002513, " ever", false], [38720, 0.002448, " human", false]]], "qwen": [34447, 1, 0.8454323410987854, [[34447, 0.845432, " computation", false], [279, 0.034439, " the", false], [54480, 0.015215, " computational", false], [803, 0.007779, " more", false], [10951, 0.006185, " massive", false], [7172, 0.004161, " increased", false], [7703, 0.003956, " increasing", false], [74151, 0.003853, " exponentially", false], [8570, 0.003264, " continued", false], [3460, 0.002766, " large", false]]]}, "raw_delta": -0.003941805412371955, "tuned_delta": 0.002870472394725992}, {"byte_start": 1250, "byte_end": 1251, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "2.52%", "qwen": "17.46%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.8701855540275574]], "qwen": [[13, ".", "normal", 0.37966933846473694]]}, "loss": {"rwkv": 2.518376353114279, "qwen": 17.464808098154315}, "topk": {"rwkv": [47, 1, 0.8701855540275574, [[47, 0.870186, ".", false], [45, 0.065886, ",", false], [275, 0.016527, " (", false], [32227, 0.003829, " that", false], [4596, 0.003633, " in", false], [60, 0.003379, ";", false], [4811, 0.002881, " to", false], [21265, 0.002864, " and", false], [9816, 0.001923, "—", false], [4423, 0.001574, " as", false]]], "qwen": [13, 2, 0.37966933846473694, [[624, 0.447089, ".\n", false], [13, 0.379669, ".", false], [11, 0.054649, ",", false], [382, 0.028451, ".\n\n", false], [320, 0.017153, " (", false], [304, 0.008535, " in", false], [311, 0.006268, " to", false], [26, 0.00412, ";", false], [429, 0.004086, " that", false], [323, 0.003441, " and", false]]]}, "raw_delta": -0.8288061618804932, "tuned_delta": -0.8219938840733952}, {"byte_start": 1251, "byte_end": 1258, "display": {"text": "  There", "kind": "normal"}, "is_word": true, "word_id": 208, "word_key": "  there", "bytes_hex": "20 20 54 68 65 72 65", "compression": {"rwkv": "80.02% 80.02% 11.67% 11.67% 11.67% 11.67% 11.67%", "qwen": "101.92% 13.40% 13.40% 13.40% 13.40% 13.40% 13.40%"}, "model_tokens": {"rwkv": [[267, "  ", "normal", 0.0001423126523150131], [33504, "There", "normal", 0.0394427552819252]], "qwen": [[220, " ", "normal", 0.0035120798274874687], [2619, " There", "normal", 0.011573479510843754]]}, "loss": {"rwkv": 31.196670108508545, "qwen": 26.047306847837543}, "topk": {"rwkv": [267, 218, 0.0001423126523150131, [[11, 0.397198, "\n", false], [261, 0.126019, "\n\n", false], [20996, 0.066846, " The", false], [19555, 0.032085, " But", false], [29894, 0.029179, " This", false], [3913, 0.023534, " In", false], [3918, 0.02072, " It", false], [4217, 0.015446, " So", false], [37451, 0.013378, " There", false], [19907, 0.012612, " For", false]]], "qwen": [220, 44, 0.0035120798274874687, [[576, 0.122041, " The", false], [1096, 0.072077, " This", false], [758, 0.061168, " In", false], [1084, 0.035065, " It", false], [1988, 0.033449, " But", false], [2619, 0.027887, " There", false], [151643, 0.026966, "\u003c|endoftext|\u003e", false], [1752, 0.026654, " For", false], [2055, 0.021972, " So", false], [4220, 0.021806, " These", false]]]}, "raw_delta": 0.2855413300650461, "tuned_delta": 0.29235360787214404}, {"byte_start": 1258, "byte_end": 1263, "display": {"text": " were", "kind": "normal"}, "is_word": true, "word_id": 209, "word_key": " were", "bytes_hex": "20 77 65 72 65", "compression": {"rwkv": "17.92% 17.92% 17.92% 17.92% 17.92%", "qwen": "18.96% 18.96% 18.96% 18.96% 18.96%"}, "model_tokens": {"rwkv": [[32462, " were", "normal", 0.006905985996127129]], "qwen": [[1033, " were", "normal", 0.005216585472226143]]}, "loss": {"rwkv": 17.92097746104259, "qwen": 18.956696540548123}, "topk": {"rwkv": [32462, 8, 0.006905985996127129, [[21286, 0.489047, " are", false], [4600, 0.318267, " is", false], [460, 0.077675, "'s", false], [31059, 0.033939, " have", false], [21800, 0.019155, " has", false], [22748, 0.010044, " was", false], [22074, 0.008278, " may", false], [32462, 0.006906, " were", false], [32475, 0.006091, " will", false], [21413, 0.003009, " can", false]]], "qwen": [1033, 8, 0.005216585472226143, [[525, 0.480714, " are", false], [374, 0.368058, " is", false], [594, 0.03353, "'s", false], [614, 0.032211, " have", false], [702, 0.02271, " has", false], [572, 0.008697, " was", false], [1231, 0.005935, " may", false], [1033, 0.005217, " were", false], [646, 0.003663, " can", false], [686, 0.003034, " will", false]]]}, "raw_delta": -0.05743246078491204, "tuned_delta": -0.05062018297781409}, {"byte_start": 1263, "byte_end": 1268, "display": {"text": " many", "kind": "normal"}, "is_word": true, "word_id": 210, "word_key": " many", "bytes_hex": "20 6d 61 6e 79", "compression": {"rwkv": "9.02% 9.02% 9.02% 9.02% 9.02%", "qwen": "8.42% 8.42% 8.42% 8.42% 8.42%"}, "model_tokens": {"rwkv": [[31370, " many", "normal", 0.08207494765520096]], "qwen": [[1657, " many", "normal", 0.09687885642051697]]}, "loss": {"rwkv": 9.01684400555602, "qwen": 8.41918623562942}, "topk": {"rwkv": [31370, 3, 0.08207494765520096, [[332, 0.122381, " a", false], [32074, 0.091173, " some", false], [31370, 0.082075, " many", false], [22638, 0.07868, " two", false], [52869, 0.046982, " several", false], [39193, 0.034796, " other", false], [39962, 0.030552, " times", false], [61963, 0.025964, " exceptions", false], [45, 0.025302, ",", false], [39946, 0.016955, " three", false]]], "qwen": [1657, 3, 0.09687885642051697, [[1378, 0.182187, " two", false], [264, 0.116732, " a", false], [1657, 0.096879, " many", false], [1045, 0.0537, " some", false], [2326, 0.037893, " three", false], [3807, 0.036552, " several", false], [11, 0.035038, ",", false], [1008, 0.023848, " other", false], [3039, 0.022582, " times", false], [19585, 0.018904, " exceptions", false]]]}, "raw_delta": 0.0331411838531494, "tuned_delta": 0.03995346166024735}, {"byte_start": 1268, "byte_end": 1277, "display": {"text": " examples", "kind": "normal"}, "is_word": true, "word_id": 211, "word_key": " examples", "bytes_hex": "20 65 78 61 6d 70 6c 65 73", "compression": {"rwkv": "5.73% 5.73% 5.73% 5.73% 5.73% 5.73% 5.73% 5.73% 5.73%", "qwen": "9.31% 9.31% 9.31% 9.31% 9.31% 9.31% 9.31% 9.31% 9.31%"}, "model_tokens": {"rwkv": [[56162, " examples", "normal", 0.05748515948653221]], "qwen": [[10295, " examples", "normal", 0.009600982069969177]]}, "loss": {"rwkv": 5.729452961863721, "qwen": 9.309170560900908}, "topk": {"rwkv": [56162, 2, 0.05748515948653221, [[39193, 0.060614, " other", false], [56162, 0.057485, " examples", false], [3609, 0.034668, " AI", false], [52654, 0.031238, " reasons", false], [30992, 0.027652, " good", false], [38328, 0.022887, " early", false], [39962, 0.022206, " times", false], [46787, 0.021301, " people", false], [32448, 0.019691, " ways", false], [55572, 0.019185, " attempts", false]]], "qwen": [10295, 13, 0.009600982069969177, [[7966, 0.098679, " reasons", false], [4124, 0.048259, " early", false], [1008, 0.04031, " other", false], [2989, 0.033604, " important", false], [19827, 0.031808, " approaches", false], [1661, 0.029696, " good", false], [18366, 0.028182, " lessons", false], [13553, 0.025138, " attempts", false], [2244, 0.024823, " great", false], [5510, 0.014277, " ways", false]]]}, "raw_delta": -0.19850169287787553, "tuned_delta": -0.19168941507077758}, {"byte_start": 1277, "byte_end": 1280, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 212, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "2.99% 2.99% 2.99%", "qwen": "2.10% 2.10% 2.10%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.6064512133598328]], "qwen": [[315, " of", "normal", 0.7047458291053772]]}, "loss": {"rwkv": 2.9938739862197723, "qwen": 2.103437752646663}, "topk": {"rwkv": [4706, 1, 0.6064512133598328, [[4706, 0.606451, " of", false], [4596, 0.174437, " in", false], [45805, 0.027283, " during", false], [31601, 0.02261, " over", false], [32227, 0.018397, " that", false], [30917, 0.018214, " from", false], [62650, 0.016299, " throughout", false], [40185, 0.014763, " where", false], [45, 0.014401, ",", false], [37678, 0.009865, " along", false]]], "qwen": [315, 1, 0.7047458291053772, [[315, 0.704746, " of", false], [304, 0.100277, " in", false], [1380, 0.026316, " where", false], [429, 0.018377, " that", false], [6814, 0.015871, " throughout", false], [11, 0.011269, ",", false], [2337, 0.010415, " during", false], [4124, 0.010242, " early", false], [3156, 0.008302, " along", false], [1573, 0.008228, " before", false]]]}, "raw_delta": 0.04937626918156942, "tuned_delta": 0.05618854698866737}, {"byte_start": 1280, "byte_end": 1283, "display": {"text": " AI", "kind": "normal"}, "is_word": true, "word_id": 213, "word_key": " ai", "bytes_hex": "20 41 49", "compression": {"rwkv": "20.10% 20.10% 20.10%", "qwen": "23.33% 23.33% 23.33%"}, "model_tokens": {"rwkv": [[3609, " AI", "normal", 0.03564358130097389]], "qwen": [[15235, " AI", "normal", 0.02062762901186943]]}, "loss": {"rwkv": 20.100048095718627, "qwen": 23.330326567436906}, "topk": {"rwkv": [3609, 3, 0.03564358130097389, [[32234, 0.531812, " this", false], [22590, 0.062195, " the", false], [3609, 0.035644, " AI", false], [57103, 0.021458, " research", false], [39936, 0.015689, " these", false], [52224, 0.014163, " methods", false], [63843, 0.013714, " researchers", false], [38720, 0.012823, " human", false], [32139, 0.012129, " such", false], [61590, 0.010093, " approaches", false]]], "qwen": [15235, 8, 0.02062762901186943, [[419, 0.215455, " this", false], [279, 0.10999, " the", false], [3738, 0.044208, " human", false], [11811, 0.023512, " researchers", false], [3412, 0.021636, " research", false], [4124, 0.02119, " early", false], [4586, 0.020909, " general", false], [15235, 0.020628, " AI", false], [1741, 0.016156, " such", false], [1493, 0.016148, " these", false]]]}, "raw_delta": -0.17912467320760106, "tuned_delta": -0.1723123954005031}, {"byte_start": 1283, "byte_end": 1295, "display": {"text": " researchers", "kind": "normal"}, "is_word": true, "word_id": 214, "word_key": " researchers", "bytes_hex": "20 72 65 73 65 61 72 63 68 65 72 73", "compression": {"rwkv": "3.66% 3.66% 3.66% 3.66% 3.66% 3.66% 3.66% 3.66% 3.66% 3.66% 3.66% 3.66%", "qwen": "2.33% 2.33% 2.33% 2.33% 2.33% 2.33% 2.33% 2.33% 2.33% 2.33% 2.33% 2.33%"}, "model_tokens": {"rwkv": [[63843, " researchers", "normal", 0.08811833709478378]], "qwen": [[11811, " researchers", "normal", 0.21270927786827087]]}, "loss": {"rwkv": 3.6630928772571334, "qwen": 2.3260886422367912}, "topk": {"rwkv": [63843, 2, 0.08811833709478378, [[57103, 0.321033, " research", false], [63843, 0.088118, " researchers", false], [53087, 0.082052, " systems", false], [56952, 0.060376, " projects", false], [32227, 0.040708, " that", false], [52224, 0.037753, " methods", false], [4596, 0.024839, " in", false], [61590, 0.022223, " approaches", false], [45124, 0.016898, " agents", false], [460, 0.012522, "'s", false]]], "qwen": [11811, 2, 0.21270927786827087, [[3412, 0.24725, " research", false], [11811, 0.212709, " researchers", false], [5942, 0.050485, " systems", false], [5413, 0.049835, " methods", false], [304, 0.035385, " in", false], [429, 0.03287, " that", false], [19827, 0.027719, " approaches", false], [7079, 0.020352, " projects", false], [1660, 0.017214, " being", false], [13009, 0.015859, " agents", false]]]}, "raw_delta": 0.07413925727208458, "tuned_delta": 0.08095153507918253}, {"byte_start": 1295, "byte_end": 1296, "display": {"text": "'", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "27", "compression": {"rwkv": "85.66%", "qwen": "76.98%"}, "model_tokens": {"rwkv": [[40, "'", "normal", 0.00875429343432188]], "qwen": [[6, "'", "normal", 0.013998657464981079]]}, "loss": {"rwkv": 85.66001805278219, "qwen": 76.98210025728152}, "topk": {"rwkv": [40, 17, 0.00875429343432188, [[22762, 0.215301, " who", false], [4596, 0.057771, " in", false], [46500, 0.037623, " making", false], [51709, 0.025025, " falling", false], [51844, 0.023266, " getting", false], [31601, 0.021966, " over", false], [47629, 0.018122, " trying", false], [45, 0.017387, ",", false], [32227, 0.016607, " that", false], [37832, 0.015162, " being", false]]], "qwen": [6, 13, 0.013998657464981079, [[879, 0.162335, " who", false], [304, 0.061561, " in", false], [3259, 0.037806, " making", false], [4460, 0.024903, " trying", false], [429, 0.023692, " that", false], [10164, 0.019427, " spending", false], [1660, 0.018906, " being", false], [19405, 0.016969, " attempting", false], [3238, 0.01593, " working", false], [10887, 0.015721, " seeking", false]]]}, "raw_delta": 0.48120594024658203, "tuned_delta": 0.48801821805367995}, {"byte_start": 1296, "byte_end": 1300, "display": {"text": " bel", "kind": "normal"}, "is_word": true, "word_id": 215, "word_key": " bel", "bytes_hex": "20 62 65 6c", "compression": {"rwkv": "41.98% 41.98% 41.98% 41.98%", "qwen": "38.94% 38.94% 38.94% 38.94%"}, "model_tokens": {"rwkv": [[21344, " bel", "normal", 9.200159547617659e-05]], "qwen": [[1656, " bel", "normal", 0.00017736996232997626]]}, "loss": {"rwkv": 41.98467990087022, "qwen": 38.94047089230917}, "topk": {"rwkv": [21344, 927, 9.200159547617659e-05, [[51708, 0.061748, " failure", false], [61701, 0.04329, " commitment", false], [62157, 0.029678, " investment", false], [59834, 0.02086, " inability", false], [55572, 0.01964, " attempts", false], [31601, 0.017157, " over", false], [38530, 0.014587, " focus", false], [56652, 0.013872, " mistakes", false], [57404, 0.012434, " tendency", false], [51566, 0.012408, " efforts", false]]], "qwen": [1656, 650, 0.00017736996232997626, [[7901, 0.056277, " failure", false], [13553, 0.052514, " attempts", false], [8869, 0.043999, " efforts", false], [27850, 0.018851, " failures", false], [37450, 0.017477, " inability", false], [4124, 0.015337, " early", false], [15155, 0.013318, " commitment", false], [23187, 0.012418, " psychological", false], [975, 0.011972, " work", false], [5786, 0.011803, " mis", false]]]}, "raw_delta": 0.168806791305542, "tuned_delta": 0.17561906911263994}, {"byte_start": 1300, "byte_end": 1304, "display": {"text": "ated", "kind": "normal"}, "is_word": true, "word_id": 216, "word_key": "ated", "bytes_hex": "61 74 65 64", "compression": {"rwkv": "1.48% 1.48% 1.48% 1.48%", "qwen": "0.37% 0.37% 0.37% 0.37%"}, "model_tokens": {"rwkv": [[24738, "ated", "normal", 0.7202048301696777]], "qwen": [[657, "ated", "normal", 0.9212166666984558]]}, "loss": {"rwkv": 1.4793259696615346, "qwen": 0.3699612855722067}, "topk": {"rwkv": [24738, 1, 0.7202048301696777, [[24738, 0.720205, "ated", false], [1840, 0.110195, "ea", false], [7931, 0.082151, "itt", false], [27525, 0.020824, "ying", false], [24385, 0.013219, "abor", false], [34907, 0.010453, "ittle", false], [1848, 0.007544, "ei", false], [33943, 0.003752, "ating", false], [34116, 0.002728, "ching", false], [1956, 0.002037, "it", false]]], "qwen": [657, 1, 0.9212166666984558, [[657, 0.921217, "ated", false], [1442, 0.039761, "itt", false], [415, 0.008735, "lic", false], [370, 0.00741, "ab", false], [550, 0.004834, "ies", false], [7272, 0.003059, "iger", false], [4324, 0.002297, "abor", false], [6711, 0.001472, "lying", false], [1122, 0.000989, "ied", false], [4738, 0.000925, "ief", false]]]}, "raw_delta": 0.06151624023914337, "tuned_delta": 0.06832851804624132}, {"byte_start": 1304, "byte_end": 1313, "display": {"text": " learning", "kind": "normal"}, "is_word": true, "word_id": 217, "word_key": " learning", "bytes_hex": "20 6c 65 61 72 6e 69 6e 67", "compression": {"rwkv": "11.02% 11.02% 11.02% 11.02% 11.02% 11.02% 11.02% 11.02% 11.02%", "qwen": "12.19% 12.19% 12.19% 12.19% 12.19% 12.19% 12.19% 12.19% 12.19%"}, "model_tokens": {"rwkv": [[56537, " learning", "normal", 0.004099339246749878]], "qwen": [[6832, " learning", "normal", 0.0022810553200542927]]}, "loss": {"rwkv": 11.020587117901803, "qwen": 12.189003806792723}, "topk": {"rwkv": [56537, 18, 0.004099339246749878, [[63821, 0.511191, " recognition", false], [63820, 0.184118, " realization", false], [59544, 0.04771, " discovery", false], [59209, 0.024188, " awareness", false], [64253, 0.023128, " appreciation", false], [65034, 0.022923, " understanding", false], [61518, 0.010991, " acceptance", false], [21265, 0.009221, " and", false], [63257, 0.008262, " acknowledge", false], [2030, 0.007611, "ly", false]]], "qwen": [6832, 34, 0.0022810553200542927, [[398, 0.201051, "ly", false], [1931, 0.200269, " real", false], [17843, 0.121466, " recognition", false], [48703, 0.045398, " realization", false], [34896, 0.044657, " appreciation", false], [323, 0.020546, " and", false], [8660, 0.01876, " understanding", false], [17526, 0.013366, " awareness", false], [18335, 0.012287, " discovery", false], [24376, 0.011437, " adoption", false]]]}, "raw_delta": -0.06479077868991423, "tuned_delta": -0.05797850088281628}, {"byte_start": 1313, "byte_end": 1316, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 218, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "2.71% 2.71% 2.71%", "qwen": "7.03% 7.03% 7.03%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.6378224492073059]], "qwen": [[315, " of", "normal", 0.31049299240112305]]}, "loss": {"rwkv": 2.7120976110461466, "qwen": 7.0306973459062245}, "topk": {"rwkv": [4706, 1, 0.6378224492073059, [[4706, 0.637822, " of", false], [32227, 0.100562, " that", false], [30917, 0.064279, " from", false], [37598, 0.052102, " about", false], [4811, 0.02564, " to", false], [116, 0.018986, "s", false], [32234, 0.015064, " this", false], [4596, 0.014244, " in", false], [45, 0.010087, ",", false], [22590, 0.009834, " the", false]]], "qwen": [315, 1, 0.31049299240112305, [[315, 0.310493, " of", false], [429, 0.251639, " that", false], [419, 0.092231, " this", false], [311, 0.089571, " to", false], [911, 0.055374, " about", false], [279, 0.032315, " the", false], [504, 0.026661, " from", false], [304, 0.021464, " in", false], [11, 0.015319, ",", false], [13, 0.012185, ".", false]]]}, "raw_delta": -0.23947401841481528, "tuned_delta": -0.23266174060771733}, {"byte_start": 1316, "byte_end": 1321, "display": {"text": " this", "kind": "normal"}, "is_word": true, "word_id": 219, "word_key": " this", "bytes_hex": "20 74 68 69 73", "compression": {"rwkv": "2.76% 2.76% 2.76% 2.76% 2.76%", "qwen": "2.70% 2.70% 2.70% 2.70% 2.70%"}, "model_tokens": {"rwkv": [[32234, " this", "normal", 0.46678540110588074]], "qwen": [[419, " this", "normal", 0.472516268491745]]}, "loss": {"rwkv": 2.7614084767015314, "qwen": 2.7039101619735093}, "topk": {"rwkv": [32234, 1, 0.46678540110588074, [[32234, 0.466785, " this", false], [22590, 0.328621, " the", false], [39936, 0.077192, " these", false], [21835, 0.014633, " how", false], [51832, 0.013439, " general", false], [32227, 0.010597, " that", false], [32464, 0.009665, " what", false], [37045, 0.00719, " Moore", false], [52127, 0.006994, " lessons", false], [332, 0.006884, " a", false]]], "qwen": [419, 1, 0.472516268491745, [[419, 0.472516, " this", false], [279, 0.384657, " the", false], [1493, 0.041137, " these", false], [1246, 0.019493, " how", false], [20219, 0.010266, " Moore", false], [429, 0.008741, " that", false], [1128, 0.007593, " what", false], [18366, 0.004646, " lessons", false], [862, 0.004166, " their", false], [4586, 0.002033, " general", false]]]}, "raw_delta": 0.0031883835792541615, "tuned_delta": 0.010000661386352108}, {"byte_start": 1321, "byte_end": 1328, "display": {"text": " bitter", "kind": "normal"}, "is_word": true, "word_id": 220, "word_key": " bitter", "bytes_hex": "20 62 69 74 74 65 72", "compression": {"rwkv": "18.52% 18.52% 18.52% 18.52% 18.52% 18.52% 18.52%", "qwen": "13.15% 13.15% 13.15% 13.15% 13.15% 13.15% 13.15%"}, "model_tokens": {"rwkv": [[45315, " bitter", "normal", 0.0007567460415884852]], "qwen": [[25180, " bitter", "normal", 0.006068412680178881]]}, "loss": {"rwkv": 18.516733225695397, "qwen": 13.150830294665546}, "topk": {"rwkv": [45315, 54, 0.0007567460415884852, [[46430, 0.560528, " lesson", false], [30808, 0.093396, " fact", false], [4596, 0.035192, " in", false], [45, 0.027359, ",", false], [47, 0.024567, ".", false], [45805, 0.022822, " during", false], [31601, 0.020496, " over", false], [40029, 0.017495, " truth", false], [39310, 0.015238, " point", false], [63591, 0.012553, " fundamental", false]]], "qwen": [25180, 16, 0.006068412680178881, [[17755, 0.46085, " lesson", false], [8046, 0.050063, " truth", false], [2097, 0.04775, " fact", false], [13, 0.041519, ".", false], [11, 0.03482, ",", false], [304, 0.03178, " in", false], [17508, 0.019368, " principle", false], [916, 0.016598, " over", false], [2989, 0.015332, " important", false], [504, 0.009869, " from", false]]]}, "raw_delta": 0.297548839024135, "tuned_delta": 0.3043611168312329}, {"byte_start": 1328, "byte_end": 1335, "display": {"text": " lesson", "kind": "normal"}, "is_word": true, "word_id": 221, "word_key": " lesson", "bytes_hex": "20 6c 65 73 73 6f 6e", "compression": {"rwkv": "0.11% 0.11% 0.11% 0.11% 0.11% 0.11% 0.11%", "qwen": "0.31% 0.31% 0.31% 0.31% 0.31% 0.31% 0.31%"}, "model_tokens": {"rwkv": [[46430, " lesson", "normal", 0.957834780216217]], "qwen": [[17755, " lesson", "normal", 0.8855627179145813]]}, "loss": {"rwkv": 0.11069786167535292, "qwen": 0.31309572112121836}, "topk": {"rwkv": [46430, 1, 0.957834780216217, [[46430, 0.957835, " lesson", false], [40029, 0.017178, " truth", false], [30808, 0.002906, " fact", false], [7513, 0.002211, "est", false], [45, 0.002203, ",", false], [21400, 0.001875, " but", false], [21265, 0.00132, " and", false], [46454, 0.000939, " little", false], [31683, 0.000806, " pill", false], [52127, 0.000639, " lessons", false]]], "qwen": [17755, 1, 0.8855627179145813, [[17755, 0.885563, " lesson", false], [8046, 0.06927, " truth", false], [8729, 0.00557, " reality", false], [11, 0.003873, ",", false], [320, 0.003319, " (", false], [323, 0.002949, " and", false], [714, 0.002562, " but", false], [3139, 0.001814, " experience", false], [2097, 0.001787, " fact", false], [15177, 0.001644, " pill", false]]]}, "raw_delta": -0.011223320450101578, "tuned_delta": -0.004411042643003631}, {"byte_start": 1335, "byte_end": 1336, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "30.15%", "qwen": "27.29%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.18515858054161072]], "qwen": [[11, ",", "normal", 0.22016479074954987]]}, "loss": {"rwkv": 30.150072143577944, "qwen": 27.29180432778036}, "topk": {"rwkv": [45, 2, 0.18515858054161072, [[47, 0.300879, ".", false], [45, 0.185159, ",", false], [4596, 0.183305, " in", false], [31601, 0.065824, " over", false], [45805, 0.059299, " during", false], [59, 0.020387, ":", false], [32227, 0.019247, " that", false], [62650, 0.0135, " throughout", false], [30917, 0.011015, " from", false], [37634, 0.010366, " after", false]]], "qwen": [11, 2, 0.22016479074954987, [[13, 0.405673, ".", false], [11, 0.220165, ",", false], [304, 0.093385, " in", false], [916, 0.030259, " over", false], [25, 0.029627, ":", false], [2337, 0.021025, " during", false], [320, 0.013752, " (", false], [504, 0.013353, " from", false], [26, 0.012638, ";", false], [1573, 0.011087, " before", false]]]}, "raw_delta": 0.15849602222442627, "tuned_delta": 0.16530830003152422}, {"byte_start": 1336, "byte_end": 1340, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 222, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"rwkv": "8.70% 8.70% 8.70% 8.70%", "qwen": "8.53% 8.53% 8.53% 8.53%"}, "model_tokens": {"rwkv": [[21265, " and", "normal", 0.14711634814739227]], "qwen": [[323, " and", "normal", 0.15088005363941193]]}, "loss": {"rwkv": 8.699845583485692, "qwen": 8.52664346813911}, "topk": {"rwkv": [21265, 2, 0.14711634814739227, [[21400, 0.347695, " but", false], [21265, 0.147116, " and", false], [59841, 0.044795, " including", false], [40186, 0.037, " which", false], [4423, 0.025527, " as", false], [4596, 0.023026, " in", false], [32139, 0.021336, " such", false], [30917, 0.01643, " from", false], [22590, 0.015656, " the", false], [57295, 0.014842, " starting", false]]], "qwen": [323, 2, 0.15088005363941193, [[714, 0.256902, " but", false], [323, 0.15088, " and", false], [2670, 0.06764, " including", false], [1741, 0.031191, " such", false], [1429, 0.030556, " most", false], [892, 0.024749, " which", false], [3545, 0.023168, " often", false], [1045, 0.021803, " some", false], [438, 0.021583, " as", false], [504, 0.02001, " from", false]]]}, "raw_delta": 0.00960436463356018, "tuned_delta": 0.016416642440658127}, {"byte_start": 1340, "byte_end": 1343, "display": {"text": " it", "kind": "normal"}, "is_word": true, "word_id": 223, "word_key": " it", "bytes_hex": "20 69 74", "compression": {"rwkv": "16.34% 16.34% 16.34%", "qwen": "17.43% 17.43% 17.43%"}, "model_tokens": {"rwkv": [[4601, " it", "normal", 0.06555406004190445]], "qwen": [[432, " it", "normal", 0.05506710335612297]]}, "loss": {"rwkv": 16.343029760070287, "qwen": 17.427773067479766}, "topk": {"rwkv": [4601, 3, 0.06555406004190445, [[22590, 0.114947, " the", false], [31370, 0.080537, " many", false], [4601, 0.065554, " it", false], [39934, 0.063835, " there", false], [308, 0.045324, " I", false], [32074, 0.039888, " some", false], [4706, 0.031278, " of", false], [332, 0.030078, " a", false], [22226, 0.027534, " one", false], [32232, 0.026076, " they", false]]], "qwen": [432, 4, 0.05506710335612297, [[279, 0.090421, " the", false], [1657, 0.079639, " many", false], [1045, 0.060173, " some", false], [432, 0.055067, " it", false], [358, 0.049406, " I", false], [807, 0.046728, " they", false], [304, 0.043768, " in", false], [1052, 0.042553, " there", false], [419, 0.037198, " this", false], [264, 0.030768, " a", false]]]}, "raw_delta": -0.06015094121297204, "tuned_delta": -0.05333866340587409}, {"byte_start": 1343, "byte_end": 1346, "display": {"text": " is", "kind": "normal"}, "is_word": true, "word_id": 224, "word_key": " is", "bytes_hex": "20 69 73", "compression": {"rwkv": "8.27% 8.27% 8.27%", "qwen": "8.51% 8.51% 8.51%"}, "model_tokens": {"rwkv": [[4600, " is", "normal", 0.2537776231765747]], "qwen": [[374, " is", "normal", 0.24256405234336853]]}, "loss": {"rwkv": 8.265440338426352, "qwen": 8.514843129358189}, "topk": {"rwkv": [4600, 1, 0.2537776231765747, [[4600, 0.253778, " is", false], [460, 0.141278, "'s", false], [22748, 0.138095, " was", false], [32272, 0.084588, " took", false], [21800, 0.041703, " has", false], [40219, 0.023496, " would", false], [39620, 0.020841, " seems", false], [59393, 0.014451, " continues", false], [32475, 0.014173, " will", false], [21413, 0.011996, " can", false]]], "qwen": [374, 1, 0.24256405234336853, [[374, 0.242564, " is", false], [572, 0.19145, " was", false], [594, 0.078296, "'s", false], [3867, 0.069163, " took", false], [702, 0.052033, " has", false], [1035, 0.019592, " would", false], [4977, 0.01895, " seems", false], [646, 0.014081, " can", false], [6069, 0.012516, " led", false], [1231, 0.012319, " may", false]]]}, "raw_delta": -0.013829827308654785, "tuned_delta": -0.007017549501556838}, {"byte_start": 1346, "byte_end": 1355, "display": {"text": " instruct", "kind": "normal"}, "is_word": true, "word_id": 225, "word_key": " instruct", "bytes_hex": "20 69 6e 73 74 72 75 63 74", "compression": {"rwkv": "7.70% 7.70% 7.70% 7.70% 7.70% 7.70% 7.70% 7.70% 7.70%", "qwen": "7.18% 7.18% 7.18% 7.18% 7.18% 7.18% 7.18% 7.18% 7.18%"}, "model_tokens": {"rwkv": [[56469, " instruct", "normal", 0.021538948640227318]], "qwen": [[21066, " instruct", "normal", 0.027793802320957184]]}, "loss": {"rwkv": 7.701887588079101, "qwen": 7.179295850141927}, "topk": {"rwkv": [56469, 7, 0.021538948640227318, [[22187, 0.108993, " not", false], [332, 0.085553, " a", false], [40218, 0.057385, " worth", false], [39820, 0.053328, " still", false], [22226, 0.04473, " one", false], [31581, 0.029086, " only", false], [56469, 0.021539, " instruct", false], [22590, 0.020802, " the", false], [59829, 0.018343, " important", false], [31048, 0.018212, " hard", false]]], "qwen": [21066, 6, 0.027793802320957184, [[537, 0.062966, " not", false], [264, 0.055177, " a", false], [5802, 0.052327, " worth", false], [2588, 0.032805, " hard", false], [2058, 0.031659, " still", false], [21066, 0.027794, " instruct", false], [279, 0.025145, " the", false], [2989, 0.024531, " important", false], [825, 0.022382, " one", false], [4135, 0.021515, " easy", false]]]}, "raw_delta": 0.028978639178805887, "tuned_delta": 0.03579091698590384}, {"byte_start": 1355, "byte_end": 1358, "display": {"text": "ive", "kind": "normal"}, "is_word": true, "word_id": 226, "word_key": "ive", "bytes_hex": "69 76 65", "compression": {"rwkv": "0.01% 0.01% 0.01%", "qwen": "0.01% 0.01% 0.01%"}, "model_tokens": {"rwkv": [[7938, "ive", "normal", 0.9983008503913879]], "qwen": [[533, "ive", "normal", 0.9985384941101074]]}, "loss": {"rwkv": 0.010089648850618105, "qwen": 0.008791913226163243}, "topk": {"rwkv": [7938, 1, 0.9983008503913879, [[7938, 0.998301, "ive", false], [34918, 0.001012, "ively", false], [7856, 0.000491, "ing", false], [24381, 4.9e-05, "able", false], [4811, 2.1e-05, " to", false], [33948, 9e-06, "ative", false], [25656, 9e-06, "ible", false], [1958, 8e-06, "iv", false], [49338, 8e-06, "iveness", false], [2255, 5e-06, "ve", false]]], "qwen": [533, 1, 0.9985384941101074, [[533, 0.998538, "ive", false], [3132, 0.000996, "ively", false], [1262, 0.000238, "ful", false], [287, 9.4e-05, "ing", false], [1388, 4.7e-05, "ative", false], [1238, 1.1e-05, "ible", false], [480, 7e-06, "able", false], [311, 6e-06, " to", false], [344, 6e-06, "iv", false], [82, 4e-06, "s", false]]]}, "raw_delta": 7.196174313624698e-05, "tuned_delta": 0.006884239550234194}, {"byte_start": 1358, "byte_end": 1361, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 227, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "0.90% 0.90% 0.90%", "qwen": "0.73% 0.73% 0.73%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.8609417080879211]], "qwen": [[311, " to", "normal", 0.8852441310882568]]}, "loss": {"rwkv": 0.9040325370153823, "qwen": 0.7327195883865194}, "topk": {"rwkv": [4811, 1, 0.8609417080879211, [[4811, 0.860942, " to", false], [32227, 0.052799, " that", false], [21700, 0.015672, " for", false], [47, 0.014632, ".", false], [4596, 0.011848, " in", false], [21265, 0.006563, " and", false], [45, 0.004669, ",", false], [21835, 0.00432, " how", false], [4423, 0.003237, " as", false], [31077, 0.002874, " here", false]]], "qwen": [311, 1, 0.8852441310882568, [[311, 0.885244, " to", false], [429, 0.027062, " that", false], [369, 0.016089, " for", false], [13, 0.015356, ".", false], [304, 0.00887, " in", false], [11, 0.006595, ",", false], [323, 0.003971, " and", false], [1588, 0.003628, " here", false], [537, 0.002653, " not", false], [315, 0.002501, " of", false]]]}, "raw_delta": 0.009499606986840568, "tuned_delta": 0.016311884793938514}, {"byte_start": 1361, "byte_end": 1368, "display": {"text": " review", "kind": "normal"}, "is_word": true, "word_id": 228, "word_key": " review", "bytes_hex": "20 72 65 76 69 65 77", "compression": {"rwkv": "6.44% 6.44% 6.44% 6.44% 6.44% 6.44% 6.44%", "qwen": "8.00% 8.00% 8.00% 8.00% 8.00% 8.00% 8.00%"}, "model_tokens": {"rwkv": [[47108, " review", "normal", 0.08198771625757217]], "qwen": [[3395, " review", "normal", 0.04484003409743309]]}, "loss": {"rwkv": 6.440602861111444, "qwen": 7.998336949748838}, "topk": {"rwkv": [47108, 3, 0.08198771625757217, [[31324, 0.21443, " look", false], [22449, 0.100256, " see", false], [47108, 0.081988, " review", false], [55832, 0.081376, " consider", false], [51667, 0.050513, " examine", false], [52751, 0.035899, " revisit", false], [31834, 0.021428, " read", false], [52672, 0.021027, " reflect", false], [39942, 0.019044, " think", false], [4559, 0.018291, " go", false]]], "qwen": [3395, 5, 0.04484003409743309, [[1401, 0.232227, " look", false], [1490, 0.08595, " see", false], [2908, 0.08425, " consider", false], [20961, 0.046059, " examine", false], [3395, 0.04484, " review", false], [1140, 0.028893, " list", false], [1896, 0.020682, " take", false], [11167, 0.019772, " highlight", false], [1349, 0.019264, " read", false], [38296, 0.016471, " cite", false]]]}, "raw_delta": -0.08637911932809013, "tuned_delta": -0.07956684152099218}, {"byte_start": 1368, "byte_end": 1373, "display": {"text": " some", "kind": "normal"}, "is_word": true, "word_id": 229, "word_key": " some", "bytes_hex": "20 73 6f 6d 65", "compression": {"rwkv": "3.69% 3.69% 3.69% 3.69% 3.69%", "qwen": "3.33% 3.33% 3.33% 3.33% 3.33%"}, "model_tokens": {"rwkv": [[32074, " some", "normal", 0.3575805127620697]], "qwen": [[1045, " some", "normal", 0.39698800444602966]]}, "loss": {"rwkv": 3.6912705147744957, "qwen": 3.33208173875113}, "topk": {"rwkv": [32074, 1, 0.3575805127620697, [[32074, 0.357581, " some", false], [32229, 0.225728, " them", false], [332, 0.17028, " a", false], [22590, 0.069763, " the", false], [39936, 0.029107, " these", false], [39944, 0.022073, " those", false], [52869, 0.012442, " several", false], [31198, 0.010982, " just", false], [32464, 0.010648, " what", false], [22226, 0.009274, " one", false]]], "qwen": [1045, 1, 0.39698800444602966, [[1045, 0.396988, " some", false], [1105, 0.183857, " them", false], [264, 0.129938, " a", false], [279, 0.071827, " the", false], [1846, 0.032438, " those", false], [1493, 0.028706, " these", false], [862, 0.018064, " their", false], [3807, 0.015456, " several", false], [1246, 0.013721, " how", false], [1128, 0.013609, " what", false]]]}, "raw_delta": 0.01991765499114989, "tuned_delta": 0.026729932798247837}, {"byte_start": 1373, "byte_end": 1376, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 230, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "1.12% 1.12% 1.12%", "qwen": "1.10% 1.10% 1.10%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.8315167427062988]], "qwen": [[315, " of", "normal", 0.8333882093429565]]}, "loss": {"rwkv": 1.1153648183956015, "qwen": 1.0955809912170524}, "topk": {"rwkv": [4706, 1, 0.8315167427062988, [[4706, 0.831517, " of", false], [47, 0.073219, ".", false], [56162, 0.021577, " examples", false], [32227, 0.006887, " that", false], [45, 0.004283, ",", false], [59, 0.003965, ":", false], [47014, 0.003303, " recent", false], [37970, 0.003042, " cases", false], [30917, 0.002791, " from", false], [4596, 0.001928, " in", false]]], "qwen": [315, 1, 0.8333882093429565, [[315, 0.833388, " of", false], [13, 0.05021, ".", false], [429, 0.014256, " that", false], [10295, 0.013134, " examples", false], [624, 0.007572, ".\n", false], [11, 0.0059, ",", false], [5048, 0.005518, " cases", false], [304, 0.004061, " in", false], [3213, 0.003573, " recent", false], [1376, 0.002602, " key", false]]]}, "raw_delta": 0.0010970483223597255, "tuned_delta": 0.007909326129457672}, {"byte_start": 1376, "byte_end": 1380, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 231, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "8.45% 8.45% 8.45% 8.45%", "qwen": "8.53% 8.53% 8.53% 8.53%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.15671095252037048]], "qwen": [[279, " the", "normal", 0.15079525113105774]]}, "loss": {"rwkv": 8.45329125520877, "qwen": 8.5291780624562}, "topk": {"rwkv": [22590, 2, 0.15671095252037048, [[32229, 0.644032, " them", false], [22590, 0.156711, " the", false], [39936, 0.126916, " these", false], [39944, 0.056844, " those", false], [39931, 0.008158, " their", false], [32234, 0.001275, " this", false], [32464, 0.000927, " what", false], [32227, 0.000911, " that", false], [21902, 0.000489, " its", false], [22248, 0.000487, " our", false]]], "qwen": [279, 2, 0.15079525113105774, [[1105, 0.632266, " them", false], [279, 0.150795, " the", false], [1493, 0.111533, " these", false], [1846, 0.076856, " those", false], [862, 0.017848, " their", false], [1181, 0.004362, " its", false], [419, 0.001052, " this", false], [432, 0.000924, " it", false], [429, 0.000873, " that", false], [1128, 0.000716, " what", false]]]}, "raw_delta": -0.00420805811882019, "tuned_delta": 0.0026042196882777565}, {"byte_start": 1380, "byte_end": 1385, "display": {"text": " most", "kind": "normal"}, "is_word": true, "word_id": 232, "word_key": " most", "bytes_hex": "20 6d 6f 73 74", "compression": {"rwkv": "5.64% 5.64% 5.64% 5.64% 5.64%", "qwen": "5.22% 5.22% 5.22% 5.22% 5.22%"}, "model_tokens": {"rwkv": [[31461, " most", "normal", 0.21210476756095886]], "qwen": [[1429, " most", "normal", 0.2352813184261322]]}, "loss": {"rwkv": 5.635527503472513, "qwen": 5.218853526398253}, "topk": {"rwkv": [31461, 1, 0.21210476756095886, [[31461, 0.212105, " most", false], [31458, 0.077855, " more", false], [56162, 0.055577, " examples", false], [32448, 0.036344, " ways", false], [37970, 0.033799, " cases", false], [30273, 0.024768, " best", false], [21952, 0.020174, " key", false], [38328, 0.01885, " early", false], [31580, 0.016924, " ones", false], [56200, 0.015623, " failures", false]]], "qwen": [1429, 1, 0.2352813184261322, [[1429, 0.235281, " most", false], [803, 0.115337, " more", false], [1376, 0.040874, " key", false], [10295, 0.033427, " examples", false], [3598, 0.029234, " major", false], [1850, 0.02745, " best", false], [5510, 0.024026, " ways", false], [5048, 0.020669, " cases", false], [6174, 0.016742, " ones", false], [18366, 0.01493, " lessons", false]]]}, "raw_delta": 0.023105311393737782, "tuned_delta": 0.029917589200835728}, {"byte_start": 1385, "byte_end": 1395, "display": {"text": " prominent", "kind": "normal"}, "is_word": true, "word_id": 233, "word_key": " prominent", "bytes_hex": "20 70 72 6f 6d 69 6e 65 6e 74", "compression": {"rwkv": "3.66% 3.66% 3.66% 3.66% 3.66% 3.66% 3.66% 3.66% 3.66% 3.66%", "qwen": "3.58% 3.58% 3.58% 3.58% 3.58% 3.58% 3.58% 3.58% 3.58% 3.58%"}, "model_tokens": {"rwkv": [[60273, " prominent", "normal", 0.1293681561946869]], "qwen": [[20469, " prominent", "normal", 0.13768811523914337]]}, "loss": {"rwkv": 3.6630928772571334, "qwen": 3.5756549627536587}, "topk": {"rwkv": [60273, 1, 0.1293681561946869, [[60273, 0.129368, " prominent", false], [52321, 0.09323, " notable", false], [45958, 0.082936, " famous", false], [59829, 0.073473, " important", false], [57323, 0.049418, " striking", false], [52796, 0.045011, " salient", false], [56056, 0.041325, " dramatic", false], [63870, 0.036203, " significant", false], [52346, 0.028749, " obvious", false], [63667, 0.02365, " interesting", false]]], "qwen": [20469, 2, 0.13768811523914337, [[27190, 0.155824, " notable", false], [20469, 0.137688, " prominent", false], [2989, 0.103076, " important", false], [11245, 0.07209, " famous", false], [89068, 0.059458, " egregious", false], [21771, 0.050865, " dramatic", false], [5089, 0.043584, " significant", false], [4274, 0.026176, " sal", false], [7040, 0.020387, " interesting", false], [4185, 0.018432, " common", false]]]}, "raw_delta": 0.00484858751296996, "tuned_delta": 0.011660865320067906}, {"byte_start": 1395, "byte_end": 1397, "display": {"text": ".\n", "kind": "control"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e 0a", "compression": {"rwkv": "16.98% 27.61%", "qwen": "47.88% 47.88%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.39206990599632263], [261, "\n\n", "control", 0.0469522625207901]], "qwen": [[382, ".\n\n", "control", 0.0003474658587947488]]}, "loss": {"rwkv": 22.295555685613127, "qwen": 47.87850528129607}, "topk": {"rwkv": [47, 1, 0.39206990599632263, [[47, 0.39207, ".", false], [31580, 0.13884, " ones", false], [56162, 0.137938, " examples", false], [4706, 0.083455, " of", false], [37970, 0.052676, " cases", false], [21265, 0.033871, " and", false], [45, 0.024575, ",", false], [59, 0.019074, ":", false], [4596, 0.012006, " in", false], [56200, 0.008213, " failures", false]]], "qwen": [382, 68, 0.0003474658587947488, [[6174, 0.231678, " ones", false], [13, 0.230389, ".", false], [10295, 0.146838, " examples", false], [5048, 0.070555, " cases", false], [315, 0.062951, " of", false], [323, 0.03409, " and", false], [624, 0.033358, ".\n", false], [11, 0.029415, ",", false], [4221, 0.014615, " among", false], [27850, 0.010837, " failures", false]]]}, "raw_delta": -1.4186199506123862, "tuned_delta": -1.4118076728052882}, {"byte_start": 1397, "byte_end": 1398, "display": {"text": "\n", "kind": "control"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "0a", "compression": {"rwkv": "27.61%", "qwen": "47.88%"}, "model_tokens": {"rwkv": [[261, "\n\n", "control", 0.0469522625207901]], "qwen": [[382, ".\n\n", "control", 0.0003474658587947488]]}, "loss": {"rwkv": 27.614084767015314, "qwen": 47.87850528129607}, "topk": {"rwkv": [261, 4, 0.0469522625207901, [[267, 0.270712, "  ", false], [11, 0.178545, "\n", false], [20996, 0.082512, " The", false], [261, 0.046952, "\n\n", false], [3913, 0.034946, " In", false], [20556, 0.026386, " One", false], [308, 0.016195, " I", false], [265, 0.01473, " \n", false], [19907, 0.011665, " For", false], [37451, 0.010179, " There", false]]], "qwen": [382, 68, 0.0003474658587947488, [[6174, 0.231678, " ones", false], [13, 0.230389, ".", false], [10295, 0.146838, " examples", false], [5048, 0.070555, " cases", false], [315, 0.062951, " of", false], [323, 0.03409, " and", false], [624, 0.033358, ".\n", false], [11, 0.029415, ",", false], [4221, 0.014615, " among", false], [27850, 0.010837, " failures", false]]]}, "raw_delta": -1.1236980756123862, "tuned_delta": -1.1168857978052882}, {"byte_start": 1398, "byte_end": 1400, "display": {"text": "In", "kind": "normal"}, "is_word": true, "word_id": 234, "word_key": "in", "bytes_hex": "49 6e", "compression": {"rwkv": "30.01% 30.01%", "qwen": "28.37% 28.37%"}, "model_tokens": {"rwkv": [[1136, "In", "normal", 0.03572390228509903]], "qwen": [[641, "In", "normal", 0.043021783232688904]]}, "loss": {"rwkv": 30.00918395599113, "qwen": 28.367428971722216}, "topk": {"rwkv": [1136, 3, 0.03572390228509903, [[53648, 0.294271, "Question", false], [6699, 0.087629, "The", false], [1136, 0.035724, "In", false], [66, 0.033058, "A", false], [6393, 0.021383, "One", false], [820, 0.019638, "AI", false], [33161, 0.017703, "Human", false], [50, 0.012007, "1", false], [36, 0.011134, "#", false], [5585, 0.010381, "Ass", false]]], "qwen": [641, 2, 0.043021783232688904, [[785, 0.132259, "The", false], [641, 0.043022, "In", false], [16, 0.029539, "1", false], [33975, 0.027545, "Human", false], [32, 0.022505, "A", false], [3966, 0.01935, "One", false], [22029, 0.013633, "Figure", false], [5338, 0.012848, "First", false], [2132, 0.011323, "It", false], [17, 0.009716, "2", false]]]}, "raw_delta": 0.09103822708129883, "tuned_delta": 0.09785050488839678}, {"byte_start": 1400, "byte_end": 1409, "display": {"text": " computer", "kind": "normal"}, "is_word": true, "word_id": 235, "word_key": " computer", "bytes_hex": "20 63 6f 6d 70 75 74 65 72", "compression": {"rwkv": "10.77% 10.77% 10.77% 10.77% 10.77% 10.77% 10.77% 10.77% 10.77%", "qwen": "12.68% 12.68% 12.68% 12.68% 12.68% 12.68% 12.68% 12.68% 12.68%"}, "model_tokens": {"rwkv": [[55809, " computer", "normal", 0.004494124557822943]], "qwen": [[6366, " computer", "normal", 0.001782963052392006]]}, "loss": {"rwkv": 10.77011922885858, "qwen": 12.682649431400927}, "topk": {"rwkv": [55809, 22, 0.004494124557822943, [[22590, 0.400433, " the", false], [3492, 0.186495, " 19", false], [3493, 0.033893, " 20", false], [332, 0.029414, " a", false], [38328, 0.025475, " early", false], [62293, 0.015469, " particular", false], [32234, 0.0128, " this", false], [21823, 0.012641, " his", false], [31370, 0.012164, " many", false], [4677, 0.01075, " my", false]]], "qwen": [6366, 32, 0.001782963052392006, [[279, 0.399548, " the", false], [220, 0.326221, " ", false], [264, 0.019494, " a", false], [825, 0.011365, " one", false], [419, 0.009697, " this", false], [847, 0.008932, " my", false], [1657, 0.007462, " many", false], [1045, 0.006665, " some", false], [71278, 0.006415, " reinforcement", false], [806, 0.00632, " his", false]]]}, "raw_delta": -0.10605319341023767, "tuned_delta": -0.09924091560313972}, {"byte_start": 1409, "byte_end": 1415, "display": {"text": " chess", "kind": "normal"}, "is_word": true, "word_id": 236, "word_key": " chess", "bytes_hex": "20 63 68 65 73 73", "compression": {"rwkv": "11.79% 11.79% 11.79% 11.79% 11.79% 11.79%", "qwen": "7.39% 7.39% 7.39% 7.39% 7.39% 7.39%"}, "model_tokens": {"rwkv": [[38013, " chess", "normal", 0.01989469863474369]], "qwen": [[32719, " chess", "normal", 0.08553595095872879]]}, "loss": {"rwkv": 11.787645028096673, "qwen": 7.39026075747072}, "topk": {"rwkv": [38013, 5, 0.01989469863474369, [[47732, 0.769843, " vision", false], [52814, 0.102841, " science", false], [56329, 0.034788, " graphics", false], [38576, 0.022059, " games", false], [38013, 0.019895, " chess", false], [46, 0.00895, "-", false], [46075, 0.003713, " gaming", false], [63795, 0.003197, " programming", false], [57181, 0.002284, " security", false], [30941, 0.00207, " game", false]]], "qwen": [32719, 3, 0.08553595095872879, [[11129, 0.712659, " vision", false], [8038, 0.097844, " science", false], [32719, 0.085536, " chess", false], [3868, 0.012228, " games", false], [5994, 0.011351, " Go", false], [1809, 0.008439, " game", false], [14181, 0.006157, " graphics", false], [12, 0.005733, "-", false], [1506, 0.004232, "ized", false], [15473, 0.003795, " programming", false]]]}, "raw_delta": 0.2438427607218425, "tuned_delta": 0.25065503852894044}, {"byte_start": 1415, "byte_end": 1416, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "3.22%", "qwen": "5.84%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.8376491665840149]], "qwen": [[11, ",", "normal", 0.7231948971748352]]}, "loss": {"rwkv": 3.2228172910483432, "qwen": 5.84429509357174}, "topk": {"rwkv": [45, 1, 0.8376491665840149, [[45, 0.837649, ",", false], [21265, 0.014995, " and", false], [22590, 0.014031, " the", false], [275, 0.012691, " (", false], [39934, 0.011163, " there", false], [4596, 0.010493, " in", false], [4858, 0.007916, " we", false], [3609, 0.006985, " AI", false], [59, 0.005627, ":", false], [52491, 0.0044, " playing", false]]], "qwen": [11, 1, 0.7231948971748352, [[11, 0.723195, ",", false], [320, 0.040994, " (", false], [7468, 0.030147, " programs", false], [304, 0.029816, " in", false], [3412, 0.019746, " research", false], [323, 0.01594, " and", false], [279, 0.013935, " the", false], [1052, 0.012069, " there", false], [369, 0.007485, " for", false], [432, 0.005921, " it", false]]]}, "raw_delta": -0.14536559581756592, "tuned_delta": -0.13855331801046797}, {"byte_start": 1416, "byte_end": 1420, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 237, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "5.07% 5.07% 5.07% 5.07%", "qwen": "6.35% 6.35% 6.35% 6.35%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.32705602049827576]], "qwen": [[279, " the", "normal", 0.24443350732326508]]}, "loss": {"rwkv": 5.071974753125262, "qwen": 6.351518688749366}, "topk": {"rwkv": [22590, 1, 0.32705602049827576, [[22590, 0.327056, " the", false], [21700, 0.073048, " for", false], [332, 0.043196, " a", false], [4601, 0.038182, " it", false], [39934, 0.031349, " there", false], [22226, 0.024075, " one", false], [4596, 0.015944, " in", false], [63843, 0.010618, " researchers", false], [38328, 0.010536, " early", false], [4858, 0.010243, " we", false]]], "qwen": [279, 1, 0.24443350732326508, [[279, 0.244434, " the", false], [264, 0.051798, " a", false], [369, 0.051381, " for", false], [1052, 0.042275, " there", false], [432, 0.040178, " it", false], [11811, 0.018852, " researchers", false], [304, 0.017217, " in", false], [825, 0.016138, " one", false], [32719, 0.013971, " chess", false], [892, 0.011749, " which", false]]]}, "raw_delta": -0.07095298171043396, "tuned_delta": -0.06414070390333601}, {"byte_start": 1420, "byte_end": 1428, "display": {"text": " methods", "kind": "normal"}, "is_word": true, "word_id": 238, "word_key": " methods", "bytes_hex": "20 6d 65 74 68 6f 64 73", "compression": {"rwkv": "14.58% 14.58% 14.58% 14.58% 14.58% 14.58% 14.58% 14.58%", "qwen": "14.12% 14.12% 14.12% 14.12% 14.12% 14.12% 14.12% 14.12%"}, "model_tokens": {"rwkv": [[52224, " methods", "normal", 0.0015434433007612824]], "qwen": [[5413, " methods", "normal", 0.0019067905377596617]]}, "loss": {"rwkv": 14.581927415235127, "qwen": 14.116621903976391}, "topk": {"rwkv": [52224, 96, 0.0015434433007612824, [[38499, 0.151814, " first", false], [31461, 0.043847, " most", false], [38328, 0.022949, " early", false], [30273, 0.021167, " best", false], [31581, 0.019889, " only", false], [38720, 0.017393, " human", false], [31356, 0.015804, " main", false], [52013, 0.014256, " initial", false], [39802, 0.011746, " state", false], [3492, 0.009615, " 19", false]]], "qwen": [5413, 86, 0.0019067905377596617, [[1156, 0.0676, " first", false], [1429, 0.042103, " most", false], [1850, 0.030411, " best", false], [4124, 0.021152, " early", false], [3738, 0.020591, " human", false], [220, 0.016693, " ", false], [17755, 0.015041, " lesson", false], [3491, 0.01422, " problem", false], [5486, 0.012232, " approach", false], [2856, 0.01215, " initial", false]]]}, "raw_delta": 0.025802016258239746, "tuned_delta": 0.032614294065337696}, {"byte_start": 1428, "byte_end": 1433, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 239, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"rwkv": "3.80% 3.80% 3.80% 3.80% 3.80%", "qwen": "4.31% 4.31% 4.31% 4.31% 4.31%"}, "model_tokens": {"rwkv": [[32227, " that", "normal", 0.3481791615486145]], "qwen": [[429, " that", "normal", 0.3024786710739136]]}, "loss": {"rwkv": 3.803981064843946, "qwen": 4.3127367029732895}, "topk": {"rwkv": [32227, 1, 0.3481791615486145, [[32227, 0.348179, " that", false], [4706, 0.211215, " of", false], [59506, 0.03931, " developed", false], [21700, 0.036227, " for", false], [32354, 0.035251, " used", false], [37810, 0.030992, " based", false], [31461, 0.027027, " most", false], [32462, 0.020337, " were", false], [59868, 0.01151, " initially", false], [59206, 0.010087, " available", false]]], "qwen": [429, 1, 0.3024786710739136, [[429, 0.302479, " that", false], [315, 0.16364, " of", false], [369, 0.053253, " for", false], [1483, 0.048816, " used", false], [7881, 0.047778, " developed", false], [1033, 0.037098, " were", false], [525, 0.017987, " are", false], [3118, 0.016369, " based", false], [614, 0.01535, " have", false], [1429, 0.014283, " most", false]]]}, "raw_delta": -0.028211402893066395, "tuned_delta": -0.02139912508596845}, {"byte_start": 1433, "byte_end": 1442, "display": {"text": " defeated", "kind": "normal"}, "is_word": true, "word_id": 240, "word_key": " defeated", "bytes_hex": "20 64 65 66 65 61 74 65 64", "compression": {"rwkv": "13.84% 13.84% 13.84% 13.84% 13.84% 13.84% 13.84% 13.84% 13.84%", "qwen": "15.80% 15.80% 15.80% 15.80% 15.80% 15.80% 15.80% 15.80% 15.80%"}, "model_tokens": {"rwkv": [[55934, " defeated", "normal", 0.0010127826826646924]], "qwen": [[23283, " defeated", "normal", 0.00037607268313877285]]}, "loss": {"rwkv": 13.83835086963806, "qwen": 15.800972930162544}, "topk": {"rwkv": [55934, 100, 0.0010127826826646924, [[56540, 0.127639, " leverage", false], [32462, 0.09446, " were", false], [31059, 0.061542, " have", false], [22777, 0.041473, " won", false], [21286, 0.035177, " are", false], [31351, 0.030668, " made", false], [47812, 0.026745, " worked", false], [21795, 0.021164, " had", false], [46936, 0.0186, " proved", false], [30256, 0.017255, " beat", false]]], "qwen": [23283, 231, 0.00037607268313877285, [[1033, 0.102351, " were", false], [614, 0.076363, " have", false], [32064, 0.056497, " leverage", false], [525, 0.055837, " are", false], [27505, 0.033256, " lever", false], [6439, 0.030144, " worked", false], [29701, 0.024997, " dominated", false], [975, 0.01789, " work", false], [1865, 0.016655, " made", false], [18651, 0.013735, " proved", false]]]}, "raw_delta": -0.1088308758205837, "tuned_delta": -0.10201859801348576}, {"byte_start": 1442, "byte_end": 1446, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 241, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "3.84% 3.84% 3.84% 3.84%", "qwen": "5.75% 5.75% 5.75% 5.75%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.4252595901489258]], "qwen": [[279, " the", "normal", 0.27914050221443176]]}, "loss": {"rwkv": 3.839203111740649, "qwen": 5.7529271605177374}, "topk": {"rwkv": [22590, 1, 0.4252595901489258, [[22590, 0.42526, " the", false], [38720, 0.107821, " human", false], [38013, 0.058712, " chess", false], [46227, 0.049112, " humans", false], [20184, 0.045005, " Kas", false], [40213, 0.041724, " world", false], [38621, 0.03617, " grand", false], [19948, 0.030579, " Gar", false], [332, 0.01633, " a", false], [22615, 0.013786, " top", false]]], "qwen": [279, 1, 0.27914050221443176, [[279, 0.279141, " the", false], [1879, 0.105652, " world", false], [3738, 0.097588, " human", false], [12677, 0.088407, " humans", false], [6662, 0.064503, " grand", false], [1909, 0.062897, " top", false], [32719, 0.05791, " chess", false], [3746, 0.012339, " strong", false], [678, 0.010331, " all", false], [37542, 0.009515, " Kas", false]]]}, "raw_delta": -0.10611939430236816, "tuned_delta": -0.09930711649527021}, {"byte_start": 1446, "byte_end": 1452, "display": {"text": " world", "kind": "normal"}, "is_word": true, "word_id": 242, "word_key": " world", "bytes_hex": "20 77 6f 72 6c 64", "compression": {"rwkv": "2.75% 2.75% 2.75% 2.75% 2.75% 2.75%", "qwen": "4.30% 4.30% 4.30% 4.30% 4.30% 4.30%"}, "model_tokens": {"rwkv": [[40213, " world", "normal", 0.40412285923957825]], "qwen": [[1879, " world", "normal", 0.2394600361585617]]}, "loss": {"rwkv": 2.74731965794285, "qwen": 4.29613163471361}, "topk": {"rwkv": [40213, 1, 0.40412285923957825, [[40213, 0.404123, " world", false], [30273, 0.151577, " best", false], [38720, 0.088457, " human", false], [60571, 0.055939, " strongest", false], [22615, 0.053982, " top", false], [38621, 0.037531, " grand", false], [39471, 0.019236, " reign", false], [37576, 0.010089, " World", false], [52196, 0.00882, " masters", false], [55716, 0.00702, " champion", false]]], "qwen": [1879, 2, 0.2394600361585617, [[1850, 0.356442, " best", false], [1879, 0.23946, " world", false], [29905, 0.048002, " strongest", false], [6662, 0.046616, " grand", false], [3738, 0.045049, " human", false], [1909, 0.040378, " top", false], [89956, 0.026188, " reigning", false], [32719, 0.013202, " chess", false], [1602, 0.012916, " very", false], [12677, 0.011226, " humans", false]]]}, "raw_delta": -0.08588437239329018, "tuned_delta": -0.07907209458619223}, {"byte_start": 1452, "byte_end": 1461, "display": {"text": " champion", "kind": "normal"}, "is_word": true, "word_id": 243, "word_key": " champion", "bytes_hex": "20 63 68 61 6d 70 69 6f 6e", "compression": {"rwkv": "1.19% 1.19% 1.19% 1.19% 1.19% 1.19% 1.19% 1.19% 1.19%", "qwen": "3.55% 3.55% 3.55% 3.55% 3.55% 3.55% 3.55% 3.55% 3.55%"}, "model_tokens": {"rwkv": [[55716, " champion", "normal", 0.5563649535179138]], "qwen": [[18319, " champion", "normal", 0.17004424333572388]]}, "loss": {"rwkv": 1.1897224729553082, "qwen": 3.550024794365723}, "topk": {"rwkv": [55716, 1, 0.5563649535179138, [[55716, 0.556365, " champion", false], [59283, 0.241155, " champions", false], [460, 0.063438, "'s", false], [38013, 0.05604, " chess", false], [46, 0.013933, "-", false], [37996, 0.012065, " champ", false], [38621, 0.011565, " grand", false], [64275, 0.010423, " championship", false], [52196, 0.008135, " masters", false], [46526, 0.003634, " master", false]]], "qwen": [18319, 2, 0.17004424333572388, [[33738, 0.404083, " champions", false], [18319, 0.170044, " champion", false], [594, 0.129451, "'s", false], [32719, 0.105916, " chess", false], [14800, 0.066794, "-class", false], [536, 0.024879, " class", false], [11582, 0.016839, "-ch", false], [21553, 0.013702, " championship", false], [1909, 0.005558, " top", false], [6662, 0.005017, " grand", false]]]}, "raw_delta": -0.13088295194837785, "tuned_delta": -0.1240706741412799}, {"byte_start": 1461, "byte_end": 1462, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "44.52%", "qwen": "45.26%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.0850820392370224]], "qwen": [[11, ",", "normal", 0.08129944652318954]]}, "loss": {"rwkv": 44.52066727743285, "qwen": 45.25763013464507}, "topk": {"rwkv": [45, 3, 0.0850820392370224, [[4596, 0.219689, " in", false], [32462, 0.197696, " were", false], [45, 0.085082, ",", false], [275, 0.039967, " (", false], [36381, 0.025634, " Bobby", false], [21286, 0.024774, " are", false], [28951, 0.023878, " Gary", false], [21265, 0.017112, " and", false], [4450, 0.016515, " by", false], [52628, 0.014898, " quickly", false]]], "qwen": [11, 3, 0.08129944652318954, [[1033, 0.322275, " were", false], [304, 0.116513, " in", false], [11, 0.081299, ",", false], [525, 0.051066, " are", false], [320, 0.028895, " (", false], [37542, 0.015117, " Kas", false], [323, 0.013393, " and", false], [518, 0.013335, " at", false], [479, 0.011227, " G", false], [553, 0.00992, " by", false]]]}, "raw_delta": -0.04086589813232422, "tuned_delta": -0.03405362032522627}, {"byte_start": 1462, "byte_end": 1466, "display": {"text": " Kas", "kind": "normal"}, "is_word": true, "word_id": 244, "word_key": " kas", "bytes_hex": "20 4b 61 73", "compression": {"rwkv": "9.58% 9.58% 9.58% 9.58%", "qwen": "14.67% 14.67% 14.67% 14.67%"}, "model_tokens": {"rwkv": [[20184, " Kas", "normal", 0.1184983104467392]], "qwen": [[37542, " Kas", "normal", 0.03861033543944359]]}, "loss": {"rwkv": 9.580396755903271, "qwen": 14.671465882840577}, "topk": {"rwkv": [20184, 1, 0.1184983104467392, [[20184, 0.118498, " Kas", false], [21265, 0.079407, " and", false], [28753, 0.078614, " Deep", false], [37404, 0.071143, " Stock", false], [19948, 0.053127, " Gar", false], [22590, 0.050334, " the", false], [28951, 0.041591, " Gary", false], [32139, 0.030872, " such", false], [50239, 0.020785, " Fischer", false], [4423, 0.016802, " as", false]]], "qwen": [37542, 3, 0.03861033543944359, [[18183, 0.49022, " Deep", false], [479, 0.073292, " G", false], [37542, 0.03861, " Kas", false], [27922, 0.027501, " IBM", false], [24708, 0.025863, " Alpha", false], [279, 0.020899, " the", false], [323, 0.018803, " and", false], [2670, 0.017984, " including", false], [1075, 0.016334, " like", false], [23826, 0.010039, " Gary", false]]]}, "raw_delta": -0.28230881690979004, "tuned_delta": -0.2754965391026921}, {"byte_start": 1466, "byte_end": 1469, "display": {"text": "par", "kind": "normal"}, "is_word": true, "word_id": 245, "word_key": "par", "bytes_hex": "70 61 72", "compression": {"rwkv": "0.06% 0.06% 0.06%", "qwen": "0.00% 0.00% 0.00%"}, "model_tokens": {"rwkv": [[8469, "par", "normal", 0.9902176260948181]], "qwen": [[1732, "par", "normal", 0.9997996687889099]]}, "loss": {"rwkv": 0.059070307816346, "qwen": 0.0012044744350566269}, "topk": {"rwkv": [8469, 1, 0.9902176260948181, [[8469, 0.990218, "par", false], [8484, 0.001847, "per", false], [113, 0.000948, "p", false], [2184, 0.000519, "si", false], [2111, 0.000479, "pa", false], [46, 0.000423, "-", false], [8517, 0.000405, "por", false], [2190, 0.000384, "so", false], [2124, 0.00034, "po", false], [25823, 0.000334, "imir", false]]], "qwen": [1732, 1, 0.9997996687889099, [[1732, 0.9998, "par", false], [318, 5.5e-05, "im", false], [712, 2.2e-05, "per", false], [4270, 2.1e-05, " Par", false], [4272, 1.8e-05, "Par", false], [1346, 1e-05, " par", false], [12, 6e-06, "-", false], [2396, 4e-06, "ram", false], [370, 4e-06, "ab", false], [3380, 3e-06, "pare", false]]]}, "raw_delta": 0.003208763140719384, "tuned_delta": 0.01002104094781733}, {"byte_start": 1469, "byte_end": 1471, "display": {"text": "ov", "kind": "normal"}, "is_word": true, "word_id": 246, "word_key": "ov", "bytes_hex": "6f 76", "compression": {"rwkv": "0.01% 0.01%", "qwen": "0.02% 0.02%"}, "model_tokens": {"rwkv": [[2105, "ov", "normal", 0.9987603425979614]], "qwen": [[859, "ov", "normal", 0.99774569272995]]}, "loss": {"rwkv": 0.011144475775909999, "qwen": 0.020349439880208684}, "topk": {"rwkv": [2105, 1, 0.9987603425979614, [[2105, 0.99876, "ov", false], [2106, 0.001, "ow", false], [28017, 5.4e-05, "ов", false], [8311, 3.6e-05, "off", false], [8443, 3e-05, "ova", false], [112, 2.9e-05, "o", false], [45, 2.1e-05, ",", false], [119, 8e-06, "v", false], [2095, 5e-06, "ok", false], [7745, 4e-06, "ian", false]]], "qwen": [859, 1, 0.99774569272995, [[859, 0.997746, "ov", false], [994, 0.001156, "ove", false], [363, 0.000447, "ow", false], [45088, 0.000114, "ovi", false], [1103, 7e-05, "ian", false], [1055, 5.9e-05, "of", false], [12660, 4.8e-05, "ova", false], [50114, 3.2e-05, "ovich", false], [30835, 2.2e-05, "iov", false], [2308, 1.8e-05, " No", false]]]}, "raw_delta": -0.0005104315932840109, "tuned_delta": 0.006301846213813936}, {"byte_start": 1471, "byte_end": 1472, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "1.83%", "qwen": "2.13%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.9029375910758972]], "qwen": [[11, ",", "normal", 0.8888115882873535]]}, "loss": {"rwkv": 1.8315464386285667, "qwen": 2.125631262784684}, "topk": {"rwkv": [45, 1, 0.9029375910758972, [[45, 0.902938, ",", false], [4596, 0.041396, " in", false], [275, 0.035844, " (", false], [21265, 0.00726, " and", false], [460, 0.001268, "'s", false], [4424, 0.001128, " at", false], [32462, 0.000583, " were", false], [326, 0.000454, " [", false], [4450, 0.000399, " by", false], [9816, 0.000381, "—", false]]], "qwen": [11, 1, 0.8888115882873535, [[11, 0.888812, ",", false], [304, 0.052188, " in", false], [320, 0.023062, " (", false], [323, 0.009136, " and", false], [594, 0.004451, "'s", false], [1154, 0.002869, " ,", false], [508, 0.002651, " [", false], [518, 0.001571, " at", false], [220, 0.001497, " ", false], [1033, 0.000954, " were", false]]]}, "raw_delta": -0.0163075253367424, "tuned_delta": -0.009495247529644455}, {"byte_start": 1472, "byte_end": 1475, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 247, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "6.57% 6.57% 6.57%", "qwen": "8.98% 8.98% 8.98%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.3318016529083252]], "qwen": [[304, " in", "normal", 0.22436822950839996]]}, "loss": {"rwkv": 6.574782087384598, "qwen": 8.983582560879153}, "topk": {"rwkv": [4596, 1, 0.3318016529083252, [[4596, 0.331802, " in", false], [32462, 0.312467, " were", false], [21265, 0.044434, " and", false], [21286, 0.024063, " are", false], [4450, 0.013706, " by", false], [4424, 0.011338, " at", false], [32354, 0.011072, " used", false], [47054, 0.010619, " relied", false], [56427, 0.008694, " included", false], [21532, 0.008006, " did", false]]], "qwen": [304, 2, 0.22436822950839996, [[1033, 0.40179, " were", false], [304, 0.224368, " in", false], [39913, 0.022348, " relied", false], [1030, 0.02026, " had", false], [323, 0.019035, " and", false], [1483, 0.018675, " used", false], [525, 0.01754, " are", false], [6398, 0.015118, " involved", false], [1521, 0.012167, " did", false], [518, 0.011098, " at", false]]]}, "raw_delta": -0.133572260538737, "tuned_delta": -0.12675998273163905}, {"byte_start": 1475, "byte_end": 1478, "display": {"text": " 19", "kind": "normal"}, "is_word": true, "word_id": 248, "word_key": " 19", "bytes_hex": "20 31 39", "compression": {"rwkv": "4.86% 4.86% 4.86%", "qwen": "11.89% 1.11% 0.01%"}, "model_tokens": {"rwkv": [[3492, " 19", "normal", 0.4477335512638092]], "qwen": [[220, " ", "normal", 0.5171647071838379], [16, "1", "normal", 0.9404540061950684], [24, "9", "normal", 0.999442994594574]]}, "loss": {"rwkv": 4.8606424717450425, "qwen": 4.336161768515685}, "topk": {"rwkv": [3492, 1, 0.4477335512638092, [[3492, 0.447734, " 19", false], [22590, 0.238869, " the", false], [3493, 0.16905, " 20", false], [332, 0.049587, " a", false], [21823, 0.005994, " his", false], [31198, 0.005136, " just", false], [31277, 0.004657, " less", false], [38013, 0.003596, " chess", false], [20394, 0.003395, " May", false], [22638, 0.002747, " two", false]]], "qwen": [220, 1, 0.5171647071838379, [[220, 0.517165, " ", false], [279, 0.350851, " the", false], [264, 0.03867, " a", false], [806, 0.00853, " his", false], [32719, 0.006975, " chess", false], [1378, 0.003782, " two", false], [862, 0.003536, " their", false], [458, 0.002794, " an", false], [2326, 0.002367, " three", false], [39061, 0.002184, " tournaments", false]]]}, "raw_delta": 0.029083385656122118, "tuned_delta": 0.03589566346322007}, {"byte_start": 1478, "byte_end": 1480, "display": {"text": "97", "kind": "normal"}, "is_word": true, "word_id": 249, "word_key": "97", "bytes_hex": "39 37", "compression": {"rwkv": "2.43% 2.43%", "qwen": "0.83% 2.49%"}, "model_tokens": {"rwkv": [[717, "97", "normal", 0.7652660608291626]], "qwen": [[24, "9", "normal", 0.9547744393348694], [22, "7", "normal", 0.8708397746086121]]}, "loss": {"rwkv": 2.4303212358725212, "qwen": 1.6643060414114925}, "topk": {"rwkv": [717, 1, 0.7652660608291626, [[717, 0.765266, "97", false], [716, 0.163144, "96", false], [719, 0.033163, "99", false], [718, 0.008326, "98", false], [710, 0.007695, "90", false], [709, 0.005563, "89", false], [715, 0.005232, "95", false], [713, 0.00312, "93", false], [705, 0.001794, "85", false], [714, 0.001756, "94", false]]], "qwen": [24, 1, 0.9547744393348694, [[24, 0.954774, "9", false], [23, 0.043984, "8", false], [22, 0.001088, "7", false], [21, 7.7e-05, "6", false], [20, 1.7e-05, "5", false], [339, 1.6e-05, "th", false], [19, 7e-06, "4", false], [220, 4e-06, " ", false], [15, 4e-06, "0", false], [18, 4e-06, "3", false]]]}, "raw_delta": 0.04247690178453922, "tuned_delta": 0.04928917959163717}, {"byte_start": 1480, "byte_end": 1481, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "36.35%", "qwen": "42.10%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.1334189772605896]], "qwen": [[11, ",", "normal", 0.09688328206539154]]}, "loss": {"rwkv": 36.34915239739771, "qwen": 42.095105661422956}, "topk": {"rwkv": [45, 3, 0.1334189772605896, [[32462, 0.386871, " were", false], [21265, 0.20885, " and", false], [45, 0.133419, ",", false], [275, 0.04482, " (", false], [32354, 0.02198, " used", false], [21286, 0.015783, " are", false], [21795, 0.012351, " had", false], [21532, 0.009035, " did", false], [56500, 0.00882, " involved", false], [47054, 0.007693, " relied", false]]], "qwen": [11, 3, 0.09688328206539154, [[1033, 0.439887, " were", false], [323, 0.13122, " and", false], [11, 0.096883, ",", false], [320, 0.035252, " (", false], [12, 0.027816, "-", false], [6398, 0.019639, " involved", false], [5230, 0.019083, " included", false], [525, 0.017318, " are", false], [1030, 0.014978, " had", false], [1521, 0.012527, " did", false]]]}, "raw_delta": -0.31862330436706543, "tuned_delta": -0.3118110265599675}, {"byte_start": 1481, "byte_end": 1486, "display": {"text": " were", "kind": "normal"}, "is_word": true, "word_id": 250, "word_key": " were", "bytes_hex": "20 77 65 72 65", "compression": {"rwkv": "5.52% 5.52% 5.52% 5.52% 5.52%", "qwen": "2.68% 2.68% 2.68% 2.68% 2.68%"}, "model_tokens": {"rwkv": [[32462, " were", "normal", 0.216700941324234]], "qwen": [[1033, " were", "normal", 0.47591105103492737]]}, "loss": {"rwkv": 5.522816953403063, "qwen": 2.678090406599476}, "topk": {"rwkv": [32462, 1, 0.216700941324234, [[32462, 0.216701, " were", false], [3493, 0.201141, " 20", false], [21265, 0.131665, " and", false], [3492, 0.123927, " 19", false], [21286, 0.019229, " are", false], [32354, 0.018702, " used", false], [22590, 0.013665, " the", false], [47054, 0.010619, " relied", false], [21795, 0.010595, " had", false], [4596, 0.010158, " in", false]]], "qwen": [1033, 1, 0.47591105103492737, [[1033, 0.475911, " were", false], [220, 0.043079, " ", false], [39913, 0.037907, " relied", false], [323, 0.032855, " and", false], [1521, 0.031137, " did", false], [1483, 0.029892, " used", false], [5230, 0.016554, " included", false], [1030, 0.015625, " had", false], [6398, 0.014981, " involved", false], [525, 0.013672, " are", false]]]}, "raw_delta": 0.15774513483047486, "tuned_delta": 0.16455741263757281}, {"byte_start": 1486, "byte_end": 1492, "display": {"text": " based", "kind": "normal"}, "is_word": true, "word_id": 251, "word_key": " based", "bytes_hex": "20 62 61 73 65 64", "compression": {"rwkv": "7.23% 7.23% 7.23% 7.23% 7.23% 7.23%", "qwen": "6.65% 6.65% 6.65% 6.65% 6.65% 6.65%"}, "model_tokens": {"rwkv": [[37810, " based", "normal", 0.0891607403755188]], "qwen": [[3118, " based", "normal", 0.109536312520504]]}, "loss": {"rwkv": 7.232260296123059, "qwen": 6.646914477533975}, "topk": {"rwkv": [37810, 1, 0.0891607403755188, [[37810, 0.089161, " based", false], [22187, 0.080918, " not", false], [22590, 0.051144, " the", false], [52094, 0.042745, " largely", false], [332, 0.040715, " a", false], [52224, 0.035886, " methods", false], [63541, 0.029135, " essentially", false], [39944, 0.024888, " those", false], [21256, 0.018984, " all", false], [32386, 0.013998, " very", false]]], "qwen": [3118, 1, 0.109536312520504, [[3118, 0.109536, " based", false], [537, 0.085856, " not", false], [279, 0.033277, " the", false], [678, 0.031775, " all", false], [264, 0.024103, " a", false], [1602, 0.01956, " very", false], [4586, 0.017779, " general", false], [13771, 0.016204, " largely", false], [1846, 0.0123, " those", false], [11368, 0.011981, " entirely", false]]]}, "raw_delta": 0.03245846430460614, "tuned_delta": 0.03927074211170409}, {"byte_start": 1492, "byte_end": 1495, "display": {"text": " on", "kind": "normal"}, "is_word": true, "word_id": 252, "word_key": " on", "bytes_hex": "20 6f 6e", "compression": {"rwkv": "0.99% 0.99% 0.99%", "qwen": "0.91% 0.91% 0.91%"}, "model_tokens": {"rwkv": [[4712, " on", "normal", 0.8487597107887268]], "qwen": [[389, " on", "normal", 0.860114574432373]]}, "loss": {"rwkv": 0.9920876542571403, "qwen": 0.9058302035883852}, "topk": {"rwkv": [4712, 1, 0.8487597107887268, [[4712, 0.84876, " on", false], [56131, 0.016617, " entirely", false], [4596, 0.013279, " in", false], [60247, 0.013048, " primarily", false], [45145, 0.013011, " almost", false], [32350, 0.011164, " upon", false], [52094, 0.010778, " largely", false], [22187, 0.009406, " not", false], [51919, 0.006351, " heavily", false], [45202, 0.005215, " around", false]]], "qwen": [389, 1, 0.860114574432373, [[389, 0.860115, " on", false], [304, 0.015985, " in", false], [4558, 0.01554, " almost", false], [11368, 0.014561, " entirely", false], [13771, 0.012379, " largely", false], [537, 0.011577, " not", false], [5193, 0.008528, " upon", false], [15503, 0.00716, " primarily", false], [2163, 0.005406, " around", false], [16916, 0.004664, " heavily", false]]]}, "raw_delta": 0.004783128698666893, "tuned_delta": 0.011595406505764839}, {"byte_start": 1495, "byte_end": 1503, "display": {"text": " massive", "kind": "normal"}, "is_word": true, "word_id": 253, "word_key": " massive", "bytes_hex": "20 6d 61 73 73 69 76 65", "compression": {"rwkv": "10.78% 10.78% 10.78% 10.78% 10.78% 10.78% 10.78% 10.78%", "qwen": "14.62% 14.62% 14.62% 14.62% 14.62% 14.62% 14.62% 14.62%"}, "model_tokens": {"rwkv": [[52195, " massive", "normal", 0.008227634243667126]], "qwen": [[10951, " massive", "normal", 0.0015222453512251377]]}, "loss": {"rwkv": 10.777946350391181, "qwen": 14.624349085853574}, "topk": {"rwkv": [52195, 20, 0.008227634243667126, [[332, 0.132743, " a", false], [22590, 0.105036, " the", false], [51832, 0.046816, " general", false], [52224, 0.026951, " methods", false], [30597, 0.020794, " deep", false], [52167, 0.019752, " machine", false], [46658, 0.019043, " neural", false], [56537, 0.015463, " learning", false], [47284, 0.012367, " simple", false], [4419, 0.012326, " an", false]]], "qwen": [10951, 84, 0.0015222453512251377, [[264, 0.132264, " a", false], [279, 0.095771, " the", false], [4586, 0.042222, " general", false], [5538, 0.023053, " deep", false], [6832, 0.022309, " learning", false], [64098, 0.022067, " brute", false], [3738, 0.02184, " human", false], [458, 0.01992, " an", false], [2711, 0.019204, " search", false], [5662, 0.018349, " machine", false]]]}, "raw_delta": -0.21328985691070557, "tuned_delta": -0.20647757910360762}, {"byte_start": 1503, "byte_end": 1504, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "77.77%", "qwen": "80.63%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.013328032568097115]], "qwen": [[11, ",", "normal", 0.011436567641794682]]}, "loss": {"rwkv": 77.77027954792068, "qwen": 80.62753051629504}, "topk": {"rwkv": [45, 15, 0.013328032568097115, [[50897, 0.129948, " amounts", false], [63370, 0.117038, " computation", false], [64423, 0.108269, " improvements", false], [22681, 0.046883, " use", false], [56812, 0.029774, " parallel", false], [38720, 0.027413, " human", false], [63621, 0.016613, " improvement", false], [64862, 0.016359, " computational", false], [59346, 0.01532, " computing", false], [63678, 0.01496, " investments", false]]], "qwen": [11, 13, 0.011436567641794682, [[14713, 0.15872, " amounts", false], [34447, 0.131126, " computation", false], [2711, 0.066927, " search", false], [82599, 0.051758, " computations", false], [54480, 0.044446, " computational", false], [31806, 0.039818, " databases", false], [821, 0.031169, " data", false], [990, 0.029515, " use", false], [24231, 0.02003, " computing", false], [64098, 0.015096, " brute", false]]]}, "raw_delta": -0.15843963623046875, "tuned_delta": -0.1516273584233708}, {"byte_start": 1504, "byte_end": 1509, "display": {"text": " deep", "kind": "normal"}, "is_word": true, "word_id": 254, "word_key": " deep", "bytes_hex": "20 64 65 65 70", "compression": {"rwkv": "15.89% 15.89% 15.89% 15.89% 15.89%", "qwen": "14.99% 14.99% 14.99% 14.99% 14.99%"}, "model_tokens": {"rwkv": [[30597, " deep", "normal", 0.012352976016700268]], "qwen": [[5538, " deep", "normal", 0.01565556600689888]]}, "loss": {"rwkv": 15.892187559792486, "qwen": 14.99295219218517}, "topk": {"rwkv": [30597, 16, 0.012352976016700268, [[38720, 0.073866, " human", false], [31044, 0.052038, " hand", false], [59988, 0.047388, " massively", false], [51832, 0.041399, " general", false], [59262, 0.034128, " carefully", false], [21400, 0.020316, " but", false], [22323, 0.019933, " pre", false], [52195, 0.019486, " massive", false], [39802, 0.01842, " state", false], [59682, 0.018172, " expensive", false]]], "qwen": [5538, 10, 0.01565556600689888, [[855, 0.049514, " pre", false], [4586, 0.047162, " general", false], [64098, 0.044898, " brute", false], [63707, 0.034973, " massively", false], [15279, 0.026881, " parallel", false], [10951, 0.023684, " massive", false], [1424, 0.020637, " hand", false], [1550, 0.019098, " high", false], [3738, 0.017058, " human", false], [5538, 0.015656, " deep", false]]]}, "raw_delta": 0.04986419677734377, "tuned_delta": 0.05667647458444172}, {"byte_start": 1509, "byte_end": 1516, "display": {"text": " search", "kind": "normal"}, "is_word": true, "word_id": 255, "word_key": " search", "bytes_hex": "20 73 65 61 72 63 68", "compression": {"rwkv": "10.39% 10.39% 10.39% 10.39% 10.39% 10.39% 10.39%", "qwen": "5.54% 5.54% 5.54% 5.54% 5.54% 5.54% 5.54%"}, "model_tokens": {"rwkv": [[47202, " search", "normal", 0.0180326197296381]], "qwen": [[2711, " search", "normal", 0.11630882322788239]]}, "loss": {"rwkv": 10.385472113542201, "qwen": 5.542799371917312}, "topk": {"rwkv": [47202, 5, 0.0180326197296381, [[56537, 0.283202, " learning", false], [45, 0.175972, ",", false], [46658, 0.136929, " neural", false], [46, 0.041777, "-", false], [47202, 0.018033, " search", false], [56705, 0.016185, " networks", false], [63384, 0.013179, " connections", false], [32298, 0.012558, " tree", false], [275, 0.0109, " (", false], [22681, 0.009974, " use", false]]], "qwen": [2711, 4, 0.11630882322788239, [[29728, 0.228634, " neural", false], [6832, 0.141765, " learning", false], [11, 0.125937, ",", false], [2711, 0.116309, " search", false], [14155, 0.035094, " networks", false], [26475, 0.026614, " searches", false], [6540, 0.022596, " knowledge", false], [6358, 0.015513, " analysis", false], [34447, 0.014, " computation", false], [82599, 0.011676, " computations", false]]]}, "raw_delta": 0.26853479657854346, "tuned_delta": 0.2753470743856414}, {"byte_start": 1516, "byte_end": 1517, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "32.12%", "qwen": "39.40%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.1677199900150299]], "qwen": [[13, ".", "normal", 0.11249887943267822]]}, "loss": {"rwkv": 32.122506769793326, "qwen": 39.40021921416191}, "topk": {"rwkv": [47, 1, 0.1677199900150299, [[47, 0.16772, ".", false], [45, 0.158341, ",", false], [40085, 0.083364, " using", false], [21265, 0.07879, " and", false], [4596, 0.049754, " in", false], [32487, 0.044998, " with", false], [4706, 0.042484, " of", false], [275, 0.03564, " (", false], [55780, 0.032637, " combined", false], [31601, 0.031853, " over", false]]], "qwen": [13, 2, 0.11249887943267822, [[315, 0.154114, " of", false], [13, 0.112499, ".", false], [11, 0.110164, ",", false], [323, 0.099218, " and", false], [429, 0.052457, " that", false], [320, 0.047566, " (", false], [448, 0.046324, " with", false], [10856, 0.041333, " combined", false], [1667, 0.030094, " using", false], [304, 0.020681, " in", false]]]}, "raw_delta": -0.403562068939209, "tuned_delta": -0.39674979113211106}, {"byte_start": 1517, "byte_end": 1520, "display": {"text": " At", "kind": "normal"}, "is_word": true, "word_id": 256, "word_key": " at", "bytes_hex": "20 41 74", "compression": {"rwkv": "28.37% 28.37% 28.37%", "qwen": "25.76% 25.76% 25.76%"}, "model_tokens": {"rwkv": [[3642, " At", "normal", 0.008991584181785583]], "qwen": [[2411, " At", "normal", 0.013779883272945881]]}, "loss": {"rwkv": 28.365488434144982, "qwen": 25.755385134193023}, "topk": {"rwkv": [3642, 16, 0.008991584181785583, [[20996, 0.190861, " The", false], [3913, 0.09211, " In", false], [29894, 0.061135, " This", false], [28753, 0.031903, " Deep", false], [19555, 0.031, " But", false], [20184, 0.028411, " Kas", false], [29893, 0.027967, " They", false], [3918, 0.027898, " It", false], [267, 0.025542, "  ", false], [29889, 0.024508, " That", false]]], "qwen": [2411, 12, 0.013779883272945881, [[576, 0.210873, " The", false], [1096, 0.054783, " This", false], [2379, 0.052526, " They", false], [220, 0.048822, " ", false], [4220, 0.045169, " These", false], [758, 0.041157, " In", false], [1988, 0.029914, " But", false], [1084, 0.025989, " It", false], [2619, 0.018194, " There", false], [18183, 0.015407, " Deep", false]]]}, "raw_delta": 0.14473485946655273, "tuned_delta": 0.15154713727365068}, {"byte_start": 1520, "byte_end": 1524, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 257, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "1.87% 1.87% 1.87% 1.87%", "qwen": "2.66% 2.66% 2.66% 2.66%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.6572101712226868]], "qwen": [[279, " the", "normal", 0.5542927980422974]]}, "loss": {"rwkv": 1.8667684855252697, "qwen": 2.6602496788230656}, "topk": {"rwkv": [22590, 1, 0.6572101712226868, [[22590, 0.65721, " the", false], [32227, 0.20417, " that", false], [38499, 0.017996, " first", false], [38879, 0.016578, " least", false], [332, 0.014953, " a", false], [37598, 0.009122, " about", false], [32234, 0.008304, " this", false], [22226, 0.006554, " one", false], [32074, 0.005833, " some", false], [21902, 0.004985, " its", false]]], "qwen": [279, 1, 0.5542927980422974, [[279, 0.554293, " the", false], [429, 0.188296, " that", false], [1156, 0.067455, " first", false], [825, 0.020725, " one", false], [264, 0.01993, " a", false], [3245, 0.018709, " least", false], [1817, 0.017859, " each", false], [419, 0.017575, " this", false], [1181, 0.008022, " its", false], [220, 0.007143, " ", false]]]}, "raw_delta": -0.043999940156936646, "tuned_delta": -0.037187662349838696}, {"byte_start": 1524, "byte_end": 1529, "display": {"text": " time", "kind": "normal"}, "is_word": true, "word_id": 258, "word_key": " time", "bytes_hex": "20 74 69 6d 65", "compression": {"rwkv": "0.52% 0.52% 0.52% 0.52% 0.52%", "qwen": "1.04% 1.04% 1.04% 1.04% 1.04%"}, "model_tokens": {"rwkv": [[32251, " time", "normal", 0.8654114603996277]], "qwen": [[882, " time", "normal", 0.748907744884491]]}, "loss": {"rwkv": 0.5248084987608778, "qwen": 1.0428501251452447}, "topk": {"rwkv": [32251, 1, 0.8654114603996277, [[32251, 0.865411, " time", false], [31937, 0.030871, " same", false], [21616, 0.026448, " end", false], [59220, 0.007385, " beginning", false], [39801, 0.006502, " start", false], [38887, 0.006358, " level", false], [22615, 0.004311, " top", false], [38676, 0.004013, " heart", false], [32321, 0.002315, " turn", false], [3492, 0.002012, " 19", false]]], "qwen": [882, 1, 0.748907744884491, [[882, 0.748908, " time", false], [1852, 0.050884, " same", false], [1191, 0.023412, " start", false], [3704, 0.02151, " root", false], [835, 0.019151, " end", false], [7167, 0.014188, " beginning", false], [1909, 0.010463, " top", false], [4746, 0.008314, " heart", false], [1602, 0.006322, " very", false], [16162, 0.005947, " peak", false]]]}, "raw_delta": -0.028726327419281005, "tuned_delta": -0.02191404961218306}, {"byte_start": 1529, "byte_end": 1530, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "5.28%", "qwen": "5.66%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.7434836626052856]], "qwen": [[11, ",", "normal", 0.7307966351509094]]}, "loss": {"rwkv": 5.283307034505481, "qwen": 5.655725790924782}, "topk": {"rwkv": [45, 1, 0.7434836626052856, [[45, 0.743484, ",", false], [4706, 0.072878, " of", false], [22590, 0.031669, " the", false], [4601, 0.024322, " it", false], [32234, 0.023768, " this", false], [32227, 0.014639, " that", false], [32232, 0.014192, " they", false], [39934, 0.011306, " there", false], [20184, 0.009363, " Kas", false], [275, 0.005357, " (", false]]], "qwen": [11, 1, 0.7307966351509094, [[11, 0.730797, ",", false], [315, 0.122308, " of", false], [279, 0.024006, " the", false], [432, 0.020119, " it", false], [419, 0.017418, " this", false], [807, 0.012417, " they", false], [1052, 0.010927, " there", false], [320, 0.009159, " (", false], [1493, 0.006985, " these", false], [429, 0.006148, " that", false]]]}, "raw_delta": -0.020651280879974365, "tuned_delta": -0.01383900307287642}, {"byte_start": 1530, "byte_end": 1535, "display": {"text": " this", "kind": "normal"}, "is_word": true, "word_id": 259, "word_key": " this", "bytes_hex": "20 74 68 69 73", "compression": {"rwkv": "8.51% 8.51% 8.51% 8.51% 8.51%", "qwen": "10.78% 10.78% 10.78% 10.78% 10.78%"}, "model_tokens": {"rwkv": [[32234, " this", "normal", 0.09476910531520844]], "qwen": [[419, " this", "normal", 0.05038928985595703]]}, "loss": {"rwkv": 8.509646530243494, "qwen": 10.776847381252168}, "topk": {"rwkv": [32234, 2, 0.09476910531520844, [[22590, 0.226885, " the", false], [32234, 0.094769, " this", false], [4601, 0.090264, " it", false], [39934, 0.043032, " there", false], [32232, 0.037281, " they", false], [39936, 0.031568, " these", false], [4692, 0.024417, " no", false], [332, 0.022055, " a", false], [38013, 0.020373, " chess", false], [32227, 0.017021, " that", false]]], "qwen": [419, 5, 0.05038928985595703, [[279, 0.223538, " the", false], [432, 0.092244, " it", false], [1052, 0.054495, " there", false], [32719, 0.054022, " chess", false], [419, 0.050389, " this", false], [902, 0.04243, " no", false], [1493, 0.02881, " these", false], [807, 0.024149, " they", false], [264, 0.02267, " a", false], [1429, 0.020667, " most", false]]]}, "raw_delta": -0.12572031021118163, "tuned_delta": -0.11890803240408368}, {"byte_start": 1535, "byte_end": 1539, "display": {"text": " was", "kind": "normal"}, "is_word": true, "word_id": 260, "word_key": " was", "bytes_hex": "20 77 61 73", "compression": {"rwkv": "2.50% 2.50% 2.50% 2.50%", "qwen": "3.42% 3.42% 3.42% 3.42%"}, "model_tokens": {"rwkv": [[22748, " was", "normal", 0.5783950686454773]], "qwen": [[572, " was", "normal", 0.46857208013534546]]}, "loss": {"rwkv": 2.5007653296659274, "qwen": 3.417678471487961}, "topk": {"rwkv": [22748, 1, 0.5783950686454773, [[22748, 0.578395, " was", false], [47211, 0.054076, " seemed", false], [55532, 0.051794, " approach", false], [46561, 0.038011, " method", false], [47202, 0.01586, " search", false], [63841, 0.01389, " represented", false], [57101, 0.012541, " required", false], [38990, 0.011362, " meant", false], [21795, 0.010969, " had", false], [40219, 0.010885, " would", false]]], "qwen": [572, 1, 0.46857208013534546, [[572, 0.468572, " was", false], [9324, 0.09243, " seemed", false], [5486, 0.078204, " approach", false], [1714, 0.041065, " method", false], [2567, 0.038069, " required", false], [2711, 0.021175, " search", false], [8791, 0.019898, " meant", false], [1030, 0.016118, " had", false], [1035, 0.015172, " would", false], [6398, 0.013176, " involved", false]]]}, "raw_delta": -0.0508444607257843, "tuned_delta": -0.04403218291868635}, {"byte_start": 1539, "byte_end": 1546, "display": {"text": " looked", "kind": "normal"}, "is_word": true, "word_id": 261, "word_key": " looked", "bytes_hex": "20 6c 6f 6f 6b 65 64", "compression": {"rwkv": "22.54% 22.54% 22.54% 22.54% 22.54% 22.54% 22.54%", "qwen": "21.48% 21.48% 21.48% 21.48% 21.48% 21.48% 21.48%"}, "model_tokens": {"rwkv": [[46471, " looked", "normal", 0.00015805060684215277]], "qwen": [[6966, " looked", "normal", 0.00023941117979120463]]}, "loss": {"rwkv": 22.542110013890053, "qwen": 21.47896731794644}, "topk": {"rwkv": [46471, 257, 0.00015805060684215277, [[22590, 0.25407, " the", false], [332, 0.138657, " a", false], [61755, 0.102712, " considered", false], [53137, 0.044112, " thought", false], [22187, 0.036023, " not", false], [31968, 0.031128, " seen", false], [4419, 0.031114, " an", false], [57059, 0.012404, " regarded", false], [55616, 0.01204, " believed", false], [47792, 0.011925, " widely", false]]], "qwen": [6966, 208, 0.00023941117979120463, [[279, 0.19248, " the", false], [264, 0.174535, " a", false], [6509, 0.114077, " considered", false], [537, 0.080483, " not", false], [458, 0.058191, " an", false], [3884, 0.025644, " seen", false], [3381, 0.022485, " thought", false], [29969, 0.009631, " unprecedented", false], [13570, 0.009015, " widely", false], [825, 0.008999, " one", false]]]}, "raw_delta": 0.058953148978097, "tuned_delta": 0.06576542678519495}, {"byte_start": 1546, "byte_end": 1551, "display": {"text": " upon", "kind": "normal"}, "is_word": true, "word_id": 262, "word_key": " upon", "bytes_hex": "20 75 70 6f 6e", "compression": {"rwkv": "3.30% 3.30% 3.30% 3.30% 3.30%", "qwen": "1.64% 1.64% 1.64% 1.64% 1.64%"}, "model_tokens": {"rwkv": [[32350, " upon", "normal", 0.4000588357448578]], "qwen": [[5193, " upon", "normal", 0.6352965831756592]]}, "loss": {"rwkv": 3.2967835895314197, "qwen": 1.6362445526461131}, "topk": {"rwkv": [32350, 1, 0.4000588357448578, [[32350, 0.400059, " upon", false], [4424, 0.315113, " at", false], [4712, 0.243661, " on", false], [30678, 0.014842, " down", false], [4811, 0.008916, " to", false], [4423, 0.005162, " as", false], [4833, 0.001703, " up", false], [21295, 0.001662, " ask", false], [30218, 0.000941, " back", false], [4450, 0.000925, " by", false]]], "qwen": [5193, 1, 0.6352965831756592, [[5193, 0.635297, " upon", false], [518, 0.167502, " at", false], [389, 0.115316, " on", false], [1495, 0.05384, " down", false], [311, 0.015149, " to", false], [1182, 0.00164, " back", false], [369, 0.001565, " for", false], [1075, 0.001294, " like", false], [438, 0.001074, " as", false], [4637, 0.000624, " forward", false]]]}, "raw_delta": 0.0920798361301422, "tuned_delta": 0.09889211393724015}, {"byte_start": 1551, "byte_end": 1556, "display": {"text": " with", "kind": "normal"}, "is_word": true, "word_id": 263, "word_key": " with", "bytes_hex": "20 77 69 74 68", "compression": {"rwkv": "6.62% 6.62% 6.62% 6.62% 6.62%", "qwen": "12.53% 12.53% 12.53% 12.53% 12.53%"}, "model_tokens": {"rwkv": [[32487, " with", "normal", 0.16169007122516632]], "qwen": [[448, " with", "normal", 0.03100200742483139]]}, "loss": {"rwkv": 6.621744816580202, "qwen": 12.528736615480607}, "topk": {"rwkv": [32487, 2, 0.16169007122516632, [[4423, 0.657353, " as", false], [32487, 0.16169, " with", false], [4450, 0.082397, " by", false], [60512, 0.035312, " skeptical", false], [4596, 0.0071, " in", false], [38458, 0.005197, " favor", false], [21295, 0.004597, " ask", false], [57263, 0.003525, " somewhat", false], [62624, 0.003029, " suspicious", false], [45, 0.002969, ",", false]]], "qwen": [448, 3, 0.03100200742483139, [[438, 0.876166, " as", false], [553, 0.03154, " by", false], [448, 0.031002, " with", false], [36579, 0.009905, " skept", false], [11, 0.006082, ",", false], [311, 0.004734, " to", false], [304, 0.004288, " in", false], [320, 0.002634, " (", false], [4694, 0.00257, " favor", false], [537, 0.002294, " not", false]]]}, "raw_delta": -0.32755317687988283, "tuned_delta": -0.3207408990727849}, {"byte_start": 1556, "byte_end": 1563, "display": {"text": " dismay", "kind": "normal"}, "is_word": true, "word_id": 264, "word_key": " dismay", "bytes_hex": "20 64 69 73 6d 61 79", "compression": {"rwkv": "13.04% 13.04% 13.04% 13.04% 13.04% 13.04% 13.04%", "qwen": "11.90% 11.90% 11.90% 11.90% 11.90% 11.90% 11.90%"}, "model_tokens": {"rwkv": [[45756, " dismay", "normal", 0.0062906015664339066]], "qwen": [[71982, " dismay", "normal", 0.00986457522958517]]}, "loss": {"rwkv": 13.042220793750673, "qwen": 11.899155303056101}, "topk": {"rwkv": [45756, 19, 0.0062906015664339066, [[60609, 0.22275, " suspicion", false], [62561, 0.202527, " skepticism", false], [32074, 0.077969, " some", false], [21542, 0.065521, " dis", false], [332, 0.050269, " a", false], [38629, 0.03476, " great", false], [46271, 0.029276, " incred", false], [64313, 0.021614, " considerable", false], [39608, 0.019406, " scorn", false], [21523, 0.018603, " der", false]]], "qwen": [71982, 18, 0.00986457522958517, [[66133, 0.185542, " skepticism", false], [2244, 0.114888, " great", false], [37041, 0.105034, " suspicion", false], [1045, 0.05703, " some", false], [264, 0.036511, " a", false], [23839, 0.035585, " considerable", false], [9653, 0.031005, " incred", false], [87006, 0.024041, " scorn", false], [50417, 0.020561, " awe", false], [78398, 0.019158, " disdain", false]]]}, "raw_delta": 0.063385009765625, "tuned_delta": 0.07019728757272295}, {"byte_start": 1563, "byte_end": 1566, "display": {"text": " by", "kind": "normal"}, "is_word": true, "word_id": 265, "word_key": " by", "bytes_hex": "20 62 79", "compression": {"rwkv": "4.41% 4.41% 4.41%", "qwen": "8.77% 8.77% 8.77%"}, "model_tokens": {"rwkv": [[4450, " by", "normal", 0.4775722920894623]], "qwen": [[553, " by", "normal", 0.23240253329277039]]}, "loss": {"rwkv": 4.414496544386801, "qwen": 8.772092628735642}, "topk": {"rwkv": [4450, 1, 0.4775722920894623, [[4450, 0.477572, " by", false], [45, 0.157234, ",", false], [4423, 0.126579, " as", false], [47, 0.068373, ".", false], [51018, 0.042676, " because", false], [21265, 0.031694, " and", false], [4596, 0.020519, " in", false], [59, 0.013243, ":", false], [60, 0.009381, ";", false], [30917, 0.009021, " from", false]]], "qwen": [553, 2, 0.23240253329277039, [[11, 0.27647, ",", false], [553, 0.232403, " by", false], [13, 0.163083, ".", false], [1576, 0.070035, " because", false], [323, 0.067026, " and", false], [438, 0.052422, " as", false], [25, 0.034901, ":", false], [26, 0.016396, ";", false], [320, 0.012731, " (", false], [2474, 0.009707, " since", false]]]}, "raw_delta": -0.24163643519083658, "tuned_delta": -0.23482415738373863}, {"byte_start": 1566, "byte_end": 1570, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 266, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "8.63% 8.63% 8.63% 8.63%", "qwen": "9.55% 9.55% 9.55% 9.55%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.1478879302740097]], "qwen": [[279, " the", "normal", 0.12037070840597153]]}, "loss": {"rwkv": 8.629401489692285, "qwen": 9.545136012910124}, "topk": {"rwkv": [22590, 2, 0.1478879302740097, [[31370, 0.17669, " many", false], [22590, 0.147888, " the", false], [32074, 0.092712, " some", false], [39944, 0.092347, " those", false], [38013, 0.084136, " chess", false], [38720, 0.071006, " human", false], [31461, 0.022281, " most", false], [3609, 0.020041, " AI", false], [46787, 0.016681, " people", false], [332, 0.01658, " a", false]]], "qwen": [279, 3, 0.12037070840597153, [[1657, 0.225981, " many", false], [32719, 0.209662, " chess", false], [279, 0.120371, " the", false], [1846, 0.0733, " those", false], [1045, 0.071325, " some", false], [3738, 0.027125, " human", false], [1429, 0.026412, " most", false], [264, 0.017876, " a", false], [11811, 0.017368, " researchers", false], [6366, 0.017071, " computer", false]]]}, "raw_delta": -0.050779104232788086, "tuned_delta": -0.043966826425690136}, {"byte_start": 1570, "byte_end": 1579, "display": {"text": " majority", "kind": "normal"}, "is_word": true, "word_id": 267, "word_key": " majority", "bytes_hex": "20 6d 61 6a 6f 72 69 74 79", "compression": {"rwkv": "10.90% 10.90% 10.90% 10.90% 10.90% 10.90% 10.90% 10.90% 10.90%", "qwen": "9.64% 9.64% 9.64% 9.64% 9.64% 9.64% 9.64% 9.64% 9.64%"}, "model_tokens": {"rwkv": [[56573, " majority", "normal", 0.00432567810639739]], "qwen": [[8686, " majority", "normal", 0.008159642107784748]]}, "loss": {"rwkv": 10.89535317338019, "qwen": 9.63510921443859}, "topk": {"rwkv": [56573, 26, 0.00432567810639739, [[38720, 0.175776, " human", false], [38013, 0.14459, " chess", false], [38621, 0.091648, " grand", false], [55809, 0.040047, " computer", false], [3609, 0.031813, " AI", false], [51685, 0.028735, " experts", false], [40213, 0.02678, " world", false], [45929, 0.019924, " expert", false], [22615, 0.015653, " top", false], [269, 0.013955, " \"", false]]], "qwen": [8686, 8, 0.008159642107784748, [[32719, 0.593104, " chess", false], [3738, 0.052657, " human", false], [15235, 0.021827, " AI", false], [6366, 0.015761, " computer", false], [6662, 0.015289, " grand", false], [1879, 0.012535, " world", false], [3942, 0.012518, " community", false], [8686, 0.00816, " majority", false], [1251, 0.008023, " people", false], [47387, 0.007971, " Chess", false]]]}, "raw_delta": 0.06988276375664604, "tuned_delta": 0.07669504156374399}, {"byte_start": 1579, "byte_end": 1582, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 268, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "0.12% 0.12% 0.12%", "qwen": "0.25% 0.25% 0.25%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.9802114963531494]], "qwen": [[315, " of", "normal", 0.9587160348892212]]}, "loss": {"rwkv": 0.12034199356373594, "qwen": 0.25343560494597595}, "topk": {"rwkv": [4706, 1, 0.9802114963531494, [[4706, 0.980211, " of", false], [45, 0.004095, ",", false], [4596, 0.002309, " in", false], [22762, 0.001842, " who", false], [47, 0.001827, ".", false], [38013, 0.001079, " chess", false], [3609, 0.000991, " AI", false], [275, 0.000686, " (", false], [52367, 0.000651, " opinion", false], [59324, 0.000648, " community", false]]], "qwen": [315, 1, 0.9587160348892212, [[315, 0.958716, " of", false], [11, 0.014388, ",", false], [13, 0.005598, ".", false], [879, 0.003266, " who", false], [320, 0.002792, " (", false], [304, 0.001867, " in", false], [9459, 0.00135, " opinion", false], [1576, 0.001321, " because", false], [25, 0.000955, ":", false], [438, 0.000939, " as", false]]]}, "raw_delta": -0.007380276918411256, "tuned_delta": -0.0005679991113133089}, {"byte_start": 1582, "byte_end": 1591, "display": {"text": " computer", "kind": "normal"}, "is_word": true, "word_id": 269, "word_key": " computer", "bytes_hex": "20 63 6f 6d 70 75 74 65 72", "compression": {"rwkv": "5.42% 5.42% 5.42% 5.42% 5.42% 5.42% 5.42% 5.42% 5.42%", "qwen": "4.84% 4.84% 4.84% 4.84% 4.84% 4.84% 4.84% 4.84% 4.84%"}, "model_tokens": {"rwkv": [[55809, " computer", "normal", 0.06703007221221924]], "qwen": [[6366, " computer", "normal", 0.08924874663352966]]}, "loss": {"rwkv": 5.416368100559693, "qwen": 4.841700493670846}, "topk": {"rwkv": [55809, 5, 0.06703007221221924, [[38013, 0.25703, " chess", false], [3609, 0.254867, " AI", false], [22590, 0.190063, " the", false], [63843, 0.079894, " researchers", false], [55809, 0.06703, " computer", false], [46787, 0.022064, " people", false], [51685, 0.017774, " experts", false], [38720, 0.012339, " human", false], [39944, 0.010441, " those", false], [52489, 0.007763, " players", false]]], "qwen": [6366, 4, 0.08924874663352966, [[32719, 0.430236, " chess", false], [279, 0.177072, " the", false], [11811, 0.107766, " researchers", false], [6366, 0.089249, " computer", false], [15235, 0.059845, " AI", false], [1251, 0.017006, " people", false], [3738, 0.011981, " human", false], [11647, 0.009664, " experts", false], [1846, 0.007894, " those", false], [3412, 0.007429, " research", false]]]}, "raw_delta": 0.03186633851793075, "tuned_delta": 0.0386786163250287}, {"byte_start": 1591, "byte_end": 1597, "display": {"text": "-chess", "kind": "normal"}, "is_word": true, "word_id": 270, "word_key": "-chess", "bytes_hex": "2d 63 68 65 73 73", "compression": {"rwkv": "57.76% 9.23% 9.23% 9.23% 9.23% 0.03%", "qwen": "22.36% 22.36% 22.36% 0.00% 0.00% 0.00%"}, "model_tokens": {"rwkv": [[46, "-", "normal", 0.04067648574709892], [24991, "ches", "normal", 0.12916827201843262], [116, "s", "normal", 0.9981344938278198]], "qwen": [[11582, "-ch", "normal", 0.02424108237028122], [433, "ess", "normal", 0.9995290040969849]]}, "loss": {"rwkv": 15.785026316590875, "qwen": 11.181420540360765}, "topk": {"rwkv": [46, 4, 0.04067648574709892, [[38013, 0.599951, " chess", false], [62532, 0.169613, " scientists", false], [51685, 0.044298, " experts", false], [46, 0.040676, "-", false], [52814, 0.03159, " science", false], [52489, 0.021046, " players", false], [63794, 0.020486, " programmers", false], [63843, 0.014725, " researchers", false], [3609, 0.008194, " AI", false], [47732, 0.003577, " vision", false]]], "qwen": [11582, 4, 0.02424108237028122, [[13923, 0.414545, " scientists", false], [32719, 0.39622, " chess", false], [8038, 0.050103, " science", false], [11582, 0.024241, "-ch", false], [54846, 0.019488, " programmers", false], [4217, 0.016435, " players", false], [11811, 0.016364, " researchers", false], [27468, 0.007223, " scientist", false], [11129, 0.006301, " vision", false], [11647, 0.003527, " experts", false]]]}, "raw_delta": 0.2552781091362703, "tuned_delta": 0.2620903869433682}, {"byte_start": 1597, "byte_end": 1609, "display": {"text": " researchers", "kind": "normal"}, "is_word": true, "word_id": 271, "word_key": " researchers", "bytes_hex": "20 72 65 73 65 61 72 63 68 65 72 73", "compression": {"rwkv": "0.38% 0.38% 0.38% 0.38% 0.38% 0.38% 0.38% 0.38% 0.38% 0.38% 0.38% 0.38%", "qwen": "0.84% 0.84% 0.84% 0.84% 0.84% 0.84% 0.84% 0.84% 0.84% 0.84% 0.84% 0.84%"}, "model_tokens": {"rwkv": [[63843, " researchers", "normal", 0.773772120475769]], "qwen": [[11811, " researchers", "normal", 0.5727719068527222]]}, "loss": {"rwkv": 0.3815721747142846, "qwen": 0.8374660249788509}, "topk": {"rwkv": [63843, 1, 0.773772120475769, [[63843, 0.773772, " researchers", false], [51685, 0.080632, " experts", false], [52489, 0.045842, " players", false], [63533, 0.016164, " enthusiasts", false], [46, 0.009484, "-", false], [57103, 0.007933, " research", false], [64985, 0.007528, " practitioners", false], [46787, 0.006487, " people", false], [63874, 0.004951, " specialists", false], [57166, 0.00384, " scholars", false]]], "qwen": [11811, 1, 0.5727719068527222, [[11811, 0.572772, " researchers", false], [4217, 0.101854, " players", false], [11647, 0.098618, " experts", false], [54846, 0.034473, " programmers", false], [42348, 0.030855, " enthusiasts", false], [72085, 0.026601, "-playing", false], [3412, 0.015379, " research", false], [82962, 0.012889, " theorists", false], [15387, 0.006701, " professionals", false], [42095, 0.006361, " practitioners", false]]]}, "raw_delta": -0.025280122955640156, "tuned_delta": -0.01846784514854221}, {"byte_start": 1609, "byte_end": 1613, "display": {"text": " who", "kind": "normal"}, "is_word": true, "word_id": 272, "word_key": " who", "bytes_hex": "20 77 68 6f", "compression": {"rwkv": "13.31% 13.31% 13.31% 13.31%", "qwen": "11.10% 11.10% 11.10% 11.10%"}, "model_tokens": {"rwkv": [[22762, " who", "normal", 0.052309829741716385]], "qwen": [[879, " who", "normal", 0.08526797592639923]]}, "loss": {"rwkv": 13.313933726953811, "qwen": 11.099538859022683}, "topk": {"rwkv": [22762, 3, 0.052309829741716385, [[45, 0.481561, ",", false], [47, 0.273125, ".", false], [22762, 0.05231, " who", false], [4423, 0.049507, " as", false], [51018, 0.047698, " because", false], [275, 0.019195, " (", false], [59, 0.014554, ":", false], [60, 0.014428, ";", false], [21265, 0.01273, " and", false], [4596, 0.005339, " in", false]]], "qwen": [879, 3, 0.08526797592639923, [[11, 0.460601, ",", false], [13, 0.243955, ".", false], [879, 0.085268, " who", false], [1576, 0.048636, " because", false], [320, 0.030388, " (", false], [323, 0.02917, " and", false], [25, 0.018105, ":", false], [438, 0.018057, " as", false], [26, 0.015047, ";", false], [2474, 0.005002, " since", false]]]}, "raw_delta": 0.12279212474822998, "tuned_delta": 0.12960440255532793}, {"byte_start": 1613, "byte_end": 1617, "display": {"text": " had", "kind": "normal"}, "is_word": true, "word_id": 273, "word_key": " had", "bytes_hex": "20 68 61 64", "compression": {"rwkv": "8.42% 8.42% 8.42% 8.42%", "qwen": "6.76% 6.76% 6.76% 6.76%"}, "model_tokens": {"rwkv": [[21795, " had", "normal", 0.15352262556552887]], "qwen": [[1030, " had", "normal", 0.2232958972454071]]}, "loss": {"rwkv": 8.418069208312065, "qwen": 6.759285254378814}, "topk": {"rwkv": [21795, 1, 0.15352262556552887, [[21795, 0.153523, " had", false], [55616, 0.133269, " believed", false], [32462, 0.118333, " were", false], [53137, 0.096134, " thought", false], [30840, 0.040349, " felt", false], [22439, 0.027057, " saw", false], [60227, 0.027033, " preferred", false], [45, 0.02322, ",", false], [39820, 0.023138, " still", false], [56175, 0.015729, " expected", false]]], "qwen": [1030, 1, 0.2232958972454071, [[1030, 0.223296, " had", false], [1033, 0.171908, " were", false], [11585, 0.130731, " believed", false], [3381, 0.049534, " thought", false], [14890, 0.037662, " preferred", false], [11, 0.028434, ",", false], [6476, 0.017256, " felt", false], [4829, 0.015278, " wanted", false], [45503, 0.012905, " favored", false], [4518, 0.011503, " instead", false]]]}, "raw_delta": 0.09198251366615295, "tuned_delta": 0.0987947914732509}, {"byte_start": 1617, "byte_end": 1625, "display": {"text": " pursued", "kind": "normal"}, "is_word": true, "word_id": 274, "word_key": " pursued", "bytes_hex": "20 70 75 72 73 75 65 64", "compression": {"rwkv": "13.31% 13.31% 13.31% 13.31% 13.31% 13.31% 13.31% 13.31%", "qwen": "11.11% 11.11% 11.11% 11.11% 11.11% 11.11% 11.11% 11.11%"}, "model_tokens": {"rwkv": [[52611, " pursued", "normal", 0.00269812298938632]], "qwen": [[45431, " pursued", "normal", 0.007243321277201176]]}, "loss": {"rwkv": 13.313933726953811, "qwen": 11.108019753493355}, "topk": {"rwkv": [52611, 48, 0.00269812298938632, [[30259, 0.262124, " been", false], [39762, 0.08623, " spent", false], [62367, 0.073228, " previously", false], [56495, 0.031902, " invested", false], [30482, 0.029053, " come", false], [47812, 0.022693, " worked", false], [55616, 0.021889, " believed", false], [38709, 0.018292, " hoped", false], [53137, 0.018248, " thought", false], [22187, 0.016705, " not", false]]], "qwen": [45431, 21, 0.007243321277201176, [[1012, 0.228198, " been", false], [7391, 0.173035, " spent", false], [27991, 0.042318, " invested", false], [10735, 0.036404, " focused", false], [8597, 0.023174, " previously", false], [7881, 0.022822, " developed", false], [6439, 0.019705, " worked", false], [11585, 0.019437, " believed", false], [6679, 0.016472, " tried", false], [28229, 0.013101, " devoted", false]]]}, "raw_delta": 0.12232184410095215, "tuned_delta": 0.1291341219080501}, {"byte_start": 1625, "byte_end": 1633, "display": {"text": " methods", "kind": "normal"}, "is_word": true, "word_id": 275, "word_key": " methods", "bytes_hex": "20 6d 65 74 68 6f 64 73", "compression": {"rwkv": "6.20% 6.20% 6.20% 6.20% 6.20% 6.20% 6.20% 6.20%", "qwen": "5.07% 5.07% 5.07% 5.07% 5.07% 5.07% 5.07% 5.07%"}, "model_tokens": {"rwkv": [[52224, " methods", "normal", 0.06365553289651871]], "qwen": [[5413, " methods", "normal", 0.10562748461961746]]}, "loss": {"rwkv": 6.199080253819764, "qwen": 5.067097970081733}, "topk": {"rwkv": [52224, 4, 0.06365553289651871, [[22590, 0.174066, " the", false], [332, 0.128629, " a", false], [39193, 0.100949, " other", false], [52224, 0.063656, " methods", false], [63277, 0.035499, " alternative", false], [31458, 0.03497, " more", false], [4419, 0.023083, " an", false], [38720, 0.01713, " human", false], [47202, 0.015241, " search", false], [53265, 0.013173, " various", false]]], "qwen": [5413, 2, 0.10562748461961746, [[264, 0.154715, " a", false], [5413, 0.105627, " methods", false], [279, 0.101364, " the", false], [1008, 0.059124, " other", false], [458, 0.029129, " an", false], [803, 0.02519, " more", false], [2155, 0.020887, " different", false], [25600, 0.016323, " shallow", false], [10555, 0.016134, " alternative", false], [1128, 0.016059, " what", false]]]}, "raw_delta": 0.06277042627334595, "tuned_delta": 0.0695827040804439}, {"byte_start": 1633, "byte_end": 1638, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 276, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"rwkv": "5.72% 5.72% 5.72% 5.72% 5.72%", "qwen": "4.99% 4.99% 4.99% 4.99% 4.99%"}, "model_tokens": {"rwkv": [[32227, " that", "normal", 0.20633858442306519]], "qwen": [[429, " that", "normal", 0.25049540400505066]]}, "loss": {"rwkv": 5.720060416024601, "qwen": 4.992860153988606}, "topk": {"rwkv": [32227, 2, 0.20633858442306519, [[37810, 0.453146, " based", false], [32227, 0.206339, " that", false], [4706, 0.06008, " of", false], [59927, 0.03484, " involving", false], [52700, 0.020773, " relying", false], [4596, 0.018187, " in", false], [31296, 0.017949, " like", false], [32139, 0.01587, " such", false], [21700, 0.014809, " for", false], [38888, 0.013882, " lever", false]]], "qwen": [429, 2, 0.25049540400505066, [[3118, 0.496231, " based", false], [429, 0.250495, " that", false], [315, 0.041951, " of", false], [38561, 0.014541, " relying", false], [1667, 0.012073, " using", false], [14606, 0.011522, " inspired", false], [448, 0.009377, " with", false], [369, 0.008967, " for", false], [803, 0.008254, " more", false], [311, 0.007694, " to", false]]]}, "raw_delta": 0.040324544906616244, "tuned_delta": 0.047136822713714194}, {"byte_start": 1638, "byte_end": 1648, "display": {"text": " leveraged", "kind": "normal"}, "is_word": true, "word_id": 277, "word_key": " leveraged", "bytes_hex": "20 6c 65 76 65 72 61 67 65 64", "compression": {"rwkv": "4.29% 4.29% 4.29% 4.29% 4.29% 4.29% 4.29% 4.29% 4.29% 0.15%", "qwen": "8.38% 8.38% 8.38% 8.38% 8.38% 8.38% 0.00% 0.00% 0.00% 0.00%"}, "model_tokens": {"rwkv": [[56540, " leverage", "normal", 0.11852595210075378], [101, "d", "normal", 0.9916390776634216]], "qwen": [[27505, " lever", "normal", 0.06148497387766838], [3279, "aged", "normal", 0.9993828535079956]]}, "loss": {"rwkv": 3.8755258476028756, "qwen": 5.030640959058762}, "topk": {"rwkv": [56540, 2, 0.11852595210075378, [[32462, 0.138632, " were", false], [56540, 0.118526, " leverage", false], [47054, 0.079038, " relied", false], [32354, 0.058516, " used", false], [56500, 0.040565, " involved", false], [21532, 0.040101, " did", false], [59685, 0.027994, " exploited", false], [31351, 0.020351, " made", false], [40219, 0.019689, " would", false], [47340, 0.018391, " sought", false]]], "qwen": [27505, 3, 0.06148497387766838, [[39913, 0.185761, " relied", false], [1033, 0.15033, " were", false], [27505, 0.061485, " lever", false], [1483, 0.056543, " used", false], [50663, 0.024234, " exploited", false], [6398, 0.024042, " involved", false], [32064, 0.021802, " leverage", false], [1030, 0.017015, " had", false], [6966, 0.014276, " looked", false], [10735, 0.013199, " focused", false]]]}, "raw_delta": -0.06405318261822683, "tuned_delta": -0.05724090481112888}, {"byte_start": 1648, "byte_end": 1654, "display": {"text": " human", "kind": "normal"}, "is_word": true, "word_id": 278, "word_key": " human", "bytes_hex": "20 68 75 6d 61 6e", "compression": {"rwkv": "1.56% 1.56% 1.56% 1.56% 1.56% 1.56%", "qwen": "1.39% 1.39% 1.39% 1.39% 1.39% 1.39%"}, "model_tokens": {"rwkv": [[38720, " human", "normal", 0.5936533808708191]], "qwen": [[3738, " human", "normal", 0.6296586990356445]]}, "loss": {"rwkv": 1.5615107457538422, "qwen": 1.3903292474063027}, "topk": {"rwkv": [38720, 1, 0.5936533808708191, [[38720, 0.593653, " human", false], [22590, 0.068954, " the", false], [59943, 0.068186, " knowledge", false], [39931, 0.051698, " their", false], [45775, 0.01944, " domain", false], [38013, 0.013575, " chess", false], [332, 0.01182, " a", false], [51832, 0.010555, " general", false], [55809, 0.008808, " computer", false], [59792, 0.006938, " heuristic", false]]], "qwen": [3738, 1, 0.6296586990356445, [[3738, 0.629659, " human", false], [6540, 0.071354, " knowledge", false], [279, 0.045133, " the", false], [862, 0.042105, " their", false], [264, 0.014281, " a", false], [32719, 0.011978, " chess", false], [7947, 0.010835, " domain", false], [803, 0.007386, " more", false], [1172, 0.005906, " only", false], [4586, 0.005699, " general", false]]]}, "raw_delta": 0.009492317835489913, "tuned_delta": 0.01630459564258786}, {"byte_start": 1654, "byte_end": 1668, "display": {"text": " understanding", "kind": "normal"}, "is_word": true, "word_id": 279, "word_key": " understanding", "bytes_hex": "20 75 6e 64 65 72 73 74 61 6e 64 69 6e 67", "compression": {"rwkv": "6.32% 6.32% 6.32% 6.32% 6.32% 6.32% 6.32% 6.32% 6.32% 6.32% 6.32% 6.32% 6.32% 6.32%", "qwen": "7.90% 7.90% 7.90% 7.90% 7.90% 7.90% 7.90% 7.90% 7.90% 7.90% 7.90% 7.90% 7.90% 7.90%"}, "model_tokens": {"rwkv": [[65034, " understanding", "normal", 0.007275206036865711]], "qwen": [[8660, " understanding", "normal", 0.0021649186965078115]]}, "loss": {"rwkv": 6.319841557465602, "qwen": 7.903099714162297}, "topk": {"rwkv": [65034, 5, 0.007275206036865711, [[59943, 0.85122, " knowledge", false], [59683, 0.030221, " expertise", false], [46, 0.027585, "-", false], [38013, 0.01552, " chess", false], [65034, 0.007275, " understanding", false], [59917, 0.005087, " intuition", false], [62418, 0.00438, " psychology", false], [52022, 0.003462, " insight", false], [64452, 0.002649, " intelligence", false], [45775, 0.002221, " domain", false]]], "qwen": [8660, 9, 0.0021649186965078115, [[6540, 0.831445, " knowledge", false], [12646, 0.055003, "-k", false], [18726, 0.026358, " expertise", false], [32719, 0.025361, " chess", false], [6203, 0.004151, " expert", false], [7947, 0.004118, " domain", false], [56251, 0.003225, " intuition", false], [3139, 0.002364, " experience", false], [8660, 0.002165, " understanding", false], [6358, 0.001524, " analysis", false]]]}, "raw_delta": -0.08779447419302808, "tuned_delta": -0.08098219638593013}, {"byte_start": 1668, "byte_end": 1671, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 280, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "2.94% 2.94% 2.94%", "qwen": "2.64% 2.64% 2.64%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.615731954574585]], "qwen": [[315, " of", "normal", 0.6447494029998779]]}, "loss": {"rwkv": 2.9351705747252668, "qwen": 2.63829000238821}, "topk": {"rwkv": [4706, 1, 0.615731954574585, [[4706, 0.615732, " of", false], [47, 0.186727, ".", false], [45, 0.061015, ",", false], [21265, 0.050334, " and", false], [275, 0.017686, " (", false], [4596, 0.013815, " in", false], [4811, 0.00869, " to", false], [4715, 0.005029, " or", false], [59, 0.003779, ":", false], [60, 0.002569, ";", false]]], "qwen": [315, 1, 0.6447494029998779, [[315, 0.644749, " of", false], [13, 0.137459, ".", false], [11, 0.060294, ",", false], [323, 0.028427, " and", false], [320, 0.027727, " (", false], [311, 0.01483, " to", false], [304, 0.013108, " in", false], [4751, 0.007219, " rather", false], [553, 0.005149, " by", false], [803, 0.005016, " more", false]]]}, "raw_delta": 0.016462554534276308, "tuned_delta": 0.023274832341374254}, {"byte_start": 1671, "byte_end": 1675, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 281, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "2.04% 2.04% 2.04% 2.04%", "qwen": "2.04% 2.04% 2.04% 2.04%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.6336353421211243]], "qwen": [[279, " the", "normal", 0.6357907056808472]]}, "loss": {"rwkv": 2.042878720008786, "qwen": 2.041800469404744}, "topk": {"rwkv": [22590, 1, 0.6336353421211243, [[22590, 0.633635, " the", false], [38013, 0.236369, " chess", false], [30941, 0.017865, " game", false], [38576, 0.01096, " games", false], [21835, 0.008598, " how", false], [57317, 0.006669, " strategy", false], [31702, 0.006351, " play", false], [39072, 0.004086, " moves", false], [32464, 0.003989, " what", false], [60563, 0.003353, " strategic", false]]], "qwen": [279, 1, 0.6357907056808472, [[279, 0.635791, " the", false], [32719, 0.282524, " chess", false], [1246, 0.015043, " how", false], [1809, 0.006775, " game", false], [1128, 0.003794, " what", false], [3868, 0.003788, " games", false], [4479, 0.00322, " board", false], [264, 0.002583, " a", false], [9892, 0.002425, " positions", false], [2309, 0.002364, " position", false]]]}, "raw_delta": 5.979090929031372e-05, "tuned_delta": 0.006872068716388261}, {"byte_start": 1675, "byte_end": 1683, "display": {"text": " special", "kind": "normal"}, "is_word": true, "word_id": 282, "word_key": " special", "bytes_hex": "20 73 70 65 63 69 61 6c", "compression": {"rwkv": "21.70% 21.70% 21.70% 21.70% 21.70% 21.70% 21.70% 21.70%", "qwen": "21.71% 21.71% 21.71% 21.71% 21.71% 21.71% 21.71% 21.71%"}, "model_tokens": {"rwkv": [[52964, " special", "normal", 6.497278809547424e-05]], "qwen": [[3281, " special", "normal", 6.576983287231997e-05]]}, "loss": {"rwkv": 21.696780888369172, "qwen": 21.706583899468352}, "topk": {"rwkv": [52964, 174, 6.497278809547424e-05, [[30941, 0.705335, " game", false], [45775, 0.161116, " domain", false], [38013, 0.023789, " chess", false], [56893, 0.009155, " position", false], [52569, 0.008581, " problem", false], [39558, 0.007689, " rules", false], [37876, 0.006085, " board", false], [46642, 0.004939, " nature", false], [38576, 0.002747, " games", false], [32202, 0.002735, " task", false]]], "qwen": [3281, 153, 6.576983287231997e-05, [[1809, 0.705544, " game", false], [7947, 0.075646, " domain", false], [32719, 0.062908, " chess", false], [5601, 0.027749, " rules", false], [4479, 0.024367, " board", false], [3491, 0.019437, " problem", false], [3868, 0.008428, " games", false], [2309, 0.006874, " position", false], [9666, 0.005155, " pieces", false], [16170, 0.003218, " principles", false]]]}, "raw_delta": -0.0005435943603515625, "tuned_delta": 0.006268683446746384}, {"byte_start": 1683, "byte_end": 1693, "display": {"text": " structure", "kind": "normal"}, "is_word": true, "word_id": 283, "word_key": " structure", "bytes_hex": "20 73 74 72 75 63 74 75 72 65", "compression": {"rwkv": "4.62% 4.62% 4.62% 4.62% 4.62% 4.62% 4.62% 4.62% 4.62% 4.62%", "qwen": "4.73% 4.73% 4.73% 4.73% 4.73% 4.73% 4.73% 4.73% 4.73% 4.73%"}, "model_tokens": {"rwkv": [[60572, " structure", "normal", 0.07770536839962006]], "qwen": [[5944, " structure", "normal", 0.07244773954153061]]}, "loss": {"rwkv": 4.621132552847461, "qwen": 4.733644462955164}, "topk": {"rwkv": [60572, 6, 0.07770536839962006, [[56215, 0.154163, " features", false], [46642, 0.111012, " nature", false], [30405, 0.09301, " case", false], [65258, 0.085431, " characteristics", false], [62404, 0.077802, " properties", false], [60572, 0.077705, " structure", false], [50964, 0.034046, " aspects", false], [45775, 0.031669, " domain", false], [46, 0.024834, "-", false], [39558, 0.021839, " rules", false]]], "qwen": [5944, 3, 0.07244773954153061, [[4419, 0.226434, " features", false], [5888, 0.196031, " properties", false], [5944, 0.072448, " structure", false], [17452, 0.046335, " characteristics", false], [6540, 0.043927, " knowledge", false], [1361, 0.035753, "ities", false], [13566, 0.027856, " aspects", false], [5601, 0.0259, " rules", false], [32719, 0.025622, " chess", false], [6993, 0.019552, " nature", false]]]}, "raw_delta": -0.006238985061645552, "tuned_delta": 0.0005732927454523947}, {"byte_start": 1693, "byte_end": 1696, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 284, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "0.46% 0.46% 0.46%", "qwen": "0.28% 0.28% 0.28%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.9261823892593384]], "qwen": [[315, " of", "normal", 0.9550149440765381]]}, "loss": {"rwkv": 0.46082178023186693, "qwen": 0.2766864276960394}, "topk": {"rwkv": [4706, 1, 0.9261823892593384, [[4706, 0.926182, " of", false], [21265, 0.047118, " and", false], [32227, 0.006042, " that", false], [4596, 0.00476, " in", false], [45, 0.003222, ",", false], [275, 0.002079, " (", false], [4715, 0.000781, " or", false], [52544, 0.000776, " present", false], [56500, 0.000576, " involved", false], [62680, 0.000555, " underlying", false]]], "qwen": [315, 1, 0.9550149440765381, [[315, 0.955015, " of", false], [323, 0.013298, " and", false], [304, 0.010245, " in", false], [429, 0.003382, " that", false], [16533, 0.002991, " underlying", false], [36988, 0.001696, " inherent", false], [3042, 0.001604, " present", false], [320, 0.001567, " (", false], [11, 0.001048, ",", false], [807, 0.000631, " they", false]]]}, "raw_delta": 0.010210632036129635, "tuned_delta": 0.01702290984322758}, {"byte_start": 1696, "byte_end": 1702, "display": {"text": " chess", "kind": "normal"}, "is_word": true, "word_id": 285, "word_key": " chess", "bytes_hex": "20 63 68 65 73 73", "compression": {"rwkv": "2.69% 2.69% 2.69% 2.69% 2.69% 2.69%", "qwen": "1.21% 1.21% 1.21% 1.21% 1.21% 1.21%"}, "model_tokens": {"rwkv": [[38013, " chess", "normal", 0.41101744771003723]], "qwen": [[32719, " chess", "normal", 0.6691892147064209]]}, "loss": {"rwkv": 2.6886162464483445, "qwen": 1.2073206275629442}, "topk": {"rwkv": [38013, 2, 0.41101744771003723, [[22590, 0.462288, " the", false], [38013, 0.411017, " chess", false], [37876, 0.016687, " board", false], [332, 0.014308, " a", false], [38576, 0.01338, " games", false], [32234, 0.01047, " this", false], [32227, 0.006132, " that", false], [60202, 0.003463, " positions", false], [30941, 0.003317, " game", false], [55809, 0.00321, " computer", false]]], "qwen": [32719, 1, 0.6691892147064209, [[32719, 0.669189, " chess", false], [279, 0.276381, " the", false], [3868, 0.006729, " games", false], [264, 0.006351, " a", false], [419, 0.005637, " this", false], [1779, 0.005631, " check", false], [6366, 0.003659, " computer", false], [5994, 0.001782, " Go", false], [4479, 0.001778, " board", false], [47387, 0.001769, " Chess", false]]]}, "raw_delta": 0.08214047054449715, "tuned_delta": 0.0889527483515951}, {"byte_start": 1702, "byte_end": 1703, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "16.91%", "qwen": "14.68%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.391720712184906]], "qwen": [[13, ".", "normal", 0.44312065839767456]]}, "loss": {"rwkv": 16.90658251041754, "qwen": 14.677857188103266}, "topk": {"rwkv": [47, 1, 0.391720712184906, [[47, 0.391721, ".", false], [45, 0.130274, ",", false], [60202, 0.102894, " positions", false], [21265, 0.051229, " and", false], [275, 0.051086, " (", false], [38576, 0.03258, " games", false], [4423, 0.029321, " as", false], [56939, 0.017375, " problems", false], [41111, 0.016269, "boards", false], [52616, 0.01403, " puzzles", false]]], "qwen": [13, 1, 0.44312065839767456, [[13, 0.443121, ".", false], [11, 0.128804, ",", false], [320, 0.080235, " (", false], [311, 0.048823, " to", false], [9892, 0.044417, " positions", false], [323, 0.028027, " and", false], [4751, 0.018054, " rather", false], [304, 0.017365, " in", false], [5322, 0.014898, " problems", false], [382, 0.010414, ".\n\n", false]]]}, "raw_delta": 0.12358677387237549, "tuned_delta": 0.13039905167947344}, {"byte_start": 1703, "byte_end": 1708, "display": {"text": " When", "kind": "normal"}, "is_word": true, "word_id": 286, "word_key": " when", "bytes_hex": "20 57 68 65 6e", "compression": {"rwkv": "17.47% 17.47% 17.47% 17.47% 17.47%", "qwen": "17.97% 17.97% 17.97% 17.97% 17.97%"}, "model_tokens": {"rwkv": [[30032, " When", "normal", 0.007976561784744263]], "qwen": [[3197, " When", "normal", 0.00685387896373868]]}, "loss": {"rwkv": 17.47013526076479, "qwen": 17.972159497939362}, "topk": {"rwkv": [30032, 23, 0.007976561784744263, [[20996, 0.14774, " The", false], [19555, 0.102756, " But", false], [3913, 0.060627, " In", false], [267, 0.040069, "  ", false], [3918, 0.035955, " It", false], [29894, 0.032153, " This", false], [50318, 0.027092, " However", false], [37453, 0.024905, " These", false], [261, 0.023868, "\n\n", false], [29893, 0.022802, " They", false]]], "qwen": [3197, 26, 0.00685387896373868, [[576, 0.144867, " The", false], [220, 0.068299, " ", false], [4220, 0.058249, " These", false], [2379, 0.047176, " They", false], [758, 0.044735, " In", false], [1096, 0.041127, " This", false], [1084, 0.033302, " It", false], [1988, 0.029506, " But", false], [47387, 0.023685, " Chess", false], [10964, 0.023642, " Their", false]]]}, "raw_delta": -0.027838134765625022, "tuned_delta": -0.021025856958527076}, {"byte_start": 1708, "byte_end": 1710, "display": {"text": " a", "kind": "normal"}, "is_word": true, "word_id": 287, "word_key": " a", "bytes_hex": "20 61", "compression": {"rwkv": "30.29% 30.29%", "qwen": "28.05% 28.05%"}, "model_tokens": {"rwkv": [[332, " a", "normal", 0.03524582087993622]], "qwen": [[264, " a", "normal", 0.04458407685160637]]}, "loss": {"rwkv": 30.290960331164754, "qwen": 28.04579776699427}, "topk": {"rwkv": [332, 6, 0.03524582087993622, [[22590, 0.213371, " the", false], [20184, 0.077096, " Kas", false], [28753, 0.057369, " Deep", false], [4601, 0.050488, " it", false], [36274, 0.035769, " Alpha", false], [332, 0.035246, " a", false], [39936, 0.027797, " these", false], [20077, 0.024291, " IBM", false], [308, 0.022402, " I", false], [32227, 0.018821, " that", false]]], "qwen": [264, 4, 0.04458407685160637, [[279, 0.201523, " the", false], [18183, 0.087553, " Deep", false], [358, 0.055487, " I", false], [264, 0.044584, " a", false], [37542, 0.044462, " Kas", false], [807, 0.039931, " they", false], [1493, 0.030735, " these", false], [32719, 0.020001, " chess", false], [5538, 0.01991, " deep", false], [419, 0.019768, " this", false]]]}, "raw_delta": 0.12449824810028076, "tuned_delta": 0.1313105259073787}, {"byte_start": 1710, "byte_end": 1718, "display": {"text": " simpler", "kind": "normal"}, "is_word": true, "word_id": 288, "word_key": " simpler", "bytes_hex": "20 73 69 6d 70 6c 65 72", "compression": {"rwkv": "14.44% 14.44% 14.44% 14.44% 14.44% 14.44% 14.44% 14.44%", "qwen": "19.53% 19.53% 19.53% 19.53% 19.53% 19.53% 19.53% 19.53%"}, "model_tokens": {"rwkv": [[52907, " simpler", "normal", 0.001654030755162239]], "qwen": [[34288, " simpler", "normal", 0.00017262586334254593]]}, "loss": {"rwkv": 14.441039227648314, "qwen": 19.531349481138687}, "topk": {"rwkv": [52907, 67, 0.001654030755162239, [[38013, 0.072277, " chess", false], [55809, 0.066716, " computer", false], [46561, 0.064088, " method", false], [30597, 0.063847, " deep", false], [38720, 0.061614, " human", false], [52167, 0.060269, " machine", false], [51832, 0.041408, " general", false], [52580, 0.039936, " program", false], [22168, 0.039859, " new", false], [47202, 0.028848, " search", false]]], "qwen": [34288, 364, 0.00017262586334254593, [[6366, 0.117928, " computer", false], [1714, 0.09407, " method", false], [32719, 0.084993, " chess", false], [3738, 0.071491, " human", false], [501, 0.042914, " new", false], [5538, 0.034239, " deep", false], [2025, 0.027557, " program", false], [6662, 0.022282, " grand", false], [1879, 0.015855, " world", false], [1849, 0.014348, " system", false]]]}, "raw_delta": -0.2822667360305786, "tuned_delta": -0.2754544582234807}, {"byte_start": 1718, "byte_end": 1719, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "34.80%", "qwen": "39.88%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.1471727341413498]], "qwen": [[11, ",", "normal", 0.10952530801296234]]}, "loss": {"rwkv": 34.799382333942766, "qwen": 39.88329698260418}, "topk": {"rwkv": [45, 2, 0.1471727341413498, [[46561, 0.470141, " method", false], [45, 0.147173, ",", false], [55532, 0.070742, " approach", false], [47202, 0.042219, " search", false], [21265, 0.026931, " and", false], [51832, 0.022308, " general", false], [53275, 0.015647, " version", false], [47487, 0.014424, " system", false], [38013, 0.011089, " chess", false], [21400, 0.010857, " but", false]]], "qwen": [11, 3, 0.10952530801296234, [[1714, 0.446108, " method", false], [5486, 0.126378, " approach", false], [11, 0.109525, ",", false], [12111, 0.029682, " algorithm", false], [323, 0.02904, " and", false], [2711, 0.021826, " search", false], [714, 0.018789, " but", false], [1849, 0.016111, " system", false], [2025, 0.013475, " program", false], [2319, 0.012094, " version", false]]]}, "raw_delta": -0.28191208839416504, "tuned_delta": -0.2750998105870671}, {"byte_start": 1719, "byte_end": 1726, "display": {"text": " search", "kind": "normal"}, "is_word": true, "word_id": 289, "word_key": " search", "bytes_hex": "20 73 65 61 72 63 68", "compression": {"rwkv": "11.67% 11.67% 11.67% 11.67% 11.67% 11.67% 11.67%", "qwen": "12.96% 12.96% 12.96% 12.96% 12.96% 12.96% 12.96%"}, "model_tokens": {"rwkv": [[47202, " search", "normal", 0.010904721915721893]], "qwen": [[2711, " search", "normal", 0.0065371133387088776]]}, "loss": {"rwkv": 11.673592685764493, "qwen": 12.95916177251648}, "topk": {"rwkv": [47202, 12, 0.010904721915721893, [[31458, 0.205355, " more", false], [38720, 0.089314, " human", false], [51832, 0.07558, " general", false], [31277, 0.06614, " less", false], [45961, 0.051148, " faster", false], [21400, 0.050527, " but", false], [45683, 0.022649, " deeper", false], [45301, 0.022306, " better", false], [37920, 0.020012, " brute", false], [52873, 0.013516, " shallow", false]]], "qwen": [2711, 21, 0.0065371133387088776, [[2686, 0.149039, " less", false], [803, 0.129059, " more", false], [3738, 0.076043, " human", false], [714, 0.072923, " but", false], [10596, 0.04321, " faster", false], [25600, 0.020209, " shallow", false], [19117, 0.019998, " deeper", false], [4586, 0.017421, " general", false], [5538, 0.015501, " deep", false], [2477, 0.013525, " non", false]]]}, "raw_delta": -0.07128708703177311, "tuned_delta": -0.06447480922467516}, {"byte_start": 1726, "byte_end": 1732, "display": {"text": "-based", "kind": "normal"}, "is_word": true, "word_id": 290, "word_key": "-based", "bytes_hex": "2d 62 61 73 65 64", "compression": {"rwkv": "0.60% 0.56% 0.56% 0.56% 0.56% 0.56%", "qwen": "3.60% 3.60% 3.60% 3.60% 3.60% 3.60%"}, "model_tokens": {"rwkv": [[46, "-", "normal", 0.9670440554618835], [34011, "based", "normal", 0.855587899684906]], "qwen": [[5980, "-based", "normal", 0.3017718195915222]]}, "loss": {"rwkv": 0.5701568841403831, "qwen": 3.600979193114894}, "topk": {"rwkv": [46, 1, 0.9670440554618835, [[46, 0.967044, "-", false], [46561, 0.007008, " method", false], [37810, 0.006624, " based", false], [26127, 0.002682, "less", false], [35003, 0.001707, "light", false], [45862, 0.001672, " engine", false], [34011, 0.001294, "based", false], [55532, 0.001162, " approach", false], [24381, 0.000905, "able", false], [59113, 0.000721, " algorithm", false]]], "qwen": [5980, 1, 0.3017718195915222, [[5980, 0.301772, "-based", false], [1717, 0.245659, "less", false], [12577, 0.082205, "-free", false], [54909, 0.076161, "-less", false], [12, 0.033105, "-", false], [2852, 0.026122, "-l", false], [3419, 0.017647, "-in", false], [6810, 0.01748, "-de", false], [17709, 0.015087, "-light", false], [18376, 0.013742, "-exp", false]]]}, "raw_delta": -0.16806447505950928, "tuned_delta": -0.16125219725241133}, {"byte_start": 1732, "byte_end": 1741, "display": {"text": " approach", "kind": "normal"}, "is_word": true, "word_id": 291, "word_key": " approach", "bytes_hex": "20 61 70 70 72 6f 61 63 68", "compression": {"rwkv": "3.13% 3.13% 3.13% 3.13% 3.13% 3.13% 3.13% 3.13% 3.13%", "qwen": "2.77% 2.77% 2.77% 2.77% 2.77% 2.77% 2.77% 2.77% 2.77%"}, "model_tokens": {"rwkv": [[55532, " approach", "normal", 0.20809625089168549]], "qwen": [[5486, " approach", "normal", 0.2512800395488739]]}, "loss": {"rwkv": 3.130848613040285, "qwen": 2.7675443399547306}, "topk": {"rwkv": [55532, 2, 0.20809625089168549, [[46561, 0.56601, " method", false], [55532, 0.208096, " approach", false], [47487, 0.037516, " system", false], [45, 0.025899, ",", false], [57260, 0.02037, " solution", false], [52580, 0.01984, " program", false], [38013, 0.016011, " chess", false], [3609, 0.014486, " AI", false], [55809, 0.011977, " computer", false], [53275, 0.005698, " version", false]]], "qwen": [5486, 2, 0.2512800395488739, [[1714, 0.624797, " method", false], [5486, 0.25128, " approach", false], [1849, 0.044035, " system", false], [2025, 0.013728, " program", false], [11, 0.01117, ",", false], [14762, 0.006686, " technique", false], [12111, 0.005863, " algorithm", false], [6291, 0.003235, " solution", false], [8282, 0.003155, " strategy", false], [6366, 0.002419, " computer", false]]]}, "raw_delta": 0.02014586660597059, "tuned_delta": 0.026958144413068538}, {"byte_start": 1741, "byte_end": 1746, "display": {"text": " with", "kind": "normal"}, "is_word": true, "word_id": 292, "word_key": " with", "bytes_hex": "20 77 69 74 68", "compression": {"rwkv": "20.74% 20.74% 20.74% 20.74% 20.74%", "qwen": "19.36% 19.36% 19.36% 19.36% 19.36%"}, "model_tokens": {"rwkv": [[32487, " with", "normal", 0.003162480890750885]], "qwen": [[448, " with", "normal", 0.004661415237933397]]}, "loss": {"rwkv": 20.738741212778844, "qwen": 19.36253948022767}, "topk": {"rwkv": [32487, 42, 0.003162480890750885, [[22748, 0.189447, " was", false], [22777, 0.077411, " won", false], [30256, 0.070821, " beat", false], [55934, 0.062007, " defeated", false], [4811, 0.052332, " to", false], [45, 0.03644, ",", false], [51744, 0.036347, " finally", false], [61959, 0.035405, " eventually", false], [32227, 0.022425, " that", false], [21795, 0.021821, " had", false]]], "qwen": [448, 36, 0.004661415237933397, [[572, 0.184156, " was", false], [2765, 0.070575, " won", false], [23283, 0.055593, " defeated", false], [374, 0.041249, " is", false], [9583, 0.028863, " eventually", false], [429, 0.026253, " that", false], [6116, 0.026081, " became", false], [29701, 0.020218, " dominated", false], [11, 0.01994, ",", false], [14816, 0.019933, " wins", false]]]}, "raw_delta": 0.07631282806396467, "tuned_delta": 0.08312510587106262}, {"byte_start": 1746, "byte_end": 1754, "display": {"text": " special", "kind": "normal"}, "is_word": true, "word_id": 293, "word_key": " special", "bytes_hex": "20 73 70 65 63 69 61 6c", "compression": {"rwkv": "15.92% 15.92% 15.92% 15.92% 15.92% 15.92% 15.92% 15.92%", "qwen": "20.77% 20.77% 20.77% 20.77% 20.77% 20.77% 20.77% 20.77%"}, "model_tokens": {"rwkv": [[52964, " special", "normal", 0.0008464222773909569]], "qwen": [[3281, " special", "normal", 9.964989294530824e-05]]}, "loss": {"rwkv": 15.920365197309849, "qwen": 20.769957783736956}, "topk": {"rwkv": [52964, 127, 0.0008464222773909569, [[332, 0.205283, " a", false], [22590, 0.042697, " the", false], [30597, 0.039145, " deep", false], [31277, 0.034323, " less", false], [38720, 0.032492, " human", false], [31466, 0.025006, " much", false], [52906, 0.023723, " similar", false], [31458, 0.021324, " more", false], [4692, 0.019114, " no", false], [4419, 0.018979, " an", false]]], "qwen": [3281, 456, 9.964989294530824e-05, [[264, 0.162726, " a", false], [2686, 0.070888, " less", false], [279, 0.054744, " the", false], [16745, 0.040869, " fewer", false], [902, 0.036982, " no", false], [2664, 0.029638, " better", false], [29039, 0.028325, " comparable", false], [1172, 0.027494, " only", false], [4428, 0.02705, " similar", false], [1753, 0.022012, " much", false]]]}, "raw_delta": -0.268918514251709, "tuned_delta": -0.26210623644461106}, {"byte_start": 1754, "byte_end": 1763, "display": {"text": " hardware", "kind": "normal"}, "is_word": true, "word_id": 294, "word_key": " hardware", "bytes_hex": "20 68 61 72 64 77 61 72 65", "compression": {"rwkv": "7.86% 7.86% 7.86% 7.86% 7.86% 7.86% 7.86% 7.86% 7.86%", "qwen": "12.55% 12.55% 12.55% 12.55% 12.55% 12.55% 12.55% 12.55% 12.55%"}, "model_tokens": {"rwkv": [[56353, " hardware", "normal", 0.019742263481020927]], "qwen": [[11773, " hardware", "normal", 0.0019082442158833146]]}, "loss": {"rwkv": 7.858430018731115, "qwen": 12.546581535334132}, "topk": {"rwkv": [56353, 10, 0.019742263481020927, [[46, 0.193369, "-", false], [62586, 0.068636, " structures", false], [60572, 0.068349, " structure", false], [59943, 0.047203, " knowledge", false], [52224, 0.041491, " methods", false], [39558, 0.027564, " rules", false], [59792, 0.027478, " heuristic", false], [62633, 0.022529, " techniques", false], [56215, 0.022317, " features", false], [56353, 0.019742, " hardware", false]]], "qwen": [11773, 41, 0.0019082442158833146, [[58238, 0.186541, "-purpose", false], [6540, 0.087972, " knowledge", false], [32719, 0.080224, " chess", false], [7428, 0.069225, " purpose", false], [5944, 0.042278, " structure", false], [5601, 0.032705, " rules", false], [566, 0.03113, " he", false], [3738, 0.030087, " human", false], [38485, 0.026627, "-case", false], [5413, 0.023169, " methods", false]]]}, "raw_delta": -0.25996632046169704, "tuned_delta": -0.2531540426545991}, {"byte_start": 1763, "byte_end": 1767, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 295, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"rwkv": "15.00% 15.00% 15.00% 15.00%", "qwen": "16.46% 16.46% 16.46% 16.46%"}, "model_tokens": {"rwkv": [[21265, " and", "normal", 0.03503108769655228]], "qwen": [[323, " and", "normal", 0.025942524895071983]]}, "loss": {"rwkv": 15.004591977995565, "qwen": 16.464178638904322}, "topk": {"rwkv": [21265, 7, 0.03503108769655228, [[22748, 0.181538, " was", false], [22777, 0.154428, " won", false], [55934, 0.068469, " defeated", false], [275, 0.053671, " (", false], [45, 0.04616, ",", false], [51744, 0.036425, " finally", false], [21265, 0.035031, " and", false], [61959, 0.031448, " eventually", false], [30256, 0.022486, " beat", false], [30383, 0.017477, " came", false]]], "qwen": [323, 7, 0.025942524895071983, [[572, 0.161828, " was", false], [6116, 0.055485, " became", false], [320, 0.053677, " (", false], [311, 0.04978, " to", false], [369, 0.043006, " for", false], [11, 0.026602, ",", false], [323, 0.025943, " and", false], [374, 0.025237, " is", false], [6519, 0.022702, " turned", false], [9583, 0.019155, " eventually", false]]]}, "raw_delta": -0.08093667030334473, "tuned_delta": -0.07412439249624678}, {"byte_start": 1767, "byte_end": 1776, "display": {"text": " software", "kind": "normal"}, "is_word": true, "word_id": 296, "word_key": " software", "bytes_hex": "20 73 6f 66 74 77 61 72 65", "compression": {"rwkv": "3.79% 3.79% 3.79% 3.79% 3.79% 3.79% 3.79% 3.79% 3.79%", "qwen": "3.74% 3.74% 3.74% 3.74% 3.74% 3.74% 3.74% 3.74% 3.74%"}, "model_tokens": {"rwkv": [[57257, " software", "normal", 0.1483611911535263]], "qwen": [[3162, " software", "normal", 0.1549476981163025]]}, "loss": {"rwkv": 3.7883268217787447, "qwen": 3.73631496859156}, "topk": {"rwkv": [57257, 1, 0.1483611911535263, [[57257, 0.148361, " software", false], [332, 0.103828, " a", false], [52195, 0.050582, " massive", false], [38720, 0.030473, " human", false], [4419, 0.018796, " an", false], [59988, 0.018053, " massively", false], [52964, 0.017287, " special", false], [31335, 0.015181, " lots", false], [31458, 0.014403, " more", false], [57453, 0.013947, " training", false]]], "qwen": [3162, 1, 0.1549476981163025, [[3162, 0.154948, " software", false], [264, 0.118348, " a", false], [25185, 0.044363, " algorithms", false], [12538, 0.024099, " techniques", false], [3281, 0.020289, " special", false], [2711, 0.019608, " search", false], [15473, 0.017461, " programming", false], [458, 0.016747, " an", false], [27699, 0.015374, " clever", false], [27076, 0.012723, " specialized", false]]]}, "raw_delta": 0.0028841495513916016, "tuned_delta": 0.009696427358489548}, {"byte_start": 1776, "byte_end": 1783, "display": {"text": " proved", "kind": "normal"}, "is_word": true, "word_id": 297, "word_key": " proved", "bytes_hex": "20 70 72 6f 76 65 64", "compression": {"rwkv": "13.20% 13.20% 13.20% 13.20% 13.20% 13.20% 13.20%", "qwen": "11.02% 11.02% 11.02% 11.02% 11.02% 11.02% 11.02%"}, "model_tokens": {"rwkv": [[46936, " proved", "normal", 0.0060165049508214]], "qwen": [[18651, " proved", "normal", 0.01385732926428318]]}, "loss": {"rwkv": 13.203235865278456, "qwen": 11.023584256828508}, "topk": {"rwkv": [46936, 22, 0.0060165049508214, [[22748, 0.195014, " was", false], [22777, 0.127125, " won", false], [55934, 0.082489, " defeated", false], [45, 0.048051, ",", false], [275, 0.037912, " (", false], [30256, 0.033662, " beat", false], [61959, 0.027514, " eventually", false], [51744, 0.027079, " finally", false], [32227, 0.025593, " that", false], [45283, 0.022666, " became", false]]], "qwen": [18651, 13, 0.01385732926428318, [[572, 0.160549, " was", false], [311, 0.048153, " to", false], [6116, 0.041038, " became", false], [6519, 0.034666, " turned", false], [369, 0.02844, " for", false], [320, 0.025774, " (", false], [1824, 0.019725, " support", false], [374, 0.01963, " is", false], [3697, 0.019219, " came", false], [11, 0.019093, ",", false]]]}, "raw_delta": 0.12086554936000271, "tuned_delta": 0.12767782716710066}, {"byte_start": 1783, "byte_end": 1790, "display": {"text": " vastly", "kind": "normal"}, "is_word": true, "word_id": 298, "word_key": " vastly", "bytes_hex": "20 76 61 73 74 6c 79", "compression": {"rwkv": "11.67% 11.67% 11.67% 11.67% 11.67% 11.67% 11.67%", "qwen": "16.44% 16.44% 16.44% 16.44% 16.44% 16.44% 16.44%"}, "model_tokens": {"rwkv": [[47708, " vastly", "normal", 0.010818568989634514]], "qwen": [[52008, " vastly", "normal", 0.0016954494640231133]]}, "loss": {"rwkv": 11.673592685764493, "qwen": 16.43592250359131}, "topk": {"rwkv": [47708, 17, 0.010818568989634514, [[4811, 0.289334, " to", false], [57350, 0.114736, " superior", false], [31458, 0.047712, " more", false], [51127, 0.044088, " capable", false], [32227, 0.036551, " that", false], [62603, 0.032794, " successful", false], [59593, 0.025028, " effective", false], [32393, 0.024019, " vict", false], [46342, 0.023509, " itself", false], [22590, 0.018983, " the", false]]], "qwen": [52008, 58, 0.0016954494640231133, [[311, 0.251034, " to", false], [6849, 0.098068, " successful", false], [16353, 0.072676, " superior", false], [14680, 0.052867, " competitive", false], [803, 0.036943, " more", false], [14016, 0.031679, " sufficient", false], [73710, 0.03152, " victorious", false], [18308, 0.025031, " equally", false], [438, 0.024942, " as", false], [7373, 0.024878, " effective", false]]]}, "raw_delta": -0.26407963888985764, "tuned_delta": -0.2572673610827597}, {"byte_start": 1790, "byte_end": 1795, "display": {"text": " more", "kind": "normal"}, "is_word": true, "word_id": 299, "word_key": " more", "bytes_hex": "20 6d 6f 72 65", "compression": {"rwkv": "3.97% 3.97% 3.97% 3.97% 3.97%", "qwen": "6.16% 6.16% 6.16% 6.16% 6.16%"}, "model_tokens": {"rwkv": [[31458, " more", "normal", 0.3299165964126587]], "qwen": [[803, " more", "normal", 0.1812962144613266]]}, "loss": {"rwkv": 3.9730468899481215, "qwen": 6.158948102240927}, "topk": {"rwkv": [31458, 2, 0.3299165964126587, [[57350, 0.50627, " superior", false], [31458, 0.329917, " more", false], [45301, 0.098795, " better", false], [45961, 0.017815, " faster", false], [57326, 0.012557, " stronger", false], [22249, 0.005037, " out", false], [59593, 0.003564, " effective", false], [62603, 0.002346, " successful", false], [56445, 0.002293, " inferior", false], [56040, 0.001394, " dominant", false]]], "qwen": [803, 2, 0.1812962144613266, [[16353, 0.660181, " superior", false], [803, 0.181296, " more", false], [37179, 0.058894, " inferior", false], [700, 0.024377, " out", false], [2664, 0.023047, " better", false], [6849, 0.009693, " successful", false], [2686, 0.005975, " less", false], [10596, 0.005228, " faster", false], [7373, 0.003773, " effective", false], [8661, 0.00299, " easier", false]]]}, "raw_delta": -0.12121210098266602, "tuned_delta": -0.11439982317556807}, {"byte_start": 1795, "byte_end": 1805, "display": {"text": " effective", "kind": "normal"}, "is_word": true, "word_id": 300, "word_key": " effective", "bytes_hex": "20 65 66 66 65 63 74 69 76 65", "compression": {"rwkv": "1.31% 1.31% 1.31% 1.31% 1.31% 1.31% 1.31% 1.31% 1.31% 1.31%", "qwen": "1.37% 1.37% 1.37% 1.37% 1.37% 1.37% 1.37% 1.37% 1.37% 1.37%"}, "model_tokens": {"rwkv": [[59593, " effective", "normal", 0.4824390709400177]], "qwen": [[7373, " effective", "normal", 0.46875810623168945]]}, "loss": {"rwkv": 1.310260144557359, "qwen": 1.3663556183001244}, "topk": {"rwkv": [59593, 1, 0.4824390709400177, [[59593, 0.482439, " effective", false], [56900, 0.290916, " powerful", false], [62603, 0.082626, " successful", false], [51127, 0.045267, " capable", false], [59594, 0.030657, " efficient", false], [63362, 0.007109, " competitive", false], [55435, 0.005784, " accurate", false], [46876, 0.004337, " potent", false], [47129, 0.004275, " robust", false], [59330, 0.004241, " competent", false]]], "qwen": [7373, 1, 0.46875810623168945, [[7373, 0.468758, " effective", false], [6849, 0.270519, " successful", false], [7988, 0.08256, " powerful", false], [11050, 0.06984, " efficient", false], [14976, 0.015863, " practical", false], [14680, 0.00762, " competitive", false], [5390, 0.006265, " useful", false], [5411, 0.005939, " popular", false], [12875, 0.005797, " capable", false], [5000, 0.004134, " difficult", false]]]}, "raw_delta": -0.0031105935573577798, "tuned_delta": 0.003701684249740167}, {"byte_start": 1805, "byte_end": 1806, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "14.37%", "qwen": "11.38%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.44623830914497375]], "qwen": [[11, ",", "normal", 0.5320721864700317]]}, "loss": {"rwkv": 14.370595133854907, "qwen": 11.378826860216636}, "topk": {"rwkv": [45, 1, 0.44623830914497375, [[45, 0.446238, ",", false], [32226, 0.376319, " than", false], [4596, 0.067881, " in", false], [4424, 0.030891, " at", false], [275, 0.013855, " (", false], [50870, 0.012889, " against", false], [21265, 0.007116, " and", false], [21700, 0.005709, " for", false], [4712, 0.004829, " on", false], [32227, 0.003987, " that", false]]], "qwen": [11, 1, 0.5320721864700317, [[11, 0.532072, ",", false], [1091, 0.212294, " than", false], [304, 0.092278, " in", false], [518, 0.045037, " at", false], [320, 0.022672, " (", false], [369, 0.015273, " for", false], [2348, 0.008727, " against", false], [323, 0.006842, " and", false], [1283, 0.005439, " after", false], [389, 0.004736, " on", false]]]}, "raw_delta": 0.165898859500885, "tuned_delta": 0.17271113730798296}, {"byte_start": 1806, "byte_end": 1812, "display": {"text": " these", "kind": "normal"}, "is_word": true, "word_id": 301, "word_key": " these", "bytes_hex": "20 74 68 65 73 65", "compression": {"rwkv": "9.91% 9.91% 9.91% 9.91% 9.91% 9.91%", "qwen": "10.84% 10.84% 10.84% 10.84% 10.84% 10.84%"}, "model_tokens": {"rwkv": [[39936, " these", "normal", 0.03645779564976692]], "qwen": [[1493, " these", "normal", 0.02717256359755993]]}, "loss": {"rwkv": 9.909135860272501, "qwen": 10.836886238030623}, "topk": {"rwkv": [39936, 6, 0.03645779564976692, [[22590, 0.291529, " the", false], [4601, 0.116443, " it", false], [31370, 0.058923, " many", false], [39934, 0.042486, " there", false], [32232, 0.038277, " they", false], [39936, 0.036458, " these", false], [39944, 0.035905, " those", false], [32234, 0.033557, " this", false], [38013, 0.028778, " chess", false], [332, 0.026175, " a", false]]], "qwen": [1493, 8, 0.02717256359755993, [[279, 0.257182, " the", false], [432, 0.19001, " it", false], [1657, 0.046408, " many", false], [807, 0.03432, " they", false], [264, 0.033781, " a", false], [419, 0.031577, " this", false], [1052, 0.028688, " there", false], [1493, 0.027173, " these", false], [1429, 0.02651, " most", false], [11811, 0.023335, " researchers", false]]]}, "raw_delta": -0.05144540468851733, "tuned_delta": -0.04463312688141938}, {"byte_start": 1812, "byte_end": 1818, "display": {"text": " human", "kind": "normal"}, "is_word": true, "word_id": 302, "word_key": " human", "bytes_hex": "20 68 75 6d 61 6e", "compression": {"rwkv": "11.36% 11.36% 11.36% 11.36% 11.36% 11.36%", "qwen": "15.86% 15.86% 15.86% 15.86% 15.86% 15.86%"}, "model_tokens": {"rwkv": [[38720, " human", "normal", 0.023077555000782013]], "qwen": [[3738, " human", "normal", 0.0051124123856425285]]}, "loss": {"rwkv": 11.364980465336235, "qwen": 15.857875301118847}, "topk": {"rwkv": [38720, 5, 0.023077555000782013, [[63843, 0.370782, " researchers", false], [52224, 0.192238, " methods", false], [31937, 0.035156, " same", false], [61590, 0.034009, " approaches", false], [38720, 0.023078, " human", false], [39193, 0.015835, " other", false], [32462, 0.012302, " were", false], [51551, 0.012192, " earlier", false], [47202, 0.011187, " search", false], [38013, 0.011043, " chess", false]]], "qwen": [3738, 6, 0.0051124123856425285, [[11811, 0.839768, " researchers", false], [1852, 0.028461, " same", false], [5413, 0.018997, " methods", false], [1251, 0.010135, " people", false], [6366, 0.009566, " computer", false], [3738, 0.005112, " human", false], [3412, 0.004544, " research", false], [11647, 0.003293, " experts", false], [1033, 0.00309, " were", false], [803, 0.002939, " more", false]]]}, "raw_delta": -0.2491389910380045, "tuned_delta": -0.24232671323090654}, {"byte_start": 1818, "byte_end": 1828, "display": {"text": "-knowledge", "kind": "normal"}, "is_word": true, "word_id": 303, "word_key": "-knowledge", "bytes_hex": "2d 6b 6e 6f 77 6c 65 64 67 65", "compression": {"rwkv": "3.26% 0.97% 0.97% 0.97% 0.97% 0.97% 0.97% 0.97% 0.97% 0.97%", "qwen": "9.30% 9.30% 0.00% 0.00% 0.00% 0.00% 0.00% 0.00% 0.00% 0.00%"}, "model_tokens": {"rwkv": [[46, "-", "normal", 0.8354793787002563], [58313, "knowledge", "normal", 0.6179141402244568]], "qwen": [[12646, "-k", "normal", 0.3563463091850281], [51186, "nowledge", "normal", 0.9994348883628845]]}, "loss": {"rwkv": 1.2028329015224146, "qwen": 1.8618295005851109}, "topk": {"rwkv": [46, 1, 0.8354793787002563, [[46, 0.835479, "-", false], [38013, 0.030065, " chess", false], [52224, 0.023278, " methods", false], [25971, 0.018211, "ists", false], [51685, 0.016525, " experts", false], [61590, 0.011455, " approaches", false], [63843, 0.006702, " researchers", false], [59943, 0.005732, " knowledge", false], [47202, 0.004978, " search", false], [7919, 0.004684, "ist", false]]], "qwen": [12646, 1, 0.3563463091850281, [[12646, 0.356346, "-k", false], [71107, 0.225456, "-under", false], [12, 0.107033, "-", false], [8660, 0.059608, " understanding", false], [5980, 0.023717, "-based", false], [6540, 0.023538, " knowledge", false], [35085, 0.017064, "-oriented", false], [18376, 0.013196, "-exp", false], [3419, 0.010298, "-in", false], [51273, 0.009458, "-focused", false]]]}, "raw_delta": -0.03654253077111207, "tuned_delta": -0.02973025296401412}, {"byte_start": 1828, "byte_end": 1834, "display": {"text": "-based", "kind": "normal"}, "is_word": true, "word_id": 304, "word_key": "-based", "bytes_hex": "2d 62 61 73 65 64", "compression": {"rwkv": "30.85% 1.50% 1.50% 1.50% 1.50% 1.50%", "qwen": "6.90% 6.90% 6.90% 6.90% 6.90% 6.90%"}, "model_tokens": {"rwkv": [[46, "-", "normal", 0.18211570382118225], [34011, "based", "normal", 0.6594290733337402]], "qwen": [[5980, "-based", "normal", 0.10055873543024063]]}, "loss": {"rwkv": 6.392801511751632, "qwen": 6.903936816493413}, "topk": {"rwkv": [46, 3, 0.18211570382118225, [[52224, 0.305458, " methods", false], [61590, 0.257982, " approaches", false], [46, 0.182116, "-", false], [63843, 0.110466, " researchers", false], [37810, 0.051892, " based", false], [38013, 0.007674, " chess", false], [56777, 0.007441, " oriented", false], [51685, 0.005248, " experts", false], [63533, 0.003041, " enthusiasts", false], [55532, 0.002783, " approach", false]]], "qwen": [5980, 3, 0.10055873543024063, [[11811, 0.458921, " researchers", false], [5413, 0.179589, " methods", false], [5980, 0.100559, "-based", false], [19827, 0.086535, " approaches", false], [3118, 0.018875, " based", false], [35085, 0.01782, "-oriented", false], [34316, 0.010812, " specialists", false], [11647, 0.009548, " experts", false], [1251, 0.007044, " people", false], [3412, 0.005827, " research", false]]]}, "raw_delta": -0.028343359629313187, "tuned_delta": -0.02153108182221524}, {"byte_start": 1834, "byte_end": 1840, "display": {"text": " chess", "kind": "normal"}, "is_word": true, "word_id": 305, "word_key": " chess", "bytes_hex": "20 63 68 65 73 73", "compression": {"rwkv": "10.57% 10.57% 10.57% 10.57% 10.57% 10.57%", "qwen": "18.40% 18.40% 18.40% 18.40% 18.40% 18.40%"}, "model_tokens": {"rwkv": [[38013, " chess", "normal", 0.02991454117000103]], "qwen": [[32719, " chess", "normal", 0.0021924730390310287]]}, "loss": {"rwkv": 10.566614069010962, "qwen": 18.40255210111632}, "topk": {"rwkv": [38013, 4, 0.02991454117000103, [[52224, 0.438643, " methods", false], [63843, 0.223789, " researchers", false], [61590, 0.22088, " approaches", false], [38013, 0.029915, " chess", false], [47202, 0.00721, " search", false], [55809, 0.005084, " computer", false], [57103, 0.005082, " research", false], [51685, 0.004291, " experts", false], [3609, 0.004153, " AI", false], [51566, 0.003567, " efforts", false]]], "qwen": [32719, 9, 0.0021924730390310287, [[11811, 0.666725, " researchers", false], [5413, 0.185187, " methods", false], [19827, 0.078376, " approaches", false], [3412, 0.008964, " research", false], [6366, 0.004887, " computer", false], [8869, 0.004315, " efforts", false], [11647, 0.003867, " experts", false], [1714, 0.002293, " method", false], [32719, 0.002192, " chess", false], [12538, 0.002084, " techniques", false]]]}, "raw_delta": -0.43451666831970215, "tuned_delta": -0.4277043905126042}, {"byte_start": 1840, "byte_end": 1852, "display": {"text": " researchers", "kind": "normal"}, "is_word": true, "word_id": 306, "word_key": " researchers", "bytes_hex": "20 72 65 73 65 61 72 63 68 65 72 73", "compression": {"rwkv": "0.65% 0.65% 0.65% 0.65% 0.65% 0.65% 0.65% 0.65% 0.65% 0.65% 0.65% 0.65%", "qwen": "0.99% 0.99% 0.99% 0.99% 0.99% 0.99% 0.99% 0.99% 0.99% 0.99% 0.99% 0.99%"}, "model_tokens": {"rwkv": [[63843, " researchers", "normal", 0.6536304950714111]], "qwen": [[11811, " researchers", "normal", 0.5165534615516663]]}, "loss": {"rwkv": 0.6457375264395588, "qwen": 0.9927191530532772}, "topk": {"rwkv": [63843, 1, 0.6536304950714111, [[63843, 0.65363, " researchers", false], [52224, 0.100927, " methods", false], [46, 0.043349, "-", false], [51685, 0.041739, " experts", false], [61590, 0.027504, " approaches", false], [56949, 0.020866, " programs", false], [52489, 0.019802, " players", false], [3609, 0.017626, " AI", false], [57103, 0.009503, " research", false], [53087, 0.004923, " systems", false]]], "qwen": [11811, 1, 0.5165534615516663, [[11811, 0.516553, " researchers", false], [7468, 0.102095, " programs", false], [5413, 0.096953, " methods", false], [54846, 0.035029, " programmers", false], [4217, 0.031163, " players", false], [72085, 0.028395, "-playing", false], [11647, 0.023772, " experts", false], [3412, 0.019797, " research", false], [5942, 0.016329, " systems", false], [19827, 0.013321, " approaches", false]]]}, "raw_delta": -0.019240746895472217, "tuned_delta": -0.01242846908837427}, {"byte_start": 1852, "byte_end": 1857, "display": {"text": " were", "kind": "normal"}, "is_word": true, "word_id": 307, "word_key": " were", "bytes_hex": "20 77 65 72 65", "compression": {"rwkv": "4.85% 4.85% 4.85% 4.85% 4.85%", "qwen": "4.53% 4.53% 4.53% 4.53% 4.53%"}, "model_tokens": {"rwkv": [[32462, " were", "normal", 0.258990615606308]], "qwen": [[1033, " were", "normal", 0.2846704423427582]]}, "loss": {"rwkv": 4.846553652986361, "qwen": 4.531588495805858}, "topk": {"rwkv": [32462, 1, 0.258990615606308, [[32462, 0.258991, " were", false], [21795, 0.047906, " had", false], [45, 0.024334, ",", false], [21532, 0.019135, " did", false], [38547, 0.018989, " found", false], [30840, 0.017474, " felt", false], [31334, 0.016149, " lost", false], [40, 0.014726, "'", false], [60419, 0.012604, " retreated", false], [45283, 0.012448, " became", false]]], "qwen": [1033, 1, 0.2846704423427582, [[1033, 0.28467, " were", false], [1030, 0.053464, " had", false], [11, 0.023811, ",", false], [6476, 0.022545, " felt", false], [5558, 0.019401, " lost", false], [6966, 0.015394, " looked", false], [22978, 0.014257, " abandoned", false], [6116, 0.014051, " became", false], [6157, 0.013707, " quickly", false], [1730, 0.013475, " found", false]]]}, "raw_delta": 0.017465376853942838, "tuned_delta": 0.024277654661040784}, {"byte_start": 1857, "byte_end": 1861, "display": {"text": " not", "kind": "normal"}, "is_word": true, "word_id": 308, "word_key": " not", "bytes_hex": "20 6e 6f 74", "compression": {"rwkv": "14.37% 14.37% 14.37% 14.37%", "qwen": "15.12% 15.12% 15.12% 15.12%"}, "model_tokens": {"rwkv": [[22187, " not", "normal", 0.04093378037214279]], "qwen": [[537, " not", "normal", 0.03495302423834801]]}, "loss": {"rwkv": 14.370595133854907, "qwen": 15.120121323712658}, "topk": {"rwkv": [22187, 4, 0.04093378037214279, [[32053, 0.098747, " slow", false], [46021, 0.064044, " forced", false], [31269, 0.061881, " left", false], [22187, 0.040934, " not", false], [62683, 0.023958, " understand", false], [45, 0.018684, ",", false], [39418, 0.016965, " quick", false], [47650, 0.01661, " unable", false], [37694, 0.012653, " among", false], [4596, 0.012133, " in", false]]], "qwen": [537, 3, 0.03495302423834801, [[26620, 0.055359, " shocked", false], [71982, 0.038058, " dismay", false], [537, 0.034953, " not", false], [14453, 0.031572, " surprised", false], [2115, 0.028282, " left", false], [9575, 0.022694, " forced", false], [46926, 0.021046, " stunned", false], [86998, 0.019709, " understandably", false], [11889, 0.015698, " unable", false], [3974, 0.015696, " quick", false]]]}, "raw_delta": -0.041562557220458984, "tuned_delta": -0.034750279413361035}, {"byte_start": 1861, "byte_end": 1866, "display": {"text": " good", "kind": "normal"}, "is_word": true, "word_id": 309, "word_key": " good", "bytes_hex": "20 67 6f 6f 64", "compression": {"rwkv": "29.30% 29.30% 29.30% 29.30% 29.30%", "qwen": "29.23% 29.23% 29.23% 29.23% 29.23%"}, "model_tokens": {"rwkv": [[30992, " good", "normal", 0.0002934182120952755]], "qwen": [[1661, " good", "normal", 0.0003018275019712746]]}, "loss": {"rwkv": 29.304743018057067, "qwen": 29.234969656602026}, "topk": {"rwkv": [30992, 256, 0.0002934182120952755, [[31581, 0.06859, " only", false], [30093, 0.058848, " able", false], [39418, 0.058292, " quick", false], [56914, 0.051926, " prepared", false], [32053, 0.048205, " slow", false], [53350, 0.042294, " willing", false], [60601, 0.029532, " surprised", false], [39449, 0.026038, " ready", false], [4424, 0.02343, " at", false], [56426, 0.018183, " inclined", false]]], "qwen": [1661, 234, 0.0003018275019712746, [[14453, 0.06331, " surprised", false], [24404, 0.051046, " impressed", false], [7945, 0.044645, " particularly", false], [518, 0.037477, " at", false], [2952, 0.037358, " able", false], [6247, 0.036072, " happy", false], [22166, 0.030846, " convinced", false], [279, 0.02569, " the", false], [8014, 0.024005, " interested", false], [1172, 0.023934, " only", false]]]}, "raw_delta": 0.0038690567016601562, "tuned_delta": 0.010681334508758102}, {"byte_start": 1866, "byte_end": 1873, "display": {"text": " losers", "kind": "normal"}, "is_word": true, "word_id": 310, "word_key": " losers", "bytes_hex": "20 6c 6f 73 65 72 73", "compression": {"rwkv": "18.41% 18.41% 18.41% 18.41% 18.41% 18.41% 0.00%", "qwen": "23.81% 23.81% 23.81% 23.81% 23.81% 23.81% 23.81%"}, "model_tokens": {"rwkv": [[38935, " loser", "normal", 0.002195763634517789], [116, "s", "normal", 0.9997751116752625]], "qwen": [[67356, " losers", "normal", 9.699879592517391e-05]]}, "loss": {"rwkv": 15.780056836945944, "qwen": 23.806560859563593}, "topk": {"rwkv": [38935, 12, 0.002195763634517789, [[4424, 0.622759, " at", false], [45865, 0.210307, " enough", false], [37598, 0.038406, " about", false], [46, 0.017678, "-", false], [32487, 0.013922, " with", false], [4811, 0.007761, " to", false], [57330, 0.007709, " students", false], [61653, 0.006905, " candidates", false], [21700, 0.004299, " for", false], [4596, 0.00387, " in", false]]], "qwen": [67356, 199, 9.699879592517391e-05, [[518, 0.431798, " at", false], [3322, 0.350935, " enough", false], [4143, 0.015584, " students", false], [23562, 0.013815, " listeners", false], [4780, 0.010812, " friends", false], [11178, 0.01081, " candidates", false], [369, 0.010241, " for", false], [911, 0.008406, " about", false], [10030, 0.006562, " prepared", false], [448, 0.00574, " with", false]]]}, "raw_delta": -0.4450838906424387, "tuned_delta": -0.4382716128353408}, {"byte_start": 1873, "byte_end": 1874, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "4.37%", "qwen": "11.44%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.7851661443710327]], "qwen": [[13, ".", "normal", 0.5303573608398438]]}, "loss": {"rwkv": 4.367533815191197, "qwen": 11.43704191264213}, "topk": {"rwkv": [47, 1, 0.7851661443710327, [[47, 0.785166, ".", false], [45, 0.102736, ",", false], [21265, 0.025082, " and", false], [60, 0.0178, ";", false], [59, 0.010548, ":", false], [4596, 0.008016, " in", false], [275, 0.007705, " (", false], [4424, 0.007233, " at", false], [21400, 0.004186, " but", false], [4450, 0.002589, " by", false]]], "qwen": [13, 1, 0.5303573608398438, [[13, 0.530357, ".", false], [11, 0.106582, ",", false], [382, 0.087159, ".\n\n", false], [624, 0.053129, ".\n", false], [304, 0.035469, " in", false], [26, 0.029752, ";", false], [323, 0.027361, " and", false], [714, 0.024008, " but", false], [320, 0.017181, " (", false], [25, 0.0155, ":", false]]]}, "raw_delta": -0.39201676845550537, "tuned_delta": -0.38520449064840745}, {"byte_start": 1874, "byte_end": 1879, "display": {"text": " They", "kind": "normal"}, "is_word": true, "word_id": 311, "word_key": " they", "bytes_hex": "20 54 68 65 79", "compression": {"rwkv": "7.95% 7.95% 7.95% 7.95% 7.95%", "qwen": "7.04% 7.04% 7.04% 7.04% 7.04%"}, "model_tokens": {"rwkv": [[29893, " They", "normal", 0.10889483243227005]], "qwen": [[2379, " They", "normal", 0.14182904362678528]]}, "loss": {"rwkv": 7.946093779896243, "qwen": 7.044437756478033}, "topk": {"rwkv": [29893, 2, 0.10889483243227005, [[261, 0.263107, "\n\n", false], [29893, 0.108895, " They", false], [267, 0.068114, "  ", false], [20996, 0.066918, " The", false], [19555, 0.040023, " But", false], [3913, 0.03657, " In", false], [37449, 0.026821, " Their", false], [3918, 0.021083, " It", false], [19417, 0.01304, " And", false], [29894, 0.012532, " This", false]]], "qwen": [2379, 1, 0.14182904362678528, [[2379, 0.141829, " They", false], [220, 0.131886, " ", false], [576, 0.082841, " The", false], [758, 0.04453, " In", false], [10964, 0.038897, " Their", false], [12090, 0.034402, " Instead", false], [1988, 0.029294, " But", false], [1084, 0.028173, " It", false], [320, 0.026805, " (", false], [1096, 0.018467, " This", false]]]}, "raw_delta": 0.049998426437377896, "tuned_delta": 0.056810704244475846}, {"byte_start": 1879, "byte_end": 1884, "display": {"text": " said", "kind": "normal"}, "is_word": true, "word_id": 312, "word_key": " said", "bytes_hex": "20 73 61 69 64", "compression": {"rwkv": "23.22% 23.22% 23.22% 23.22% 23.22%", "qwen": "24.38% 24.38% 24.38% 24.38% 24.38%"}, "model_tokens": {"rwkv": [[31929, " said", "normal", 0.0015937149291858077]], "qwen": [[1053, " said", "normal", 0.0011602459708228707]]}, "loss": {"rwkv": 23.218373314306753, "qwen": 24.378384255590834}, "topk": {"rwkv": [31929, 96, 0.0015937149291858077, [[32462, 0.123487, " were", false], [21795, 0.10147, " had", false], [21532, 0.056417, " did", false], [59392, 0.036853, " continued", false], [40013, 0.018638, " tried", false], [39762, 0.018479, " spent", false], [39820, 0.017718, " still", false], [38128, 0.017341, " could", false], [60158, 0.013666, " persisted", false], [31334, 0.013464, " lost", false]]], "qwen": [1053, 110, 0.0011602459708228707, [[1033, 0.182277, " were", false], [1030, 0.157047, " had", false], [1521, 0.037867, " did", false], [8570, 0.02375, " continued", false], [5558, 0.023589, " lost", false], [7391, 0.017444, " spent", false], [1410, 0.017068, " could", false], [1035, 0.013185, " would", false], [6476, 0.011364, " felt", false], [11585, 0.010578, " believed", false]]]}, "raw_delta": -0.0643246650695799, "tuned_delta": -0.05751238726248195}, {"byte_start": 1884, "byte_end": 1889, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 313, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"rwkv": "4.17% 4.17% 4.17% 4.17% 4.17%", "qwen": "4.76% 4.76% 4.76% 4.76% 4.76%"}, "model_tokens": {"rwkv": [[32227, " that", "normal", 0.3171359598636627]], "qwen": [[429, " that", "normal", 0.26710042357444763]]}, "loss": {"rwkv": 4.170290352569659, "qwen": 4.761364626621232}, "topk": {"rwkv": [32227, 1, 0.3171359598636627, [[32227, 0.317136, " that", false], [45, 0.116878, ",", false], [32232, 0.108233, " they", false], [22590, 0.098751, " the", false], [4601, 0.048944, " it", false], [47539, 0.038282, " things", false], [39931, 0.028657, " their", false], [269, 0.026365, " \"", false], [4788, 0.015678, " so", false], [38013, 0.012355, " chess", false]]], "qwen": [429, 1, 0.26710042357444763, [[429, 0.2671, " that", false], [11, 0.250771, ",", false], [330, 0.068366, " \"", false], [807, 0.055191, " they", false], [432, 0.050815, " it", false], [2513, 0.03838, " things", false], [4302, 0.036074, " nothing", false], [279, 0.033549, " the", false], [25, 0.031332, ":", false], [311, 0.012669, " to", false]]]}, "raw_delta": -0.0327761173248291, "tuned_delta": -0.025963839517731156}, {"byte_start": 1889, "byte_end": 1892, "display": {"text": " ``", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "20 60 60", "compression": {"rwkv": "68.00% 68.00% 68.00%", "qwen": "64.29% 64.29% 64.29%"}, "model_tokens": {"rwkv": [[4404, " ``", "normal", 1.1975742381764576e-05]], "qwen": [[9902, " ``", "normal", 2.2649990569334477e-05]]}, "loss": {"rwkv": 68.00203187523499, "qwen": 64.29221131173843}, "topk": {"rwkv": [4404, 1020, 1.1975742381764576e-05, [[22590, 0.307914, " the", false], [39931, 0.101499, " their", false], [32232, 0.085941, " they", false], [47202, 0.074075, " search", false], [4601, 0.033928, " it", false], [332, 0.028208, " a", false], [32234, 0.028077, " this", false], [30597, 0.021603, " deep", false], [45, 0.020069, ",", false], [38720, 0.018062, " human", false]]], "qwen": [9902, 723, 2.2649990569334477e-05, [[279, 0.227069, " the", false], [807, 0.152814, " they", false], [862, 0.072788, " their", false], [432, 0.062657, " it", false], [32719, 0.034045, " chess", false], [2711, 0.031921, " search", false], [264, 0.027836, " a", false], [419, 0.02541, " this", false], [1052, 0.022813, " there", false], [11, 0.019629, ",", false]]]}, "raw_delta": 0.20571613311767578, "tuned_delta": 0.21252841092477373}, {"byte_start": 1892, "byte_end": 1897, "display": {"text": "brute", "kind": "normal"}, "is_word": true, "word_id": 314, "word_key": "brute", "bytes_hex": "62 72 75 74 65", "compression": {"rwkv": "46.21% 46.21% 46.21% 0.02% 0.02%", "qwen": "64.52% 64.52% 0.20% 0.20% 0.20%"}, "model_tokens": {"rwkv": [[7184, "bru", "normal", 0.00045388934086076915], [2206, "te", "normal", 0.9976199269294739]], "qwen": [[1323, "br", "normal", 0.0007809735834598541], [1070, "ute", "normal", 0.9664857387542725]]}, "loss": {"rwkv": 27.73543572546411, "qwen": 25.92904569975074}, "topk": {"rwkv": [7184, 192, 0.00045388934086076915, [[8801, 0.131728, "the", false], [25116, 0.073922, "deep", false], [42233, 0.049455, "search", false], [34580, 0.046748, "human", false], [24991, 0.028961, "ches", false], [53865, 0.025185, "computer", false], [2278, 0.02411, "we", false], [1956, 0.021183, "it", false], [35755, 0.0203, "there", false], [2073, 0.019979, "no", false]]], "qwen": [1323, 137, 0.0007809735834598541, [[1782, 0.152667, "the", false], [896, 0.046311, "we", false], [331, 0.044493, "ch", false], [25312, 0.034654, "human", false], [1836, 0.031319, "search", false], [18532, 0.030247, "there", false], [275, 0.030046, "it", false], [64, 0.024511, "a", false], [64947, 0.020238, "comput", false], [785, 0.015029, "The", false]]]}, "raw_delta": 0.10016753226518631, "tuned_delta": 0.10697981007228426}, {"byte_start": 1897, "byte_end": 1903, "display": {"text": " force", "kind": "normal"}, "is_word": true, "word_id": 315, "word_key": " force", "bytes_hex": "20 66 6f 72 63 65", "compression": {"rwkv": "1.12% 1.12% 1.12% 1.12% 1.12% 1.12%", "qwen": "0.64% 0.64% 0.64% 0.64% 0.64% 0.64%"}, "model_tokens": {"rwkv": [[38536, " force", "normal", 0.6842653155326843]], "qwen": [[5344, " force", "normal", 0.8073176741600037]]}, "loss": {"rwkv": 1.121235159545052, "qwen": 0.6433158405242455}, "topk": {"rwkv": [38536, 1, 0.6842653155326843, [[38536, 0.684265, " force", false], [46, 0.260822, "-", false], [57319, 0.007889, " strength", false], [439, 0.006784, "''", false], [59346, 0.005311, " computing", false], [47202, 0.005055, " search", false], [63370, 0.004006, " computation", false], [39339, 0.003538, " power", false], [37920, 0.002226, " brute", false], [51779, 0.00209, " forcing", false]]], "qwen": [5344, 1, 0.8073176741600037, [[5344, 0.807318, " force", false], [80049, 0.155477, "-force", false], [2355, 0.013885, " power", false], [8170, 0.005856, " strength", false], [2711, 0.002685, " search", false], [24231, 0.001879, " computing", false], [24913, 0.001521, " forcing", false], [34447, 0.001121, " computation", false], [15039, 0.000489, " searching", false], [19428, 0.000473, "-search", false]]]}, "raw_delta": 0.02650147428115208, "tuned_delta": 0.03331375208825003}, {"byte_start": 1903, "byte_end": 1904, "display": {"text": "\"", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "22", "compression": {"rwkv": "68.19%", "qwen": "60.17%"}, "model_tokens": {"rwkv": [[35, "\"", "normal", 0.022961752489209175]], "qwen": [[1, "\"", "normal", 0.0355585552752018]]}, "loss": {"rwkv": 68.1898827920174, "qwen": 60.17074454064671}, "topk": {"rwkv": [35, 3, 0.022961752489209175, [[439, 0.692869, "''", false], [4600, 0.068501, " is", false], [35, 0.022962, "\"", false], [40, 0.021512, "'", false], [22748, 0.016159, " was", false], [32475, 0.012522, " will", false], [47202, 0.012236, " search", false], [5341, 0.011479, ",''", false], [32481, 0.009042, " wins", false], [40219, 0.007943, " would", false]]], "qwen": [1, 5, 0.0355585552752018, [[4605, 0.666866, "''", false], [374, 0.046522, " is", false], [6, 0.040162, "'", false], [2711, 0.039583, " search", false], [1, 0.035559, "\"", false], [40510, 0.018344, ",''", false], [572, 0.010485, " was", false], [50817, 0.007851, "'',", false], [11, 0.007359, ",", false], [686, 0.006617, " will", false]]]}, "raw_delta": 0.4446754455566406, "tuned_delta": 0.45148772336373855}, {"byte_start": 1904, "byte_end": 1911, "display": {"text": " search", "kind": "normal"}, "is_word": true, "word_id": 316, "word_key": " search", "bytes_hex": "20 73 65 61 72 63 68", "compression": {"rwkv": "8.09% 8.09% 8.09% 8.09% 8.09% 8.09% 8.09%", "qwen": "5.22% 5.22% 5.22% 5.22% 5.22% 5.22% 5.22%"}, "model_tokens": {"rwkv": [[47202, " search", "normal", 0.04276701807975769]], "qwen": [[2711, " search", "normal", 0.13174693286418915]]}, "loss": {"rwkv": 8.091007344271251, "qwen": 5.22171206232272}, "topk": {"rwkv": [47202, 5, 0.04276701807975769, [[22748, 0.281297, " was", false], [52224, 0.155981, " methods", false], [40219, 0.103828, " would", false], [21795, 0.046685, " had", false], [47202, 0.042767, " search", false], [4600, 0.038754, " is", false], [38128, 0.030128, " could", false], [61590, 0.025649, " approaches", false], [275, 0.017013, " (", false], [21265, 0.011662, " and", false]]], "qwen": [2711, 2, 0.13174693286418915, [[572, 0.244206, " was", false], [2711, 0.131747, " search", false], [1035, 0.095376, " would", false], [5413, 0.057583, " methods", false], [374, 0.057558, " is", false], [320, 0.044885, " (", false], [1030, 0.040804, " had", false], [323, 0.020798, " and", false], [32719, 0.013899, " chess", false], [476, 0.01116, " or", false]]]}, "raw_delta": 0.15910751479012622, "tuned_delta": 0.16591979259722417}, {"byte_start": 1911, "byte_end": 1915, "display": {"text": " may", "kind": "normal"}, "is_word": true, "word_id": 317, "word_key": " may", "bytes_hex": "20 6d 61 79", "compression": {"rwkv": "37.76% 37.76% 37.76% 37.76%", "qwen": "34.56% 34.56% 34.56% 34.56%"}, "model_tokens": {"rwkv": [[22074, " may", "normal", 0.00022737793915439397]], "qwen": [[1231, " may", "normal", 0.00046904574264772236]]}, "loss": {"rwkv": 37.758034273265835, "qwen": 34.556198865622754}, "topk": {"rwkv": [22074, 129, 0.00022737793915439397, [[22748, 0.415824, " was", false], [40219, 0.102733, " would", false], [21795, 0.063009, " had", false], [52224, 0.052967, " methods", false], [38128, 0.05229, " could", false], [4600, 0.050096, " is", false], [45, 0.019529, ",", false], [21532, 0.014646, " did", false], [47285, 0.010065, " simply", false], [45599, 0.00844, " couldn", false]]], "qwen": [1231, 92, 0.00046904574264772236, [[572, 0.389624, " was", false], [1035, 0.13415, " would", false], [374, 0.099906, " is", false], [1030, 0.037142, " had", false], [11, 0.030969, ",", false], [1410, 0.024413, " could", false], [5413, 0.017751, " methods", false], [320, 0.016459, " (", false], [686, 0.015828, " will", false], [323, 0.012574, " and", false]]]}, "raw_delta": 0.17754745483398438, "tuned_delta": 0.18435973264108232}, {"byte_start": 1915, "byte_end": 1920, "display": {"text": " have", "kind": "normal"}, "is_word": true, "word_id": 318, "word_key": " have", "bytes_hex": "20 68 61 76 65", "compression": {"rwkv": "4.54% 4.54% 4.54% 4.54% 4.54%", "qwen": "7.79% 7.79% 7.79% 7.79% 7.79%"}, "model_tokens": {"rwkv": [[31059, " have", "normal", 0.28118181228637695]], "qwen": [[614, " have", "normal", 0.11545616388320923]]}, "loss": {"rwkv": 4.536599640295373, "qwen": 7.786456903625622}, "topk": {"rwkv": [31059, 2, 0.28118181228637695, [[4435, 0.356462, " be", false], [31059, 0.281182, " have", false], [32499, 0.120041, " work", false], [22187, 0.032091, " not", false], [22770, 0.027452, " win", false], [61959, 0.017374, " eventually", false], [30256, 0.017127, " beat", false], [32458, 0.016481, " well", false], [46272, 0.006254, " indeed", false], [45685, 0.005246, " defeat", false]]], "qwen": [614, 3, 0.11545616388320923, [[387, 0.394511, " be", false], [537, 0.152496, " not", false], [614, 0.115456, " have", false], [975, 0.048592, " work", false], [1632, 0.045093, " well", false], [9583, 0.024234, " eventually", false], [3164, 0.020108, " win", false], [13653, 0.011506, " ultimately", false], [12824, 0.009843, " indeed", false], [12118, 0.008267, " prove", false]]]}, "raw_delta": -0.18021035194396973, "tuned_delta": -0.17339807413687178}, {"byte_start": 1920, "byte_end": 1924, "display": {"text": " won", "kind": "normal"}, "is_word": true, "word_id": 319, "word_key": " won", "bytes_hex": "20 77 6f 6e", "compression": {"rwkv": "8.81% 8.81% 8.81% 8.81%", "qwen": "8.65% 8.65% 8.65% 8.65%"}, "model_tokens": {"rwkv": [[22777, " won", "normal", 0.14129860699176788]], "qwen": [[2765, " won", "normal", 0.14682579040527344]]}, "loss": {"rwkv": 8.805511724175801, "qwen": 8.649445530204561}, "topk": {"rwkv": [22777, 3, 0.14129860699176788, [[30259, 0.323271, " been", false], [47812, 0.160315, " worked", false], [22777, 0.141299, " won", false], [55934, 0.06489, " defeated", false], [45281, 0.035494, " beaten", false], [61959, 0.016486, " eventually", false], [47333, 0.014594, " solved", false], [332, 0.013218, " a", false], [60586, 0.012088, " succeeded", false], [30256, 0.011253, " beat", false]]], "qwen": [2765, 2, 0.14682579040527344, [[1012, 0.28794, " been", false], [2765, 0.146826, " won", false], [30294, 0.072956, " beaten", false], [23283, 0.069093, " defeated", false], [6439, 0.037148, " worked", false], [264, 0.025148, " a", false], [700, 0.013904, " out", false], [279, 0.013003, " the", false], [6069, 0.010961, " led", false], [1030, 0.010471, " had", false]]]}, "raw_delta": 0.008654147386550903, "tuned_delta": 0.01546642519364885}, {"byte_start": 1924, "byte_end": 1929, "display": {"text": " this", "kind": "normal"}, "is_word": true, "word_id": 320, "word_key": " this", "bytes_hex": "20 74 68 69 73", "compression": {"rwkv": "16.46% 16.46% 16.46% 16.46% 16.46%", "qwen": "17.28% 17.28% 17.28% 17.28% 17.28%"}, "model_tokens": {"rwkv": [[32234, " this", "normal", 0.010152711533010006]], "qwen": [[419, " this", "normal", 0.008304568938910961]]}, "loss": {"rwkv": 16.45574031013974, "qwen": 17.279697151637894}, "topk": {"rwkv": [32234, 12, 0.010152711533010006, [[22590, 0.513006, " the", false], [45, 0.119524, ",", false], [50870, 0.063709, " against", false], [4712, 0.053436, " on", false], [4596, 0.047962, " in", false], [32229, 0.032383, " them", false], [332, 0.018943, " a", false], [21700, 0.013663, " for", false], [38013, 0.013399, " chess", false], [4424, 0.012409, " at", false]]], "qwen": [419, 9, 0.008304568938910961, [[279, 0.444667, " the", false], [11, 0.260208, ",", false], [32719, 0.059978, " chess", false], [304, 0.037963, " in", false], [37542, 0.02516, " Kas", false], [714, 0.015706, " but", false], [2348, 0.012235, " against", false], [13, 0.009391, ".", false], [419, 0.008305, " this", false], [264, 0.007524, " a", false]]]}, "raw_delta": -0.045689868927002, "tuned_delta": -0.03887759111990405}, {"byte_start": 1929, "byte_end": 1934, "display": {"text": " time", "kind": "normal"}, "is_word": true, "word_id": 321, "word_key": " time", "bytes_hex": "20 74 69 6d 65", "compression": {"rwkv": "6.45% 6.45% 6.45% 6.45% 6.45%", "qwen": "13.29% 13.29% 13.29% 13.29% 13.29%"}, "model_tokens": {"rwkv": [[32251, " time", "normal", 0.1674596071243286]], "qwen": [[882, " time", "normal", 0.02511478215456009]]}, "loss": {"rwkv": 6.452678991476026, "qwen": 13.288298852929454}, "topk": {"rwkv": [32251, 2, 0.1674596071243286, [[62293, 0.252761, " particular", false], [32251, 0.16746, " time", false], [39551, 0.106563, " round", false], [30941, 0.087889, " game", false], [38981, 0.068827, " match", false], [45278, 0.052414, " battle", false], [22226, 0.035034, " one", false], [38013, 0.031674, " chess", false], [57271, 0.031303, " specific", false], [62653, 0.0243, " tournament", false]]], "qwen": [882, 12, 0.02511478215456009, [[3953, 0.221175, " particular", false], [1809, 0.1886, " game", false], [2432, 0.102998, " match", false], [8049, 0.067648, " battle", false], [32719, 0.04686, " chess", false], [825, 0.041474, " one", false], [6957, 0.034948, " race", false], [4116, 0.029859, " war", false], [10707, 0.02819, " competition", false], [4778, 0.028065, " round", false]]]}, "raw_delta": -0.37904725074768064, "tuned_delta": -0.3722349729405827}, {"byte_start": 1934, "byte_end": 1935, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "2.45%", "qwen": "5.44%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.8727167844772339]], "qwen": [[11, ",", "normal", 0.7395690679550171]]}, "loss": {"rwkv": 2.4479322593208726, "qwen": 5.440540023273668}, "topk": {"rwkv": [45, 1, 0.8727167844772339, [[45, 0.872717, ",", false], [21400, 0.055516, " but", false], [275, 0.014981, " (", false], [45202, 0.013832, " around", false], [51018, 0.011425, " because", false], [50870, 0.004993, " against", false], [21265, 0.003042, " and", false], [4596, 0.002116, " in", false], [4450, 0.002066, " by", false], [47, 0.002023, ".", false]]], "qwen": [11, 1, 0.7395690679550171, [[11, 0.739569, ",", false], [714, 0.134095, " but", false], [13, 0.026886, ".", false], [1576, 0.021813, " because", false], [320, 0.012209, " (", false], [323, 0.008291, " and", false], [26, 0.007506, ";", false], [2163, 0.006502, " around", false], [304, 0.005369, " in", false], [553, 0.002741, " by", false]]]}, "raw_delta": -0.1659454107284546, "tuned_delta": -0.15913313292135664}, {"byte_start": 1935, "byte_end": 1939, "display": {"text": " but", "kind": "normal"}, "is_word": true, "word_id": 322, "word_key": " but", "bytes_hex": "20 62 75 74", "compression": {"rwkv": "0.13% 0.13% 0.13% 0.13%", "qwen": "0.29% 0.29% 0.29% 0.29%"}, "model_tokens": {"rwkv": [[21400, " but", "normal", 0.9723497629165649]], "qwen": [[714, " but", "normal", 0.9371599555015564]]}, "loss": {"rwkv": 0.12712957551778814, "qwen": 0.2926023471418245}, "topk": {"rwkv": [21400, 1, 0.9723497629165649, [[21400, 0.97235, " but", false], [21265, 0.011484, " and", false], [51018, 0.003315, " because", false], [4596, 0.000879, " in", false], [32227, 0.00071, " that", false], [4423, 0.000686, " as", false], [21700, 0.000608, " for", false], [4715, 0.000583, " or", false], [4601, 0.000492, " it", false], [39690, 0.00045, " since", false]]], "qwen": [714, 1, 0.9371599555015564, [[714, 0.93716, " but", false], [323, 0.028797, " and", false], [9902, 0.002806, " ``", false], [1576, 0.002413, " because", false], [537, 0.00212, " not", false], [1393, 0.001582, " while", false], [773, 0.001197, " so", false], [304, 0.001113, " in", false], [429, 0.001088, " that", false], [892, 0.001065, " which", false]]]}, "raw_delta": -0.009175758808851242, "tuned_delta": -0.002363481001753295}, {"byte_start": 1939, "byte_end": 1942, "display": {"text": " it", "kind": "normal"}, "is_word": true, "word_id": 323, "word_key": " it", "bytes_hex": "20 69 74", "compression": {"rwkv": "5.64% 5.64% 5.64%", "qwen": "10.12% 10.12% 10.12%"}, "model_tokens": {"rwkv": [[4601, " it", "normal", 0.38872674107551575]], "qwen": [[432, " it", "normal", 0.1857195794582367]]}, "loss": {"rwkv": 5.635527503472513, "qwen": 10.120008804656042}, "topk": {"rwkv": [4601, 1, 0.38872674107551575, [[4601, 0.388727, " it", false], [32227, 0.123688, " that", false], [22590, 0.046712, " the", false], [40219, 0.042901, " would", false], [32232, 0.042028, " they", false], [4596, 0.040861, " in", false], [37920, 0.033457, " brute", false], [39934, 0.018486, " there", false], [32465, 0.012099, " when", false], [31581, 0.012095, " only", false]]], "qwen": [432, 2, 0.1857195794582367, [[429, 0.205034, " that", false], [432, 0.18572, " it", false], [807, 0.076933, " they", false], [279, 0.07421, " the", false], [9902, 0.054034, " ``", false], [304, 0.031521, " in", false], [3738, 0.027188, " human", false], [862, 0.02355, " their", false], [11, 0.012975, ",", false], [1052, 0.012856, " there", false]]]}, "raw_delta": -0.2486724456151327, "tuned_delta": -0.24186016780803474}, {"byte_start": 1942, "byte_end": 1946, "display": {"text": " was", "kind": "normal"}, "is_word": true, "word_id": 324, "word_key": " was", "bytes_hex": "20 77 61 73", "compression": {"rwkv": "9.02% 9.02% 9.02% 9.02%", "qwen": "6.05% 6.05% 6.05% 6.05%"}, "model_tokens": {"rwkv": [[22748, " was", "normal", 0.13505084812641144]], "qwen": [[572, " was", "normal", 0.26141783595085144]]}, "loss": {"rwkv": 9.01684400555602, "qwen": 6.048657778025745}, "topk": {"rwkv": [22748, 3, 0.13505084812641144, [[40219, 0.342753, " would", false], [32475, 0.140538, " will", false], [22748, 0.135051, " was", false], [4600, 0.064773, " is", false], [22777, 0.057185, " won", false], [38128, 0.048928, " could", false], [47816, 0.042702, " wouldn", false], [45599, 0.017871, " couldn", false], [21795, 0.017453, " had", false], [32445, 0.015269, " wasn", false]]], "qwen": [572, 1, 0.26141783595085144, [[572, 0.261418, " was", false], [1035, 0.232932, " would", false], [1030, 0.083405, " had", false], [374, 0.064521, " is", false], [686, 0.062818, " will", false], [5710, 0.039827, " wasn", false], [1521, 0.028683, " did", false], [1410, 0.025184, " could", false], [8270, 0.020922, " wouldn", false], [2765, 0.013033, " won", false]]]}, "raw_delta": 0.16459119319915771, "tuned_delta": 0.17140347100625566}, {"byte_start": 1946, "byte_end": 1950, "display": {"text": " not", "kind": "normal"}, "is_word": true, "word_id": 325, "word_key": " not", "bytes_hex": "20 6e 6f 74", "compression": {"rwkv": "6.45% 6.45% 6.45% 6.45%", "qwen": "5.50% 5.50% 5.50% 5.50%"}, "model_tokens": {"rwkv": [[22187, " not", "normal", 0.2384081780910492]], "qwen": [[537, " not", "normal", 0.295030802488327]]}, "loss": {"rwkv": 6.4456345820966865, "qwen": 5.503320140188}, "topk": {"rwkv": [22187, 1, 0.2384081780910492, [[22187, 0.238408, " not", false], [332, 0.139467, " a", false], [31581, 0.056389, " only", false], [4692, 0.041301, " no", false], [22590, 0.041056, " the", false], [4419, 0.030903, " an", false], [57492, 0.025859, " unlikely", false], [31198, 0.021273, " just", false], [45781, 0.020709, " doomed", false], [39115, 0.016713, " never", false]]], "qwen": [537, 1, 0.295030802488327, [[537, 0.295031, " not", false], [264, 0.097277, " a", false], [1172, 0.061949, " only", false], [279, 0.038257, " the", false], [9902, 0.028887, " ``", false], [2058, 0.022418, " still", false], [2581, 0.021681, " never", false], [902, 0.018413, " no", false], [458, 0.015422, " an", false], [4969, 0.014254, " wrong", false]]]}, "raw_delta": 0.052253007888793945, "tuned_delta": 0.059065285695891895}, {"byte_start": 1950, "byte_end": 1952, "display": {"text": " a", "kind": "normal"}, "is_word": true, "word_id": 326, "word_key": " a", "bytes_hex": "20 61", "compression": {"rwkv": "11.34% 11.34%", "qwen": "19.45% 19.45%"}, "model_tokens": {"rwkv": [[332, " a", "normal", 0.28031447529792786]], "qwen": [[264, " a", "normal", 0.11562146991491318]]}, "loss": {"rwkv": 11.341499100738432, "qwen": 19.453241410466205}, "topk": {"rwkv": [332, 1, 0.28031447529792786, [[332, 0.280314, " a", false], [22590, 0.173136, " the", false], [38606, 0.120373, " going", false], [4419, 0.045434, " an", false], [46439, 0.031891, " likely", false], [51832, 0.026627, " general", false], [30992, 0.019086, " good", false], [47008, 0.018724, " really", false], [32464, 0.01073, " what", false], [4423, 0.009245, " as", false]]], "qwen": [264, 2, 0.11562146991491318, [[279, 0.455008, " the", false], [264, 0.115621, " a", false], [2087, 0.036553, " going", false], [862, 0.026023, " their", false], [1128, 0.024629, " what", false], [2167, 0.020695, " really", false], [4586, 0.015172, " general", false], [458, 0.013861, " an", false], [14312, 0.013161, " necessarily", false], [1576, 0.007926, " because", false]]]}, "raw_delta": -0.4498105049133301, "tuned_delta": -0.44299822710623216}, {"byte_start": 1952, "byte_end": 1960, "display": {"text": " general", "kind": "normal"}, "is_word": true, "word_id": 327, "word_key": " general", "bytes_hex": "20 67 65 6e 65 72 61 6c", "compression": {"rwkv": "3.61% 3.61% 3.61% 3.61% 3.61% 3.61% 3.61% 3.61%", "qwen": "5.09% 5.09% 5.09% 5.09% 5.09% 5.09% 5.09% 5.09%"}, "model_tokens": {"rwkv": [[51832, " general", "normal", 0.20347818732261658]], "qwen": [[4586, " general", "normal", 0.10466268658638]]}, "loss": {"rwkv": 3.6102598069120786, "qwen": 5.087782645968473}, "topk": {"rwkv": [51832, 1, 0.20347818732261658, [[51832, 0.203478, " general", false], [30992, 0.098668, " good", false], [46561, 0.079969, " method", false], [30811, 0.040708, " fair", false], [31835, 0.028125, " real", false], [53354, 0.027467, " winning", false], [53283, 0.027219, " victory", false], [32313, 0.023837, " true", false], [40091, 0.023617, " valid", false], [4404, 0.022651, " ``", false]]], "qwen": [4586, 1, 0.10466268658638, [[4586, 0.104663, " general", false], [1661, 0.085055, " good", false], [1602, 0.039174, " very", false], [1714, 0.03682, " method", false], [830, 0.034978, " true", false], [10987, 0.030614, " winning", false], [6624, 0.029465, " fair", false], [6291, 0.025684, " solution", false], [12560, 0.022494, " victory", false], [7394, 0.017502, " princip", false]]]}, "raw_delta": -0.08193126320838928, "tuned_delta": -0.07511898540129133}, {"byte_start": 1960, "byte_end": 1969, "display": {"text": " strategy", "kind": "normal"}, "is_word": true, "word_id": 328, "word_key": " strategy", "bytes_hex": "20 73 74 72 61 74 65 67 79", "compression": {"rwkv": "7.95% 7.95% 7.95% 7.95% 7.95% 7.95% 7.95% 7.95% 7.95%", "qwen": "9.24% 9.24% 9.24% 9.24% 9.24% 9.24% 9.24% 9.24% 9.24%"}, "model_tokens": {"rwkv": [[57317, " strategy", "normal", 0.018513312563300133]], "qwen": [[8282, " strategy", "normal", 0.009917660616338253]]}, "loss": {"rwkv": 7.952355477122325, "qwen": 9.244144876068852}, "topk": {"rwkv": [57317, 6, 0.018513312563300133, [[46561, 0.527286, " method", false], [55532, 0.165826, " approach", false], [41729, 0.089709, "izable", false], [57260, 0.070878, " solution", false], [22752, 0.021843, " way", false], [57317, 0.018513, " strategy", false], [46, 0.015155, "-", false], [60250, 0.013945, " principle", false], [60624, 0.007947, " technique", false], [45, 0.007033, ",", false]]], "qwen": [8282, 11, 0.009917660616338253, [[1714, 0.38849, " method", false], [5486, 0.148424, " approach", false], [8335, 0.098412, "izable", false], [6291, 0.068549, " solution", false], [58238, 0.068317, "-purpose", false], [10987, 0.02087, " winning", false], [12111, 0.01473, " algorithm", false], [7428, 0.013208, " purpose", false], [14762, 0.012738, " technique", false], [11, 0.012299, ",", false]]]}, "raw_delta": -0.071632014380561, "tuned_delta": -0.06481973657346304}, {"byte_start": 1969, "byte_end": 1970, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "34.94%", "qwen": "33.33%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.1430448293685913]], "qwen": [[11, ",", "normal", 0.15751907229423523]]}, "loss": {"rwkv": 34.94027052152958, "qwen": 33.33002060911559}, "topk": {"rwkv": [45, 3, 0.1430448293685913, [[47, 0.378565, ".", false], [21700, 0.191638, " for", false], [45, 0.143045, ",", false], [32227, 0.117537, " that", false], [21265, 0.068345, " and", false], [60, 0.020794, ";", false], [4811, 0.010787, " to", false], [275, 0.00977, " (", false], [59, 0.006006, ":", false], [61586, 0.005823, " applicable", false]]], "qwen": [11, 3, 0.15751907229423523, [[13, 0.267979, ".", false], [429, 0.184571, " that", false], [11, 0.157519, ",", false], [369, 0.122608, " for", false], [323, 0.089749, " and", false], [26, 0.032851, ";", false], [382, 0.022751, ".\n\n", false], [8415, 0.016348, " applicable", false], [311, 0.011225, " to", false], [320, 0.009869, " (", false]]]}, "raw_delta": 0.08929121494293213, "tuned_delta": 0.09610349275003008}, {"byte_start": 1970, "byte_end": 1974, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 329, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"rwkv": "1.03% 1.03% 1.03% 1.03%", "qwen": "1.64% 1.64% 1.64% 1.64%"}, "model_tokens": {"rwkv": [[21265, " and", "normal", 0.7980367541313171]], "qwen": [[323, " and", "normal", 0.6953110098838806]]}, "loss": {"rwkv": 1.0258421158664808, "qwen": 1.6383427409866393}, "topk": {"rwkv": [21265, 1, 0.7980367541313171, [[21265, 0.798037, " and", false], [4601, 0.038315, " it", false], [4788, 0.019627, " so", false], [22185, 0.018563, " nor", false], [51018, 0.009506, " because", false], [32227, 0.009272, " that", false], [22187, 0.00864, " not", false], [4423, 0.007225, " as", false], [4715, 0.006625, " or", false], [40186, 0.006296, " which", false]]], "qwen": [323, 1, 0.6953110098838806, [[323, 0.695311, " and", false], [432, 0.04768, " it", false], [773, 0.025122, " so", false], [6329, 0.021133, " nor", false], [1576, 0.018084, " because", false], [438, 0.017532, " as", false], [2474, 0.014623, " since", false], [892, 0.014369, " which", false], [1101, 0.012344, " just", false], [537, 0.007646, " not", false]]]}, "raw_delta": -0.03396424651145935, "tuned_delta": -0.027151968704361405}, {"byte_start": 1974, "byte_end": 1981, "display": {"text": " anyway", "kind": "normal"}, "is_word": true, "word_id": 330, "word_key": " anyway", "bytes_hex": "20 61 6e 79 77 61 79", "compression": {"rwkv": "18.03% 18.03% 18.03% 18.03% 18.03% 18.03% 18.03%", "qwen": "25.02% 25.02% 25.02% 25.02% 25.02% 25.02% 25.02%"}, "model_tokens": {"rwkv": [[45179, " anyway", "normal", 0.0009036038536578417]], "qwen": [[13657, " anyway", "normal", 6.052275057299994e-05]]}, "loss": {"rwkv": 18.03368801111204, "qwen": 25.021719020604834}, "topk": {"rwkv": [45179, 87, 0.0009036038536578417, [[4601, 0.183967, " it", false], [40219, 0.088272, " would", false], [32232, 0.087992, " they", false], [32227, 0.076481, " that", false], [22590, 0.067705, " the", false], [4596, 0.028912, " in", false], [39934, 0.02806, " there", false], [60645, 0.018401, " therefore", false], [4788, 0.017412, " so", false], [32465, 0.015252, " when", false]]], "qwen": [13657, 396, 6.052275057299994e-05, [[432, 0.176351, " it", false], [429, 0.112898, " that", false], [807, 0.084212, " they", false], [279, 0.076921, " the", false], [1035, 0.040495, " would", false], [304, 0.031902, " in", false], [862, 0.025066, " their", false], [1052, 0.022272, " there", false], [11, 0.020961, ",", false], [773, 0.020704, " so", false]]]}, "raw_delta": -0.3874987193516321, "tuned_delta": -0.3806864415445342}, {"byte_start": 1981, "byte_end": 1984, "display": {"text": " it", "kind": "normal"}, "is_word": true, "word_id": 331, "word_key": " it", "bytes_hex": "20 69 74", "compression": {"rwkv": "11.22% 11.22% 11.22%", "qwen": "10.77% 10.77% 10.77%"}, "model_tokens": {"rwkv": [[4601, " it", "normal", 0.156508669257164]], "qwen": [[432, " it", "normal", 0.16680200397968292]]}, "loss": {"rwkv": 11.224092277749422, "qwen": 10.765798642485237}, "topk": {"rwkv": [4601, 2, 0.156508669257164, [[45, 0.257649, ",", false], [4601, 0.156509, " it", false], [32232, 0.109228, " they", false], [22590, 0.09316, " the", false], [37920, 0.042577, " brute", false], [39934, 0.024331, " there", false], [39931, 0.014044, " their", false], [22748, 0.013665, " was", false], [38013, 0.01345, " chess", false], [4858, 0.012382, " we", false]]], "qwen": [432, 2, 0.16680200397968292, [[11, 0.396045, ",", false], [432, 0.166802, " it", false], [279, 0.084714, " the", false], [807, 0.055127, " they", false], [9902, 0.024949, " ``", false], [1052, 0.022042, " there", false], [37542, 0.019368, " Kas", false], [429, 0.012784, " that", false], [862, 0.012405, " their", false], [32719, 0.011599, " chess", false]]]}, "raw_delta": 0.025413195292155022, "tuned_delta": 0.03222547309925297}, {"byte_start": 1984, "byte_end": 1988, "display": {"text": " was", "kind": "normal"}, "is_word": true, "word_id": 332, "word_key": " was", "bytes_hex": "20 77 61 73", "compression": {"rwkv": "4.10% 4.10% 4.10% 4.10%", "qwen": "4.60% 4.60% 4.60% 4.60%"}, "model_tokens": {"rwkv": [[22748, " was", "normal", 0.40512874722480774]], "qwen": [[572, " was", "normal", 0.3602137267589569]]}, "loss": {"rwkv": 4.103368463465923, "qwen": 4.6033591132832}, "topk": {"rwkv": [22748, 1, 0.40512874722480774, [[22748, 0.405129, " was", false], [40219, 0.096941, " would", false], [21795, 0.075935, " had", false], [21532, 0.041085, " did", false], [57101, 0.035755, " required", false], [4600, 0.031075, " is", false], [38128, 0.030933, " could", false], [32272, 0.026478, " took", false], [30633, 0.017005, " didn", false], [32445, 0.015419, " wasn", false]]], "qwen": [572, 1, 0.3602137267589569, [[572, 0.360214, " was", false], [1035, 0.139555, " would", false], [1030, 0.070819, " had", false], [1521, 0.059803, " did", false], [374, 0.039697, " is", false], [1410, 0.034259, " could", false], [2567, 0.022039, " required", false], [3867, 0.017384, " took", false], [3207, 0.012466, " didn", false], [5710, 0.011562, " wasn", false]]]}, "raw_delta": -0.02772536873817444, "tuned_delta": -0.020913090931076492}, {"byte_start": 1988, "byte_end": 1992, "display": {"text": " not", "kind": "normal"}, "is_word": true, "word_id": 333, "word_key": " not", "bytes_hex": "20 6e 6f 74", "compression": {"rwkv": "6.76% 6.76% 6.76% 6.76%", "qwen": "7.19% 7.19% 7.19% 7.19%"}, "model_tokens": {"rwkv": [[22187, " not", "normal", 0.22644324600696564]], "qwen": [[537, " not", "normal", 0.2031400054693222]]}, "loss": {"rwkv": 6.762633004167015, "qwen": 7.185793091940252}, "topk": {"rwkv": [22187, 1, 0.22644324600696564, [[22187, 0.226443, " not", false], [22614, 0.075538, " too", false], [332, 0.059292, " a", false], [31581, 0.03172, " only", false], [55725, 0.029441, " cheating", false], [4404, 0.021459, " ``", false], [31198, 0.020155, " just", false], [4788, 0.017237, " so", false], [4692, 0.014911, " no", false], [4419, 0.013402, " an", false]]], "qwen": [537, 1, 0.2031400054693222, [[537, 0.20314, " not", false], [264, 0.068181, " a", false], [2238, 0.048861, " too", false], [1172, 0.045624, " only", false], [279, 0.023624, " the", false], [1101, 0.018506, " just", false], [3118, 0.017074, " based", false], [458, 0.014615, " an", false], [9902, 0.013939, " ``", false], [2588, 0.010936, " hard", false]]]}, "raw_delta": -0.023464977741241455, "tuned_delta": -0.01665269993414351}, {"byte_start": 1992, "byte_end": 1996, "display": {"text": " how", "kind": "normal"}, "is_word": true, "word_id": 334, "word_key": " how", "bytes_hex": "20 68 6f 77", "compression": {"rwkv": "21.84% 21.84% 21.84% 21.84%", "qwen": "22.53% 22.53% 22.53% 22.53%"}, "model_tokens": {"rwkv": [[21835, " how", "normal", 0.007837917655706406]], "qwen": [[1246, " how", "normal", 0.00675914017483592]]}, "loss": {"rwkv": 21.837669075955986, "qwen": 22.52795154215777}, "topk": {"rwkv": [21835, 22, 0.007837917655706406, [[332, 0.119702, " a", false], [22590, 0.062053, " the", false], [30992, 0.048431, " good", false], [32386, 0.046061, " very", false], [47008, 0.038866, " really", false], [30788, 0.035908, " even", false], [4423, 0.030169, " as", false], [4404, 0.028023, " ``", false], [38606, 0.025513, " going", false], [32464, 0.02425, " what", false]]], "qwen": [1246, 25, 0.00675914017483592, [[279, 0.142635, " the", false], [264, 0.096139, " a", false], [1128, 0.042469, " what", false], [862, 0.025291, " their", false], [1602, 0.023666, " very", false], [4586, 0.017903, " general", false], [438, 0.017367, " as", false], [3204, 0.016983, " possible", false], [2797, 0.01667, " clear", false], [2087, 0.016029, " going", false]]]}, "raw_delta": -0.038277387619018555, "tuned_delta": -0.031465109811920605}, {"byte_start": 1996, "byte_end": 2003, "display": {"text": " people", "kind": "normal"}, "is_word": true, "word_id": 335, "word_key": " people", "bytes_hex": "20 70 65 6f 70 6c 65", "compression": {"rwkv": "7.57% 7.57% 7.57% 7.57% 7.57% 7.57% 7.57%", "qwen": "12.17% 12.17% 12.17% 12.17% 12.17% 12.17% 12.17%"}, "model_tokens": {"rwkv": [[46787, " people", "normal", 0.052859190851449966]], "qwen": [[1251, " people", "normal", 0.00887445081025362]]}, "loss": {"rwkv": 7.567708361805946, "qwen": 12.171654442663186}, "topk": {"rwkv": [46787, 6, 0.052859190851449966, [[46227, 0.241127, " humans", false], [32232, 0.228659, " they", false], [38720, 0.068011, " human", false], [38013, 0.059886, " chess", false], [22590, 0.058795, " the", false], [46787, 0.052859, " people", false], [332, 0.038401, " a", false], [4858, 0.030061, " we", false], [59345, 0.029344, " computers", false], [22226, 0.028189, " one", false]]], "qwen": [1251, 12, 0.00887445081025362, [[807, 0.505775, " they", false], [32719, 0.172376, " chess", false], [279, 0.065239, " the", false], [12677, 0.054809, " humans", false], [18495, 0.032193, " computers", false], [37542, 0.024116, " Kas", false], [862, 0.017381, " their", false], [264, 0.014293, " a", false], [432, 0.012555, " it", false], [3738, 0.011437, " human", false]]]}, "raw_delta": -0.25529697963169645, "tuned_delta": -0.2484847018245985}, {"byte_start": 2003, "byte_end": 2010, "display": {"text": " played", "kind": "normal"}, "is_word": true, "word_id": 336, "word_key": " played", "bytes_hex": "20 70 6c 61 79 65 64", "compression": {"rwkv": "2.64% 2.64% 2.64% 2.64% 2.64% 2.64% 2.64%", "qwen": "2.96% 2.96% 2.96% 2.96% 2.96% 2.96% 2.96%"}, "model_tokens": {"rwkv": [[46840, " played", "normal", 0.3580745458602905]], "qwen": [[6342, " played", "normal", 0.31700965762138367]]}, "loss": {"rwkv": 2.6366217962674976, "qwen": 2.9596451391318017}, "topk": {"rwkv": [46840, 1, 0.3580745458602905, [[46840, 0.358075, " played", false], [31702, 0.272382, " play", false], [55448, 0.055463, " actually", false], [39942, 0.047659, " think", false], [53137, 0.033044, " thought", false], [56714, 0.030052, " normally", false], [47008, 0.027831, " really", false], [40219, 0.025346, " would", false], [47333, 0.019127, " solved", false], [52112, 0.009268, " learned", false]]], "qwen": [6342, 1, 0.31700965762138367, [[6342, 0.31701, " played", false], [1486, 0.260489, " play", false], [1744, 0.073582, " think", false], [3381, 0.072214, " thought", false], [3520, 0.031797, " actually", false], [1030, 0.023478, " had", false], [14279, 0.016623, " normally", false], [11136, 0.015295, " typically", false], [9498, 0.011615, " learned", false], [5990, 0.011504, " usually", false]]]}, "raw_delta": -0.01791221754891531, "tuned_delta": -0.011099939741817364}, {"byte_start": 2010, "byte_end": 2016, "display": {"text": " chess", "kind": "normal"}, "is_word": true, "word_id": 337, "word_key": " chess", "bytes_hex": "20 63 68 65 73 73", "compression": {"rwkv": "1.18% 1.18% 1.18% 1.18% 1.18% 1.18%", "qwen": "0.36% 0.36% 0.36% 0.36% 0.36% 0.36%"}, "model_tokens": {"rwkv": [[38013, " chess", "normal", 0.6767595410346985]], "qwen": [[32719, " chess", "normal", 0.8862245678901672]]}, "loss": {"rwkv": 1.1799385710395573, "qwen": 0.36303296000348356}, "topk": {"rwkv": [38013, 1, 0.6767595410346985, [[38013, 0.67676, " chess", false], [47, 0.174595, ".", false], [22590, 0.073232, " the", false], [45, 0.026558, ",", false], [275, 0.007459, " (", false], [21265, 0.005028, " and", false], [4715, 0.004706, " or", false], [4596, 0.003671, " in", false], [60, 0.003118, ";", false], [38576, 0.002855, " games", false]]], "qwen": [32719, 1, 0.8862245678901672, [[32719, 0.886225, " chess", false], [279, 0.046825, " the", false], [13, 0.031141, ".", false], [11, 0.006314, ",", false], [3868, 0.003067, " games", false], [382, 0.002365, ".\n\n", false], [320, 0.002193, " (", false], [304, 0.001716, " in", false], [862, 0.001423, " their", false], [323, 0.001294, " and", false]]]}, "raw_delta": 0.04529886568586033, "tuned_delta": 0.05211114349295828}, {"byte_start": 2016, "byte_end": 2017, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "4.90%", "qwen": "7.36%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.7638916969299316]], "qwen": [[13, ".", "normal", 0.6647235751152039]]}, "loss": {"rwkv": 4.895864518641745, "qwen": 7.364670097319523}, "topk": {"rwkv": [47, 1, 0.7638916969299316, [[47, 0.763892, ".", false], [45, 0.105886, ",", false], [275, 0.027109, " (", false], [45179, 0.012705, " anyway", false], [34, 0.011858, "!", false], [4596, 0.011686, " in", false], [21265, 0.011567, " and", false], [60, 0.008938, ";", false], [4715, 0.004236, " or", false], [4424, 0.00357, " at", false]]], "qwen": [13, 1, 0.6647235751152039, [[13, 0.664724, ".", false], [11, 0.093925, ",", false], [382, 0.059952, ".\n\n", false], [320, 0.025962, " (", false], [304, 0.022525, " in", false], [13657, 0.021117, " anyway", false], [26, 0.015994, ";", false], [624, 0.009761, ".\n", false], [323, 0.009525, " and", false], [1573, 0.007049, " before", false]]]}, "raw_delta": -0.1368996500968933, "tuned_delta": -0.13008737228979536}, {"byte_start": 2017, "byte_end": 2023, "display": {"text": " These", "kind": "normal"}, "is_word": true, "word_id": 338, "word_key": " these", "bytes_hex": "20 54 68 65 73 65", "compression": {"rwkv": "13.06% 13.06% 13.06% 13.06% 13.06% 13.06%", "qwen": "13.75% 13.75% 13.75% 13.75% 13.75% 13.75%"}, "model_tokens": {"rwkv": [[37453, " These", "normal", 0.012810165993869305]], "qwen": [[4220, " These", "normal", 0.010298359207808971]]}, "loss": {"rwkv": 13.055638716377988, "qwen": 13.753004001417803}, "topk": {"rwkv": [37453, 13, 0.012810165993869305, [[261, 0.187077, "\n\n", false], [267, 0.093115, "  ", false], [29893, 0.089965, " They", false], [20996, 0.065892, " The", false], [19555, 0.0393, " But", false], [29894, 0.039028, " This", false], [3913, 0.035325, " In", false], [3918, 0.026709, " It", false], [275, 0.02232, " (", false], [19417, 0.017117, " And", false]]], "qwen": [4220, 16, 0.010298359207808971, [[2379, 0.138351, " They", false], [220, 0.111454, " ", false], [576, 0.09405, " The", false], [1096, 0.040878, " This", false], [1084, 0.038529, " It", false], [758, 0.035303, " In", false], [1597, 0.02738, " And", false], [10964, 0.026182, " Their", false], [1988, 0.024559, " But", false], [320, 0.024182, " (", false]]]}, "raw_delta": -0.038670142491658455, "tuned_delta": -0.031857864684560505}, {"byte_start": 2023, "byte_end": 2035, "display": {"text": " researchers", "kind": "normal"}, "is_word": true, "word_id": 339, "word_key": " researchers", "bytes_hex": "20 72 65 73 65 61 72 63 68 65 72 73", "compression": {"rwkv": "2.40% 2.40% 2.40% 2.40% 2.40% 2.40% 2.40% 2.40% 2.40% 2.40% 2.40% 2.40%", "qwen": "0.81% 0.81% 0.81% 0.81% 0.81% 0.81% 0.81% 0.81% 0.81% 0.81% 0.81% 0.81%"}, "model_tokens": {"rwkv": [[63843, " researchers", "normal", 0.20422649383544922]], "qwen": [[11811, " researchers", "normal", 0.5851952433586121]]}, "loss": {"rwkv": 2.3950991889758177, "qwen": 0.8052188300705875}, "topk": {"rwkv": [63843, 1, 0.20422649383544922, [[63843, 0.204226, " researchers", false], [46787, 0.112363, " people", false], [32462, 0.084844, " were", false], [38720, 0.066428, " human", false], [31937, 0.031516, " same", false], [38013, 0.031312, " chess", false], [21286, 0.022179, " are", false], [59165, 0.021506, " arguments", false], [40119, 0.014262, " views", false], [61715, 0.012767, " complaints", false]]], "qwen": [11811, 1, 0.5851952433586121, [[11811, 0.585195, " researchers", false], [3738, 0.069799, " human", false], [32719, 0.031066, " chess", false], [1033, 0.029196, " were", false], [1251, 0.026365, " people", false], [1852, 0.025132, " same", false], [525, 0.018851, " are", false], [5413, 0.014455, " methods", false], [6366, 0.013637, " computer", false], [9902, 0.008271, " ``", false]]]}, "raw_delta": 0.08816168705622353, "tuned_delta": 0.09497396486332148}, {"byte_start": 2035, "byte_end": 2042, "display": {"text": " wanted", "kind": "normal"}, "is_word": true, "word_id": 340, "word_key": " wanted", "bytes_hex": "20 77 61 6e 74 65 64", "compression": {"rwkv": "15.14% 15.14% 15.14% 15.14% 15.14% 15.14% 15.14%", "qwen": "13.46% 13.46% 13.46% 13.46% 13.46% 13.46% 13.46%"}, "model_tokens": {"rwkv": [[47763, " wanted", "normal", 0.0028459264431148767]], "qwen": [[4829, " wanted", "normal", 0.005385169759392738]]}, "loss": {"rwkv": 15.135416723611891, "qwen": 13.458558851854368}, "topk": {"rwkv": [47763, 47, 0.0028459264431148767, [[32462, 0.210127, " were", false], [21795, 0.091754, " had", false], [40, 0.054741, "'", false], [21532, 0.046796, " did", false], [45, 0.037065, ",", false], [31059, 0.023008, " have", false], [21286, 0.019384, " are", false], [40219, 0.017449, " would", false], [30135, 0.015049, " also", false], [38128, 0.012087, " could", false]]], "qwen": [4829, 30, 0.005385169759392738, [[1033, 0.212382, " were", false], [1030, 0.053234, " had", false], [1521, 0.046063, " did", false], [1083, 0.040398, " also", false], [11, 0.032438, ",", false], [6, 0.021224, "'", false], [11585, 0.020043, " believed", false], [1053, 0.017736, " said", false], [525, 0.016484, " are", false], [614, 0.014885, " have", false]]]}, "raw_delta": 0.09298474448067806, "tuned_delta": 0.09979702228777601}, {"byte_start": 2042, "byte_end": 2050, "display": {"text": " methods", "kind": "normal"}, "is_word": true, "word_id": 341, "word_key": " methods", "bytes_hex": "20 6d 65 74 68 6f 64 73", "compression": {"rwkv": "9.72% 9.72% 9.72% 9.72% 9.72% 9.72% 9.72% 9.72%", "qwen": "12.30% 12.30% 12.30% 12.30% 12.30% 12.30% 12.30% 12.30%"}, "model_tokens": {"rwkv": [[52224, " methods", "normal", 0.01331915333867073]], "qwen": [[5413, " methods", "normal", 0.004273268394172192]]}, "loss": {"rwkv": 9.721284943490085, "qwen": 12.29756893004144}, "topk": {"rwkv": [52224, 7, 0.01331915333867073, [[4811, 0.64024, " to", false], [332, 0.076421, " a", false], [39931, 0.054856, " their", false], [22590, 0.033285, " the", false], [38013, 0.020784, " chess", false], [4419, 0.014516, " an", false], [52224, 0.013319, " methods", false], [31458, 0.012961, " more", false], [38720, 0.009321, " human", false], [45, 0.00743, ",", false]]], "qwen": [5413, 10, 0.004273268394172192, [[311, 0.74202, " to", false], [264, 0.061502, " a", false], [279, 0.032519, " the", false], [862, 0.027466, " their", false], [803, 0.01411, " more", false], [3738, 0.009216, " human", false], [458, 0.008059, " an", false], [32719, 0.006059, " chess", false], [2494, 0.005639, " something", false], [5413, 0.004273, " methods", false]]]}, "raw_delta": -0.14285951852798462, "tuned_delta": -0.13604724072088667}, {"byte_start": 2050, "byte_end": 2056, "display": {"text": " based", "kind": "normal"}, "is_word": true, "word_id": 342, "word_key": " based", "bytes_hex": "20 62 61 73 65 64", "compression": {"rwkv": "9.02% 9.02% 9.02% 9.02% 9.02% 9.02%", "qwen": "7.00% 7.00% 7.00% 7.00% 7.00% 7.00%"}, "model_tokens": {"rwkv": [[37810, " based", "normal", 0.05000009760260582]], "qwen": [[3118, " based", "normal", 0.09755192697048187]]}, "loss": {"rwkv": 9.01684400555602, "qwen": 6.995178628936783}, "topk": {"rwkv": [37810, 3, 0.05000009760260582, [[32227, 0.773566, " that", false], [4811, 0.066448, " to", false], [37810, 0.05, " based", false], [21700, 0.024942, " for", false], [4706, 0.011687, " of", false], [32232, 0.007255, " they", false], [32487, 0.007001, " with", false], [45, 0.005444, ",", false], [31458, 0.005022, " more", false], [4596, 0.004938, " in", false]]], "qwen": [3118, 2, 0.09755192697048187, [[429, 0.764439, " that", false], [3118, 0.097552, " based", false], [311, 0.034021, " to", false], [1075, 0.013267, " like", false], [315, 0.012646, " of", false], [369, 0.011456, " for", false], [448, 0.006683, " with", false], [4428, 0.004272, " similar", false], [803, 0.003858, " more", false], [76482, 0.003539, " leveraging", false]]]}, "raw_delta": 0.11210493246714277, "tuned_delta": 0.11891721027424072}, {"byte_start": 2056, "byte_end": 2059, "display": {"text": " on", "kind": "normal"}, "is_word": true, "word_id": 343, "word_key": " on", "bytes_hex": "20 6f 6e", "compression": {"rwkv": "0.20% 0.20% 0.20%", "qwen": "0.25% 0.25% 0.25%"}, "model_tokens": {"rwkv": [[4712, " on", "normal", 0.9665234684944153]], "qwen": [[389, " on", "normal", 0.959489107131958]]}, "loss": {"rwkv": 0.20399435494340606, "qwen": 0.24859024008723393}, "topk": {"rwkv": [4712, 1, 0.9665234684944153, [[4712, 0.966523, " on", false], [31458, 0.006044, " more", false], [32350, 0.006013, " upon", false], [4596, 0.004818, " in", false], [22187, 0.003985, " not", false], [56003, 0.001019, " directly", false], [31581, 0.000903, " only", false], [46957, 0.000865, " purely", false], [45, 0.000804, ",", false], [52028, 0.00076, " instead", false]]], "qwen": [389, 1, 0.959489107131958, [[389, 0.959489, " on", false], [803, 0.008495, " more", false], [304, 0.007239, " in", false], [5193, 0.006055, " upon", false], [537, 0.002056, " not", false], [21063, 0.001594, " solely", false], [2163, 0.001537, " around", false], [1172, 0.001132, " only", false], [31127, 0.001066, " purely", false], [11, 0.001, ",", false]]]}, "raw_delta": -0.0024729209641615544, "tuned_delta": 0.0043393568429363925}, {"byte_start": 2059, "byte_end": 2065, "display": {"text": " human", "kind": "normal"}, "is_word": true, "word_id": 344, "word_key": " human", "bytes_hex": "20 68 75 6d 61 6e", "compression": {"rwkv": "3.48% 3.48% 3.48% 3.48% 3.48% 3.48%", "qwen": "2.34% 2.34% 2.34% 2.34% 2.34% 2.34%"}, "model_tokens": {"rwkv": [[38720, " human", "normal", 0.3127826452255249]], "qwen": [[3738, " human", "normal", 0.4591285288333893]]}, "loss": {"rwkv": 3.4752419604747162, "qwen": 2.3396458912854303}, "topk": {"rwkv": [38720, 1, 0.3127826452255249, [[38720, 0.312783, " human", false], [39931, 0.092708, " their", false], [22590, 0.077717, " the", false], [65034, 0.049374, " understanding", false], [51832, 0.042356, " general", false], [38013, 0.032553, " chess", false], [30597, 0.031166, " deep", false], [332, 0.029314, " a", false], [59943, 0.023118, " knowledge", false], [32464, 0.014339, " what", false]]], "qwen": [3738, 1, 0.4591285288333893, [[3738, 0.459129, " human", false], [862, 0.141376, " their", false], [279, 0.061694, " the", false], [4586, 0.028779, " general", false], [264, 0.02666, " a", false], [8660, 0.018119, " understanding", false], [6540, 0.016029, " knowledge", false], [76482, 0.014361, " leveraging", false], [5538, 0.012181, " deep", false], [70601, 0.009768, " exploiting", false]]]}, "raw_delta": 0.06297081708908081, "tuned_delta": 0.06978309489617876}, {"byte_start": 2065, "byte_end": 2071, "display": {"text": " input", "kind": "normal"}, "is_word": true, "word_id": 345, "word_key": " input", "bytes_hex": "20 69 6e 70 75 74", "compression": {"rwkv": "25.74% 25.74% 25.74% 25.74% 25.74% 25.74%", "qwen": "24.75% 24.75% 24.75% 24.75% 24.75% 24.75%"}, "model_tokens": {"rwkv": [[38786, " input", "normal", 0.00018668266420718282]], "qwen": [[1946, " input", "normal", 0.00026557513047009706]]}, "loss": {"rwkv": 25.73557559919114, "qwen": 24.747068050449464}, "topk": {"rwkv": [38786, 89, 0.00018668266420718282, [[59943, 0.395847, " knowledge", false], [65034, 0.328922, " understanding", false], [59683, 0.044428, " expertise", false], [46, 0.041604, "-", false], [38013, 0.037176, " chess", false], [31702, 0.015741, " play", false], [59917, 0.012936, " intuition", false], [62418, 0.011439, " psychology", false], [61979, 0.007645, " experience", false], [60323, 0.00736, " reasoning", false]]], "qwen": [1946, 53, 0.00026557513047009706, [[6540, 0.446881, " knowledge", false], [8660, 0.339385, " understanding", false], [12646, 0.115004, "-k", false], [18726, 0.016356, " expertise", false], [56251, 0.010285, " intuition", false], [71107, 0.004593, "-under", false], [32719, 0.004265, " chess", false], [32711, 0.003989, " reasoning", false], [20017, 0.003962, " insight", false], [12681, 0.002659, "-like", false]]]}, "raw_delta": 0.054814497629801284, "tuned_delta": 0.061626775436899234}, {"byte_start": 2071, "byte_end": 2074, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 346, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "14.65% 14.65% 14.65%", "qwen": "12.74% 12.74% 12.74%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.08839938789606094]], "qwen": [[311, " to", "normal", 0.12003070116043091]]}, "loss": {"rwkv": 14.652371509028534, "qwen": 12.743852801817559}, "topk": {"rwkv": [4811, 4, 0.08839938789606094, [[45, 0.295346, ",", false], [21265, 0.17078, " and", false], [47, 0.129955, ".", false], [4811, 0.088399, " to", false], [32227, 0.078324, " that", false], [4706, 0.050533, " of", false], [31162, 0.047485, " into", false], [47001, 0.012908, " rather", false], [60, 0.012177, ";", false], [275, 0.011747, " (", false]]], "qwen": [311, 3, 0.12003070116043091, [[11, 0.312136, ",", false], [323, 0.121356, " and", false], [311, 0.120031, " to", false], [13, 0.104371, ".", false], [315, 0.044556, " of", false], [429, 0.036089, " that", false], [320, 0.025742, " (", false], [304, 0.018819, " in", false], [369, 0.017285, " for", false], [4751, 0.017163, " rather", false]]]}, "raw_delta": 0.10583074887593591, "tuned_delta": 0.11264302668303386}, {"byte_start": 2074, "byte_end": 2078, "display": {"text": " win", "kind": "normal"}, "is_word": true, "word_id": 347, "word_key": " win", "bytes_hex": "20 77 69 6e", "compression": {"rwkv": "13.67% 13.67% 13.67% 13.67%", "qwen": "17.09% 17.09% 17.09% 17.09%"}, "model_tokens": {"rwkv": [[22770, " win", "normal", 0.04771824926137924]], "qwen": [[3164, " win", "normal", 0.022558091208338737]]}, "loss": {"rwkv": 13.666154195920843, "qwen": 17.09441013788265}, "topk": {"rwkv": [22770, 4, 0.04771824926137924, [[4435, 0.18649, " be", false], [22590, 0.123287, " the", false], [38013, 0.058749, " chess", false], [22770, 0.047718, " win", false], [30256, 0.026651, " beat", false], [31702, 0.021086, " play", false], [39931, 0.019484, " their", false], [55851, 0.017242, " continue", false], [47059, 0.01696, " remain", false], [56540, 0.01522, " leverage", false]]], "qwen": [3164, 6, 0.022558091208338737, [[387, 0.205114, " be", false], [279, 0.061523, " the", false], [1486, 0.047995, " play", false], [8474, 0.047719, " guide", false], [7269, 0.041327, " improve", false], [3164, 0.022558, " win", false], [11625, 0.022102, " solve", false], [1281, 0.021222, " make", false], [975, 0.018889, " work", false], [32719, 0.017693, " chess", false]]]}, "raw_delta": -0.19010287523269653, "tuned_delta": -0.18329059742559858}, {"byte_start": 2078, "byte_end": 2082, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 348, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"rwkv": "23.81% 23.81% 23.81% 23.81%", "qwen": "21.92% 21.92% 21.92% 21.92%"}, "model_tokens": {"rwkv": [[21265, " and", "normal", 0.005041623022407293]], "qwen": [[323, " and", "normal", 0.007743414957076311]]}, "loss": {"rwkv": 23.810103702171368, "qwen": 21.915044070579164}, "topk": {"rwkv": [21265, 19, 0.005041623022407293, [[45, 0.219672, ",", false], [4596, 0.133152, " in", false], [22590, 0.131841, " the", false], [47, 0.099296, ".", false], [38013, 0.087334, " chess", false], [37635, 0.06456, " again", false], [50870, 0.023596, " against", false], [46064, 0.023044, " future", false], [4424, 0.018953, " at", false], [4712, 0.015755, " on", false]]], "qwen": [323, 16, 0.007743414957076311, [[11, 0.236852, ",", false], [279, 0.183753, " the", false], [32719, 0.144311, " chess", false], [13, 0.087307, ".", false], [518, 0.040148, " at", false], [304, 0.030065, " in", false], [1182, 0.021278, " back", false], [1549, 0.018115, " again", false], [678, 0.017551, " all", false], [803, 0.014423, " more", false]]]}, "raw_delta": 0.10508441925048828, "tuned_delta": 0.11189669705758623}, {"byte_start": 2082, "byte_end": 2087, "display": {"text": " were", "kind": "normal"}, "is_word": true, "word_id": 349, "word_key": " were", "bytes_hex": "20 77 65 72 65", "compression": {"rwkv": "9.58% 9.58% 9.58% 9.58% 9.58%", "qwen": "6.67% 6.67% 6.67% 6.67% 6.67%"}, "model_tokens": {"rwkv": [[32462, " were", "normal", 0.07050078362226486]], "qwen": [[1033, " were", "normal", 0.1573631316423416]]}, "loss": {"rwkv": 9.580396755903271, "qwen": 6.669576201481539}, "topk": {"rwkv": [32462, 2, 0.07050078362226486, [[32232, 0.114963, " they", false], [32462, 0.070501, " were", false], [45, 0.068963, ",", false], [4811, 0.050358, " to", false], [22187, 0.034965, " not", false], [4788, 0.03276, " so", false], [21795, 0.028785, " had", false], [21532, 0.026164, " did", false], [22777, 0.018426, " won", false], [22590, 0.017302, " the", false]]], "qwen": [1033, 1, 0.1573631316423416, [[1033, 0.157363, " were", false], [11, 0.057803, ",", false], [537, 0.046059, " not", false], [807, 0.045585, " they", false], [311, 0.04225, " to", false], [773, 0.031472, " so", false], [11585, 0.03093, " believed", false], [1521, 0.029817, " did", false], [1035, 0.022363, " would", false], [1030, 0.015981, " had", false]]]}, "raw_delta": 0.16141016483306886, "tuned_delta": 0.1682224426401668}, {"byte_start": 2087, "byte_end": 2100, "display": {"text": " disappointed", "kind": "normal"}, "is_word": true, "word_id": 350, "word_key": " disappointed", "bytes_hex": "20 64 69 73 61 70 70 6f 69 6e 74 65 64", "compression": {"rwkv": "4.57% 4.57% 4.57% 4.57% 4.57% 4.57% 4.57% 4.57% 4.57% 4.57% 4.57% 4.57% 4.57%", "qwen": "4.56% 4.56% 4.56% 4.56% 4.56% 4.56% 4.56% 4.56% 4.56% 4.56% 4.56% 4.56% 4.56%"}, "model_tokens": {"rwkv": [[64362, " disappointed", "normal", 0.03691527992486954]], "qwen": [[24402, " disappointed", "normal", 0.03749189153313637]]}, "loss": {"rwkv": 4.57344732012577, "qwen": 4.555074611975615}, "topk": {"rwkv": [64362, 3, 0.03691527992486954, [[22187, 0.21124, " not", false], [60713, 0.049455, " unwilling", false], [64362, 0.036915, " disappointed", false], [53350, 0.034593, " willing", false], [32239, 0.030685, " thus", false], [62028, 0.025388, " frustrated", false], [60645, 0.013866, " therefore", false], [47650, 0.012581, " unable", false], [45756, 0.012245, " dismay", false], [53228, 0.011584, " unhappy", false]]], "qwen": [24402, 4, 0.03749189153313637, [[537, 0.212352, " not", false], [45143, 0.057787, " unwilling", false], [9831, 0.049617, " willing", false], [24402, 0.037492, " disappointed", false], [6247, 0.029933, " happy", false], [14453, 0.021838, " surprised", false], [1602, 0.015655, " very", false], [10030, 0.014863, " prepared", false], [8450, 0.012646, " thus", false], [42940, 0.011894, " reluctant", false]]]}, "raw_delta": 0.0010187992682823555, "tuned_delta": 0.007831077075380301}, {"byte_start": 2100, "byte_end": 2105, "display": {"text": " when", "kind": "normal"}, "is_word": true, "word_id": 351, "word_key": " when", "bytes_hex": "20 77 68 65 6e", "compression": {"rwkv": "4.14% 4.14% 4.14% 4.14% 4.14%", "qwen": "3.83% 3.83% 3.83% 3.83% 3.83%"}, "model_tokens": {"rwkv": [[32465, " when", "normal", 0.31251636147499084]], "qwen": [[979, " when", "normal", 0.34567907452583313]]}, "loss": {"rwkv": 4.1421127150522965, "qwen": 3.8312368753526838}, "topk": {"rwkv": [32465, 1, 0.31251636147499084, [[32465, 0.312516, " when", false], [32227, 0.247963, " that", false], [47, 0.100306, ".", false], [4811, 0.090414, " to", false], [4450, 0.073856, " by", false], [4596, 0.033734, " in", false], [4424, 0.029241, " at", false], [32487, 0.022114, " with", false], [45, 0.021067, ",", false], [21265, 0.013366, " and", false]]], "qwen": [979, 1, 0.34567907452583313, [[979, 0.345679, " when", false], [429, 0.229684, " that", false], [311, 0.205805, " to", false], [553, 0.114107, " by", false], [448, 0.034713, " with", false], [323, 0.011793, " and", false], [304, 0.011361, " in", false], [518, 0.009385, " at", false], [11, 0.007122, ",", false], [537, 0.00442, " not", false]]]}, "raw_delta": 0.017238616943359375, "tuned_delta": 0.02405089475045732}, {"byte_start": 2105, "byte_end": 2110, "display": {"text": " they", "kind": "normal"}, "is_word": true, "word_id": 352, "word_key": " they", "bytes_hex": "20 74 68 65 79", "compression": {"rwkv": "4.62% 4.62% 4.62% 4.62% 4.62%", "qwen": "5.51% 5.51% 5.51% 5.51% 5.51%"}, "model_tokens": {"rwkv": [[32232, " they", "normal", 0.28065958619117737]], "qwen": [[807, " they", "normal", 0.21718207001686096]]}, "loss": {"rwkv": 4.62113255284746, "qwen": 5.50755779270526}, "topk": {"rwkv": [32232, 1, 0.28065958619117737, [[32232, 0.28066, " they", false], [37920, 0.168368, " brute", false], [22590, 0.118843, " the", false], [39931, 0.056157, " their", false], [4601, 0.054386, " it", false], [332, 0.03988, " a", false], [52224, 0.031428, " methods", false], [32234, 0.022314, " this", false], [47202, 0.02161, " search", false], [32227, 0.020618, " that", false]]], "qwen": [807, 1, 0.21718207001686096, [[807, 0.217182, " they", false], [279, 0.146606, " the", false], [862, 0.087454, " their", false], [2711, 0.058103, " search", false], [432, 0.040035, " it", false], [1741, 0.038384, " such", false], [64098, 0.038306, " brute", false], [419, 0.037, " this", false], [264, 0.031455, " a", false], [429, 0.029938, " that", false]]]}, "raw_delta": -0.0491538524627686, "tuned_delta": -0.04234157465567065}, {"byte_start": 2110, "byte_end": 2114, "display": {"text": " did", "kind": "normal"}, "is_word": true, "word_id": 353, "word_key": " did", "bytes_hex": "20 64 69 64", "compression": {"rwkv": "4.40% 4.40% 4.40% 4.40%", "qwen": "8.23% 8.23% 8.23% 8.23%"}, "model_tokens": {"rwkv": [[21532, " did", "normal", 0.3785440921783447]], "qwen": [[1521, " did", "normal", 0.1610872596502304]]}, "loss": {"rwkv": 4.402755862087901, "qwen": 8.231518014583825}, "topk": {"rwkv": [21532, 1, 0.3785440921783447, [[21532, 0.378544, " did", false], [30633, 0.17225, " didn", false], [45953, 0.12128, " failed", false], [31334, 0.080294, " lost", false], [32462, 0.061792, " were", false], [38128, 0.020331, " could", false], [38547, 0.014392, " found", false], [30383, 0.009207, " came", false], [46936, 0.00914, " proved", false], [45599, 0.009088, " couldn", false]]], "qwen": [1521, 1, 0.1610872596502304, [[1521, 0.161087, " did", false], [1033, 0.117427, " were", false], [1730, 0.114327, " found", false], [9498, 0.108848, " learned", false], [5485, 0.076586, " saw", false], [4641, 0.070985, " failed", false], [1410, 0.044698, " could", false], [11105, 0.033996, " discovered", false], [3207, 0.028945, " didn", false], [15043, 0.02417, " realized", false]]]}, "raw_delta": -0.21231165528297424, "tuned_delta": -0.2054993774758763}, {"byte_start": 2114, "byte_end": 2118, "display": {"text": " not", "kind": "normal"}, "is_word": true, "word_id": 354, "word_key": " not", "bytes_hex": "20 6e 6f 74", "compression": {"rwkv": "0.04% 0.04% 0.04% 0.04%", "qwen": "0.03% 0.03% 0.03% 0.03%"}, "model_tokens": {"rwkv": [[22187, " not", "normal", 0.9918107986450195]], "qwen": [[537, " not", "normal", 0.9942071437835693]]}, "loss": {"rwkv": 0.03687308034498617, "qwen": 0.02619250425652555}, "topk": {"rwkv": [22187, 1, 0.9918107986450195, [[22187, 0.991811, " not", false], [47, 0.003887, ".", false], [4788, 0.001302, " so", false], [45, 0.000551, ",", false], [22770, 0.000392, " win", false], [4692, 0.000136, " no", false], [22590, 9.6e-05, " the", false], [45301, 8.8e-05, " better", false], [40216, 8.5e-05, " worse", false], [31332, 7.8e-05, " lose", false]]], "qwen": [537, 1, 0.9942071437835693, [[537, 0.994207, " not", false], [13, 0.001272, ".", false], [279, 0.000411, " the", false], [902, 0.00031, " no", false], [773, 0.000306, " so", false], [382, 0.000292, ".\n\n", false], [11, 0.000233, ",", false], [4302, 0.000182, " nothing", false], [2664, 0.000141, " better", false], [4518, 0.000124, " instead", false]]]}, "raw_delta": 0.0005922568961977959, "tuned_delta": 0.007404534703295743}, {"byte_start": 2118, "byte_end": 2120, "display": {"text": ".\n", "kind": "control"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e 0a", "compression": {"rwkv": "2.85% 8.17%", "qwen": "16.34% 16.34%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.8541350364685059], [261, "\n\n", "control", 0.4013567864894867]], "qwen": [[382, ".\n\n", "control", 0.06594829261302948]]}, "loss": {"rwkv": 5.512250339334051, "qwen": 16.343836645340584}, "topk": {"rwkv": [47, 1, 0.8541350364685059, [[47, 0.854135, ".", false], [45, 0.040417, ",", false], [22770, 0.025818, " win", false], [32499, 0.019578, " work", false], [4491, 0.005856, " do", false], [275, 0.004983, " (", false], [60, 0.004629, ";", false], [53051, 0.004235, " succeed", false], [4596, 0.003006, " in", false], [30256, 0.001979, " beat", false]]], "qwen": [382, 5, 0.06594829261302948, [[13, 0.292512, ".", false], [3164, 0.140883, " win", false], [633, 0.097434, " get", false], [1477, 0.067145, " find", false], [382, 0.065948, ".\n\n", false], [11996, 0.057187, " succeed", false], [614, 0.046361, " have", false], [1490, 0.02706, " see", false], [11, 0.022252, ",", false], [975, 0.018473, " work", false]]]}, "raw_delta": -0.6006306807200114, "tuned_delta": -0.5938184029129134}, {"byte_start": 2120, "byte_end": 2121, "display": {"text": "\n", "kind": "control"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "0a", "compression": {"rwkv": "8.17%", "qwen": "16.34%"}, "model_tokens": {"rwkv": [[261, "\n\n", "control", 0.4013567864894867]], "qwen": [[382, ".\n\n", "control", 0.06594829261302948]]}, "loss": {"rwkv": 8.171514880035144, "qwen": 16.343836645340584}, "topk": {"rwkv": [261, 1, 0.4013567864894867, [[261, 0.401357, "\n\n", false], [267, 0.103311, "  ", false], [29893, 0.058263, " They", false], [20996, 0.042109, " The", false], [29894, 0.031195, " This", false], [19555, 0.029298, " But", false], [3913, 0.026236, " In", false], [3918, 0.020275, " It", false], [3336, 0.015135, " \n\n", false], [275, 0.011451, " (", false]]], "qwen": [382, 5, 0.06594829261302948, [[13, 0.292512, ".", false], [3164, 0.140883, " win", false], [633, 0.097434, " get", false], [1477, 0.067145, " find", false], [382, 0.065948, ".\n\n", false], [11996, 0.057187, " succeed", false], [614, 0.046361, " have", false], [1490, 0.02706, " see", false], [11, 0.022252, ",", false], [975, 0.018473, " work", false]]]}, "raw_delta": -0.45316974322001136, "tuned_delta": -0.44635746541291343}, {"byte_start": 2121, "byte_end": 2122, "display": {"text": "A", "kind": "normal"}, "is_word": true, "word_id": 355, "word_key": "a", "bytes_hex": "41", "compression": {"rwkv": "52.97%", "qwen": "60.08%"}, "model_tokens": {"rwkv": [[66, "A", "normal", 0.052234403789043427]], "qwen": [[32, "A", "normal", 0.03574218973517418]]}, "loss": {"rwkv": 52.97395853264162, "qwen": 60.07785241134943}, "topk": {"rwkv": [66, 3, 0.052234403789043427, [[1136, 0.347874, "In", false], [6699, 0.153207, "The", false], [66, 0.052234, "A", false], [58094, 0.043856, "Similarly", false], [24242, 0.023988, "This", false], [33504, 0.020559, "There", false], [1141, 0.01599, "It", false], [24327, 0.014958, "When", false], [23560, 0.012942, "Deep", false], [6393, 0.011096, "One", false]]], "qwen": [32, 4, 0.03574218973517418, [[641, 0.353845, "In", false], [785, 0.115869, "The", false], [67691, 0.045728, "Similarly", false], [32, 0.035742, "A", false], [3862, 0.02463, "There", false], [14037, 0.023558, "Another", false], [4498, 0.021734, "When", false], [1986, 0.018385, "This", false], [3966, 0.011602, "One", false], [1655, 0.011292, "At", false]]]}, "raw_delta": -0.3939235210418701, "tuned_delta": -0.3871112432347722}, {"byte_start": 2122, "byte_end": 2130, "display": {"text": " similar", "kind": "normal"}, "is_word": true, "word_id": 356, "word_key": " similar", "bytes_hex": "20 73 69 6d 69 6c 61 72", "compression": {"rwkv": "1.44% 1.44% 1.44% 1.44% 1.44% 1.44% 1.44% 1.44%", "qwen": "1.47% 1.47% 1.47% 1.47% 1.47% 1.47% 1.47% 1.47%"}, "model_tokens": {"rwkv": [[52906, " similar", "normal", 0.5281198620796204]], "qwen": [[4428, " similar", "normal", 0.5214805603027344]]}, "loss": {"rwkv": 1.4441039227648313, "qwen": 1.4676789820776348}, "topk": {"rwkv": [52906, 1, 0.5281198620796204, [[52906, 0.52812, " similar", false], [31458, 0.036984, " more", false], [52693, 0.031535, " related", false], [21674, 0.029108, " few", false], [47205, 0.024347, " second", false], [30992, 0.015121, " good", false], [32386, 0.015091, " very", false], [59513, 0.012795, " different", false], [57263, 0.012781, " somewhat", false], [45674, 0.010718, " decade", false]]], "qwen": [4428, 1, 0.5214805603027344, [[4428, 0.521481, " similar", false], [803, 0.048354, " more", false], [5435, 0.031472, " related", false], [2086, 0.028084, " second", false], [2421, 0.02363, " few", false], [2155, 0.022031, " different", false], [1602, 0.01837, " very", false], [14400, 0.010205, " somewhat", false], [13212, 0.009056, " decade", false], [11416, 0.008557, " classic", false]]]}, "raw_delta": -0.0013072788715362549, "tuned_delta": 0.005504998935561692}, {"byte_start": 2130, "byte_end": 2138, "display": {"text": " pattern", "kind": "normal"}, "is_word": true, "word_id": 357, "word_key": " pattern", "bytes_hex": "20 70 61 74 74 65 72 6e", "compression": {"rwkv": "6.16% 6.16% 6.16% 6.16% 6.16% 6.16% 6.16% 6.16%", "qwen": "6.29% 6.29% 6.29% 6.29% 6.29% 6.29% 6.29% 6.29%"}, "model_tokens": {"rwkv": [[52427, " pattern", "normal", 0.06449791043996811]], "qwen": [[5383, " pattern", "normal", 0.06150469928979874]]}, "loss": {"rwkv": 6.163858206923061, "qwen": 6.286187316698641}, "topk": {"rwkv": [52427, 3, 0.06449791043996811, [[39831, 0.25861, " story", false], [60511, 0.088556, " situation", false], [52427, 0.064498, " pattern", false], [45315, 0.064312, " bitter", false], [65126, 0.051597, " disappointment", false], [46430, 0.039463, " lesson", false], [30405, 0.022853, " case", false], [51668, 0.021382, " example", false], [45, 0.017849, ",", false], [22459, 0.016599, " set", false]]], "qwen": [5383, 4, 0.06150469928979874, [[6534, 0.161408, " situation", false], [3364, 0.133674, " story", false], [17755, 0.097952, " lesson", false], [5383, 0.061505, " pattern", false], [3110, 0.033002, " example", false], [3166, 0.029063, " thing", false], [12720, 0.022721, " reaction", false], [40598, 0.022441, " disappointment", false], [18915, 0.021367, " attitude", false], [24382, 0.020877, " fate", false]]]}, "raw_delta": -0.0067833662033081055, "tuned_delta": 2.891160378984143e-05}, {"byte_start": 2138, "byte_end": 2141, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 358, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "18.22% 18.22% 18.22%", "qwen": "15.92% 15.92% 15.92%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.04806630685925484]], "qwen": [[315, " of", "normal", 0.07075536251068115]]}, "loss": {"rwkv": 18.22153892789446, "qwen": 15.920904076282552}, "topk": {"rwkv": [4706, 7, 0.04806630685925484, [[56745, 0.147728, " occurred", false], [22748, 0.121769, " was", false], [4600, 0.108608, " is", false], [21413, 0.074998, " can", false], [46840, 0.074467, " played", false], [51585, 0.058953, " emerged", false], [4706, 0.048066, " of", false], [21800, 0.037593, " has", false], [57093, 0.030503, " repeated", false], [51586, 0.027078, " emerges", false]]], "qwen": [315, 5, 0.07075536251068115, [[572, 0.173193, " was", false], [21992, 0.146087, " emerged", false], [646, 0.09904, " can", false], [10017, 0.076013, " occurred", false], [315, 0.070755, " of", false], [374, 0.05973, " is", false], [702, 0.042734, " has", false], [6342, 0.0253, " played", false], [58596, 0.023844, " emerges", false], [312, 0.017661, " re", false]]]}, "raw_delta": 0.1275742848714193, "tuned_delta": 0.13438656267851726}, {"byte_start": 2141, "byte_end": 2150, "display": {"text": " research", "kind": "normal"}, "is_word": true, "word_id": 359, "word_key": " research", "bytes_hex": "20 72 65 73 65 61 72 63 68", "compression": {"rwkv": "10.08% 10.08% 10.08% 10.08% 10.08% 10.08% 10.08% 10.08% 10.08%", "qwen": "7.76% 7.76% 7.76% 7.76% 7.76% 7.76% 7.76% 7.76% 7.76%"}, "model_tokens": {"rwkv": [[57103, " research", "normal", 0.006457152310758829]], "qwen": [[3412, " research", "normal", 0.02082969807088375]]}, "loss": {"rwkv": 10.081332533989718, "qwen": 7.757242115177639}, "topk": {"rwkv": [57103, 18, 0.006457152310758829, [[45315, 0.298679, " bitter", false], [65126, 0.115666, " disappointment", false], [51708, 0.047749, " failure", false], [61640, 0.033623, " bitterness", false], [38720, 0.03169, " human", false], [45685, 0.017821, " defeat", false], [62500, 0.013175, " resistance", false], [45294, 0.012942, " belief", false], [55615, 0.01086, " behavior", false], [56537, 0.009534, " learning", false]]], "qwen": [3412, 8, 0.02082969807088375, [[40598, 0.106948, " disappointment", false], [7709, 0.059513, " behavior", false], [3738, 0.049548, " human", false], [12720, 0.045738, " reaction", false], [1656, 0.034726, " bel", false], [7901, 0.033575, " failure", false], [13643, 0.023229, " resistance", false], [3412, 0.02083, " research", false], [7274, 0.019194, " thinking", false], [6832, 0.019006, " learning", false]]]}, "raw_delta": 0.12887493769327804, "tuned_delta": 0.135687215500376}, {"byte_start": 2150, "byte_end": 2159, "display": {"text": " progress", "kind": "normal"}, "is_word": true, "word_id": 360, "word_key": " progress", "bytes_hex": "20 70 72 6f 67 72 65 73 73", "compression": {"rwkv": "12.52% 12.52% 12.52% 12.52% 12.52% 12.52% 12.52% 12.52% 12.52%", "qwen": "10.72% 10.72% 10.72% 10.72% 10.72% 10.72% 10.72% 10.72% 10.72%"}, "model_tokens": {"rwkv": [[56950, " progress", "normal", 0.001917681423947215]], "qwen": [[5098, " progress", "normal", 0.00474706431850791]]}, "loss": {"rwkv": 12.52339445216114, "qwen": 10.720484080360402}, "topk": {"rwkv": [56950, 55, 0.001917681423947215, [[51708, 0.133771, " failure", false], [22748, 0.075292, " was", false], [65126, 0.056456, " disappointment", false], [4600, 0.056252, " is", false], [21413, 0.043713, " can", false], [21265, 0.038905, " and", false], [4596, 0.036706, " in", false], [56745, 0.034871, " occurred", false], [21800, 0.034114, " has", false], [46, 0.025213, "-", false]]], "qwen": [5098, 36, 0.00474706431850791, [[572, 0.076821, " was", false], [323, 0.066671, " and", false], [374, 0.032934, " is", false], [7901, 0.028421, " failure", false], [10017, 0.023164, " occurred", false], [702, 0.020978, " has", false], [304, 0.020233, " in", false], [9162, 0.020032, " investment", false], [5041, 0.01999, " effort", false], [11, 0.017641, ",", false]]]}, "raw_delta": 0.09997457928127707, "tuned_delta": 0.10678685708837501}, {"byte_start": 2159, "byte_end": 2163, "display": {"text": " was", "kind": "normal"}, "is_word": true, "word_id": 361, "word_key": " was", "bytes_hex": "20 77 61 73", "compression": {"rwkv": "8.77% 8.77% 8.77% 8.77%", "qwen": "6.99% 6.99% 6.99% 6.99%"}, "model_tokens": {"rwkv": [[22748, " was", "normal", 0.14464251697063446]], "qwen": [[572, " was", "normal", 0.21211445331573486]]}, "loss": {"rwkv": 8.770289677279099, "qwen": 6.990891065621055}, "topk": {"rwkv": [22748, 1, 0.14464251697063446, [[22748, 0.144643, " was", false], [4596, 0.144165, " in", false], [4600, 0.107564, " is", false], [21413, 0.099478, " can", false], [56745, 0.091278, " occurred", false], [21800, 0.05422, " has", false], [21265, 0.041359, " and", false], [45, 0.026249, ",", false], [51585, 0.017389, " emerged", false], [46840, 0.015187, " played", false]]], "qwen": [572, 1, 0.21211445331573486, [[572, 0.212114, " was", false], [646, 0.094362, " can", false], [10017, 0.088096, " occurred", false], [374, 0.070937, " is", false], [304, 0.0703, " in", false], [323, 0.058003, " and", false], [8110, 0.03405, " followed", false], [702, 0.031553, " has", false], [21992, 0.026239, " emerged", false], [11, 0.018598, ",", false]]]}, "raw_delta": 0.09867081046104431, "tuned_delta": 0.10548308826814226}, {"byte_start": 2163, "byte_end": 2168, "display": {"text": " seen", "kind": "normal"}, "is_word": true, "word_id": 362, "word_key": " seen", "bytes_hex": "20 73 65 65 6e", "compression": {"rwkv": "3.07% 3.07% 3.07% 3.07% 3.07%", "qwen": "4.22% 4.22% 4.22% 4.22% 4.22%"}, "model_tokens": {"rwkv": [[31968, " seen", "normal", 0.42882269620895386]], "qwen": [[3884, " seen", "normal", 0.31041789054870605]]}, "loss": {"rwkv": 3.0713624893925195, "qwen": 4.2192912194968635}, "topk": {"rwkv": [31968, 1, 0.42882269620895386, [[31968, 0.428823, " seen", false], [51661, 0.107808, " evident", false], [56734, 0.095228, " observed", false], [56255, 0.05653, " followed", false], [57093, 0.055165, " repeated", false], [38547, 0.033505, " found", false], [55524, 0.024035, " apparent", false], [53296, 0.023705, " visible", false], [22590, 0.009131, " the", false], [59676, 0.008594, " exhibited", false]]], "qwen": [3884, 1, 0.31041789054870605, [[3884, 0.310418, " seen", false], [13166, 0.190853, " observed", false], [29476, 0.077438, " evident", false], [1730, 0.048113, " found", false], [11504, 0.029763, " repeated", false], [31026, 0.028457, " witnessed", false], [8110, 0.024862, " followed", false], [1083, 0.015594, " also", false], [304, 0.013705, " in", false], [10321, 0.010507, " experienced", false]]]}, "raw_delta": -0.06365468502044677, "tuned_delta": -0.05684240721334882}, {"byte_start": 2168, "byte_end": 2171, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 363, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "0.72% 0.72% 0.72%", "qwen": "0.94% 0.94% 0.94%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.8881146907806396]], "qwen": [[304, " in", "normal", 0.8556819558143616]]}, "loss": {"rwkv": 0.7191167908076904, "qwen": 0.9368891954426406}, "topk": {"rwkv": [4596, 1, 0.8881146907806396, [[4596, 0.888115, " in", false], [32487, 0.041647, " with", false], [32465, 0.010086, " when", false], [21700, 0.009607, " for", false], [45, 0.005814, ",", false], [45805, 0.004071, " during", false], [4424, 0.003097, " at", false], [31601, 0.002384, " over", false], [4712, 0.002197, " on", false], [45202, 0.002005, " around", false]]], "qwen": [304, 1, 0.8556819558143616, [[304, 0.855682, " in", false], [448, 0.046766, " with", false], [369, 0.018555, " for", false], [979, 0.011921, " when", false], [518, 0.011762, " at", false], [553, 0.010531, " by", false], [11, 0.005457, ",", false], [2337, 0.00533, " during", false], [916, 0.004182, " over", false], [4221, 0.003949, " among", false]]]}, "raw_delta": -0.01207586626211802, "tuned_delta": -0.0052635884550200724}, {"byte_start": 2171, "byte_end": 2180, "display": {"text": " computer", "kind": "normal"}, "is_word": true, "word_id": 364, "word_key": " computer", "bytes_hex": "20 63 6f 6d 70 75 74 65 72", "compression": {"rwkv": "4.23% 4.23% 4.23% 4.23% 4.23% 4.23% 4.23% 4.23% 4.23%", "qwen": "6.31% 6.31% 6.31% 6.31% 6.31% 6.31% 6.31% 6.31% 6.31%"}, "model_tokens": {"rwkv": [[55809, " computer", "normal", 0.12001878023147583]], "qwen": [[6366, " computer", "normal", 0.04282262921333313]]}, "loss": {"rwkv": 4.226645627604385, "qwen": 6.313170678024638}, "topk": {"rwkv": [55809, 2, 0.12001878023147583, [[22590, 0.259711, " the", false], [55809, 0.120019, " computer", false], [38328, 0.04964, " early", false], [52299, 0.039287, " natural", false], [52167, 0.038211, " machine", false], [3851, 0.033462, " Go", false], [3609, 0.031312, " AI", false], [38013, 0.019854, " chess", false], [45929, 0.018727, " expert", false], [30941, 0.01707, " game", false]]], "qwen": [6366, 3, 0.04282262921333313, [[279, 0.321339, " the", false], [1809, 0.056189, " game", false], [6366, 0.042823, " computer", false], [1008, 0.027065, " other", false], [6203, 0.022183, " expert", false], [5994, 0.020669, " Go", false], [5662, 0.018329, " machine", false], [20443, 0.016123, " artificial", false], [3868, 0.014979, " games", false], [5810, 0.013605, " natural", false]]]}, "raw_delta": -0.11570151646931962, "tuned_delta": -0.10888923866222167}, {"byte_start": 2180, "byte_end": 2183, "display": {"text": " Go", "kind": "normal"}, "is_word": true, "word_id": 365, "word_key": " go", "bytes_hex": "20 47 6f", "compression": {"rwkv": "6.57% 6.57% 6.57%", "qwen": "2.32% 2.32% 2.32%"}, "model_tokens": {"rwkv": [[3851, " Go", "normal", 0.33767253160476685]], "qwen": [[5994, " Go", "normal", 0.6799574494361877]]}, "loss": {"rwkv": 6.574782087384598, "qwen": 2.3186817435910383}, "topk": {"rwkv": [3851, 1, 0.33767253160476685, [[3851, 0.337673, " Go", false], [46, 0.08338, "-", false], [52814, 0.082601, " science", false], [47732, 0.053572, " vision", false], [39311, 0.039533, " poker", false], [38576, 0.032549, " games", false], [47350, 0.029175, " speech", false], [56529, 0.028389, " language", false], [31044, 0.021721, " hand", false], [4559, 0.021168, " go", false]]], "qwen": [5994, 1, 0.6799574494361877, [[5994, 0.679957, " Go", false], [3868, 0.049785, " games", false], [20814, 0.030803, " poker", false], [728, 0.029928, " go", false], [1809, 0.02932, " game", false], [19926, 0.023104, "-go", false], [1182, 0.015382, " back", false], [1779, 0.009107, " check", false], [3701, 0.009033, " card", false], [12604, 0.007157, " GO", false]]]}, "raw_delta": 0.2360083162784576, "tuned_delta": 0.24282059408555556}, {"byte_start": 2183, "byte_end": 2184, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "21.56%", "qwen": "16.10%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.30419832468032837]], "qwen": [[11, ",", "normal", 0.40962767601013184]]}, "loss": {"rwkv": 21.555892700782362, "qwen": 16.09518771169503}, "topk": {"rwkv": [45, 2, 0.30419832468032837, [[47, 0.527649, ".", false], [45, 0.304198, ",", false], [4596, 0.052748, " in", false], [275, 0.017448, " (", false], [21265, 0.016553, " and", false], [59, 0.014056, ":", false], [31601, 0.006313, " over", false], [30917, 0.005257, " from", false], [332, 0.004098, " a", false], [45805, 0.002739, " during", false]]], "qwen": [11, 2, 0.40962767601013184, [[13, 0.442132, ".", false], [11, 0.409628, ",", false], [304, 0.034679, " in", false], [320, 0.023862, " (", false], [323, 0.015349, " and", false], [3412, 0.006555, " research", false], [25, 0.006412, ":", false], [553, 0.005444, " by", false], [979, 0.005193, " when", false], [26, 0.002816, ";", false]]]}, "raw_delta": 0.3028057813644409, "tuned_delta": 0.30961805917153884}, {"byte_start": 2184, "byte_end": 2189, "display": {"text": " only", "kind": "normal"}, "is_word": true, "word_id": 366, "word_key": " only", "bytes_hex": "20 6f 6e 6c 79", "compression": {"rwkv": "26.71% 26.71% 26.71% 26.71% 26.71%", "qwen": "31.91% 31.91% 31.91% 31.91% 31.91%"}, "model_tokens": {"rwkv": [[31581, " only", "normal", 0.0006091473042033613]], "qwen": [[1172, " only", "normal", 0.00014375371392816305]]}, "loss": {"rwkv": 26.71240036645971, "qwen": 31.910283618281632}, "topk": {"rwkv": [31581, 62, 0.0006091473042033613, [[40185, 0.42708, " where", false], [40186, 0.102821, " which", false], [22590, 0.05795, " the", false], [4596, 0.04842, " in", false], [21265, 0.040479, " and", false], [32487, 0.035222, " with", false], [332, 0.030405, " a", false], [55495, 0.016676, " although", false], [32465, 0.015997, " when", false], [21400, 0.013857, " but", false]]], "qwen": [1172, 146, 0.00014375371392816305, [[1380, 0.360335, " where", false], [892, 0.147696, " which", false], [264, 0.065947, " a", false], [304, 0.062296, " in", false], [279, 0.05924, " the", false], [448, 0.042481, " with", false], [323, 0.029347, " and", false], [979, 0.018793, " when", false], [458, 0.015009, " an", false], [2441, 0.012311, " another", false]]]}, "raw_delta": -0.28823184967041016, "tuned_delta": -0.28141957186331223}, {"byte_start": 2189, "byte_end": 2197, "display": {"text": " delayed", "kind": "normal"}, "is_word": true, "word_id": 367, "word_key": " delayed", "bytes_hex": "20 64 65 6c 61 79 65 64", "compression": {"rwkv": "14.93% 14.93% 14.93% 14.93% 14.93% 14.93% 14.93% 14.93%", "qwen": "14.29% 14.29% 14.29% 14.29% 14.29% 14.29% 14.29% 14.29%"}, "model_tokens": {"rwkv": [[51419, " delayed", "normal", 0.0013423830969259143]], "qwen": [[22706, " delayed", "normal", 0.0017680253367871046]]}, "loss": {"rwkv": 14.934147884202158, "qwen": 14.28694599714994}, "topk": {"rwkv": [51419, 53, 0.0013423830969259143, [[31458, 0.112081, " more", false], [332, 0.103725, " a", false], [31466, 0.092322, " much", false], [38869, 0.073139, " later", false], [32487, 0.065183, " with", false], [4601, 0.042027, " it", false], [57263, 0.041403, " somewhat", false], [57245, 0.037563, " slightly", false], [4596, 0.031044, " in", false], [22590, 0.030864, " the", false]]], "qwen": [22706, 45, 0.0017680253367871046, [[419, 0.243399, " this", false], [803, 0.134981, " more", false], [448, 0.060628, " with", false], [264, 0.05519, " a", false], [1753, 0.054965, " much", false], [304, 0.050239, " in", false], [311, 0.034538, " to", false], [432, 0.031966, " it", false], [279, 0.025637, " the", false], [429, 0.025317, " that", false]]]}, "raw_delta": 0.035888493061065674, "tuned_delta": 0.04270077086816362}, {"byte_start": 2197, "byte_end": 2200, "display": {"text": " by", "kind": "normal"}, "is_word": true, "word_id": 368, "word_key": " by", "bytes_hex": "20 62 79", "compression": {"rwkv": "3.01% 3.01% 3.01%", "qwen": "4.23% 4.23% 4.23%"}, "model_tokens": {"rwkv": [[4450, " by", "normal", 0.6036739349365234]], "qwen": [[553, " by", "normal", 0.49497660994529724]]}, "loss": {"rwkv": 3.0056146685186733, "qwen": 4.227365804954872}, "topk": {"rwkv": [4450, 1, 0.6036739349365234, [[4450, 0.603674, " by", false], [332, 0.079799, " a", false], [57263, 0.049991, " somewhat", false], [21700, 0.033978, " for", false], [57245, 0.029274, " slightly", false], [51018, 0.021927, " because", false], [40076, 0.021862, " until", false], [47, 0.018612, ".", false], [21265, 0.017979, " and", false], [37598, 0.015609, " about", false]]], "qwen": [553, 1, 0.49497660994529724, [[553, 0.494977, " by", false], [3080, 0.072059, " until", false], [304, 0.060012, " in", false], [13, 0.051781, ".", false], [264, 0.044172, " a", false], [369, 0.040421, " for", false], [311, 0.02979, " to", false], [10078, 0.021066, " slightly", false], [1576, 0.020199, " because", false], [803, 0.016974, " more", false]]]}, "raw_delta": -0.06774826844533285, "tuned_delta": -0.060935990638234905}, {"byte_start": 2200, "byte_end": 2202, "display": {"text": " a", "kind": "normal"}, "is_word": true, "word_id": 369, "word_key": " a", "bytes_hex": "20 61", "compression": {"rwkv": "11.83% 11.83%", "qwen": "13.95% 13.95%"}, "model_tokens": {"rwkv": [[332, " a", "normal", 0.26985085010528564]], "qwen": [[264, " a", "normal", 0.21295078098773956]]}, "loss": {"rwkv": 11.834607757292277, "qwen": 13.946301035477545}, "topk": {"rwkv": [332, 1, 0.26985085010528564, [[332, 0.269851, " a", false], [37598, 0.161243, " about", false], [52869, 0.087766, " several", false], [22590, 0.054883, " the", false], [3483, 0.035098, " 10", false], [22638, 0.032183, " two", false], [31370, 0.029369, " many", false], [31458, 0.027341, " more", false], [30869, 0.020405, " five", false], [22583, 0.017665, " ten", false]]], "qwen": [264, 1, 0.21295078098773956, [[264, 0.212951, " a", false], [279, 0.190157, " the", false], [220, 0.099973, " ", false], [10793, 0.051928, " decades", false], [3807, 0.040558, " several", false], [803, 0.03866, " more", false], [1657, 0.034201, " many", false], [1378, 0.029853, " two", false], [911, 0.025934, " about", false], [2441, 0.018902, " another", false]]]}, "raw_delta": -0.11709713935852051, "tuned_delta": -0.11028486155142256}, {"byte_start": 2202, "byte_end": 2210, "display": {"text": " further", "kind": "normal"}, "is_word": true, "word_id": 370, "word_key": " further", "bytes_hex": "20 66 75 72 74 68 65 72", "compression": {"rwkv": "13.95% 13.95% 13.95% 13.95% 13.95% 13.95% 13.95% 13.95%", "qwen": "11.41% 11.41% 11.41% 11.41% 11.41% 11.41% 11.41% 11.41%"}, "model_tokens": {"rwkv": [[51816, " further", "normal", 0.0020301963668316603]], "qwen": [[4623, " further", "normal", 0.006346368696540594]]}, "loss": {"rwkv": 13.947930571094469, "qwen": 11.406020541992751}, "topk": {"rwkv": [51816, 13, 0.0020301963668316603, [[21674, 0.428139, " few", false], [45674, 0.301061, " decade", false], [45602, 0.118709, " couple", false], [32512, 0.039321, " year", false], [62035, 0.01861, " generation", false], [21365, 0.01311, " bit", false], [45950, 0.009873, " factor", false], [46685, 0.009321, " number", false], [46454, 0.008868, " little", false], [31040, 0.002867, " half", false]]], "qwen": [4623, 17, 0.006346368696540594, [[13212, 0.361089, " decade", false], [2421, 0.127623, " few", false], [8168, 0.081854, " factor", false], [9471, 0.06511, " generation", false], [5021, 0.057878, " longer", false], [9294, 0.037375, " century", false], [5625, 0.029724, " couple", false], [1753, 0.023602, " much", false], [803, 0.017667, " more", false], [1042, 0.013761, " year", false]]]}, "raw_delta": 0.1409534215927124, "tuned_delta": 0.14776569939981035}, {"byte_start": 2210, "byte_end": 2213, "display": {"text": " 20", "kind": "normal"}, "is_word": true, "word_id": 371, "word_key": " 20", "bytes_hex": "20 32 30", "compression": {"rwkv": "21.23% 21.23% 21.23%", "qwen": "14.81% 15.29% 5.23%"}, "model_tokens": {"rwkv": [[3493, " 20", "normal", 0.029776887968182564]], "qwen": [[220, " ", "normal", 0.43981674313545227], [17, "2", "normal", 0.42840680480003357], [15, "0", "normal", 0.7482753396034241]]}, "loss": {"rwkv": 21.22715359641313, "qwen": 11.77637980616797}, "topk": {"rwkv": [3493, 10, 0.029776887968182564, [[45674, 0.20292, " decade", false], [3483, 0.100033, " 10", false], [30869, 0.086928, " five", false], [22638, 0.058598, " two", false], [22583, 0.053782, " ten", false], [3488, 0.048864, " 15", false], [30905, 0.044523, " four", false], [39644, 0.040254, " seven", false], [39946, 0.033334, " three", false], [3493, 0.029777, " 20", false]]], "qwen": [220, 1, 0.43981674313545227, [[220, 0.439817, " ", false], [13212, 0.100761, " decade", false], [1378, 0.053785, " two", false], [5779, 0.039719, " ten", false], [4236, 0.037992, " five", false], [17073, 0.03225, " twenty", false], [9471, 0.030196, " generation", false], [2326, 0.028439, " three", false], [8168, 0.02575, " factor", false], [36655, 0.022671, " fifteen", false]]]}, "raw_delta": 0.524062176545461, "tuned_delta": 0.5308744543525589}, {"byte_start": 2213, "byte_end": 2219, "display": {"text": " years", "kind": "normal"}, "is_word": true, "word_id": 372, "word_key": " years", "bytes_hex": "20 79 65 61 72 73", "compression": {"rwkv": "0.13% 0.13% 0.13% 0.13% 0.13% 0.13%", "qwen": "0.08% 0.08% 0.08% 0.08% 0.08% 0.08%"}, "model_tokens": {"rwkv": [[40237, " years", "normal", 0.9584115147590637]], "qwen": [[1635, " years", "normal", 0.9749020338058472]]}, "loss": {"rwkv": 0.12767992000054912, "qwen": 0.07639755989077397}, "topk": {"rwkv": [40237, 1, 0.9584115147590637, [[40237, 0.958412, " years", false], [4715, 0.011977, " or", false], [46, 0.010842, "-", false], [44, 0.006514, "+", false], [49, 0.001767, "0", false], [4811, 0.001442, " to", false], [620, 0.001377, "00", false], [32512, 0.000897, " year", false], [46596, 0.000704, " months", false], [45, 0.000431, ",", false]]], "qwen": [1635, 1, 0.9749020338058472, [[1635, 0.974902, " years", false], [476, 0.005643, " or", false], [12, 0.004019, "-", false], [311, 0.002986, " to", false], [4102, 0.00289, " ", false], [10, 0.002163, "+", false], [15, 0.001481, "0", false], [4142, 0.001073, "–", false], [56088, 0.00053, "-years", false], [22934, 0.000528, "-plus", false]]]}, "raw_delta": 0.0028436978658040357, "tuned_delta": 0.009655975672901983}, {"byte_start": 2219, "byte_end": 2220, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "5.00%", "qwen": "6.47%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.7557412981987]], "qwen": [[13, ".", "normal", 0.6986647844314575]]}, "loss": {"rwkv": 5.001530659331855, "qwen": 6.466596042562159}, "topk": {"rwkv": [47, 1, 0.7557412981987, [[47, 0.755741, ".", false], [45, 0.075432, ",", false], [4715, 0.03661, " or", false], [21265, 0.024369, " and", false], [51018, 0.017036, " because", false], [275, 0.015179, " (", false], [59, 0.012902, ":", false], [21572, 0.012319, " due", false], [37634, 0.008486, " after", false], [4706, 0.003914, " of", false]]], "qwen": [13, 1, 0.6986647844314575, [[13, 0.698665, ".", false], [11, 0.08126, ",", false], [320, 0.02321, " (", false], [1576, 0.021752, " because", false], [315, 0.019394, " of", false], [323, 0.015811, " and", false], [476, 0.012819, " or", false], [1573, 0.011566, " before", false], [4152, 0.010564, " due", false], [504, 0.010561, " from", false]]]}, "raw_delta": -0.08124047517776489, "tuned_delta": -0.07442819737066694}, {"byte_start": 2220, "byte_end": 2223, "display": {"text": " En", "kind": "normal"}, "is_word": true, "word_id": 373, "word_key": " en", "bytes_hex": "20 45 6e", "compression": {"rwkv": "63.87% 63.87% 63.87%", "qwen": "67.94% 67.94% 67.94%"}, "model_tokens": {"rwkv": [[3785, " En", "normal", 2.3706126739853062e-05]], "qwen": [[2925, " En", "normal", 1.2355040780676063e-05]]}, "loss": {"rwkv": 63.86931170602181, "qwen": 67.93558351169662}, "topk": {"rwkv": [3785, 871, 2.3706126739853062e-05, [[20996, 0.183232, " The", false], [3913, 0.149144, " In", false], [37451, 0.033284, " There", false], [30032, 0.030478, " When", false], [28753, 0.028266, " Deep", false], [261, 0.026304, "\n\n", false], [300, 0.023199, " A", false], [29894, 0.023014, " This", false], [3851, 0.022371, " Go", false], [267, 0.021816, "  ", false]]], "qwen": [2925, 1381, 1.2355040780676063e-05, [[576, 0.194352, " The", false], [758, 0.129986, " In", false], [3197, 0.042168, " When", false], [1084, 0.029462, " It", false], [1096, 0.028426, " This", false], [362, 0.026568, " A", false], [5994, 0.024987, " Go", false], [2411, 0.024318, " At", false], [18183, 0.022559, " Deep", false], [2619, 0.021317, " There", false]]]}, "raw_delta": -0.22548198699951172, "tuned_delta": -0.21866970919241377}, {"byte_start": 2223, "byte_end": 2226, "display": {"text": "orm", "kind": "normal"}, "is_word": true, "word_id": 374, "word_key": "orm", "bytes_hex": "6f 72 6d", "compression": {"rwkv": "8.78% 8.78% 8.78%", "qwen": "0.88% 0.88% 0.88%"}, "model_tokens": {"rwkv": [[8404, "orm", "normal", 0.23251210153102875]], "qwen": [[493, "orm", "normal", 0.8644454479217529]]}, "loss": {"rwkv": 8.782030359578, "qwen": 0.8756382013579326}, "topk": {"rwkv": [8404, 2, 0.23251210153102875, [[26596, 0.478058, "ough", false], [8404, 0.232512, "orm", false], [35003, 0.058141, "light", false], [40885, 0.031288, "abling", false], [27567, 0.029585, "zyme", false], [39552, 0.027222, " route", false], [34698, 0.020062, "igmat", false], [41795, 0.012156, "listed", false], [26883, 0.007829, "rico", false], [9163, 0.00726, "zig", false]]], "qwen": [493, 1, 0.8644454479217529, [[493, 0.864445, "orm", false], [33132, 0.049235, "thus", false], [309, 0.017022, "am", false], [13013, 0.016572, "vision", false], [55247, 0.014893, "rico", false], [2152, 0.003988, "no", false], [18768, 0.002521, "abling", false], [12738, 0.002172, "zo", false], [1494, 0.001699, " pass", false], [98730, 0.001685, "igmatic", false]]]}, "raw_delta": 0.43842347462972003, "tuned_delta": 0.44523575243681796}, {"byte_start": 2226, "byte_end": 2229, "display": {"text": "ous", "kind": "normal"}, "is_word": true, "word_id": 375, "word_key": "ous", "bytes_hex": "6f 75 73", "compression": {"rwkv": "0.33% 0.33% 0.33%", "qwen": "0.45% 0.45% 0.45%"}, "model_tokens": {"rwkv": [[8439, "ous", "normal", 0.9461843967437744]], "qwen": [[782, "ous", "normal", 0.9285297393798828]]}, "loss": {"rwkv": 0.33460944551868044, "qwen": 0.4457498298154722}, "topk": {"rwkv": [8439, 1, 0.9461843967437744, [[8439, 0.946184, "ous", false], [35323, 0.053244, "ously", false], [27340, 8.3e-05, "uous", false], [25902, 6.5e-05, "ious", false], [2243, 6.3e-05, "us", false], [7933, 2.8e-05, "ity", false], [8435, 2.8e-05, "oul", false], [7450, 2.2e-05, "ely", false], [2102, 2.1e-05, "os", false], [25297, 2e-05, "eous", false]]], "qwen": [782, 1, 0.9285297393798828, [[782, 0.92853, "ous", false], [7017, 0.070054, "ously", false], [288, 0.000248, "es", false], [1530, 0.000137, "ouse", false], [283, 0.000123, "ou", false], [68, 0.000119, "e", false], [487, 0.000111, "ity", false], [78, 8.3e-05, "o", false], [33072, 7.9e-05, "eous", false], [480, 6.4e-05, "able", false]]]}, "raw_delta": -0.006162931521733601, "tuned_delta": 0.0006493462853643462}, {"byte_start": 2229, "byte_end": 2237, "display": {"text": " initial", "kind": "normal"}, "is_word": true, "word_id": 376, "word_key": " initial", "bytes_hex": "20 69 6e 69 74 69 61 6c", "compression": {"rwkv": "15.57% 15.57% 15.57% 15.57% 15.57% 15.57% 15.57% 15.57%", "qwen": "18.19% 18.19% 18.19% 18.19% 18.19% 18.19% 18.19% 18.19%"}, "model_tokens": {"rwkv": [[52013, " initial", "normal", 0.0010147057473659515]], "qwen": [[2856, " initial", "normal", 0.00031285788281820714]]}, "loss": {"rwkv": 15.568144728342816, "qwen": 18.19094464749472}, "topk": {"rwkv": [52013, 66, 0.0010147057473659515, [[56950, 0.31702, " progress", false], [64423, 0.122459, " improvements", false], [51566, 0.039175, " efforts", false], [50897, 0.038094, " amounts", false], [55465, 0.033236, " advances", false], [63621, 0.030979, " improvement", false], [45829, 0.029695, " effort", false], [45, 0.025143, ",", false], [57103, 0.02258, " research", false], [38720, 0.020271, " human", false]]], "qwen": [2856, 145, 0.00031285788281820714, [[2711, 0.142274, " search", false], [54480, 0.113539, " computational", false], [5098, 0.08119, " progress", false], [5041, 0.073557, " effort", false], [29903, 0.052898, " advances", false], [34447, 0.049092, " computation", false], [18142, 0.04861, " improvements", false], [14713, 0.038292, " amounts", false], [11, 0.025313, ",", false], [8869, 0.015892, " efforts", false]]]}, "raw_delta": -0.14543890953063965, "tuned_delta": -0.1386266317235417}, {"byte_start": 2237, "byte_end": 2245, "display": {"text": " efforts", "kind": "normal"}, "is_word": true, "word_id": 377, "word_key": " efforts", "bytes_hex": "20 65 66 66 6f 72 74 73", "compression": {"rwkv": "7.19% 7.19% 7.19% 7.19% 7.19% 7.19% 7.19% 7.19%", "qwen": "5.33% 5.33% 5.33% 5.33% 5.33% 5.33% 5.33% 5.33%"}, "model_tokens": {"rwkv": [[51566, " efforts", "normal", 0.04123802110552788]], "qwen": [[8869, " efforts", "normal", 0.09407690912485123]]}, "loss": {"rwkv": 7.185297566927454, "qwen": 5.328149360934822}, "topk": {"rwkv": [51566, 5, 0.04123802110552788, [[56950, 0.353481, " progress", false], [62157, 0.129399, " investment", false], [53052, 0.080928, " success", false], [63678, 0.072322, " investments", false], [51566, 0.041238, " efforts", false], [57103, 0.039185, " research", false], [45829, 0.036312, " effort", false], [55465, 0.029156, " advances", false], [60587, 0.027878, " successes", false], [64423, 0.019909, " improvements", false]]], "qwen": [8869, 3, 0.09407690912485123, [[5041, 0.139331, " effort", false], [5098, 0.133733, " progress", false], [8869, 0.094077, " efforts", false], [9162, 0.085854, " investment", false], [29903, 0.07295, " advances", false], [54480, 0.068006, " computational", false], [2393, 0.050085, " success", false], [47088, 0.041195, " successes", false], [19619, 0.0384, " gains", false], [2711, 0.030214, " search", false]]]}, "raw_delta": 0.10298216342926025, "tuned_delta": 0.1097944412363582}, {"byte_start": 2245, "byte_end": 2250, "display": {"text": " went", "kind": "normal"}, "is_word": true, "word_id": 378, "word_key": " went", "bytes_hex": "20 77 65 6e 74", "compression": {"rwkv": "14.88% 14.88% 14.88% 14.88% 14.88%", "qwen": "14.21% 14.21% 14.21% 14.21% 14.21%"}, "model_tokens": {"rwkv": [[32460, " went", "normal", 0.016379324719309807]], "qwen": [[3937, " went", "normal", 0.01947474665939808]]}, "loss": {"rwkv": 14.877792609167432, "qwen": 14.205629375147302}, "topk": {"rwkv": [32460, 10, 0.016379324719309807, [[4811, 0.271668, " to", false], [32462, 0.187201, " were", false], [4596, 0.10273, " in", false], [4424, 0.064131, " at", false], [4450, 0.062538, " by", false], [51770, 0.029362, " focused", false], [4712, 0.024177, " on", false], [45, 0.023752, ",", false], [37810, 0.020655, " based", false], [32460, 0.016379, " went", false]]], "qwen": [3937, 9, 0.01947474665939808, [[1033, 0.326123, " were", false], [311, 0.202252, " to", false], [304, 0.091795, " in", false], [553, 0.044073, " by", false], [518, 0.034734, " at", false], [11, 0.032869, ",", false], [3118, 0.023143, " based", false], [1030, 0.020815, " had", false], [3937, 0.019475, " went", false], [389, 0.01851, " on", false]]]}, "raw_delta": 0.037272644042968706, "tuned_delta": 0.044084921850066655}, {"byte_start": 2250, "byte_end": 2255, "display": {"text": " into", "kind": "normal"}, "is_word": true, "word_id": 379, "word_key": " into", "bytes_hex": "20 69 6e 74 6f", "compression": {"rwkv": "0.51% 0.51% 0.51% 0.51% 0.51%", "qwen": "0.39% 0.39% 0.39% 0.39% 0.39%"}, "model_tokens": {"rwkv": [[31162, " into", "normal", 0.8669528365135193]], "qwen": [[1119, " into", "normal", 0.8965668678283691]]}, "loss": {"rwkv": 0.5142418846918668, "qwen": 0.39379216907816855}, "topk": {"rwkv": [31162, 1, 0.8669528365135193, [[31162, 0.866953, " into", false], [4811, 0.067688, " to", false], [47585, 0.02652, " toward", false], [4596, 0.016102, " in", false], [53169, 0.010308, " towards", false], [4712, 0.003051, " on", false], [56003, 0.000626, " directly", false], [52028, 0.000591, " instead", false], [45, 0.000547, ",", false], [38543, 0.000426, " forth", false]]], "qwen": [1119, 1, 0.8965668678283691, [[1119, 0.896567, " into", false], [8841, 0.040515, " toward", false], [6974, 0.020418, " towards", false], [311, 0.020106, " to", false], [304, 0.012883, " in", false], [389, 0.001529, " on", false], [1283, 0.001193, " after", false], [369, 0.000768, " for", false], [13771, 0.00056, " largely", false], [537, 0.000338, " not", false]]]}, "raw_delta": 0.006679150462150574, "tuned_delta": 0.01349142826924852}, {"byte_start": 2255, "byte_end": 2264, "display": {"text": " avoiding", "kind": "normal"}, "is_word": true, "word_id": 380, "word_key": " avoiding", "bytes_hex": "20 61 76 6f 69 64 69 6e 67", "compression": {"rwkv": "19.54% 19.54% 19.54% 19.54% 19.54% 19.54% 19.54% 19.54% 19.54%", "qwen": "18.25% 18.25% 18.25% 18.25% 18.25% 18.25% 18.25% 18.25% 18.25%"}, "model_tokens": {"rwkv": [[55586, " avoiding", "normal", 5.9574635088210925e-05]], "qwen": [[30426, " avoiding", "normal", 0.0001108758442569524]]}, "loss": {"rwkv": 19.536495345371375, "qwen": 18.248287962858655}, "topk": {"rwkv": [55586, 671, 5.9574635088210925e-05, [[52224, 0.110806, " methods", false], [61857, 0.079418, " developing", false], [22590, 0.072222, " the", false], [38720, 0.068286, " human", false], [47202, 0.029486, " search", false], [55882, 0.026411, " creating", false], [47629, 0.025222, " trying", false], [55666, 0.020721, " building", false], [59832, 0.019431, " improving", false], [55809, 0.018271, " computer", false]]], "qwen": [30426, 397, 0.0001108758442569524, [[11220, 0.192012, " developing", false], [5413, 0.153821, " methods", false], [3738, 0.062345, " human", false], [279, 0.032841, " the", false], [4460, 0.024713, " trying", false], [76482, 0.022661, " leveraging", false], [4752, 0.022024, " building", false], [6825, 0.019116, " creating", false], [9271, 0.019007, " finding", false], [8660, 0.016814, " understanding", false]]]}, "raw_delta": 0.07143338521321607, "tuned_delta": 0.07824566302031402}, {"byte_start": 2264, "byte_end": 2271, "display": {"text": " search", "kind": "normal"}, "is_word": true, "word_id": 381, "word_key": " search", "bytes_hex": "20 73 65 61 72 63 68", "compression": {"rwkv": "7.21% 7.21% 7.21% 7.21% 7.21% 7.21% 7.21%", "qwen": "6.52% 6.52% 6.52% 6.52% 6.52% 6.52% 6.52%"}, "model_tokens": {"rwkv": [[47202, " search", "normal", 0.06168128922581673]], "qwen": [[2711, " search", "normal", 0.07964933663606644]]}, "loss": {"rwkv": 7.205424450868429, "qwen": 6.518203890075754}, "topk": {"rwkv": [47202, 3, 0.06168128922581673, [[22590, 0.349533, " the", false], [37920, 0.187961, " brute", false], [47202, 0.061681, " search", false], [38720, 0.031522, " human", false], [30597, 0.02458, " deep", false], [332, 0.020053, " a", false], [4404, 0.012023, " ``", false], [63370, 0.008769, " computation", false], [4715, 0.007254, " or", false], [21273, 0.007037, " any", false]]], "qwen": [2711, 3, 0.07964933663606644, [[279, 0.160157, " the", false], [9902, 0.08651, " ``", false], [2711, 0.079649, " search", false], [64098, 0.058393, " brute", false], [264, 0.039142, " a", false], [5538, 0.028358, " deep", false], [3738, 0.02146, " human", false], [5413, 0.01834, " methods", false], [6366, 0.017076, " computer", false], [4285, 0.015536, " simple", false]]]}, "raw_delta": 0.03810759953090126, "tuned_delta": 0.04491987733799921}, {"byte_start": 2271, "byte_end": 2274, "display": {"text": " by", "kind": "normal"}, "is_word": true, "word_id": 382, "word_key": " by", "bytes_hex": "20 62 79", "compression": {"rwkv": "13.90% 13.90% 13.90%", "qwen": "16.33% 16.33% 16.33%"}, "model_tokens": {"rwkv": [[4450, " by", "normal", 0.09901873022317886]], "qwen": [[553, " by", "normal", 0.06609392911195755]]}, "loss": {"rwkv": 13.900967841898865, "qwen": 16.33057678295906}, "topk": {"rwkv": [4450, 3, 0.09901873022317886, [[45, 0.202978, ",", false], [21265, 0.110574, " and", false], [4450, 0.099019, " by", false], [46, 0.070087, "-", false], [61566, 0.066807, " altogether", false], [47, 0.066582, ".", false], [52224, 0.049963, " methods", false], [4424, 0.036288, " at", false], [4596, 0.035526, " in", false], [56131, 0.033199, " entirely", false]]], "qwen": [553, 5, 0.06609392911195755, [[11, 0.249933, ",", false], [5980, 0.190714, "-based", false], [13, 0.076707, ".", false], [323, 0.074601, " and", false], [553, 0.066094, " by", false], [30055, 0.035941, " altogether", false], [5413, 0.028147, " methods", false], [304, 0.026033, " in", false], [320, 0.025177, " (", false], [518, 0.020442, " at", false]]]}, "raw_delta": -0.13472612698872877, "tuned_delta": -0.12791384918163082}, {"byte_start": 2274, "byte_end": 2281, "display": {"text": " taking", "kind": "normal"}, "is_word": true, "word_id": 383, "word_key": " taking", "bytes_hex": "20 74 61 6b 69 6e 67", "compression": {"rwkv": "14.89% 14.89% 14.89% 14.89% 14.89% 14.89% 14.89%", "qwen": "11.33% 11.33% 11.33% 11.33% 11.33% 11.33% 11.33%"}, "model_tokens": {"rwkv": [[47497, " taking", "normal", 0.0031171555165201426]], "qwen": [[4633, " taking", "normal", 0.012311335653066635]]}, "loss": {"rwkv": 14.89389411632021, "qwen": 11.328337514157404}, "topk": {"rwkv": [47497, 53, 0.0031171555165201426, [[40085, 0.098745, " using", false], [38720, 0.072966, " human", false], [31044, 0.053923, " hand", false], [38888, 0.034093, " lever", false], [38989, 0.030081, " means", false], [61857, 0.027846, " developing", false], [56537, 0.022633, " learning", false], [61984, 0.02185, " exploiting", false], [47629, 0.017465, " trying", false], [46227, 0.015631, " humans", false]]], "qwen": [4633, 10, 0.012311335653066635, [[76482, 0.19438, " leveraging", false], [1667, 0.092285, " using", false], [70601, 0.072228, " exploiting", false], [38561, 0.036308, " relying", false], [11220, 0.028414, " developing", false], [3738, 0.022611, " human", false], [4460, 0.020352, " trying", false], [3259, 0.019752, " making", false], [9271, 0.012575, " finding", false], [4633, 0.012311, " taking", false]]]}, "raw_delta": 0.197716440473284, "tuned_delta": 0.20452871828038194}, {"byte_start": 2281, "byte_end": 2291, "display": {"text": " advantage", "kind": "normal"}, "is_word": true, "word_id": 384, "word_key": " advantage", "bytes_hex": "20 61 64 76 61 6e 74 61 67 65", "compression": {"rwkv": "0.52% 0.52% 0.52% 0.52% 0.52% 0.52% 0.52% 0.52% 0.52% 0.52%", "qwen": "0.21% 0.21% 0.21% 0.21% 0.21% 0.21% 0.21% 0.21% 0.21% 0.21%"}, "model_tokens": {"rwkv": [[59093, " advantage", "normal", 0.7510920166969299]], "qwen": [[9423, " advantage", "normal", 0.8883240818977356]]}, "loss": {"rwkv": 0.5177640893815371, "qwen": 0.21355244304141213}, "topk": {"rwkv": [59093, 1, 0.7510920166969299, [[59093, 0.751092, " advantage", false], [38720, 0.043057, " human", false], [332, 0.031389, " a", false], [22590, 0.021939, " the", false], [31044, 0.011486, " hand", false], [4419, 0.005704, " an", false], [46227, 0.005541, " humans", false], [45929, 0.004591, " expert", false], [30923, 0.004457, " full", false], [31162, 0.002945, " into", false]]], "qwen": [9423, 1, 0.8883240818977356, [[9423, 0.888324, " advantage", false], [3738, 0.020714, " human", false], [264, 0.013984, " a", false], [279, 0.010219, " the", false], [3281, 0.004454, " special", false], [458, 0.003345, " an", false], [1119, 0.003085, " into", false], [19760, 0.00281, " inspiration", false], [22146, 0.002526, " advantages", false], [2480, 0.001395, " full", false]]]}, "raw_delta": 0.01686907559633255, "tuned_delta": 0.023681353403430496}, {"byte_start": 2291, "byte_end": 2294, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 385, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "0.03% 0.03% 0.03%", "qwen": "0.02% 0.02% 0.02%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.9949510097503662]], "qwen": [[315, " of", "normal", 0.997437596321106]]}, "loss": {"rwkv": 0.030268946551854317, "qwen": 0.015422807340620752}, "topk": {"rwkv": [4706, 1, 0.9949510097503662, [[4706, 0.994951, " of", false], [38720, 0.001425, " human", false], [45, 0.001253, ",", false], [52028, 0.000355, " instead", false], [275, 0.000218, " (", false], [22590, 0.000216, " the", false], [4596, 0.000175, " in", false], [31581, 0.000107, " only", false], [4423, 7.9e-05, " as", false], [11, 6.1e-05, "\n", false]]], "qwen": [315, 1, 0.997437596321106, [[315, 0.997438, " of", false], [3738, 0.000296, " human", false], [1172, 0.0002, " only", false], [11, 0.000194, ",", false], [4518, 0.000167, " instead", false], [320, 0.000163, " (", false], [916, 0.000138, " over", false], [279, 9.3e-05, " the", false], [198, 9e-05, "\n", false], [220, 7.1e-05, " ", false]]]}, "raw_delta": 0.0008232447629173597, "tuned_delta": 0.007635522570015306}, {"byte_start": 2294, "byte_end": 2300, "display": {"text": " human", "kind": "normal"}, "is_word": true, "word_id": 386, "word_key": " human", "bytes_hex": "20 68 75 6d 61 6e", "compression": {"rwkv": "2.81% 2.81% 2.81% 2.81% 2.81% 2.81%", "qwen": "6.58% 6.58% 6.58% 6.58% 6.58% 6.58%"}, "model_tokens": {"rwkv": [[38720, " human", "normal", 0.39645394682884216]], "qwen": [[3738, " human", "normal", 0.11216458678245544]]}, "loss": {"rwkv": 2.8060230694373556, "qwen": 6.575647733393941}, "topk": {"rwkv": [38720, 1, 0.39645394682884216, [[38720, 0.396454, " human", false], [22590, 0.172868, " the", false], [52964, 0.048272, " special", false], [59943, 0.038495, " knowledge", false], [45775, 0.018938, " domain", false], [332, 0.015999, " a", false], [59792, 0.014702, " heuristic", false], [31044, 0.013634, " hand", false], [51832, 0.01312, " general", false], [46227, 0.011502, " humans", false]]], "qwen": [3738, 3, 0.11216458678245544, [[279, 0.509798, " the", false], [5994, 0.117232, " Go", false], [3738, 0.112165, " human", false], [3281, 0.049416, " special", false], [264, 0.015319, " a", false], [6540, 0.010242, " knowledge", false], [7947, 0.005956, " domain", false], [5888, 0.005153, " properties", false], [1045, 0.004887, " some", false], [1809, 0.003871, " game", false]]]}, "raw_delta": -0.20903237660725912, "tuned_delta": -0.20222009880016117}, {"byte_start": 2300, "byte_end": 2310, "display": {"text": " knowledge", "kind": "normal"}, "is_word": true, "word_id": 387, "word_key": " knowledge", "bytes_hex": "20 6b 6e 6f 77 6c 65 64 67 65", "compression": {"rwkv": "1.34% 1.34% 1.34% 1.34% 1.34% 1.34% 1.34% 1.34% 1.34% 1.34%", "qwen": "1.42% 1.42% 1.42% 1.42% 1.42% 1.42% 1.42% 1.42% 1.42% 1.42%"}, "model_tokens": {"rwkv": [[59943, " knowledge", "normal", 0.475334495306015]], "qwen": [[6540, " knowledge", "normal", 0.45614248514175415]]}, "loss": {"rwkv": 1.3384377820747217, "qwen": 1.4155544802541344}, "topk": {"rwkv": [59943, 1, 0.475334495306015, [[59943, 0.475334, " knowledge", false], [65034, 0.176449, " understanding", false], [59683, 0.04783, " expertise", false], [46, 0.042973, "-", false], [59917, 0.037102, " intuition", false], [38786, 0.024222, " input", false], [52022, 0.017017, " insight", false], [31702, 0.007885, " play", false], [38013, 0.007799, " chess", false], [56463, 0.006537, " insights", false]]], "qwen": [6540, 1, 0.45614248514175415, [[6540, 0.456142, " knowledge", false], [8660, 0.220656, " understanding", false], [1946, 0.077828, " input", false], [18726, 0.045055, " expertise", false], [12646, 0.020202, "-k", false], [56251, 0.018437, " intuition", false], [71107, 0.007661, "-under", false], [20017, 0.00634, " insight", false], [5994, 0.004771, " Go", false], [6203, 0.004634, " expert", false]]]}, "raw_delta": -0.00427625775337219, "tuned_delta": 0.0025360200537257573}, {"byte_start": 2310, "byte_end": 2311, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "37.48%", "qwen": "45.93%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.12603360414505005]], "qwen": [[11, ",", "normal", 0.07831751555204391]]}, "loss": {"rwkv": 37.47625789809221, "qwen": 45.931514055087085}, "topk": {"rwkv": [45, 3, 0.12603360414505005, [[4706, 0.493161, " of", false], [47, 0.168807, ".", false], [45, 0.126034, ",", false], [37598, 0.057755, " about", false], [21265, 0.056257, " and", false], [4596, 0.025047, " in", false], [275, 0.016994, " (", false], [4811, 0.009549, " to", false], [60, 0.00713, ";", false], [59, 0.004377, ":", false]]], "qwen": [11, 4, 0.07831751555204391, [[315, 0.576531, " of", false], [911, 0.126413, " about", false], [13, 0.089047, ".", false], [11, 0.078318, ",", false], [429, 0.028862, " that", false], [323, 0.024365, " and", false], [320, 0.016268, " (", false], [304, 0.009154, " in", false], [311, 0.009109, " to", false], [26, 0.005714, ";", false]]]}, "raw_delta": -0.4688589572906494, "tuned_delta": -0.4620466794835515}, {"byte_start": 2311, "byte_end": 2314, "display": {"text": " or", "kind": "normal"}, "is_word": true, "word_id": 388, "word_key": " or", "bytes_hex": "20 6f 72", "compression": {"rwkv": "30.06% 30.06% 30.06%", "qwen": "34.32% 34.32% 34.32%"}, "model_tokens": {"rwkv": [[4715, " or", "normal", 0.006686931475996971]], "qwen": [[476, " or", "normal", 0.003315593581646681]]}, "loss": {"rwkv": 30.056146685186736, "qwen": 34.31882267814688}, "topk": {"rwkv": [4715, 17, 0.006686931475996971, [[21400, 0.360326, " but", false], [21265, 0.188727, " and", false], [32139, 0.035446, " such", false], [59841, 0.024169, " including", false], [32487, 0.02359, " with", false], [4596, 0.021442, " in", false], [40186, 0.018815, " which", false], [4423, 0.016583, " as", false], [61953, 0.011311, " especially", false], [31581, 0.009307, " only", false]]], "qwen": [476, 25, 0.003315593581646681, [[714, 0.434782, " but", false], [323, 0.181965, " and", false], [448, 0.038411, " with", false], [1741, 0.030794, " such", false], [2670, 0.028073, " including", false], [1172, 0.024085, " only", false], [892, 0.023578, " which", false], [3080, 0.011885, " until", false], [304, 0.010632, " in", false], [438, 0.00972, " as", false]]]}, "raw_delta": -0.2363729476928711, "tuned_delta": -0.22956066988577314}, {"byte_start": 2314, "byte_end": 2317, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 389, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "17.47% 17.47% 17.47%", "qwen": "20.35% 20.35% 20.35%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.05423704907298088]], "qwen": [[315, " of", "normal", 0.03386511653661728]]}, "loss": {"rwkv": 17.47013526076479, "qwen": 20.350234124306272}, "topk": {"rwkv": [4706, 3, 0.05423704907298088, [[4450, 0.188271, " by", false], [4424, 0.085238, " at", false], [4706, 0.054237, " of", false], [4404, 0.041375, " ``", false], [30788, 0.033618, " even", false], [31458, 0.029157, " more", false], [4596, 0.027611, " in", false], [59943, 0.026481, " knowledge", false], [45, 0.026047, ",", false], [4788, 0.023588, " so", false]]], "qwen": [315, 7, 0.03386511653661728, [[9902, 0.18007, " ``", false], [11, 0.061641, ",", false], [518, 0.060405, " at", false], [553, 0.057777, " by", false], [304, 0.05474, " in", false], [1496, 0.033909, " even", false], [315, 0.033865, " of", false], [773, 0.029784, " so", false], [4751, 0.028175, " rather", false], [1119, 0.021958, " into", false]]]}, "raw_delta": -0.15970659255981445, "tuned_delta": -0.1528943147527165}, {"byte_start": 2317, "byte_end": 2321, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 390, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "10.85% 10.85% 10.85% 10.85%", "qwen": "6.59% 6.59% 6.59% 6.59%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.09054161608219147]], "qwen": [[279, " the", "normal", 0.23200125992298126]]}, "loss": {"rwkv": 10.848390444184586, "qwen": 6.586860823081602}, "topk": {"rwkv": [22590, 1, 0.09054161608219147, [[22590, 0.090542, " the", false], [38720, 0.074887, " human", false], [59943, 0.041179, " knowledge", false], [31044, 0.038663, " hand", false], [59792, 0.035513, " heuristic", false], [4404, 0.033113, " ``", false], [39193, 0.032025, " other", false], [32074, 0.021938, " some", false], [332, 0.02084, " a", false], [52964, 0.016341, " special", false]]], "qwen": [279, 1, 0.23200125992298126, [[279, 0.232001, " the", false], [3281, 0.062086, " special", false], [3738, 0.054244, " human", false], [5994, 0.043076, " Go", false], [1008, 0.037108, " other", false], [264, 0.033044, " a", false], [1045, 0.021499, " some", false], [9902, 0.019784, " ``", false], [1667, 0.007692, " using", false], [27076, 0.007412, " specialized", false]]]}, "raw_delta": 0.23630937933921814, "tuned_delta": 0.2431216571463161}, {"byte_start": 2321, "byte_end": 2329, "display": {"text": " special", "kind": "normal"}, "is_word": true, "word_id": 391, "word_key": " special", "bytes_hex": "20 73 70 65 63 69 61 6c", "compression": {"rwkv": "5.00% 5.00% 5.00% 5.00% 5.00% 5.00% 5.00% 5.00%", "qwen": "3.71% 3.71% 3.71% 3.71% 3.71% 3.71% 3.71% 3.71%"}, "model_tokens": {"rwkv": [[52964, " special", "normal", 0.10896649211645126]], "qwen": [[3281, " special", "normal", 0.1932644546031952]]}, "loss": {"rwkv": 5.001530659331855, "qwen": 3.7052372258510644}, "topk": {"rwkv": [52964, 2, 0.10896649211645126, [[60572, 0.122943, " structure", false], [52964, 0.108966, " special", false], [38720, 0.067812, " human", false], [62293, 0.028824, " particular", false], [30808, 0.028614, " fact", false], [4404, 0.019259, " ``", false], [30941, 0.018846, " game", false], [39558, 0.012427, " rules", false], [57271, 0.012033, " specific", false], [59943, 0.00877, " knowledge", false]]], "qwen": [3281, 1, 0.1932644546031952, [[3281, 0.193264, " special", false], [5944, 0.122526, " structure", false], [2097, 0.03143, " fact", false], [5994, 0.02518, " Go", false], [1809, 0.020541, " game", false], [3738, 0.017236, " human", false], [7199, 0.01705, " limited", false], [9902, 0.012231, " ``", false], [1602, 0.011476, " very", false], [9981, 0.009489, " apparent", false]]]}, "raw_delta": 0.07188177108764648, "tuned_delta": 0.07869404889474443}, {"byte_start": 2329, "byte_end": 2338, "display": {"text": " features", "kind": "normal"}, "is_word": true, "word_id": 392, "word_key": " features", "bytes_hex": "20 66 65 61 74 75 72 65 73", "compression": {"rwkv": "9.27% 9.27% 9.27% 9.27% 9.27% 9.27% 9.27% 9.27% 9.27%", "qwen": "8.23% 8.23% 8.23% 8.23% 8.23% 8.23% 8.23% 8.23% 8.23%"}, "model_tokens": {"rwkv": [[56215, " features", "normal", 0.009868385270237923]], "qwen": [[4419, " features", "normal", 0.0164879709482193]]}, "loss": {"rwkv": 9.267311894599242, "qwen": 8.225613933782384}, "topk": {"rwkv": [56215, 6, 0.009868385270237923, [[60572, 0.682275, " structure", false], [46642, 0.033235, " nature", false], [62404, 0.028099, " properties", false], [62586, 0.020987, " structures", false], [65258, 0.01269, " characteristics", false], [56215, 0.009868, " features", false], [56353, 0.009468, " hardware", false], [56310, 0.006682, " geometry", false], [39558, 0.006566, " rules", false], [30405, 0.006078, " case", false]]], "qwen": [4419, 4, 0.0164879709482193, [[5944, 0.698773, " structure", false], [5888, 0.067933, " properties", false], [6993, 0.024992, " nature", false], [4419, 0.016488, " features", false], [14389, 0.009091, " structures", false], [1809, 0.006874, " game", false], [17452, 0.00664, " characteristics", false], [6540, 0.00576, " knowledge", false], [5601, 0.005621, " rules", false], [45120, 0.004294, " symmetry", false]]]}, "raw_delta": 0.057764000362820034, "tuned_delta": 0.06457627816991798}, {"byte_start": 2338, "byte_end": 2341, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 393, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "0.17% 0.17% 0.17%", "qwen": "0.21% 0.21% 0.21%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.9721830487251282]], "qwen": [[315, " of", "normal", 0.9655314683914185]]}, "loss": {"rwkv": 0.17023989333406547, "qwen": 0.21085330521885146}, "topk": {"rwkv": [4706, 1, 0.9721830487251282, [[4706, 0.972183, " of", false], [32227, 0.007122, " that", false], [21265, 0.004049, " and", false], [4596, 0.003393, " in", false], [275, 0.002769, " (", false], [45, 0.000969, ",", false], [4715, 0.000502, " or", false], [47660, 0.000434, " unique", false], [32139, 0.000331, " such", false], [57271, 0.000304, " specific", false]]], "qwen": [315, 1, 0.9655314683914185, [[315, 0.965531, " of", false], [304, 0.006975, " in", false], [429, 0.006378, " that", false], [323, 0.004845, " and", false], [36988, 0.002197, " inherent", false], [320, 0.001166, " (", false], [11, 0.001155, ",", false], [3042, 0.000999, " present", false], [4911, 0.000969, " unique", false], [476, 0.000662, " or", false]]]}, "raw_delta": -0.002252085755268734, "tuned_delta": 0.004560192051829213}, {"byte_start": 2341, "byte_end": 2345, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 394, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "4.26% 4.26% 4.26% 4.26%", "qwen": "5.12% 5.12% 5.12% 5.12%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.39513444900512695]], "qwen": [[279, " the", "normal", 0.3214719593524933]]}, "loss": {"rwkv": 4.2618676745010875, "qwen": 5.116360250638249}, "topk": {"rwkv": [22590, 1, 0.39513444900512695, [[22590, 0.395134, " the", false], [3851, 0.29484, " Go", false], [37876, 0.05778, " board", false], [332, 0.021, " a", false], [62293, 0.020083, " particular", false], [30941, 0.017809, " game", false], [38576, 0.013606, " games", false], [52491, 0.013126, " playing", false], [51161, 0.007062, " certain", false], [32234, 0.005177, " this", false]]], "qwen": [279, 2, 0.3214719593524933, [[5994, 0.547585, " Go", false], [279, 0.321472, " the", false], [419, 0.021368, " this", false], [264, 0.011347, " a", false], [4479, 0.008572, " board", false], [3738, 0.005747, " human", false], [32719, 0.00415, " chess", false], [6366, 0.003771, " computer", false], [728, 0.003709, " go", false], [9902, 0.003297, " ``", false]]]}, "raw_delta": -0.047383129596710205, "tuned_delta": -0.040570851789612256}, {"byte_start": 2345, "byte_end": 2350, "display": {"text": " game", "kind": "normal"}, "is_word": true, "word_id": 395, "word_key": " game", "bytes_hex": "20 67 61 6d 65", "compression": {"rwkv": "3.55% 3.55% 3.55% 3.55% 3.55%", "qwen": "4.66% 4.66% 4.66% 4.66% 4.66%"}, "model_tokens": {"rwkv": [[30941, " game", "normal", 0.3746490776538849]], "qwen": [[1809, " game", "normal", 0.275059312582016]]}, "loss": {"rwkv": 3.550382327187683, "qwen": 4.655463299656067}, "topk": {"rwkv": [30941, 1, 0.3746490776538849, [[30941, 0.374649, " game", false], [37876, 0.264796, " board", false], [3851, 0.149562, " Go", false], [62293, 0.019093, " particular", false], [45775, 0.016183, " domain", false], [38720, 0.008136, " human", false], [52491, 0.006783, " playing", false], [52569, 0.006717, " problem", false], [52964, 0.006624, " special", false], [22638, 0.00572, " two", false]]], "qwen": [1809, 2, 0.275059312582016, [[5994, 0.436529, " Go", false], [1809, 0.275059, " game", false], [4479, 0.128263, " board", false], [7947, 0.017312, " domain", false], [220, 0.008379, " ", false], [3738, 0.004586, " human", false], [3953, 0.004514, " particular", false], [2613, 0.004435, " small", false], [3491, 0.00443, " problem", false], [5944, 0.004076, " structure", false]]]}, "raw_delta": -0.06127870082855227, "tuned_delta": -0.05446642302145432}, {"byte_start": 2350, "byte_end": 2351, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "27.75%", "qwen": "29.58%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.2125014066696167]], "qwen": [[11, ",", "normal", 0.19395911693572998]]}, "loss": {"rwkv": 27.754972954602124, "qwen": 29.57719578377079}, "topk": {"rwkv": [45, 2, 0.2125014066696167, [[47, 0.363354, ".", false], [45, 0.212501, ",", false], [4706, 0.086155, " of", false], [275, 0.067456, " (", false], [32139, 0.033587, " such", false], [32227, 0.032623, " that", false], [460, 0.028656, "'s", false], [46342, 0.023545, " itself", false], [60572, 0.018495, " structure", false], [37876, 0.009923, " board", false]]], "qwen": [11, 2, 0.19395911693572998, [[13, 0.347763, ".", false], [11, 0.193959, ",", false], [315, 0.146011, " of", false], [4479, 0.062257, " board", false], [5086, 0.059378, " itself", false], [320, 0.048018, " (", false], [5994, 0.014755, " Go", false], [429, 0.014364, " that", false], [1741, 0.009644, " such", false], [323, 0.008801, " and", false]]]}, "raw_delta": -0.10104548931121826, "tuned_delta": -0.09423321150412031}, {"byte_start": 2351, "byte_end": 2355, "display": {"text": " but", "kind": "normal"}, "is_word": true, "word_id": 396, "word_key": " but", "bytes_hex": "20 62 75 74", "compression": {"rwkv": "5.99% 5.99% 5.99% 5.99%", "qwen": "5.01% 5.01% 5.01% 5.01%"}, "model_tokens": {"rwkv": [[21400, " but", "normal", 0.2628247141838074]], "qwen": [[714, " but", "normal", 0.3293311893939972]]}, "loss": {"rwkv": 5.987747972439545, "qwen": 5.007465673123974}, "topk": {"rwkv": [21400, 1, 0.2628247141838074, [[21400, 0.262825, " but", false], [32139, 0.202559, " such", false], [4715, 0.145407, " or", false], [21265, 0.111007, " and", false], [31296, 0.027653, " like", false], [4596, 0.026865, " in", false], [59841, 0.017324, " including", false], [4811, 0.016986, " to", false], [4423, 0.012698, " as", false], [40186, 0.011941, " which", false]]], "qwen": [714, 1, 0.3293311893939972, [[714, 0.329331, " but", false], [323, 0.146605, " and", false], [476, 0.131584, " or", false], [1741, 0.044465, " such", false], [3080, 0.036367, " until", false], [1172, 0.026147, " only", false], [892, 0.023762, " which", false], [448, 0.02018, " with", false], [2670, 0.018039, " including", false], [304, 0.016751, " in", false]]]}, "raw_delta": 0.05435839295387268, "tuned_delta": 0.06117067076097063}, {"byte_start": 2355, "byte_end": 2359, "display": {"text": " all", "kind": "normal"}, "is_word": true, "word_id": 397, "word_key": " all", "bytes_hex": "20 61 6c 6c", "compression": {"rwkv": "18.17% 18.17% 18.17% 18.17%", "qwen": "21.68% 21.68% 21.68% 21.68%"}, "model_tokens": {"rwkv": [[21256, " all", "normal", 0.017991824075579643]], "qwen": [[678, " all", "normal", 0.00816090777516365]]}, "loss": {"rwkv": 18.174576198698855, "qwen": 21.678297052967693}, "topk": {"rwkv": [21256, 12, 0.017991824075579643, [[39936, 0.156873, " these", false], [22590, 0.098987, " the", false], [32465, 0.082158, " when", false], [32234, 0.073173, " this", false], [4596, 0.061987, " in", false], [4601, 0.036463, " it", false], [4423, 0.027136, " as", false], [32232, 0.026842, " they", false], [61959, 0.021209, " eventually", false], [32230, 0.019437, " then", false]]], "qwen": [678, 25, 0.00816090777516365, [[1493, 0.137282, " these", false], [279, 0.095442, " the", false], [419, 0.089494, " this", false], [432, 0.06762, " it", false], [9583, 0.064241, " eventually", false], [304, 0.043861, " in", false], [979, 0.037487, " when", false], [1172, 0.029987, " only", false], [1221, 0.024956, " then", false], [11, 0.023043, ",", false]]]}, "raw_delta": -0.19428753852844238, "tuned_delta": -0.18747526072134443}, {"byte_start": 2359, "byte_end": 2365, "display": {"text": " those", "kind": "normal"}, "is_word": true, "word_id": 398, "word_key": " those", "bytes_hex": "20 74 68 6f 73 65", "compression": {"rwkv": "10.05% 10.05% 10.05% 10.05% 10.05% 10.05%", "qwen": "12.36% 12.36% 12.36% 12.36% 12.36% 12.36%"}, "model_tokens": {"rwkv": [[39944, " those", "normal", 0.03453841432929039]], "qwen": [[1846, " those", "normal", 0.01638016290962696]]}, "loss": {"rwkv": 10.050024047859313, "qwen": 12.358138711594995}, "topk": {"rwkv": [39944, 9, 0.03453841432929039, [[4706, 0.245991, " of", false], [39936, 0.162353, " these", false], [32139, 0.0768, " such", false], [32234, 0.074556, " this", false], [45953, 0.062698, " failed", false], [32462, 0.059603, " were", false], [32227, 0.050882, " that", false], [22590, 0.035304, " the", false], [39944, 0.034538, " those", false], [46936, 0.02144, " proved", false]]], "qwen": [1846, 11, 0.01638016290962696, [[315, 0.231068, " of", false], [1493, 0.211625, " these", false], [419, 0.083974, " this", false], [429, 0.068219, " that", false], [1741, 0.039104, " such", false], [1033, 0.033162, " were", false], [4641, 0.032745, " failed", false], [279, 0.027002, " the", false], [8869, 0.020748, " efforts", false], [304, 0.020119, " in", false]]]}, "raw_delta": -0.1279890537261963, "tuned_delta": -0.12117677591909834}, {"byte_start": 2365, "byte_end": 2373, "display": {"text": " efforts", "kind": "normal"}, "is_word": true, "word_id": 399, "word_key": " efforts", "bytes_hex": "20 65 66 66 6f 72 74 73", "compression": {"rwkv": "1.45% 1.45% 1.45% 1.45% 1.45% 1.45% 1.45% 1.45%", "qwen": "1.16% 1.16% 1.16% 1.16% 1.16% 1.16% 1.16% 1.16%"}, "model_tokens": {"rwkv": [[51566, " efforts", "normal", 0.5281104445457458]], "qwen": [[8869, " efforts", "normal", 0.5964605808258057]]}, "loss": {"rwkv": 1.4529094344890072, "qwen": 1.164845749811886}, "topk": {"rwkv": [51566, 1, 0.5281104445457458, [[51566, 0.52811, " efforts", false], [52224, 0.117267, " methods", false], [61590, 0.077048, " approaches", false], [38720, 0.025167, " human", false], [55572, 0.020934, " attempts", false], [32462, 0.015455, " were", false], [38328, 0.012582, " early", false], [22762, 0.007505, " who", false], [45953, 0.006056, " failed", false], [32227, 0.005611, " that", false]]], "qwen": [8869, 1, 0.5964605808258057, [[8869, 0.596461, " efforts", false], [5413, 0.095559, " methods", false], [19827, 0.069919, " approaches", false], [13553, 0.038784, " attempts", false], [4124, 0.02333, " early", false], [1635, 0.008638, " years", false], [2856, 0.007268, " initial", false], [12538, 0.005982, " techniques", false], [6708, 0.005706, " ideas", false], [3412, 0.005579, " research", false]]]}, "raw_delta": 0.015973642468452454, "tuned_delta": 0.0227859202755504}, {"byte_start": 2373, "byte_end": 2380, "display": {"text": " proved", "kind": "normal"}, "is_word": true, "word_id": 400, "word_key": " proved", "bytes_hex": "20 70 72 6f 76 65 64", "compression": {"rwkv": "6.76% 6.76% 6.76% 6.76% 6.76% 6.76% 6.76%", "qwen": "7.26% 7.26% 7.26% 7.26% 7.26% 7.26% 7.26%"}, "model_tokens": {"rwkv": [[46936, " proved", "normal", 0.07221803069114685]], "qwen": [[18651, " proved", "normal", 0.05967317521572113]]}, "loss": {"rwkv": 6.762633004167015, "qwen": 7.262095805446487}, "topk": {"rwkv": [46936, 3, 0.07221803069114685, [[32462, 0.368053, " were", false], [45953, 0.153551, " failed", false], [46936, 0.072218, " proved", false], [62676, 0.045242, " ultimately", false], [30383, 0.025103, " came", false], [38367, 0.02357, " ended", false], [61959, 0.022709, " eventually", false], [21532, 0.01888, " did", false], [32460, 0.013607, " went", false], [31059, 0.012961, " have", false]]], "qwen": [18651, 3, 0.05967317521572113, [[1033, 0.367029, " were", false], [4641, 0.179818, " failed", false], [18651, 0.059673, " proved", false], [13653, 0.048752, " ultimately", false], [9583, 0.031623, " eventually", false], [9482, 0.028981, " ended", false], [11, 0.015861, ",", false], [11052, 0.014836, " fell", false], [614, 0.014054, " have", false], [3697, 0.012633, " came", false]]]}, "raw_delta": -0.02769609860011507, "tuned_delta": -0.020883820793017125}, {"byte_start": 2380, "byte_end": 2391, "display": {"text": " irrelevant", "kind": "normal"}, "is_word": true, "word_id": 401, "word_key": " irrelevant", "bytes_hex": "20 69 72 72 65 6c 65 76 61 6e 74", "compression": {"rwkv": "8.30% 8.30% 8.30% 8.30% 8.30% 8.30% 8.30% 8.30% 8.30% 8.30% 8.30%", "qwen": "10.89% 10.89% 10.89% 10.89% 10.89% 10.89% 10.89% 10.89% 10.89% 10.89% 10.89%"}, "model_tokens": {"rwkv": [[62161, " irrelevant", "normal", 0.006276476662606001]], "qwen": [[39715, " irrelevant", "normal", 0.0013073112349957228]]}, "loss": {"rwkv": 8.299595050568607, "qwen": 10.885433943701791}, "topk": {"rwkv": [62161, 23, 0.006276476662606001, [[4811, 0.214577, " to", false], [62676, 0.098712, " ultimately", false], [62088, 0.081389, " inadequate", false], [21719, 0.05491, " fut", false], [63631, 0.053397, " ineffective", false], [31277, 0.037537, " less", false], [64450, 0.037164, " insufficient", false], [64616, 0.025735, " unsuccessful", false], [38562, 0.019138, " fruit", false], [47650, 0.017093, " unable", false]]], "qwen": [39715, 63, 0.0013073112349957228, [[44925, 0.188567, " unsuccessful", false], [13779, 0.135968, " fruit", false], [311, 0.112288, " to", false], [84527, 0.065561, " futile", false], [38313, 0.053151, " insufficient", false], [54188, 0.041893, " ineffective", false], [13653, 0.034876, " ultimately", false], [45479, 0.024206, " inadequate", false], [38123, 0.017821, " disappointing", false], [2238, 0.01687, " too", false]]]}, "raw_delta": -0.14338935505260117, "tuned_delta": -0.13657707724550322}, {"byte_start": 2391, "byte_end": 2392, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "62.27%", "qwen": "49.52%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.03125414252281189]], "qwen": [[11, ",", "normal", 0.06418482959270477]]}, "loss": {"rwkv": 62.27257891337126, "qwen": 49.520297528472675}, "topk": {"rwkv": [45, 7, 0.03125414252281189, [[32465, 0.260746, " when", false], [4811, 0.17477, " to", false], [4596, 0.156989, " in", false], [47, 0.149855, ".", false], [4423, 0.063103, " as", false], [31578, 0.038896, " once", false], [45, 0.031254, ",", false], [21265, 0.015295, " and", false], [55794, 0.013712, " compared", false], [37634, 0.012075, " after", false]]], "qwen": [11, 6, 0.06418482959270477, [[13, 0.225093, ".", false], [979, 0.184171, " when", false], [304, 0.139454, " in", false], [311, 0.097434, " to", false], [438, 0.075705, " as", false], [11, 0.064185, ",", false], [3055, 0.046634, " once", false], [1283, 0.021483, " after", false], [369, 0.014886, " for", false], [323, 0.014392, " and", false]]]}, "raw_delta": 0.7071366310119629, "tuned_delta": 0.7139489088190608}, {"byte_start": 2392, "byte_end": 2395, "display": {"text": " or", "kind": "normal"}, "is_word": true, "word_id": 402, "word_key": " or", "bytes_hex": "20 6f 72", "compression": {"rwkv": "18.69% 18.69% 18.69%", "qwen": "25.52% 25.52% 25.52%"}, "model_tokens": {"rwkv": [[4715, " or", "normal", 0.044712554663419724]], "qwen": [[476, " or", "normal", 0.01434085238724947]]}, "loss": {"rwkv": 18.691166219850498, "qwen": 25.515523797412175}, "topk": {"rwkv": [4715, 5, 0.044712554663419724, [[21265, 0.347083, " and", false], [4423, 0.123989, " as", false], [51018, 0.06796, " because", false], [4596, 0.052751, " in", false], [4715, 0.044713, " or", false], [40187, 0.035655, " while", false], [32465, 0.034567, " when", false], [39690, 0.019461, " since", false], [31578, 0.018964, " once", false], [32487, 0.017679, " with", false]]], "qwen": [476, 8, 0.01434085238724947, [[323, 0.510421, " and", false], [438, 0.138638, " as", false], [1576, 0.072281, " because", false], [2474, 0.031531, " since", false], [1496, 0.024779, " even", false], [304, 0.017724, " in", false], [448, 0.016665, " with", false], [476, 0.014341, " or", false], [369, 0.013842, " for", false], [518, 0.010165, " at", false]]]}, "raw_delta": -0.37842273712158203, "tuned_delta": -0.3716104593144841}, {"byte_start": 2395, "byte_end": 2401, "display": {"text": " worse", "kind": "normal"}, "is_word": true, "word_id": 403, "word_key": " worse", "bytes_hex": "20 77 6f 72 73 65", "compression": {"rwkv": "7.89% 7.89% 7.89% 7.89% 7.89% 7.89%", "qwen": "6.50% 6.50% 6.50% 6.50% 6.50% 6.50%"}, "model_tokens": {"rwkv": [[40216, " worse", "normal", 0.07289236783981323]], "qwen": [[10960, " worse", "normal", 0.1149168461561203]]}, "loss": {"rwkv": 7.889738504861517, "qwen": 6.502787283355913}, "topk": {"rwkv": [40216, 2, 0.07289236783981323, [[4424, 0.361525, " at", false], [40216, 0.072892, " worse", false], [30788, 0.042083, " even", false], [31581, 0.033609, " only", false], [31277, 0.019172, " less", false], [22187, 0.016814, " not", false], [22614, 0.015445, " too", false], [62161, 0.014493, " irrelevant", false], [63631, 0.013707, " ineffective", false], [4706, 0.012132, " of", false]]], "qwen": [10960, 2, 0.1149168461561203, [[518, 0.291973, " at", false], [10960, 0.114917, " worse", false], [1496, 0.109925, " even", false], [1033, 0.072651, " were", false], [11, 0.019511, ",", false], [304, 0.019083, " in", false], [1172, 0.018328, " only", false], [4751, 0.0173, " rather", false], [1602, 0.008229, " very", false], [421, 0.007831, " if", false]]]}, "raw_delta": 0.07690890630086261, "tuned_delta": 0.08372118410796056}, {"byte_start": 2401, "byte_end": 2402, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "4.51%", "qwen": "5.24%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.7774559259414673]], "qwen": [[11, ",", "normal", 0.7480016350746155]]}, "loss": {"rwkv": 4.50842200277801, "qwen": 5.2360832858074735}, "topk": {"rwkv": [45, 1, 0.7774559259414673, [[45, 0.777456, ",", false], [47, 0.16873, ".", false], [32226, 0.012453, " than", false], [59, 0.006539, ":", false], [275, 0.004662, " (", false], [39820, 0.004233, " still", false], [4596, 0.003218, " in", false], [22797, 0.00198, " yet", false], [21700, 0.001824, " for", false], [32465, 0.0018, " when", false]]], "qwen": [11, 1, 0.7480016350746155, [[11, 0.748002, ",", false], [13, 0.156205, ".", false], [1091, 0.024821, " than", false], [25, 0.013021, ":", false], [2058, 0.011146, " still", false], [382, 0.007431, ".\n\n", false], [320, 0.006354, " (", false], [3602, 0.006277, " yet", false], [304, 0.002296, " in", false], [1496, 0.001828, " even", false]]]}, "raw_delta": -0.040350109338760376, "tuned_delta": -0.033537831531662426}, {"byte_start": 2402, "byte_end": 2407, "display": {"text": " once", "kind": "normal"}, "is_word": true, "word_id": 404, "word_key": " once", "bytes_hex": "20 6f 6e 63 65", "compression": {"rwkv": "10.76% 10.76% 10.76% 10.76% 10.76%", "qwen": "17.17% 17.17% 17.17% 17.17% 17.17%"}, "model_tokens": {"rwkv": [[31578, " once", "normal", 0.04994548484683037]], "qwen": [[3055, " once", "normal", 0.008549327030777931]]}, "loss": {"rwkv": 10.7638575316325, "qwen": 17.174933919864813}, "topk": {"rwkv": [31578, 5, 0.04994548484683037, [[32465, 0.464842, " when", false], [4596, 0.124651, " in", false], [4423, 0.11116, " as", false], [4811, 0.100846, " to", false], [31578, 0.049945, " once", false], [37634, 0.014293, " after", false], [51018, 0.013443, " because", false], [22590, 0.008948, " the", false], [21265, 0.005949, " and", false], [4424, 0.004697, " at", false]]], "qwen": [3055, 16, 0.008549327030777931, [[979, 0.130104, " when", false], [304, 0.094937, " in", false], [438, 0.081083, " as", false], [311, 0.047145, " to", false], [5546, 0.046519, " counter", false], [807, 0.035521, " they", false], [1033, 0.033083, " were", false], [1576, 0.0218, " because", false], [323, 0.018987, " and", false], [1283, 0.014799, " after", false]]]}, "raw_delta": -0.35550556182861326, "tuned_delta": -0.34869328402151534}, {"byte_start": 2407, "byte_end": 2414, "display": {"text": " search", "kind": "normal"}, "is_word": true, "word_id": 405, "word_key": " search", "bytes_hex": "20 73 65 61 72 63 68", "compression": {"rwkv": "6.96% 6.96% 6.96% 6.96% 6.96% 6.96% 6.96%", "qwen": "5.30% 5.30% 5.30% 5.30% 5.30% 5.30% 5.30%"}, "model_tokens": {"rwkv": [[47202, " search", "normal", 0.06547728925943375]], "qwen": [[2711, " search", "normal", 0.12801995873451233]]}, "loss": {"rwkv": 6.963901843576749, "qwen": 5.295641875914862}, "topk": {"rwkv": [47202, 4, 0.06547728925943375, [[22590, 0.255015, " the", false], [332, 0.106338, " a", false], [51832, 0.076013, " general", false], [47202, 0.065477, " search", false], [30597, 0.044719, " deep", false], [52195, 0.022847, " massive", false], [52224, 0.020584, " methods", false], [4601, 0.020541, " it", false], [63370, 0.018646, " computation", false], [59345, 0.01728, " computers", false]]], "qwen": [2711, 2, 0.12801995873451233, [[279, 0.272289, " the", false], [2711, 0.12802, " search", false], [264, 0.067083, " a", false], [5538, 0.042659, " deep", false], [64098, 0.025337, " brute", false], [5994, 0.021651, " Go", false], [6366, 0.020424, " computer", false], [432, 0.020042, " it", false], [10951, 0.016654, " massive", false], [803, 0.01515, " more", false]]]}, "raw_delta": 0.09250797544206894, "tuned_delta": 0.09932025324916689}, {"byte_start": 2414, "byte_end": 2418, "display": {"text": " was", "kind": "normal"}, "is_word": true, "word_id": 406, "word_key": " was", "bytes_hex": "20 77 61 73", "compression": {"rwkv": "8.10% 8.10% 8.10% 8.10%", "qwen": "9.35% 9.35% 9.35% 9.35%"}, "model_tokens": {"rwkv": [[22748, " was", "normal", 0.16714654862880707]], "qwen": [[572, " was", "normal", 0.12576831877231598]]}, "loss": {"rwkv": 8.101070786241737, "qwen": 9.347373162682981}, "topk": {"rwkv": [22748, 2, 0.16714654862880707, [[45283, 0.255168, " became", false], [22748, 0.167147, " was", false], [46, 0.126654, "-", false], [52224, 0.087446, " methods", false], [21795, 0.034653, " had", false], [61559, 0.016022, " algorithms", false], [51616, 0.015144, " engines", false], [21265, 0.013719, " and", false], [39339, 0.013039, " power", false], [32487, 0.012283, " with", false]]], "qwen": [572, 3, 0.12576831877231598, [[5980, 0.388347, "-based", false], [6116, 0.183554, " became", false], [572, 0.125768, " was", false], [5413, 0.037246, " methods", false], [1030, 0.026783, " had", false], [18651, 0.025728, " proved", false], [3118, 0.018455, " based", false], [3697, 0.013409, " came", false], [1410, 0.012272, " could", false], [6009, 0.009349, " began", false]]]}, "raw_delta": -0.06910967826843262, "tuned_delta": -0.06229740046133467}, {"byte_start": 2418, "byte_end": 2426, "display": {"text": " applied", "kind": "normal"}, "is_word": true, "word_id": 407, "word_key": " applied", "bytes_hex": "20 61 70 70 6c 69 65 64", "compression": {"rwkv": "6.13% 6.13% 6.13% 6.13% 6.13% 6.13% 6.13% 6.13%", "qwen": "8.78% 8.78% 8.78% 8.78% 8.78% 8.78% 8.78% 8.78%"}, "model_tokens": {"rwkv": [[50937, " applied", "normal", 0.06570269912481308]], "qwen": [[9251, " applied", "normal", 0.0203444492071867]]}, "loss": {"rwkv": 6.128636160026358, "qwen": 8.780032494450476}, "topk": {"rwkv": [50937, 3, 0.06570269912481308, [[59206, 0.122941, " available", false], [31351, 0.075744, " made", false], [50937, 0.065703, " applied", false], [59506, 0.034954, " developed", false], [51097, 0.031496, " brought", false], [51744, 0.031057, " finally", false], [32354, 0.026035, " used", false], [62151, 0.025351, " introduced", false], [22590, 0.022681, " the", false], [64583, 0.021482, " sufficiently", false]]], "qwen": [9251, 12, 0.0203444492071867, [[1865, 0.053315, " made", false], [2500, 0.049449, " available", false], [5499, 0.049129, " finally", false], [11523, 0.040386, " introduced", false], [7117, 0.037536, " brought", false], [1483, 0.036969, " used", false], [11537, 0.035659, " implemented", false], [5420, 0.032594, " allowed", false], [279, 0.023325, " the", false], [3694, 0.021444, " added", false]]]}, "raw_delta": -0.14702463150024414, "tuned_delta": -0.1402123536931462}, {"byte_start": 2426, "byte_end": 2438, "display": {"text": " effectively", "kind": "normal"}, "is_word": true, "word_id": 408, "word_key": " effectively", "bytes_hex": "20 65 66 66 65 63 74 69 76 65 6c 79", "compression": {"rwkv": "8.59% 8.59% 8.59% 8.59% 8.59% 8.59% 8.59% 8.59% 8.59% 8.59% 8.59% 8.59%", "qwen": "6.01% 6.01% 6.01% 6.01% 6.01% 6.01% 6.01% 6.01% 6.01% 6.01% 6.01% 6.01%"}, "model_tokens": {"rwkv": [[63507, " effectively", "normal", 0.003335079178214073]], "qwen": [[13444, " effectively", "normal", 0.018304264172911644]]}, "loss": {"rwkv": 8.594179442795582, "qwen": 6.012163059512656}, "topk": {"rwkv": [63507, 21, 0.003335079178214073, [[47, 0.48374, ".", false], [4811, 0.144696, " to", false], [4596, 0.080104, " in", false], [21265, 0.042234, " and", false], [45, 0.03566, ",", false], [4712, 0.02219, " on", false], [4517, 0.01732, " en", false], [32487, 0.017317, " with", false], [4424, 0.015479, " at", false], [4423, 0.014821, " as", false]]], "qwen": [13444, 9, 0.018304264172911644, [[13, 0.52186, ".", false], [311, 0.097049, " to", false], [382, 0.055723, ".\n\n", false], [304, 0.043837, " in", false], [518, 0.029843, " at", false], [11, 0.029381, ",", false], [448, 0.027847, " with", false], [389, 0.02059, " on", false], [13444, 0.018304, " effectively", false], [323, 0.014927, " and", false]]]}, "raw_delta": 0.14317739009857178, "tuned_delta": 0.14998966790566973}, {"byte_start": 2438, "byte_end": 2441, "display": {"text": " at", "kind": "normal"}, "is_word": true, "word_id": 409, "word_key": " at", "bytes_hex": "20 61 74", "compression": {"rwkv": "33.44% 33.44% 33.44%", "qwen": "30.17% 30.17% 30.17%"}, "model_tokens": {"rwkv": [[4424, " at", "normal", 0.003859272925183177]], "qwen": [[518, " at", "normal", 0.006613673642277718]]}, "loss": {"rwkv": 33.43746318727025, "qwen": 30.16805292972565}, "topk": {"rwkv": [4424, 12, 0.003859272925183177, [[47, 0.598356, ".", false], [4811, 0.201176, " to", false], [21265, 0.052364, " and", false], [45, 0.03967, ",", false], [4596, 0.027589, " in", false], [275, 0.012574, " (", false], [4450, 0.010319, " by", false], [32487, 0.008999, " with", false], [4712, 0.006969, " on", false], [40085, 0.005186, " using", false]]], "qwen": [518, 12, 0.006613673642277718, [[13, 0.617983, ".", false], [382, 0.087803, ".\n\n", false], [311, 0.062098, " to", false], [11, 0.055043, ",", false], [3322, 0.032495, " enough", false], [323, 0.030829, " and", false], [304, 0.020317, " in", false], [553, 0.012897, " by", false], [320, 0.010857, " (", false], [448, 0.010341, " with", false]]]}, "raw_delta": 0.181294600168864, "tuned_delta": 0.18810687797596196}, {"byte_start": 2441, "byte_end": 2447, "display": {"text": " scale", "kind": "normal"}, "is_word": true, "word_id": 410, "word_key": " scale", "bytes_hex": "20 73 63 61 6c 65", "compression": {"rwkv": "5.40% 5.40% 5.40% 5.40% 5.40% 5.40%", "qwen": "5.67% 5.67% 5.67% 5.67% 5.67% 5.67%"}, "model_tokens": {"rwkv": [[39590, " scale", "normal", 0.16738204658031464]], "qwen": [[5452, " scale", "normal", 0.151595801115036]]}, "loss": {"rwkv": 5.400713857494492, "qwen": 5.670204938641484}, "topk": {"rwkv": [39590, 3, 0.16738204658031464, [[332, 0.206805, " a", false], [22590, 0.205795, " the", false], [39590, 0.167382, " scale", false], [38864, 0.083838, " large", false], [21256, 0.032432, " all", false], [4419, 0.027146, " an", false], [52195, 0.025472, " massive", false], [3851, 0.01313, " Go", false], [38234, 0.012457, " depth", false], [62606, 0.011885, " sufficient", false]]], "qwen": [5452, 3, 0.151595801115036, [[279, 0.230702, " the", false], [264, 0.194575, " a", false], [5452, 0.151596, " scale", false], [678, 0.06696, " all", false], [458, 0.024789, " an", false], [3460, 0.013573, " large", false], [1602, 0.013524, " very", false], [1045, 0.01254, " some", false], [28405, 0.012332, " scales", false], [1550, 0.012189, " high", false]]]}, "raw_delta": -0.014943758646647098, "tuned_delta": -0.008131480839549152}, {"byte_start": 2447, "byte_end": 2448, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "3.36%", "qwen": "5.67%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.8297162652015686]], "qwen": [[13, ".", "normal", 0.7302824258804321]]}, "loss": {"rwkv": 3.363705478635156, "qwen": 5.668420260341593}, "topk": {"rwkv": [47, 1, 0.8297162652015686, [[47, 0.829716, ".", false], [45, 0.041606, ",", false], [4811, 0.034673, " to", false], [21265, 0.027353, " and", false], [275, 0.013739, " (", false], [4596, 0.008833, " in", false], [4450, 0.008193, " by", false], [32487, 0.006679, " with", false], [40085, 0.006471, " using", false], [4712, 0.002666, " on", false]]], "qwen": [13, 1, 0.7302824258804321, [[13, 0.730282, ".", false], [382, 0.108808, ".\n\n", false], [11, 0.040343, ",", false], [311, 0.02045, " to", false], [323, 0.018308, " and", false], [320, 0.016744, " (", false], [304, 0.008748, " in", false], [448, 0.007164, " with", false], [624, 0.006981, ".\n", false], [553, 0.006571, " by", false]]]}, "raw_delta": -0.12780052423477173, "tuned_delta": -0.12098824642767378}, {"byte_start": 2448, "byte_end": 2453, "display": {"text": " Also", "kind": "normal"}, "is_word": true, "word_id": 411, "word_key": " also", "bytes_hex": "20 41 6c 73 6f", "compression": {"rwkv": "27.50% 27.50% 27.50% 27.50% 27.50%", "qwen": "28.49% 28.49% 28.49% 28.49% 28.49%"}, "model_tokens": {"rwkv": [[28402, " Also", "normal", 0.0004957510973326862]], "qwen": [[7281, " Also", "normal", 0.0003707799769472331]]}, "loss": {"rwkv": 27.50137421694586, "qwen": 28.49287311726155}, "topk": {"rwkv": [28402, 115, 0.0004957510973326862, [[261, 0.284321, "\n\n", false], [20996, 0.121913, " The", false], [3913, 0.039884, " In", false], [267, 0.033589, "  ", false], [36251, 0.029964, " Again", false], [29894, 0.028876, " This", false], [3918, 0.026178, " It", false], [300, 0.019648, " A", false], [29511, 0.017638, " Once", false], [37451, 0.017028, " There", false]]], "qwen": [7281, 176, 0.0003707799769472331, [[576, 0.178201, " The", false], [758, 0.057772, " In", false], [1096, 0.054582, " This", false], [220, 0.050601, " ", false], [1084, 0.038084, " It", false], [13759, 0.030587, " Again", false], [4220, 0.022767, " These", false], [362, 0.022738, " A", false], [320, 0.020443, " (", false], [2619, 0.020139, " There", false]]]}, "raw_delta": -0.05498037338256845, "tuned_delta": -0.0481680955754705}, {"byte_start": 2453, "byte_end": 2463, "display": {"text": " important", "kind": "normal"}, "is_word": true, "word_id": 412, "word_key": " important", "bytes_hex": "20 69 6d 70 6f 72 74 61 6e 74", "compression": {"rwkv": "15.22% 15.22% 15.22% 15.22% 15.22% 15.22% 15.22% 15.22% 15.22% 15.22%", "qwen": "11.92% 11.92% 11.92% 11.92% 11.92% 11.92% 11.92% 11.92% 11.92% 11.92%"}, "model_tokens": {"rwkv": [[59829, " important", "normal", 0.00021100549201946706]], "qwen": [[2989, " important", "normal", 0.0013470856938511133]]}, "loss": {"rwkv": 15.215924259375784, "qwen": 11.919928350385316}, "topk": {"rwkv": [59829, 119, 0.00021100549201946706, [[45, 0.435759, ",", false], [4596, 0.189855, " in", false], [31296, 0.078448, " like", false], [4423, 0.047393, " as", false], [4424, 0.02891, " at", false], [51419, 0.012242, " delayed", false], [32487, 0.011343, " with", false], [332, 0.010452, " a", false], [52906, 0.010326, " similar", false], [31077, 0.008003, " here", false]]], "qwen": [2989, 33, 0.0013470856938511133, [[11, 0.518282, ",", false], [304, 0.154027, " in", false], [4428, 0.038448, " similar", false], [1075, 0.03246, " like", false], [518, 0.026148, " at", false], [1490, 0.014715, " see", false], [79330, 0.012672, " delaying", false], [22706, 0.011817, " delayed", false], [438, 0.011266, " as", false], [279, 0.006489, " the", false]]]}, "raw_delta": 0.1827688217163086, "tuned_delta": 0.18958109952340654}, {"byte_start": 2463, "byte_end": 2467, "display": {"text": " was", "kind": "normal"}, "is_word": true, "word_id": 413, "word_key": " was", "bytes_hex": "20 77 61 73", "compression": {"rwkv": "7.61% 7.61% 7.61% 7.61%", "qwen": "5.04% 5.04% 5.04% 5.04%"}, "model_tokens": {"rwkv": [[22748, " was", "normal", 0.18585625290870667]], "qwen": [[572, " was", "normal", 0.32709893584251404]]}, "loss": {"rwkv": 7.607962129687892, "qwen": 5.038128029989677}, "topk": {"rwkv": [22748, 2, 0.18585625290870667, [[4596, 0.245159, " in", false], [22748, 0.185856, " was", false], [31077, 0.125289, " here", false], [45, 0.111044, ",", false], [32462, 0.104618, " were", false], [4811, 0.078909, " to", false], [4600, 0.05465, " is", false], [21700, 0.020154, " for", false], [21286, 0.015729, " are", false], [21400, 0.008079, " but", false]]], "qwen": [572, 1, 0.32709893584251404, [[572, 0.327099, " was", false], [304, 0.145178, " in", false], [374, 0.132326, " is", false], [1588, 0.093775, " here", false], [311, 0.089232, " to", false], [11, 0.0642, ",", false], [1033, 0.047665, " were", false], [369, 0.025981, " for", false], [25, 0.022407, ":", false], [525, 0.013844, " are", false]]]}, "raw_delta": 0.1425018608570099, "tuned_delta": 0.14931413866410784}, {"byte_start": 2467, "byte_end": 2471, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 414, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "1.50% 1.50% 1.50% 1.50%", "qwen": "2.14% 2.14% 2.14% 2.14%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.7161668539047241]], "qwen": [[279, " the", "normal", 0.622162401676178]]}, "loss": {"rwkv": 1.4969369931098861, "qwen": 2.1394903772153064}, "topk": {"rwkv": [22590, 1, 0.7161668539047241, [[22590, 0.716167, " the", false], [32227, 0.080381, " that", false], [332, 0.070382, " a", false], [4419, 0.014833, " an", false], [21835, 0.006391, " how", false], [32499, 0.00588, " work", false], [57103, 0.005559, " research", false], [56950, 0.005399, " progress", false], [38720, 0.003923, " human", false], [50919, 0.003798, " another", false]]], "qwen": [279, 1, 0.622162401676178, [[279, 0.622162, " the", false], [429, 0.178184, " that", false], [264, 0.082814, " a", false], [458, 0.020369, " an", false], [1246, 0.009444, " how", false], [3738, 0.003298, " human", false], [3412, 0.00252, " research", false], [5994, 0.00251, " Go", false], [537, 0.002483, " not", false], [5098, 0.002443, " progress", false]]]}, "raw_delta": -0.0356307253241539, "tuned_delta": -0.028818447517055954}, {"byte_start": 2471, "byte_end": 2475, "display": {"text": " use", "kind": "normal"}, "is_word": true, "word_id": 415, "word_key": " use", "bytes_hex": "20 75 73 65", "compression": {"rwkv": "19.16% 19.16% 19.16% 19.16%", "qwen": "21.57% 21.57% 21.57% 21.57%"}, "model_tokens": {"rwkv": [[22681, " use", "normal", 0.014148341491818428]], "qwen": [[990, " use", "normal", 0.008351313881576061]]}, "loss": {"rwkv": 19.160793511806542, "qwen": 21.57431634225604}, "topk": {"rwkv": [22681, 8, 0.014148341491818428, [[30808, 0.093269, " fact", false], [59544, 0.03828, " discovery", false], [63820, 0.030931, " realization", false], [63469, 0.029487, " development", false], [51708, 0.018488, " failure", false], [63729, 0.017672, " observation", false], [31894, 0.014992, " role", false], [22681, 0.014148, " use", false], [63821, 0.014094, " recognition", false], [59612, 0.012787, " emergence", false]]], "qwen": [990, 13, 0.008351313881576061, [[2097, 0.131559, " fact", false], [48703, 0.073433, " realization", false], [4401, 0.028247, " development", false], [18335, 0.026365, " discovery", false], [7901, 0.019405, " failure", false], [7626, 0.018758, " delay", false], [17843, 0.017594, " recognition", false], [6853, 0.017374, " lack", false], [48079, 0.0142, " emergence", false], [21930, 0.011831, " observation", false]]]}, "raw_delta": -0.1338341236114502, "tuned_delta": -0.12702184580435225}, {"byte_start": 2475, "byte_end": 2478, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 416, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "0.28% 0.28% 0.28%", "qwen": "0.25% 0.25% 0.25%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.9550983905792236]], "qwen": [[315, " of", "normal", 0.9587425589561462]]}, "loss": {"rwkv": 0.27737361931153776, "qwen": 0.25326935505014186}, "topk": {"rwkv": [4706, 1, 0.9550983905792236, [[4706, 0.955098, " of", false], [45, 0.016241, ",", false], [4450, 0.009675, " by", false], [4596, 0.008323, " in", false], [275, 0.001415, " (", false], [4424, 0.000834, " at", false], [21265, 0.000721, " and", false], [31601, 0.000596, " over", false], [32227, 0.000428, " that", false], [21700, 0.00035, " for", false]]], "qwen": [315, 1, 0.9587425589561462, [[315, 0.958743, " of", false], [553, 0.015525, " by", false], [304, 0.007103, " in", false], [11, 0.006722, ",", false], [323, 0.001733, " and", false], [429, 0.001189, " that", false], [320, 0.001157, " (", false], [1865, 0.001034, " made", false], [311, 0.000661, " to", false], [518, 0.000401, " at", false]]]}, "raw_delta": 0.0013366242249806728, "tuned_delta": 0.00814890203207862}, {"byte_start": 2478, "byte_end": 2487, "display": {"text": " learning", "kind": "normal"}, "is_word": true, "word_id": 417, "word_key": " learning", "bytes_hex": "20 6c 65 61 72 6e 69 6e 67", "compression": {"rwkv": "12.15% 12.15% 12.15% 12.15% 12.15% 12.15% 12.15% 12.15% 12.15%", "qwen": "12.02% 12.02% 12.02% 12.02% 12.02% 12.02% 12.02% 12.02% 12.02%"}, "model_tokens": {"rwkv": [[56537, " learning", "normal", 0.002324591623619199]], "qwen": [[6832, " learning", "normal", 0.0024785639252513647]]}, "loss": {"rwkv": 12.147692618596306, "qwen": 12.022611547542127}, "topk": {"rwkv": [56537, 61, 0.002324591623619199, [[38720, 0.06341, " human", false], [332, 0.058996, " a", false], [22590, 0.047478, " the", false], [46658, 0.046913, " neural", false], [30597, 0.033679, " deep", false], [52195, 0.03095, " massive", false], [65003, 0.02225, " reinforcement", false], [52964, 0.019644, " special", false], [52167, 0.018353, " machine", false], [56812, 0.017183, " parallel", false]]], "qwen": [6832, 63, 0.0024785639252513647, [[264, 0.079057, " a", false], [3738, 0.068136, " human", false], [279, 0.0513, " the", false], [5538, 0.047295, " deep", false], [29728, 0.02188, " neural", false], [11773, 0.018944, " hardware", false], [45767, 0.017372, " Monte", false], [9902, 0.01727, " ``", false], [71278, 0.014542, " reinforcement", false], [1602, 0.013646, " very", false]]]}, "raw_delta": 0.006935967339409821, "tuned_delta": 0.013748245146507767}, {"byte_start": 2487, "byte_end": 2490, "display": {"text": " by", "kind": "normal"}, "is_word": true, "word_id": 418, "word_key": " by", "bytes_hex": "20 62 79", "compression": {"rwkv": "20.66% 20.66% 20.66%", "qwen": "23.24% 23.24% 23.24%"}, "model_tokens": {"rwkv": [[4450, " by", "normal", 0.031864289194345474]], "qwen": [[553, " by", "normal", 0.02092740871012211]]}, "loss": {"rwkv": 20.66360084606588, "qwen": 23.243592850229273}, "topk": {"rwkv": [4450, 7, 0.031864289194345474, [[4811, 0.16553, " to", false], [52224, 0.162983, " methods", false], [61559, 0.132333, " algorithms", false], [45, 0.092324, ",", false], [30917, 0.091484, " from", false], [46, 0.032638, "-", false], [4450, 0.031864, " by", false], [62633, 0.030699, " techniques", false], [4596, 0.021855, " in", false], [21265, 0.021578, " and", false]]], "qwen": [553, 11, 0.02092740871012211, [[311, 0.189302, " to", false], [5413, 0.157174, " methods", false], [11, 0.103816, ",", false], [5980, 0.077431, "-based", false], [25185, 0.067118, " algorithms", false], [12538, 0.049246, " techniques", false], [504, 0.0439, " from", false], [13, 0.031723, ".", false], [304, 0.028716, " in", false], [323, 0.027407, " and", false]]]}, "raw_delta": -0.14306513468424487, "tuned_delta": -0.13625285687714692}, {"byte_start": 2490, "byte_end": 2495, "display": {"text": " self", "kind": "normal"}, "is_word": true, "word_id": 419, "word_key": " self", "bytes_hex": "20 73 65 6c 66", "compression": {"rwkv": "16.34% 16.34% 16.34% 16.34% 16.34%", "qwen": "13.08% 13.08% 13.08% 13.08% 13.08%"}, "model_tokens": {"rwkv": [[31978, " self", "normal", 0.010636383667588234]], "qwen": [[656, " self", "normal", 0.026586027815937996]]}, "loss": {"rwkv": 16.343029760070287, "qwen": 13.082969625977602}, "topk": {"rwkv": [31978, 14, 0.010636383667588234, [[65003, 0.193422, " reinforcement", false], [59815, 0.173223, " imitation", false], [30597, 0.063102, " deep", false], [51668, 0.042929, " example", false], [46658, 0.03882, " neural", false], [38720, 0.038328, " human", false], [52491, 0.025811, " playing", false], [62557, 0.023464, " simulation", false], [30218, 0.022973, " back", false], [64886, 0.018826, " demonstration", false]]], "qwen": [656, 7, 0.026586027815937996, [[5619, 0.168756, " playing", false], [3738, 0.110576, " human", false], [12677, 0.065122, " humans", false], [71278, 0.053049, " reinforcement", false], [3110, 0.036931, " example", false], [9091, 0.028179, " trial", false], [656, 0.026586, " self", false], [86840, 0.024489, " imitation", false], [1486, 0.023211, " play", false], [55103, 0.018182, " analogy", false]]]}, "raw_delta": 0.18077611923217773, "tuned_delta": 0.18758839703927568}, {"byte_start": 2495, "byte_end": 2500, "display": {"text": " play", "kind": "normal"}, "is_word": true, "word_id": 420, "word_key": " play", "bytes_hex": "20 70 6c 61 79", "compression": {"rwkv": "11.50% 11.50% 11.50% 11.50% 11.50%", "qwen": "15.15% 15.15% 15.15% 15.15% 15.15%"}, "model_tokens": {"rwkv": [[31702, " play", "normal", 0.04085620120167732]], "qwen": [[1486, " play", "normal", 0.014976556412875652]]}, "loss": {"rwkv": 11.496476107083925, "qwen": 15.15287541956948}, "topk": {"rwkv": [31702, 2, 0.04085620120167732, [[46, 0.937133, "-", false], [31702, 0.040856, " play", false], [26697, 0.011494, "play", false], [52491, 0.001105, " playing", false], [57453, 0.001066, " training", false], [63621, 0.000686, " improvement", false], [61793, 0.000488, " correction", false], [21265, 0.000421, " and", false], [45, 0.000405, ",", false], [64886, 0.000376, " demonstration", false]]], "qwen": [1486, 3, 0.014976556412875652, [[26544, 0.943901, "-play", false], [1363, 0.017777, "play", false], [1486, 0.014977, " play", false], [12, 0.005114, "-", false], [72085, 0.003058, "-playing", false], [2371, 0.001586, "-g", false], [48793, 0.001382, "-te", false], [85370, 0.001343, "-training", false], [1331, 0.001274, "-s", false], [41912, 0.001197, "playing", false]]]}, "raw_delta": -0.20275382995605473, "tuned_delta": -0.19594155214895678}, {"byte_start": 2500, "byte_end": 2503, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 421, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "12.40% 12.40% 12.40%", "qwen": "12.75% 12.75% 12.75%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.12697963416576385]], "qwen": [[311, " to", "normal", 0.11986345052719116]]}, "loss": {"rwkv": 12.398160507639528, "qwen": 12.752235522858365}, "topk": {"rwkv": [4811, 3, 0.12697963416576385, [[45, 0.40076, ",", false], [47, 0.129217, ".", false], [4811, 0.12698, " to", false], [275, 0.04001, " (", false], [21265, 0.033526, " and", false], [4596, 0.029029, " in", false], [32487, 0.025965, " with", false], [4706, 0.019302, " of", false], [59, 0.017776, ":", false], [4712, 0.016864, " on", false]]], "qwen": [311, 3, 0.11986345052719116, [[11, 0.426174, ",", false], [13, 0.142018, ".", false], [311, 0.119863, " to", false], [304, 0.036712, " in", false], [320, 0.03566, " (", false], [382, 0.021482, ".\n\n", false], [323, 0.020301, " and", false], [4751, 0.017265, " rather", false], [25, 0.015469, ":", false], [429, 0.015155, " that", false]]]}, "raw_delta": -0.01963408788045251, "tuned_delta": -0.012821810073354565}, {"byte_start": 2503, "byte_end": 2509, "display": {"text": " learn", "kind": "normal"}, "is_word": true, "word_id": 422, "word_key": " learn", "bytes_hex": "20 6c 65 61 72 6e", "compression": {"rwkv": "11.08% 11.08% 11.08% 11.08% 11.08% 11.08%", "qwen": "11.45% 11.45% 11.45% 11.45% 11.45% 11.45%"}, "model_tokens": {"rwkv": [[38877, " learn", "normal", 0.02504769340157509]], "qwen": [[3960, " learn", "normal", 0.02213427983224392]]}, "loss": {"rwkv": 11.083204090162608, "qwen": 11.453278508072337}, "topk": {"rwkv": [38877, 5, 0.02504769340157509, [[51982, 0.159715, " improve", false], [30858, 0.028023, " find", false], [51456, 0.027747, " develop", false], [37786, 0.026026, " avoid", false], [38877, 0.025048, " learn", false], [40000, 0.024084, " train", false], [56010, 0.022765, " discover", false], [31358, 0.018329, " make", false], [37923, 0.017632, " build", false], [56305, 0.015293, " generate", false]]], "qwen": [3960, 9, 0.02213427983224392, [[7269, 0.099804, " improve", false], [1477, 0.056095, " find", false], [6923, 0.047802, " generate", false], [6997, 0.040892, " discover", false], [5426, 0.039814, " train", false], [2225, 0.038448, " develop", false], [8193, 0.032726, " produce", false], [1855, 0.023893, " create", false], [3960, 0.022134, " learn", false], [13186, 0.020129, " explore", false]]]}, "raw_delta": -0.02052128314971924, "tuned_delta": -0.013709005342621292}, {"byte_start": 2509, "byte_end": 2511, "display": {"text": " a", "kind": "normal"}, "is_word": true, "word_id": 423, "word_key": " a", "bytes_hex": "20 61", "compression": {"rwkv": "24.94% 24.94%", "qwen": "24.36% 24.36%"}, "model_tokens": {"rwkv": [[332, " a", "normal", 0.06329740583896637]], "qwen": [[264, " a", "normal", 0.06712794303894043]]}, "loss": {"rwkv": 24.93720920286587, "qwen": 24.355892794467625}, "topk": {"rwkv": [332, 4, 0.06329740583896637, [[22590, 0.128561, " the", false], [4811, 0.123152, " to", false], [30917, 0.120552, " from", false], [332, 0.063297, " a", false], [21835, 0.054218, " how", false], [47202, 0.030596, " search", false], [37598, 0.026336, " about", false], [32464, 0.017929, " what", false], [51832, 0.016342, " general", false], [22168, 0.014785, " new", false]]], "qwen": [264, 3, 0.06712794303894043, [[279, 0.236323, " the", false], [1246, 0.075652, " how", false], [264, 0.067128, " a", false], [504, 0.066064, " from", false], [311, 0.053305, " to", false], [3738, 0.026512, " human", false], [14830, 0.02373, " strategies", false], [1128, 0.020004, " what", false], [2664, 0.019458, " better", false], [1809, 0.017289, " game", false]]]}, "raw_delta": 0.032235026359558105, "tuned_delta": 0.039047304166656055}, {"byte_start": 2511, "byte_end": 2517, "display": {"text": " value", "kind": "normal"}, "is_word": true, "word_id": 424, "word_key": " value", "bytes_hex": "20 76 61 6c 75 65", "compression": {"rwkv": "16.91% 16.91% 16.91% 16.91% 16.91% 16.91%", "qwen": "17.96% 17.96% 17.96% 17.96% 17.96% 17.96%"}, "model_tokens": {"rwkv": [[40093, " value", "normal", 0.0036197355948388577]], "qwen": [[897, " value", "normal", 0.0025432310067117214]]}, "loss": {"rwkv": 16.90658251041754, "qwen": 17.95650363059357}, "topk": {"rwkv": [40093, 39, 0.0036197355948388577, [[46857, 0.068463, " policy", false], [51832, 0.067323, " general", false], [47202, 0.063696, " search", false], [30992, 0.043208, " good", false], [57317, 0.03972, " strategy", false], [65161, 0.037012, " representation", false], [30597, 0.03434, " deep", false], [39043, 0.030054, " model", false], [38864, 0.02873, " large", false], [3851, 0.026111, " Go", false]]], "qwen": [897, 50, 0.0025432310067117214, [[8282, 0.080409, " strategy", false], [1661, 0.051989, " good", false], [1809, 0.05055, " game", false], [4842, 0.049585, " policy", false], [10987, 0.045937, " winning", false], [3738, 0.035362, " human", false], [1602, 0.032474, " very", false], [2664, 0.032441, " better", false], [9902, 0.030276, " ``", false], [501, 0.028941, " new", false]]]}, "raw_delta": -0.05821998914082849, "tuned_delta": -0.05140771133373054}, {"byte_start": 2517, "byte_end": 2526, "display": {"text": " function", "kind": "normal"}, "is_word": true, "word_id": 425, "word_key": " function", "bytes_hex": "20 66 75 6e 63 74 69 6f 6e", "compression": {"rwkv": "0.84% 0.84% 0.84% 0.84% 0.84% 0.84% 0.84% 0.84% 0.84%", "qwen": "0.65% 0.65% 0.65% 0.65% 0.65% 0.65% 0.65% 0.65% 0.65%"}, "model_tokens": {"rwkv": [[56292, " function", "normal", 0.6558983325958252]], "qwen": [[729, " function", "normal", 0.7247667908668518]]}, "loss": {"rwkv": 0.8375020039882761, "qwen": 0.6450156173193224}, "topk": {"rwkv": [56292, 1, 0.6558983325958252, [[56292, 0.655898, " function", false], [21700, 0.063333, " for", false], [46, 0.056184, "-", false], [56149, 0.049829, " estimate", false], [4706, 0.02819, " of", false], [65161, 0.016347, " representation", false], [39043, 0.008729, " model", false], [61955, 0.008548, " estimation", false], [47487, 0.007287, " system", false], [56772, 0.006653, " ordering", false]]], "qwen": [729, 1, 0.7247667908668518, [[729, 0.724767, " function", false], [3922, 0.118357, " network", false], [5980, 0.032652, "-based", false], [33749, 0.022315, "-function", false], [16045, 0.013704, " estimate", false], [369, 0.00758, " for", false], [4179, 0.007473, " net", false], [315, 0.00721, " of", false], [16460, 0.006187, " evaluation", false], [13042, 0.004347, " representation", false]]]}, "raw_delta": 0.010673711697260543, "tuned_delta": 0.01748598950435849}, {"byte_start": 2526, "byte_end": 2528, "display": {"text": " (", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "20 28", "compression": {"rwkv": "35.22% 35.22%", "qwen": "27.56% 27.56%"}, "model_tokens": {"rwkv": [[275, " (", "normal", 0.020251084119081497]], "qwen": [[320, " (", "normal", 0.0470462329685688]]}, "loss": {"rwkv": 35.222046896703205, "qwen": 27.561105511417026}, "topk": {"rwkv": [275, 9, 0.020251084119081497, [[45, 0.192408, ",", false], [32227, 0.169469, " that", false], [21700, 0.15666, " for", false], [47, 0.092871, ".", false], [30917, 0.053528, " from", false], [21265, 0.046792, " and", false], [4706, 0.042186, " of", false], [4811, 0.040586, " to", false], [275, 0.020251, " (", false], [55536, 0.015493, " approxim", false]]], "qwen": [320, 6, 0.0470462329685688, [[11, 0.200767, ",", false], [429, 0.133146, " that", false], [369, 0.1235, " for", false], [13, 0.109011, ".", false], [323, 0.062236, " and", false], [320, 0.047046, " (", false], [311, 0.043689, " to", false], [504, 0.035917, " from", false], [3118, 0.021552, " based", false], [304, 0.018403, " in", false]]]}, "raw_delta": 0.42481279373168945, "tuned_delta": 0.4316250715387874}, {"byte_start": 2528, "byte_end": 2530, "display": {"text": "as", "kind": "normal"}, "is_word": true, "word_id": 426, "word_key": "as", "bytes_hex": "61 73", "compression": {"rwkv": "31.28% 31.28%", "qwen": "29.55% 29.55%"}, "model_tokens": {"rwkv": [[1751, "as", "normal", 0.030832067131996155]], "qwen": [[300, "as", "normal", 0.03771577402949333]]}, "loss": {"rwkv": 31.277177644272445, "qwen": 29.55430059337468}, "topk": {"rwkv": [1751, 7, 0.030832067131996155, [[36003, 0.08513, "which", false], [2101, 0.07078, "or", false], [98, 0.058089, "a", false], [8801, 0.054528, "the", false], [7005, 0.046894, "and", false], [7579, 0.030867, "for", false], [1751, 0.030832, "as", false], [1950, 0.024434, "in", false], [2215, 0.022009, "to", false], [42135, 0.019441, "rather", false]]], "qwen": [300, 6, 0.03771577402949333, [[1782, 0.097205, "the", false], [8206, 0.075568, "which", false], [64, 0.075485, "a", false], [437, 0.049882, "and", false], [269, 0.042432, "or", false], [300, 0.037716, "as", false], [4060, 0.029328, "see", false], [258, 0.028759, "in", false], [276, 0.027044, "an", false], [9033, 0.024652, "that", false]]]}, "raw_delta": 0.09553658962249756, "tuned_delta": 0.10234886742959551}, {"byte_start": 2530, "byte_end": 2533, "display": {"text": " it", "kind": "normal"}, "is_word": true, "word_id": 427, "word_key": " it", "bytes_hex": "20 69 74", "compression": {"rwkv": "30.24% 30.24% 30.24%", "qwen": "35.37% 35.37% 35.37%"}, "model_tokens": {"rwkv": [[4601, " it", "normal", 0.006504768040031195]], "qwen": [[432, " it", "normal", 0.0027835743967443705]]}, "loss": {"rwkv": 30.243997601969152, "qwen": 35.37018988577891}, "topk": {"rwkv": [4601, 18, 0.006504768040031195, [[4596, 0.284445, " in", false], [52369, 0.223791, " opposed", false], [22748, 0.045451, " was", false], [332, 0.038342, " a", false], [32458, 0.032788, " well", false], [32487, 0.023781, " with", false], [22590, 0.017041, " the", false], [21795, 0.015157, " had", false], [4600, 0.01505, " is", false], [4419, 0.013815, " an", false]]], "qwen": [432, 23, 0.0027835743967443705, [[16087, 0.457368, " opposed", false], [304, 0.130405, " in", false], [1632, 0.102626, " well", false], [264, 0.022272, " a", false], [7481, 0.02131, " described", false], [14078, 0.018769, " discussed", false], [12460, 0.018734, " distinct", false], [572, 0.013752, " was", false], [279, 0.009101, " the", false], [1483, 0.00864, " used", false]]]}, "raw_delta": -0.2842564582824707, "tuned_delta": -0.2774441804753728}, {"byte_start": 2533, "byte_end": 2537, "display": {"text": " was", "kind": "normal"}, "is_word": true, "word_id": 428, "word_key": " was", "bytes_hex": "20 77 61 73", "compression": {"rwkv": "6.45% 6.45% 6.45% 6.45%", "qwen": "8.25% 8.25% 8.25% 8.25%"}, "model_tokens": {"rwkv": [[22748, " was", "normal", 0.2405787855386734]], "qwen": [[572, " was", "normal", 0.16035059094429016]]}, "loss": {"rwkv": 6.4456345820966865, "qwen": 8.252182267530776}, "topk": {"rwkv": [22748, 1, 0.2405787855386734, [[22748, 0.240579, " was", false], [47638, 0.159741, " turned", false], [4600, 0.156558, " is", false], [32462, 0.136922, " were", false], [40040, 0.069461, " turns", false], [51896, 0.030068, " happens", false], [21795, 0.027726, " had", false], [40219, 0.018773, " would", false], [56348, 0.018326, " happened", false], [45283, 0.011525, " became", false]]], "qwen": [572, 2, 0.16035059094429016, [[374, 0.257658, " is", false], [572, 0.160351, " was", false], [10577, 0.100438, " turns", false], [6519, 0.080026, " turned", false], [1521, 0.034738, " did", false], [1035, 0.034517, " would", false], [1030, 0.034259, " had", false], [6116, 0.028161, " became", false], [1558, 0.026933, " does", false], [702, 0.023676, " has", false]]]}, "raw_delta": -0.10017627477645874, "tuned_delta": -0.09336399696936079}, {"byte_start": 2537, "byte_end": 2540, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 429, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "24.61% 24.61% 24.61%", "qwen": "21.74% 21.74% 21.74%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.016830896958708763]], "qwen": [[304, " in", "normal", 0.026875125244259834]]}, "loss": {"rwkv": 24.60847009849664, "qwen": 21.73993706822568}, "topk": {"rwkv": [4596, 9, 0.016830896958708763, [[45395, 0.298296, " called", false], [32230, 0.053093, " then", false], [38848, 0.043576, " known", false], [38869, 0.031222, " later", false], [30666, 0.026462, " done", false], [22187, 0.024272, " not", false], [62275, 0.023394, " originally", false], [62684, 0.021326, " understood", false], [4596, 0.016831, " in", false], [59868, 0.015557, " initially", false]]], "qwen": [304, 6, 0.026875125244259834, [[2598, 0.379656, " called", false], [2814, 0.082709, " done", false], [1221, 0.063428, " then", false], [3881, 0.049845, " known", false], [2937, 0.031391, " later", false], [304, 0.026875, " in", false], [537, 0.017914, " not", false], [60837, 0.016524, " termed", false], [9251, 0.013353, " applied", false], [1083, 0.01199, " also", false]]]}, "raw_delta": 0.15906524658203125, "tuned_delta": 0.1658775243891292}, {"byte_start": 2540, "byte_end": 2545, "display": {"text": " many", "kind": "normal"}, "is_word": true, "word_id": 430, "word_key": " many", "bytes_hex": "20 6d 61 6e 79", "compression": {"rwkv": "17.81% 17.81% 17.81% 17.81% 17.81%", "qwen": "16.15% 16.15% 16.15% 16.15% 16.15%"}, "model_tokens": {"rwkv": [[31370, " many", "normal", 0.007104665972292423]], "qwen": [[1657, " many", "normal", 0.011345302686095238]]}, "loss": {"rwkv": 17.808266910973142, "qwen": 16.154402628256975}, "topk": {"rwkv": [31370, 18, 0.007104665972292423, [[38013, 0.299711, " chess", false], [22590, 0.140037, " the", false], [3851, 0.104797, " Go", false], [36274, 0.048844, " Alpha", false], [55809, 0.041567, " computer", false], [38720, 0.024018, " human", false], [30322, 0.021796, " both", false], [3492, 0.0201, " 19", false], [3609, 0.01846, " AI", false], [38328, 0.016094, " early", false]]], "qwen": [1657, 11, 0.011345302686095238, [[279, 0.303091, " the", false], [32719, 0.109606, " chess", false], [24708, 0.061578, " Alpha", false], [6366, 0.041331, " computer", false], [5994, 0.040199, " Go", false], [18183, 0.035052, " Deep", false], [264, 0.019417, " a", false], [1182, 0.017414, " back", false], [220, 0.01583, " ", false], [1008, 0.012868, " other", false]]]}, "raw_delta": 0.09170970916748056, "tuned_delta": 0.09852198697457851}, {"byte_start": 2545, "byte_end": 2551, "display": {"text": " other", "kind": "normal"}, "is_word": true, "word_id": 431, "word_key": " other", "bytes_hex": "20 6f 74 68 65 72", "compression": {"rwkv": "3.66% 3.66% 3.66% 3.66% 3.66% 3.66%", "qwen": "4.74% 4.74% 4.74% 4.74% 4.74% 4.74%"}, "model_tokens": {"rwkv": [[39193, " other", "normal", 0.2974819839000702]], "qwen": [[1008, " other", "normal", 0.20644254982471466]]}, "loss": {"rwkv": 3.6630928772571334, "qwen": 4.742057925894811}, "topk": {"rwkv": [39193, 1, 0.2974819839000702, [[39193, 0.297482, " other", false], [51551, 0.116463, " earlier", false], [38328, 0.086185, " early", false], [4706, 0.081322, " of", false], [51515, 0.030483, " domains", false], [55809, 0.028327, " computer", false], [56926, 0.027895, " previous", false], [3609, 0.026703, " AI", false], [38013, 0.024086, " chess", false], [38576, 0.023456, " games", false]]], "qwen": [1008, 1, 0.20644254982471466, [[1008, 0.206443, " other", false], [315, 0.192479, " of", false], [6366, 0.066459, " computer", false], [32719, 0.054559, " chess", false], [5048, 0.036724, " cases", false], [3868, 0.02637, " games", false], [4124, 0.02322, " early", false], [6788, 0.016202, " earlier", false], [5510, 0.014827, " ways", false], [3738, 0.011991, " human", false]]]}, "raw_delta": -0.05983052651087445, "tuned_delta": -0.0530182487037765}, {"byte_start": 2551, "byte_end": 2557, "display": {"text": " games", "kind": "normal"}, "is_word": true, "word_id": 432, "word_key": " games", "bytes_hex": "20 67 61 6d 65 73", "compression": {"rwkv": "8.03% 8.03% 8.03% 8.03% 8.03% 8.03%", "qwen": "5.62% 5.62% 5.62% 5.62% 5.62% 5.62%"}, "model_tokens": {"rwkv": [[38576, " games", "normal", 0.06931746006011963]], "qwen": [[3868, " games", "normal", 0.15397393703460693]]}, "loss": {"rwkv": 8.030626692448331, "qwen": 5.62342064144615}, "topk": {"rwkv": [38576, 4, 0.06931746006011963, [[51515, 0.47534, " domains", false], [3609, 0.091183, " AI", false], [37738, 0.073494, " areas", false], [38576, 0.069317, " games", false], [37970, 0.042522, " cases", false], [45976, 0.031635, " fields", false], [38328, 0.018612, " early", false], [64251, 0.017461, " applications", false], [56939, 0.01601, " problems", false], [55809, 0.011394, " computer", false]]], "qwen": [3868, 2, 0.15397393703460693, [[30476, 0.331291, " domains", false], [3868, 0.153974, " games", false], [5671, 0.08402, " areas", false], [8357, 0.054478, " applications", false], [15235, 0.034859, " AI", false], [5322, 0.029711, " problems", false], [37597, 0.027073, " contexts", false], [5048, 0.021655, " cases", false], [1809, 0.017305, " game", false], [5043, 0.016215, " fields", false]]]}, "raw_delta": 0.1334838469823201, "tuned_delta": 0.14029612478941805}, {"byte_start": 2557, "byte_end": 2561, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 433, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"rwkv": "19.72% 19.72% 19.72% 19.72%", "qwen": "16.39% 16.39% 16.39% 16.39%"}, "model_tokens": {"rwkv": [[21265, " and", "normal", 0.012676974758505821]], "qwen": [[323, " and", "normal", 0.02634415403008461]]}, "loss": {"rwkv": 19.724346262153794, "qwen": 16.394916925835595}, "topk": {"rwkv": [21265, 7, 0.012676974758505821, [[42, 0.271526, ")", false], [497, 0.221315, "),", false], [499, 0.180222, ").", false], [45, 0.122376, ",", false], [4423, 0.053557, " as", false], [4424, 0.013465, " at", false], [21265, 0.012677, " and", false], [22614, 0.010353, " too", false], [4706, 0.00856, " of", false], [45285, 0.008439, " before", false]]], "qwen": [323, 5, 0.02634415403008461, [[8, 0.282654, ")", false], [568, 0.194803, ").", false], [701, 0.179022, "),", false], [11, 0.100799, ",", false], [323, 0.026344, " and", false], [438, 0.024904, " as", false], [3593, 0.021138, ").\n\n", false], [518, 0.017665, " at", false], [1573, 0.015239, " before", false], [315, 0.011811, " of", false]]]}, "raw_delta": 0.18462276458740234, "tuned_delta": 0.1914350423945003}, {"byte_start": 2561, "byte_end": 2566, "display": {"text": " even", "kind": "normal"}, "is_word": true, "word_id": 434, "word_key": " even", "bytes_hex": "20 65 76 65 6e", "compression": {"rwkv": "18.48% 18.48% 18.48% 18.48% 18.48%", "qwen": "16.42% 16.42% 16.42% 16.42% 16.42%"}, "model_tokens": {"rwkv": [[30788, " even", "normal", 0.006030562799423933]], "qwen": [[1496, " even", "normal", 0.010534564033150673]]}, "loss": {"rwkv": 18.48453021138984, "qwen": 16.42181501243054}, "topk": {"rwkv": [30788, 24, 0.006030562799423933, [[51515, 0.359119, " domains", false], [4596, 0.115759, " in", false], [64251, 0.04071, " applications", false], [4423, 0.040366, " as", false], [3609, 0.028642, " AI", false], [39193, 0.024711, " other", false], [4811, 0.022781, " to", false], [56939, 0.014021, " problems", false], [39898, 0.013162, " tasks", false], [31370, 0.01253, " many", false]]], "qwen": [1496, 16, 0.010534564033150673, [[30476, 0.274515, " domains", false], [8357, 0.089942, " applications", false], [304, 0.088429, " in", false], [1008, 0.036862, " other", false], [5322, 0.032097, " problems", false], [374, 0.028859, " is", false], [9079, 0.026332, " tasks", false], [21737, 0.025758, " environments", false], [537, 0.017821, " not", false], [11, 0.014259, ",", false]]]}, "raw_delta": 0.11438121795654288, "tuned_delta": 0.12119349576364083}, {"byte_start": 2566, "byte_end": 2569, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 435, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "4.72% 4.72% 4.72%", "qwen": "4.87% 4.87% 4.87%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.45314669609069824]], "qwen": [[304, " in", "normal", 0.44450274109840393]]}, "loss": {"rwkv": 4.719754284158229, "qwen": 4.873898751154672}, "topk": {"rwkv": [4596, 1, 0.45314669609069824, [[4596, 0.453147, " in", false], [38013, 0.055882, " chess", false], [31458, 0.041357, " more", false], [22184, 0.036255, " non", false], [32074, 0.029235, " some", false], [4423, 0.023727, " as", false], [4811, 0.020932, " to", false], [52391, 0.013062, " outside", false], [22190, 0.011704, " now", false], [51551, 0.01126, " earlier", false]]], "qwen": [304, 1, 0.44450274109840393, [[304, 0.444503, " in", false], [1045, 0.042425, " some", false], [32719, 0.033628, " chess", false], [1008, 0.0305, " other", false], [279, 0.02201, " the", false], [7797, 0.019831, " beyond", false], [2272, 0.019661, " life", false], [1657, 0.018959, " many", false], [803, 0.018664, " more", false], [11, 0.012248, ",", false]]]}, "raw_delta": -0.008547584215799986, "tuned_delta": -0.001735306408702039}, {"byte_start": 2569, "byte_end": 2575, "display": {"text": " chess", "kind": "normal"}, "is_word": true, "word_id": 436, "word_key": " chess", "bytes_hex": "20 63 68 65 73 73", "compression": {"rwkv": "4.72% 4.72% 4.72% 4.72% 4.72% 4.72%", "qwen": "4.06% 4.06% 4.06% 4.06% 4.06% 4.06%"}, "model_tokens": {"rwkv": [[38013, " chess", "normal", 0.20656141638755798]], "qwen": [[32719, " chess", "normal", 0.25881946086883545]]}, "loss": {"rwkv": 4.719754284158229, "qwen": 4.062462389958204}, "topk": {"rwkv": [38013, 1, 0.20656141638755798, [[38013, 0.206561, " chess", false], [3851, 0.104223, " Go", false], [22590, 0.072431, " the", false], [55809, 0.05877, " computer", false], [32074, 0.047467, " some", false], [31370, 0.028405, " many", false], [38328, 0.021958, " early", false], [36274, 0.019265, " Alpha", false], [38720, 0.018338, " human", false], [52299, 0.017236, " natural", false]]], "qwen": [32719, 1, 0.25881946086883545, [[32719, 0.258819, " chess", false], [279, 0.13382, " the", false], [1045, 0.055217, " some", false], [1008, 0.039027, " other", false], [1931, 0.031313, " real", false], [3738, 0.031129, " human", false], [6366, 0.029792, " computer", false], [1657, 0.025833, " many", false], [5810, 0.024103, " natural", false], [5994, 0.0238, " Go", false]]]}, "raw_delta": 0.036448001861572266, "tuned_delta": 0.043260279668670215}, {"byte_start": 2575, "byte_end": 2576, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "43.11%", "qwen": "48.06%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.0918067917227745]], "qwen": [[11, ",", "normal", 0.06960668414831161]]}, "loss": {"rwkv": 43.111785401564724, "qwen": 48.05787745339095}, "topk": {"rwkv": [45, 4, 0.0918067917227745, [[499, 0.290132, ").", false], [42, 0.22561, ")", false], [497, 0.212234, "),", false], [45, 0.091807, ",", false], [45285, 0.052567, " before", false], [4596, 0.013898, " in", false], [4424, 0.012886, " at", false], [39356, 0.010602, " prior", false], [21265, 0.006284, " and", false], [502, 0.005503, ");", false]]], "qwen": [11, 4, 0.06960668414831161, [[8, 0.311405, ")", false], [568, 0.216466, ").", false], [701, 0.159245, "),", false], [11, 0.069607, ",", false], [323, 0.032871, " and", false], [3593, 0.028469, ").\n\n", false], [304, 0.021751, " in", false], [518, 0.018202, " at", false], [1573, 0.014773, " before", false], [1215, 0.011096, ");", false]]]}, "raw_delta": -0.27426958084106445, "tuned_delta": -0.26745730303396653}, {"byte_start": 2576, "byte_end": 2585, "display": {"text": " although", "kind": "normal"}, "is_word": true, "word_id": 437, "word_key": " although", "bytes_hex": "20 61 6c 74 68 6f 75 67 68", "compression": {"rwkv": "7.39% 7.39% 7.39% 7.39% 7.39% 7.39% 7.39% 7.39% 7.39%", "qwen": "6.11% 6.11% 6.11% 6.11% 6.11% 6.11% 6.11% 6.11% 6.11%"}, "model_tokens": {"rwkv": [[55495, " although", "normal", 0.02519947476685047]], "qwen": [[7892, " although", "normal", 0.04747393727302551]]}, "loss": {"rwkv": 7.388802726775073, "qwen": 6.106556454033087}, "topk": {"rwkv": [55495, 8, 0.02519947476685047, [[21400, 0.201324, " but", false], [40185, 0.123417, " where", false], [45285, 0.055266, " before", false], [47544, 0.051468, " though", false], [21265, 0.033969, " and", false], [4423, 0.030103, " as", false], [22449, 0.025926, " see", false], [55495, 0.025199, " although", false], [22590, 0.023365, " the", false], [40186, 0.02147, " which", false]]], "qwen": [7892, 4, 0.04747393727302551, [[714, 0.253728, " but", false], [1380, 0.079006, " where", false], [3498, 0.063448, " though", false], [7892, 0.047474, " although", false], [1490, 0.044499, " see", false], [438, 0.039695, " as", false], [323, 0.024683, " and", false], [892, 0.022883, " which", false], [304, 0.021609, " in", false], [1573, 0.019246, " before", false]]]}, "raw_delta": 0.07110283109876842, "tuned_delta": 0.07791510890586636}, {"byte_start": 2585, "byte_end": 2594, "display": {"text": " learning", "kind": "normal"}, "is_word": true, "word_id": 438, "word_key": " learning", "bytes_hex": "20 6c 65 61 72 6e 69 6e 67", "compression": {"rwkv": "10.58% 10.58% 10.58% 10.58% 10.58% 10.58% 10.58% 10.58% 10.58%", "qwen": "10.41% 10.41% 10.41% 10.41% 10.41% 10.41% 10.41% 10.41% 10.41%"}, "model_tokens": {"rwkv": [[56537, " learning", "normal", 0.005138338077813387]], "qwen": [[6832, " learning", "normal", 0.005532432813197374]]}, "loss": {"rwkv": 10.582268312076161, "qwen": 10.413708115965523}, "topk": {"rwkv": [56537, 22, 0.005138338077813387, [[22590, 0.150062, " the", false], [4596, 0.132582, " in", false], [32227, 0.096653, " that", false], [39934, 0.075048, " there", false], [4601, 0.066337, " it", false], [22187, 0.056777, " not", false], [32234, 0.05526, " this", false], [38013, 0.023386, " chess", false], [31277, 0.017923, " less", false], [31077, 0.017427, " here", false]]], "qwen": [6832, 25, 0.005532432813197374, [[537, 0.222352, " not", false], [279, 0.082857, " the", false], [432, 0.069599, " it", false], [419, 0.059519, " this", false], [304, 0.058971, " in", false], [1052, 0.040108, " there", false], [429, 0.036923, " that", false], [5994, 0.033935, " Go", false], [1588, 0.025159, " here", false], [311, 0.020415, " to", false]]]}, "raw_delta": 0.009346961975097656, "tuned_delta": 0.016159239782195602}, {"byte_start": 2594, "byte_end": 2598, "display": {"text": " did", "kind": "normal"}, "is_word": true, "word_id": 439, "word_key": " did", "bytes_hex": "20 64 69 64", "compression": {"rwkv": "27.90% 27.90% 27.90% 27.90%", "qwen": "20.85% 20.85% 20.85% 20.85%"}, "model_tokens": {"rwkv": [[21532, " did", "normal", 0.0020397547632455826]], "qwen": [[1521, " did", "normal", 0.009800087660551071]]}, "loss": {"rwkv": 27.895861142188938, "qwen": 20.8530920473809}, "topk": {"rwkv": [21532, 31, 0.0020397547632455826, [[4450, 0.419899, " by", false], [332, 0.13661, " a", false], [22590, 0.064871, " the", false], [4706, 0.062829, " of", false], [22748, 0.054654, " was", false], [4596, 0.032786, " in", false], [4811, 0.030225, " to", false], [30917, 0.023718, " from", false], [46, 0.016733, "-", false], [4600, 0.012892, " is", false]]], "qwen": [1521, 14, 0.009800087660551071, [[553, 0.234046, " by", false], [572, 0.159847, " was", false], [304, 0.06377, " in", false], [264, 0.042462, " a", false], [374, 0.030726, " is", false], [897, 0.029572, " value", false], [279, 0.025313, " the", false], [311, 0.023479, " to", false], [504, 0.020341, " from", false], [5413, 0.018399, " methods", false]]]}, "raw_delta": 0.39053404331207275, "tuned_delta": 0.3973463211191707}, {"byte_start": 2598, "byte_end": 2602, "display": {"text": " not", "kind": "normal"}, "is_word": true, "word_id": 440, "word_key": " not", "bytes_hex": "20 6e 6f 74", "compression": {"rwkv": "0.24% 0.24% 0.24% 0.24%", "qwen": "0.24% 0.24% 0.24% 0.24%"}, "model_tokens": {"rwkv": [[22187, " not", "normal", 0.9479790925979614]], "qwen": [[537, " not", "normal", 0.9479894638061523]]}, "loss": {"rwkv": 0.24215157241483454, "qwen": 0.2408033560754438}, "topk": {"rwkv": [22187, 1, 0.9479790925979614, [[22187, 0.947979, " not", false], [32187, 0.003753, " take", false], [39166, 0.003515, " occur", false], [31702, 0.003486, " play", false], [31466, 0.002277, " much", false], [31458, 0.002172, " more", false], [46159, 0.001978, " happen", false], [61959, 0.001423, " eventually", false], [31967, 0.001331, " seem", false], [31059, 0.001055, " have", false]]], "qwen": [537, 1, 0.9479894638061523, [[537, 0.947989, " not", false], [1486, 0.011866, " play", false], [1896, 0.003933, " take", false], [12170, 0.002203, " occur", false], [614, 0.002135, " have", false], [12118, 0.002025, " prove", false], [1172, 0.001618, " only", false], [2803, 0.001143, " seem", false], [1492, 0.000945, " help", false], [2632, 0.000863, " little", false]]]}, "raw_delta": 7.476098835468292e-05, "tuned_delta": 0.00688703879545263}, {"byte_start": 2602, "byte_end": 2607, "display": {"text": " play", "kind": "normal"}, "is_word": true, "word_id": 441, "word_key": " play", "bytes_hex": "20 70 6c 61 79", "compression": {"rwkv": "9.02% 9.02% 9.02% 9.02% 9.02%", "qwen": "5.06% 5.06% 5.06% 5.06% 5.06%"}, "model_tokens": {"rwkv": [[31702, " play", "normal", 0.08282151073217392]], "qwen": [[1486, " play", "normal", 0.2457631230354309]]}, "loss": {"rwkv": 9.01684400555602, "qwen": 5.061649344724086}, "topk": {"rwkv": [31702, 1, 0.08282151073217392, [[31702, 0.082822, " play", false], [31967, 0.05776, " seem", false], [32499, 0.031889, " work", false], [39166, 0.031046, " occur", false], [39801, 0.030305, " start", false], [45185, 0.02916, " appear", false], [56041, 0.026607, " dominate", false], [22770, 0.025776, " win", false], [39374, 0.025428, " prove", false], [46159, 0.024204, " happen", false]]], "qwen": [1486, 1, 0.2457631230354309, [[1486, 0.245763, " play", false], [12118, 0.057356, " prove", false], [2803, 0.044004, " seem", false], [4994, 0.038472, " appear", false], [3635, 0.03657, " become", false], [975, 0.027108, " work", false], [1492, 0.026829, " help", false], [12170, 0.026608, " occur", false], [2525, 0.023338, " come", false], [3602, 0.022493, " yet", false]]]}, "raw_delta": 0.2193225622177124, "tuned_delta": 0.22613484002481035}, {"byte_start": 2607, "byte_end": 2609, "display": {"text": " a", "kind": "normal"}, "is_word": true, "word_id": 442, "word_key": " a", "bytes_hex": "20 61", "compression": {"rwkv": "8.56% 8.56%", "qwen": "4.35% 4.35%"}, "model_tokens": {"rwkv": [[332, " a", "normal", 0.3866051435470581]], "qwen": [[264, " a", "normal", 0.6170863509178162]]}, "loss": {"rwkv": 8.55895739589888, "qwen": 4.3528478404219735}, "topk": {"rwkv": [332, 1, 0.3866051435470581, [[332, 0.386605, " a", false], [4423, 0.2204, " as", false], [22590, 0.11476, " the", false], [32139, 0.097871, " such", false], [32227, 0.034147, " that", false], [4419, 0.030808, " an", false], [31466, 0.027967, " much", false], [21273, 0.015072, " any", false], [32234, 0.011435, " this", false], [46647, 0.010533, " nearly", false]]], "qwen": [264, 1, 0.6170863509178162, [[264, 0.617086, " a", false], [438, 0.147431, " as", false], [1741, 0.048873, " such", false], [458, 0.047076, " an", false], [279, 0.029216, " the", false], [1753, 0.021222, " much", false], [894, 0.016069, " any", false], [7009, 0.013102, " nearly", false], [5008, 0.007137, " quite", false], [1052, 0.007039, " there", false]]]}, "raw_delta": 0.23323623836040497, "tuned_delta": 0.24004851616750292}, {"byte_start": 2609, "byte_end": 2613, "display": {"text": " big", "kind": "normal"}, "is_word": true, "word_id": 443, "word_key": " big", "bytes_hex": "20 62 69 67", "compression": {"rwkv": "17.26% 17.26% 17.26% 17.26%", "qwen": "13.34% 13.34% 13.34% 13.34%"}, "model_tokens": {"rwkv": [[21357, " big", "normal", 0.021967004984617233]], "qwen": [[2409, " big", "normal", 0.05184754729270935]]}, "loss": {"rwkv": 17.25880297938457, "qwen": 13.342438776442753}, "topk": {"rwkv": [21357, 10, 0.021967004984617233, [[31894, 0.37702, " role", false], [51156, 0.082353, " central", false], [38961, 0.070037, " major", false], [38864, 0.056885, " large", false], [60273, 0.05073, " prominent", false], [63870, 0.035862, " significant", false], [31633, 0.0308, " part", false], [45752, 0.030461, " direct", false], [56040, 0.027518, " dominant", false], [21357, 0.021967, " big", false]]], "qwen": [2409, 5, 0.05184754729270935, [[3476, 0.349896, " role", false], [3598, 0.160371, " major", false], [3460, 0.089409, " large", false], [5089, 0.068478, " significant", false], [2409, 0.051848, " big", false], [8622, 0.050104, " central", false], [20469, 0.038747, " prominent", false], [949, 0.029593, " part", false], [2118, 0.012775, " direct", false], [1376, 0.012518, " key", false]]]}, "raw_delta": 0.21716934442520142, "tuned_delta": 0.22398162223229937}, {"byte_start": 2613, "byte_end": 2618, "display": {"text": " role", "kind": "normal"}, "is_word": true, "word_id": 444, "word_key": " role", "bytes_hex": "20 72 6f 6c 65", "compression": {"rwkv": "0.57% 0.57% 0.57% 0.57% 0.57%", "qwen": "0.51% 0.51% 0.51% 0.51% 0.51%"}, "model_tokens": {"rwkv": [[31894, " role", "normal", 0.8537411093711853]], "qwen": [[3476, " role", "normal", 0.867730975151062]]}, "loss": {"rwkv": 0.5705971597265919, "qwen": 0.5117005723024768}, "topk": {"rwkv": [31894, 1, 0.8537411093711853, [[31894, 0.853741, " role", false], [31633, 0.107772, " part", false], [45865, 0.018715, " enough", false], [52013, 0.006781, " initial", false], [45752, 0.001893, " direct", false], [45, 0.00159, ",", false], [39568, 0.000699, " rôle", false], [4715, 0.000686, " or", false], [31895, 0.000566, " roll", false], [45950, 0.000527, " factor", false]]], "qwen": [3476, 1, 0.867730975151062, [[3476, 0.867731, " role", false], [949, 0.121771, " part", false], [8168, 0.002727, " factor", false], [3322, 0.002314, " enough", false], [6502, 0.000408, " roll", false], [11, 0.000291, ",", false], [1809, 0.00026, " game", false], [2118, 0.00023, " direct", false], [14976, 0.000209, " practical", false], [2456, 0.000182, " effect", false]]]}, "raw_delta": 0.0032659202814102166, "tuned_delta": 0.010078198088508163}, {"byte_start": 2618, "byte_end": 2621, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 445, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "3.08% 3.08% 3.08%", "qwen": "2.27% 2.27% 2.27%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.5968453884124756]], "qwen": [[304, " in", "normal", 0.6852281093597412]]}, "loss": {"rwkv": 3.07605876231208, "qwen": 2.272265417609112}, "topk": {"rwkv": [4596, 1, 0.5968453884124756, [[4596, 0.596845, " in", false], [39934, 0.13499, " there", false], [499, 0.071073, ").", false], [4424, 0.032096, " at", false], [40076, 0.0296, " until", false], [59868, 0.02121, " initially", false], [31077, 0.01401, " here", false], [497, 0.011811, "),", false], [42, 0.011347, ")", false], [21700, 0.009482, " for", false]]], "qwen": [304, 1, 0.6852281093597412, [[304, 0.685228, " in", false], [1052, 0.096012, " there", false], [3080, 0.035162, " until", false], [568, 0.034877, ").", false], [518, 0.027178, " at", false], [369, 0.01464, " for", false], [8, 0.013315, ")", false], [15102, 0.011603, " initially", false], [1221, 0.007446, " then", false], [1588, 0.007177, " here", false]]]}, "raw_delta": 0.04457176725069681, "tuned_delta": 0.05138404505779476}, {"byte_start": 2621, "byte_end": 2625, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 446, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "5.81% 5.81% 5.81% 5.81%", "qwen": "7.64% 7.64% 7.64% 7.64%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.27635613083839417]], "qwen": [[279, " the", "normal", 0.18346962332725525]]}, "loss": {"rwkv": 5.811637737956029, "qwen": 7.644958822563186}, "topk": {"rwkv": [22590, 1, 0.27635613083839417, [[22590, 0.276356, " the", false], [38013, 0.186664, " chess", false], [3851, 0.141275, " Go", false], [55809, 0.042918, " computer", false], [32227, 0.041054, " that", false], [38328, 0.021854, " early", false], [39944, 0.018366, " those", false], [53354, 0.016722, " winning", false], [47202, 0.014932, " search", false], [45833, 0.013246, " either", false]]], "qwen": [279, 2, 0.18346962332725525, [[32719, 0.341252, " chess", false], [279, 0.18347, " the", false], [5994, 0.154985, " Go", false], [6366, 0.07453, " computer", false], [1846, 0.02422, " those", false], [429, 0.018696, " that", false], [4124, 0.010531, " early", false], [1181, 0.010355, " its", false], [419, 0.010157, " this", false], [1493, 0.009928, " these", false]]]}, "raw_delta": -0.10166090726852417, "tuned_delta": -0.09484862946142622}, {"byte_start": 2625, "byte_end": 2628, "display": {"text": " 19", "kind": "normal"}, "is_word": true, "word_id": 447, "word_key": " 19", "bytes_hex": "20 31 39", "compression": {"rwkv": "23.76% 23.76% 23.76%", "qwen": "46.90% 1.40% 0.09%"}, "model_tokens": {"rwkv": [[3492, " 19", "normal", 0.019095398485660553]], "qwen": [[220, " ", "normal", 0.07424170523881912], [16, "1", "normal", 0.925460696220398], [24, "9", "normal", 0.9950696229934692]]}, "loss": {"rwkv": 23.763140972975762, "qwen": 16.127139440185175}, "topk": {"rwkv": [3492, 11, 0.019095398485660553, [[47202, 0.092734, " search", false], [38328, 0.091065, " early", false], [3851, 0.071562, " Go", false], [52013, 0.057884, " initial", false], [38013, 0.054114, " chess", false], [38720, 0.04199, " human", false], [38491, 0.038013, " final", false], [38499, 0.032156, " first", false], [51551, 0.03105, " earlier", false], [38869, 0.023193, " later", false]]], "qwen": [220, 3, 0.07424170523881912, [[4124, 0.121692, " early", false], [32719, 0.103933, " chess", false], [220, 0.074242, " ", false], [6366, 0.056794, " computer", false], [2856, 0.037899, " initial", false], [2711, 0.036277, " search", false], [6788, 0.032006, " earlier", false], [3738, 0.031073, " human", false], [4401, 0.030849, " development", false], [5994, 0.026553, " Go", false]]]}, "raw_delta": 0.4234298346564173, "tuned_delta": 0.43024211246351524}, {"byte_start": 2628, "byte_end": 2630, "display": {"text": "97", "kind": "normal"}, "is_word": true, "word_id": 448, "word_key": "97", "bytes_hex": "39 37", "compression": {"rwkv": "1.81% 1.81%", "qwen": "0.56% 2.55%"}, "model_tokens": {"rwkv": [[717, "97", "normal", 0.8187543153762817]], "qwen": [[24, "9", "normal", 0.969538152217865], [22, "7", "normal", 0.8682795763015747]]}, "loss": {"rwkv": 1.8051299034560393, "qwen": 1.5524927134108706}, "topk": {"rwkv": [717, 1, 0.8187543153762817, [[717, 0.818754, "97", false], [710, 0.105615, "90", false], [716, 0.03082, "96", false], [700, 0.009371, "80", false], [690, 0.005107, "70", false], [719, 0.004684, "99", false], [709, 0.004559, "89", false], [715, 0.00418, "95", false], [670, 0.002988, "50", false], [718, 0.001945, "98", false]]], "qwen": [24, 1, 0.969538152217865, [[24, 0.969538, "9", false], [23, 0.017938, "8", false], [22, 0.009043, "7", false], [21, 0.001301, "6", false], [20, 0.00081, "5", false], [19, 0.00038, "4", false], [339, 0.000238, "th", false], [17, 0.000152, "2", false], [15, 0.000122, "0", false], [18, 8.3e-05, "3", false]]]}, "raw_delta": 0.01400918047875166, "tuned_delta": 0.020821458285849605}, {"byte_start": 2630, "byte_end": 2638, "display": {"text": " program", "kind": "normal"}, "is_word": true, "word_id": 449, "word_key": " program", "bytes_hex": "20 70 72 6f 67 72 61 6d", "compression": {"rwkv": "10.36% 10.36% 10.36% 10.36% 10.36% 10.36% 10.36% 10.36%", "qwen": "11.39% 11.39% 11.39% 11.39% 11.39% 11.39% 11.39% 11.39%"}, "model_tokens": {"rwkv": [[52580, " program", "normal", 0.010331242345273495]], "qwen": [[2025, " program", "normal", 0.00640413723886013]]}, "loss": {"rwkv": 10.355281787630743, "qwen": 11.385594377528088}, "topk": {"rwkv": [52580, 18, 0.010331242345273495, [[53283, 0.127796, " victory", false], [38013, 0.072205, " chess", false], [45685, 0.067679, " defeat", false], [20184, 0.065319, " Kas", false], [30941, 0.060685, " game", false], [38981, 0.050484, " match", false], [46, 0.044195, "-", false], [21265, 0.042775, " and", false], [40213, 0.035676, " world", false], [47202, 0.034965, " search", false]]], "qwen": [2025, 18, 0.00640413723886013, [[32719, 0.263852, " chess", false], [6366, 0.208496, " computer", false], [5994, 0.076176, " Go", false], [1879, 0.036089, " world", false], [12560, 0.034823, " victory", false], [37542, 0.027709, " Kas", false], [12, 0.023072, "-", false], [1142, 0.01972, " case", false], [1809, 0.017739, " game", false], [47387, 0.012744, " Chess", false]]]}, "raw_delta": -0.05713266134262085, "tuned_delta": -0.0503203835355229}, {"byte_start": 2638, "byte_end": 2643, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 450, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"rwkv": "12.62% 12.62% 12.62% 12.62% 12.62%", "qwen": "10.15% 10.15% 10.15% 10.15% 10.15%"}, "model_tokens": {"rwkv": [[32227, " that", "normal", 0.030196361243724823]], "qwen": [[429, " that", "normal", 0.06002192944288254]]}, "loss": {"rwkv": 12.623581607778428, "qwen": 10.145916127863138}, "topk": {"rwkv": [32227, 5, 0.030196361243724823, [[499, 0.68005, ").", false], [497, 0.076714, "),", false], [42, 0.056869, ")", false], [45, 0.039525, ",", false], [32227, 0.030196, " that", false], [21700, 0.019714, " for", false], [580, 0.014835, ".)", false], [21265, 0.013987, " and", false], [4706, 0.006928, " of", false], [460, 0.004782, "'s", false]]], "qwen": [429, 5, 0.06002192944288254, [[568, 0.498181, ").", false], [8, 0.109327, ")", false], [3593, 0.094091, ").\n\n", false], [701, 0.070225, "),", false], [429, 0.060022, " that", false], [11, 0.027611, ",", false], [369, 0.026642, " for", false], [304, 0.00916, " in", false], [2348, 0.007056, " against", false], [594, 0.006991, "'s", false]]]}, "raw_delta": 0.13739094734191892, "tuned_delta": 0.14420322514901687}, {"byte_start": 2643, "byte_end": 2649, "display": {"text": " first", "kind": "normal"}, "is_word": true, "word_id": 451, "word_key": " first", "bytes_hex": "20 66 69 72 73 74", "compression": {"rwkv": "14.93% 14.93% 14.93% 14.93% 14.93% 14.93%", "qwen": "17.83% 17.83% 17.83% 17.83% 17.83% 17.83%"}, "model_tokens": {"rwkv": [[38499, " first", "normal", 0.006960505619645119]], "qwen": [[1156, " first", "normal", 0.002655275631695986]]}, "loss": {"rwkv": 14.934147884202158, "qwen": 17.82692186911223}, "topk": {"rwkv": [38499, 9, 0.006960505619645119, [[22777, 0.3962, " won", false], [55934, 0.274493, " defeated", false], [30256, 0.098416, " beat", false], [22748, 0.018753, " was", false], [51744, 0.016322, " finally", false], [61959, 0.011651, " eventually", false], [62676, 0.010748, " ultimately", false], [21994, 0.007149, " led", false], [38499, 0.006961, " first", false], [32272, 0.004787, " took", false]]], "qwen": [1156, 15, 0.002655275631695986, [[23283, 0.532717, " defeated", false], [9382, 0.188874, " beat", false], [2765, 0.122936, " won", false], [572, 0.010686, " was", false], [6342, 0.009291, " played", false], [3867, 0.008745, " took", false], [3937, 0.007337, " went", false], [29701, 0.006301, " dominated", false], [9583, 0.005843, " eventually", false], [18651, 0.003529, " proved", false]]]}, "raw_delta": -0.16040945053100586, "tuned_delta": -0.1535971727239079}, {"byte_start": 2649, "byte_end": 2654, "display": {"text": " beat", "kind": "normal"}, "is_word": true, "word_id": 452, "word_key": " beat", "bytes_hex": "20 62 65 61 74", "compression": {"rwkv": "5.66% 5.66% 5.66% 5.66% 5.66%", "qwen": "6.08% 6.08% 6.08% 6.08% 6.08%"}, "model_tokens": {"rwkv": [[30256, " beat", "normal", 0.20898061990737915]], "qwen": [[9382, " beat", "normal", 0.18517979979515076]]}, "loss": {"rwkv": 5.663705140989876, "qwen": 6.082503533758917}, "topk": {"rwkv": [30256, 3, 0.20898061990737915, [[55934, 0.27568, " defeated", false], [22777, 0.238748, " won", false], [30256, 0.208981, " beat", false], [31351, 0.012254, " made", false], [55437, 0.011515, " achieved", false], [32272, 0.008793, " took", false], [32354, 0.007975, " used", false], [37915, 0.005528, " broke", false], [51097, 0.00548, " brought", false], [52086, 0.005336, " knocked", false]]], "qwen": [9382, 2, 0.18517979979515076, [[23283, 0.474552, " defeated", false], [9382, 0.18518, " beat", false], [2765, 0.039459, " won", false], [18651, 0.020258, " proved", false], [16994, 0.015913, " achieved", false], [3867, 0.015192, " took", false], [1483, 0.013701, " used", false], [3937, 0.013551, " went", false], [20459, 0.011575, " demonstrated", false], [6342, 0.010672, " played", false]]]}, "raw_delta": -0.02322311401367183, "tuned_delta": -0.016410836206573885}, {"byte_start": 2654, "byte_end": 2656, "display": {"text": " a", "kind": "normal"}, "is_word": true, "word_id": 453, "word_key": " a", "bytes_hex": "20 61", "compression": {"rwkv": "33.11% 33.11%", "qwen": "42.06% 42.06%"}, "model_tokens": {"rwkv": [[332, " a", "normal", 0.025930684059858322]], "qwen": [[264, " a", "normal", 0.009427649900317192]]}, "loss": {"rwkv": 33.10872408290101, "qwen": 42.0555367530257}, "topk": {"rwkv": [332, 3, 0.025930684059858322, [[20184, 0.770983, " Kas", false], [22590, 0.137464, " the", false], [332, 0.025931, " a", false], [40213, 0.013964, " world", false], [38720, 0.012315, " human", false], [19948, 0.004679, " Gar", false], [38013, 0.003716, " chess", false], [46227, 0.002137, " humans", false], [38621, 0.001837, " grand", false], [28951, 0.001511, " Gary", false]]], "qwen": [264, 3, 0.009427649900317192, [[37542, 0.890068, " Kas", false], [279, 0.062893, " the", false], [264, 0.009428, " a", false], [730, 0.005613, " K", false], [3738, 0.005219, " human", false], [1879, 0.003376, " world", false], [32719, 0.002167, " chess", false], [220, 0.001656, " ", false], [5994, 0.000883, " Go", false], [12677, 0.000816, " humans", false]]]}, "raw_delta": -0.49611663818359375, "tuned_delta": -0.48930436037649583}, {"byte_start": 2656, "byte_end": 2662, "display": {"text": " world", "kind": "normal"}, "is_word": true, "word_id": 454, "word_key": " world", "bytes_hex": "20 77 6f 72 6c 64", "compression": {"rwkv": "2.84% 2.84% 2.84% 2.84% 2.84% 2.84%", "qwen": "3.36% 3.36% 3.36% 3.36% 3.36% 3.36%"}, "model_tokens": {"rwkv": [[40213, " world", "normal", 0.3840406537055969]], "qwen": [[1879, " world", "normal", 0.3270755708217621]]}, "loss": {"rwkv": 2.8412451163340586, "qwen": 3.358966998306696}, "topk": {"rwkv": [40213, 1, 0.3840406537055969, [[40213, 0.384041, " world", false], [38720, 0.288065, " human", false], [38621, 0.125906, " grand", false], [22615, 0.062042, " top", false], [38013, 0.049048, " chess", false], [64532, 0.013017, " professional", false], [55716, 0.012454, " champion", false], [47436, 0.005971, " strong", false], [36747, 0.005925, " Grand", false], [39471, 0.00578, " reign", false]]], "qwen": [1879, 2, 0.3270755708217621, [[3738, 0.441339, " human", false], [1879, 0.327076, " world", false], [6662, 0.093183, " grand", false], [1909, 0.017116, " top", false], [6584, 0.016489, " professional", false], [32719, 0.01559, " chess", false], [89956, 0.012008, " reigning", false], [18319, 0.010819, " champion", false], [10304, 0.008297, " Grand", false], [2781, 0.005426, " player", false]]]}, "raw_delta": -0.0287085970242818, "tuned_delta": -0.021896319217183855}, {"byte_start": 2662, "byte_end": 2671, "display": {"text": " champion", "kind": "normal"}, "is_word": true, "word_id": 455, "word_key": " champion", "bytes_hex": "20 63 68 61 6d 70 69 6f 6e", "compression": {"rwkv": "0.59% 0.59% 0.59% 0.59% 0.59% 0.59% 0.59% 0.59% 0.59%", "qwen": "0.33% 0.33% 0.33% 0.33% 0.33% 0.33% 0.33% 0.33% 0.33%"}, "model_tokens": {"rwkv": [[55716, " champion", "normal", 0.7439901232719421]], "qwen": [[18319, " champion", "normal", 0.8487852215766907]]}, "loss": {"rwkv": 0.5909476757113536, "qwen": 0.32851188423501704}, "topk": {"rwkv": [55716, 1, 0.7439901232719421, [[55716, 0.74399, " champion", false], [38013, 0.127326, " chess", false], [46, 0.08072, "-", false], [37996, 0.011937, " champ", false], [38621, 0.010059, " grand", false], [64275, 0.008178, " championship", false], [46526, 0.003189, " master", false], [38720, 0.002906, " human", false], [38046, 0.001844, " class", false], [46841, 0.001195, " player", false]]], "qwen": [18319, 1, 0.8487852215766907, [[18319, 0.848785, " champion", false], [32719, 0.050926, " chess", false], [14800, 0.030213, "-class", false], [11582, 0.019481, "-ch", false], [6662, 0.008552, " grand", false], [34541, 0.0065, " champ", false], [21553, 0.006274, " championship", false], [536, 0.004128, " class", false], [2781, 0.003682, " player", false], [5994, 0.002991, " Go", false]]]}, "raw_delta": 0.014552530315187245, "tuned_delta": 0.02136480812228519}, {"byte_start": 2671, "byte_end": 2673, "display": {"text": ").", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "29 2e", "compression": {"rwkv": "2.92% 2.92%", "qwen": "5.28% 5.28%"}, "model_tokens": {"rwkv": [[499, ").", "normal", 0.7201230525970459]], "qwen": [[568, ").", "normal", 0.5565124750137329]]}, "loss": {"rwkv": 2.923429892426366, "qwen": 5.284463080386749}, "topk": {"rwkv": [499, 1, 0.7201230525970459, [[499, 0.720123, ").", false], [497, 0.055362, "),", false], [42, 0.04632, ")", false], [45, 0.043449, ",", false], [580, 0.031807, ".)", false], [4596, 0.022608, " in", false], [47, 0.016536, ".", false], [4424, 0.016234, " at", false], [21265, 0.005871, " and", false], [4450, 0.005418, " by", false]]], "qwen": [568, 1, 0.5565124750137329, [[568, 0.556512, ").", false], [3593, 0.125492, ").\n\n", false], [8, 0.088581, ")", false], [304, 0.068221, " in", false], [701, 0.046289, "),", false], [11, 0.028162, ",", false], [6138, 0.011887, ".)", false], [518, 0.010606, " at", false], [553, 0.006713, " by", false], [448, 0.004133, " with", false]]]}, "raw_delta": -0.13092347979545593, "tuned_delta": -0.12411120198835798}, {"byte_start": 2673, "byte_end": 2682, "display": {"text": " Learning", "kind": "normal"}, "is_word": true, "word_id": 456, "word_key": " learning", "bytes_hex": "20 4c 65 61 72 6e 69 6e 67", "compression": {"rwkv": "8.70% 8.70% 8.70% 8.70% 8.70% 8.70% 8.70% 8.70% 8.70%", "qwen": "7.34% 7.34% 7.34% 7.34% 7.34% 7.34% 7.34% 7.34% 7.34%"}, "model_tokens": {"rwkv": [[55122, " Learning", "normal", 0.013044266030192375]], "qwen": [[20909, " Learning", "normal", 0.025673646479845047]]}, "loss": {"rwkv": 8.703759144251991, "qwen": 7.338289033568737}, "topk": {"rwkv": [55122, 13, 0.013044266030192375, [[261, 0.283579, "\n\n", false], [20996, 0.105477, " The", false], [267, 0.060301, "  ", false], [29894, 0.047339, " This", false], [3913, 0.043343, " In", false], [19555, 0.039792, " But", false], [3918, 0.020962, " It", false], [36251, 0.020049, " Again", false], [37453, 0.017464, " These", false], [300, 0.015887, " A", false]]], "qwen": [20909, 6, 0.025673646479845047, [[1096, 0.131989, " This", false], [576, 0.113991, " The", false], [220, 0.064805, " ", false], [758, 0.056152, " In", false], [1084, 0.032568, " It", false], [20909, 0.025674, " Learning", false], [10115, 0.025323, " Self", false], [4220, 0.022711, " These", false], [362, 0.018038, " A", false], [3197, 0.017117, " When", false]]]}, "raw_delta": 0.075717740588718, "tuned_delta": 0.08253001839581595}, {"byte_start": 2682, "byte_end": 2685, "display": {"text": " by", "kind": "normal"}, "is_word": true, "word_id": 457, "word_key": " by", "bytes_hex": "20 62 79", "compression": {"rwkv": "7.37% 7.37% 7.37%", "qwen": "7.34% 7.34% 7.34%"}, "model_tokens": {"rwkv": [[4450, " by", "normal", 0.293800950050354]], "qwen": [[553, " by", "normal", 0.2946818768978119]]}, "loss": {"rwkv": 7.373148483709871, "qwen": 7.344873819313647}, "topk": {"rwkv": [4450, 1, 0.293800950050354, [[4450, 0.293801, " by", false], [22748, 0.083885, " was", false], [4600, 0.076733, " is", false], [332, 0.050877, " a", false], [30917, 0.045053, " from", false], [4811, 0.033694, " to", false], [4706, 0.032845, " of", false], [22590, 0.02896, " the", false], [45, 0.023587, ",", false], [21800, 0.018826, " has", false]]], "qwen": [553, 1, 0.2946818768978119, [[553, 0.294682, " by", false], [572, 0.101215, " was", false], [374, 0.06683, " is", false], [702, 0.032769, " has", false], [11, 0.026648, ",", false], [304, 0.022976, " in", false], [1030, 0.01806, " had", false], [5980, 0.016686, "-based", false], [646, 0.016298, " can", false], [5413, 0.015814, " methods", false]]]}, "raw_delta": 0.0015678803126017438, "tuned_delta": 0.00838015811969969}, {"byte_start": 2685, "byte_end": 2690, "display": {"text": " self", "kind": "normal"}, "is_word": true, "word_id": 458, "word_key": " self", "bytes_hex": "20 73 65 6c 66", "compression": {"rwkv": "0.64% 0.64% 0.64% 0.64% 0.64%", "qwen": "0.08% 0.08% 0.08% 0.08% 0.08%"}, "model_tokens": {"rwkv": [[31978, " self", "normal", 0.8368369340896606]], "qwen": [[656, " self", "normal", 0.9773311018943787]]}, "loss": {"rwkv": 0.6445634582096686, "qwen": 0.08270163994208604}, "topk": {"rwkv": [31978, 1, 0.8368369340896606, [[31978, 0.836837, " self", false], [38720, 0.020539, " human", false], [47202, 0.012204, " search", false], [65003, 0.009923, " reinforcement", false], [46342, 0.008327, " itself", false], [40093, 0.008069, " value", false], [52491, 0.007429, " playing", false], [59815, 0.006075, " imitation", false], [31702, 0.005053, " play", false], [47112, 0.003228, " reward", false]]], "qwen": [656, 1, 0.9773311018943787, [[656, 0.977331, " self", false], [5086, 0.004029, " itself", false], [5619, 0.001925, " playing", false], [71278, 0.001007, " reinforcement", false], [3738, 0.000895, " human", false], [1486, 0.000809, " play", false], [11504, 0.000486, " repeated", false], [4862, 0.00044, " training", false], [10115, 0.000352, " Self", false], [2711, 0.000339, " search", false]]]}, "raw_delta": 0.031156234815716742, "tuned_delta": 0.03796851262281469}, {"byte_start": 2690, "byte_end": 2695, "display": {"text": " play", "kind": "normal"}, "is_word": true, "word_id": 459, "word_key": " play", "bytes_hex": "20 70 6c 61 79", "compression": {"rwkv": "1.01% 1.01% 1.01% 1.01% 1.01%", "qwen": "0.63% 0.63% 0.63% 0.63% 0.63%"}, "model_tokens": {"rwkv": [[31702, " play", "normal", 0.7555635571479797]], "qwen": [[1486, " play", "normal", 0.8401477932929993]]}, "loss": {"rwkv": 1.0073505412457118, "qwen": 0.6282122614234654}, "topk": {"rwkv": [31702, 1, 0.7555635571479797, [[31702, 0.755564, " play", false], [46, 0.240181, "-", false], [26697, 0.001259, "play", false], [52491, 0.00032, " playing", false], [4715, 0.000187, " or", false], [39301, 0.000187, " plays", false], [47077, 0.00015, " replay", false], [11, 0.000107, "\n", false], [261, 7.9e-05, "\n\n", false], [275, 6.9e-05, " (", false]]], "qwen": [1486, 1, 0.8401477932929993, [[1486, 0.840148, " play", false], [26544, 0.153109, "-play", false], [1363, 0.002449, "play", false], [5619, 0.00096, " playing", false], [12, 0.000871, "-", false], [6342, 0.000397, " played", false], [11088, 0.00036, " plays", false], [72085, 0.000153, "-playing", false], [2268, 0.000136, "-p", false], [481, 0.000131, " -", false]]]}, "raw_delta": 0.02102389037609101, "tuned_delta": 0.027836168183188955}, {"byte_start": 2695, "byte_end": 2696, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "51.00%", "qwen": "51.11%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.05967998132109642]], "qwen": [[11, ",", "normal", 0.058770012110471725]]}, "loss": {"rwkv": 51.00152390642624, "qwen": 51.10970099381895}, "topk": {"rwkv": [45, 3, 0.05967998132109642, [[4600, 0.263185, " is", false], [22748, 0.181255, " was", false], [45, 0.05968, ",", false], [21800, 0.043465, " has", false], [46936, 0.025547, " proved", false], [21795, 0.018503, " had", false], [4596, 0.015808, " in", false], [30135, 0.015738, " also", false], [21413, 0.015332, " can", false], [21265, 0.014251, " and", false]]], "qwen": [11, 3, 0.058770012110471725, [[374, 0.186056, " is", false], [572, 0.16232, " was", false], [11, 0.05877, ",", false], [702, 0.054755, " has", false], [18651, 0.041368, " proved", false], [646, 0.024019, " can", false], [1558, 0.022965, " does", false], [1030, 0.018434, " had", false], [1521, 0.016502, " did", false], [1083, 0.015467, " also", false]]]}, "raw_delta": -0.0059986114501953125, "tuned_delta": 0.0008136663569026344}, {"byte_start": 2696, "byte_end": 2700, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 460, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"rwkv": "11.34% 11.34% 11.34% 11.34%", "qwen": "11.83% 11.83% 11.83% 11.83%"}, "model_tokens": {"rwkv": [[21265, " and", "normal", 0.08123543113470078]], "qwen": [[323, " and", "normal", 0.07252924889326096]]}, "loss": {"rwkv": 11.341499100738432, "qwen": 11.82904196875373}, "topk": {"rwkv": [21265, 2, 0.08123543113470078, [[4715, 0.101554, " or", false], [21265, 0.081235, " and", false], [51948, 0.073095, " however", false], [4596, 0.066226, " in", false], [40186, 0.057564, " which", false], [4423, 0.042135, " as", false], [4450, 0.029119, " by", false], [32487, 0.023596, " with", false], [55780, 0.018712, " combined", false], [332, 0.017656, " a", false]]], "qwen": [323, 3, 0.07252924889326096, [[892, 0.120817, " which", false], [4764, 0.08481, " however", false], [323, 0.072529, " and", false], [304, 0.052395, " in", false], [476, 0.047287, " or", false], [438, 0.041698, " as", false], [1075, 0.030872, " like", false], [10856, 0.029464, " combined", false], [979, 0.023073, " when", false], [264, 0.018457, " a", false]]]}, "raw_delta": -0.027035117149353027, "tuned_delta": -0.02022283934225508}, {"byte_start": 2700, "byte_end": 2709, "display": {"text": " learning", "kind": "normal"}, "is_word": true, "word_id": 461, "word_key": " learning", "bytes_hex": "20 6c 65 61 72 6e 69 6e 67", "compression": {"rwkv": "6.23% 6.23% 6.23% 6.23% 6.23% 6.23% 6.23% 6.23% 6.23%", "qwen": "5.58% 5.58% 5.58% 5.58% 5.58% 5.58% 5.58% 5.58% 5.58%"}, "model_tokens": {"rwkv": [[56537, " learning", "normal", 0.04473163187503815]], "qwen": [[6832, " learning", "normal", 0.061622485518455505]]}, "loss": {"rwkv": 6.2303887399501665, "qwen": 5.583887801632613}, "topk": {"rwkv": [56537, 5, 0.04473163187503815, [[22590, 0.13659, " the", false], [4450, 0.083722, " by", false], [32230, 0.053184, " then", false], [47202, 0.045796, " search", false], [56537, 0.044732, " learning", false], [4596, 0.03619, " in", false], [21902, 0.033856, " its", false], [39193, 0.027043, " other", false], [40085, 0.023495, " using", false], [61953, 0.023127, " especially", false]]], "qwen": [6832, 2, 0.061622485518455505, [[279, 0.169488, " the", false], [6832, 0.061622, " learning", false], [1181, 0.055484, " its", false], [304, 0.049826, " in", false], [5310, 0.043404, " especially", false], [1008, 0.036733, " other", false], [2937, 0.02753, " later", false], [1221, 0.024226, " then", false], [553, 0.023626, " by", false], [71278, 0.023571, " reinforcement", false]]]}, "raw_delta": 0.03584962420993382, "tuned_delta": 0.042661902017031766}, {"byte_start": 2709, "byte_end": 2712, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 462, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "21.60% 21.60% 21.60%", "qwen": "9.63% 9.63% 9.63%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.02753668650984764]], "qwen": [[304, " in", "normal", 0.20149588584899902]]}, "loss": {"rwkv": 21.602855429977968, "qwen": 9.62990697811478}, "topk": {"rwkv": [4596, 7, 0.02753668650984764, [[4450, 0.459161, " by", false], [30917, 0.103562, " from", false], [4811, 0.087803, " to", false], [332, 0.037618, " a", false], [32487, 0.029148, " with", false], [22590, 0.027632, " the", false], [4596, 0.027537, " in", false], [4706, 0.027104, " of", false], [22705, 0.011425, " via", false], [53140, 0.01096, " through", false]]], "qwen": [304, 2, 0.20149588584899902, [[553, 0.460229, " by", false], [304, 0.201496, " in", false], [504, 0.032372, " from", false], [803, 0.028194, " more", false], [311, 0.026235, " to", false], [8789, 0.022546, " generally", false], [315, 0.015536, " of", false], [448, 0.015369, " with", false], [5086, 0.011464, " itself", false], [518, 0.009877, " at", false]]]}, "raw_delta": 0.6639212369918824, "tuned_delta": 0.6707335147989804}, {"byte_start": 2712, "byte_end": 2720, "display": {"text": " general", "kind": "normal"}, "is_word": true, "word_id": 463, "word_key": " general", "bytes_hex": "20 67 65 6e 65 72 61 6c", "compression": {"rwkv": "2.10% 2.10% 2.10% 2.10% 2.10% 2.10% 2.10% 2.10%", "qwen": "0.29% 0.29% 0.29% 0.29% 0.29% 0.29% 0.29% 0.29%"}, "model_tokens": {"rwkv": [[51832, " general", "normal", 0.39190810918807983]], "qwen": [[4586, " general", "normal", 0.8802781701087952]]}, "loss": {"rwkv": 2.1045173020780163, "qwen": 0.2874509964834224}, "topk": {"rwkv": [51832, 1, 0.39190810918807983, [[51832, 0.391908, " general", false], [22590, 0.112262, " the", false], [332, 0.076912, " a", false], [39193, 0.03269, " other", false], [38576, 0.021365, " games", false], [38864, 0.018913, " large", false], [62293, 0.018781, " particular", false], [56812, 0.015577, " parallel", false], [47202, 0.015063, " search", false], [4419, 0.014244, " an", false]]], "qwen": [4586, 1, 0.8802781701087952, [[4586, 0.880278, " general", false], [1008, 0.024624, " other", false], [803, 0.015842, " more", false], [279, 0.009629, " the", false], [3953, 0.009389, " particular", false], [264, 0.006392, " a", false], [1657, 0.005726, " many", false], [3868, 0.004921, " games", false], [894, 0.003346, " any", false], [71278, 0.001897, " reinforcement", false]]]}, "raw_delta": 0.10075955092906952, "tuned_delta": 0.10757182873616747}, {"byte_start": 2720, "byte_end": 2721, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "1.11%", "qwen": "0.88%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.940605640411377]], "qwen": [[11, ",", "normal", 0.9525086283683777]]}, "loss": {"rwkv": 1.105091721384063, "qwen": 0.8774496399791492}, "topk": {"rwkv": [45, 1, 0.940605640411377, [[45, 0.940606, ",", false], [275, 0.009129, " (", false], [4450, 0.005688, " by", false], [30917, 0.004829, " from", false], [4596, 0.004026, " in", false], [21286, 0.003584, " are", false], [4600, 0.002199, " is", false], [4423, 0.002197, " as", false], [32462, 0.002052, " were", false], [21700, 0.00204, " for", false]]], "qwen": [11, 1, 0.9525086283683777, [[11, 0.952509, ",", false], [320, 0.011165, " (", false], [438, 0.003895, " as", false], [572, 0.002728, " was", false], [304, 0.002635, " in", false], [553, 0.002413, " by", false], [369, 0.001557, " for", false], [504, 0.001391, " from", false], [374, 0.001263, " is", false], [323, 0.001132, " and", false]]]}, "raw_delta": 0.012623157352209091, "tuned_delta": 0.019435435159307037}, {"byte_start": 2721, "byte_end": 2724, "display": {"text": " is", "kind": "normal"}, "is_word": true, "word_id": 464, "word_key": " is", "bytes_hex": "20 69 73", "compression": {"rwkv": "8.97% 8.97% 8.97%", "qwen": "9.93% 9.93% 9.93%"}, "model_tokens": {"rwkv": [[4600, " is", "normal", 0.22548101842403412]], "qwen": [[374, " is", "normal", 0.19180235266685486]]}, "loss": {"rwkv": 8.969881276360416, "qwen": 9.926281813969146}, "topk": {"rwkv": [4600, 1, 0.22548101842403412, [[4600, 0.225481, " is", false], [22748, 0.148431, " was", false], [21286, 0.099869, " are", false], [21800, 0.078144, " has", false], [32462, 0.060378, " were", false], [46936, 0.030666, " proved", false], [31059, 0.027814, " have", false], [21795, 0.02609, " had", false], [45283, 0.016617, " became", false], [47638, 0.016055, " turned", false]]], "qwen": [374, 2, 0.19180235266685486, [[572, 0.203406, " was", false], [374, 0.191802, " is", false], [702, 0.08035, " has", false], [525, 0.051294, " are", false], [1033, 0.048801, " were", false], [18651, 0.029424, " proved", false], [614, 0.022187, " have", false], [1030, 0.021144, " had", false], [6116, 0.019618, " became", false], [646, 0.014353, " can", false]]]}, "raw_delta": -0.05303410689036053, "tuned_delta": -0.04622182908326258}, {"byte_start": 2724, "byte_end": 2729, "display": {"text": " like", "kind": "normal"}, "is_word": true, "word_id": 465, "word_key": " like", "bytes_hex": "20 6c 69 6b 65", "compression": {"rwkv": "28.85% 28.85% 28.85% 28.85% 28.85%", "qwen": "27.71% 27.71% 27.71% 27.71% 27.71%"}, "model_tokens": {"rwkv": [[31296, " like", "normal", 0.0003263710532337427]], "qwen": [[1075, " like", "normal", 0.0004606365109793842]]}, "loss": {"rwkv": 28.853900817779266, "qwen": 27.710209310235552}, "topk": {"rwkv": [31296, 200, 0.0003263710532337427, [[332, 0.270096, " a", false], [22187, 0.068322, " not", false], [22590, 0.066306, " the", false], [4419, 0.0577, " an", false], [31466, 0.032521, " much", false], [22226, 0.028438, " one", false], [31458, 0.023716, " more", false], [39171, 0.020318, " often", false], [50919, 0.019868, " another", false], [22190, 0.017068, " now", false]]], "qwen": [1075, 154, 0.0004606365109793842, [[264, 0.256609, " a", false], [537, 0.086539, " not", false], [279, 0.061306, " the", false], [458, 0.054938, " an", false], [825, 0.03098, " one", false], [1431, 0.028723, " now", false], [2441, 0.01771, " another", false], [1602, 0.014805, " very", false], [3118, 0.01421, " based", false], [3545, 0.013818, " often", false]]]}, "raw_delta": 0.06341972351074232, "tuned_delta": 0.07023200131784027}, {"byte_start": 2729, "byte_end": 2736, "display": {"text": " search", "kind": "normal"}, "is_word": true, "word_id": 466, "word_key": " search", "bytes_hex": "20 73 65 61 72 63 68", "compression": {"rwkv": "8.74% 8.74% 8.74% 8.74% 8.74% 8.74% 8.74%", "qwen": "8.18% 8.18% 8.18% 8.18% 8.18% 8.18% 8.18%"}, "model_tokens": {"rwkv": [[47202, " search", "normal", 0.03389985114336014]], "qwen": [[2711, " search", "normal", 0.04180444777011871]]}, "loss": {"rwkv": 8.735067630382394, "qwen": 8.178927946511084}, "topk": {"rwkv": [47202, 4, 0.03389985114336014, [[332, 0.183561, " a", false], [22590, 0.12833, " the", false], [38720, 0.06064, " human", false], [47202, 0.0339, " search", false], [37920, 0.029186, " brute", false], [21273, 0.021487, " any", false], [4419, 0.021226, " an", false], [26142, 0.016276, "lier", false], [60463, 0.014586, " searching", false], [47497, 0.013787, " taking", false]]], "qwen": [2711, 3, 0.04180444777011871, [[264, 0.205371, " a", false], [279, 0.14606, " the", false], [2711, 0.041804, " search", false], [3738, 0.039201, " human", false], [458, 0.029872, " an", false], [64098, 0.024256, " brute", false], [9902, 0.016597, " ``", false], [6832, 0.015212, " learning", false], [1667, 0.015136, " using", false], [15039, 0.014427, " searching", false]]]}, "raw_delta": 0.030838932309831868, "tuned_delta": 0.03765121011692982}, {"byte_start": 2736, "byte_end": 2739, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 467, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "5.17% 5.17% 5.17%", "qwen": "4.43% 4.43% 4.43%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.4230516254901886]], "qwen": [[304, " in", "normal", 0.478597491979599]]}, "loss": {"rwkv": 5.16590021151647, "qwen": 4.429646782739058}, "topk": {"rwkv": [4596, 1, 0.4230516254901886, [[4596, 0.423052, " in", false], [45, 0.228974, ",", false], [4450, 0.050528, " by", false], [59, 0.046425, ":", false], [21400, 0.042232, " but", false], [47, 0.039977, ".", false], [21265, 0.024274, " and", false], [60, 0.014388, ";", false], [31581, 0.013153, " only", false], [32487, 0.010909, " with", false]]], "qwen": [304, 1, 0.478597491979599, [[304, 0.478597, " in", false], [25, 0.13181, ":", false], [11, 0.102186, ",", false], [13, 0.028422, ".", false], [3118, 0.018091, " based", false], [26, 0.016742, ";", false], [369, 0.016629, " for", false], [714, 0.014212, " but", false], [5980, 0.01371, "-based", false], [448, 0.013334, " with", false]]]}, "raw_delta": 0.04082655906677243, "tuned_delta": 0.04763883687387038}, {"byte_start": 2739, "byte_end": 2744, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 468, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"rwkv": "1.66% 1.66% 1.66% 1.66% 1.66%", "qwen": "1.66% 1.66% 1.66% 1.66% 1.66%"}, "model_tokens": {"rwkv": [[32227, " that", "normal", 0.6303417086601257]], "qwen": [[429, " that", "normal", 0.6315386295318604]]}, "loss": {"rwkv": 1.6624806135243915, "qwen": 1.6576426340664636}, "topk": {"rwkv": [32227, 1, 0.6303417086601257, [[32227, 0.630342, " that", false], [22590, 0.086834, " the", false], [31370, 0.037146, " many", false], [37832, 0.03588, " being", false], [21902, 0.03241, " its", false], [38013, 0.020628, " chess", false], [32234, 0.017536, " this", false], [332, 0.017349, " a", false], [39920, 0.007469, " terms", false], [32074, 0.006893, " some", false]]], "qwen": [429, 1, 0.6315386295318604, [[429, 0.631539, " that", false], [279, 0.092578, " the", false], [419, 0.053061, " this", false], [264, 0.034964, " a", false], [32719, 0.02852, " chess", false], [1181, 0.0169, " its", false], [1657, 0.013024, " many", false], [825, 0.011143, " one", false], [2441, 0.009717, " another", false], [3793, 0.009374, " terms", false]]]}, "raw_delta": 0.000268274545669564, "tuned_delta": 0.007080552352767511}, {"byte_start": 2744, "byte_end": 2747, "display": {"text": " it", "kind": "normal"}, "is_word": true, "word_id": 469, "word_key": " it", "bytes_hex": "20 69 74", "compression": {"rwkv": "2.24% 2.24% 2.24%", "qwen": "1.21% 1.21% 1.21%"}, "model_tokens": {"rwkv": [[4601, " it", "normal", 0.6833642721176147]], "qwen": [[432, " it", "normal", 0.8172699809074402]]}, "loss": {"rwkv": 2.242470319090104, "qwen": 1.2129804691136825}, "topk": {"rwkv": [4601, 1, 0.6833642721176147, [[4601, 0.683364, " it", false], [22590, 0.100183, " the", false], [45, 0.02094, ",", false], [21902, 0.020488, " its", false], [30322, 0.01229, " both", false], [332, 0.010897, " a", false], [39934, 0.010492, " there", false], [56537, 0.008932, " learning", false], [22799, 0.005762, " you", false], [22226, 0.005548, " one", false]]], "qwen": [432, 1, 0.8172699809074402, [[432, 0.81727, " it", false], [279, 0.029159, " the", false], [11, 0.022253, ",", false], [1181, 0.019094, " its", false], [2176, 0.012306, " both", false], [807, 0.008344, " they", false], [1052, 0.006602, " there", false], [2711, 0.00489, " search", false], [264, 0.004275, " a", false], [304, 0.00391, " in", false]]]}, "raw_delta": 0.05708703895409902, "tuned_delta": 0.06389931676119696}, {"byte_start": 2747, "byte_end": 2755, "display": {"text": " enables", "kind": "normal"}, "is_word": true, "word_id": 470, "word_key": " enables", "bytes_hex": "20 65 6e 61 62 6c 65 73", "compression": {"rwkv": "11.91% 11.91% 11.91% 11.91% 11.91% 11.91% 11.91% 11.91%", "qwen": "11.85% 11.85% 11.85% 11.85% 11.85% 11.85% 11.85% 11.85%"}, "model_tokens": {"rwkv": [[51597, " enables", "normal", 0.005140244960784912]], "qwen": [[20081, " enables", "normal", 0.005207602400332689]]}, "loss": {"rwkv": 11.905051851085684, "qwen": 11.85181999596894}, "topk": {"rwkv": [51597, 26, 0.005140244960784912, [[4600, 0.262432, " is", false], [21413, 0.093822, " can", false], [56540, 0.054755, " leverage", false], [57102, 0.037081, " requires", false], [30659, 0.035184, " does", false], [47181, 0.026769, " scales", false], [56501, 0.025782, " involves", false], [21800, 0.023252, " has", false], [32356, 0.018581, " uses", false], [39914, 0.017044, " tends", false]]], "qwen": [20081, 26, 0.005207602400332689, [[374, 0.315095, " is", false], [1558, 0.083303, " does", false], [646, 0.064419, " can", false], [7460, 0.038913, " requires", false], [27505, 0.021124, " lever", false], [702, 0.020943, " has", false], [3643, 0.019325, " makes", false], [17601, 0.017854, " involves", false], [5711, 0.017011, " uses", false], [4990, 0.011349, " takes", false]]]}, "raw_delta": 0.00295180082321167, "tuned_delta": 0.009764078630309616}, {"byte_start": 2755, "byte_end": 2763, "display": {"text": " massive", "kind": "normal"}, "is_word": true, "word_id": 471, "word_key": " massive", "bytes_hex": "20 6d 61 73 73 69 76 65", "compression": {"rwkv": "7.04% 7.04% 7.04% 7.04% 7.04% 7.04% 7.04% 7.04%", "qwen": "12.42% 12.42% 12.42% 12.42% 12.42% 12.42% 12.42% 12.42%"}, "model_tokens": {"rwkv": [[52195, " massive", "normal", 0.04355967044830322]], "qwen": [[10951, " massive", "normal", 0.004051612690091133]]}, "loss": {"rwkv": 7.044409379340641, "qwen": 12.417637542849741}, "topk": {"rwkv": [52195, 3, 0.04355967044830322, [[22590, 0.17772, " the", false], [332, 0.108606, " a", false], [52195, 0.04356, " massive", false], [22226, 0.038325, " one", false], [4419, 0.031225, " an", false], [38888, 0.028313, " lever", false], [59988, 0.024938, " massively", false], [63370, 0.022342, " computation", false], [51832, 0.020172, " general", false], [52224, 0.019133, " methods", false]]], "qwen": [10951, 27, 0.004051612690091133, [[279, 0.188626, " the", false], [264, 0.10628, " a", false], [4586, 0.06056, " general", false], [5413, 0.052981, " methods", false], [458, 0.04216, " an", false], [39661, 0.036924, " exploitation", false], [13009, 0.036775, " agents", false], [76482, 0.023248, " leveraging", false], [26403, 0.022925, " exploration", false], [6832, 0.018577, " learning", false]]]}, "raw_delta": -0.2979550361633301, "tuned_delta": -0.29114275835623216}, {"byte_start": 2763, "byte_end": 2775, "display": {"text": " computation", "kind": "normal"}, "is_word": true, "word_id": 472, "word_key": " computation", "bytes_hex": "20 63 6f 6d 70 75 74 61 74 69 6f 6e", "compression": {"rwkv": "2.95% 2.95% 2.95% 2.95% 2.95% 2.95% 2.95% 2.95% 2.95% 2.95% 2.95% 2.95%", "qwen": "3.18% 3.18% 3.18% 3.18% 3.18% 3.18% 3.18% 3.18% 3.18% 3.18% 3.18% 3.18%"}, "model_tokens": {"rwkv": [[63370, " computation", "normal", 0.1430862843990326]], "qwen": [[34447, " computation", "normal", 0.12069942057132721]]}, "loss": {"rwkv": 2.946911257024168, "qwen": 3.17761380105219}, "topk": {"rwkv": [63370, 1, 0.1430862843990326, [[63370, 0.143086, " computation", false], [45, 0.142375, ",", false], [63621, 0.112733, " improvement", false], [56812, 0.097265, " parallel", false], [64423, 0.074449, " improvements", false], [56950, 0.058108, " progress", false], [56540, 0.023402, " leverage", false], [63562, 0.022578, " exploration", false], [38888, 0.022326, " lever", false], [59847, 0.017635, " increases", false]]], "qwen": [34447, 1, 0.12069942057132721, [[34447, 0.120699, " computation", false], [26403, 0.09624, " exploration", false], [2711, 0.075672, " search", false], [14713, 0.075473, " amounts", false], [15673, 0.049149, " improvement", false], [18142, 0.038987, " improvements", false], [39661, 0.034509, " exploitation", false], [11, 0.031238, ",", false], [26943, 0.031151, " scaling", false], [5452, 0.030295, " scale", false]]]}, "raw_delta": -0.01279286543528238, "tuned_delta": -0.005980587628184433}, {"byte_start": 2775, "byte_end": 2778, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 473, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "4.39% 4.39% 4.39%", "qwen": "6.63% 6.63% 6.63%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.4815525710582733]], "qwen": [[311, " to", "normal", 0.3317577838897705]]}, "loss": {"rwkv": 4.391015179789, "qwen": 6.632490865881613}, "topk": {"rwkv": [4811, 1, 0.4815525710582733, [[4811, 0.481553, " to", false], [45, 0.102269, ",", false], [47, 0.077224, ".", false], [4424, 0.034031, " at", false], [21265, 0.033354, " and", false], [32487, 0.031421, " with", false], [53356, 0.030182, " without", false], [4596, 0.027087, " in", false], [4712, 0.020374, " on", false], [4706, 0.017045, " of", false]]], "qwen": [311, 1, 0.3317577838897705, [[311, 0.331758, " to", false], [11, 0.125657, ",", false], [13, 0.109759, ".", false], [2041, 0.058306, " without", false], [323, 0.0552, " and", false], [518, 0.033041, " at", false], [429, 0.032326, " that", false], [448, 0.026722, " with", false], [382, 0.02651, ".\n\n", false], [714, 0.022131, " but", false]]]}, "raw_delta": -0.12429380416870113, "tuned_delta": -0.11748152636160318}, {"byte_start": 2778, "byte_end": 2781, "display": {"text": " be", "kind": "normal"}, "is_word": true, "word_id": 474, "word_key": " be", "bytes_hex": "20 62 65", "compression": {"rwkv": "1.35% 1.35% 1.35%", "qwen": "2.03% 2.03% 2.03%"}, "model_tokens": {"rwkv": [[4435, " be", "normal", 0.7977592945098877]], "qwen": [[387, " be", "normal", 0.7130709290504456]]}, "loss": {"rwkv": 1.350178464373623, "qwen": 2.032843532330941}, "topk": {"rwkv": [4435, 1, 0.7977592945098877, [[4435, 0.797759, " be", false], [56540, 0.050451, " leverage", false], [31702, 0.005593, " play", false], [45284, 0.005557, " become", false], [32187, 0.005474, " take", false], [51982, 0.00545, " improve", false], [52570, 0.005322, " proceed", false], [31358, 0.004948, " make", false], [22770, 0.003624, " win", false], [22249, 0.003535, " out", false]]], "qwen": [387, 1, 0.7130709290504456, [[387, 0.713071, " be", false], [1896, 0.027526, " take", false], [614, 0.013965, " have", false], [3635, 0.012586, " become", false], [32064, 0.010333, " leverage", false], [1281, 0.009125, " make", false], [7269, 0.008625, " improve", false], [11075, 0.008269, " achieve", false], [22279, 0.007899, " overcome", false], [1486, 0.006836, " play", false]]]}, "raw_delta": -0.03785498936971028, "tuned_delta": -0.031042711562612336}, {"byte_start": 2781, "byte_end": 2789, "display": {"text": " brought", "kind": "normal"}, "is_word": true, "word_id": 475, "word_key": " brought", "bytes_hex": "20 62 72 6f 75 67 68 74", "compression": {"rwkv": "10.57% 10.57% 10.57% 10.57% 10.57% 10.57% 10.57% 10.57%", "qwen": "11.49% 11.49% 11.49% 11.49% 11.49% 11.49% 11.49% 11.49%"}, "model_tokens": {"rwkv": [[51097, " brought", "normal", 0.00899605080485344]], "qwen": [[7117, " brought", "normal", 0.0061202989891171455]]}, "loss": {"rwkv": 10.566614069010962, "qwen": 11.487784318887634}, "topk": {"rwkv": [51097, 10, 0.00899605080485344, [[50937, 0.35485, " applied", false], [56540, 0.184066, " leverage", false], [60152, 0.067788, " performed", false], [32354, 0.066895, " used", false], [30666, 0.058532, " done", false], [51139, 0.0171, " carried", false], [59355, 0.015044, " conducted", false], [31351, 0.013109, " made", false], [55957, 0.009753, " deployed", false], [51097, 0.008996, " brought", false]]], "qwen": [7117, 19, 0.0061202989891171455, [[1483, 0.209172, " used", false], [27505, 0.177003, " lever", false], [9251, 0.148379, " applied", false], [2814, 0.096124, " done", false], [10660, 0.041811, " performed", false], [1865, 0.026493, " made", false], [50663, 0.019872, " exploited", false], [26075, 0.011203, " deployed", false], [19446, 0.009398, " employed", false], [2182, 0.008854, " put", false]]]}, "raw_delta": -0.051080524921417236, "tuned_delta": -0.04426824711431929}, {"byte_start": 2789, "byte_end": 2792, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 476, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "0.20% 0.20% 0.20%", "qwen": "0.21% 0.21% 0.21%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.9672085046768188]], "qwen": [[311, " to", "normal", 0.965833842754364]]}, "loss": {"rwkv": 0.20105918436868078, "qwen": 0.2089710581155999}, "topk": {"rwkv": [4811, 1, 0.9672085046768188, [[4811, 0.967209, " to", false], [31162, 0.008847, " into", false], [40062, 0.003113, " under", false], [4596, 0.002222, " in", false], [63507, 0.001328, " effectively", false], [56003, 0.001224, " directly", false], [30678, 0.001106, " down", false], [52628, 0.001052, " quickly", false], [51791, 0.000799, " forward", false], [57435, 0.000773, " together", false]]], "qwen": [311, 1, 0.965833842754364, [[311, 0.965834, " to", false], [1119, 0.023412, " into", false], [304, 0.002711, " in", false], [1212, 0.001242, " under", false], [911, 0.000974, " about", false], [2860, 0.000767, " online", false], [3786, 0.000469, " together", false], [11872, 0.000411, " cheap", false], [389, 0.000329, " on", false], [8630, 0.000317, " onto", false]]]}, "raw_delta": -0.0004387274384498596, "tuned_delta": 0.006373550368648087}, {"byte_start": 2792, "byte_end": 2797, "display": {"text": " bear", "kind": "normal"}, "is_word": true, "word_id": 477, "word_key": " bear", "bytes_hex": "20 62 65 61 72", "compression": {"rwkv": "0.05% 0.05% 0.05% 0.05% 0.05%", "qwen": "0.03% 0.03% 0.03% 0.03% 0.03%"}, "model_tokens": {"rwkv": [[30255, " bear", "normal", 0.9850945472717285]], "qwen": [[11722, " bear", "normal", 0.9928228855133057]]}, "loss": {"rwkv": 0.05415389710368118, "qwen": 0.025979210499576095}, "topk": {"rwkv": [30255, 1, 0.9850945472717285, [[30255, 0.985095, " bear", false], [22590, 0.004819, " the", false], [332, 0.002608, " a", false], [4419, 0.000851, " an", false], [39590, 0.000556, " scale", false], [31702, 0.000522, " play", false], [30235, 0.000466, " bare", false], [32202, 0.000264, " task", false], [22681, 0.000158, " use", false], [32499, 0.000146, " work", false]]], "qwen": [11722, 1, 0.9928228855133057, [[11722, 0.992823, " bear", false], [279, 0.003907, " the", false], [264, 0.000731, " a", false], [1486, 0.000568, " play", false], [3383, 0.000198, " task", false], [5452, 0.000198, " scale", false], [458, 0.000177, " an", false], [894, 8.3e-05, " any", false], [21828, 6.7e-05, " solving", false], [3491, 5.7e-05, " problem", false]]]}, "raw_delta": 0.0015623363666236402, "tuned_delta": 0.008374614173721586}, {"byte_start": 2797, "byte_end": 2798, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "45.37%", "qwen": "37.38%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.07932576537132263]], "qwen": [[13, ".", "normal", 0.12581726908683777]]}, "loss": {"rwkv": 45.365996402953726, "qwen": 37.38247575857672}, "topk": {"rwkv": [47, 2, 0.07932576537132263, [[4712, 0.620828, " on", false], [47, 0.079326, ".", false], [45, 0.072461, ",", false], [4596, 0.054491, " in", false], [4811, 0.025311, " to", false], [53356, 0.019198, " without", false], [4424, 0.015254, " at", false], [21265, 0.010135, " and", false], [50870, 0.0061, " against", false], [32350, 0.005661, " upon", false]]], "qwen": [13, 3, 0.12581726908683777, [[389, 0.432773, " on", false], [11, 0.149686, ",", false], [13, 0.125817, ".", false], [304, 0.049302, " in", false], [382, 0.038853, ".\n\n", false], [2041, 0.035623, " without", false], [323, 0.029677, " and", false], [311, 0.019642, " to", false], [26, 0.011298, ";", false], [714, 0.00808, " but", false]]]}, "raw_delta": 0.4427003860473633, "tuned_delta": 0.4495126638544612}, {"byte_start": 2798, "byte_end": 2805, "display": {"text": " Search", "kind": "normal"}, "is_word": true, "word_id": 478, "word_key": " search", "bytes_hex": "20 53 65 61 72 63 68", "compression": {"rwkv": "9.50% 9.50% 9.50% 9.50% 9.50% 9.50% 9.50%", "qwen": "10.67% 10.67% 10.67% 10.67% 10.67% 10.67% 10.67%"}, "model_tokens": {"rwkv": [[44844, " Search", "normal", 0.024802951142191887]], "qwen": [[7542, " Search", "normal", 0.015871211886405945]]}, "loss": {"rwkv": 9.499889220139378, "qwen": 10.674007406894734}, "topk": {"rwkv": [44844, 9, 0.024802951142191887, [[261, 0.167314, "\n\n", false], [19555, 0.112426, " But", false], [20996, 0.096775, " The", false], [3918, 0.072429, " It", false], [3913, 0.049912, " In", false], [19417, 0.031475, " And", false], [55122, 0.026682, " Learning", false], [267, 0.026067, "  ", false], [44844, 0.024803, " Search", false], [29894, 0.021449, " This", false]]], "qwen": [7542, 10, 0.015871211886405945, [[1084, 0.136113, " It", false], [576, 0.094023, " The", false], [220, 0.081177, " ", false], [758, 0.062874, " In", false], [1988, 0.036261, " But", false], [20909, 0.03, " Learning", false], [1597, 0.028712, " And", false], [1096, 0.025151, " This", false], [4354, 0.017457, " However", false], [7542, 0.015871, " Search", false]]]}, "raw_delta": -0.06510693686349045, "tuned_delta": -0.0582946590563925}, {"byte_start": 2805, "byte_end": 2809, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 479, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"rwkv": "9.37% 9.37% 9.37% 9.37%", "qwen": "10.57% 10.57% 10.57% 10.57%"}, "model_tokens": {"rwkv": [[21265, " and", "normal", 0.12787574529647827]], "qwen": [[323, " and", "normal", 0.09580511599779129]]}, "loss": {"rwkv": 9.369064474523052, "qwen": 10.57422967576948}, "topk": {"rwkv": [21265, 2, 0.12787574529647827, [[4600, 0.199483, " is", false], [21265, 0.127876, " and", false], [45, 0.070735, ",", false], [22748, 0.061423, " was", false], [4596, 0.038787, " in", false], [46, 0.034261, "-", false], [21800, 0.034, " has", false], [21413, 0.031205, " can", false], [30659, 0.017795, " does", false], [52224, 0.017302, " methods", false]]], "qwen": [323, 2, 0.09580511599779129, [[374, 0.206357, " is", false], [323, 0.095805, " and", false], [5980, 0.071295, "-based", false], [646, 0.046686, " can", false], [11, 0.045902, ",", false], [572, 0.042375, " was", false], [702, 0.0265, " has", false], [304, 0.024422, " in", false], [553, 0.023038, " by", false], [20081, 0.018307, " enables", false]]]}, "raw_delta": -0.06682854890823364, "tuned_delta": -0.06001627110113569}, {"byte_start": 2809, "byte_end": 2818, "display": {"text": " learning", "kind": "normal"}, "is_word": true, "word_id": 480, "word_key": " learning", "bytes_hex": "20 6c 65 61 72 6e 69 6e 67", "compression": {"rwkv": "0.60% 0.60% 0.60% 0.60% 0.60% 0.60% 0.60% 0.60% 0.60%", "qwen": "0.25% 0.25% 0.25% 0.25% 0.25% 0.25% 0.25% 0.25% 0.25%"}, "model_tokens": {"rwkv": [[56537, " learning", "normal", 0.7402265071868896]], "qwen": [[6832, " learning", "normal", 0.8839277029037476]]}, "loss": {"rwkv": 0.6026883580102548, "qwen": 0.2472218956567819}, "topk": {"rwkv": [56537, 1, 0.7402265071868896, [[56537, 0.740227, " learning", false], [31978, 0.23442, " self", false], [30597, 0.003194, " deep", false], [65003, 0.002563, " reinforcement", false], [22590, 0.001768, " the", false], [51832, 0.001334, " general", false], [39193, 0.001004, " other", false], [40093, 0.00068, " value", false], [21902, 0.000667, " its", false], [38720, 0.000541, " human", false]]], "qwen": [6832, 1, 0.8839277029037476, [[6832, 0.883928, " learning", false], [656, 0.037151, " self", false], [3738, 0.005913, " human", false], [279, 0.004736, " the", false], [4586, 0.003994, " general", false], [1008, 0.003665, " other", false], [3960, 0.003263, " learn", false], [71278, 0.003174, " reinforcement", false], [11, 0.002926, ",", false], [5662, 0.002919, " machine", false]]]}, "raw_delta": 0.019711246093114216, "tuned_delta": 0.026523523900212162}, {"byte_start": 2818, "byte_end": 2822, "display": {"text": " are", "kind": "normal"}, "is_word": true, "word_id": 481, "word_key": " are", "bytes_hex": "20 61 72 65", "compression": {"rwkv": "4.75% 4.75% 4.75% 4.75%", "qwen": "4.28% 4.28% 4.28% 4.28%"}, "model_tokens": {"rwkv": [[21286, " are", "normal", 0.3468010425567627]], "qwen": [[525, " are", "normal", 0.3873915672302246]]}, "loss": {"rwkv": 4.754976331054933, "qwen": 4.275423669509565}, "topk": {"rwkv": [21286, 1, 0.3468010425567627, [[21286, 0.346801, " are", false], [4450, 0.109074, " by", false], [21413, 0.061296, " can", false], [30322, 0.057845, " both", false], [31059, 0.052406, " have", false], [45, 0.035298, ",", false], [32462, 0.034347, " were", false], [4596, 0.026549, " in", false], [4491, 0.011575, " do", false], [22681, 0.010491, " use", false]]], "qwen": [525, 1, 0.3873915672302246, [[525, 0.387392, " are", false], [553, 0.133823, " by", false], [646, 0.054331, " can", false], [614, 0.044623, " have", false], [2176, 0.03334, " both", false], [11, 0.030488, ",", false], [1033, 0.025587, " were", false], [304, 0.018692, " in", false], [22766, 0.015927, " complement", false], [653, 0.012731, " do", false]]]}, "raw_delta": 0.02659204602241516, "tuned_delta": 0.03340432382951311}, {"byte_start": 2822, "byte_end": 2826, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 482, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "12.05% 12.05% 12.05% 12.05%", "qwen": "12.84% 12.84% 12.84% 12.84%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.0690191239118576]], "qwen": [[279, " the", "normal", 0.05798915773630142]]}, "loss": {"rwkv": 12.045940038672496, "qwen": 12.837728815196645}, "topk": {"rwkv": [22590, 4, 0.0690191239118576, [[30322, 0.120617, " both", false], [64857, 0.104218, " complementary", false], [22187, 0.075526, " not", false], [22590, 0.069019, " the", false], [22638, 0.041905, " two", false], [32239, 0.030754, " thus", false], [30135, 0.019606, " also", false], [45, 0.017638, ",", false], [59513, 0.017606, " different", false], [32386, 0.017054, " very", false]]], "qwen": [279, 5, 0.05798915773630142, [[2176, 0.143617, " both", false], [537, 0.10829, " not", false], [57435, 0.095817, " complementary", false], [1378, 0.078652, " two", false], [279, 0.057989, " the", false], [1602, 0.029411, " very", false], [2155, 0.021551, " different", false], [42493, 0.017764, " fundamentally", false], [1075, 0.015924, " like", false], [3545, 0.015657, " often", false]]]}, "raw_delta": -0.04390609264373779, "tuned_delta": -0.03709381483663984}, {"byte_start": 2826, "byte_end": 2830, "display": {"text": " two", "kind": "normal"}, "is_word": true, "word_id": 483, "word_key": " two", "bytes_hex": "20 74 77 6f", "compression": {"rwkv": "5.00% 5.00% 5.00% 5.00%", "qwen": "3.14% 3.14% 3.14% 3.14%"}, "model_tokens": {"rwkv": [[22638, " two", "normal", 0.3276766240596771]], "qwen": [[1378, " two", "normal", 0.49840816855430603]]}, "loss": {"rwkv": 5.001530659331855, "qwen": 3.139376414584656}, "topk": {"rwkv": [22638, 1, 0.3276766240596771, [[22638, 0.327677, " two", false], [31937, 0.10695, " same", false], [31581, 0.074064, " only", false], [31461, 0.073502, " most", false], [31356, 0.018841, " main", false], [51832, 0.018515, " general", false], [52224, 0.016319, " methods", false], [57481, 0.015149, " ultimate", false], [21952, 0.012762, " key", false], [56040, 0.01002, " dominant", false]]], "qwen": [1378, 1, 0.49840816855430603, [[1378, 0.498408, " two", false], [1429, 0.062366, " most", false], [1172, 0.056847, " only", false], [4586, 0.038485, " general", false], [1852, 0.034889, " same", false], [1850, 0.016256, " best", false], [5413, 0.014677, " methods", false], [3363, 0.011128, " means", false], [1887, 0.011071, " main", false], [27397, 0.007124, " twin", false]]]}, "raw_delta": 0.10325975716114044, "tuned_delta": 0.11007203496823839}, {"byte_start": 2830, "byte_end": 2835, "display": {"text": " most", "kind": "normal"}, "is_word": true, "word_id": 484, "word_key": " most", "bytes_hex": "20 6d 6f 73 74", "compression": {"rwkv": "5.21% 5.21% 5.21% 5.21% 5.21%", "qwen": "6.89% 6.89% 6.89% 6.89% 6.89%"}, "model_tokens": {"rwkv": [[31461, " most", "normal", 0.23221451044082642]], "qwen": [[1429, " most", "normal", 0.14800553023815155]]}, "loss": {"rwkv": 5.212862940712074, "qwen": 6.890692575869345}, "topk": {"rwkv": [31461, 1, 0.23221451044082642, [[31461, 0.232215, " most", false], [31356, 0.102634, " main", false], [52224, 0.062878, " methods", false], [51832, 0.062212, " general", false], [61590, 0.033773, " approaches", false], [52469, 0.027192, " pillars", false], [38961, 0.025403, " major", false], [21357, 0.021885, " big", false], [56040, 0.020553, " dominant", false], [63591, 0.018289, " fundamental", false]]], "qwen": [1429, 1, 0.14800553023815155, [[1429, 0.148006, " most", false], [4586, 0.087399, " general", false], [1887, 0.080456, " main", false], [5413, 0.06258, " methods", false], [3598, 0.042226, " major", false], [11067, 0.038367, " sides", false], [5510, 0.034518, " ways", false], [15811, 0.02932, " fundamental", false], [6028, 0.027451, " primary", false], [19827, 0.023461, " approaches", false]]]}, "raw_delta": -0.09303863048553468, "tuned_delta": -0.08622635267843673}, {"byte_start": 2835, "byte_end": 2845, "display": {"text": " important", "kind": "normal"}, "is_word": true, "word_id": 485, "word_key": " important", "bytes_hex": "20 69 6d 70 6f 72 74 61 6e 74", "compression": {"rwkv": "2.71% 2.71% 2.71% 2.71% 2.71% 2.71% 2.71% 2.71% 2.71% 2.71%", "qwen": "3.02% 3.02% 3.02% 3.02% 3.02% 3.02% 3.02% 3.02% 3.02% 3.02%"}, "model_tokens": {"rwkv": [[59829, " important", "normal", 0.22219449281692505]], "qwen": [[2989, " important", "normal", 0.18727020919322968]]}, "loss": {"rwkv": 2.7050532016668054, "qwen": 3.0210083339813387}, "topk": {"rwkv": [59829, 2, 0.22219449281692505, [[51832, 0.229595, " general", false], [59829, 0.222194, " important", false], [59593, 0.163492, " effective", false], [56900, 0.108313, " powerful", false], [63591, 0.034884, " fundamental", false], [45534, 0.023134, " common", false], [60274, 0.022206, " promising", false], [37812, 0.018313, " basic", false], [62603, 0.011674, " successful", false], [59594, 0.01111, " efficient", false]]], "qwen": [2989, 2, 0.18727020919322968, [[7373, 0.220257, " effective", false], [2989, 0.18727, " important", false], [7988, 0.147371, " powerful", false], [4586, 0.067652, " general", false], [4185, 0.057547, " common", false], [20469, 0.025604, " prominent", false], [15811, 0.019474, " fundamental", false], [6770, 0.019341, " basic", false], [8036, 0.018842, " obvious", false], [6849, 0.017663, " successful", false]]]}, "raw_delta": -0.017520272731781, "tuned_delta": -0.010707994924683054}, {"byte_start": 2845, "byte_end": 2853, "display": {"text": " classes", "kind": "normal"}, "is_word": true, "word_id": 486, "word_key": " classes", "bytes_hex": "20 63 6c 61 73 73 65 73", "compression": {"rwkv": "10.50% 10.50% 10.50% 10.50% 10.50% 10.50% 10.50% 10.50%", "qwen": "11.57% 11.57% 11.57% 11.57% 11.57% 11.57% 11.57% 11.57%"}, "model_tokens": {"rwkv": [[51200, " classes", "normal", 0.00936118047684431]], "qwen": [[6846, " classes", "normal", 0.005898187402635813]]}, "loss": {"rwkv": 10.496169975217555, "qwen": 11.571113137905368}, "topk": {"rwkv": [51200, 19, 0.00936118047684431, [[52224, 0.182578, " methods", false], [51832, 0.158487, " general", false], [32448, 0.041796, " ways", false], [62633, 0.039619, " techniques", false], [61590, 0.0372, " approaches", false], [39979, 0.027065, " tools", false], [21265, 0.024962, " and", false], [45, 0.020284, ",", false], [38888, 0.019376, " lever", false], [63639, 0.017262, " ingredients", false]]], "qwen": [6846, 20, 0.005898187402635813, [[4586, 0.143531, " general", false], [5413, 0.132431, " methods", false], [5510, 0.094557, " ways", false], [7375, 0.058382, " tools", false], [19827, 0.049997, " approaches", false], [12538, 0.038348, " techniques", false], [3363, 0.028763, " means", false], [6813, 0.025909, " components", false], [54480, 0.024748, " computational", false], [13966, 0.021211, " ingredients", false]]]}, "raw_delta": -0.059607505798339844, "tuned_delta": -0.052795227991241894}, {"byte_start": 2853, "byte_end": 2856, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 487, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "0.03% 0.03% 0.03%", "qwen": "0.03% 0.03% 0.03%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.994479775428772]], "qwen": [[315, " of", "normal", 0.9943274855613708]]}, "loss": {"rwkv": 0.03357101344842024, "qwen": 0.034195892144145486}, "topk": {"rwkv": [4706, 1, 0.994479775428772, [[4706, 0.99448, " of", false], [4596, 0.002019, " in", false], [21700, 0.000557, " for", false], [45, 0.00051, ",", false], [32227, 0.000289, " that", false], [275, 0.000237, " (", false], [4715, 0.000237, " or", false], [4811, 0.000172, " to", false], [47, 0.000165, ".", false], [21265, 0.000124, " and", false]]], "qwen": [315, 1, 0.9943274855613708, [[315, 0.994327, " of", false], [304, 0.001101, " in", false], [429, 0.000963, " that", false], [369, 0.000572, " for", false], [320, 0.000504, " (", false], [11, 0.000416, ",", false], [476, 0.000242, " or", false], [311, 0.000238, " to", false], [323, 0.000137, " and", false], [4221, 8.4e-05, " among", false]]]}, "raw_delta": -3.465063249071432e-05, "tuned_delta": 0.006777627174607233}, {"byte_start": 2856, "byte_end": 2867, "display": {"text": " techniques", "kind": "normal"}, "is_word": true, "word_id": 488, "word_key": " techniques", "bytes_hex": "20 74 65 63 68 6e 69 71 75 65 73", "compression": {"rwkv": "4.84% 4.84% 4.84% 4.84% 4.84% 4.84% 4.84% 4.84% 4.84% 4.84% 4.84%", "qwen": "5.74% 5.74% 5.74% 5.74% 5.74% 5.74% 5.74% 5.74% 5.74% 5.74% 5.74%"}, "model_tokens": {"rwkv": [[62633, " techniques", "normal", 0.05263730511069298]], "qwen": [[12538, " techniques", "normal", 0.030211452394723892]]}, "loss": {"rwkv": 4.841430446165023, "qwen": 5.737227880581591}, "topk": {"rwkv": [62633, 5, 0.05263730511069298, [[52224, 0.406319, " methods", false], [51832, 0.166604, " general", false], [61559, 0.092985, " algorithms", false], [3609, 0.054142, " AI", false], [62633, 0.052637, " techniques", false], [61590, 0.033882, " approaches", false], [63370, 0.018149, " computation", false], [59113, 0.01785, " algorithm", false], [46561, 0.010238, " method", false], [64862, 0.009286, " computational", false]]], "qwen": [12538, 7, 0.030211452394723892, [[5413, 0.40924, " methods", false], [4586, 0.115374, " general", false], [1714, 0.07087, " method", false], [34447, 0.068192, " computation", false], [54480, 0.041362, " computational", false], [25185, 0.032391, " algorithms", false], [12538, 0.030211, " techniques", false], [19827, 0.02384, " approaches", false], [12111, 0.023117, " algorithm", false], [15235, 0.02189, " AI", false]]]}, "raw_delta": -0.04967355728149414, "tuned_delta": -0.04286127947439619}, {"byte_start": 2867, "byte_end": 2871, "display": {"text": " for", "kind": "normal"}, "is_word": true, "word_id": 489, "word_key": " for", "bytes_hex": "20 66 6f 72", "compression": {"rwkv": "5.00% 5.00% 5.00% 5.00%", "qwen": "5.20% 5.20% 5.20% 5.20%"}, "model_tokens": {"rwkv": [[21700, " for", "normal", 0.33222195506095886]], "qwen": [[369, " for", "normal", 0.31576159596443176]]}, "loss": {"rwkv": 5.001530659331855, "qwen": 5.19716361191722}, "topk": {"rwkv": [21700, 1, 0.33222195506095886, [[21700, 0.332222, " for", false], [32227, 0.213011, " that", false], [4596, 0.186358, " in", false], [45, 0.063882, ",", false], [47, 0.034781, ".", false], [4811, 0.028378, " to", false], [32354, 0.01923, " used", false], [59206, 0.013073, " available", false], [21265, 0.007484, " and", false], [4450, 0.00502, " by", false]]], "qwen": [369, 1, 0.31576159596443176, [[369, 0.315762, " for", false], [429, 0.26786, " that", false], [304, 0.126991, " in", false], [311, 0.066363, " to", false], [11, 0.043717, ",", false], [1483, 0.023521, " used", false], [2500, 0.016698, " available", false], [13, 0.015239, ".", false], [582, 0.005726, " we", false], [553, 0.00528, " by", false]]]}, "raw_delta": -0.010848194360733032, "tuned_delta": -0.004035916553635085}, {"byte_start": 2871, "byte_end": 2881, "display": {"text": " utilizing", "kind": "normal"}, "is_word": true, "word_id": 490, "word_key": " utilizing", "bytes_hex": "20 75 74 69 6c 69 7a 69 6e 67", "compression": {"rwkv": "12.57% 12.57% 12.57% 12.57% 12.57% 12.57% 12.57% 12.57% 12.57% 12.57%", "qwen": "9.54% 9.54% 9.54% 9.54% 9.54% 9.54% 9.54% 9.54% 9.54% 9.54%"}, "model_tokens": {"rwkv": [[60720, " utilizing", "normal", 0.0009274845360778272]], "qwen": [[34888, " utilizing", "normal", 0.0050475276075303555]]}, "loss": {"rwkv": 12.567226332743706, "qwen": 9.537758817101363}, "topk": {"rwkv": [60720, 125, 0.0009274845360778272, [[59832, 0.069, " improving", false], [3609, 0.058659, " AI", false], [38888, 0.05521, " lever", false], [51832, 0.053939, " general", false], [52949, 0.042934, " solving", false], [46500, 0.036598, " making", false], [51844, 0.02304, " getting", false], [47497, 0.021951, " taking", false], [51392, 0.020486, " dealing", false], [56109, 0.019924, " enabling", false]]], "qwen": [34888, 35, 0.0050475276075303555, [[76482, 0.162236, " leveraging", false], [21828, 0.083615, " solving", false], [4586, 0.049685, " general", false], [15235, 0.040716, " AI", false], [18392, 0.030699, " improving", false], [27362, 0.030692, " enabling", false], [4633, 0.023317, " taking", false], [70601, 0.022516, " exploiting", false], [1667, 0.017289, " using", false], [279, 0.016945, " the", false]]]}, "raw_delta": 0.16798934936523438, "tuned_delta": 0.17480162717233233}, {"byte_start": 2881, "byte_end": 2889, "display": {"text": " massive", "kind": "normal"}, "is_word": true, "word_id": 491, "word_key": " massive", "bytes_hex": "20 6d 61 73 73 69 76 65", "compression": {"rwkv": "4.44% 4.44% 4.44% 4.44% 4.44% 4.44% 4.44% 4.44%", "qwen": "4.69% 4.69% 4.69% 4.69% 4.69% 4.69% 4.69% 4.69%"}, "model_tokens": {"rwkv": [[52195, " massive", "normal", 0.1399914175271988]], "qwen": [[10951, " massive", "normal", 0.12494955211877823]]}, "loss": {"rwkv": 4.437977908984604, "qwen": 4.688409908592699}, "topk": {"rwkv": [52195, 2, 0.1399914175271988, [[63370, 0.499604, " computation", false], [52195, 0.139991, " massive", false], [51832, 0.07506, " general", false], [22590, 0.065859, " the", false], [59988, 0.03637, " massively", false], [38864, 0.025724, " large", false], [64862, 0.014679, " computational", false], [59346, 0.007843, " computing", false], [332, 0.00633, " a", false], [37045, 0.005417, " Moore", false]]], "qwen": [10951, 2, 0.12494955211877823, [[34447, 0.473113, " computation", false], [10951, 0.12495, " massive", false], [279, 0.085623, " the", false], [63707, 0.04671, " massively", false], [54480, 0.033167, " computational", false], [4586, 0.028939, " general", false], [3460, 0.018179, " large", false], [6366, 0.014301, " computer", false], [419, 0.012215, " this", false], [74151, 0.007824, " exponentially", false]]]}, "raw_delta": -0.013886898756027222, "tuned_delta": -0.007074620948929275}, {"byte_start": 2889, "byte_end": 2897, "display": {"text": " amounts", "kind": "normal"}, "is_word": true, "word_id": 492, "word_key": " amounts", "bytes_hex": "20 61 6d 6f 75 6e 74 73", "compression": {"rwkv": "10.07% 10.07% 10.07% 10.07% 10.07% 10.07% 10.07% 10.07%", "qwen": "8.24% 8.24% 8.24% 8.24% 8.24% 8.24% 8.24% 8.24%"}, "model_tokens": {"rwkv": [[50897, " amounts", "normal", 0.011472208425402641]], "qwen": [[14713, " amounts", "normal", 0.02579469420015812]]}, "loss": {"rwkv": 10.073505412457116, "qwen": 8.244971894893352}, "topk": {"rwkv": [50897, 4, 0.011472208425402641, [[63370, 0.875778, " computation", false], [64862, 0.025768, " computational", false], [45, 0.023483, ",", false], [50897, 0.011472, " amounts", false], [59346, 0.007768, " computing", false], [64298, 0.007284, " computations", false], [56812, 0.00536, " parallel", false], [51266, 0.00368, " compute", false], [51832, 0.003105, " general", false], [56353, 0.002396, " hardware", false]]], "qwen": [14713, 3, 0.02579469420015812, [[34447, 0.834982, " computation", false], [54480, 0.052718, " computational", false], [14713, 0.025795, " amounts", false], [24231, 0.018217, " computing", false], [6366, 0.008259, " computer", false], [11, 0.006246, ",", false], [82599, 0.005775, " computations", false], [821, 0.002735, " data", false], [12564, 0.002578, " compute", false], [2500, 0.002349, " available", false]]]}, "raw_delta": 0.10139542818069458, "tuned_delta": 0.10820770598779253}, {"byte_start": 2897, "byte_end": 2900, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 493, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "0.01% 0.01% 0.01%", "qwen": "0.01% 0.01% 0.01%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.9987157583236694]], "qwen": [[315, " of", "normal", 0.9980055689811707]]}, "loss": {"rwkv": 0.0077506847988839086, "qwen": 0.012001000602508067}, "topk": {"rwkv": [4706, 1, 0.9987157583236694, [[4706, 0.998716, " of", false], [63370, 0.000294, " computation", false], [21265, 0.00017, " and", false], [275, 0.000153, " (", false], [4715, 8.8e-05, " or", false], [45, 5e-05, ",", false], [11, 4.9e-05, "\n", false], [261, 4.5e-05, "\n\n", false], [4588, 3.2e-05, " if", false], [59346, 2.6e-05, " computing", false]]], "qwen": [315, 1, 0.9980055689811707, [[315, 0.998006, " of", false], [34447, 0.000474, " computation", false], [323, 0.000282, " and", false], [320, 0.000122, " (", false], [11, 9.3e-05, ",", false], [476, 8.8e-05, " or", false], [13, 7.9e-05, ".", false], [2500, 6.7e-05, " available", false], [198, 6e-05, "\n", false], [54480, 4.8e-05, " computational", false]]]}, "raw_delta": -0.00023568755326171717, "tuned_delta": 0.00657659025383623}, {"byte_start": 2900, "byte_end": 2912, "display": {"text": " computation", "kind": "normal"}, "is_word": true, "word_id": 494, "word_key": " computation", "bytes_hex": "20 63 6f 6d 70 75 74 61 74 69 6f 6e", "compression": {"rwkv": "0.17% 0.17% 0.17% 0.17% 0.17% 0.17% 0.17% 0.17% 0.17% 0.17% 0.17% 0.17%", "qwen": "0.22% 0.22% 0.22% 0.22% 0.22% 0.22% 0.22% 0.22% 0.22% 0.22% 0.22% 0.22%"}, "model_tokens": {"rwkv": [[63370, " computation", "normal", 0.8907105922698975]], "qwen": [[34447, " computation", "normal", 0.8663378953933716]]}, "loss": {"rwkv": 0.17317506390879073, "qwen": 0.21562315894494896}, "topk": {"rwkv": [63370, 1, 0.8907105922698975, [[63370, 0.890711, " computation", false], [64862, 0.032159, " computational", false], [59346, 0.016947, " computing", false], [51266, 0.009648, " compute", false], [55809, 0.004876, " computer", false], [59206, 0.004645, " available", false], [52167, 0.003176, " machine", false], [51832, 0.002854, " general", false], [56812, 0.002711, " parallel", false], [56353, 0.002163, " hardware", false]]], "qwen": [34447, 1, 0.8663378953933716, [[34447, 0.866338, " computation", false], [54480, 0.034819, " computational", false], [821, 0.017538, " data", false], [6366, 0.013891, " computer", false], [24231, 0.0123, " computing", false], [2500, 0.011808, " available", false], [1995, 0.005185, " information", false], [12564, 0.003155, " compute", false], [3738, 0.001975, " human", false], [4586, 0.001658, " general", false]]]}, "raw_delta": -0.0023538221915562936, "tuned_delta": 0.004458455615541653}, {"byte_start": 2912, "byte_end": 2915, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 495, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "14.75% 14.75% 14.75%", "qwen": "14.28% 14.28% 14.28%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.08483771234750748]], "qwen": [[304, " in", "normal", 0.09289742261171341]]}, "loss": {"rwkv": 14.746296967419742, "qwen": 14.284239778479177}, "topk": {"rwkv": [4596, 4, 0.08483771234750748, [[47, 0.468454, ".", false], [45, 0.178982, ",", false], [4811, 0.100229, " to", false], [4596, 0.084838, " in", false], [21700, 0.024928, " for", false], [21265, 0.017962, " and", false], [32227, 0.016095, " that", false], [60, 0.013785, ";", false], [63507, 0.010331, " effectively", false], [275, 0.008978, " (", false]]], "qwen": [304, 4, 0.09289742261171341, [[13, 0.313173, ".", false], [11, 0.211635, ",", false], [382, 0.14766, ".\n\n", false], [304, 0.092897, " in", false], [311, 0.06056, " to", false], [323, 0.020972, " and", false], [26, 0.019117, ";", false], [369, 0.017094, " for", false], [624, 0.012426, ".\n", false], [429, 0.01229, " that", false]]]}, "raw_delta": 0.025621891021728516, "tuned_delta": 0.032434168828826465}, {"byte_start": 2915, "byte_end": 2918, "display": {"text": " AI", "kind": "normal"}, "is_word": true, "word_id": 496, "word_key": " ai", "bytes_hex": "20 41 49", "compression": {"rwkv": "4.46% 4.46% 4.46%", "qwen": "9.37% 9.37% 9.37%"}, "model_tokens": {"rwkv": [[3609, " AI", "normal", 0.47680994868278503]], "qwen": [[15235, " AI", "normal", 0.210323303937912]]}, "loss": {"rwkv": 4.461459273582406, "qwen": 9.372163745210477}, "topk": {"rwkv": [3609, 1, 0.47680994868278503, [[3609, 0.47681, " AI", false], [332, 0.078321, " a", false], [22590, 0.06558, " the", false], [51832, 0.043926, " general", false], [4419, 0.027652, " an", false], [52949, 0.023132, " solving", false], [52167, 0.017134, " machine", false], [46588, 0.016665, " modern", false], [61594, 0.015962, " artificial", false], [32448, 0.013318, " ways", false]]], "qwen": [15235, 1, 0.210323303937912, [[15235, 0.210323, " AI", false], [264, 0.094458, " a", false], [279, 0.078566, " the", false], [4586, 0.072917, " general", false], [458, 0.063759, " an", false], [5662, 0.041125, " machine", false], [1973, 0.030933, " order", false], [20443, 0.024568, " artificial", false], [71278, 0.022122, " reinforcement", false], [2711, 0.017161, " search", false]]]}, "raw_delta": -0.27230727672576904, "tuned_delta": -0.2654949989186711}, {"byte_start": 2918, "byte_end": 2927, "display": {"text": " research", "kind": "normal"}, "is_word": true, "word_id": 497, "word_key": " research", "bytes_hex": "20 72 65 73 65 61 72 63 68", "compression": {"rwkv": "2.82% 2.82% 2.82% 2.82% 2.82% 2.82% 2.82% 2.82% 2.82%", "qwen": "4.03% 4.03% 4.03% 4.03% 4.03% 4.03% 4.03% 4.03% 4.03%"}, "model_tokens": {"rwkv": [[57103, " research", "normal", 0.2472943216562271]], "qwen": [[3412, " research", "normal", 0.1335524618625641]]}, "loss": {"rwkv": 2.8177637517362566, "qwen": 4.034057544249869}, "topk": {"rwkv": [57103, 2, 0.2472943216562271, [[47, 0.469579, ".", false], [57103, 0.247294, " research", false], [45, 0.125734, ",", false], [53087, 0.029659, " systems", false], [52224, 0.022049, " methods", false], [21265, 0.013362, " and", false], [56949, 0.012616, " programs", false], [60, 0.008792, ";", false], [275, 0.00632, " (", false], [45124, 0.00406, " agents", false]]], "qwen": [3412, 4, 0.1335524618625641, [[13, 0.313332, ".", false], [382, 0.201284, ".\n\n", false], [11, 0.157925, ",", false], [3412, 0.133552, " research", false], [5942, 0.023116, " systems", false], [26, 0.020041, ";", false], [5322, 0.018045, " problems", false], [323, 0.016884, " and", false], [624, 0.013142, ".\n", false], [8357, 0.010693, " applications", false]]]}, "raw_delta": -0.06744564904106987, "tuned_delta": -0.06063337123397192}, {"byte_start": 2927, "byte_end": 2928, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "5.04%", "qwen": "15.99%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.7559685707092285]], "qwen": [[13, ".", "normal", 0.41206297278404236]]}, "loss": {"rwkv": 5.036752706228558, "qwen": 15.988290820159683}, "topk": {"rwkv": [47, 1, 0.7559685707092285, [[47, 0.755969, ".", false], [45, 0.163603, ",", false], [21265, 0.01469, " and", false], [60, 0.011694, ";", false], [275, 0.010936, " (", false], [39971, 0.005906, " today", false], [51018, 0.003865, " because", false], [56949, 0.003331, " programs", false], [4596, 0.003011, " in", false], [59, 0.00301, ":", false]]], "qwen": [13, 1, 0.41206297278404236, [[13, 0.412063, ".", false], [382, 0.242195, ".\n\n", false], [11, 0.20158, ",", false], [323, 0.02533, " and", false], [3351, 0.02175, " today", false], [26, 0.021355, ";", false], [624, 0.019663, ".\n", false], [320, 0.01351, " (", false], [4192, 0.003885, ".\n\n\n", false], [25, 0.003144, ":", false]]]}, "raw_delta": -0.6072822213172913, "tuned_delta": -0.6004699435101933}, {"byte_start": 2928, "byte_end": 2931, "display": {"text": " In", "kind": "normal"}, "is_word": true, "word_id": 498, "word_key": " in", "bytes_hex": "20 49 6e", "compression": {"rwkv": "21.13% 21.13% 21.13%", "qwen": "18.27% 18.27% 18.27%"}, "model_tokens": {"rwkv": [[3913, " In", "normal", 0.029720166698098183]], "qwen": [[758, " In", "normal", 0.047852978110313416]]}, "loss": {"rwkv": 21.133228138021924, "qwen": 18.27186391791443}, "topk": {"rwkv": [3913, 5, 0.029720166698098183, [[261, 0.425959, "\n\n", false], [20996, 0.064912, " The", false], [267, 0.042914, "  ", false], [29893, 0.042693, " They", false], [3913, 0.02972, " In", false], [44844, 0.023084, " Search", false], [3918, 0.020533, " It", false], [19417, 0.018159, " And", false], [28530, 0.017083, " Both", false], [19555, 0.016546, " But", false]]], "qwen": [758, 3, 0.047852978110313416, [[220, 0.127926, " ", false], [576, 0.096576, " The", false], [758, 0.047853, " In", false], [2379, 0.047493, " They", false], [7542, 0.038321, " Search", false], [1084, 0.034894, " It", false], [320, 0.028448, " (", false], [2619, 0.024459, " There", false], [4220, 0.018994, " These", false], [11733, 0.018804, " Both", false]]]}, "raw_delta": 0.15866772333780932, "tuned_delta": 0.16548000114490727}, {"byte_start": 2931, "byte_end": 2940, "display": {"text": " computer", "kind": "normal"}, "is_word": true, "word_id": 499, "word_key": " computer", "bytes_hex": "20 63 6f 6d 70 75 74 65 72", "compression": {"rwkv": "5.89% 5.89% 5.89% 5.89% 5.89% 5.89% 5.89% 5.89% 5.89%", "qwen": "5.53% 5.53% 5.53% 5.53% 5.53% 5.53% 5.53% 5.53% 5.53%"}, "model_tokens": {"rwkv": [[55809, " computer", "normal", 0.052670981734991074]], "qwen": [[6366, " computer", "normal", 0.06315793842077255]]}, "loss": {"rwkv": 5.885995392515736, "qwen": 5.534572731956873}, "topk": {"rwkv": [55809, 4, 0.052670981734991074, [[22590, 0.167844, " the", false], [30322, 0.102213, " both", false], [38013, 0.099223, " chess", false], [55809, 0.052671, " computer", false], [30808, 0.049141, " fact", false], [56901, 0.047145, " practice", false], [32234, 0.033135, " this", false], [31370, 0.030783, " many", false], [51832, 0.024932, " general", false], [30719, 0.022493, " each", false]]], "qwen": [6366, 4, 0.06315793842077255, [[279, 0.183702, " the", false], [5994, 0.095047, " Go", false], [2097, 0.085396, " fact", false], [6366, 0.063158, " computer", false], [32719, 0.061677, " chess", false], [1657, 0.046327, " many", false], [2176, 0.041075, " both", false], [419, 0.034534, " this", false], [1045, 0.029164, " some", false], [264, 0.025614, " a", false]]]}, "raw_delta": 0.019487010108100056, "tuned_delta": 0.026299287915198002}, {"byte_start": 2940, "byte_end": 2943, "display": {"text": " Go", "kind": "normal"}, "is_word": true, "word_id": 500, "word_key": " go", "bytes_hex": "20 47 6f", "compression": {"rwkv": "3.69% 3.69% 3.69%", "qwen": "0.47% 0.47% 0.47%"}, "model_tokens": {"rwkv": [[3851, " Go", "normal", 0.5442687273025513]], "qwen": [[5994, " Go", "normal", 0.924994945526123]]}, "loss": {"rwkv": 3.6865742418549354, "qwen": 0.468677580468661}, "topk": {"rwkv": [3851, 1, 0.5442687273025513, [[3851, 0.544269, " Go", false], [38013, 0.298116, " chess", false], [38576, 0.061463, " games", false], [46, 0.029922, "-", false], [52814, 0.017359, " science", false], [36466, 0.008353, " Chess", false], [47202, 0.003445, " search", false], [30941, 0.002501, " game", false], [52491, 0.002408, " playing", false], [47732, 0.002395, " vision", false]]], "qwen": [5994, 1, 0.924994945526123, [[5994, 0.924995, " Go", false], [32719, 0.050755, " chess", false], [3868, 0.005219, " games", false], [11129, 0.002533, " vision", false], [728, 0.001525, " go", false], [19926, 0.001371, "-go", false], [20814, 0.001265, " poker", false], [1809, 0.000784, " game", false], [8038, 0.000777, " science", false], [47387, 0.00046, " Chess", false]]]}, "raw_delta": 0.1784380798538526, "tuned_delta": 0.18525035766095055}, {"byte_start": 2943, "byte_end": 2944, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "3.22%", "qwen": "2.89%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.8358439207077026]], "qwen": [[11, ",", "normal", 0.851840615272522]]}, "loss": {"rwkv": 3.2228172910483432, "qwen": 2.891806851221859}, "topk": {"rwkv": [45, 1, 0.8358439207077026, [[45, 0.835844, ",", false], [21265, 0.04589, " and", false], [22590, 0.02593, " the", false], [4423, 0.011928, " as", false], [39934, 0.011436, " there", false], [275, 0.007951, " (", false], [4601, 0.007844, " it", false], [4596, 0.0054, " in", false], [32232, 0.004526, " they", false], [4424, 0.003126, " at", false]]], "qwen": [11, 1, 0.851840615272522, [[11, 0.851841, ",", false], [323, 0.023537, " and", false], [279, 0.017421, " the", false], [304, 0.013813, " in", false], [320, 0.009807, " (", false], [1052, 0.006973, " there", false], [432, 0.005671, " it", false], [419, 0.004637, " this", false], [1493, 0.004015, " these", false], [807, 0.003892, " they", false]]]}, "raw_delta": 0.0183551162481308, "tuned_delta": 0.025167394055228744}, {"byte_start": 2944, "byte_end": 2947, "display": {"text": " as", "kind": "normal"}, "is_word": true, "word_id": 501, "word_key": " as", "bytes_hex": "20 61 73", "compression": {"rwkv": "15.12% 15.12% 15.12%", "qwen": "17.78% 17.78% 17.78%"}, "model_tokens": {"rwkv": [[4423, " as", "normal", 0.08035154640674591]], "qwen": [[438, " as", "normal", 0.05194857344031334]]}, "loss": {"rwkv": 15.121998800984576, "qwen": 17.778216382387882}, "topk": {"rwkv": [4423, 3, 0.08035154640674591, [[22590, 0.242481, " the", false], [56537, 0.089831, " learning", false], [4423, 0.080352, " as", false], [47202, 0.079444, " search", false], [4601, 0.050511, " it", false], [39936, 0.035352, " these", false], [21265, 0.025398, " and", false], [51948, 0.02536, " however", false], [32232, 0.023504, " they", false], [332, 0.020452, " a", false]]], "qwen": [438, 5, 0.05194857344031334, [[279, 0.195139, " the", false], [2711, 0.096289, " search", false], [6832, 0.074085, " learning", false], [1493, 0.066387, " these", false], [438, 0.051949, " as", false], [264, 0.029, " a", false], [432, 0.028833, " it", false], [2176, 0.024597, " both", false], [807, 0.023639, " they", false], [3738, 0.018343, " human", false]]]}, "raw_delta": -0.14729197820027673, "tuned_delta": -0.14047970039317878}, {"byte_start": 2947, "byte_end": 2950, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 502, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "0.72% 0.72% 0.72%", "qwen": "1.53% 1.53% 1.53%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.8860278725624084]], "qwen": [[304, " in", "normal", 0.7752819657325745]]}, "loss": {"rwkv": 0.7220519613824157, "qwen": 1.530029321513405}, "topk": {"rwkv": [4596, 1, 0.8860278725624084, [[4596, 0.886028, " in", false], [32458, 0.030806, " well", false], [32487, 0.024695, " with", false], [4601, 0.008303, " it", false], [59608, 0.005251, " elsewhere", false], [22748, 0.004379, " was", false], [332, 0.003296, " a", false], [4600, 0.002961, " is", false], [22590, 0.00238, " the", false], [22190, 0.002072, " now", false]]], "qwen": [304, 1, 0.7752819657325745, [[304, 0.775282, " in", false], [1632, 0.065017, " well", false], [448, 0.045322, " with", false], [17920, 0.014089, " elsewhere", false], [432, 0.009485, " it", false], [264, 0.008159, " a", false], [374, 0.007507, " is", false], [369, 0.007215, " for", false], [279, 0.006596, " the", false], [807, 0.004535, " they", false]]]}, "raw_delta": -0.044803778330485024, "tuned_delta": -0.037991500523387074}, {"byte_start": 2950, "byte_end": 2959, "display": {"text": " computer", "kind": "normal"}, "is_word": true, "word_id": 503, "word_key": " computer", "bytes_hex": "20 63 6f 6d 70 75 74 65 72", "compression": {"rwkv": "2.30% 2.30% 2.30% 2.30% 2.30% 2.30% 2.30% 2.30% 2.30%", "qwen": "2.47% 2.47% 2.47% 2.47% 2.47% 2.47% 2.47% 2.47% 2.47%"}, "model_tokens": {"rwkv": [[55809, " computer", "normal", 0.3146480917930603]], "qwen": [[6366, " computer", "normal", 0.29155558347702026]]}, "loss": {"rwkv": 2.301173730584609, "qwen": 2.4696627449869744}, "topk": {"rwkv": [55809, 2, 0.3146480917930603, [[38013, 0.422919, " chess", false], [55809, 0.314648, " computer", false], [31370, 0.07201, " many", false], [39193, 0.035737, " other", false], [22590, 0.030681, " the", false], [3609, 0.014306, " AI", false], [31461, 0.014234, " most", false], [21256, 0.011483, " all", false], [4788, 0.004774, " so", false], [36466, 0.004553, " Chess", false]]], "qwen": [6366, 2, 0.29155558347702026, [[32719, 0.383288, " chess", false], [6366, 0.291556, " computer", false], [1657, 0.098925, " many", false], [1008, 0.058122, " other", false], [678, 0.038657, " all", false], [279, 0.024456, " the", false], [1429, 0.023449, " most", false], [773, 0.022911, " so", false], [1753, 0.004562, " much", false], [5994, 0.004359, " Go", false]]]}, "raw_delta": -0.009343014823065876, "tuned_delta": -0.002530737015967929}, {"byte_start": 2959, "byte_end": 2965, "display": {"text": " chess", "kind": "normal"}, "is_word": true, "word_id": 504, "word_key": " chess", "bytes_hex": "20 63 68 65 73 73", "compression": {"rwkv": "0.08% 0.08% 0.08% 0.08% 0.08% 0.08%", "qwen": "0.04% 0.04% 0.04% 0.04% 0.04% 0.04%"}, "model_tokens": {"rwkv": [[38013, " chess", "normal", 0.9746769666671753]], "qwen": [[32719, " chess", "normal", 0.9878679513931274]]}, "loss": {"rwkv": 0.07741512390837892, "qwen": 0.03668731444912257}, "topk": {"rwkv": [38013, 1, 0.9746769666671753, [[38013, 0.974677, " chess", false], [36466, 0.018197, " Chess", false], [46, 0.001293, "-", false], [47202, 0.001249, " search", false], [3851, 0.000997, " Go", false], [39311, 0.000438, " poker", false], [38576, 0.000348, " games", false], [51180, 0.00018, " checker", false], [20660, 0.000109, " Pok", false], [3609, 9.1e-05, " AI", false]]], "qwen": [32719, 1, 0.9878679513931274, [[32719, 0.987868, " chess", false], [47387, 0.003848, " Chess", false], [20814, 0.001194, " poker", false], [5994, 0.001027, " Go", false], [1779, 0.00058, " check", false], [1182, 0.000245, " back", false], [14164, 0.000241, " bridge", false], [3868, 0.000149, " games", false], [11129, 0.00014, " vision", false], [61447, 0.000136, " tic", false]]]}, "raw_delta": 0.0022584293037652965, "tuned_delta": 0.009070707110863243}, {"byte_start": 2965, "byte_end": 2966, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "0.69%", "qwen": "1.98%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.9626989364624023]], "qwen": [[11, ",", "normal", 0.8959089517593384]]}, "loss": {"rwkv": 0.6868299144857125, "qwen": 1.9821993443024535}, "topk": {"rwkv": [45, 1, 0.9626989364624023, [[45, 0.962699, ",", false], [21265, 0.011953, " and", false], [45285, 0.00631, " before", false], [275, 0.005648, " (", false], [4596, 0.001931, " in", false], [332, 0.00102, " a", false], [22590, 0.000868, " the", false], [51551, 0.000689, " earlier", false], [4424, 0.000441, " at", false], [39934, 0.000439, " there", false]]], "qwen": [11, 1, 0.8959089517593384, [[11, 0.895909, ",", false], [323, 0.048074, " and", false], [1573, 0.013162, " before", false], [304, 0.009898, " in", false], [320, 0.009069, " (", false], [518, 0.001852, " at", false], [369, 0.00163, " for", false], [220, 0.001625, " ", false], [264, 0.001368, " a", false], [4867, 0.00135, " prior", false]]]}, "raw_delta": -0.07183053344488144, "tuned_delta": -0.06501825563778349}, {"byte_start": 2966, "byte_end": 2978, "display": {"text": " researchers", "kind": "normal"}, "is_word": true, "word_id": 505, "word_key": " researchers", "bytes_hex": "20 72 65 73 65 61 72 63 68 65 72 73", "compression": {"rwkv": "6.62% 6.62% 6.62% 6.62% 6.62% 6.62% 6.62% 6.62% 6.62% 6.62% 6.62% 6.62%", "qwen": "7.09% 7.09% 7.09% 7.09% 7.09% 7.09% 7.09% 7.09% 7.09% 7.09% 7.09% 7.09%"}, "model_tokens": {"rwkv": [[63843, " researchers", "normal", 0.012493818998336792]], "qwen": [[11811, " researchers", "normal", 0.008952687494456768]]}, "loss": {"rwkv": 6.621744816580202, "qwen": 7.086940688899014}, "topk": {"rwkv": [63843, 11, 0.012493818998336792, [[22590, 0.378658, " the", false], [47202, 0.070844, " search", false], [56537, 0.059059, " learning", false], [4601, 0.05407, " it", false], [39936, 0.049599, " these", false], [39934, 0.040103, " there", false], [38720, 0.03863, " human", false], [332, 0.017467, " a", false], [32232, 0.013832, " they", false], [52224, 0.013441, " methods", false]]], "qwen": [11811, 15, 0.008952687494456768, [[279, 0.266813, " the", false], [2711, 0.094763, " search", false], [6832, 0.081794, " learning", false], [1493, 0.067788, " these", false], [432, 0.04355, " it", false], [3738, 0.03791, " human", false], [1052, 0.033235, " there", false], [264, 0.026297, " a", false], [64098, 0.019366, " brute", false], [807, 0.017445, " they", false]]]}, "raw_delta": -0.025795936584472656, "tuned_delta": -0.01898365877737471}, {"byte_start": 2978, "byte_end": 2979, "display": {"text": "'", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "27", "compression": {"rwkv": "56.92%", "qwen": "79.26%"}, "model_tokens": {"rwkv": [[40, "'", "normal", 0.042486514896154404]], "qwen": [[6, "'", "normal", 0.012339101172983646]]}, "loss": {"rwkv": 56.91882778507238, "qwen": 79.25774029696802}, "topk": {"rwkv": [40, 3, 0.042486514896154404, [[22762, 0.241989, " who", false], [32462, 0.086339, " were", false], [40, 0.042487, "'", false], [21795, 0.039932, " had", false], [21532, 0.025365, " did", false], [59868, 0.023382, " initially", false], [32487, 0.021912, " with", false], [31059, 0.021281, " have", false], [52112, 0.01602, " learned", false], [32227, 0.013872, " that", false]]], "qwen": [6, 12, 0.012339101172983646, [[879, 0.154815, " who", false], [1033, 0.119077, " were", false], [1030, 0.043249, " had", false], [614, 0.031094, " have", false], [9498, 0.030262, " learned", false], [304, 0.020639, " in", false], [15102, 0.018902, " initially", false], [525, 0.017185, " are", false], [1521, 0.016844, " did", false], [9583, 0.01548, " eventually", false]]]}, "raw_delta": -1.2387323379516602, "tuned_delta": -1.2319200601445621}, {"byte_start": 2979, "byte_end": 2987, "display": {"text": " initial", "kind": "normal"}, "is_word": true, "word_id": 506, "word_key": " initial", "bytes_hex": "20 69 6e 69 74 69 61 6c", "compression": {"rwkv": "5.32% 5.32% 5.32% 5.32% 5.32% 5.32% 5.32% 5.32%", "qwen": "4.61% 4.61% 4.61% 4.61% 4.61% 4.61% 4.61% 4.61%"}, "model_tokens": {"rwkv": [[52013, " initial", "normal", 0.09523221850395203]], "qwen": [[2856, " initial", "normal", 0.12912534177303314]]}, "loss": {"rwkv": 5.3185290814021835, "qwen": 4.614306346456402}, "topk": {"rwkv": [52013, 1, 0.09523221850395203, [[52013, 0.095232, " initial", false], [62157, 0.074228, " investment", false], [38720, 0.07165, " human", false], [51566, 0.052047, " efforts", false], [63678, 0.026115, " investments", false], [61701, 0.025266, " commitment", false], [64997, 0.02234, " psychological", false], [45294, 0.020815, " belief", false], [55572, 0.0187, " attempts", false], [65034, 0.018214, " understanding", false]]], "qwen": [2856, 1, 0.12912534177303314, [[2856, 0.129125, " initial", false], [7901, 0.106858, " failure", false], [3738, 0.028307, " human", false], [8660, 0.017108, " understanding", false], [40598, 0.014864, " disappointment", false], [82950, 0.014519, " reluctance", false], [6853, 0.014486, " lack", false], [5244, 0.013037, " focus", false], [8869, 0.011784, " efforts", false], [27850, 0.01027, " failures", false]]]}, "raw_delta": 0.039050400257110596, "tuned_delta": 0.045862678064208545}, {"byte_start": 2987, "byte_end": 2994, "display": {"text": " effort", "kind": "normal"}, "is_word": true, "word_id": 507, "word_key": " effort", "bytes_hex": "20 65 66 66 6f 72 74", "compression": {"rwkv": "13.77% 13.77% 13.77% 13.77% 13.77% 13.77% 13.77%", "qwen": "11.72% 11.72% 11.72% 11.72% 11.72% 11.72% 11.72%"}, "model_tokens": {"rwkv": [[45829, " effort", "normal", 0.004769123159348965]], "qwen": [[5041, " effort", "normal", 0.010584041476249695]]}, "loss": {"rwkv": 13.766788615625707, "qwen": 11.717795912378751}, "topk": {"rwkv": [45829, 34, 0.004769123159348965, [[51566, 0.160158, " efforts", false], [62157, 0.104376, " investment", false], [63678, 0.049886, " investments", false], [38530, 0.048241, " focus", false], [62500, 0.028342, " resistance", false], [61701, 0.027491, " commitment", false], [55572, 0.024938, " attempts", false], [57077, 0.023075, " reliance", false], [62476, 0.018669, " reluctance", false], [61590, 0.018181, " approaches", false]]], "qwen": [5041, 17, 0.010584041476249695, [[8869, 0.090965, " efforts", false], [7901, 0.074317, " failure", false], [5244, 0.066832, " focus", false], [40598, 0.032757, " disappointment", false], [15155, 0.032682, " commitment", false], [9162, 0.03148, " investment", false], [16396, 0.029786, " belief", false], [82950, 0.02839, " reluctance", false], [13553, 0.028032, " attempts", false], [3738, 0.026329, " human", false]]]}, "raw_delta": 0.11362028121948242, "tuned_delta": 0.12043255902658037}, {"byte_start": 2994, "byte_end": 2998, "display": {"text": " was", "kind": "normal"}, "is_word": true, "word_id": 508, "word_key": " was", "bytes_hex": "20 77 61 73", "compression": {"rwkv": "5.49% 5.49% 5.49% 5.49%", "qwen": "4.65% 4.65% 4.65% 4.65%"}, "model_tokens": {"rwkv": [[22748, " was", "normal", 0.29335394501686096]], "qwen": [[572, " was", "normal", 0.3565994203090668]]}, "loss": {"rwkv": 5.4946393158857, "qwen": 4.648823801930352}, "topk": {"rwkv": [22748, 1, 0.29335394501686096, [[22748, 0.293354, " was", false], [4811, 0.164143, " to", false], [4424, 0.114988, " at", false], [32460, 0.074201, " went", false], [4596, 0.044523, " in", false], [51770, 0.024527, " focused", false], [4712, 0.022194, " on", false], [31162, 0.02127, " into", false], [47518, 0.017698, " tended", false], [21795, 0.014511, " had", false]]], "qwen": [572, 1, 0.3565994203090668, [[572, 0.356599, " was", false], [311, 0.163238, " to", false], [304, 0.111005, " in", false], [3937, 0.058702, " went", false], [10735, 0.040209, " focused", false], [518, 0.027906, " at", false], [1521, 0.01743, " did", false], [1033, 0.015174, " were", false], [1030, 0.009388, " had", false], [11, 0.009278, ",", false]]]}, "raw_delta": 0.046901971101760864, "tuned_delta": 0.053714248908858814}, {"byte_start": 2998, "byte_end": 3007, "display": {"text": " directed", "kind": "normal"}, "is_word": true, "word_id": 509, "word_key": " directed", "bytes_hex": "20 64 69 72 65 63 74 65 64", "compression": {"rwkv": "6.42% 6.42% 6.42% 6.42% 6.42% 6.42% 6.42% 6.42% 6.42%", "qwen": "7.23% 7.23% 7.23% 7.23% 7.23% 7.23% 7.23% 7.23% 7.23%"}, "model_tokens": {"rwkv": [[56002, " directed", "normal", 0.04088252782821655]], "qwen": [[15540, " directed", "normal", 0.02707730233669281]]}, "loss": {"rwkv": 6.418239656732583, "qwen": 7.231627782151552}, "topk": {"rwkv": [56002, 9, 0.04088252782821655, [[4811, 0.17133, " to", false], [39762, 0.083219, " spent", false], [22187, 0.06898, " not", false], [51459, 0.059453, " devoted", false], [4596, 0.059381, " in", false], [51770, 0.052947, " focused", false], [37810, 0.051365, " based", false], [4712, 0.043837, " on", false], [56002, 0.040883, " directed", false], [56495, 0.028951, " invested", false]]], "qwen": [15540, 6, 0.02707730233669281, [[311, 0.359191, " to", false], [3118, 0.063251, " based", false], [304, 0.062321, " in", false], [10735, 0.050541, " focused", false], [537, 0.040582, " not", false], [15540, 0.027077, " directed", false], [13771, 0.021218, " largely", false], [7391, 0.021157, " spent", false], [28229, 0.019022, " devoted", false], [38828, 0.016841, " wasted", false]]]}, "raw_delta": -0.0451038148668077, "tuned_delta": -0.03829153705970975}, {"byte_start": 3007, "byte_end": 3015, "display": {"text": " towards", "kind": "normal"}, "is_word": true, "word_id": 510, "word_key": " towards", "bytes_hex": "20 74 6f 77 61 72 64 73", "compression": {"rwkv": "4.26% 4.26% 4.26% 4.26% 4.26% 4.26% 4.26% 4.26%", "qwen": "5.04% 5.04% 5.04% 5.04% 5.04% 5.04% 5.04% 5.04%"}, "model_tokens": {"rwkv": [[53169, " towards", "normal", 0.14893095195293427]], "qwen": [[6974, " towards", "normal", 0.10707979649305344]]}, "loss": {"rwkv": 4.2618676745010875, "qwen": 5.036315225360426}, "topk": {"rwkv": [53169, 3, 0.14893095195293427, [[4424, 0.339084, " at", false], [47585, 0.241748, " toward", false], [53169, 0.148931, " towards", false], [4811, 0.114099, " to", false], [30211, 0.042948, " away", false], [50870, 0.016265, " against", false], [60247, 0.012903, " primarily", false], [4596, 0.008032, " in", false], [45145, 0.007536, " almost", false], [4450, 0.006558, " by", false]]], "qwen": [6974, 3, 0.10707979649305344, [[518, 0.484283, " at", false], [8841, 0.184966, " toward", false], [6974, 0.10708, " towards", false], [311, 0.043649, " to", false], [2348, 0.037031, " against", false], [3123, 0.022275, " away", false], [15503, 0.014535, " primarily", false], [304, 0.010548, " in", false], [537, 0.00793, " not", false], [803, 0.007657, " more", false]]]}, "raw_delta": -0.042944490909576416, "tuned_delta": -0.036132213102478467}, {"byte_start": 3015, "byte_end": 3025, "display": {"text": " utilizing", "kind": "normal"}, "is_word": true, "word_id": 511, "word_key": " utilizing", "bytes_hex": "20 75 74 69 6c 69 7a 69 6e 67", "compression": {"rwkv": "11.27% 11.27% 11.27% 11.27% 11.27% 11.27% 11.27% 11.27% 11.27% 11.27%", "qwen": "10.55% 10.55% 10.55% 10.55% 10.55% 10.55% 10.55% 10.55% 10.55% 10.55%"}, "model_tokens": {"rwkv": [[60720, " utilizing", "normal", 0.0019067571265622973]], "qwen": [[34888, " utilizing", "normal", 0.002871462842449546]]}, "loss": {"rwkv": 11.271055006945026, "qwen": 10.554998360771686}, "topk": {"rwkv": [60720, 40, 0.0019067571265622973, [[52224, 0.188454, " methods", false], [38720, 0.119853, " human", false], [22590, 0.101488, " the", false], [47202, 0.094247, " search", false], [38888, 0.053468, " lever", false], [55586, 0.042144, " avoiding", false], [61590, 0.023955, " approaches", false], [332, 0.021149, " a", false], [61984, 0.015551, " exploiting", false], [60463, 0.014171, " searching", false]]], "qwen": [34888, 40, 0.002871462842449546, [[5413, 0.125822, " methods", false], [3738, 0.120421, " human", false], [76482, 0.10533, " leveraging", false], [2711, 0.053487, " search", false], [279, 0.053393, " the", false], [30426, 0.041448, " avoiding", false], [264, 0.034367, " a", false], [70601, 0.029746, " exploiting", false], [1667, 0.025237, " using", false], [6832, 0.024637, " learning", false]]]}, "raw_delta": 0.0397066116333008, "tuned_delta": 0.04651888944039875}, {"byte_start": 3025, "byte_end": 3031, "display": {"text": " human", "kind": "normal"}, "is_word": true, "word_id": 512, "word_key": " human", "bytes_hex": "20 68 75 6d 61 6e", "compression": {"rwkv": "1.09% 1.09% 1.09% 1.09% 1.09% 1.09%", "qwen": "1.52% 1.52% 1.52% 1.52% 1.52% 1.52%"}, "model_tokens": {"rwkv": [[38720, " human", "normal", 0.7011746168136597]], "qwen": [[3738, " human", "normal", 0.6021825075149536]]}, "loss": {"rwkv": 1.0860131126483488, "qwen": 1.5244318236736045}, "topk": {"rwkv": [38720, 1, 0.7011746168136597, [[38720, 0.701175, " human", false], [39931, 0.111335, " their", false], [22590, 0.049385, " the", false], [59943, 0.030756, " knowledge", false], [47202, 0.012437, " search", false], [39936, 0.00565, " these", false], [32464, 0.005092, " what", false], [46227, 0.004809, " humans", false], [52964, 0.004127, " special", false], [332, 0.003964, " a", false]]], "qwen": [3738, 1, 0.6021825075149536, [[3738, 0.602183, " human", false], [279, 0.087118, " the", false], [862, 0.060083, " their", false], [3281, 0.042672, " special", false], [6540, 0.030904, " knowledge", false], [2711, 0.016004, " search", false], [264, 0.011134, " a", false], [34447, 0.00597, " computation", false], [10951, 0.005759, " massive", false], [27076, 0.004542, " specialized", false]]]}, "raw_delta": -0.024311095476150516, "tuned_delta": -0.01749881766905257}, {"byte_start": 3031, "byte_end": 3045, "display": {"text": " understanding", "kind": "normal"}, "is_word": true, "word_id": 513, "word_key": " understanding", "bytes_hex": "20 75 6e 64 65 72 73 74 61 6e 64 69 6e 67", "compression": {"rwkv": "4.33% 4.33% 4.33% 4.33% 4.33% 4.33% 4.33% 4.33% 4.33% 4.33% 4.33% 4.33% 4.33% 4.33%", "qwen": "3.28% 3.28% 3.28% 3.28% 3.28% 3.28% 3.28% 3.28% 3.28% 3.28% 3.28% 3.28% 3.28% 3.28%"}, "model_tokens": {"rwkv": [[65034, " understanding", "normal", 0.034412119537591934]], "qwen": [[8660, " understanding", "normal", 0.07843122631311417]]}, "loss": {"rwkv": 4.327280047309252, "qwen": 3.2789536567374693}, "topk": {"rwkv": [65034, 2, 0.034412119537591934, [[59943, 0.889427, " knowledge", false], [65034, 0.034412, " understanding", false], [59683, 0.017316, " expertise", false], [46, 0.013869, "-", false], [38786, 0.009687, " input", false], [52022, 0.003006, " insight", false], [59917, 0.002779, " intuition", false], [31702, 0.00161, " play", false], [38013, 0.001503, " chess", false], [61979, 0.001253, " experience", false]]], "qwen": [8660, 3, 0.07843122631311417, [[6540, 0.738685, " knowledge", false], [12646, 0.111411, "-k", false], [8660, 0.078431, " understanding", false], [1946, 0.025349, " input", false], [18726, 0.008945, " expertise", false], [323, 0.001976, " and", false], [1995, 0.001632, " information", false], [11229, 0.001501, " intelligence", false], [476, 0.001448, " or", false], [56251, 0.001325, " intuition", false]]]}, "raw_delta": 0.05813155855451313, "tuned_delta": 0.06494383636161108}, {"byte_start": 3045, "byte_end": 3047, "display": {"text": " (", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "20 28", "compression": {"rwkv": "39.73% 39.73%", "qwen": "37.90% 37.90%"}, "model_tokens": {"rwkv": [[275, " (", "normal", 0.011919747106730938]], "qwen": [[320, " (", "normal", 0.01495111733675003]]}, "loss": {"rwkv": 39.73046889948122, "qwen": 37.897516502681846}, "topk": {"rwkv": [275, 8, 0.011919747106730938, [[4706, 0.453403, " of", false], [45, 0.220616, ",", false], [47, 0.075281, ".", false], [21265, 0.069492, " and", false], [4596, 0.042024, " in", false], [47001, 0.034383, " rather", false], [4811, 0.025917, " to", false], [275, 0.01192, " (", false], [4423, 0.010393, " as", false], [52028, 0.006775, " instead", false]]], "qwen": [320, 9, 0.01495111733675003, [[315, 0.460297, " of", false], [11, 0.168162, ",", false], [323, 0.082457, " and", false], [311, 0.07492, " to", false], [13, 0.05549, ".", false], [4751, 0.029435, " rather", false], [476, 0.024722, " or", false], [304, 0.020419, " in", false], [320, 0.014951, " (", false], [4518, 0.007982, " instead", false]]]}, "raw_delta": 0.10164046287536621, "tuned_delta": 0.10845274068246416}, {"byte_start": 3047, "byte_end": 3049, "display": {"text": "so", "kind": "normal"}, "is_word": true, "word_id": 514, "word_key": "so", "bytes_hex": "73 6f", "compression": {"rwkv": "49.59% 49.59%", "qwen": "60.55% 60.55%"}, "model_tokens": {"rwkv": [[2190, "so", "normal", 0.0041105737909674644]], "qwen": [[704, "so", "normal", 0.0012126192450523376]]}, "loss": {"rwkv": 49.59264203055811, "qwen": 60.54785949832613}, "topk": {"rwkv": [2190, 34, 0.0041105737909674644, [[2101, 0.098994, "or", false], [1950, 0.095969, "in", false], [7005, 0.091681, "and", false], [36003, 0.050634, "which", false], [2090, 0.047843, "of", false], [1751, 0.043412, "as", false], [8801, 0.031822, "the", false], [98, 0.021175, "a", false], [102, 0.017657, "e", false], [1782, 0.016691, "by", false]]], "qwen": [704, 78, 0.0012126192450523376, [[269, 0.204208, "or", false], [437, 0.11614, "and", false], [258, 0.054871, "in", false], [300, 0.039512, "as", false], [8206, 0.037719, "which", false], [1782, 0.025826, "the", false], [1055, 0.025452, "of", false], [36141, 0.020878, "although", false], [64, 0.013947, "a", false], [4197, 0.013222, "with", false]]]}, "raw_delta": -0.6074862480163574, "tuned_delta": -0.6006739702092595}, {"byte_start": 3049, "byte_end": 3054, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 515, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"rwkv": "7.07% 7.07% 7.07% 7.07% 7.07%", "qwen": "7.08% 7.08% 7.08% 7.08% 7.08%"}, "model_tokens": {"rwkv": [[32227, " that", "normal", 0.14210288226604462]], "qwen": [[429, " that", "normal", 0.14031538367271423]]}, "loss": {"rwkv": 7.072587016858004, "qwen": 7.083137292575182}, "topk": {"rwkv": [32227, 2, 0.14210288226604462, [[46, 0.334862, "-", false], [32227, 0.142103, " that", false], [4423, 0.097829, " as", false], [45395, 0.072989, " called", false], [32232, 0.05065, " they", false], [22590, 0.02287, " the", false], [45, 0.022553, ",", false], [31466, 0.020772, " much", false], [4601, 0.017283, " it", false], [4811, 0.016514, " to", false]]], "qwen": [429, 2, 0.14031538367271423, [[18900, 0.328651, "-called", false], [429, 0.140315, " that", false], [2598, 0.064618, " called", false], [311, 0.061745, " to", false], [438, 0.047244, " as", false], [807, 0.039029, " they", false], [279, 0.023667, " the", false], [1753, 0.02324, " much", false], [11, 0.019221, ",", false], [432, 0.01812, " it", false]]]}, "raw_delta": -0.0005850315093993697, "tuned_delta": 0.006227246297698577}, {"byte_start": 3054, "byte_end": 3059, "display": {"text": " less", "kind": "normal"}, "is_word": true, "word_id": 516, "word_key": " less", "bytes_hex": "20 6c 65 73 73", "compression": {"rwkv": "26.15% 26.15% 26.15% 26.15% 26.15%", "qwen": "24.53% 24.53% 24.53% 24.53% 24.53%"}, "model_tokens": {"rwkv": [[31277, " less", "normal", 0.0007091802544891834]], "qwen": [[2686, " less", "normal", 0.001113724778406322]]}, "loss": {"rwkv": 26.14884761611246, "qwen": 24.525978046734792}, "topk": {"rwkv": [31277, 93, 0.0007091802544891834, [[22590, 0.211255, " the", false], [47202, 0.112999, " search", false], [32232, 0.106627, " they", false], [4601, 0.058535, " it", false], [332, 0.039342, " a", false], [56537, 0.03259, " learning", false], [38720, 0.027598, " human", false], [45, 0.025461, ",", false], [39931, 0.024177, " their", false], [46227, 0.01593, " humans", false]]], "qwen": [2686, 73, 0.001113724778406322, [[279, 0.20481, " the", false], [807, 0.145276, " they", false], [432, 0.082475, " it", false], [11, 0.045246, ",", false], [3738, 0.043629, " human", false], [264, 0.041135, " a", false], [862, 0.032532, " their", false], [5994, 0.024569, " Go", false], [2711, 0.021499, " search", false], [12677, 0.017729, " humans", false]]]}, "raw_delta": 0.08999099731445304, "tuned_delta": 0.09680327512155099}, {"byte_start": 3059, "byte_end": 3066, "display": {"text": " search", "kind": "normal"}, "is_word": true, "word_id": 517, "word_key": " search", "bytes_hex": "20 73 65 61 72 63 68", "compression": {"rwkv": "6.60% 6.60% 6.60% 6.60% 6.60% 6.60% 6.60%", "qwen": "7.46% 7.46% 7.46% 7.46% 7.46% 7.46% 7.46%"}, "model_tokens": {"rwkv": [[47202, " search", "normal", 0.0774722769856453]], "qwen": [[2711, " search", "normal", 0.05523906648159027]]}, "loss": {"rwkv": 6.601617932639228, "qwen": 7.461012782105671}, "topk": {"rwkv": [47202, 2, 0.0774722769856453, [[63370, 0.333693, " computation", false], [47202, 0.077472, " search", false], [52195, 0.072861, " massive", false], [45829, 0.059866, " effort", false], [32251, 0.038686, " time", false], [56537, 0.035533, " learning", false], [4706, 0.032389, " of", false], [59346, 0.028978, " computing", false], [22748, 0.026339, " was", false], [38720, 0.021184, " human", false]]], "qwen": [2711, 3, 0.05523906648159027, [[34447, 0.337095, " computation", false], [882, 0.062932, " time", false], [2711, 0.055239, " search", false], [3738, 0.054309, " human", false], [5041, 0.049145, " effort", false], [315, 0.041335, " of", false], [54480, 0.029346, " computational", false], [24231, 0.026667, " computing", false], [6366, 0.022173, " computer", false], [572, 0.017356, " was", false]]]}, "raw_delta": -0.04765496935163227, "tuned_delta": -0.04084269154453432}, {"byte_start": 3066, "byte_end": 3070, "display": {"text": " was", "kind": "normal"}, "is_word": true, "word_id": 518, "word_key": " was", "bytes_hex": "20 77 61 73", "compression": {"rwkv": "3.36% 3.36% 3.36% 3.36%", "qwen": "3.46% 3.46% 3.46% 3.46%"}, "model_tokens": {"rwkv": [[22748, " was", "normal", 0.47232913970947266]], "qwen": [[572, " was", "normal", 0.46383416652679443]]}, "loss": {"rwkv": 3.363705478635156, "qwen": 3.463496799460949}, "topk": {"rwkv": [22748, 1, 0.47232913970947266, [[22748, 0.472329, " was", false], [40219, 0.279598, " would", false], [38128, 0.050936, " could", false], [21265, 0.043946, " and", false], [4715, 0.026951, " or", false], [21795, 0.026767, " had", false], [4600, 0.017064, " is", false], [31506, 0.013723, " need", false], [32251, 0.00969, " time", false], [45829, 0.009177, " effort", false]]], "qwen": [572, 1, 0.46383416652679443, [[572, 0.463834, " was", false], [1035, 0.302694, " would", false], [1410, 0.052677, " could", false], [374, 0.044084, " is", false], [2578, 0.036068, " might", false], [5041, 0.022308, " effort", false], [323, 0.013622, " and", false], [11, 0.0084, ",", false], [5980, 0.006814, "-based", false], [1231, 0.005859, " may", false]]]}, "raw_delta": -0.0055336058139801025, "tuned_delta": 0.0012786719931178444}, {"byte_start": 3070, "byte_end": 3077, "display": {"text": " needed", "kind": "normal"}, "is_word": true, "word_id": 519, "word_key": " needed", "bytes_hex": "20 6e 65 65 64 65 64", "compression": {"rwkv": "1.79% 1.79% 1.79% 1.79% 1.79% 1.79% 1.79%", "qwen": "1.83% 1.83% 1.83% 1.83% 1.83% 1.83% 1.83%"}, "model_tokens": {"rwkv": [[46650, " needed", "normal", 0.5043575763702393]], "qwen": [[4362, " needed", "normal", 0.4906936287879944]]}, "loss": {"rwkv": 1.7912926707466197, "qwen": 1.834116965035213}, "topk": {"rwkv": [46650, 1, 0.5043575763702393, [[46650, 0.504358, " needed", false], [57101, 0.337809, " required", false], [60050, 0.124911, " necessary", false], [30666, 0.004856, " done", false], [56500, 0.004459, " involved", false], [55448, 0.004079, " actually", false], [60152, 0.002536, " performed", false], [32354, 0.001662, " used", false], [56895, 0.001336, " possible", false], [37832, 0.001035, " being", false]]], "qwen": [4362, 1, 0.4906936287879944, [[4362, 0.490694, " needed", false], [2567, 0.33809, " required", false], [5871, 0.128202, " necessary", false], [2814, 0.008532, " done", false], [1483, 0.004738, " used", false], [6398, 0.002998, " involved", false], [10660, 0.002806, " performed", false], [3204, 0.00258, " possible", false], [3520, 0.002044, " actually", false], [9251, 0.001293, " applied", false]]]}, "raw_delta": -0.002374683107648587, "tuned_delta": 0.00443759469944936}, {"byte_start": 3077, "byte_end": 3078, "display": {"text": ")", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "29", "compression": {"rwkv": "20.15%", "qwen": "23.27%"}, "model_tokens": {"rwkv": [[42, ")", "normal", 0.3281613290309906]], "qwen": [[8, ")", "normal", 0.27510666847229004]]}, "loss": {"rwkv": 20.147010824914233, "qwen": 23.27421221143226}, "topk": {"rwkv": [42, 2, 0.3281613290309906, [[497, 0.366389, "),", false], [42, 0.328161, ")", false], [499, 0.132854, ").", false], [45, 0.052343, ",", false], [4811, 0.040712, " to", false], [21265, 0.015964, " and", false], [502, 0.010662, ");", false], [4596, 0.008907, " in", false], [4715, 0.008534, " or", false], [21700, 0.007098, " for", false]]], "qwen": [8, 2, 0.27510666847229004, [[701, 0.362747, "),", false], [8, 0.275107, ")", false], [568, 0.237883, ").", false], [11, 0.02339, ",", false], [1215, 0.020628, ");", false], [311, 0.02036, " to", false], [3593, 0.014575, ").\n\n", false], [323, 0.012792, " and", false], [304, 0.004909, " in", false], [369, 0.00392, " for", false]]]}, "raw_delta": -0.1734088659286499, "tuned_delta": -0.16659658812155195}, {"byte_start": 3078, "byte_end": 3082, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 520, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"rwkv": "5.14% 5.14% 5.14% 5.14%", "qwen": "6.03% 6.03% 6.03% 6.03%"}, "model_tokens": {"rwkv": [[21265, " and", "normal", 0.3229995369911194]], "qwen": [[323, " and", "normal", 0.2626458406448364]]}, "loss": {"rwkv": 5.142418846918668, "qwen": 6.02752863447568}, "topk": {"rwkv": [21265, 1, 0.3229995369911194, [[21265, 0.323, " and", false], [47001, 0.275311, " rather", false], [21400, 0.19147, " but", false], [4715, 0.065843, " or", false], [40187, 0.019102, " while", false], [4596, 0.015474, " in", false], [52028, 0.01441, " instead", false], [4423, 0.014306, " as", false], [45285, 0.010042, " before", false], [4811, 0.006011, " to", false]]], "qwen": [323, 2, 0.2626458406448364, [[714, 0.439768, " but", false], [323, 0.262646, " and", false], [4751, 0.118464, " rather", false], [476, 0.043201, " or", false], [4518, 0.016896, " instead", false], [311, 0.012526, " to", false], [304, 0.011211, " in", false], [1177, 0.010443, " --", false], [438, 0.006834, " as", false], [1393, 0.006713, " while", false]]]}, "raw_delta": -0.04908090829849243, "tuned_delta": -0.04226863049139448}, {"byte_start": 3082, "byte_end": 3087, "display": {"text": " only", "kind": "normal"}, "is_word": true, "word_id": 521, "word_key": " only", "bytes_hex": "20 6f 6e 6c 79", "compression": {"rwkv": "11.05% 11.05% 11.05% 11.05% 11.05%", "qwen": "14.81% 14.81% 14.81% 14.81% 14.81%"}, "model_tokens": {"rwkv": [[31581, " only", "normal", 0.046903979033231735]], "qwen": [[1172, " only", "normal", 0.01648406870663166]]}, "loss": {"rwkv": 11.045633906806126, "qwen": 14.806959834583077}, "topk": {"rwkv": [31581, 6, 0.046903979033231735, [[32230, 0.100212, " then", false], [32234, 0.069189, " this", false], [22590, 0.066999, " the", false], [56537, 0.061095, " learning", false], [45, 0.0518, ",", false], [31581, 0.046904, " only", false], [32232, 0.040673, " they", false], [32227, 0.034003, " that", false], [4601, 0.030542, " it", false], [22187, 0.024814, " not", false]]], "qwen": [1172, 13, 0.01648406870663166, [[419, 0.085718, " this", false], [11, 0.082977, ",", false], [1221, 0.072507, " then", false], [279, 0.062896, " the", false], [862, 0.042075, " their", false], [6974, 0.042065, " towards", false], [807, 0.04025, " they", false], [429, 0.037697, " that", false], [537, 0.030036, " not", false], [432, 0.027768, " it", false]]]}, "raw_delta": -0.20857219696044912, "tuned_delta": -0.20175991915335117}, {"byte_start": 3087, "byte_end": 3092, "display": {"text": " much", "kind": "normal"}, "is_word": true, "word_id": 522, "word_key": " much", "bytes_hex": "20 6d 75 63 68", "compression": {"rwkv": "10.88% 10.88% 10.88% 10.88% 10.88%", "qwen": "15.20% 15.20% 15.20% 15.20% 15.20%"}, "model_tokens": {"rwkv": [[31466, " much", "normal", 0.049740489572286606]], "qwen": [[1753, " much", "normal", 0.0147688128054142]]}, "loss": {"rwkv": 10.87656808170195, "qwen": 15.20325601731323}, "topk": {"rwkv": [31466, 3, 0.049740489572286606, [[38869, 0.53006, " later", false], [37634, 0.077764, " after", false], [31466, 0.04974, " much", false], [32230, 0.034081, " then", false], [32465, 0.03098, " when", false], [47205, 0.030019, " second", false], [61552, 0.024582, " afterwards", false], [4596, 0.021238, " in", false], [4424, 0.014392, " at", false], [59771, 0.010485, " gradually", false]]], "qwen": [1753, 8, 0.0147688128054142, [[2937, 0.466931, " later", false], [1283, 0.152772, " after", false], [979, 0.060403, " when", false], [304, 0.04391, " in", false], [1221, 0.033484, " then", false], [264, 0.021305, " a", false], [26024, 0.015625, " gradually", false], [1753, 0.014769, " much", false], [518, 0.01123, " at", false], [3055, 0.008694, " once", false]]]}, "raw_delta": -0.23992252349853516, "tuned_delta": -0.2331102456914372}, {"byte_start": 3092, "byte_end": 3098, "display": {"text": " later", "kind": "normal"}, "is_word": true, "word_id": 523, "word_key": " later", "bytes_hex": "20 6c 61 74 65 72", "compression": {"rwkv": "0.06% 0.06% 0.06% 0.06% 0.06% 0.06%", "qwen": "0.05% 0.05% 0.05% 0.05% 0.05% 0.05%"}, "model_tokens": {"rwkv": [[38869, " later", "normal", 0.979004979133606]], "qwen": [[2937, " later", "normal", 0.9822579026222229]]}, "loss": {"rwkv": 0.0634730636784339, "qwen": 0.053804716338493846}, "topk": {"rwkv": [38869, 1, 0.979004979133606, [[38869, 0.979005, " later", false], [31458, 0.010521, " more", false], [45, 0.001982, ",", false], [46405, 0.001333, " latter", false], [31466, 0.001317, " much", false], [31277, 0.000788, " less", false], [61552, 0.000778, " afterwards", false], [51816, 0.000625, " further", false], [31255, 0.000466, " late", false], [64580, 0.000462, " subsequently", false]]], "qwen": [2937, 1, 0.9822579026222229, [[2937, 0.982258, " later", false], [803, 0.005995, " more", false], [11, 0.003197, ",", false], [5021, 0.002368, " longer", false], [4623, 0.002054, " further", false], [1283, 0.000772, " after", false], [15271, 0.00027, " latter", false], [28393, 0.000231, " slower", false], [2686, 0.000211, " less", false], [8131, 0.000192, " larger", false]]]}, "raw_delta": 0.0005361270159482956, "tuned_delta": 0.0073484048230462425}, {"byte_start": 3098, "byte_end": 3102, "display": {"text": " was", "kind": "normal"}, "is_word": true, "word_id": 524, "word_key": " was", "bytes_hex": "20 77 61 73", "compression": {"rwkv": "9.30% 9.30% 9.30% 9.30%", "qwen": "11.38% 11.38% 11.38% 11.38%"}, "model_tokens": {"rwkv": [[22748, " was", "normal", 0.12753541767597198]], "qwen": [[572, " was", "normal", 0.08012823015451431]]}, "loss": {"rwkv": 9.298620380729647, "qwen": 11.37982973404948}, "topk": {"rwkv": [22748, 2, 0.12753541767597198, [[21532, 0.517645, " did", false], [22748, 0.127535, " was", false], [32462, 0.110271, " were", false], [45, 0.078835, ",", false], [53169, 0.021654, " towards", false], [47585, 0.013872, " toward", false], [275, 0.011637, " (", false], [30383, 0.01014, " came", false], [32232, 0.006742, " they", false], [22590, 0.006285, " the", false]]], "qwen": [572, 3, 0.08012823015451431, [[1521, 0.530067, " did", false], [11, 0.086312, ",", false], [572, 0.080128, " was", false], [1033, 0.063535, " were", false], [6974, 0.045399, " towards", false], [807, 0.045398, " they", false], [320, 0.023243, " (", false], [311, 0.015634, " to", false], [304, 0.007121, " in", false], [6519, 0.006442, " turned", false]]]}, "raw_delta": -0.11540675163269043, "tuned_delta": -0.10859447382559248}, {"byte_start": 3102, "byte_end": 3107, "display": {"text": " much", "kind": "normal"}, "is_word": true, "word_id": 525, "word_key": " much", "bytes_hex": "20 6d 75 63 68", "compression": {"rwkv": "20.29% 20.29% 20.29% 20.29% 20.29%", "qwen": "22.89% 22.89% 22.89% 22.89% 22.89%"}, "model_tokens": {"rwkv": [[31466, " much", "normal", 0.0035604957956820726]], "qwen": [[1753, " much", "normal", 0.0017537848325446248]]}, "loss": {"rwkv": 20.287899012501047, "qwen": 22.88828185302624}, "topk": {"rwkv": [31466, 20, 0.0035604957956820726, [[22590, 0.229891, " the", false], [56537, 0.164994, " learning", false], [4601, 0.159895, " it", false], [47202, 0.073, " search", false], [32234, 0.039346, " this", false], [39934, 0.039259, " there", false], [39931, 0.034851, " their", false], [32227, 0.028804, " that", false], [51832, 0.01772, " general", false], [332, 0.01684, " a", false]]], "qwen": [1753, 29, 0.0017537848325446248, [[279, 0.308798, " the", false], [432, 0.210639, " it", false], [2711, 0.118688, " search", false], [1052, 0.045521, " there", false], [419, 0.039567, " this", false], [264, 0.033565, " a", false], [429, 0.027979, " that", false], [862, 0.023797, " their", false], [807, 0.012551, " they", false], [458, 0.012507, " an", false]]]}, "raw_delta": -0.14419584274291997, "tuned_delta": -0.13738356493582202}, {"byte_start": 3107, "byte_end": 3115, "display": {"text": " greater", "kind": "normal"}, "is_word": true, "word_id": 526, "word_key": " greater", "bytes_hex": "20 67 72 65 61 74 65 72", "compression": {"rwkv": "8.31% 8.31% 8.31% 8.31% 8.31% 8.31% 8.31% 8.31%", "qwen": "5.54% 5.54% 5.54% 5.54% 5.54% 5.54% 5.54% 5.54%"}, "model_tokens": {"rwkv": [[51867, " greater", "normal", 0.02542337216436863]], "qwen": [[7046, " greater", "normal", 0.08576159179210663]]}, "loss": {"rwkv": 8.312403067621956, "qwen": 5.536756792190434}, "topk": {"rwkv": [51867, 6, 0.02542337216436863, [[31458, 0.285203, " more", false], [4706, 0.234896, " of", false], [45829, 0.116271, " effort", false], [47202, 0.047336, " search", false], [59193, 0.030247, " attention", false], [51867, 0.025423, " greater", false], [56537, 0.023253, " learning", false], [31277, 0.021922, " less", false], [57103, 0.017974, " research", false], [45301, 0.015204, " better", false]]], "qwen": [7046, 3, 0.08576159179210663, [[803, 0.497301, " more", false], [315, 0.092637, " of", false], [7046, 0.085762, " greater", false], [2664, 0.043084, " better", false], [8131, 0.034521, " larger", false], [2686, 0.027994, " less", false], [5041, 0.015091, " effort", false], [11243, 0.013299, " bigger", false], [2711, 0.013052, " search", false], [6529, 0.012105, " attention", false]]]}, "raw_delta": 0.15391451120376587, "tuned_delta": 0.16072678901086382}, {"byte_start": 3115, "byte_end": 3123, "display": {"text": " success", "kind": "normal"}, "is_word": true, "word_id": 527, "word_key": " success", "bytes_hex": "20 73 75 63 63 65 73 73", "compression": {"rwkv": "4.65% 4.65% 4.65% 4.65% 4.65% 4.65% 4.65% 4.65%", "qwen": "12.94% 12.94% 12.94% 12.94% 12.94% 12.94% 12.94% 12.94%"}, "model_tokens": {"rwkv": [[53052, " success", "normal", 0.1264445036649704]], "qwen": [[2393, " success", "normal", 0.003210589289665222]]}, "loss": {"rwkv": 4.649310190364823, "qwen": 12.942102936222147}, "topk": {"rwkv": [53052, 3, 0.1264445036649704, [[45829, 0.149013, " effort", false], [56950, 0.13976, " progress", false], [53052, 0.126445, " success", false], [64902, 0.054121, " effectiveness", false], [47202, 0.051464, " search", false], [63370, 0.038013, " computation", false], [64862, 0.033424, " computational", false], [22681, 0.023536, " use", false], [51030, 0.022824, " benefit", false], [59346, 0.021459, " computing", false]]], "qwen": [2393, 21, 0.003210589289665222, [[5041, 0.395522, " effort", false], [24654, 0.16705, " emphasis", false], [2711, 0.120219, " search", false], [6529, 0.045958, " attention", false], [54480, 0.03399, " computational", false], [5244, 0.025252, " focus", false], [990, 0.023858, " use", false], [32064, 0.016879, " leverage", false], [34447, 0.012279, " computation", false], [2355, 0.008149, " power", false]]]}, "raw_delta": -0.4598500728607178, "tuned_delta": -0.45303779505361985}, {"byte_start": 3123, "byte_end": 3127, "display": {"text": " had", "kind": "normal"}, "is_word": true, "word_id": 528, "word_key": " had", "bytes_hex": "20 68 61 64", "compression": {"rwkv": "15.29% 15.29% 15.29% 15.29%", "qwen": "15.10% 15.10% 15.10% 15.10%"}, "model_tokens": {"rwkv": [[21795, " had", "normal", 0.033520761877298355]], "qwen": [[1030, " had", "normal", 0.03509770333766937]]}, "loss": {"rwkv": 15.286368353169191, "qwen": 15.101498827298919}, "topk": {"rwkv": [21795, 6, 0.033520761877298355, [[55437, 0.493712, " achieved", false], [38547, 0.087878, " found", false], [56741, 0.061514, " obtained", false], [57027, 0.056428, " realized", false], [31968, 0.047495, " seen", false], [21795, 0.033521, " had", false], [55571, 0.02799, " attained", false], [4596, 0.021911, " in", false], [56895, 0.015921, " possible", false], [46071, 0.014049, " gained", false]]], "qwen": [1030, 6, 0.03509770333766937, [[16994, 0.519765, " achieved", false], [12180, 0.081078, " obtained", false], [15043, 0.071143, " realized", false], [1730, 0.054407, " found", false], [62160, 0.038328, " attained", false], [1030, 0.035098, " had", false], [18163, 0.021739, " gained", false], [3204, 0.017975, " possible", false], [3884, 0.014565, " seen", false], [1865, 0.014538, " made", false]]]}, "raw_delta": 0.010251343250274658, "tuned_delta": 0.017063621057372604}, {"byte_start": 3127, "byte_end": 3130, "display": {"text": " by", "kind": "normal"}, "is_word": true, "word_id": 529, "word_key": " by", "bytes_hex": "20 62 79", "compression": {"rwkv": "7.56% 7.56% 7.56%", "qwen": "16.99% 16.99% 16.99%"}, "model_tokens": {"rwkv": [[4450, " by", "normal", 0.28584808111190796]], "qwen": [[553, " by", "normal", 0.05922115221619606]]}, "loss": {"rwkv": 7.560999400492288, "qwen": 16.990598901741535}, "topk": {"rwkv": [4450, 2, 0.28584808111190796, [[32487, 0.352672, " with", false], [4450, 0.285848, " by", false], [4596, 0.124189, " in", false], [30917, 0.03221, " from", false], [32465, 0.028811, " when", false], [40085, 0.025599, " using", false], [4712, 0.017037, " on", false], [30259, 0.012608, " been", false], [53140, 0.010713, " through", false], [4811, 0.0081, " to", false]]], "qwen": [553, 4, 0.05922115221619606, [[16994, 0.270542, " achieved", false], [304, 0.08869, " in", false], [311, 0.084446, " to", false], [553, 0.059221, " by", false], [15043, 0.053533, " realized", false], [279, 0.039495, " the", false], [1730, 0.03894, " found", false], [448, 0.024488, " with", false], [13, 0.020905, ".", false], [62160, 0.017123, " attained", false]]]}, "raw_delta": -0.5228880246480305, "tuned_delta": -0.5160757468409326}, {"byte_start": 3130, "byte_end": 3140, "display": {"text": " embracing", "kind": "normal"}, "is_word": true, "word_id": 530, "word_key": " embracing", "bytes_hex": "20 65 6d 62 72 61 63 69 6e 67", "compression": {"rwkv": "9.02% 9.02% 9.02% 9.02% 9.02% 9.02% 9.02% 9.02% 9.02% 9.02%", "qwen": "10.73% 10.73% 10.73% 10.73% 10.73% 10.73% 10.73% 10.73% 10.73% 10.73%"}, "model_tokens": {"rwkv": [[59611, " embracing", "normal", 0.006763958837836981]], "qwen": [[55401, " embracing", "normal", 0.002601034939289093]]}, "loss": {"rwkv": 9.01684400555602, "qwen": 10.733373606767065}, "topk": {"rwkv": [59611, 27, 0.006763958837836981, [[40085, 0.09908, " using", false], [38888, 0.086658, " lever", false], [56537, 0.069912, " learning", false], [22590, 0.055378, " the", false], [60720, 0.05475, " utilizing", false], [47497, 0.041997, " taking", false], [55531, 0.038416, " applying", false], [52224, 0.027183, " methods", false], [332, 0.025437, " a", false], [47285, 0.022547, " simply", false]]], "qwen": [55401, 51, 0.002601034939289093, [[76482, 0.100302, " leveraging", false], [1667, 0.070835, " using", false], [18950, 0.06986, " applying", false], [279, 0.038026, " the", false], [2711, 0.034177, " search", false], [34888, 0.033063, " utilizing", false], [5413, 0.032772, " methods", false], [11811, 0.031422, " researchers", false], [15039, 0.030786, " searching", false], [4633, 0.028974, " taking", false]]]}, "raw_delta": -0.09518461227416997, "tuned_delta": -0.08837233446707202}, {"byte_start": 3140, "byte_end": 3147, "display": {"text": " search", "kind": "normal"}, "is_word": true, "word_id": 531, "word_key": " search", "bytes_hex": "20 73 65 61 72 63 68", "compression": {"rwkv": "1.95% 1.95% 1.95% 1.95% 1.95% 1.95% 1.95%", "qwen": "3.91% 3.91% 3.91% 3.91% 3.91% 3.91% 3.91%"}, "model_tokens": {"rwkv": [[47202, " search", "normal", 0.4736820459365845]], "qwen": [[2711, " search", "normal", 0.21910656988620758]]}, "loss": {"rwkv": 1.9523077422744066, "qwen": 3.9112417303970552}, "topk": {"rwkv": [47202, 1, 0.4736820459365845, [[47202, 0.473682, " search", false], [22590, 0.198306, " the", false], [52195, 0.063341, " massive", false], [56537, 0.043351, " learning", false], [21265, 0.03721, " and", false], [51832, 0.023265, " general", false], [332, 0.022562, " a", false], [63370, 0.015312, " computation", false], [37920, 0.006637, " brute", false], [31458, 0.006364, " more", false]]], "qwen": [2711, 2, 0.21910656988620758, [[279, 0.224037, " the", false], [2711, 0.219107, " search", false], [34447, 0.139735, " computation", false], [10951, 0.126667, " massive", false], [4586, 0.039499, " general", false], [64098, 0.023071, " brute", false], [54480, 0.015243, " computational", false], [264, 0.015111, " a", false], [6832, 0.013645, " learning", false], [3460, 0.010581, " large", false]]]}, "raw_delta": -0.1086263656616211, "tuned_delta": -0.10181408785452314}, {"byte_start": 3147, "byte_end": 3151, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 532, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"rwkv": "7.40% 7.40% 7.40% 7.40%", "qwen": "7.99% 7.99% 7.99% 7.99%"}, "model_tokens": {"rwkv": [[21265, " and", "normal", 0.19319365918636322]], "qwen": [[323, " and", "normal", 0.17001445591449738]]}, "loss": {"rwkv": 7.396629848307673, "qwen": 7.988345832625277}, "topk": {"rwkv": [21265, 2, 0.19319365918636322, [[47, 0.425733, ".", false], [21265, 0.193194, " and", false], [4423, 0.100068, " as", false], [45, 0.050296, ",", false], [275, 0.039217, " (", false], [4596, 0.016643, " in", false], [46, 0.015571, "-", false], [32487, 0.011919, " with", false], [31458, 0.011103, " more", false], [46342, 0.010791, " itself", false]]], "qwen": [323, 3, 0.17001445591449738, [[13, 0.275088, ".", false], [382, 0.179275, ".\n\n", false], [323, 0.170014, " and", false], [11, 0.060514, ",", false], [320, 0.046399, " (", false], [438, 0.042173, " as", false], [518, 0.029792, " at", false], [304, 0.025262, " in", false], [5980, 0.019391, "-based", false], [311, 0.009923, " to", false]]]}, "raw_delta": -0.03281170129776001, "tuned_delta": -0.025999423490662064}, {"byte_start": 3151, "byte_end": 3160, "display": {"text": " learning", "kind": "normal"}, "is_word": true, "word_id": 533, "word_key": " learning", "bytes_hex": "20 6c 65 61 72 6e 69 6e 67", "compression": {"rwkv": "0.79% 0.79% 0.79% 0.79% 0.79% 0.79% 0.79% 0.79% 0.79%", "qwen": "0.85% 0.85% 0.85% 0.85% 0.85% 0.85% 0.85% 0.85% 0.85%"}, "model_tokens": {"rwkv": [[56537, " learning", "normal", 0.6724904775619507]], "qwen": [[6832, " learning", "normal", 0.6542668342590332]]}, "loss": {"rwkv": 0.7866257140263716, "qwen": 0.8500679044303276}, "topk": {"rwkv": [56537, 1, 0.6724904775619507, [[56537, 0.67249, " learning", false], [31978, 0.062366, " self", false], [38888, 0.034824, " lever", false], [22590, 0.026285, " the", false], [21902, 0.019797, " its", false], [45, 0.01, ",", false], [4450, 0.009939, " by", false], [40085, 0.008039, " using", false], [52195, 0.006968, " massive", false], [56540, 0.005964, " leverage", false]]], "qwen": [6832, 1, 0.6542668342590332, [[6832, 0.654267, " learning", false], [656, 0.038117, " self", false], [76482, 0.036463, " leveraging", false], [11, 0.035101, ",", false], [553, 0.017691, " by", false], [1181, 0.015146, " its", false], [1221, 0.013366, " then", false], [279, 0.013133, " the", false], [34447, 0.009518, " computation", false], [1008, 0.007302, " other", false]]]}, "raw_delta": -0.0035179820325639544, "tuned_delta": 0.0032942957745339925}, {"byte_start": 3160, "byte_end": 3162, "display": {"text": ".\n", "kind": "control"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e 0a", "compression": {"rwkv": "6.80% 4.03%", "qwen": "7.92% 7.92%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.689434289932251], [261, "\n\n", "control", 0.6365012526512146]], "qwen": [[382, ".\n\n", "control", 0.2678096890449524]]}, "loss": {"rwkv": 5.4153897103681174, "qwen": 7.919666352489161}, "topk": {"rwkv": [47, 1, 0.689434289932251, [[47, 0.689434, ".", false], [4423, 0.061033, " as", false], [45, 0.043855, ",", false], [4450, 0.03516, " by", false], [275, 0.021523, " (", false], [4596, 0.017862, " in", false], [21265, 0.010853, " and", false], [4811, 0.009701, " to", false], [52028, 0.008804, " instead", false], [31458, 0.008358, " more", false]]], "qwen": [382, 2, 0.2678096890449524, [[13, 0.349543, ".", false], [382, 0.26781, ".\n\n", false], [438, 0.062033, " as", false], [11, 0.042986, ",", false], [320, 0.03386, " (", false], [518, 0.031675, " at", false], [304, 0.026401, " in", false], [553, 0.026048, " by", false], [624, 0.014623, ".\n", false], [311, 0.014055, " to", false]]]}, "raw_delta": -0.1388665835062663, "tuned_delta": -0.13205430569916835}, {"byte_start": 3162, "byte_end": 3163, "display": {"text": "\n", "kind": "control"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "0a", "compression": {"rwkv": "4.03%", "qwen": "7.92%"}, "model_tokens": {"rwkv": [[261, "\n\n", "control", 0.6365012526512146]], "qwen": [[382, ".\n\n", "control", 0.2678096890449524]]}, "loss": {"rwkv": 4.032924369672517, "qwen": 7.919666352489161}, "topk": {"rwkv": [261, 1, 0.6365012526512146, [[261, 0.636501, "\n\n", false], [267, 0.045183, "  ", false], [20996, 0.040955, " The", false], [3913, 0.018841, " In", false], [29894, 0.018792, " This", false], [3918, 0.013663, " It", false], [3336, 0.012496, " \n\n", false], [19417, 0.011234, " And", false], [19555, 0.010483, " But", false], [0, 0.009013, "[0]", false]]], "qwen": [382, 2, 0.2678096890449524, [[13, 0.349543, ".", false], [382, 0.26781, ".\n\n", false], [438, 0.062033, " as", false], [11, 0.042986, ",", false], [320, 0.03386, " (", false], [518, 0.031675, " at", false], [304, 0.026401, " in", false], [553, 0.026048, " by", false], [624, 0.014623, ".\n", false], [311, 0.014055, " to", false]]]}, "raw_delta": -0.2155267397562663, "tuned_delta": -0.20871446194916835}, {"byte_start": 3163, "byte_end": 3165, "display": {"text": "In", "kind": "normal"}, "is_word": true, "word_id": 534, "word_key": "in", "bytes_hex": "49 6e", "compression": {"rwkv": "15.50% 15.50%", "qwen": "14.30% 14.30%"}, "model_tokens": {"rwkv": [[1136, "In", "normal", 0.18105536699295044]], "qwen": [[641, "In", "normal", 0.20481045544147491]]}, "loss": {"rwkv": 15.49770063454941, "qwen": 14.297742208057853}, "topk": {"rwkv": [1136, 1, 0.18105536699295044, [[1136, 0.181055, "In", false], [6699, 0.156454, "The", false], [66, 0.09281, "A", false], [48358, 0.050991, "Another", false], [33504, 0.040894, "There", false], [1141, 0.023755, "It", false], [24242, 0.01541, "This", false], [6393, 0.015201, "One", false], [33505, 0.013902, "These", false], [53454, 0.012258, "Computer", false]]], "qwen": [641, 1, 0.20481045544147491, [[641, 0.20481, "In", false], [785, 0.130888, "The", false], [32, 0.057549, "A", false], [14037, 0.046997, "Another", false], [3862, 0.033794, "There", false], [37332, 0.019945, "Computer", false], [1986, 0.018975, "This", false], [2132, 0.016819, "It", false], [9485, 0.014706, "These", false], [3966, 0.013877, "One", false]]]}, "raw_delta": 0.06653982400894165, "tuned_delta": 0.0733521018160396}, {"byte_start": 3165, "byte_end": 3172, "display": {"text": " speech", "kind": "normal"}, "is_word": true, "word_id": 535, "word_key": " speech", "bytes_hex": "20 73 70 65 65 63 68", "compression": {"rwkv": "13.28% 13.28% 13.28% 13.28% 13.28% 13.28% 13.28%", "qwen": "13.46% 13.46% 13.46% 13.46% 13.46% 13.46% 13.46%"}, "model_tokens": {"rwkv": [[47350, " speech", "normal", 0.005778757389634848]], "qwen": [[8806, " speech", "normal", 0.0053747124038636684]]}, "loss": {"rwkv": 13.283743401042354, "qwen": 13.46356600388949}, "topk": {"rwkv": [47350, 20, 0.005778757389634848, [[55809, 0.354352, " computer", false], [22590, 0.117915, " the", false], [52299, 0.041558, " natural", false], [52766, 0.035278, " robotic", false], [3492, 0.03283, " 19", false], [52167, 0.028848, " machine", false], [3609, 0.020775, " AI", false], [51832, 0.017634, " general", false], [31370, 0.016006, " many", false], [3493, 0.015141, " 20", false]]], "qwen": [8806, 20, 0.0053747124038636684, [[279, 0.194954, " the", false], [6366, 0.167436, " computer", false], [73606, 0.065926, " robotics", false], [71278, 0.027959, " reinforcement", false], [5662, 0.025601, " machine", false], [1657, 0.023437, " many", false], [220, 0.021513, " ", false], [264, 0.018057, " a", false], [678, 0.017338, " all", false], [2176, 0.016811, " both", false]]]}, "raw_delta": -0.009971482413155597, "tuned_delta": -0.00315920460605765}, {"byte_start": 3172, "byte_end": 3184, "display": {"text": " recognition", "kind": "normal"}, "is_word": true, "word_id": 536, "word_key": " recognition", "bytes_hex": "20 72 65 63 6f 67 6e 69 74 69 6f 6e", "compression": {"rwkv": "0.17% 0.17% 0.17% 0.17% 0.17% 0.17% 0.17% 0.17% 0.17% 0.17% 0.17% 0.17%", "qwen": "0.45% 0.45% 0.45% 0.45% 0.45% 0.45% 0.45% 0.45% 0.45% 0.45% 0.45% 0.45%"}, "model_tokens": {"rwkv": [[63821, " recognition", "normal", 0.8912237882614136]], "qwen": [[17843, " recognition", "normal", 0.7405100464820862]]}, "loss": {"rwkv": 0.17170747862142813, "qwen": 0.45146749157513333}, "topk": {"rwkv": [63821, 1, 0.8912237882614136, [[63821, 0.891224, " recognition", false], [21265, 0.023185, " and", false], [45, 0.018448, ",", false], [62378, 0.015231, " processing", false], [46, 0.014512, "-", false], [65034, 0.010347, " understanding", false], [60615, 0.009655, " synthesis", false], [62035, 0.002811, " generation", false], [63944, 0.002718, " translation", false], [62634, 0.001152, " technology", false]]], "qwen": [17843, 1, 0.7405100464820862, [[17843, 0.74051, " recognition", false], [323, 0.073654, " and", false], [38875, 0.037246, " synthesis", false], [11, 0.032458, ",", false], [8692, 0.024103, " processing", false], [8660, 0.015766, " understanding", false], [5440, 0.013933, " technology", false], [3412, 0.010654, " research", false], [59172, 0.008406, "-rec", false], [4686, 0.002944, "-to", false]]]}, "raw_delta": -0.015513189136981964, "tuned_delta": -0.008700911329884018}, {"byte_start": 3184, "byte_end": 3185, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "2.91%", "qwen": "3.65%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.8522300720214844]], "qwen": [[11, ",", "normal", 0.8166376948356628]]}, "loss": {"rwkv": 2.9058188689780144, "qwen": 3.6528986056272403}, "topk": {"rwkv": [45, 1, 0.8522300720214844, [[45, 0.85223, ",", false], [21265, 0.073625, " and", false], [275, 0.010877, " (", false], [22590, 0.009216, " the", false], [57103, 0.008834, " research", false], [39934, 0.0072, " there", false], [53087, 0.003412, " systems", false], [4601, 0.003236, " it", false], [4596, 0.002659, " in", false], [332, 0.002335, " a", false]]], "qwen": [11, 1, 0.8166376948356628, [[11, 0.816638, ",", false], [323, 0.053789, " and", false], [3412, 0.044563, " research", false], [320, 0.024043, " (", false], [304, 0.010581, " in", false], [5942, 0.007971, " systems", false], [1052, 0.004169, " there", false], [279, 0.003158, " the", false], [518, 0.002123, " at", false], [369, 0.002005, " for", false]]]}, "raw_delta": -0.041426897048950195, "tuned_delta": -0.034614619241852246}, {"byte_start": 3185, "byte_end": 3191, "display": {"text": " there", "kind": "normal"}, "is_word": true, "word_id": 537, "word_key": " there", "bytes_hex": "20 74 68 65 72 65", "compression": {"rwkv": "8.69% 8.69% 8.69% 8.69% 8.69% 8.69%", "qwen": "9.39% 9.39% 9.39% 9.39% 9.39% 9.39%"}, "model_tokens": {"rwkv": [[39934, " there", "normal", 0.0553722120821476]], "qwen": [[1052, " there", "normal", 0.0440269410610199]]}, "loss": {"rwkv": 8.68810490118679, "qwen": 9.386394592974995}, "topk": {"rwkv": [39934, 3, 0.0553722120821476, [[22590, 0.358925, " the", false], [63843, 0.0658, " researchers", false], [39934, 0.055372, " there", false], [332, 0.051584, " a", false], [4601, 0.023382, " it", false], [50919, 0.014656, " another", false], [38328, 0.014162, " early", false], [4423, 0.013529, " as", false], [40186, 0.013495, " which", false], [22226, 0.011982, " one", false]]], "qwen": [1052, 5, 0.0440269410610199, [[279, 0.276267, " the", false], [264, 0.065506, " a", false], [4124, 0.049636, " early", false], [11811, 0.047668, " researchers", false], [1052, 0.044027, " there", false], [458, 0.01796, " an", false], [432, 0.01707, " it", false], [304, 0.016023, " in", false], [3412, 0.015395, " research", false], [3738, 0.015389, " human", false]]]}, "raw_delta": -0.038721402486165346, "tuned_delta": -0.0319091246790674}, {"byte_start": 3191, "byte_end": 3195, "display": {"text": " was", "kind": "normal"}, "is_word": true, "word_id": 538, "word_key": " was", "bytes_hex": "20 77 61 73", "compression": {"rwkv": "3.87% 3.87% 3.87% 3.87%", "qwen": "3.51% 3.51% 3.51% 3.51%"}, "model_tokens": {"rwkv": [[22748, " was", "normal", 0.4260845482349396]], "qwen": [[572, " was", "normal", 0.4586254358291626]]}, "loss": {"rwkv": 3.8744251586373526, "qwen": 3.5144114570802074}, "topk": {"rwkv": [22748, 1, 0.4260845482349396, [[22748, 0.426085, " was", false], [32462, 0.207751, " were", false], [21800, 0.112533, " has", false], [4600, 0.102862, " is", false], [31059, 0.058945, " have", false], [21286, 0.04924, " are", false], [21795, 0.015887, " had", false], [39620, 0.002312, " seems", false], [30135, 0.002223, " also", false], [22614, 0.001896, " too", false]]], "qwen": [572, 1, 0.4586254358291626, [[572, 0.458625, " was", false], [1033, 0.19218, " were", false], [702, 0.119229, " has", false], [374, 0.079648, " is", false], [614, 0.058493, " have", false], [525, 0.046995, " are", false], [1030, 0.015486, " had", false], [1083, 0.003227, " also", false], [1483, 0.002581, " used", false], [15102, 0.002502, " initially", false]]]}, "raw_delta": 0.019963398575782776, "tuned_delta": 0.026775676382880722}, {"byte_start": 3195, "byte_end": 3198, "display": {"text": " an", "kind": "normal"}, "is_word": true, "word_id": 539, "word_key": " an", "bytes_hex": "20 61 6e", "compression": {"rwkv": "13.71% 13.71% 13.71%", "qwen": "11.65% 11.65% 11.65%"}, "model_tokens": {"rwkv": [[4419, " an", "normal", 0.09993455559015274]], "qwen": [[458, " an", "normal", 0.14387594163417816]]}, "loss": {"rwkv": 13.713116925116447, "qwen": 11.654594949822933}, "topk": {"rwkv": [4419, 2, 0.09993455559015274, [[332, 0.503841, " a", false], [4419, 0.099935, " an", false], [30135, 0.046081, " also", false], [59868, 0.029832, " initially", false], [50919, 0.029308, " another", false], [22590, 0.025742, " the", false], [30788, 0.020826, " even", false], [31466, 0.020397, " much", false], [52906, 0.019792, " similar", false], [4692, 0.014455, " no", false]]], "qwen": [458, 2, 0.14387594163417816, [[264, 0.44822, " a", false], [458, 0.143876, " an", false], [1083, 0.063595, " also", false], [15102, 0.039345, " initially", false], [1753, 0.020871, " much", false], [2441, 0.018998, " another", false], [279, 0.015884, " the", false], [1045, 0.013977, " some", false], [2856, 0.013189, " initial", false], [902, 0.012129, " no", false]]]}, "raw_delta": 0.11414869626363111, "tuned_delta": 0.12096097407072906}, {"byte_start": 3198, "byte_end": 3204, "display": {"text": " early", "kind": "normal"}, "is_word": true, "word_id": 540, "word_key": " early", "bytes_hex": "20 65 61 72 6c 79", "compression": {"rwkv": "4.44% 4.44% 4.44% 4.44% 4.44% 4.44%", "qwen": "5.60% 5.60% 5.60% 5.60% 5.60% 5.60%"}, "model_tokens": {"rwkv": [[38328, " early", "normal", 0.2304590493440628]], "qwen": [[4124, " early", "normal", 0.15495134890079498]]}, "loss": {"rwkv": 4.437977908984604, "qwen": 5.604401510043859}, "topk": {"rwkv": [38328, 2, 0.2304590493440628, [[52013, 0.241339, " initial", false], [38328, 0.230459, " early", false], [30788, 0.106414, " even", false], [51639, 0.033354, " equally", false], [59134, 0.030665, " analogous", false], [51551, 0.030493, " earlier", false], [45829, 0.022568, " effort", false], [59829, 0.01901, " important", false], [56125, 0.014789, " enormous", false], [50976, 0.012936, " attempt", false]]], "qwen": [4124, 2, 0.15495134890079498, [[2856, 0.439237, " initial", false], [4124, 0.154951, " early", false], [6788, 0.037533, " earlier", false], [1496, 0.026808, " even", false], [2989, 0.023843, " important", false], [5041, 0.02224, " effort", false], [7040, 0.019334, " interesting", false], [18308, 0.018332, " equally", false], [4774, 0.01645, " attempt", false], [22399, 0.014664, " enormous", false]]]}, "raw_delta": -0.06468025843302411, "tuned_delta": -0.05786798062592616}, {"byte_start": 3204, "byte_end": 3216, "display": {"text": " competition", "kind": "normal"}, "is_word": true, "word_id": 541, "word_key": " competition", "bytes_hex": "20 63 6f 6d 70 65 74 69 74 69 6f 6e", "compression": {"rwkv": "8.78% 8.78% 8.78% 8.78% 8.78% 8.78% 8.78% 8.78% 8.78% 8.78% 8.78% 8.78%", "qwen": "12.69% 12.69% 12.69% 12.69% 12.69% 12.69% 12.69% 12.69% 12.69% 12.69% 12.69% 12.69%"}, "model_tokens": {"rwkv": [[63361, " competition", "normal", 0.0029223086312413216]], "qwen": [[10707, " competition", "normal", 0.00021447411563713104]]}, "loss": {"rwkv": 8.782030359578, "qwen": 12.694697293823454}, "topk": {"rwkv": [63361, 47, 0.0029223086312413216, [[45829, 0.141187, " effort", false], [45, 0.058337, ",", false], [21265, 0.048762, " and", false], [50976, 0.046172, " attempt", false], [46790, 0.042007, " period", false], [56103, 0.028583, " emphasis", false], [55532, 0.025192, " approach", false], [31813, 0.022913, " race", false], [57404, 0.021204, " tendency", false], [38530, 0.017781, " focus", false]]], "qwen": [10707, 293, 0.00021447411563713104, [[5041, 0.176581, " effort", false], [4168, 0.084525, " period", false], [4774, 0.084485, " attempt", false], [11, 0.035262, ",", false], [16396, 0.030165, " belief", false], [12060, 0.025291, " wave", false], [323, 0.02347, " and", false], [3738, 0.020796, " human", false], [7901, 0.020668, " failure", false], [30854, 0.020547, " tendency", false]]]}, "raw_delta": -0.216964324315389, "tuned_delta": -0.21015204650829106}, {"byte_start": 3216, "byte_end": 3217, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "71.29%", "qwen": "64.79%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.01882927119731903]], "qwen": [[11, ",", "normal", 0.027518654242157936]]}, "loss": {"rwkv": 71.28942291892729, "qwen": 64.7930792522237}, "topk": {"rwkv": [45, 6, 0.01882927119731903, [[51035, 0.767378, " between", false], [4811, 0.04131, " to", false], [37694, 0.032379, " among", false], [4596, 0.025756, " in", false], [21700, 0.021407, " for", false], [45, 0.018829, ",", false], [32487, 0.018137, " with", false], [4706, 0.013717, " of", false], [32227, 0.009288, " that", false], [31601, 0.006236, " over", false]]], "qwen": [11, 8, 0.027518654242157936, [[304, 0.250155, " in", false], [1948, 0.178994, " between", false], [429, 0.107616, " that", false], [311, 0.068565, " to", false], [369, 0.033285, " for", false], [448, 0.030391, " with", false], [2598, 0.029603, " called", false], [11, 0.027519, ",", false], [320, 0.026758, " (", false], [518, 0.023081, " at", false]]]}, "raw_delta": 0.36023378372192383, "tuned_delta": 0.36704606152902175}, {"byte_start": 3217, "byte_end": 3227, "display": {"text": " sponsored", "kind": "normal"}, "is_word": true, "word_id": 542, "word_key": " sponsored", "bytes_hex": "20 73 70 6f 6e 73 6f 72 65 64", "compression": {"rwkv": "11.50% 11.50% 11.50% 11.50% 11.50% 11.50% 11.50% 11.50% 11.50% 11.50%", "qwen": "6.79% 6.79% 6.79% 6.79% 6.79% 6.79% 6.79% 6.79% 6.79% 6.79%"}, "model_tokens": {"rwkv": [[60543, " sponsored", "normal", 0.0017198668792843819]], "qwen": [[29538, " sponsored", "normal", 0.02318495884537697]]}, "loss": {"rwkv": 11.496476107083927, "qwen": 6.7883340915119526}, "topk": {"rwkv": [60543, 78, 0.0017198668792843819, [[4596, 0.168012, " in", false], [51035, 0.085158, " between", false], [32487, 0.044217, " with", false], [30917, 0.034206, " from", false], [40186, 0.031817, " which", false], [21265, 0.025779, " and", false], [22590, 0.025604, " the", false], [37635, 0.019696, " again", false], [30135, 0.019442, " also", false], [3492, 0.019079, " 19", false]]], "qwen": [29538, 7, 0.02318495884537697, [[304, 0.261176, " in", false], [279, 0.133815, " the", false], [2598, 0.048218, " called", false], [323, 0.034305, " and", false], [5644, 0.030072, " held", false], [892, 0.023604, " which", false], [29538, 0.023185, " sponsored", false], [3881, 0.020487, " known", false], [448, 0.019819, " with", false], [96127, 0.017136, " DAR", false]]]}, "raw_delta": 0.2610748291015624, "tuned_delta": 0.2678871069086603}, {"byte_start": 3227, "byte_end": 3230, "display": {"text": " by", "kind": "normal"}, "is_word": true, "word_id": 543, "word_key": " by", "bytes_hex": "20 62 79", "compression": {"rwkv": "0.51% 0.51% 0.51%", "qwen": "0.17% 0.17% 0.17%"}, "model_tokens": {"rwkv": [[4450, " by", "normal", 0.9185013175010681]], "qwen": [[553, " by", "normal", 0.972740650177002]]}, "loss": {"rwkv": 0.5107196800021965, "qwen": 0.16613700982584528}, "topk": {"rwkv": [4450, 1, 0.9185013175010681, [[4450, 0.918501, " by", false], [4596, 0.03995, " in", false], [52063, 0.005186, " jointly", false], [21265, 0.004489, " and", false], [21700, 0.004145, " for", false], [4424, 0.003314, " at", false], [59868, 0.002699, " initially", false], [4423, 0.00205, " as", false], [46768, 0.001738, " partly", false], [45, 0.001452, ",", false]]], "qwen": [553, 1, 0.972740650177002, [[553, 0.972741, " by", false], [304, 0.010446, " in", false], [52158, 0.003276, " jointly", false], [323, 0.003095, " and", false], [518, 0.001075, " at", false], [27037, 0.000755, " partly", false], [438, 0.000746, " as", false], [11, 0.00068, ",", false], [15102, 0.000552, " initially", false], [369, 0.00038, " for", false]]]}, "raw_delta": 0.01910772050420443, "tuned_delta": 0.025919998311302376}, {"byte_start": 3230, "byte_end": 3234, "display": {"text": " DAR", "kind": "normal"}, "is_word": true, "word_id": 544, "word_key": " dar", "bytes_hex": "20 44 41 52", "compression": {"rwkv": "4.65% 4.65% 4.65% 4.65%", "qwen": "12.82% 12.82% 12.82% 12.82%"}, "model_tokens": {"rwkv": [[19678, " DAR", "normal", 0.35753074288368225]], "qwen": [[96127, " DAR", "normal", 0.05827023833990097]]}, "loss": {"rwkv": 4.649310190364823, "qwen": 12.815927864416649}, "topk": {"rwkv": [19678, 1, 0.35753074288368225, [[19678, 0.357531, " DAR", false], [22590, 0.195091, " the", false], [28484, 0.150744, " Bell", false], [3620, 0.069916, " AT", false], [20077, 0.068104, " IBM", false], [323, 0.019403, " X", false], [54894, 0.019301, " Carnegie", false], [332, 0.012317, " a", false], [62041, 0.006682, " government", false], [36292, 0.004928, " Apple", false]]], "qwen": [96127, 4, 0.05827023833990097, [[27922, 0.30154, " IBM", false], [17884, 0.282074, " Bell", false], [279, 0.10406, " the", false], [96127, 0.05827, " DAR", false], [7369, 0.046139, " AT", false], [1599, 0.022942, " X", false], [264, 0.017722, " a", false], [5085, 0.01045, " Google", false], [5100, 0.009302, " Microsoft", false], [15611, 0.0087, " Intel", false]]]}, "raw_delta": -0.4528534412384033, "tuned_delta": -0.4460411634313054}, {"byte_start": 3234, "byte_end": 3236, "display": {"text": "PA", "kind": "normal"}, "is_word": true, "word_id": 545, "word_key": "pa", "bytes_hex": "50 41", "compression": {"rwkv": "0.00% 0.00%", "qwen": "0.00% 0.00%"}, "model_tokens": {"rwkv": [[1342, "PA", "normal", 0.9996203184127808]], "qwen": [[8041, "PA", "normal", 0.9999293088912964]]}, "loss": {"rwkv": 0.003439653017256172, "qwen": 0.0006373881968423287}, "topk": {"rwkv": [1342, 1, 0.9996203184127808, [[1342, 0.99962, "PA", false], [6405, 9.4e-05, "PAN", false], [81, 6.8e-05, "P", false], [66, 5.4e-05, "A", false], [2111, 2.2e-05, "pa", false], [6408, 1.9e-05, "PAT", false], [85, 1.7e-05, "T", false], [1364, 1.2e-05, "Pa", false], [1356, 8e-06, "PP", false], [1470, 8e-06, "TA", false]]], "qwen": [8041, 1, 0.9999293088912964, [[8041, 0.999929, "PA", false], [20291, 2.7e-05, "Pa", false], [6595, 6e-06, "pa", false], [47, 6e-06, "P", false], [12878, 3e-06, " PA", false], [4872, 3e-06, "PC", false], [23304, 3e-06, "WIN", false], [54, 2e-06, "W", false], [4406, 2e-06, "PP", false], [81450, 2e-06, "PCA", false]]]}, "raw_delta": 0.0001553905567561742, "tuned_delta": 0.006967668363854121}, {"byte_start": 3236, "byte_end": 3237, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "3.73%", "qwen": "2.21%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.8117443919181824]], "qwen": [[11, ",", "normal", 0.8846657872200012]]}, "loss": {"rwkv": 3.7335369710505395, "qwen": 2.209944548117162}, "topk": {"rwkv": [45, 1, 0.8117443919181824, [[45, 0.811744, ",", false], [4596, 0.084284, " in", false], [21265, 0.05394, " and", false], [275, 0.021544, " (", false], [21700, 0.003091, " for", false], [51035, 0.002443, " between", false], [4811, 0.002399, " to", false], [4423, 0.002033, " as", false], [45805, 0.001577, " during", false], [460, 0.001494, "'s", false]]], "qwen": [11, 1, 0.8846657872200012, [[11, 0.884666, ",", false], [304, 0.040663, " in", false], [323, 0.027295, " and", false], [320, 0.020129, " (", false], [13, 0.005623, ".", false], [429, 0.002827, " that", false], [311, 0.001975, " to", false], [594, 0.001838, "'s", false], [518, 0.001258, " at", false], [369, 0.001099, " for", false]]]}, "raw_delta": 0.08448590338230133, "tuned_delta": 0.09129818118939928}, {"byte_start": 3237, "byte_end": 3240, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 546, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "16.72% 16.72% 16.72%", "qwen": "8.62% 8.62% 8.62%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.06147482991218567]], "qwen": [[304, " in", "normal", 0.23855070769786835]]}, "loss": {"rwkv": 16.718731593635123, "qwen": 8.615134095614458}, "topk": {"rwkv": [4596, 3, 0.06147482991218567, [[51035, 0.64986, " between", false], [4811, 0.118719, " to", false], [4596, 0.061475, " in", false], [32227, 0.045241, " that", false], [21700, 0.028657, " for", false], [32487, 0.014665, " with", false], [40186, 0.012054, " which", false], [37694, 0.010914, " among", false], [40185, 0.004942, " where", false], [4706, 0.004793, " of", false]]], "qwen": [304, 2, 0.23855070769786835, [[311, 0.238995, " to", false], [304, 0.238551, " in", false], [429, 0.175627, " that", false], [369, 0.05571, " for", false], [1948, 0.040542, " between", false], [892, 0.031381, " which", false], [1380, 0.031349, " where", false], [448, 0.028236, " with", false], [2598, 0.025995, " called", false], [323, 0.01324, " and", false]]]}, "raw_delta": 0.44935886065165204, "tuned_delta": 0.45617113845874996}, {"byte_start": 3240, "byte_end": 3244, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 547, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "11.48% 11.48% 11.48% 11.48%", "qwen": "8.54% 8.54% 8.54% 8.54%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.0794694647192955]], "qwen": [[279, " the", "normal", 0.1504439413547516]]}, "loss": {"rwkv": 11.482387288325246, "qwen": 8.539694264110675}, "topk": {"rwkv": [22590, 2, 0.0794694647192955, [[40186, 0.633312, " which", false], [22590, 0.079469, " the", false], [3492, 0.077924, " 19", false], [53342, 0.013452, " whether", false], [40085, 0.010083, " using", false], [52224, 0.008725, " methods", false], [61857, 0.007635, " developing", false], [55666, 0.005629, " building", false], [47350, 0.005621, " speech", false], [21835, 0.005187, " how", false]]], "qwen": [279, 3, 0.1504439413547516, [[892, 0.647437, " which", false], [220, 0.170432, " ", false], [279, 0.150444, " the", false], [9902, 0.001091, " ``", false], [48083, 0.001075, " recognizing", false], [8806, 0.001071, " speech", false], [1246, 0.001006, " how", false], [264, 0.000975, " a", false], [1667, 0.000938, " using", false], [3309, 0.000766, " late", false]]]}, "raw_delta": 0.16317754983901978, "tuned_delta": 0.16998982764611772}, {"byte_start": 3244, "byte_end": 3247, "display": {"text": " 19", "kind": "normal"}, "is_word": true, "word_id": 548, "word_key": " 19", "bytes_hex": "20 31 39", "compression": {"rwkv": "6.48% 6.48% 6.48%", "qwen": "12.98% 0.19% 0.00%"}, "model_tokens": {"rwkv": [[3492, " 19", "normal", 0.33863505721092224]], "qwen": [[220, " ", "normal", 0.4868954122066498], [16, "1", "normal", 0.9896891117095947], [24, "9", "normal", 0.9997244477272034]]}, "loss": {"rwkv": 6.48085662899339, "qwen": 4.390276775293654}, "topk": {"rwkv": [3492, 1, 0.33863505721092224, [[3492, 0.338635, " 19", false], [31255, 0.137006, " late", false], [38328, 0.097092, " early", false], [22681, 0.050568, " use", false], [22089, 0.048692, " mid", false], [63469, 0.023698, " development", false], [30899, 0.011696, " form", false], [38478, 0.010711, " field", false], [47202, 0.007469, " search", false], [46685, 0.007149, " number", false]]], "qwen": [220, 1, 0.4868954122066498, [[220, 0.486895, " ", false], [3309, 0.207656, " late", false], [4124, 0.125531, " early", false], [5099, 0.097892, " mid", false], [990, 0.004568, " use", false], [3639, 0.004485, " United", false], [9902, 0.003857, " ``", false], [2274, 0.003569, " US", false], [4401, 0.003243, " development", false], [1042, 0.002953, " year", false]]]}, "raw_delta": 0.11592636250619155, "tuned_delta": 0.1227386403132895}, {"byte_start": 3247, "byte_end": 3249, "display": {"text": "70", "kind": "normal"}, "is_word": true, "word_id": 549, "word_key": "70", "bytes_hex": "37 30", "compression": {"rwkv": "7.89% 7.89%", "qwen": "25.38% 0.02%"}, "model_tokens": {"rwkv": [[690, "70", "normal", 0.41704320907592773]], "qwen": [[22, "7", "normal", 0.24479924142360687], [15, "0", "normal", 0.9991158843040466]]}, "loss": {"rwkv": 7.889738504861517, "qwen": 12.697532554416602}, "topk": {"rwkv": [690, 1, 0.41704320907592773, [[690, 0.417043, "70", false], [700, 0.21472, "80", false], [680, 0.186031, "60", false], [710, 0.119308, "90", false], [670, 0.026292, "50", false], [686, 0.003428, "66", false], [689, 0.003156, "69", false], [691, 0.002219, "71", false], [711, 0.002105, "91", false], [706, 0.001464, "86", false]]], "qwen": [22, 3, 0.24479924142360687, [[24, 0.345654, "9", false], [23, 0.263998, "8", false], [22, 0.244799, "7", false], [21, 0.126102, "6", false], [20, 0.016886, "5", false], [19, 0.001879, "4", false], [18, 0.000354, "3", false], [15, 0.000186, "0", false], [17, 6.5e-05, "2", false], [16, 1.6e-05, "1", false]]]}, "raw_delta": -0.26660071121295914, "tuned_delta": -0.2597884334058612}, {"byte_start": 3249, "byte_end": 3250, "display": {"text": "s", "kind": "normal"}, "is_word": true, "word_id": 550, "word_key": "s", "bytes_hex": "73", "compression": {"rwkv": "2.41%", "qwen": "1.25%"}, "model_tokens": {"rwkv": [[116, "s", "normal", 0.8744454979896545]], "qwen": [[82, "s", "normal", 0.9332221746444702]]}, "loss": {"rwkv": 2.4127102124241695, "qwen": 1.2463441628509455}, "topk": {"rwkv": [116, 1, 0.8744454979896545, [[116, 0.874445, "s", false], [460, 0.122301, "'s", false], [46, 0.000539, "-", false], [21265, 0.000514, " and", false], [28309, 0.000376, "’s", false], [97, 0.000231, "`", false], [40, 0.000191, "'", false], [350, 0.000163, " s", false], [439, 0.000118, "''", false], [9835, 0.000113, "′", false]]], "qwen": [82, 1, 0.9332221746444702, [[82, 0.933222, "s", false], [594, 0.0611, "'s", false], [748, 0.001087, "’s", false], [274, 0.001046, " s", false], [38515, 0.00053, "′", false], [12, 0.000401, "-", false], [550, 0.000263, "ies", false], [11, 0.000204, ",", false], [323, 0.000146, " and", false], [429, 0.000109, " that", false]]]}, "raw_delta": 0.06467706710100174, "tuned_delta": 0.07148934490809969}, {"byte_start": 3250, "byte_end": 3251, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "71.85%", "qwen": "44.10%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.01897917315363884]], "qwen": [[13, ".", "normal", 0.08669820427894592]]}, "loss": {"rwkv": 71.85297566927454, "qwen": 44.09817469732327}, "topk": {"rwkv": [47, 6, 0.01897917315363884, [[51035, 0.410076, " between", false], [45, 0.206306, ",", false], [21265, 0.171455, " and", false], [4811, 0.084389, " to", false], [32227, 0.03277, " that", false], [47, 0.018979, ".", false], [21700, 0.014509, " for", false], [4596, 0.011124, " in", false], [37694, 0.007002, " among", false], [275, 0.004687, " (", false]]], "qwen": [13, 4, 0.08669820427894592, [[11, 0.429518, ",", false], [429, 0.095464, " that", false], [311, 0.095161, " to", false], [13, 0.086698, ".", false], [323, 0.082738, " and", false], [304, 0.04481, " in", false], [1948, 0.027085, " between", false], [2598, 0.020796, " called", false], [369, 0.017049, " for", false], [320, 0.014453, " (", false]]]}, "raw_delta": 1.539052963256836, "tuned_delta": 1.545865241063934}, {"byte_start": 3251, "byte_end": 3260, "display": {"text": " Entrants", "kind": "normal"}, "is_word": true, "word_id": 551, "word_key": " entrants", "bytes_hex": "20 45 6e 74 72 61 6e 74 73", "compression": {"rwkv": "38.89% 38.89% 38.89% 38.89% 4.79% 4.79% 4.79% 4.79% 0.22%", "qwen": "40.55% 40.55% 40.55% 40.55% 40.55% 0.06% 0.06% 0.06% 0.06%"}, "model_tokens": {"rwkv": [[19830, " Ent", "normal", 0.0001834049471653998], [26809, "rant", "normal", 0.3446483910083771], [116, "s", "normal", 0.9876083731651306]], "qwen": [[47141, " Entr", "normal", 1.311307914875215e-05], [1783, "ants", "normal", 0.9865424633026123]]}, "loss": {"rwkv": 19.43621035073493, "qwen": 22.55302913193068}, "topk": {"rwkv": [19830, 176, 0.0001834049471653998, [[20996, 0.331123, " The", false], [20556, 0.149936, " One", false], [3918, 0.060608, " It", false], [29894, 0.043475, " This", false], [3913, 0.04193, " In", false], [37451, 0.028742, " There", false], [63222, 0.025583, " Researchers", false], [300, 0.02168, " A", false], [19678, 0.018505, " DAR", false], [21042, 0.01361, " Two", false]]], "qwen": [47141, 1259, 1.311307914875215e-05, [[576, 0.293552, " The", false], [1084, 0.109592, " It", false], [1096, 0.083515, " This", false], [758, 0.048719, " In", false], [362, 0.029816, " A", false], [2619, 0.027854, " There", false], [11445, 0.01968, " Its", false], [3776, 0.019046, " One", false], [2411, 0.01553, " At", false], [58150, 0.015228, " Researchers", false]]]}, "raw_delta": -0.17283313204016945, "tuned_delta": -0.1660208542330715}, {"byte_start": 3260, "byte_end": 3269, "display": {"text": " included", "kind": "normal"}, "is_word": true, "word_id": 552, "word_key": " included", "bytes_hex": "20 69 6e 63 6c 75 64 65 64", "compression": {"rwkv": "6.20% 6.20% 6.20% 6.20% 6.20% 6.20% 6.20% 6.20% 6.20%", "qwen": "8.71% 8.71% 8.71% 8.71% 8.71% 8.71% 8.71% 8.71% 8.71%"}, "model_tokens": {"rwkv": [[56427, " included", "normal", 0.04538050293922424]], "qwen": [[5230, " included", "normal", 0.012943398207426071]]}, "loss": {"rwkv": 6.199080253819764, "qwen": 8.710610741970532}, "topk": {"rwkv": [56427, 3, 0.04538050293922424, [[32462, 0.369993, " were", false], [32354, 0.062406, " used", false], [56427, 0.045381, " included", false], [21795, 0.040109, " had", false], [4811, 0.039028, " to", false], [4596, 0.030203, " in", false], [55796, 0.026209, " competed", false], [22762, 0.017686, " who", false], [59506, 0.016634, " developed", false], [38128, 0.01312, " could", false]]], "qwen": [5230, 13, 0.012943398207426071, [[1033, 0.298909, " were", false], [1483, 0.085028, " used", false], [304, 0.082163, " in", false], [1030, 0.052615, " had", false], [311, 0.051618, " to", false], [14634, 0.024043, " submitted", false], [2765, 0.022824, " won", false], [6, 0.015722, "'", false], [429, 0.014798, " that", false], [6679, 0.01377, " tried", false]]]}, "raw_delta": -0.13926882214016387, "tuned_delta": -0.13245654433306592}, {"byte_start": 3269, "byte_end": 3271, "display": {"text": " a", "kind": "normal"}, "is_word": true, "word_id": 553, "word_key": " a", "bytes_hex": "20 61", "compression": {"rwkv": "22.12% 22.12%", "qwen": "21.65% 21.65%"}, "model_tokens": {"rwkv": [[332, " a", "normal", 0.08612234145402908]], "qwen": [[264, " a", "normal", 0.09066668152809143]]}, "loss": {"rwkv": 22.11944545112961, "qwen": 21.645521459279514}, "topk": {"rwkv": [332, 3, 0.08612234145402908, [[22590, 0.098057, " the", false], [63843, 0.088116, " researchers", false], [332, 0.086122, " a", false], [30322, 0.051287, " both", false], [32074, 0.026744, " some", false], [22638, 0.025854, " two", false], [31370, 0.024958, " many", false], [52869, 0.016467, " several", false], [46787, 0.014021, " people", false], [22226, 0.013128, " one", false]]], "qwen": [264, 2, 0.09066668152809143, [[27922, 0.149647, " IBM", false], [264, 0.090667, " a", false], [11811, 0.083081, " researchers", false], [279, 0.074898, " the", false], [17884, 0.065079, " Bell", false], [14865, 0.02785, " MIT", false], [1657, 0.025836, " many", false], [1378, 0.018612, " two", false], [1045, 0.017207, " some", false], [3807, 0.016664, " several", false]]]}, "raw_delta": 0.026279926300048828, "tuned_delta": 0.03309220410714678}, {"byte_start": 3271, "byte_end": 3276, "display": {"text": " host", "kind": "normal"}, "is_word": true, "word_id": 554, "word_key": " host", "bytes_hex": "20 68 6f 73 74", "compression": {"rwkv": "25.59% 25.59% 25.59% 25.59% 25.59%", "qwen": "29.84% 29.84% 29.84% 29.84% 29.84%"}, "model_tokens": {"rwkv": [[31112, " host", "normal", 0.0008313425933010876]], "qwen": [[3468, " host", "normal", 0.00025549010024406016]]}, "loss": {"rwkv": 25.585294865765206, "qwen": 29.83611437477487}, "topk": {"rwkv": [31112, 92, 0.0008313425933010876, [[32207, 0.178962, " team", false], [46685, 0.106213, " number", false], [38640, 0.084443, " group", false], [53264, 0.040018, " variety", false], [38720, 0.037599, " human", false], [38864, 0.035975, " large", false], [47350, 0.028681, " speech", false], [46561, 0.022178, " method", false], [47202, 0.020266, " search", false], [57103, 0.019331, " research", false]]], "qwen": [3468, 250, 0.00025549010024406016, [[1372, 0.132876, " number", false], [1874, 0.058637, " group", false], [2421, 0.054193, " few", false], [2083, 0.043321, " team", false], [8806, 0.039168, " speech", false], [1714, 0.039105, " method", false], [2813, 0.03677, " company", false], [3738, 0.035784, " human", false], [8045, 0.028896, " variety", false], [3460, 0.026857, " large", false]]]}, "raw_delta": -0.2357154846191407, "tuned_delta": -0.22890320681204276}, {"byte_start": 3276, "byte_end": 3279, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 555, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "0.04% 0.04% 0.04%", "qwen": "0.01% 0.01% 0.01%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.9936123490333557]], "qwen": [[315, " of", "normal", 0.9980087876319885]]}, "loss": {"rwkv": 0.03852411379326913, "qwen": 0.011981691743041081}, "topk": {"rwkv": [4706, 1, 0.9936123490333557, [[4706, 0.993612, " of", false], [22762, 0.000631, " who", false], [32227, 0.000501, " that", false], [45, 0.000309, ",", false], [46, 0.000268, "-", false], [37747, 0.000248, " array", false], [1851, 0.000211, "el", false], [52580, 0.000193, " program", false], [275, 0.000181, " (", false], [21265, 0.000175, " and", false]]], "qwen": [315, 1, 0.9980087876319885, [[315, 0.998009, " of", false], [433, 0.000175, "ess", false], [11, 0.000174, ",", false], [320, 0.000116, " (", false], [879, 8.6e-05, " who", false], [198, 8.4e-05, "\n", false], [1372, 7.1e-05, " number", false], [476, 6.8e-05, " or", false], [429, 5.9e-05, " that", false], [264, 5.5e-05, " a", false]]]}, "raw_delta": 0.0014718244007478158, "tuned_delta": 0.008284102207845763}, {"byte_start": 3279, "byte_end": 3287, "display": {"text": " special", "kind": "normal"}, "is_word": true, "word_id": 556, "word_key": " special", "bytes_hex": "20 73 70 65 63 69 61 6c", "compression": {"rwkv": "12.89% 12.89% 12.89% 12.89% 12.89% 12.89% 12.89% 12.89%", "qwen": "14.77% 14.77% 14.77% 14.77% 14.77% 14.77% 14.77% 14.77%"}, "model_tokens": {"rwkv": [[52964, " special", "normal", 0.0033107500057667494]], "qwen": [[3281, " special", "normal", 0.0014242958277463913]]}, "loss": {"rwkv": 12.891269164193373, "qwen": 14.77427388685166}, "topk": {"rwkv": [52964, 47, 0.0033107500057667494, [[63843, 0.192833, " researchers", false], [38720, 0.090363, " human", false], [57103, 0.046395, " research", false], [52224, 0.031307, " methods", false], [55809, 0.02184, " computer", false], [3609, 0.018602, " AI", false], [46787, 0.018039, " people", false], [47350, 0.017347, " speech", false], [59513, 0.016242, " different", false], [61590, 0.015683, " approaches", false]]], "qwen": [3281, 82, 0.0014242958277463913, [[11811, 0.180827, " researchers", false], [3738, 0.056594, " human", false], [5413, 0.053861, " methods", false], [5110, 0.031301, " companies", false], [2155, 0.028066, " different", false], [3412, 0.027185, " research", false], [8806, 0.024624, " speech", false], [5942, 0.018314, " systems", false], [19827, 0.01823, " approaches", false], [1602, 0.017551, " very", false]]]}, "raw_delta": -0.10441595315933228, "tuned_delta": -0.09760367535223433}, {"byte_start": 3287, "byte_end": 3295, "display": {"text": " methods", "kind": "normal"}, "is_word": true, "word_id": 557, "word_key": " methods", "bytes_hex": "20 6d 65 74 68 6f 64 73", "compression": {"rwkv": "6.80% 6.80% 6.80% 6.80% 6.80% 6.80% 6.80% 6.80%", "qwen": "8.12% 8.12% 8.12% 8.12% 8.12% 8.12% 8.12% 8.12%"}, "model_tokens": {"rwkv": [[52224, " methods", "normal", 0.048781439661979675]], "qwen": [[5413, " methods", "normal", 0.027293074876070023]]}, "loss": {"rwkv": 6.797855051063719, "qwen": 8.117689684772923}, "topk": {"rwkv": [52224, 3, 0.048781439661979675, [[46, 0.690092, "-", false], [52610, 0.055081, " purpose", false], [52224, 0.048781, " methods", false], [62633, 0.0284, " techniques", false], [61590, 0.023539, " approaches", false], [25971, 0.007133, "ists", false], [38720, 0.006933, " human", false], [45, 0.00661, ",", false], [27161, 0.005874, "ties", false], [7919, 0.004472, "ist", false]]], "qwen": [5413, 3, 0.027293074876070023, [[58238, 0.773182, "-purpose", false], [7428, 0.037158, " purpose", false], [5413, 0.027293, " methods", false], [12538, 0.0171, " techniques", false], [25185, 0.007393, " algorithms", false], [38485, 0.006867, "-case", false], [19827, 0.005876, " approaches", false], [11, 0.005599, ",", false], [12, 0.005488, "-", false], [11647, 0.004813, " experts", false]]]}, "raw_delta": -0.07318717241287231, "tuned_delta": -0.06637489460577436}, {"byte_start": 3295, "byte_end": 3300, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 558, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"rwkv": "7.38% 7.38% 7.38% 7.38% 7.38%", "qwen": "4.54% 4.54% 4.54% 4.54% 4.54%"}, "model_tokens": {"rwkv": [[32227, " that", "normal", 0.12804584205150604]], "qwen": [[429, " that", "normal", 0.28388261795043945]]}, "loss": {"rwkv": 7.3825410295489915, "qwen": 4.541584127474004}, "topk": {"rwkv": [32227, 4, 0.12804584205150604, [[45, 0.205667, ",", false], [21700, 0.158411, " for", false], [37810, 0.128662, " based", false], [32227, 0.128046, " that", false], [55966, 0.033402, " designed", false], [21265, 0.031372, " and", false], [38888, 0.019905, " lever", false], [4811, 0.016389, " to", false], [47, 0.016102, ".", false], [275, 0.015879, " (", false]]], "qwen": [429, 1, 0.28388261795043945, [[429, 0.283883, " that", false], [3118, 0.205155, " based", false], [11, 0.141055, ",", false], [369, 0.076992, " for", false], [6188, 0.028651, " designed", false], [320, 0.023569, " (", false], [70601, 0.020602, " exploiting", false], [323, 0.016581, " and", false], [311, 0.012588, " to", false], [40791, 0.011173, " tailored", false]]]}, "raw_delta": 0.15753610134124757, "tuned_delta": 0.16434837914834552}, {"byte_start": 3300, "byte_end": 3305, "display": {"text": " took", "kind": "normal"}, "is_word": true, "word_id": 559, "word_key": " took", "bytes_hex": "20 74 6f 6f 6b", "compression": {"rwkv": "8.06% 8.06% 8.06% 8.06% 8.06%", "qwen": "6.42% 6.42% 6.42% 6.42% 6.42%"}, "model_tokens": {"rwkv": [[32272, " took", "normal", 0.10568306595087051]], "qwen": [[3867, " took", "normal", 0.16853733360767365]]}, "loss": {"rwkv": 8.058804329965694, "qwen": 6.422149921164743}, "topk": {"rwkv": [32272, 3, 0.10568306595087051, [[32462, 0.133401, " were", false], [56540, 0.11892, " leverage", false], [32272, 0.105683, " took", false], [59685, 0.063175, " exploited", false], [31351, 0.05242, " made", false], [32354, 0.038576, " used", false], [40013, 0.037286, " tried", false], [57510, 0.033665, " utilized", false], [21795, 0.030222, " had", false], [59189, 0.021512, " attempted", false]]], "qwen": [3867, 1, 0.16853733360767365, [[3867, 0.168537, " took", false], [1033, 0.148943, " were", false], [27505, 0.138017, " lever", false], [50663, 0.068061, " exploited", false], [1865, 0.036492, " made", false], [39913, 0.027299, " relied", false], [1030, 0.02667, " had", false], [1483, 0.023096, " used", false], [1521, 0.016878, " did", false], [33616, 0.016635, " utilized", false]]]}, "raw_delta": 0.09075539112091069, "tuned_delta": 0.09756766892800864}, {"byte_start": 3305, "byte_end": 3315, "display": {"text": " advantage", "kind": "normal"}, "is_word": true, "word_id": 560, "word_key": " advantage", "bytes_hex": "20 61 64 76 61 6e 74 61 67 65", "compression": {"rwkv": "0.13% 0.13% 0.13% 0.13% 0.13% 0.13% 0.13% 0.13% 0.13% 0.13%", "qwen": "0.17% 0.17% 0.17% 0.17% 0.17% 0.17% 0.17% 0.17% 0.17% 0.17%"}, "model_tokens": {"rwkv": [[59093, " advantage", "normal", 0.932227373123169]], "qwen": [[9423, " advantage", "normal", 0.91209876537323]]}, "loss": {"rwkv": 0.12591881765571397, "qwen": 0.1659225331283318}, "topk": {"rwkv": [59093, 1, 0.932227373123169, [[59093, 0.932227, " advantage", false], [38720, 0.015691, " human", false], [30923, 0.007365, " full", false], [31162, 0.004644, " into", false], [332, 0.003373, " a", false], [61544, 0.003124, " advantages", false], [22590, 0.002636, " the", false], [38629, 0.002625, " great", false], [50845, 0.001999, " account", false], [56540, 0.001236, " leverage", false]]], "qwen": [9423, 1, 0.91209876537323, [[9423, 0.912099, " advantage", false], [3738, 0.019265, " human", false], [2480, 0.009981, " full", false], [2244, 0.006812, " great", false], [22146, 0.004719, " advantages", false], [264, 0.003321, " a", false], [279, 0.002832, " the", false], [3281, 0.002583, " special", false], [1119, 0.001649, " into", false], [5257, 0.001598, " various", false]]]}, "raw_delta": -0.0022182770073413834, "tuned_delta": 0.004594000799756564}, {"byte_start": 3315, "byte_end": 3318, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 561, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "0.03% 0.03% 0.03%", "qwen": "0.02% 0.02% 0.02%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.9954160451889038]], "qwen": [[315, " of", "normal", 0.9974083304405212]]}, "loss": {"rwkv": 0.02770067229896971, "qwen": 0.01559934988305673}, "topk": {"rwkv": [4706, 1, 0.9954160451889038, [[4706, 0.995416, " of", false], [45, 0.001271, ",", false], [4596, 0.000739, " in", false], [38720, 0.00056, " human", false], [275, 0.00023, " (", false], [45833, 0.000159, " either", false], [22187, 0.000144, " not", false], [22590, 0.000132, " the", false], [4715, 0.000112, " or", false], [30322, 8.7e-05, " both", false]]], "qwen": [315, 1, 0.9974083304405212, [[315, 0.997408, " of", false], [11, 0.000401, ",", false], [2987, 0.000314, " either", false], [537, 0.000232, " not", false], [3738, 0.000214, " human", false], [320, 0.000182, " (", false], [2176, 0.000108, " both", false], [304, 7.5e-05, " in", false], [311, 6.1e-05, " to", false], [279, 5.1e-05, " the", false]]]}, "raw_delta": 0.0006710398010909558, "tuned_delta": 0.007483317608188903}, {"byte_start": 3318, "byte_end": 3324, "display": {"text": " human", "kind": "normal"}, "is_word": true, "word_id": 562, "word_key": " human", "bytes_hex": "20 68 75 6d 61 6e", "compression": {"rwkv": "3.80% 3.80% 3.80% 3.80% 3.80% 3.80%", "qwen": "2.80% 2.80% 2.80% 2.80% 2.80% 2.80%"}, "model_tokens": {"rwkv": [[38720, " human", "normal", 0.27998611330986023]], "qwen": [[3738, " human", "normal", 0.3939196765422821]]}, "loss": {"rwkv": 3.803981064843946, "qwen": 2.800055271452416}, "topk": {"rwkv": [38720, 1, 0.27998611330986023, [[38720, 0.279986, " human", false], [22590, 0.260283, " the", false], [59943, 0.068491, " knowledge", false], [62182, 0.030379, " linguistic", false], [45775, 0.018788, " domain", false], [332, 0.015281, " a", false], [52964, 0.012065, " special", false], [62293, 0.010735, " particular", false], [56215, 0.010291, " features", false], [53265, 0.009577, " various", false]]], "qwen": [3738, 1, 0.3939196765422821, [[3738, 0.39392, " human", false], [279, 0.212672, " the", false], [3281, 0.052552, " special", false], [6540, 0.026586, " knowledge", false], [264, 0.012291, " a", false], [7947, 0.01182, " domain", false], [8806, 0.010677, " speech", false], [5257, 0.010535, " various", false], [862, 0.010528, " their", false], [3953, 0.009571, " particular", false]]]}, "raw_delta": 0.05566946665445962, "tuned_delta": 0.06248174446155757}, {"byte_start": 3324, "byte_end": 3334, "display": {"text": " knowledge", "kind": "normal"}, "is_word": true, "word_id": 563, "word_key": " knowledge", "bytes_hex": "20 6b 6e 6f 77 6c 65 64 67 65", "compression": {"rwkv": "0.83% 0.83% 0.83% 0.83% 0.83% 0.83% 0.83% 0.83% 0.83% 0.83%", "qwen": "0.94% 0.94% 0.94% 0.94% 0.94% 0.94% 0.94% 0.94% 0.94% 0.94%"}, "model_tokens": {"rwkv": [[59943, " knowledge", "normal", 0.6331534385681152]], "qwen": [[6540, " knowledge", "normal", 0.592913031578064]]}, "loss": {"rwkv": 0.8277181020725253, "qwen": 0.9426344371284479}, "topk": {"rwkv": [59943, 1, 0.6331534385681152, [[59943, 0.633153, " knowledge", false], [65034, 0.181854, " understanding", false], [62182, 0.027207, " linguistic", false], [46, 0.026557, "-", false], [59683, 0.022099, " expertise", false], [38786, 0.019365, " input", false], [47350, 0.011484, " speech", false], [56529, 0.009501, " language", false], [59917, 0.0039, " intuition", false], [61979, 0.00368, " experience", false]]], "qwen": [6540, 1, 0.592913031578064, [[6540, 0.592913, " knowledge", false], [8660, 0.140599, " understanding", false], [18726, 0.080196, " expertise", false], [64667, 0.02676, " linguistic", false], [1946, 0.02544, " input", false], [12646, 0.021762, "-k", false], [4128, 0.007777, " language", false], [71107, 0.006643, "-under", false], [8806, 0.005197, " speech", false], [7947, 0.003196, " domain", false]]]}, "raw_delta": -0.006372314691543576, "tuned_delta": 0.00043996311555437057}, {"byte_start": 3334, "byte_end": 3337, "display": {"text": "---", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2d 2d 2d", "compression": {"rwkv": "48.84% 48.84% 48.84%", "qwen": "44.71% 44.71% 44.71%"}, "model_tokens": {"rwkv": [[5346, "---", "normal", 0.0002870198804885149]], "qwen": [[4421, "---", "normal", 0.0005885124555788934]]}, "loss": {"rwkv": 48.841238363428445, "qwen": 44.71099761076521}, "topk": {"rwkv": [5346, 39, 0.0002870198804885149, [[4706, 0.289271, " of", false], [45, 0.262478, ",", false], [47, 0.113681, ".", false], [21265, 0.082663, " and", false], [37598, 0.078868, " about", false], [275, 0.048487, " (", false], [4596, 0.032736, " in", false], [59, 0.018171, ":", false], [4811, 0.010483, " to", false], [32139, 0.006688, " such", false]]], "qwen": [4421, 31, 0.0005885124555788934, [[315, 0.28056, " of", false], [11, 0.207789, ",", false], [13, 0.10953, ".", false], [911, 0.10866, " about", false], [323, 0.065017, " and", false], [320, 0.057745, " (", false], [311, 0.040508, " to", false], [304, 0.033645, " in", false], [476, 0.015063, " or", false], [25, 0.011465, ":", false]]]}, "raw_delta": 0.22902917861938477, "tuned_delta": 0.23584145642648272}, {"byte_start": 3337, "byte_end": 3346, "display": {"text": "knowledge", "kind": "normal"}, "is_word": true, "word_id": 564, "word_key": "knowledge", "bytes_hex": "6b 6e 6f 77 6c 65 64 67 65", "compression": {"rwkv": "7.39% 7.39% 7.39% 7.39% 7.39% 7.39% 7.39% 7.39% 7.39%", "qwen": "10.00% 10.00% 10.00% 10.00% 10.00% 10.00% 10.00% 10.00% 10.00%"}, "model_tokens": {"rwkv": [[58313, "knowledge", "normal", 0.025334566831588745]], "qwen": [[89053, "knowledge", "normal", 0.006804365664720535]]}, "loss": {"rwkv": 7.388802726775073, "qwen": 9.999060811112807}, "topk": {"rwkv": [58313, 6, 0.025334566831588745, [[35381, 0.087492, "phone", false], [7579, 0.054782, "for", false], [27095, 0.04407, "such", false], [58282, 0.034512, "including", false], [1950, 0.028541, "in", false], [58313, 0.025335, "knowledge", false], [8801, 0.023389, "the", false], [2090, 0.020853, "of", false], [6907, 0.013985, "aco", false], [98, 0.01397, "a", false]]], "qwen": [89053, 19, 0.006804365664720535, [[1958, 0.113174, "for", false], [1782, 0.039278, "the", false], [20805, 0.035593, "such", false], [51701, 0.034481, "phon", false], [258, 0.027204, "in", false], [16169, 0.025303, "including", false], [64, 0.023208, "a", false], [68, 0.022413, "e", false], [35742, 0.017526, "methods", false], [437, 0.014828, "and", false]]]}, "raw_delta": -0.1447434425354004, "tuned_delta": -0.13793116472830244}, {"byte_start": 3346, "byte_end": 3349, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 565, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "1.50% 1.50% 1.50%", "qwen": "4.17% 4.17% 4.17%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.7764443159103394]], "qwen": [[315, " of", "normal", 0.5000578165054321]]}, "loss": {"rwkv": 1.5028073342593367, "qwen": 4.165971939865932}, "topk": {"rwkv": [4706, 1, 0.7764443159103394, [[4706, 0.776444, " of", false], [37598, 0.088302, " about", false], [32227, 0.053708, " that", false], [32139, 0.005832, " such", false], [37810, 0.0051, " based", false], [4596, 0.004597, " in", false], [46, 0.004588, "-", false], [30917, 0.003643, " from", false], [55442, 0.003206, " acquired", false], [22187, 0.003126, " not", false]]], "qwen": [315, 1, 0.5000578165054321, [[315, 0.500058, " of", false], [911, 0.244429, " about", false], [429, 0.108862, " that", false], [1741, 0.013823, " such", false], [11, 0.012711, ",", false], [504, 0.008878, " from", false], [304, 0.004599, " in", false], [5980, 0.003731, "-based", false], [3118, 0.003642, " based", false], [18163, 0.003563, " gained", false]]]}, "raw_delta": -0.14767720301946002, "tuned_delta": -0.14086492521236207}, {"byte_start": 3349, "byte_end": 3355, "display": {"text": " words", "kind": "normal"}, "is_word": true, "word_id": 566, "word_key": " words", "bytes_hex": "20 77 6f 72 64 73", "compression": {"rwkv": "12.96% 12.96% 12.96% 12.96% 12.96% 12.96%", "qwen": "15.78% 15.78% 15.78% 15.78% 15.78% 15.78%"}, "model_tokens": {"rwkv": [[40210, " words", "normal", 0.013446687720716]], "qwen": [[4244, " words", "normal", 0.005253321025520563]]}, "loss": {"rwkv": 12.96171325798678, "qwen": 15.77615487818387}, "topk": {"rwkv": [40210, 13, 0.013446687720716, [[22590, 0.219817, " the", false], [39273, 0.130548, " phone", false], [47350, 0.076903, " speech", false], [55440, 0.062609, " acoustic", false], [56529, 0.054502, " language", false], [21835, 0.044073, " how", false], [62182, 0.036181, " linguistic", false], [51860, 0.028234, " grammar", false], [64996, 0.019455, " pronunciation", false], [59946, 0.018359, " languages", false]]], "qwen": [4244, 17, 0.005253321025520563, [[279, 0.353914, " the", false], [50823, 0.253003, " phon", false], [1246, 0.058093, " how", false], [4128, 0.035753, " language", false], [8806, 0.03563, " speech", false], [31428, 0.015489, " grammar", false], [1128, 0.013788, " what", false], [3281, 0.013287, " special", false], [6364, 0.010292, " English", false], [70622, 0.010262, " pronunciation", false]]]}, "raw_delta": -0.15606578191121423, "tuned_delta": -0.14925350410411628}, {"byte_start": 3355, "byte_end": 3356, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "6.41%", "qwen": "7.27%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.703881025314331]], "qwen": [[11, ",", "normal", 0.6681299209594727]]}, "loss": {"rwkv": 6.410412535199983, "qwen": 7.272493308360682}, "topk": {"rwkv": [45, 1, 0.703881025314331, [[45, 0.703881, ",", false], [21265, 0.192168, " and", false], [4596, 0.028148, " in", false], [275, 0.017157, " (", false], [32227, 0.010611, " that", false], [4715, 0.008769, " or", false], [5346, 0.005063, "---", false], [4423, 0.004397, " as", false], [40, 0.002569, "'", false], [47, 0.00171, ".", false]]], "qwen": [11, 1, 0.6681299209594727, [[11, 0.66813, ",", false], [323, 0.21026, " and", false], [304, 0.026596, " in", false], [320, 0.019248, " (", false], [476, 0.016288, " or", false], [429, 0.011097, " that", false], [438, 0.007941, " as", false], [1660, 0.003235, " being", false], [1075, 0.002041, " like", false], [1741, 0.001965, " such", false]]]}, "raw_delta": -0.047803908586502075, "tuned_delta": -0.040991630779404126}, {"byte_start": 3356, "byte_end": 3359, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 567, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "10.75% 10.75% 10.75%", "qwen": "10.98% 10.98% 10.98%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.16636644303798676]], "qwen": [[315, " of", "normal", 0.16089268028736115]]}, "loss": {"rwkv": 10.754464985793378, "qwen": 10.982622186588632}, "topk": {"rwkv": [4706, 2, 0.16636644303798676, [[59943, 0.398848, " knowledge", false], [4706, 0.166366, " of", false], [51860, 0.051316, " grammar", false], [39273, 0.036622, " phone", false], [32497, 0.017375, " word", false], [64996, 0.016479, " pronunciation", false], [21265, 0.014877, " and", false], [47486, 0.012725, " syntax", false], [47341, 0.012651, " sounds", false], [47350, 0.01222, " speech", false]]], "qwen": [315, 1, 0.16089268028736115, [[315, 0.160893, " of", false], [50823, 0.158093, " phon", false], [6540, 0.15273, " knowledge", false], [31428, 0.073357, " grammar", false], [323, 0.032645, " and", false], [862, 0.026638, " their", false], [70622, 0.02638, " pronunciation", false], [279, 0.025346, " the", false], [476, 0.017606, " or", false], [4128, 0.014281, " language", false]]]}, "raw_delta": -0.012651721636454338, "tuned_delta": -0.0058394438293563914}, {"byte_start": 3359, "byte_end": 3368, "display": {"text": " phonemes", "kind": "normal"}, "is_word": true, "word_id": 568, "word_key": " phonemes", "bytes_hex": "20 70 68 6f 6e 65 6d 65 73", "compression": {"rwkv": "7.47% 7.47% 7.47% 7.47% 7.47% 7.47% 3.80% 3.80% 3.80%", "qwen": "5.17% 5.17% 5.17% 5.17% 5.17% 4.32% 4.32% 4.32% 4.32%"}, "model_tokens": {"rwkv": [[39273, " phone", "normal", 0.08367644250392914], [8164, "mes", "normal", 0.5309309959411621]], "qwen": [[50823, " phon", "normal", 0.23876725137233734], [15660, "emes", "normal", 0.383487343788147]]}, "loss": {"rwkv": 6.246042983015369, "qwen": 4.79037800427587}, "topk": {"rwkv": [39273, 2, 0.08367644250392914, [[51860, 0.145716, " grammar", false], [39273, 0.083676, " phone", false], [22590, 0.081417, " the", false], [47350, 0.046232, " speech", false], [56529, 0.040378, " language", false], [55440, 0.033522, " acoustic", false], [64996, 0.030268, " pronunciation", false], [47486, 0.029265, " syntax", false], [57192, 0.027432, " sentence", false], [51310, 0.026503, " context", false]]], "qwen": [50823, 1, 0.23876725137233734, [[50823, 0.238767, " phon", false], [279, 0.117382, " the", false], [70622, 0.049761, " pronunciation", false], [8806, 0.049463, " speech", false], [4128, 0.040122, " language", false], [31428, 0.030796, " grammar", false], [1246, 0.026751, " how", false], [3409, 0.026679, " word", false], [862, 0.02647, " their", false], [15459, 0.019261, " languages", false]]]}, "raw_delta": 0.08071920606825086, "tuned_delta": 0.08753148387534881}, {"byte_start": 3368, "byte_end": 3369, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "2.43%", "qwen": "2.14%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.8738864064216614]], "qwen": [[11, ",", "normal", 0.8879333138465881]]}, "loss": {"rwkv": 2.4303212358725212, "qwen": 2.1434594143297496}, "topk": {"rwkv": [45, 1, 0.8738864064216614, [[45, 0.873886, ",", false], [21265, 0.047157, " and", false], [275, 0.037917, " (", false], [4596, 0.013656, " in", false], [4715, 0.005535, " or", false], [5346, 0.004033, "---", false], [4706, 0.003326, " of", false], [47, 0.002951, ".", false], [4423, 0.001518, " as", false], [32227, 0.001078, " that", false]]], "qwen": [11, 1, 0.8879333138465881, [[11, 0.887933, ",", false], [323, 0.048608, " and", false], [320, 0.039137, " (", false], [476, 0.005605, " or", false], [304, 0.004284, " in", false], [429, 0.001585, " that", false], [13, 0.001211, ".", false], [438, 0.001177, " as", false], [4421, 0.001061, "---", false], [3489, 0.000585, " (\"", false]]]}, "raw_delta": 0.01590699702501297, "tuned_delta": 0.022719274832110916}, {"byte_start": 3369, "byte_end": 3372, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 569, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "1.41% 1.41% 1.41%", "qwen": "2.01% 2.01% 2.01%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.7909825444221497]], "qwen": [[315, " of", "normal", 0.7161024808883667]]}, "loss": {"rwkv": 1.4088818758681283, "qwen": 2.0073415507340955}, "topk": {"rwkv": [4706, 1, 0.7909825444221497, [[4706, 0.790983, " of", false], [21265, 0.118344, " and", false], [21643, 0.025033, " etc", false], [4715, 0.010908, " or", false], [30788, 0.0071, " even", false], [59943, 0.005968, " knowledge", false], [22590, 0.002387, " the", false], [39273, 0.002071, " phone", false], [55440, 0.00202, " acoustic", false], [51860, 0.00136, " grammar", false]]], "qwen": [315, 1, 0.7161024808883667, [[315, 0.716102, " of", false], [323, 0.192834, " and", false], [476, 0.024667, " or", false], [4992, 0.023788, " etc", false], [6540, 0.009226, " knowledge", false], [1496, 0.00469, " even", false], [50823, 0.004016, " phon", false], [279, 0.001684, " the", false], [5601, 0.000789, " rules", false], [31428, 0.000649, " grammar", false]]]}, "raw_delta": -0.03318565090497334, "tuned_delta": -0.026373373097875397}, {"byte_start": 3372, "byte_end": 3376, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 570, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "10.78% 10.78% 10.78% 10.78%", "qwen": "8.30% 8.30% 8.30% 8.30%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.0908898413181305]], "qwen": [[279, " the", "normal", 0.1585163027048111]]}, "loss": {"rwkv": 10.777946350391181, "qwen": 8.304052772476783}, "topk": {"rwkv": [22590, 2, 0.0908898413181305, [[51860, 0.112277, " grammar", false], [22590, 0.09089, " the", false], [55440, 0.076909, " acoustic", false], [51310, 0.038985, " context", false], [56529, 0.036278, " language", false], [47350, 0.03462, " speech", false], [39273, 0.031495, " phone", false], [62182, 0.026989, " linguistic", false], [21835, 0.022897, " how", false], [64996, 0.02196, " pronunciation", false]]], "qwen": [279, 1, 0.1585163027048111, [[279, 0.158516, " the", false], [4128, 0.06611, " language", false], [50823, 0.065517, " phon", false], [8806, 0.064626, " speech", false], [31428, 0.045814, " grammar", false], [8709, 0.02981, " pros", false], [1246, 0.027838, " how", false], [3409, 0.027465, " word", false], [70622, 0.024873, " pronunciation", false], [15459, 0.024133, " languages", false]]]}, "raw_delta": 0.13718178868293762, "tuned_delta": 0.14399406649003557}, {"byte_start": 3376, "byte_end": 3382, "display": {"text": " human", "kind": "normal"}, "is_word": true, "word_id": 571, "word_key": " human", "bytes_hex": "20 68 75 6d 61 6e", "compression": {"rwkv": "15.59% 15.59% 15.59% 15.59% 15.59% 15.59%", "qwen": "16.97% 16.97% 16.97% 16.97% 16.97% 16.97%"}, "model_tokens": {"rwkv": [[38720, " human", "normal", 0.005643317010253668]], "qwen": [[3738, " human", "normal", 0.0035279719159007072]]}, "loss": {"rwkv": 15.591626092940619, "qwen": 16.97280156375475}, "topk": {"rwkv": [38720, 31, 0.005643317010253668, [[60572, 0.126662, " structure", false], [55440, 0.093347, " acoustic", false], [51860, 0.054715, " grammar", false], [22752, 0.033415, " way", false], [39273, 0.02786, " phone", false], [51310, 0.021547, " context", false], [39747, 0.021012, " sound", false], [47350, 0.018946, " speech", false], [47341, 0.018083, " sounds", false], [56529, 0.017367, " language", false]]], "qwen": [3738, 35, 0.0035279719159007072, [[5944, 0.196786, " structure", false], [3281, 0.084411, " special", false], [50823, 0.04054, " phon", false], [44066, 0.039506, " acoustic", false], [1616, 0.033336, " way", false], [8806, 0.03235, " speech", false], [4128, 0.024568, " language", false], [5112, 0.020068, " sound", false], [31428, 0.014308, " grammar", false], [2266, 0.013803, " context", false]]]}, "raw_delta": -0.07658863067626953, "tuned_delta": -0.06977635286917158}, {"byte_start": 3382, "byte_end": 3388, "display": {"text": " vocal", "kind": "normal"}, "is_word": true, "word_id": 572, "word_key": " vocal", "bytes_hex": "20 76 6f 63 61 6c", "compression": {"rwkv": "7.09% 7.09% 7.09% 7.09% 7.09% 7.09%", "qwen": "5.47% 5.47% 5.47% 5.47% 5.47% 5.47%"}, "model_tokens": {"rwkv": [[40136, " vocal", "normal", 0.09380804747343063]], "qwen": [[25407, " vocal", "normal", 0.1618843823671341]]}, "loss": {"rwkv": 7.0913721085362456, "qwen": 5.472842306374786}, "topk": {"rwkv": [40136, 2, 0.09380804747343063, [[40139, 0.424794, " voice", false], [40136, 0.093808, " vocal", false], [47350, 0.058424, " speech", false], [56529, 0.041626, " language", false], [52963, 0.034792, " speaker", false], [50905, 0.034094, " anatomy", false], [55579, 0.026264, " auditory", false], [21590, 0.025256, " ear", false], [62321, 0.017191, " physiology", false], [46, 0.016723, "-", false]]], "qwen": [25407, 1, 0.1618843823671341, [[25407, 0.161884, " vocal", false], [7743, 0.124555, " voice", false], [8806, 0.082691, " speech", false], [4128, 0.069859, " language", false], [82529, 0.066939, " auditory", false], [2430, 0.040684, " ear", false], [8109, 0.039357, " brain", false], [50823, 0.034274, " phon", false], [10778, 0.031447, " hearing", false], [27564, 0.023384, " artic", false]]]}, "raw_delta": 0.08975034952163696, "tuned_delta": 0.09656262732873491}, {"byte_start": 3388, "byte_end": 3394, "display": {"text": " tract", "kind": "normal"}, "is_word": true, "word_id": 573, "word_key": " tract", "bytes_hex": "20 74 72 61 63 74", "compression": {"rwkv": "1.22% 1.22% 1.22% 1.22% 1.22% 1.22%", "qwen": "0.08% 0.08% 0.08% 0.08% 0.08% 0.08%"}, "model_tokens": {"rwkv": [[39996, " tract", "normal", 0.6676325798034668]], "qwen": [[41829, " tract", "normal", 0.9751889109611511]]}, "loss": {"rwkv": 1.2151606179362606, "qwen": 0.07551333841152351}, "topk": {"rwkv": [39996, 1, 0.6676325798034668, [[39996, 0.667633, " tract", false], [59153, 0.137809, " apparatus", false], [47487, 0.066625, " system", false], [50905, 0.043397, " anatomy", false], [38115, 0.012107, " cords", false], [59994, 0.010074, " mechanism", false], [46719, 0.008023, " organs", false], [38024, 0.004772, " chord", false], [62382, 0.004414, " production", false], [39191, 0.004395, " organ", false]]], "qwen": [41829, 1, 0.9751889109611511, [[41829, 0.975189, " tract", false], [40605, 0.007592, " apparatus", false], [1849, 0.002449, " system", false], [16953, 0.002247, " mechanism", false], [2872, 0.00137, " organ", false], [79617, 0.001342, " cords", false], [35753, 0.001225, " organs", false], [489, 0.001167, " tr", false], [61590, 0.00104, " anatomy", false], [3754, 0.000617, " track", false]]]}, "raw_delta": 0.06319546389083068, "tuned_delta": 0.07000774169792863}, {"byte_start": 3394, "byte_end": 3395, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "8.95%", "qwen": "3.67%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.6128008365631104]], "qwen": [[11, ",", "normal", 0.8159487247467041]]}, "loss": {"rwkv": 8.946399911762613, "qwen": 3.6681201451201666}, "topk": {"rwkv": [45, 1, 0.6128008365631104, [[45, 0.612801, ",", false], [47, 0.147002, ".", false], [5346, 0.112048, "---", false], [21265, 0.073953, " and", false], [275, 0.008802, " (", false], [568, 0.004912, "--", false], [21643, 0.004069, " etc", false], [50905, 0.003683, " anatomy", false], [60, 0.003387, ";", false], [116, 0.002734, "s", false]]], "qwen": [11, 1, 0.8159487247467041, [[11, 0.815949, ",", false], [13, 0.073331, ".", false], [323, 0.039013, " and", false], [4421, 0.033701, "---", false], [320, 0.010362, " (", false], [4992, 0.002894, " etc", false], [26, 0.002181, ";", false], [5944, 0.002157, " structure", false], [476, 0.002121, " or", false], [438, 0.001473, " as", false]]]}, "raw_delta": 0.2926899790763855, "tuned_delta": 0.2995022568834834}, {"byte_start": 3395, "byte_end": 3399, "display": {"text": " etc", "kind": "normal"}, "is_word": true, "word_id": 574, "word_key": " etc", "bytes_hex": "20 65 74 63", "compression": {"rwkv": "9.65% 9.65% 9.65% 9.65%", "qwen": "8.02% 8.02% 8.02% 8.02%"}, "model_tokens": {"rwkv": [[21643, " etc", "normal", 0.11659017205238342]], "qwen": [[4992, " etc", "normal", 0.16893409192562103]]}, "loss": {"rwkv": 9.650840849696678, "qwen": 8.017086283367588}, "topk": {"rwkv": [21643, 3, 0.11659017205238342, [[4706, 0.496546, " of", false], [21265, 0.308384, " and", false], [21643, 0.11659, " etc", false], [59943, 0.015289, " knowledge", false], [4715, 0.008496, " or", false], [30788, 0.008091, " even", false], [22590, 0.006095, " the", false], [55440, 0.002241, " acoustic", false], [4522, 0.002024, " et", false], [21256, 0.001605, " all", false]]], "qwen": [4992, 3, 0.16893409192562103, [[315, 0.404679, " of", false], [323, 0.344859, " and", false], [4992, 0.168934, " etc", false], [6540, 0.021371, " knowledge", false], [476, 0.011289, " or", false], [279, 0.005028, " the", false], [1496, 0.004895, " even", false], [678, 0.003127, " all", false], [50823, 0.002071, " phon", false], [1842, 0.002019, " et", false]]]}, "raw_delta": 0.0905945897102356, "tuned_delta": 0.09740686751733355}, {"byte_start": 3399, "byte_end": 3400, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "4.17%", "qwen": "1.88%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.7948051691055298]], "qwen": [[13, ".", "normal", 0.9009494781494141]]}, "loss": {"rwkv": 4.17381255725933, "qwen": 1.8810239662215529}, "topk": {"rwkv": [47, 1, 0.7948051691055298, [[47, 0.794805, ".", false], [5361, 0.082589, ".--", false], [583, 0.057493, ".,", false], [5346, 0.031973, "---", false], [584, 0.005957, ".-", false], [45, 0.004454, ",", false], [23326, 0.004066, ".—", false], [25358, 0.003573, "eter", false], [585, 0.002887, "..", false], [568, 0.002406, "--", false]]], "qwen": [13, 1, 0.9009494781494141, [[13, 0.900949, ".", false], [4421, 0.032714, "---", false], [2572, 0.032237, ".,", false], [11, 0.006014, ",", false], [1404, 0.005206, "eter", false], [32401, 0.005182, ".--", false], [382, 0.004326, ".\n\n", false], [7110, 0.00181, ".\\", false], [496, 0.001474, "..", false], [15642, 0.00098, ".;", false]]]}, "raw_delta": 0.12713919579982758, "tuned_delta": 0.13395147360692553}, {"byte_start": 3400, "byte_end": 3403, "display": {"text": " On", "kind": "normal"}, "is_word": true, "word_id": 575, "word_key": " on", "bytes_hex": "20 4f 6e", "compression": {"rwkv": "40.01% 40.01% 40.01%", "qwen": "40.04% 40.04% 40.04%"}, "model_tokens": {"rwkv": [[4095, " On", "normal", 0.00129071029368788]], "qwen": [[1913, " On", "normal", 0.0012803024146705866]]}, "loss": {"rwkv": 40.01224527465484, "qwen": 40.0387478011528}, "topk": {"rwkv": [4095, 78, 0.00129071029368788, [[20996, 0.186237, " The", false], [37453, 0.100522, " These", false], [19555, 0.057442, " But", false], [3913, 0.041156, " In", false], [29894, 0.032504, " This", false], [19407, 0.029767, " All", false], [37451, 0.028297, " There", false], [20556, 0.027277, " One", false], [29804, 0.026625, " Some", false], [29425, 0.022377, " Most", false]]], "qwen": [1913, 69, 0.0012803024146705866, [[4220, 0.13774, " These", false], [576, 0.116353, " The", false], [1988, 0.048123, " But", false], [1096, 0.045986, " This", false], [4421, 0.042403, "---", false], [2009, 0.032058, " All", false], [758, 0.031777, " In", false], [2619, 0.024885, " There", false], [1084, 0.022443, " It", false], [2240, 0.019998, " None", false]]]}, "raw_delta": -0.0014696121215820312, "tuned_delta": 0.005342665685515916}, {"byte_start": 3403, "byte_end": 3407, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 576, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "2.66% 2.66% 2.66% 2.66%", "qwen": "3.02% 3.02% 3.02% 3.02%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.5562889575958252]], "qwen": [[279, " the", "normal", 0.5120087265968323]]}, "loss": {"rwkv": 2.6592645407010918, "qwen": 3.0179988525695527}, "topk": {"rwkv": [22590, 1, 0.5562889575958252, [[22590, 0.556289, " the", false], [332, 0.06757, " a", false], [32234, 0.047149, " this", false], [50987, 0.045201, " average", false], [22615, 0.036209, " top", false], [22226, 0.032094, " one", false], [32227, 0.0125, " that", false], [34514, 0.012306, "going", false], [30719, 0.011793, " each", false], [39931, 0.009977, " their", false]]], "qwen": [279, 1, 0.5120087265968323, [[279, 0.512009, " the", false], [825, 0.077259, " one", false], [264, 0.065043, " a", false], [419, 0.062111, " this", false], [5567, 0.028102, " paper", false], [5461, 0.020084, " average", false], [1493, 0.013356, " these", false], [10778, 0.012195, " hearing", false], [429, 0.010967, " that", false], [1181, 0.010632, " its", false]]]}, "raw_delta": -0.019892454147338867, "tuned_delta": -0.013080176340240921}, {"byte_start": 3407, "byte_end": 3413, "display": {"text": " other", "kind": "normal"}, "is_word": true, "word_id": 577, "word_key": " other", "bytes_hex": "20 6f 74 68 65 72", "compression": {"rwkv": "2.35% 2.35% 2.35% 2.35% 2.35% 2.35%", "qwen": "3.91% 3.91% 3.91% 3.91% 3.91% 3.91%"}, "model_tokens": {"rwkv": [[39193, " other", "normal", 0.45846298336982727]], "qwen": [[1008, " other", "normal", 0.2723727226257324]]}, "loss": {"rwkv": 2.3481364597802137, "qwen": 3.909053865388579}, "topk": {"rwkv": [39193, 1, 0.45846298336982727, [[39193, 0.458463, " other", false], [40190, 0.139689, " whole", false], [37815, 0.074647, " basis", false], [22226, 0.043625, " one", false], [30807, 0.025235, " face", false], [53064, 0.013019, " surface", false], [38499, 0.010289, " first", false], [19678, 0.007036, " DAR", false], [21509, 0.006114, " day", false], [30218, 0.005524, " back", false]]], "qwen": [1008, 1, 0.2723727226257324, [[1008, 0.272373, " other", false], [825, 0.128202, " one", false], [8037, 0.101598, " basis", false], [4361, 0.084979, " whole", false], [7329, 0.062224, " surface", false], [1156, 0.035604, " first", false], [1899, 0.020541, " day", false], [3579, 0.019704, " face", false], [8170, 0.016435, " strength", false], [24335, 0.007199, " assumption", false]]]}, "raw_delta": -0.08655563990275063, "tuned_delta": -0.07974336209565268}, {"byte_start": 3413, "byte_end": 3418, "display": {"text": " side", "kind": "normal"}, "is_word": true, "word_id": 578, "word_key": " side", "bytes_hex": "20 73 69 64 65", "compression": {"rwkv": "3.07% 3.07% 3.07% 3.07% 3.07%", "qwen": "13.41% 13.41% 13.41% 13.41% 13.41%"}, "model_tokens": {"rwkv": [[32011, " side", "normal", 0.4273950159549713]], "qwen": [[3108, " side", "normal", 0.024280866608023643]]}, "loss": {"rwkv": 3.0713624893925195, "qwen": 13.410090946877716}, "topk": {"rwkv": [32011, 2, 0.4273950159549713, [[31044, 0.550646, " hand", false], [32011, 0.427395, " side", false], [21616, 0.014313, " end", false], [32207, 0.001616, " team", false], [45, 0.001107, ",", false], [51699, 0.000739, " extreme", false], [38559, 0.00033, " front", false], [32462, 0.000185, " were", false], [38660, 0.000139, " hands", false], [39995, 0.000135, " track", false]]], "qwen": [3108, 2, 0.024280866608023643, [[1424, 0.966155, " hand", false], [3108, 0.024281, " side", false], [835, 0.005734, " end", false], [14226, 0.000471, " extreme", false], [6078, 0.000411, " hands", false], [1616, 0.000195, " way", false], [11, 0.000186, ",", false], [3579, 0.000149, " face", false], [24413, 8.5e-05, "-hand", false], [1030, 7.4e-05, " had", false]]]}, "raw_delta": -0.573300838470459, "tuned_delta": -0.5664885606633611}, {"byte_start": 3418, "byte_end": 3423, "display": {"text": " were", "kind": "normal"}, "is_word": true, "word_id": 579, "word_key": " were", "bytes_hex": "20 77 65 72 65", "compression": {"rwkv": "4.54% 4.54% 4.54% 4.54% 4.54%", "qwen": "5.26% 5.26% 5.26% 5.26% 5.26%"}, "model_tokens": {"rwkv": [[32462, " were", "normal", 0.28445324301719666]], "qwen": [[1033, " were", "normal", 0.23232492804527283]]}, "loss": {"rwkv": 4.536599640295373, "qwen": 5.26446031571068}, "topk": {"rwkv": [32462, 2, 0.28445324301719666, [[45, 0.33072, ",", false], [32462, 0.284453, " were", false], [22748, 0.226678, " was", false], [4706, 0.122208, " of", false], [39934, 0.018141, " there", false], [39826, 0.003793, " stood", false], [22590, 0.00179, " the", false], [275, 0.001717, " (", false], [4858, 0.001261, " we", false], [5346, 0.001212, "---", false]]], "qwen": [1033, 2, 0.23232492804527283, [[315, 0.490659, " of", false], [1033, 0.232325, " were", false], [11, 0.166032, ",", false], [572, 0.082803, " was", false], [1052, 0.011907, " there", false], [14638, 0.003368, " stood", false], [320, 0.001514, " (", false], [7578, 0.001177, " sat", false], [582, 0.001015, " we", false], [279, 0.000952, " the", false]]]}, "raw_delta": -0.04036116600036621, "tuned_delta": -0.03354888819326826}, {"byte_start": 3423, "byte_end": 3429, "display": {"text": " newer", "kind": "normal"}, "is_word": true, "word_id": 580, "word_key": " newer", "bytes_hex": "20 6e 65 77 65 72", "compression": {"rwkv": "26.67% 26.67% 26.67% 26.67% 26.67% 26.67%", "qwen": "26.07% 26.07% 26.07% 26.07% 26.07% 26.07%"}, "model_tokens": {"rwkv": [[39116, " newer", "normal", 0.00013971509179100394]], "qwen": [[25546, " newer", "normal", 0.00017089667380787432]]}, "loss": {"rwkv": 26.67483018310323, "qwen": 26.072059655604225}, "topk": {"rwkv": [39116, 312, 0.00013971509179100394, [[52224, 0.231212, " methods", false], [63843, 0.132186, " researchers", false], [22590, 0.119761, " the", false], [332, 0.038844, " a", false], [61590, 0.022628, " approaches", false], [39904, 0.022013, " teams", false], [39944, 0.017609, " those", false], [62633, 0.016497, " techniques", false], [51566, 0.016447, " efforts", false], [47202, 0.015616, " search", false]]], "qwen": [25546, 334, 0.00017089667380787432, [[5413, 0.14978, " methods", false], [279, 0.096848, " the", false], [264, 0.049531, " a", false], [29728, 0.035675, " neural", false], [1378, 0.033291, " two", false], [11811, 0.032846, " researchers", false], [5942, 0.031073, " systems", false], [4586, 0.021922, " general", false], [7468, 0.021892, " programs", false], [1657, 0.021721, " many", false]]]}, "raw_delta": 0.0334246953328452, "tuned_delta": 0.04023697313994315}, {"byte_start": 3429, "byte_end": 3437, "display": {"text": " methods", "kind": "normal"}, "is_word": true, "word_id": 581, "word_key": " methods", "bytes_hex": "20 6d 65 74 68 6f 64 73", "compression": {"rwkv": "1.72% 1.72% 1.72% 1.72% 1.72% 1.72% 1.72% 1.72%", "qwen": "1.34% 1.34% 1.34% 1.34% 1.34% 1.34% 1.34% 1.34%"}, "model_tokens": {"rwkv": [[52224, " methods", "normal", 0.4692554175853729]], "qwen": [[5413, " methods", "normal", 0.5520504713058472]]}, "loss": {"rwkv": 1.7170747862142812, "qwen": 1.3392624926301873}, "topk": {"rwkv": [52224, 1, 0.4692554175853729, [[52224, 0.469255, " methods", false], [61590, 0.135555, " approaches", false], [45, 0.13509, ",", false], [62633, 0.066641, " techniques", false], [38378, 0.030153, " entra", false], [21265, 0.025285, " and", false], [63843, 0.015166, " researchers", false], [57103, 0.009228, " research", false], [63363, 0.007917, " competitors", false], [47202, 0.005868, " search", false]]], "qwen": [5413, 1, 0.5520504713058472, [[5413, 0.55205, " methods", false], [11, 0.132193, ",", false], [19827, 0.082683, " approaches", false], [12538, 0.043585, " techniques", false], [5942, 0.030773, " systems", false], [323, 0.017067, " and", false], [4586, 0.011913, " general", false], [7468, 0.010526, " programs", false], [9902, 0.006363, " ``", false], [11811, 0.005818, " researchers", false]]]}, "raw_delta": 0.02095036208629608, "tuned_delta": 0.027762639893394028}, {"byte_start": 3437, "byte_end": 3442, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 582, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"rwkv": "3.09% 3.09% 3.09% 3.09% 3.09%", "qwen": "2.18% 2.18% 2.18% 2.18% 2.18%"}, "model_tokens": {"rwkv": [[32227, " that", "normal", 0.4238909184932709]], "qwen": [[429, " that", "normal", 0.5460522174835205]]}, "loss": {"rwkv": 3.0854513081512005, "qwen": 2.182222718369164}, "topk": {"rwkv": [32227, 1, 0.4238909184932709, [[32227, 0.423891, " that", false], [37810, 0.225697, " based", false], [45, 0.105588, ",", false], [4706, 0.03983, " of", false], [40085, 0.021845, " using", false], [5346, 0.017346, "---", false], [32139, 0.015011, " such", false], [21700, 0.012217, " for", false], [275, 0.009653, " (", false], [31296, 0.008469, " like", false]]], "qwen": [429, 1, 0.5460522174835205, [[429, 0.546052, " that", false], [3118, 0.155059, " based", false], [11, 0.141318, ",", false], [4421, 0.023036, "---", false], [320, 0.012567, " (", false], [315, 0.011942, " of", false], [1667, 0.009367, " using", false], [1741, 0.009027, " such", false], [1075, 0.008867, " like", false], [892, 0.007434, " which", false]]]}, "raw_delta": 0.05008562803268433, "tuned_delta": 0.05689790583978228}, {"byte_start": 3442, "byte_end": 3447, "display": {"text": " were", "kind": "normal"}, "is_word": true, "word_id": 583, "word_key": " were", "bytes_hex": "20 77 65 72 65", "compression": {"rwkv": "7.95% 7.95% 7.95% 7.95% 7.95%", "qwen": "7.93% 7.93% 7.93% 7.93% 7.93%"}, "model_tokens": {"rwkv": [[32462, " were", "normal", 0.11110776662826538]], "qwen": [[1033, " were", "normal", 0.1108400747179985]]}, "loss": {"rwkv": 7.946093779896243, "qwen": 7.933621598055672}, "topk": {"rwkv": [32462, 3, 0.11110776662826538, [[32354, 0.156601, " used", false], [32272, 0.128351, " took", false], [32462, 0.111108, " were", false], [56540, 0.054765, " leverage", false], [21532, 0.054184, " did", false], [57510, 0.038551, " utilized", false], [31351, 0.035004, " made", false], [47054, 0.028587, " relied", false], [21795, 0.021199, " had", false], [50937, 0.01595, " applied", false]]], "qwen": [1033, 2, 0.1108400747179985, [[1483, 0.118791, " used", false], [1033, 0.11084, " were", false], [3867, 0.110069, " took", false], [1521, 0.06304, " did", false], [27505, 0.052365, " lever", false], [39913, 0.052317, " relied", false], [1865, 0.034872, " made", false], [33616, 0.033021, " utilized", false], [9251, 0.020661, " applied", false], [50663, 0.019668, " exploited", false]]]}, "raw_delta": 0.0006916046142578236, "tuned_delta": 0.0075038824213557705}, {"byte_start": 3447, "byte_end": 3452, "display": {"text": " more", "kind": "normal"}, "is_word": true, "word_id": 584, "word_key": " more", "bytes_hex": "20 6d 6f 72 65", "compression": {"rwkv": "10.48% 10.48% 10.48% 10.48% 10.48%", "qwen": "10.64% 10.64% 10.64% 10.64% 10.64%"}, "model_tokens": {"rwkv": [[31458, " more", "normal", 0.05482875183224678]], "qwen": [[803, " more", "normal", 0.052396297454833984]]}, "loss": {"rwkv": 10.482081156458875, "qwen": 10.635978111756948}, "topk": {"rwkv": [31458, 2, 0.05482875183224678, [[37810, 0.277373, " based", false], [31458, 0.054829, " more", false], [22187, 0.054813, " not", false], [31466, 0.019538, " much", false], [63541, 0.019073, " essentially", false], [47202, 0.017314, " search", false], [46957, 0.016986, " purely", false], [51832, 0.010649, " general", false], [45, 0.00965, ",", false], [56131, 0.009253, " entirely", false]]], "qwen": [803, 3, 0.052396297454833984, [[3118, 0.30488, " based", false], [537, 0.055778, " not", false], [803, 0.052396, " more", false], [2686, 0.026301, " less", false], [1753, 0.025835, " much", false], [15791, 0.021092, " essentially", false], [4586, 0.016136, " general", false], [2711, 0.015008, " search", false], [13771, 0.01305, " largely", false], [1602, 0.011742, " very", false]]]}, "raw_delta": -0.008533859252929599, "tuned_delta": -0.0017215814458316518}, {"byte_start": 3452, "byte_end": 3464, "display": {"text": " statistical", "kind": "normal"}, "is_word": true, "word_id": 585, "word_key": " statistical", "bytes_hex": "20 73 74 61 74 69 73 74 69 63 61 6c", "compression": {"rwkv": "7.33% 7.33% 7.33% 7.33% 7.33% 7.33% 7.33% 7.33% 7.33% 7.33% 7.33% 7.33%", "qwen": "9.61% 9.61% 9.61% 9.61% 9.61% 9.61% 9.61% 9.61% 9.61% 9.61% 9.61% 9.61%"}, "model_tokens": {"rwkv": [[63885, " statistical", "normal", 0.007582460064440966]], "qwen": [[28464, " statistical", "normal", 0.0016723305452615023]]}, "loss": {"rwkv": 7.326185754514267, "qwen": 9.608254362371156}, "topk": {"rwkv": [63885, 21, 0.007582460064440966, [[51832, 0.345775, " general", false], [31296, 0.084525, " like", false], [59593, 0.028752, " effective", false], [30579, 0.025895, " data", false], [59758, 0.021203, " generally", false], [4715, 0.017158, " or", false], [4596, 0.016879, " in", false], [64862, 0.014066, " computational", false], [37810, 0.013456, " based", false], [55424, 0.011481, " abstract", false]]], "qwen": [28464, 55, 0.0016723305452615023, [[4586, 0.515447, " general", false], [1075, 0.03594, " like", false], [2711, 0.024862, " search", false], [3716, 0.018841, " comput", false], [476, 0.016976, " or", false], [7373, 0.016174, " effective", false], [54480, 0.015547, " computational", false], [13954, 0.014393, " generic", false], [3118, 0.013251, " based", false], [31499, 0.012603, " suited", false]]]}, "raw_delta": -0.1265447537104288, "tuned_delta": -0.11973247590333086}, {"byte_start": 3464, "byte_end": 3467, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 586, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "7.14% 7.14% 7.14%", "qwen": "7.96% 7.96% 7.96%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.3087635040283203]], "qwen": [[304, " in", "normal", 0.26591023802757263]]}, "loss": {"rwkv": 7.138334837731849, "qwen": 7.962453486240692}, "topk": {"rwkv": [4596, 2, 0.3087635040283203, [[45, 0.32, ",", false], [4596, 0.308764, " in", false], [21265, 0.174599, " and", false], [47, 0.071229, ".", false], [5346, 0.031595, "---", false], [275, 0.025327, " (", false], [4715, 0.011921, " or", false], [32226, 0.008615, " than", false], [59, 0.005644, ":", false], [61590, 0.004505, " approaches", false]]], "qwen": [304, 1, 0.26591023802757263, [[304, 0.26591, " in", false], [11, 0.261915, ",", false], [323, 0.217155, " and", false], [4421, 0.069411, "---", false], [13, 0.061853, ".", false], [320, 0.038152, " (", false], [714, 0.021823, " but", false], [476, 0.011689, " or", false], [25, 0.009083, ":", false], [26, 0.005756, ";", false]]]}, "raw_delta": -0.04569884141286218, "tuned_delta": -0.03888656360576423}, {"byte_start": 3467, "byte_end": 3474, "display": {"text": " nature", "kind": "normal"}, "is_word": true, "word_id": 587, "word_key": " nature", "bytes_hex": "20 6e 61 74 75 72 65", "compression": {"rwkv": "0.72% 0.72% 0.72% 0.72% 0.72% 0.72% 0.72%", "qwen": "0.58% 0.58% 0.58% 0.58% 0.58% 0.58% 0.58%"}, "model_tokens": {"rwkv": [[46642, " nature", "normal", 0.7518977522850037]], "qwen": [[6993, " nature", "normal", 0.7982470989227295]]}, "loss": {"rwkv": 0.7245678218750374, "qwen": 0.5805226393643393}, "topk": {"rwkv": [46642, 1, 0.7518977522850037, [[46642, 0.751898, " nature", false], [55532, 0.065544, " approach", false], [59284, 0.053648, " character", false], [39931, 0.043038, " their", false], [46004, 0.024629, " flavor", false], [47362, 0.011569, " spirit", false], [22590, 0.010589, " the", false], [63735, 0.005503, " orientation", false], [30899, 0.002562, " form", false], [46723, 0.002277, " origin", false]]], "qwen": [6993, 1, 0.7982470989227295, [[6993, 0.798247, " nature", false], [3668, 0.055633, " character", false], [17172, 0.04214, " flavor", false], [5486, 0.025221, " approach", false], [862, 0.024129, " their", false], [8913, 0.007035, " spirit", false], [279, 0.005846, " the", false], [16725, 0.004318, " orientation", false], [1352, 0.003448, " form", false], [5244, 0.003247, " focus", false]]]}, "raw_delta": 0.00798756097044264, "tuned_delta": 0.014799838777540587}, {"byte_start": 3474, "byte_end": 3478, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 588, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"rwkv": "7.68% 7.68% 7.68% 7.68%", "qwen": "7.11% 7.11% 7.11% 7.11%"}, "model_tokens": {"rwkv": [[21265, " and", "normal", 0.18158705532550812]], "qwen": [[323, " and", "normal", 0.20663084089756012]]}, "loss": {"rwkv": 7.678406223481298, "qwen": 7.108976503486595}, "topk": {"rwkv": [21265, 3, 0.18158705532550812, [[45, 0.44778, ",", false], [47, 0.228313, ".", false], [21265, 0.181587, " and", false], [5346, 0.05192, "---", false], [275, 0.047175, " (", false], [59, 0.013326, ":", false], [21400, 0.009705, " but", false], [60, 0.006601, ";", false], [4715, 0.001903, " or", false], [32227, 0.001524, " that", false]]], "qwen": [323, 3, 0.20663084089756012, [[11, 0.348995, ",", false], [13, 0.261467, ".", false], [323, 0.206631, " and", false], [4421, 0.067034, "---", false], [320, 0.041091, " (", false], [714, 0.02972, " but", false], [25, 0.015691, ":", false], [26, 0.008932, ";", false], [429, 0.004058, " that", false], [313, 0.001818, "--", false]]]}, "raw_delta": 0.03157588839530945, "tuned_delta": 0.0383881662024074}, {"byte_start": 3478, "byte_end": 3482, "display": {"text": " did", "kind": "normal"}, "is_word": true, "word_id": 589, "word_key": " did", "bytes_hex": "20 64 69 64", "compression": {"rwkv": "11.69% 11.69% 11.69% 11.69%", "qwen": "12.47% 12.47% 12.47% 12.47%"}, "model_tokens": {"rwkv": [[21532, " did", "normal", 0.07378979027271271]], "qwen": [[1521, " did", "normal", 0.06296456605195999]]}, "loss": {"rwkv": 11.693719569705465, "qwen": 12.466612827357629}, "topk": {"rwkv": [21532, 2, 0.07378979027271271, [[32227, 0.153298, " that", false], [21532, 0.07379, " did", false], [32354, 0.072372, " used", false], [37810, 0.060761, " based", false], [32462, 0.051322, " were", false], [31458, 0.045525, " more", false], [32272, 0.025518, " took", false], [21795, 0.025416, " had", false], [31277, 0.023815, " less", false], [45, 0.023553, ",", false]]], "qwen": [1521, 2, 0.06296456605195999, [[429, 0.120831, " that", false], [1521, 0.062965, " did", false], [1033, 0.058103, " were", false], [3867, 0.057854, " took", false], [11, 0.035677, ",", false], [1483, 0.033562, " used", false], [1865, 0.031942, " made", false], [39913, 0.028828, " relied", false], [892, 0.023499, " which", false], [1030, 0.023368, " had", false]]]}, "raw_delta": -0.0428583025932312, "tuned_delta": -0.03604602478613325}, {"byte_start": 3482, "byte_end": 3487, "display": {"text": " much", "kind": "normal"}, "is_word": true, "word_id": 590, "word_key": " much", "bytes_hex": "20 6d 75 63 68", "compression": {"rwkv": "22.09% 22.09% 22.09% 22.09% 22.09%", "qwen": "20.84% 20.84% 20.84% 20.84% 20.84%"}, "model_tokens": {"rwkv": [[31466, " much", "normal", 0.0021982984617352486]], "qwen": [[1753, " much", "normal", 0.0030921902507543564]]}, "loss": {"rwkv": 22.09126781361225, "qwen": 20.84288874666184}, "topk": {"rwkv": [31466, 4, 0.0021982984617352486, [[22187, 0.973046, " not", false], [30211, 0.004469, " away", false], [4692, 0.002833, " no", false], [31466, 0.002198, " much", false], [31277, 0.001806, " less", false], [31458, 0.001425, " more", false], [46454, 0.001201, " little", false], [332, 0.001129, " a", false], [45301, 0.001058, " better", false], [31856, 0.000681, " rely", false]]], "qwen": [1753, 4, 0.0030921902507543564, [[537, 0.949856, " not", false], [264, 0.004543, " a", false], [2664, 0.00393, " better", false], [1753, 0.003092, " much", false], [2686, 0.00274, " less", false], [1632, 0.002697, " well", false], [1373, 0.002249, " require", false], [2632, 0.001887, " little", false], [803, 0.001702, " more", false], [1602, 0.001505, " very", false]]]}, "raw_delta": 0.06922483444213867, "tuned_delta": 0.07603711224923662}, {"byte_start": 3487, "byte_end": 3492, "display": {"text": " more", "kind": "normal"}, "is_word": true, "word_id": 591, "word_key": " more", "bytes_hex": "20 6d 6f 72 65", "compression": {"rwkv": "9.30% 9.30% 9.30% 9.30% 9.30%", "qwen": "5.78% 5.78% 5.78% 5.78% 5.78%"}, "model_tokens": {"rwkv": [[31458, " more", "normal", 0.07646842300891876]], "qwen": [[803, " more", "normal", 0.20147407054901123]]}, "loss": {"rwkv": 9.298620380729647, "qwen": 5.778335017442954}, "topk": {"rwkv": [31458, 3, 0.07646842300891876, [[45301, 0.514165, " better", false], [31277, 0.301504, " less", false], [31458, 0.076468, " more", false], [4706, 0.033663, " of", false], [22590, 0.014379, " the", false], [32487, 0.011051, " with", false], [4811, 0.008533, " to", false], [45, 0.004552, ",", false], [4715, 0.00371, " or", false], [38475, 0.002422, " fewer", false]]], "qwen": [803, 3, 0.20147407054901123, [[2686, 0.413826, " less", false], [2664, 0.293949, " better", false], [803, 0.201474, " more", false], [315, 0.03732, " of", false], [10960, 0.006383, " worse", false], [448, 0.00482, " with", false], [311, 0.004143, " to", false], [11, 0.003658, ",", false], [6832, 0.003465, " learning", false], [279, 0.003133, " the", false]]]}, "raw_delta": 0.19520606994628908, "tuned_delta": 0.20201834775338703}, {"byte_start": 3492, "byte_end": 3504, "display": {"text": " computation", "kind": "normal"}, "is_word": true, "word_id": 592, "word_key": " computation", "bytes_hex": "20 63 6f 6d 70 75 74 61 74 69 6f 6e", "compression": {"rwkv": "3.66% 3.66% 3.66% 3.66% 3.66% 3.66% 3.66% 3.66% 3.66% 3.66% 3.66% 3.66%", "qwen": "1.86% 1.86% 1.86% 1.86% 1.86% 1.86% 1.86% 1.86% 1.86% 1.86% 1.86% 1.86%"}, "model_tokens": {"rwkv": [[63370, " computation", "normal", 0.08778508007526398]], "qwen": [[34447, " computation", "normal", 0.2901773154735565]]}, "loss": {"rwkv": 3.6630928772571334, "qwen": 1.8593682153775188}, "topk": {"rwkv": [63370, 2, 0.08778508007526398, [[32487, 0.270428, " with", false], [63370, 0.087785, " computation", false], [4811, 0.062312, " to", false], [51832, 0.042301, " general", false], [4706, 0.039211, " of", false], [32499, 0.024623, " work", false], [56537, 0.023751, " learning", false], [63507, 0.019989, " effectively", false], [59593, 0.013272, " effective", false], [4450, 0.012706, " by", false]]], "qwen": [34447, 1, 0.2901773154735565, [[34447, 0.290177, " computation", false], [15039, 0.145217, " searching", false], [2711, 0.081705, " search", false], [315, 0.0751, " of", false], [448, 0.05351, " with", false], [24231, 0.031271, " computing", false], [6832, 0.022954, " learning", false], [4586, 0.018643, " general", false], [975, 0.017757, " work", false], [311, 0.01145, " to", false]]]}, "raw_delta": 0.10001973311106364, "tuned_delta": 0.1068320109181616}, {"byte_start": 3504, "byte_end": 3505, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "34.52%", "qwen": "45.12%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.14680984616279602]], "qwen": [[11, ",", "normal", 0.08190564066171646]]}, "loss": {"rwkv": 34.51760595876914, "qwen": 45.12366854832176}, "topk": {"rwkv": [45, 2, 0.14680984616279602, [[47, 0.48754, ".", false], [45, 0.14681, ",", false], [5346, 0.051497, "---", false], [275, 0.044569, " (", false], [22278, 0.03316, " per", false], [4596, 0.031384, " in", false], [4712, 0.022337, " on", false], [4811, 0.021803, " to", false], [32226, 0.02167, " than", false], [21265, 0.019114, " and", false]]], "qwen": [11, 2, 0.08190564066171646, [[13, 0.583414, ".", false], [11, 0.081906, ",", false], [1091, 0.070011, " than", false], [4421, 0.039688, "---", false], [320, 0.033191, " (", false], [304, 0.031476, " in", false], [817, 0.024267, " per", false], [389, 0.023708, " on", false], [311, 0.02129, " to", false], [323, 0.013687, " and", false]]]}, "raw_delta": -0.5881249904632568, "tuned_delta": -0.5813127126561589}, {"byte_start": 3505, "byte_end": 3511, "display": {"text": " based", "kind": "normal"}, "is_word": true, "word_id": 593, "word_key": " based", "bytes_hex": "20 62 61 73 65 64", "compression": {"rwkv": "12.59% 12.59% 12.59% 12.59% 12.59% 12.59%", "qwen": "13.62% 13.62% 13.62% 13.62% 13.62% 13.62%"}, "model_tokens": {"rwkv": [[37810, " based", "normal", 0.015305726788938046]], "qwen": [[3118, " based", "normal", 0.01076422818005085]]}, "loss": {"rwkv": 12.586011424421944, "qwen": 13.620024149393167}, "topk": {"rwkv": [37810, 11, 0.015305726788938046, [[21400, 0.23474, " but", false], [21265, 0.119558, " and", false], [59841, 0.053861, " including", false], [40085, 0.037291, " using", false], [4596, 0.025085, " in", false], [40186, 0.023396, " which", false], [32487, 0.01988, " with", false], [4788, 0.016254, " so", false], [38888, 0.016036, " lever", false], [61953, 0.015371, " especially", false]]], "qwen": [3118, 12, 0.01076422818005085, [[714, 0.261164, " but", false], [323, 0.184254, " and", false], [2670, 0.10632, " including", false], [1741, 0.029872, " such", false], [5310, 0.020441, " especially", false], [448, 0.019934, " with", false], [892, 0.018584, " which", false], [304, 0.01769, " in", false], [7892, 0.014641, " although", false], [1667, 0.014108, " using", false]]]}, "raw_delta": -0.057337840398152706, "tuned_delta": -0.05052556259105476}, {"byte_start": 3511, "byte_end": 3514, "display": {"text": " on", "kind": "normal"}, "is_word": true, "word_id": 594, "word_key": " on", "bytes_hex": "20 6f 6e", "compression": {"rwkv": "0.48% 0.48% 0.48%", "qwen": "0.84% 0.84% 0.84%"}, "model_tokens": {"rwkv": [[4712, " on", "normal", 0.9228700399398804]], "qwen": [[389, " on", "normal", 0.8698983192443848]]}, "loss": {"rwkv": 0.48136797425494376, "qwen": 0.8378387436300176}, "topk": {"rwkv": [4712, 1, 0.9228700399398804, [[4712, 0.92287, " on", false], [4596, 0.01056, " in", false], [32350, 0.010244, " upon", false], [52094, 0.007695, " largely", false], [46495, 0.005735, " mainly", false], [45, 0.005434, ",", false], [60247, 0.004831, " primarily", false], [46602, 0.00379, " mostly", false], [45202, 0.003078, " around", false], [31458, 0.00207, " more", false]]], "qwen": [389, 1, 0.8698983192443848, [[389, 0.869898, " on", false], [304, 0.021619, " in", false], [11, 0.011789, ",", false], [13771, 0.010429, " largely", false], [438, 0.008155, " as", false], [10008, 0.005441, " mostly", false], [537, 0.005329, " not", false], [2987, 0.005026, " either", false], [15503, 0.004967, " primarily", false], [5193, 0.004075, " upon", false]]]}, "raw_delta": -0.019766936699549358, "tuned_delta": -0.012954658892451412}, {"byte_start": 3514, "byte_end": 3521, "display": {"text": " hidden", "kind": "normal"}, "is_word": true, "word_id": 595, "word_key": " hidden", "bytes_hex": "20 68 69 64 64 65 6e", "compression": {"rwkv": "8.37% 8.37% 8.37% 8.37% 8.37% 8.37% 8.37%", "qwen": "10.98% 10.98% 10.98% 10.98% 10.98% 10.98% 10.98%"}, "model_tokens": {"rwkv": [[46196, " hidden", "normal", 0.038226861506700516]], "qwen": [[8177, " hidden", "normal", 0.014072589576244354]]}, "loss": {"rwkv": 8.372783719444877, "qwen": 10.983872234296777}, "topk": {"rwkv": [46196, 5, 0.038226861506700516, [[22590, 0.167481, " the", false], [56537, 0.054717, " learning", false], [332, 0.048736, " a", false], [38864, 0.042485, " large", false], [46196, 0.038227, " hidden", false], [52195, 0.026739, " massive", false], [52224, 0.023715, " methods", false], [63885, 0.022242, " statistical", false], [44396, 0.016242, " Hidden", false], [62633, 0.016198, " techniques", false]]], "qwen": [8177, 7, 0.014072589576244354, [[279, 0.121637, " the", false], [264, 0.052986, " a", false], [6832, 0.03322, " learning", false], [3460, 0.029745, " large", false], [4862, 0.026799, " training", false], [29728, 0.015595, " neural", false], [8177, 0.014073, " hidden", false], [12538, 0.012574, " techniques", false], [5662, 0.012055, " machine", false], [5413, 0.010144, " methods", false]]]}, "raw_delta": -0.14478949138096397, "tuned_delta": -0.13797721357386603}, {"byte_start": 3521, "byte_end": 3528, "display": {"text": " Markov", "kind": "normal"}, "is_word": true, "word_id": 596, "word_key": " markov", "bytes_hex": "20 4d 61 72 6b 6f 76", "compression": {"rwkv": "0.10% 0.10% 0.10% 0.10% 0.10% 0.10% 0.10%", "qwen": "0.37% 0.37% 0.37% 0.37% 0.37% 0.01% 0.01%"}, "model_tokens": {"rwkv": [[44557, " Markov", "normal", 0.9619584679603577]], "qwen": [[4389, " Mark", "normal", 0.9030137658119202], [859, "ov", "normal", 0.9992189407348633]]}, "loss": {"rwkv": 0.10126338482802172, "qwen": 0.2648345104151857}, "topk": {"rwkv": [44557, 1, 0.9619584679603577, [[44557, 0.961958, " Markov", false], [46, 0.016333, "-", false], [31376, 0.010048, " mark", false], [60725, 0.002056, " variables", false], [47398, 0.000976, " states", false], [39802, 0.000607, " state", false], [40069, 0.000602, " units", false], [57518, 0.000471, " variable", false], [275, 0.000341, " (", false], [46587, 0.000331, " models", false]]], "qwen": [4389, 1, 0.9030137658119202, [[4389, 0.903014, " Mark", false], [1868, 0.035682, " mark", false], [5251, 0.009038, "-M", false], [28904, 0.007059, "-mark", false], [12, 0.006278, "-", false], [1448, 0.004914, "-m", false], [20733, 0.004111, "-state", false], [1584, 0.002487, " state", false], [8949, 0.001597, "Mark", false], [64096, 0.001461, "-memory", false]]]}, "raw_delta": -0.009070309161740755, "tuned_delta": -0.002258031354642808}, {"byte_start": 3528, "byte_end": 3535, "display": {"text": " models", "kind": "normal"}, "is_word": true, "word_id": 597, "word_key": " models", "bytes_hex": "20 6d 6f 64 65 6c 73", "compression": {"rwkv": "0.15% 0.15% 0.15% 0.15% 0.15% 0.15% 0.15%", "qwen": "0.08% 0.08% 0.08% 0.08% 0.08% 0.08% 0.08%"}, "model_tokens": {"rwkv": [[46587, " models", "normal", 0.9431876540184021]], "qwen": [[4119, " models", "normal", 0.9691730737686157]]}, "loss": {"rwkv": 0.15032266443414405, "qwen": 0.08066737789838634}, "topk": {"rwkv": [46587, 1, 0.9431876540184021, [[46587, 0.943188, " models", false], [39043, 0.014277, " model", false], [46, 0.010012, "-", false], [56658, 0.007087, " modeling", false], [21265, 0.003885, " and", false], [45447, 0.003066, " chains", false], [60261, 0.002833, " processes", false], [4715, 0.002538, " or", false], [44592, 0.001409, " Models", false], [45, 0.001098, ",", false]]], "qwen": [4119, 1, 0.9691730737686157, [[4119, 0.969173, " models", false], [1614, 0.012049, " model", false], [26874, 0.00448, " Models", false], [33479, 0.003152, " modeling", false], [476, 0.002071, " or", false], [26179, 0.001405, " chains", false], [28244, 0.001231, "-model", false], [323, 0.00104, " and", false], [11364, 0.000769, " processes", false], [4194, 0.000413, " random", false]]]}, "raw_delta": 0.003862509237868447, "tuned_delta": 0.010674787044966393}, {"byte_start": 3535, "byte_end": 3537, "display": {"text": " (", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "20 28", "compression": {"rwkv": "18.17% 18.17%", "qwen": "16.60% 16.60%"}, "model_tokens": {"rwkv": [[275, " (", "normal", 0.13171638548374176]], "qwen": [[320, " (", "normal", 0.15871939063072205]]}, "loss": {"rwkv": 18.174576198698855, "qwen": 16.59656013462283}, "topk": {"rwkv": [275, 4, 0.13171638548374176, [[47, 0.28309, ".", false], [21265, 0.271492, " and", false], [45, 0.207196, ",", false], [275, 0.131716, " (", false], [4715, 0.035819, " or", false], [4706, 0.013745, " of", false], [5346, 0.010189, "---", false], [32227, 0.009444, " that", false], [21700, 0.005647, " for", false], [32487, 0.005494, " with", false]]], "qwen": [320, 4, 0.15871939063072205, [[323, 0.328073, " and", false], [11, 0.233007, ",", false], [13, 0.175975, ".", false], [320, 0.158719, " (", false], [476, 0.035767, " or", false], [448, 0.013998, " with", false], [429, 0.010125, " that", false], [4421, 0.006499, "---", false], [315, 0.006206, " of", false], [369, 0.003851, " for", false]]]}, "raw_delta": 0.08750379085540771, "tuned_delta": 0.09431606866250566}, {"byte_start": 3537, "byte_end": 3541, "display": {"text": "HMMs", "kind": "normal"}, "is_word": true, "word_id": 598, "word_key": "hmms", "bytes_hex": "48 4d 4d 73", "compression": {"rwkv": "2.55% 2.55% 0.95% 0.95%", "qwen": "6.68% 0.03% 0.03% 2.60%"}, "model_tokens": {"rwkv": [[1082, "HM", "normal", 0.7519206404685974], [1261, "Ms", "normal", 0.9006590843200684]], "qwen": [[39, "H", "normal", 0.6906211972236633], [8035, "MM", "normal", 0.9962831139564514], [82, "s", "normal", 0.8658856153488159]]}, "loss": {"rwkv": 1.7500954551799406, "qwen": 2.334867245282211}, "topk": {"rwkv": [1082, 1, 0.7519206404685974, [[1082, 0.751921, "HM", false], [36003, 0.021977, "which", false], [7005, 0.0198, "and", false], [98, 0.019467, "a", false], [2101, 0.01375, "or", false], [8695, 0.010896, "see", false], [8801, 0.010098, "the", false], [1926, 0.008635, "hm", false], [27142, 0.0064, "that", false], [7579, 0.004195, "for", false]]], "qwen": [39, 1, 0.6906211972236633, [[39, 0.690621, "H", false], [8206, 0.047421, "which", false], [437, 0.039519, "and", false], [64, 0.024801, "a", false], [269, 0.016491, "or", false], [1782, 0.01081, "the", false], [258, 0.009388, "in", false], [71, 0.008746, "h", false], [300, 0.006994, "as", false], [4197, 0.006513, "with", false]]]}, "raw_delta": -0.03242663340643048, "tuned_delta": -0.025614355599332537}, {"byte_start": 3541, "byte_end": 3543, "display": {"text": ").", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "29 2e", "compression": {"rwkv": "7.36% 7.36%", "qwen": "9.13% 9.13%"}, "model_tokens": {"rwkv": [[499, ").", "normal", 0.4392243027687073]], "qwen": [[568, ").", "normal", 0.3631744682788849]]}, "loss": {"rwkv": 7.361407801410969, "qwen": 9.132908647273922}, "topk": {"rwkv": [499, 1, 0.4392243027687073, [[499, 0.439224, ").", false], [42, 0.317476, ")", false], [497, 0.21548, "),", false], [5308, 0.008782, ")--", false], [45, 0.007772, ",", false], [502, 0.002593, ");", false], [60, 0.001671, ";", false], [21700, 0.001497, " for", false], [501, 0.000692, "):", false], [21265, 0.000659, " and", false]]], "qwen": [568, 2, 0.3631744682788849, [[8, 0.385691, ")", false], [568, 0.363174, ").", false], [701, 0.229154, "),", false], [11, 0.006967, ",", false], [3593, 0.002974, ").\n\n", false], [1215, 0.002065, ");", false], [29621, 0.001574, ")--", false], [26, 0.001246, ";", false], [323, 0.001242, " and", false], [4421, 0.000941, "---", false]]]}, "raw_delta": -0.09823286533355713, "tuned_delta": -0.09142058752645918}, {"byte_start": 3543, "byte_end": 3549, "display": {"text": " Again", "kind": "normal"}, "is_word": true, "word_id": 599, "word_key": " again", "bytes_hex": "20 41 67 61 69 6e", "compression": {"rwkv": "16.53% 16.53% 16.53% 16.53% 16.53% 16.53%", "qwen": "15.64% 15.64% 15.64% 15.64% 15.64% 15.64%"}, "model_tokens": {"rwkv": [[36251, " Again", "normal", 0.004122769460082054]], "qwen": [[13759, " Again", "normal", 0.005494527984410524]]}, "loss": {"rwkv": 16.530880676852703, "qwen": 15.641225889449453}, "topk": {"rwkv": [36251, 30, 0.004122769460082054, [[20996, 0.327538, " The", false], [3866, 0.09022, " HM", false], [37453, 0.082834, " These", false], [3913, 0.059431, " In", false], [3918, 0.027579, " It", false], [29894, 0.021933, " This", false], [3642, 0.016981, " At", false], [37451, 0.015479, " There", false], [54829, 0.014843, " Although", false], [300, 0.013017, " A", false]]], "qwen": [13759, 31, 0.005494527984410524, [[576, 0.262557, " The", false], [4220, 0.073662, " These", false], [472, 0.071914, " H", false], [758, 0.057428, " In", false], [1096, 0.038843, " This", false], [1084, 0.028376, " It", false], [2411, 0.020486, " At", false], [2619, 0.016192, " There", false], [3197, 0.015853, " When", false], [3216, 0.014445, " By", false]]]}, "raw_delta": 0.049332936604817634, "tuned_delta": 0.056145214411915584}, {"byte_start": 3549, "byte_end": 3550, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "2.34%", "qwen": "3.05%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.8776857852935791]], "qwen": [[11, ",", "normal", 0.8445719480514526]]}, "loss": {"rwkv": 2.342266118630763, "qwen": 3.0463466991666914}, "topk": {"rwkv": [45, 1, 0.8776857852935791, [[45, 0.877686, ",", false], [22590, 0.045616, " the", false], [39934, 0.013296, " there", false], [4601, 0.009857, " it", false], [21265, 0.005789, " and", false], [4596, 0.004533, " in", false], [39936, 0.003849, " these", false], [3866, 0.003686, " HM", false], [47202, 0.003224, " search", false], [32234, 0.003154, " this", false]]], "qwen": [11, 1, 0.8445719480514526, [[11, 0.844572, ",", false], [279, 0.053969, " the", false], [1052, 0.015605, " there", false], [432, 0.015465, " it", false], [304, 0.009116, " in", false], [419, 0.005411, " this", false], [1493, 0.005168, " these", false], [323, 0.0044, " and", false], [264, 0.003203, " a", false], [11811, 0.002799, " researchers", false]]]}, "raw_delta": -0.03904251754283905, "tuned_delta": -0.0322302397357411}, {"byte_start": 3550, "byte_end": 3554, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 600, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "3.45% 3.45% 3.45% 3.45%", "qwen": "4.65% 4.65% 4.65% 4.65%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.4640112519264221]], "qwen": [[279, " the", "normal", 0.356892853975296]]}, "loss": {"rwkv": 3.451760595876914, "qwen": 4.645115963466906}, "topk": {"rwkv": [22590, 1, 0.4640112519264221, [[22590, 0.464011, " the", false], [39934, 0.049172, " there", false], [3866, 0.04652, " HM", false], [4601, 0.040708, " it", false], [38720, 0.04066, " human", false], [39936, 0.036161, " these", false], [4596, 0.020336, " in", false], [32234, 0.019479, " this", false], [63843, 0.018726, " researchers", false], [332, 0.014602, " a", false]]], "qwen": [279, 1, 0.356892853975296, [[279, 0.356893, " the", false], [432, 0.05677, " it", false], [3738, 0.041688, " human", false], [1052, 0.038032, " there", false], [304, 0.035916, " in", false], [472, 0.034717, " H", false], [1493, 0.033768, " these", false], [419, 0.021128, " this", false], [4124, 0.020707, " early", false], [438, 0.017895, " as", false]]]}, "raw_delta": -0.06617367267608643, "tuned_delta": -0.059361394868988476}, {"byte_start": 3554, "byte_end": 3566, "display": {"text": " statistical", "kind": "normal"}, "is_word": true, "word_id": 601, "word_key": " statistical", "bytes_hex": "20 73 74 61 74 69 73 74 69 63 61 6c", "compression": {"rwkv": "4.98% 4.98% 4.98% 4.98% 4.98% 4.98% 4.98% 4.98% 4.98% 4.98% 4.98% 4.98%", "qwen": "4.40% 4.40% 4.40% 4.40% 4.40% 4.40% 4.40% 4.40% 4.40% 4.40% 4.40% 4.40%"}, "model_tokens": {"rwkv": [[63885, " statistical", "normal", 0.03704267367720604]], "qwen": [[28464, " statistical", "normal", 0.05349557474255562]]}, "loss": {"rwkv": 4.978049294734053, "qwen": 4.400454877538232}, "topk": {"rwkv": [63885, 4, 0.03704267367720604, [[3866, 0.193819, " HM", false], [38720, 0.155209, " human", false], [38328, 0.037065, " early", false], [63885, 0.037043, " statistical", false], [52013, 0.034494, " initial", false], [47202, 0.033788, " search", false], [47798, 0.032465, " winner", false], [52224, 0.027882, " methods", false], [63843, 0.020644, " researchers", false], [39116, 0.020236, " newer", false]]], "qwen": [28464, 4, 0.05349557474255562, [[3738, 0.136382, " human", false], [472, 0.068326, " H", false], [4124, 0.056395, " early", false], [28464, 0.053496, " statistical", false], [2856, 0.047444, " initial", false], [5413, 0.042712, " methods", false], [25546, 0.032433, " newer", false], [15271, 0.031915, " latter", false], [13632, 0.028531, " winner", false], [3281, 0.025215, " special", false]]]}, "raw_delta": 0.03202863534291587, "tuned_delta": 0.03884091315001382}, {"byte_start": 3566, "byte_end": 3574, "display": {"text": " methods", "kind": "normal"}, "is_word": true, "word_id": 602, "word_key": " methods", "bytes_hex": "20 6d 65 74 68 6f 64 73", "compression": {"rwkv": "0.69% 0.69% 0.69% 0.69% 0.69% 0.69% 0.69% 0.69%", "qwen": "0.92% 0.92% 0.92% 0.92% 0.92% 0.92% 0.92% 0.92%"}, "model_tokens": {"rwkv": [[52224, " methods", "normal", 0.7348640561103821]], "qwen": [[5413, " methods", "normal", 0.664587140083313]]}, "loss": {"rwkv": 0.6912326703478003, "qwen": 0.9210465029849182}, "topk": {"rwkv": [52224, 1, 0.7348640561103821, [[52224, 0.734864, " methods", false], [55532, 0.063329, " approach", false], [61590, 0.051345, " approaches", false], [46561, 0.037905, " method", false], [3866, 0.01463, " HM", false], [46587, 0.014503, " models", false], [46, 0.012338, "-", false], [45, 0.011988, ",", false], [62633, 0.009757, " techniques", false], [39043, 0.0047, " model", false]]], "qwen": [5413, 1, 0.664587140083313, [[5413, 0.664587, " methods", false], [5486, 0.064661, " approach", false], [19827, 0.043287, " approaches", false], [1714, 0.034178, " method", false], [11, 0.026638, ",", false], [323, 0.014655, " and", false], [472, 0.014598, " H", false], [320, 0.013281, " (", false], [5980, 0.012254, "-based", false], [4119, 0.010203, " models", false]]]}, "raw_delta": -0.01274358481168747, "tuned_delta": -0.005931307004589523}, {"byte_start": 3574, "byte_end": 3578, "display": {"text": " won", "kind": "normal"}, "is_word": true, "word_id": 603, "word_key": " won", "bytes_hex": "20 77 6f 6e", "compression": {"rwkv": "3.42% 3.42% 3.42% 3.42%", "qwen": "8.76% 8.76% 8.76% 8.76%"}, "model_tokens": {"rwkv": [[22777, " won", "normal", 0.4703347384929657]], "qwen": [[2765, " won", "normal", 0.1433647722005844]]}, "loss": {"rwkv": 3.4165385489802107, "qwen": 8.7569921936927}, "topk": {"rwkv": [22777, 1, 0.4703347384929657, [[22777, 0.470335, " won", false], [32462, 0.140988, " were", false], [46936, 0.056509, " proved", false], [45, 0.035044, ",", false], [61959, 0.028525, " eventually", false], [60244, 0.018564, " prevailed", false], [21795, 0.018205, " had", false], [30256, 0.012706, " beat", false], [21532, 0.012226, " did", false], [62676, 0.010409, " ultimately", false]]], "qwen": [2765, 1, 0.1433647722005844, [[2765, 0.143365, " won", false], [1033, 0.120753, " were", false], [18651, 0.109853, " proved", false], [11, 0.049774, ",", false], [29701, 0.047198, " dominated", false], [9583, 0.046813, " eventually", false], [13653, 0.027808, " ultimately", false], [9382, 0.026061, " beat", false], [3118, 0.025765, " based", false], [1521, 0.018119, " did", false]]]}, "raw_delta": -0.29613763093948364, "tuned_delta": -0.2893253531323857}, {"byte_start": 3578, "byte_end": 3582, "display": {"text": " out", "kind": "normal"}, "is_word": true, "word_id": 604, "word_key": " out", "bytes_hex": "20 6f 75 74", "compression": {"rwkv": "9.72% 9.72% 9.72% 9.72%", "qwen": "13.68% 13.68% 13.68% 13.68%"}, "model_tokens": {"rwkv": [[22249, " out", "normal", 0.11624613404273987]], "qwen": [[700, " out", "normal", 0.048153363168239594]]}, "loss": {"rwkv": 9.721284943490085, "qwen": 13.675686334344915}, "topk": {"rwkv": [22249, 3, 0.11624613404273987, [[45, 0.244124, ",", false], [47, 0.212043, ".", false], [22249, 0.116246, " out", false], [22590, 0.113579, " the", false], [4450, 0.054151, " by", false], [4596, 0.05103, " in", false], [21265, 0.02241, " and", false], [5346, 0.021564, "---", false], [55925, 0.010817, " decisive", false], [32234, 0.010722, " this", false]]], "qwen": [700, 4, 0.048153363168239594, [[11, 0.257229, ",", false], [13, 0.197844, ".", false], [279, 0.160048, " the", false], [700, 0.048153, " out", false], [323, 0.043212, " and", false], [304, 0.038485, " in", false], [553, 0.02944, " by", false], [382, 0.023635, ".\n\n", false], [4421, 0.02173, "---", false], [419, 0.013421, " this", false]]]}, "raw_delta": -0.21927857398986816, "tuned_delta": -0.21246629618277021}, {"byte_start": 3582, "byte_end": 3587, "display": {"text": " over", "kind": "normal"}, "is_word": true, "word_id": 605, "word_key": " over", "bytes_hex": "20 6f 76 65 72", "compression": {"rwkv": "12.79% 12.79% 12.79% 12.79% 12.79%", "qwen": "13.65% 13.65% 13.65% 13.65% 13.65%"}, "model_tokens": {"rwkv": [[31601, " over", "normal", 0.028818456456065178]], "qwen": [[916, " over", "normal", 0.022708440199494362]]}, "loss": {"rwkv": 12.792647432882603, "qwen": 13.651568347301168}, "topk": {"rwkv": [31601, 5, 0.028818456456065178, [[45, 0.317066, ",", false], [47, 0.256941, ".", false], [4596, 0.133962, " in", false], [21265, 0.051836, " and", false], [31601, 0.028818, " over", false], [4450, 0.028229, " by", false], [61959, 0.0264, " eventually", false], [5346, 0.018425, "---", false], [55925, 0.00895, " decisive", false], [51018, 0.008778, " because", false]]], "qwen": [916, 6, 0.022708440199494362, [[11, 0.350947, ",", false], [13, 0.276182, ".", false], [304, 0.087414, " in", false], [323, 0.057563, " and", false], [382, 0.034446, ".\n\n", false], [916, 0.022708, " over", false], [4421, 0.021969, "---", false], [33022, 0.014341, " decis", false], [553, 0.013826, " by", false], [320, 0.01148, " (", false]]]}, "raw_delta": -0.047628688812255904, "tuned_delta": -0.040816411005157954}, {"byte_start": 3587, "byte_end": 3591, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 606, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "2.50% 2.50% 2.50% 2.50%", "qwen": "1.04% 1.04% 1.04% 1.04%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.5765215754508972]], "qwen": [[279, " the", "normal", 0.7941256165504456]]}, "loss": {"rwkv": 2.5007653296659274, "qwen": 1.0392525974289544}, "topk": {"rwkv": [22590, 1, 0.5765215754508972, [[22590, 0.576522, " the", false], [32251, 0.183276, " time", false], [332, 0.04766, " a", false], [38720, 0.024792, " human", false], [52224, 0.021896, " methods", false], [31370, 0.01975, " many", false], [39944, 0.018004, " those", false], [31323, 0.012172, " long", false], [52869, 0.006481, " several", false], [37920, 0.004974, " brute", false]]], "qwen": [279, 1, 0.7941256165504456, [[279, 0.794126, " the", false], [678, 0.024315, " all", false], [882, 0.023916, " time", false], [264, 0.023365, " a", false], [3738, 0.019839, " human", false], [3281, 0.012307, " special", false], [1657, 0.00971, " many", false], [1846, 0.008672, " those", false], [5413, 0.006965, " methods", false], [803, 0.005373, " more", false]]]}, "raw_delta": 0.08104347437620163, "tuned_delta": 0.08785575218329958}, {"byte_start": 3591, "byte_end": 3597, "display": {"text": " human", "kind": "normal"}, "is_word": true, "word_id": 607, "word_key": " human", "bytes_hex": "20 68 75 6d 61 6e", "compression": {"rwkv": "2.45% 2.45% 2.45% 2.45% 2.45% 2.45%", "qwen": "4.50% 4.50% 4.50% 4.50% 4.50% 4.50%"}, "model_tokens": {"rwkv": [[38720, " human", "normal", 0.4416837990283966]], "qwen": [[3738, " human", "normal", 0.22361716628074646]]}, "loss": {"rwkv": 2.4538026004703233, "qwen": 4.501869105482948}, "topk": {"rwkv": [38720, 1, 0.4416837990283966, [[38720, 0.441684, " human", false], [52224, 0.111975, " methods", false], [31458, 0.063576, " more", false], [52964, 0.033792, " special", false], [63875, 0.02442, " specialized", false], [59943, 0.02214, " knowledge", false], [47202, 0.019659, " search", false], [31580, 0.017222, " ones", false], [3866, 0.013584, " HM", false], [46726, 0.010994, " others", false]]], "qwen": [3738, 2, 0.22361716628074646, [[3281, 0.358286, " special", false], [3738, 0.223617, " human", false], [5413, 0.075183, " methods", false], [6540, 0.072806, " knowledge", false], [803, 0.040975, " more", false], [3800, 0.022162, " others", false], [27076, 0.0214, " specialized", false], [6788, 0.014749, " earlier", false], [1008, 0.01418, " other", false], [4124, 0.010068, " early", false]]]}, "raw_delta": -0.11356892188390093, "tuned_delta": -0.10675664407680298}, {"byte_start": 3597, "byte_end": 3607, "display": {"text": "-knowledge", "kind": "normal"}, "is_word": true, "word_id": 608, "word_key": "-knowledge", "bytes_hex": "2d 6b 6e 6f 77 6c 65 64 67 65", "compression": {"rwkv": "4.68% 0.10% 0.10% 0.10% 0.10% 0.10% 0.10% 0.10% 0.10% 0.10%", "qwen": "2.63% 2.63% 0.00% 0.00% 0.00% 0.00% 0.00% 0.00% 0.00% 0.00%"}, "model_tokens": {"rwkv": [[46, "-", "normal", 0.7695422768592834], [58313, "knowledge", "normal", 0.949985682964325]], "qwen": [[12646, "-k", "normal", 0.7466897964477539], [51186, "nowledge", "normal", 0.998958945274353]]}, "loss": {"rwkv": 0.5609110968299983, "qwen": 0.5286522461362759}, "topk": {"rwkv": [46, 1, 0.7695422768592834, [[46, 0.769542, "-", false], [59943, 0.142256, " knowledge", false], [52224, 0.050125, " methods", false], [61590, 0.005838, " approaches", false], [34864, 0.004619, "istic", false], [7919, 0.002384, "ist", false], [65034, 0.001999, " understanding", false], [56529, 0.001837, " language", false], [46561, 0.001719, " method", false], [55532, 0.0012, " approach", false]]], "qwen": [12646, 1, 0.7466897964477539, [[12646, 0.74669, "-k", false], [6540, 0.156835, " knowledge", false], [12, 0.014235, "-", false], [5980, 0.012712, "-based", false], [8660, 0.010945, " understanding", false], [71107, 0.010203, "-under", false], [5413, 0.004288, " methods", false], [35085, 0.002812, "-oriented", false], [50297, 0.002317, "-method", false], [3419, 0.00195, "-in", false]]]}, "raw_delta": 0.0017888105125166479, "tuned_delta": 0.008601088319614595}, {"byte_start": 3607, "byte_end": 3613, "display": {"text": "-based", "kind": "normal"}, "is_word": true, "word_id": 609, "word_key": "-based", "bytes_hex": "2d 62 61 73 65 64", "compression": {"rwkv": "32.12% 0.47% 0.47% 0.47% 0.47% 0.47%", "qwen": "3.14% 3.14% 3.14% 3.14% 3.14% 3.14%"}, "model_tokens": {"rwkv": [[46, "-", "normal", 0.16662932932376862], [34011, "based", "normal", 0.8785135746002197]], "qwen": [[5980, "-based", "normal", 0.35163143277168274]]}, "loss": {"rwkv": 5.744128814737346, "qwen": 3.141383505864803}, "topk": {"rwkv": [46, 2, 0.16662932932376862, [[52224, 0.691617, " methods", false], [46, 0.166629, "-", false], [61590, 0.072455, " approaches", false], [37810, 0.019923, " based", false], [31580, 0.010815, " ones", false], [55532, 0.008456, " approach", false], [46561, 0.003377, " method", false], [45, 0.002986, ",", false], [51566, 0.001769, " efforts", false], [62633, 0.001685, " techniques", false]]], "qwen": [5980, 2, 0.35163143277168274, [[5413, 0.454863, " methods", false], [5980, 0.351631, "-based", false], [19827, 0.061546, " approaches", false], [3118, 0.04312, " based", false], [6174, 0.026549, " ones", false], [5486, 0.006416, " approach", false], [31405, 0.005861, "-driven", false], [12538, 0.002516, " techniques", false], [2331, 0.002066, " base", false], [35085, 0.002062, "-oriented", false]]]}, "raw_delta": 0.1443268458048502, "tuned_delta": 0.15113912361194815}, {"byte_start": 3613, "byte_end": 3621, "display": {"text": " methods", "kind": "normal"}, "is_word": true, "word_id": 610, "word_key": " methods", "bytes_hex": "20 6d 65 74 68 6f 64 73", "compression": {"rwkv": "0.65% 0.65% 0.65% 0.65% 0.65% 0.65% 0.65% 0.65%", "qwen": "0.44% 0.44% 0.44% 0.44% 0.44% 0.44% 0.44% 0.44%"}, "model_tokens": {"rwkv": [[52224, " methods", "normal", 0.7516207695007324]], "qwen": [[5413, " methods", "normal", 0.8244560956954956]]}, "loss": {"rwkv": 0.6472051117269214, "qwen": 0.4351335400805226}, "topk": {"rwkv": [52224, 1, 0.7516207695007324, [[52224, 0.751621, " methods", false], [31580, 0.09601, " ones", false], [61590, 0.094103, " approaches", false], [55532, 0.008445, " approach", false], [45, 0.004803, ",", false], [51566, 0.004648, " efforts", false], [47, 0.003399, ".", false], [63363, 0.003285, " competitors", false], [46561, 0.002622, " method", false], [62633, 0.002083, " techniques", false]]], "qwen": [5413, 1, 0.8244560956954956, [[5413, 0.824456, " methods", false], [19827, 0.067382, " approaches", false], [6174, 0.052365, " ones", false], [5942, 0.006073, " systems", false], [5486, 0.005619, " approach", false], [8869, 0.00496, " efforts", false], [12538, 0.003728, " techniques", false], [3281, 0.003131, " special", false], [1714, 0.002541, " method", false], [11, 0.002202, ",", false]]]}, "raw_delta": 0.011759744957089424, "tuned_delta": 0.01857202276418737}, {"byte_start": 3621, "byte_end": 3622, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "14.37%", "qwen": "17.17%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.4585483968257904]], "qwen": [[13, ".", "normal", 0.38593173027038574]]}, "loss": {"rwkv": 14.370595133854907, "qwen": 17.169780459731708}, "topk": {"rwkv": [47, 1, 0.4585483968257904, [[47, 0.458548, ".", false], [45, 0.313017, ",", false], [4596, 0.05967, " in", false], [21265, 0.03687, " and", false], [4450, 0.025626, " by", false], [5346, 0.013857, "---", false], [275, 0.011479, " (", false], [51018, 0.007219, " because", false], [32227, 0.006811, " that", false], [37634, 0.004469, " after", false]]], "qwen": [13, 1, 0.38593173027038574, [[13, 0.385932, ".", false], [11, 0.298631, ",", false], [382, 0.07573, ".\n\n", false], [304, 0.050795, " in", false], [323, 0.034481, " and", false], [553, 0.020631, " by", false], [4421, 0.019415, "---", false], [320, 0.015519, " (", false], [26, 0.007749, ";", false], [518, 0.005623, " at", false]]]}, "raw_delta": -0.15521979331970215, "tuned_delta": -0.1484075155126042}, {"byte_start": 3622, "byte_end": 3627, "display": {"text": " This", "kind": "normal"}, "is_word": true, "word_id": 611, "word_key": " this", "bytes_hex": "20 54 68 69 73", "compression": {"rwkv": "9.97% 9.97% 9.97% 9.97% 9.97%", "qwen": "8.12% 8.12% 8.12% 8.12% 8.12%"}, "model_tokens": {"rwkv": [[29894, " This", "normal", 0.06204051151871681]], "qwen": [[1096, " This", "normal", 0.10536638647317886]]}, "loss": {"rwkv": 9.974883681146347, "qwen": 8.116282651710552}, "topk": {"rwkv": [29894, 4, 0.06204051151871681, [[261, 0.181097, "\n\n", false], [20996, 0.140929, " The", false], [3913, 0.072965, " In", false], [29894, 0.062041, " This", false], [19555, 0.032647, " But", false], [3918, 0.031326, " It", false], [267, 0.023281, "  ", false], [19417, 0.021651, " And", false], [37451, 0.020287, " There", false], [300, 0.019412, " A", false]]], "qwen": [1096, 2, 0.10536638647317886, [[576, 0.147242, " The", false], [1096, 0.105366, " This", false], [758, 0.077956, " In", false], [1084, 0.038441, " It", false], [2619, 0.034625, " There", false], [362, 0.023556, " A", false], [220, 0.023178, " ", false], [65694, 0.022903, " Statistical", false], [472, 0.021494, " H", false], [4220, 0.019384, " These", false]]]}, "raw_delta": 0.10306272506713865, "tuned_delta": 0.1098750028742366}, {"byte_start": 3627, "byte_end": 3631, "display": {"text": " led", "kind": "normal"}, "is_word": true, "word_id": 612, "word_key": " led", "bytes_hex": "20 6c 65 64", "compression": {"rwkv": "22.26% 22.26% 22.26% 22.26%", "qwen": "20.00% 20.00% 20.00% 20.00%"}, "model_tokens": {"rwkv": [[21994, " led", "normal", 0.00731703219935298]], "qwen": [[6069, " led", "normal", 0.01184548158198595]]}, "loss": {"rwkv": 22.260333638716425, "qwen": 19.99849735654479}, "topk": {"rwkv": [21994, 12, 0.00731703219935298, [[22748, 0.339281, " was", false], [32251, 0.123453, " time", false], [4600, 0.086706, " is", false], [63361, 0.064196, " competition", false], [52427, 0.04238, " pattern", false], [56348, 0.011652, " happened", false], [38328, 0.010602, " early", false], [53283, 0.010217, " victory", false], [22074, 0.009479, " may", false], [52382, 0.007942, " outcome", false]]], "qwen": [6069, 8, 0.01184548158198595, [[572, 0.290054, " was", false], [374, 0.138482, " is", false], [5383, 0.073053, " pattern", false], [882, 0.046901, " time", false], [9149, 0.018298, " trend", false], [10707, 0.012723, " competition", false], [6932, 0.011943, " happened", false], [6069, 0.011845, " led", false], [12560, 0.010531, " victory", false], [4124, 0.010371, " early", false]]]}, "raw_delta": 0.12542283535003662, "tuned_delta": 0.13223511315713457}, {"byte_start": 3631, "byte_end": 3634, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 613, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "2.02% 2.02% 2.02%", "qwen": "1.64% 1.64% 1.64%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.7110750079154968]], "qwen": [[311, " to", "normal", 0.7614275813102722]]}, "loss": {"rwkv": 2.019397355410984, "qwen": 1.638421924665474}, "topk": {"rwkv": [4811, 1, 0.7110750079154968, [[4811, 0.711075, " to", false], [32074, 0.050928, " some", false], [31370, 0.04177, " many", false], [22590, 0.038769, " the", false], [63843, 0.020765, " researchers", false], [332, 0.018181, " a", false], [19678, 0.013078, " DAR", false], [22226, 0.010681, " one", false], [46787, 0.008987, " people", false], [45, 0.008903, ",", false]]], "qwen": [311, 1, 0.7614275813102722, [[311, 0.761428, " to", false], [1045, 0.048317, " some", false], [1657, 0.041988, " many", false], [279, 0.02385, " the", false], [264, 0.018831, " a", false], [11811, 0.016607, " researchers", false], [11, 0.008645, ",", false], [825, 0.007132, " one", false], [304, 0.005231, " in", false], [1251, 0.003191, " people", false]]]}, "raw_delta": 0.021125763654708862, "tuned_delta": 0.02793804146180681}, {"byte_start": 3634, "byte_end": 3636, "display": {"text": " a", "kind": "normal"}, "is_word": true, "word_id": 614, "word_key": " a", "bytes_hex": "20 61", "compression": {"rwkv": "10.21% 10.21%", "qwen": "8.44% 8.44%"}, "model_tokens": {"rwkv": [[332, " a", "normal", 0.3240458369255066]], "qwen": [[264, " a", "normal", 0.3922613263130188]]}, "loss": {"rwkv": 10.214393600043929, "qwen": 8.438206226944965}, "topk": {"rwkv": [332, 1, 0.3240458369255066, [[332, 0.324046, " a", false], [22590, 0.245708, " the", false], [4419, 0.047678, " an", false], [32074, 0.029692, " some", false], [31466, 0.027767, " much", false], [31370, 0.019728, " many", false], [51816, 0.013779, " further", false], [50919, 0.01291, " another", false], [31458, 0.008787, " more", false], [65126, 0.008094, " disappointment", false]]], "qwen": [264, 1, 0.3922613263130188, [[264, 0.392261, " a", false], [279, 0.185976, " the", false], [458, 0.075346, " an", false], [1657, 0.02746, " many", false], [1045, 0.025467, " some", false], [1753, 0.018786, " much", false], [2441, 0.014868, " another", false], [4623, 0.009604, " further", false], [1128, 0.007172, " what", false], [803, 0.005978, " more", false]]]}, "raw_delta": 0.09849274158477783, "tuned_delta": 0.10530501939187578}, {"byte_start": 3636, "byte_end": 3642, "display": {"text": " major", "kind": "normal"}, "is_word": true, "word_id": 615, "word_key": " major", "bytes_hex": "20 6d 61 6a 6f 72", "compression": {"rwkv": "12.12% 12.12% 12.12% 12.12% 12.12% 12.12%", "qwen": "12.44% 12.44% 12.44% 12.44% 12.44% 12.44%"}, "model_tokens": {"rwkv": [[38961, " major", "normal", 0.017687087878584862]], "qwen": [[3598, " major", "normal", 0.015963859856128693]]}, "loss": {"rwkv": 12.116384132465903, "qwen": 12.43551513940693}, "topk": {"rwkv": [38961, 11, 0.017687087878584862, [[31323, 0.059281, " long", false], [46790, 0.050994, " period", false], [45315, 0.028251, " bitter", false], [39664, 0.021968, " shift", false], [51816, 0.021655, " further", false], [38629, 0.021512, " great", false], [45674, 0.02032, " decade", false], [22031, 0.020205, " lot", false], [45450, 0.01916, " change", false], [55591, 0.018927, " backlash", false]]], "qwen": [3598, 10, 0.015963859856128693, [[1293, 0.075389, " long", false], [25180, 0.037527, " bitter", false], [4168, 0.029762, " period", false], [4586, 0.023005, " general", false], [2696, 0.019431, " lot", false], [501, 0.019248, " new", false], [2244, 0.017001, " great", false], [3460, 0.016283, " large", false], [1372, 0.016052, " number", false], [3598, 0.015964, " major", false]]]}, "raw_delta": -0.017696380615234375, "tuned_delta": -0.010884102808136429}, {"byte_start": 3642, "byte_end": 3649, "display": {"text": " change", "kind": "normal"}, "is_word": true, "word_id": 616, "word_key": " change", "bytes_hex": "20 63 68 61 6e 67 65", "compression": {"rwkv": "4.85% 4.85% 4.85% 4.85% 4.85% 4.85% 4.85%", "qwen": "6.66% 6.66% 6.66% 6.66% 6.66% 6.66% 6.66%"}, "model_tokens": {"rwkv": [[45450, " change", "normal", 0.15228797495365143]], "qwen": [[2297, " change", "normal", 0.07551056891679764]]}, "loss": {"rwkv": 4.850579029774557, "qwen": 6.6556739224766694}, "topk": {"rwkv": [45450, 2, 0.15228797495365143, [[39664, 0.174095, " shift", false], [45450, 0.152288, " change", false], [57103, 0.040897, " research", false], [45829, 0.035171, " effort", false], [4757, 0.03405, " re", false], [56810, 0.033107, " paradigm", false], [22378, 0.024043, " ret", false], [57138, 0.019627, " revision", false], [31872, 0.018109, " retr", false], [45, 0.012865, ",", false]]], "qwen": [2297, 2, 0.07551056891679764, [[6407, 0.115522, " shift", false], [2297, 0.075511, " change", false], [48240, 0.05293, " paradigm", false], [312, 0.050844, " re", false], [11004, 0.035189, " debate", false], [3412, 0.020011, " research", false], [47056, 0.018988, " backlash", false], [40598, 0.018954, " disappointment", false], [25573, 0.018221, " controversy", false], [5041, 0.011259, " effort", false]]]}, "raw_delta": -0.10009571484157018, "tuned_delta": -0.09328343703447223}, {"byte_start": 3649, "byte_end": 3652, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 617, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "0.60% 0.60% 0.60%", "qwen": "0.75% 0.75% 0.75%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.9052832126617432]], "qwen": [[304, " in", "normal", 0.882537305355072]]}, "loss": {"rwkv": 0.5958396266692293, "qwen": 0.7511284501011392}, "topk": {"rwkv": [4596, 1, 0.9052832126617432, [[4596, 0.905283, " in", false], [4706, 0.042731, " of", false], [45, 0.01702, ",", false], [59, 0.006428, ":", false], [47, 0.004428, ".", false], [4811, 0.001988, " to", false], [30917, 0.001652, " from", false], [4424, 0.00161, " at", false], [32227, 0.001495, " that", false], [37694, 0.001246, " among", false]]], "qwen": [304, 1, 0.882537305355072, [[304, 0.882537, " in", false], [315, 0.081219, " of", false], [11, 0.007828, ",", false], [504, 0.00465, " from", false], [25, 0.002838, ":", false], [4421, 0.002085, "---", false], [311, 0.001744, " to", false], [916, 0.001621, " over", false], [429, 0.001302, " that", false], [369, 0.001157, " for", false]]]}, "raw_delta": -0.008611040810743965, "tuned_delta": -0.0017987630036460185}, {"byte_start": 3652, "byte_end": 3656, "display": {"text": " all", "kind": "normal"}, "is_word": true, "word_id": 618, "word_key": " all", "bytes_hex": "20 61 6c 6c", "compression": {"rwkv": "36.63% 36.63% 36.63% 36.63%", "qwen": "32.00% 32.00% 32.00% 32.00%"}, "model_tokens": {"rwkv": [[21256, " all", "normal", 0.00030418793903663754]], "qwen": [[678, " all", "normal", 0.0008276173612102866]]}, "loss": {"rwkv": 36.63092877257133, "qwen": 31.99608877249348}, "topk": {"rwkv": [21256, 101, 0.00030418793903663754, [[22590, 0.445317, " the", false], [47350, 0.07807, " speech", false], [3609, 0.076574, " AI", false], [57103, 0.07322, " research", false], [59526, 0.057135, " direction", false], [56103, 0.030654, " emphasis", false], [38530, 0.01776, " focus", false], [57419, 0.015497, " thinking", false], [21835, 0.013009, " how", false], [55532, 0.01039, " approach", false]]], "qwen": [678, 54, 0.0008276173612102866, [[279, 0.515891, " the", false], [3412, 0.07072, " research", false], [8806, 0.070528, " speech", false], [1246, 0.067919, " how", false], [15235, 0.028624, " AI", false], [7274, 0.019499, " thinking", false], [5244, 0.016435, " focus", false], [24654, 0.012447, " emphasis", false], [5106, 0.011719, " direction", false], [6366, 0.011553, " computer", false]]]}, "raw_delta": 0.2570101022720337, "tuned_delta": 0.2638223800791316}, {"byte_start": 3656, "byte_end": 3659, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 619, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "12.30% 12.30% 12.30%", "qwen": "13.25% 13.25% 13.25%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.12971822917461395]], "qwen": [[315, " of", "normal", 0.11038658767938614]]}, "loss": {"rwkv": 12.30423504924832, "qwen": 13.247346344106003}, "topk": {"rwkv": [4706, 2, 0.12971822917461395, [[47350, 0.422602, " speech", false], [4706, 0.129718, " of", false], [3609, 0.077295, " AI", false], [22590, 0.066393, " the", false], [62597, 0.051695, " subsequent", false], [57103, 0.039337, " research", false], [37738, 0.028436, " areas", false], [46064, 0.016524, " future", false], [50964, 0.016413, " aspects", false], [55809, 0.008874, " computer", false]]], "qwen": [315, 3, 0.11038658767938614, [[8806, 0.358103, " speech", false], [17420, 0.151202, " subsequent", false], [315, 0.110387, " of", false], [279, 0.08224, " the", false], [3412, 0.050408, " research", false], [15235, 0.029133, " AI", false], [5671, 0.024269, " areas", false], [3853, 0.014411, " future", false], [19827, 0.012652, " approaches", false], [13566, 0.011898, " aspects", false]]]}, "raw_delta": -0.05229719479878747, "tuned_delta": -0.04548491699168952}, {"byte_start": 3659, "byte_end": 3667, "display": {"text": " natural", "kind": "normal"}, "is_word": true, "word_id": 620, "word_key": " natural", "bytes_hex": "20 6e 61 74 75 72 61 6c", "compression": {"rwkv": "13.81% 13.81% 13.81% 13.81% 13.81% 13.81% 13.81% 13.81%", "qwen": "10.22% 10.22% 10.22% 10.22% 10.22% 10.22% 10.22% 10.22%"}, "model_tokens": {"rwkv": [[52299, " natural", "normal", 0.002164592733606696]], "qwen": [[5810, " natural", "normal", 0.010747061111032963]]}, "loss": {"rwkv": 13.807042383507657, "qwen": 10.218615774122611}, "topk": {"rwkv": [52299, 11, 0.002164592733606696, [[47350, 0.762332, " speech", false], [3609, 0.085676, " AI", false], [22590, 0.043017, " the", false], [55809, 0.031686, " computer", false], [57103, 0.010278, " research", false], [19678, 0.006339, " DAR", false], [64862, 0.006077, " computational", false], [52167, 0.003712, " machine", false], [62182, 0.00227, " linguistic", false], [4047, 0.002201, " NL", false]]], "qwen": [5810, 6, 0.010747061111032963, [[8806, 0.68847, " speech", false], [279, 0.089251, " the", false], [15235, 0.083967, " AI", false], [6366, 0.029443, " computer", false], [451, 0.013061, " N", false], [5810, 0.010747, " natural", false], [5662, 0.006164, " machine", false], [3412, 0.006111, " research", false], [3738, 0.005999, " human", false], [4128, 0.004576, " language", false]]]}, "raw_delta": 0.19898462295532227, "tuned_delta": 0.20579690076242022}, {"byte_start": 3667, "byte_end": 3676, "display": {"text": " language", "kind": "normal"}, "is_word": true, "word_id": 621, "word_key": " language", "bytes_hex": "20 6c 61 6e 67 75 61 67 65", "compression": {"rwkv": "0.43% 0.43% 0.43% 0.43% 0.43% 0.43% 0.43% 0.43% 0.43%", "qwen": "0.89% 0.89% 0.89% 0.89% 0.89% 0.89% 0.89% 0.89% 0.89%"}, "model_tokens": {"rwkv": [[56529, " language", "normal", 0.8075101971626282]], "qwen": [[4128, " language", "normal", 0.6401944160461426]]}, "loss": {"rwkv": 0.428534903909889, "qwen": 0.8936361857707253}, "topk": {"rwkv": [56529, 1, 0.8075101971626282, [[56529, 0.80751, " language", false], [46, 0.186819, "-", false], [47350, 0.001959, " speech", false], [59946, 0.00155, " languages", false], [21265, 0.000285, " and", false], [275, 0.000154, " (", false], [34864, 0.000146, "istic", false], [52814, 0.000106, " science", false], [62378, 0.000105, " processing", false], [48, 0.000101, "/", false]]], "qwen": [4128, 1, 0.6401944160461426, [[4128, 0.640194, " language", false], [43558, 0.341647, "-language", false], [8806, 0.003305, " speech", false], [1331, 0.002551, "-s", false], [11476, 0.001883, "-com", false], [323, 0.001119, " and", false], [15459, 0.001004, " languages", false], [12, 0.000899, "-", false], [8038, 0.000572, " science", false], [24231, 0.000527, " computing", false]]]}, "raw_delta": -0.025790691375732425, "tuned_delta": -0.01897841356863448}, {"byte_start": 3676, "byte_end": 3687, "display": {"text": " processing", "kind": "normal"}, "is_word": true, "word_id": 622, "word_key": " processing", "bytes_hex": "20 70 72 6f 63 65 73 73 69 6e 67", "compression": {"rwkv": "0.13% 0.13% 0.13% 0.13% 0.13% 0.13% 0.13% 0.13% 0.13% 0.13% 0.13%", "qwen": "0.16% 0.16% 0.16% 0.16% 0.16% 0.16% 0.16% 0.16% 0.16% 0.16% 0.16%"}, "model_tokens": {"rwkv": [[62378, " processing", "normal", 0.9241369366645813]], "qwen": [[8692, " processing", "normal", 0.9070752859115601]]}, "loss": {"rwkv": 0.1296811726651345, "qwen": 0.15989290567035236}, "topk": {"rwkv": [62378, 1, 0.9241369366645813, [[62378, 0.924137, " processing", false], [57103, 0.038018, " research", false], [65034, 0.018003, " understanding", false], [45, 0.003035, ",", false], [21265, 0.001866, " and", false], [63821, 0.001735, " recognition", false], [47, 0.001323, ".", false], [46, 0.001235, "-", false], [275, 0.001169, " (", false], [62634, 0.000886, " technology", false]]], "qwen": [8692, 1, 0.9070752859115601, [[8692, 0.907075, " processing", false], [3412, 0.032684, " research", false], [8660, 0.014011, " understanding", false], [69193, 0.007294, "-processing", false], [323, 0.005977, " and", false], [8806, 0.003086, " speech", false], [320, 0.002747, " (", false], [15235, 0.002486, " AI", false], [11, 0.002392, ",", false], [24231, 0.001239, " computing", false]]]}, "raw_delta": -0.0016752942041917288, "tuned_delta": 0.005136983602906218}, {"byte_start": 3687, "byte_end": 3688, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "22.40%", "qwen": "22.27%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.2874051630496979]], "qwen": [[11, ",", "normal", 0.29089972376823425]]}, "loss": {"rwkv": 22.40122182630324, "qwen": 22.26757840788402}, "topk": {"rwkv": [45, 1, 0.2874051630496979, [[45, 0.287405, ",", false], [275, 0.246518, " (", false], [47, 0.155146, ".", false], [57103, 0.091568, " research", false], [59, 0.0454, ":", false], [5346, 0.042396, "---", false], [21265, 0.038817, " and", false], [4596, 0.018298, " in", false], [32227, 0.009156, " that", false], [60, 0.005284, ";", false]]], "qwen": [11, 1, 0.29089972376823425, [[11, 0.2909, ",", false], [320, 0.28355, " (", false], [13, 0.098036, ".", false], [3412, 0.078873, " research", false], [323, 0.062554, " and", false], [4421, 0.032666, "---", false], [25, 0.021578, ":", false], [304, 0.018883, " in", false], [382, 0.015774, ".\n\n", false], [369, 0.014402, " for", false]]]}, "raw_delta": 0.007410764694213867, "tuned_delta": 0.014223042501311813}, {"byte_start": 3688, "byte_end": 3698, "display": {"text": " gradually", "kind": "normal"}, "is_word": true, "word_id": 623, "word_key": " gradually", "bytes_hex": "20 67 72 61 64 75 61 6c 6c 79", "compression": {"rwkv": "15.22% 15.22% 15.22% 15.22% 15.22% 15.22% 15.22% 15.22% 15.22% 15.22%", "qwen": "17.05% 17.05% 17.05% 17.05% 17.05% 17.05% 17.05% 17.05% 17.05% 17.05%"}, "model_tokens": {"rwkv": [[59771, " gradually", "normal", 0.00022050189727451652]], "qwen": [[26024, " gradually", "normal", 7.828678644727916e-05]]}, "loss": {"rwkv": 15.215924259375784, "qwen": 17.051089212978507}, "topk": {"rwkv": [59771, 146, 0.00022050189727451652, [[40186, 0.163955, " which", false], [21265, 0.118386, " and", false], [30917, 0.085189, " from", false], [32487, 0.066471, " with", false], [40185, 0.062385, " where", false], [4423, 0.056238, " as", false], [4811, 0.050484, " to", false], [4596, 0.041551, " in", false], [59841, 0.024972, " including", false], [22590, 0.021643, " the", false]]], "qwen": [26024, 308, 7.828678644727916e-05, [[323, 0.155709, " and", false], [892, 0.104721, " which", false], [438, 0.092851, " as", false], [448, 0.086681, " with", false], [2670, 0.081711, " including", false], [1380, 0.071378, " where", false], [304, 0.038294, " in", false], [504, 0.033125, " from", false], [264, 0.019029, " a", false], [1576, 0.013909, " because", false]]]}, "raw_delta": -0.1017631530761719, "tuned_delta": -0.09495087526907395}, {"byte_start": 3698, "byte_end": 3703, "display": {"text": " over", "kind": "normal"}, "is_word": true, "word_id": 624, "word_key": " over", "bytes_hex": "20 6f 76 65 72", "compression": {"rwkv": "16.68% 16.68% 16.68% 16.68% 16.68%", "qwen": "12.23% 12.23% 12.23% 12.23% 12.23%"}, "model_tokens": {"rwkv": [[31601, " over", "normal", 0.009780705906450748]], "qwen": [[916, " over", "normal", 0.0336746983230114]]}, "loss": {"rwkv": 16.681161410278637, "qwen": 12.230478282961545}, "topk": {"rwkv": [31601, 18, 0.009780705906450748, [[60385, 0.164342, " replacing", false], [46612, 0.128911, " moving", false], [57209, 0.116485, " shifting", false], [52107, 0.035145, " leading", false], [45, 0.024388, ",", false], [50834, 0.022641, " abandon", false], [55660, 0.021963, " bringing", false], [39856, 0.015564, " suppl", false], [46500, 0.015465, " making", false], [38269, 0.015359, " displ", false]]], "qwen": [916, 7, 0.0336746983230114, [[24891, 0.07919, " replacing", false], [7218, 0.063611, " moving", false], [11, 0.043552, ",", false], [714, 0.037893, " but", false], [6388, 0.037171, " leading", false], [31831, 0.036395, " shifting", false], [916, 0.033675, " over", false], [10018, 0.027561, " changing", false], [3259, 0.023925, " making", false], [2714, 0.02245, " er", false]]]}, "raw_delta": 0.24679827690124512, "tuned_delta": 0.25361055470834304}, {"byte_start": 3703, "byte_end": 3711, "display": {"text": " decades", "kind": "normal"}, "is_word": true, "word_id": 625, "word_key": " decades", "bytes_hex": "20 64 65 63 61 64 65 73", "compression": {"rwkv": "8.66% 8.66% 8.66% 8.66% 8.66% 8.66% 8.66% 8.66%", "qwen": "10.19% 10.19% 10.19% 10.19% 10.19% 10.19% 10.19% 10.19%"}, "model_tokens": {"rwkv": [[51396, " decades", "normal", 0.021370047703385353]], "qwen": [[10793, " decades", "normal", 0.010877071879804134]]}, "loss": {"rwkv": 8.664623536588989, "qwen": 10.191509158563496}, "topk": {"rwkv": [51396, 6, 0.021370047703385353, [[22590, 0.493199, " the", false], [332, 0.176697, " a", false], [32251, 0.084428, " time", false], [31370, 0.072857, " many", false], [52869, 0.048588, " several", false], [51396, 0.02137, " decades", false], [3493, 0.015518, " 20", false], [37598, 0.013941, " about", false], [22638, 0.008379, " two", false], [31458, 0.005927, " more", false]]], "qwen": [10793, 9, 0.010877071879804134, [[279, 0.336972, " the", false], [264, 0.297456, " a", false], [1657, 0.081974, " many", false], [220, 0.055959, " ", false], [882, 0.054568, " time", false], [3807, 0.053385, " several", false], [458, 0.01625, " an", false], [803, 0.011744, " more", false], [10793, 0.010877, " decades", false], [7009, 0.00856, " nearly", false]]]}, "raw_delta": -0.08466851711273193, "tuned_delta": -0.07785623930563398}, {"byte_start": 3711, "byte_end": 3712, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "13.81%", "qwen": "11.64%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.46346408128738403]], "qwen": [[11, ",", "normal", 0.5245233774185181]]}, "loss": {"rwkv": 13.807042383507657, "qwen": 11.636512765570654}, "topk": {"rwkv": [45, 1, 0.46346408128738403, [[45, 0.463464, ",", false], [47, 0.386144, ".", false], [4706, 0.018829, " of", false], [21265, 0.018126, " and", false], [4423, 0.013948, " as", false], [59, 0.011537, ":", false], [21400, 0.009628, " but", false], [275, 0.008508, " (", false], [5346, 0.008376, "---", false], [4811, 0.006866, " to", false]]], "qwen": [11, 1, 0.5245233774185181, [[11, 0.524523, ",", false], [13, 0.264647, ".", false], [382, 0.065992, ".\n\n", false], [315, 0.032031, " of", false], [323, 0.017668, " and", false], [320, 0.01125, " (", false], [25, 0.009036, ":", false], [4421, 0.008871, "---", false], [438, 0.007894, " as", false], [311, 0.005143, " to", false]]]}, "raw_delta": 0.12035971879959106, "tuned_delta": 0.12717199660668901}, {"byte_start": 3712, "byte_end": 3718, "display": {"text": " where", "kind": "normal"}, "is_word": true, "word_id": 626, "word_key": " where", "bytes_hex": "20 77 68 65 72 65", "compression": {"rwkv": "11.04% 11.04% 11.04% 11.04% 11.04% 11.04%", "qwen": "13.11% 13.11% 13.11% 13.11% 13.11% 13.11%"}, "model_tokens": {"rwkv": [[40185, " where", "normal", 0.024976719170808792]], "qwen": [[1380, " where", "normal", 0.012734335847198963]]}, "loss": {"rwkv": 11.036241360967004, "qwen": 13.114859509013838}, "topk": {"rwkv": [40185, 12, 0.024976719170808792, [[30917, 0.170761, " from", false], [4423, 0.135936, " as", false], [32487, 0.077335, " with", false], [21265, 0.074656, " and", false], [4811, 0.072813, " to", false], [30211, 0.061233, " away", false], [4596, 0.057784, " in", false], [21400, 0.047897, " but", false], [53169, 0.034742, " towards", false], [40186, 0.02897, " which", false]]], "qwen": [1380, 16, 0.012734335847198963, [[438, 0.176274, " as", false], [323, 0.137214, " and", false], [504, 0.105461, " from", false], [311, 0.068331, " to", false], [448, 0.06198, " with", false], [304, 0.041964, " in", false], [3123, 0.027893, " away", false], [714, 0.027693, " but", false], [773, 0.025551, " so", false], [2670, 0.023168, " including", false]]]}, "raw_delta": -0.11526306470235193, "tuned_delta": -0.10845078689525398}, {"byte_start": 3718, "byte_end": 3729, "display": {"text": " statistics", "kind": "normal"}, "is_word": true, "word_id": 627, "word_key": " statistics", "bytes_hex": "20 73 74 61 74 69 73 74 69 63 73", "compression": {"rwkv": "10.04% 10.04% 10.04% 10.04% 10.04% 10.04% 10.04% 10.04% 10.04% 10.04% 10.04%", "qwen": "10.25% 10.25% 10.25% 10.25% 10.25% 10.25% 10.25% 10.25% 10.25% 10.25% 10.25%"}, "model_tokens": {"rwkv": [[62577, " statistics", "normal", 0.002166098915040493]], "qwen": [[13142, " statistics", "normal", 0.0019320999272167683]]}, "loss": {"rwkv": 10.041485369823748, "qwen": 10.245016674508697}, "topk": {"rwkv": [62577, 40, 0.002166098915040493, [[63885, 0.208626, " statistical", false], [22590, 0.205883, " the", false], [3866, 0.087573, " HM", false], [38720, 0.037767, " human", false], [52224, 0.037085, " methods", false], [31458, 0.021751, " more", false], [21256, 0.018047, " all", false], [4601, 0.017714, " it", false], [31466, 0.01552, " much", false], [22190, 0.015496, " now", false]]], "qwen": [13142, 61, 0.0019320999272167683, [[279, 0.191419, " the", false], [28464, 0.104236, " statistical", false], [3738, 0.073572, " human", false], [472, 0.053897, " H", false], [5413, 0.042883, " methods", false], [264, 0.030919, " a", false], [803, 0.021692, " more", false], [6788, 0.020739, " earlier", false], [11811, 0.020264, " researchers", false], [678, 0.020051, " all", false]]]}, "raw_delta": -0.011286171999844719, "tuned_delta": -0.004473894192746772}, {"byte_start": 3729, "byte_end": 3733, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 628, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"rwkv": "11.20% 11.20% 11.20% 11.20%", "qwen": "9.20% 9.20% 9.20% 9.20%"}, "model_tokens": {"rwkv": [[21265, " and", "normal", 0.08263315260410309]], "qwen": [[323, " and", "normal", 0.129806786775589]]}, "loss": {"rwkv": 11.20061091315162, "qwen": 9.20488231176844}, "topk": {"rwkv": [21265, 2, 0.08263315260410309, [[45283, 0.113156, " became", false], [21265, 0.082633, " and", false], [30383, 0.067791, " came", false], [46, 0.062144, "-", false], [32272, 0.05382, " took", false], [31059, 0.048, " have", false], [22777, 0.043653, " won", false], [57094, 0.042739, " replaced", false], [32462, 0.03779, " were", false], [37828, 0.03229, " began", false]]], "qwen": [323, 1, 0.129806786775589, [[323, 0.129807, " and", false], [6116, 0.110121, " became", false], [702, 0.052799, " has", false], [5980, 0.051573, "-based", false], [4421, 0.050791, "---", false], [11, 0.048703, ",", false], [572, 0.041111, " was", false], [3867, 0.034376, " took", false], [320, 0.031195, " (", false], [12575, 0.023812, " replaced", false]]]}, "raw_delta": 0.11066669225692749, "tuned_delta": 0.11747897006402544}, {"byte_start": 3733, "byte_end": 3745, "display": {"text": " computation", "kind": "normal"}, "is_word": true, "word_id": 629, "word_key": " computation", "bytes_hex": "20 63 6f 6d 70 75 74 61 74 69 6f 6e", "compression": {"rwkv": "3.15% 3.15% 3.15% 3.15% 3.15% 3.15% 3.15% 3.15% 3.15% 3.15% 3.15% 3.15%", "qwen": "1.57% 1.57% 1.57% 1.57% 1.57% 1.57% 1.57% 1.57% 1.57% 1.57% 1.57% 1.57%"}, "model_tokens": {"rwkv": [[63370, " computation", "normal", 0.1241152286529541]], "qwen": [[34447, " computation", "normal", 0.3509063720703125]]}, "loss": {"rwkv": 3.1465028561054873, "qwen": 1.5737937108487454}, "topk": {"rwkv": [63370, 2, 0.1241152286529541, [[3866, 0.216281, " HM", false], [63370, 0.124115, " computation", false], [56537, 0.11271, " learning", false], [47202, 0.079525, " search", false], [52167, 0.062128, " machine", false], [63885, 0.058401, " statistical", false], [56935, 0.025983, " probabil", false], [63787, 0.021027, " probability", false], [30597, 0.018259, " deep", false], [52195, 0.017505, " massive", false]]], "qwen": [34447, 1, 0.3509063720703125, [[34447, 0.350906, " computation", false], [5662, 0.09078, " machine", false], [6832, 0.047997, " learning", false], [472, 0.044146, " H", false], [2711, 0.035162, " search", false], [28464, 0.026352, " statistical", false], [54480, 0.021034, " computational", false], [10951, 0.019022, " massive", false], [24231, 0.016781, " computing", false], [279, 0.016624, " the", false]]]}, "raw_delta": 0.08720951279004417, "tuned_delta": 0.09402179059714212}, {"byte_start": 3745, "byte_end": 3750, "display": {"text": " came", "kind": "normal"}, "is_word": true, "word_id": 630, "word_key": " came", "bytes_hex": "20 63 61 6d 65", "compression": {"rwkv": "8.12% 8.12% 8.12% 8.12% 8.12%", "qwen": "11.08% 11.08% 11.08% 11.08% 11.08%"}, "model_tokens": {"rwkv": [[30383, " came", "normal", 0.10543467104434967]], "qwen": [[3697, " came", "normal", 0.04633750766515732]]}, "loss": {"rwkv": 8.115159605000418, "qwen": 11.079189441815968}, "topk": {"rwkv": [30383, 2, 0.10543467104434967, [[45283, 0.114442, " became", false], [30383, 0.105435, " came", false], [31059, 0.102587, " have", false], [32272, 0.075175, " took", false], [32462, 0.052735, " were", false], [22777, 0.051508, " won", false], [57094, 0.046783, " replaced", false], [61959, 0.03908, " eventually", false], [22190, 0.034601, " now", false], [21286, 0.025561, " are", false]]], "qwen": [3697, 6, 0.04633750766515732, [[6116, 0.155787, " became", false], [614, 0.143535, " have", false], [1033, 0.084004, " were", false], [3867, 0.052117, " took", false], [29701, 0.04924, " dominated", false], [3697, 0.046338, " came", false], [11, 0.026066, ",", false], [525, 0.022455, " are", false], [1431, 0.021502, " now", false], [916, 0.018227, " over", false]]]}, "raw_delta": -0.16436071395874025, "tuned_delta": -0.1575484361516423}, {"byte_start": 3750, "byte_end": 3753, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 631, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "0.23% 0.23% 0.23%", "qwen": "0.19% 0.19% 0.19%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.9628196954727173]], "qwen": [[311, " to", "normal", 0.9691116213798523]]}, "loss": {"rwkv": 0.22894330482857084, "qwen": 0.18860515475946268}, "topk": {"rwkv": [4811, 1, 0.9628196954727173, [[4811, 0.96282, " to", false], [38499, 0.010817, " first", false], [31162, 0.005857, " into", false], [4596, 0.004115, " in", false], [57435, 0.002546, " together", false], [22249, 0.002409, " out", false], [64430, 0.001808, " increasingly", false], [31458, 0.00054, " more", false], [4712, 0.000473, " on", false], [45285, 0.000435, " before", false]]], "qwen": [311, 1, 0.9691116213798523, [[311, 0.969112, " to", false], [1119, 0.006749, " into", false], [14756, 0.005994, " increasingly", false], [304, 0.002393, " in", false], [700, 0.002006, " out", false], [518, 0.00129, " at", false], [1156, 0.000882, " first", false], [315, 0.000805, " of", false], [803, 0.000767, " more", false], [1182, 0.000627, " back", false]]]}, "raw_delta": 0.002236821999152502, "tuned_delta": 0.00904909980625045}, {"byte_start": 3753, "byte_end": 3762, "display": {"text": " dominate", "kind": "normal"}, "is_word": true, "word_id": 632, "word_key": " dominate", "bytes_hex": "20 64 6f 6d 69 6e 61 74 65", "compression": {"rwkv": "1.55% 1.55% 1.55% 1.55% 1.55% 1.55% 1.55% 1.55% 1.55%", "qwen": "0.88% 0.88% 0.88% 0.88% 0.88% 0.88% 0.88% 0.88% 0.88%"}, "model_tokens": {"rwkv": [[56041, " dominate", "normal", 0.460539847612381]], "qwen": [[40736, " dominate", "normal", 0.6446137428283691]]}, "loss": {"rwkv": 1.549770063454941, "qwen": 0.8798515971554768}, "topk": {"rwkv": [56041, 1, 0.460539847612381, [[56041, 0.46054, " dominate", false], [4435, 0.206091, " be", false], [31907, 0.050503, " rule", false], [31702, 0.047828, " play", false], [56906, 0.037388, " predomin", false], [52716, 0.030395, " replace", false], [32187, 0.021976, " take", false], [22590, 0.019868, " the", false], [52550, 0.013854, " prevail", false], [31059, 0.006649, " have", false]]], "qwen": [40736, 1, 0.6446137428283691, [[40736, 0.644614, " dominate", false], [1486, 0.059636, " play", false], [279, 0.044036, " the", false], [387, 0.039062, " be", false], [1896, 0.037964, " take", false], [4162, 0.030339, " pred", false], [8290, 0.025675, " replace", false], [1026, 0.009732, " sup", false], [65728, 0.008506, " prevail", false], [5912, 0.008304, " rule", false]]]}, "raw_delta": 0.03714816768964132, "tuned_delta": 0.04396044549673927}, {"byte_start": 3762, "byte_end": 3766, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 633, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "12.54% 12.54% 12.54% 12.54%", "qwen": "9.96% 9.96% 9.96% 9.96%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.06307712197303772]], "qwen": [[279, " the", "normal", 0.10979695618152618]]}, "loss": {"rwkv": 12.539048695226342, "qwen": 9.959656122260641}, "topk": {"rwkv": [22590, 3, 0.06307712197303772, [[47, 0.593226, ".", false], [45, 0.126144, ",", false], [22590, 0.063077, " the", false], [31601, 0.051631, " over", false], [21265, 0.034733, " and", false], [275, 0.013902, " (", false], [4596, 0.009784, " in", false], [57103, 0.009383, " research", false], [21256, 0.007014, " all", false], [52224, 0.006543, " methods", false]]], "qwen": [279, 3, 0.10979695618152618, [[13, 0.282776, ".", false], [382, 0.179756, ".\n\n", false], [279, 0.109797, " the", false], [916, 0.090845, " over", false], [11, 0.083813, ",", false], [323, 0.025576, " and", false], [3738, 0.023952, " human", false], [678, 0.019848, " all", false], [320, 0.015324, " (", false], [5413, 0.012913, " methods", false]]]}, "raw_delta": 0.14303189516067505, "tuned_delta": 0.149844172967773}, {"byte_start": 3766, "byte_end": 3772, "display": {"text": " field", "kind": "normal"}, "is_word": true, "word_id": 634, "word_key": " field", "bytes_hex": "20 66 69 65 6c 64", "compression": {"rwkv": "2.83% 2.83% 2.83% 2.83% 2.83% 2.83%", "qwen": "0.73% 0.73% 0.73% 0.73% 0.73% 0.73%"}, "model_tokens": {"rwkv": [[38478, " field", "normal", 0.38770171999931335]], "qwen": [[2070, " field", "normal", 0.7843818068504333]]}, "loss": {"rwkv": 2.829504434035157, "qwen": 0.7299417550650444}, "topk": {"rwkv": [38478, 1, 0.38770171999931335, [[38478, 0.387702, " field", false], [57103, 0.185816, " research", false], [52224, 0.065283, " methods", false], [39597, 0.034776, " scene", false], [55532, 0.022566, " approach", false], [39802, 0.019467, " state", false], [61590, 0.018541, " approaches", false], [45829, 0.011941, " effort", false], [59945, 0.009755, " landscape", false], [62633, 0.009257, " techniques", false]]], "qwen": [2070, 1, 0.7843818068504333, [[2070, 0.784382, " field", false], [5413, 0.030536, " methods", false], [3412, 0.025925, " research", false], [3082, 0.015, " area", false], [5486, 0.009158, " approach", false], [25364, 0.007416, " discipline", false], [7947, 0.007026, " domain", false], [3738, 0.006482, " human", false], [1616, 0.005541, " way", false], [990, 0.004777, " use", false]]]}, "raw_delta": 0.11642447610696154, "tuned_delta": 0.12323675391405949}, {"byte_start": 3772, "byte_end": 3773, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "5.39%", "qwen": "13.96%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.7433637976646423]], "qwen": [[13, ".", "normal", 0.46101492643356323]]}, "loss": {"rwkv": 5.3889731751955905, "qwen": 13.963933556757253}, "topk": {"rwkv": [47, 1, 0.7433637976646423, [[47, 0.743364, ".", false], [45, 0.127399, ",", false], [21265, 0.032581, " and", false], [275, 0.013635, " (", false], [4706, 0.011864, " of", false], [31601, 0.010717, " over", false], [5346, 0.00713, "---", false], [4596, 0.006113, " in", false], [4423, 0.005017, " as", false], [40187, 0.003821, " while", false]]], "qwen": [13, 1, 0.46101492643356323, [[13, 0.461015, ".", false], [382, 0.256917, ".\n\n", false], [11, 0.13449, ",", false], [323, 0.027926, " and", false], [320, 0.020551, " (", false], [4421, 0.01885, "---", false], [304, 0.007144, " in", false], [916, 0.007141, " over", false], [624, 0.005872, ".\n", false], [315, 0.00569, " of", false]]]}, "raw_delta": -0.475496768951416, "tuned_delta": -0.4686844911443181}, {"byte_start": 3773, "byte_end": 3777, "display": {"text": " The", "kind": "normal"}, "is_word": true, "word_id": 635, "word_key": " the", "bytes_hex": "20 54 68 65", "compression": {"rwkv": "10.92% 10.92% 10.92% 10.92%", "qwen": "9.02% 9.02% 9.02% 9.02%"}, "model_tokens": {"rwkv": [[20996, " The", "normal", 0.09082569181919098]], "qwen": [[576, " The", "normal", 0.13527105748653412]]}, "loss": {"rwkv": 10.918834537977993, "qwen": 9.018984114667694}, "topk": {"rwkv": [20996, 2, 0.09082569181919098, [[261, 0.395419, "\n\n", false], [20996, 0.090826, " The", false], [29894, 0.041516, " This", false], [3913, 0.033132, " In", false], [3918, 0.029884, " It", false], [267, 0.026487, "  ", false], [37451, 0.020684, " There", false], [36251, 0.018191, " Again", false], [275, 0.015308, " (", false], [19555, 0.013476, " But", false]]], "qwen": [576, 1, 0.13527105748653412, [[576, 0.135271, " The", false], [1096, 0.087521, " This", false], [758, 0.070972, " In", false], [1084, 0.059122, " It", false], [220, 0.042533, " ", false], [2619, 0.033782, " There", false], [320, 0.031058, " (", false], [362, 0.024504, " A", false], [65694, 0.018292, " Statistical", false], [3776, 0.01478, " One", false]]]}, "raw_delta": 0.1053500771522522, "tuned_delta": 0.11216235495935015}, {"byte_start": 3777, "byte_end": 3784, "display": {"text": " recent", "kind": "normal"}, "is_word": true, "word_id": 636, "word_key": " recent", "bytes_hex": "20 72 65 63 65 6e 74", "compression": {"rwkv": "16.34% 16.34% 16.34% 16.34% 16.34% 16.34% 16.34%", "qwen": "16.84% 16.84% 16.84% 16.84% 16.84% 16.84% 16.84%"}, "model_tokens": {"rwkv": [[47014, " recent", "normal", 0.0017301434418186545]], "qwen": [[3213, " recent", "normal", 0.001448009512387216]]}, "loss": {"rwkv": 16.343029760070287, "qwen": 16.842344533425265}, "topk": {"rwkv": [47014, 90, 0.0017301434418186545, [[38720, 0.094622, " human", false], [63885, 0.090344, " statistical", false], [38328, 0.029754, " early", false], [52224, 0.020338, " methods", false], [46430, 0.019364, " lesson", false], [19678, 0.018607, " DAR", false], [52013, 0.017428, " initial", false], [62577, 0.015655, " statistics", false], [31937, 0.015621, " same", false], [52127, 0.013595, " lessons", false]]], "qwen": [3213, 106, 0.001448009512387216, [[3738, 0.08607, " human", false], [17755, 0.057509, " lesson", false], [1852, 0.039748, " same", false], [2297, 0.033862, " change", false], [2874, 0.025564, " reason", false], [4124, 0.023552, " early", false], [28464, 0.022176, " statistical", false], [2070, 0.021218, " field", false], [18366, 0.013596, " lessons", false], [2856, 0.012939, " initial", false]]]}, "raw_delta": -0.027687890189034614, "tuned_delta": -0.020875612381936668}, {"byte_start": 3784, "byte_end": 3789, "display": {"text": " rise", "kind": "normal"}, "is_word": true, "word_id": 637, "word_key": " rise", "bytes_hex": "20 72 69 73 65", "compression": {"rwkv": "13.69% 13.69% 13.69% 13.69% 13.69%", "qwen": "11.77% 11.77% 11.77% 11.77% 11.77%"}, "model_tokens": {"rwkv": [[31886, " rise", "normal", 0.022438595071434975]], "qwen": [[10000, " rise", "normal", 0.03823969513177872]]}, "loss": {"rwkv": 13.694331833438206, "qwen": 11.7719630767155}, "topk": {"rwkv": [31886, 6, 0.022438595071434975, [[53052, 0.187084, " success", false], [59687, 0.056754, " explosion", false], [60587, 0.046959, " successes", false], [22377, 0.031875, " res", false], [32499, 0.02322, " work", false], [31886, 0.022439, " rise", false], [63469, 0.021027, " development", false], [56950, 0.019834, " progress", false], [40009, 0.019444, " trend", false], [55465, 0.015924, " advances", false]]], "qwen": [10000, 4, 0.03823969513177872, [[2393, 0.155085, " success", false], [90490, 0.075235, " resurgence", false], [9902, 0.065232, " ``", false], [10000, 0.03824, " rise", false], [48079, 0.031369, " emergence", false], [4401, 0.023977, " development", false], [975, 0.023407, " work", false], [47088, 0.022941, " successes", false], [24199, 0.016634, " explosion", false], [12560, 0.010869, " victory", false]]]}, "raw_delta": 0.10659875869750979, "tuned_delta": 0.11341103650460774}, {"byte_start": 3789, "byte_end": 3792, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 638, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "0.83% 0.83% 0.83%", "qwen": "0.88% 0.88% 0.88%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.8706773519515991]], "qwen": [[315, " of", "normal", 0.8635035753250122]]}, "loss": {"rwkv": 0.8335884432219759, "qwen": 0.8821916360987787}, "topk": {"rwkv": [4706, 1, 0.8706773519515991, [[4706, 0.870677, " of", false], [4596, 0.097037, " in", false], [4811, 0.017224, " to", false], [21265, 0.008711, " and", false], [45, 0.002765, ",", false], [275, 0.001328, " (", false], [37635, 0.000271, " again", false], [30917, 0.00021, " from", false], [4600, 0.000126, " is", false], [4715, 9.7e-05, " or", false]]], "qwen": [315, 1, 0.8635035753250122, [[315, 0.863504, " of", false], [304, 0.106901, " in", false], [311, 0.014329, " to", false], [323, 0.010539, " and", false], [11, 0.001082, ",", false], [320, 0.000833, " (", false], [1549, 0.000326, " again", false], [702, 0.000226, " has", false], [504, 0.000149, " from", false], [8841, 0.000125, " toward", false]]]}, "raw_delta": -0.0026951332887013707, "tuned_delta": 0.004117144518396576}, {"byte_start": 3792, "byte_end": 3797, "display": {"text": " deep", "kind": "normal"}, "is_word": true, "word_id": 639, "word_key": " deep", "bytes_hex": "20 64 65 65 70", "compression": {"rwkv": "2.04% 2.04% 2.04% 2.04% 2.04%", "qwen": "2.71% 2.71% 2.71% 2.71% 2.71%"}, "model_tokens": {"rwkv": [[30597, " deep", "normal", 0.5748578906059265]], "qwen": [[5538, " deep", "normal", 0.47233864665031433]]}, "loss": {"rwkv": 2.042878720008786, "qwen": 2.7052662451755625}, "topk": {"rwkv": [30597, 1, 0.5748578906059265, [[30597, 0.574858, " deep", false], [46658, 0.117838, " neural", false], [52167, 0.023863, " machine", false], [60342, 0.023523, " recurrent", false], [22590, 0.02292, " the", false], [59193, 0.01819, " attention", false], [4404, 0.016531, " ``", false], [32497, 0.008654, " word", false], [56529, 0.007959, " language", false], [38864, 0.007106, " large", false]]], "qwen": [5538, 1, 0.47233864665031433, [[5538, 0.472339, " deep", false], [29728, 0.166442, " neural", false], [5662, 0.030954, " machine", false], [279, 0.029208, " the", false], [3460, 0.017315, " large", false], [9902, 0.017042, " ``", false], [6529, 0.013668, " attention", false], [1766, 0.011558, " gener", false], [15235, 0.010287, " AI", false], [28464, 0.010208, " statistical", false]]]}, "raw_delta": -0.03673056364059449, "tuned_delta": -0.029918285833496542}, {"byte_start": 3797, "byte_end": 3806, "display": {"text": " learning", "kind": "normal"}, "is_word": true, "word_id": 640, "word_key": " learning", "bytes_hex": "20 6c 65 61 72 6e 69 6e 67", "compression": {"rwkv": "0.45% 0.45% 0.45% 0.45% 0.45% 0.45% 0.45% 0.45% 0.45%", "qwen": "0.45% 0.45% 0.45% 0.45% 0.45% 0.45% 0.45% 0.45% 0.45%"}, "model_tokens": {"rwkv": [[56537, " learning", "normal", 0.797748863697052]], "qwen": [[6832, " learning", "normal", 0.7984076142311096]]}, "loss": {"rwkv": 0.4539730488908413, "qwen": 0.4511146733470222}, "topk": {"rwkv": [56537, 1, 0.797748863697052, [[56537, 0.797749, " learning", false], [46658, 0.158959, " neural", false], [46, 0.013196, "-", false], [56705, 0.005656, " networks", false], [31510, 0.002521, " nets", false], [47350, 0.002386, " speech", false], [56529, 0.00179, " language", false], [46086, 0.001142, " genera", false], [45, 0.001055, ",", false], [65003, 0.000972, " reinforcement", false]]], "qwen": [6832, 1, 0.7984076142311096, [[6832, 0.798408, " learning", false], [29728, 0.147366, " neural", false], [70756, 0.025295, "-learning", false], [14155, 0.00426, " networks", false], [71278, 0.00325, " reinforcement", false], [52457, 0.002188, " nets", false], [55712, 0.00194, " convolution", false], [11, 0.001538, ",", false], [1766, 0.001425, " gener", false], [320, 0.001152, " (", false]]]}, "raw_delta": 0.00015850199593438197, "tuned_delta": 0.006970779803032329}, {"byte_start": 3806, "byte_end": 3809, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 641, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "10.14% 10.14% 10.14%", "qwen": "10.72% 10.72% 10.72%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.18356020748615265]], "qwen": [[304, " in", "normal", 0.16819624602794647]]}, "loss": {"rwkv": 10.143949506250523, "qwen": 10.715761006811082}, "topk": {"rwkv": [4596, 1, 0.18356020748615265, [[4596, 0.18356, " in", false], [45, 0.145091, ",", false], [21800, 0.114902, " has", false], [4600, 0.092772, " is", false], [52224, 0.073284, " methods", false], [275, 0.038886, " (", false], [21265, 0.037521, " and", false], [21700, 0.023723, " for", false], [22748, 0.021678, " was", false], [21413, 0.021187, " can", false]]], "qwen": [304, 2, 0.16819624602794647, [[702, 0.183061, " has", false], [304, 0.168196, " in", false], [374, 0.121965, " is", false], [11, 0.09634, ",", false], [572, 0.051172, " was", false], [323, 0.048385, " and", false], [5413, 0.047639, " methods", false], [320, 0.035923, " (", false], [1083, 0.016303, " also", false], [646, 0.015431, " can", false]]]}, "raw_delta": -0.03170796235402429, "tuned_delta": -0.024895684546926342}, {"byte_start": 3809, "byte_end": 3816, "display": {"text": " speech", "kind": "normal"}, "is_word": true, "word_id": 642, "word_key": " speech", "bytes_hex": "20 73 70 65 65 63 68", "compression": {"rwkv": "3.08% 3.08% 3.08% 3.08% 3.08% 3.08% 3.08%", "qwen": "3.08% 3.08% 3.08% 3.08% 3.08% 3.08% 3.08%"}, "model_tokens": {"rwkv": [[47350, " speech", "normal", 0.3008098006248474]], "qwen": [[8806, " speech", "normal", 0.30251842737197876]]}, "loss": {"rwkv": 3.0794132429689087, "qwen": 3.0801874720096674}, "topk": {"rwkv": [47350, 1, 0.3008098006248474, [[47350, 0.30081, " speech", false], [4047, 0.294918, " NL", false], [52299, 0.167886, " natural", false], [55809, 0.056445, " computer", false], [32234, 0.031087, " this", false], [22590, 0.027434, " the", false], [62293, 0.011245, " particular", false], [3609, 0.010595, " AI", false], [56529, 0.008944, " language", false], [52167, 0.008135, " machine", false]]], "qwen": [8806, 1, 0.30251842737197876, [[8806, 0.302518, " speech", false], [5810, 0.227938, " natural", false], [451, 0.12571, " N", false], [6366, 0.050058, " computer", false], [279, 0.045199, " the", false], [419, 0.039475, " this", false], [5662, 0.023615, " machine", false], [4128, 0.021623, " language", false], [678, 0.016251, " all", false], [29728, 0.015388, " neural", false]]]}, "raw_delta": -4.2932374136772644e-05, "tuned_delta": 0.006769345432961174}, {"byte_start": 3816, "byte_end": 3828, "display": {"text": " recognition", "kind": "normal"}, "is_word": true, "word_id": 643, "word_key": " recognition", "bytes_hex": "20 72 65 63 6f 67 6e 69 74 69 6f 6e", "compression": {"rwkv": "0.33% 0.33% 0.33% 0.33% 0.33% 0.33% 0.33% 0.33% 0.33% 0.33% 0.33% 0.33%", "qwen": "0.25% 0.25% 0.25% 0.25% 0.25% 0.25% 0.25% 0.25% 0.25% 0.25% 0.25% 0.25%"}, "model_tokens": {"rwkv": [[63821, " recognition", "normal", 0.8041918277740479]], "qwen": [[17843, " recognition", "normal", 0.845000684261322]]}, "loss": {"rwkv": 0.3258039337945046, "qwen": 0.25309961175671214}, "topk": {"rwkv": [63821, 1, 0.8041918277740479, [[63821, 0.804192, " recognition", false], [21265, 0.063798, " and", false], [62378, 0.034685, " processing", false], [21800, 0.01924, " has", false], [45, 0.01297, ",", false], [4600, 0.011906, " is", false], [275, 0.004559, " (", false], [46, 0.004432, "-", false], [65034, 0.004367, " understanding", false], [22748, 0.00272, " was", false]]], "qwen": [17843, 1, 0.845000684261322, [[17843, 0.845001, " recognition", false], [323, 0.051257, " and", false], [8692, 0.02725, " processing", false], [702, 0.014117, " has", false], [59172, 0.012267, "-rec", false], [11, 0.009875, ",", false], [374, 0.007562, " is", false], [572, 0.002541, " was", false], [3412, 0.00192, " research", false], [320, 0.00178, " (", false]]]}, "raw_delta": 0.004031583666801453, "tuned_delta": 0.010843861473899399}, {"byte_start": 3828, "byte_end": 3831, "display": {"text": " is", "kind": "normal"}, "is_word": true, "word_id": 644, "word_key": " is", "bytes_hex": "20 69 73", "compression": {"rwkv": "7.75% 7.75% 7.75%", "qwen": "7.52% 7.52% 7.52%"}, "model_tokens": {"rwkv": [[4600, " is", "normal", 0.27737218141555786]], "qwen": [[374, " is", "normal", 0.2861829102039337]]}, "loss": {"rwkv": 7.748850317274705, "qwen": 7.520794156286835}, "topk": {"rwkv": [4600, 1, 0.27737218141555786, [[4600, 0.277372, " is", false], [21800, 0.195876, " has", false], [21265, 0.106645, " and", false], [45, 0.103559, ",", false], [22748, 0.07034, " was", false], [275, 0.024549, " (", false], [21413, 0.021272, " can", false], [39680, 0.009037, " shows", false], [5346, 0.008389, "---", false], [22074, 0.007196, " may", false]]], "qwen": [374, 1, 0.2861829102039337, [[374, 0.286183, " is", false], [702, 0.119782, " has", false], [11, 0.093267, ",", false], [572, 0.083613, " was", false], [323, 0.074318, " and", false], [646, 0.039305, " can", false], [320, 0.032056, " (", false], [1083, 0.024595, " also", false], [4933, 0.013609, " shows", false], [1231, 0.009235, " may", false]]]}, "raw_delta": 0.012646118799845396, "tuned_delta": 0.019458396606943342}, {"byte_start": 3831, "byte_end": 3835, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 645, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "11.62% 11.62% 11.62% 11.62%", "qwen": "11.99% 11.99% 11.99% 11.99%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.07666730880737305]], "qwen": [[279, " the", "normal", 0.0699431374669075]]}, "loss": {"rwkv": 11.623275475912058, "qwen": 11.992730756278679}, "topk": {"rwkv": [22590, 3, 0.07666730880737305, [[332, 0.264894, " a", false], [4419, 0.089492, " an", false], [22590, 0.076667, " the", false], [50919, 0.039424, " another", false], [22797, 0.031481, " yet", false], [31198, 0.030372, " just", false], [4596, 0.024025, " in", false], [52906, 0.019958, " similar", false], [45, 0.019265, ",", false], [47285, 0.019189, " simply", false]]], "qwen": [279, 4, 0.0699431374669075, [[264, 0.234943, " a", false], [2441, 0.142371, " another", false], [458, 0.090994, " an", false], [279, 0.069943, " the", false], [3602, 0.038998, " yet", false], [1101, 0.03188, " just", false], [1083, 0.027514, " also", false], [304, 0.021343, " in", false], [537, 0.01635, " not", false], [8365, 0.014277, " perhaps", false]]]}, "raw_delta": -0.020486950874328613, "tuned_delta": -0.013674673067230667}, {"byte_start": 3835, "byte_end": 3840, "display": {"text": " most", "kind": "normal"}, "is_word": true, "word_id": 646, "word_key": " most", "bytes_hex": "20 6d 6f 73 74", "compression": {"rwkv": "7.38% 7.38% 7.38% 7.38% 7.38%", "qwen": "5.85% 5.85% 5.85% 5.85% 5.85%"}, "model_tokens": {"rwkv": [[31461, " most", "normal", 0.12969781458377838]], "qwen": [[1429, " most", "normal", 0.1974916160106659]]}, "loss": {"rwkv": 7.3825410295489915, "qwen": 5.850342003576077}, "topk": {"rwkv": [31461, 2, 0.12969781458377838, [[46404, 0.370095, " latest", false], [31461, 0.129698, " most", false], [45635, 0.117241, " culmin", false], [52299, 0.043231, " natural", false], [64328, 0.038152, " continuation", false], [47092, 0.035379, " result", false], [31515, 0.029396, " next", false], [52154, 0.028008, " logical", false], [38491, 0.015696, " final", false], [31937, 0.015184, " same", false]]], "qwen": [1429, 2, 0.1974916160106659, [[5535, 0.307636, " latest", false], [1429, 0.197492, " most", false], [92201, 0.057313, " culmination", false], [1102, 0.04321, " result", false], [16724, 0.030106, " ultimate", false], [1590, 0.026096, " final", false], [5810, 0.019535, " natural", false], [1790, 0.018574, " next", false], [6481, 0.016573, " modern", false], [1850, 0.013925, " best", false]]]}, "raw_delta": 0.08496315479278566, "tuned_delta": 0.0917754325998836}, {"byte_start": 3840, "byte_end": 3847, "display": {"text": " recent", "kind": "normal"}, "is_word": true, "word_id": 647, "word_key": " recent", "bytes_hex": "20 72 65 63 65 6e 74", "compression": {"rwkv": "1.07% 1.07% 1.07% 1.07% 1.07% 1.07% 1.07%", "qwen": "1.77% 1.77% 1.77% 1.77% 1.77% 1.77% 1.77%"}, "model_tokens": {"rwkv": [[47014, " recent", "normal", 0.6648916006088257]], "qwen": [[3213, " recent", "normal", 0.5033757090568542]]}, "loss": {"rwkv": 1.0717565698568259, "qwen": 1.7683793607497929}, "topk": {"rwkv": [47014, 1, 0.6648916006088257, [[47014, 0.664892, " recent", false], [56056, 0.093059, " dramatic", false], [52346, 0.048408, " obvious", false], [63878, 0.020336, " spectacular", false], [60273, 0.01949, " prominent", false], [51699, 0.013504, " extreme", false], [57323, 0.013124, " striking", false], [53296, 0.012925, " visible", false], [45752, 0.009645, " direct", false], [59829, 0.009479, " important", false]]], "qwen": [3213, 1, 0.5033757090568542, [[3213, 0.503376, " recent", false], [21771, 0.087077, " dramatic", false], [20469, 0.041847, " prominent", false], [8036, 0.041745, " obvious", false], [14226, 0.036954, " extreme", false], [27709, 0.034373, " spectacular", false], [9434, 0.032216, " visible", false], [2989, 0.022292, " important", false], [5089, 0.018553, " significant", false], [27190, 0.017109, " notable", false]]]}, "raw_delta": -0.038628969873700826, "tuned_delta": -0.03181669206660288}, {"byte_start": 3847, "byte_end": 3852, "display": {"text": " step", "kind": "normal"}, "is_word": true, "word_id": 648, "word_key": " step", "bytes_hex": "20 73 74 65 70", "compression": {"rwkv": "19.39% 19.39% 19.39% 19.39% 19.39%", "qwen": "19.09% 19.09% 19.09% 19.09% 19.09%"}, "model_tokens": {"rwkv": [[32115, " step", "normal", 0.004619718063622713]], "qwen": [[3019, " step", "normal", 0.005021218676120043]]}, "loss": {"rwkv": 19.386214611945444, "qwen": 19.094366932737294}, "topk": {"rwkv": [32115, 23, 0.004619718063622713, [[51668, 0.387621, " example", false], [64955, 0.101399, " manifestation", false], [21265, 0.048972, " and", false], [53275, 0.029514, " version", false], [45, 0.027213, ",", false], [56467, 0.02281, " instance", false], [4706, 0.021745, " of", false], [59932, 0.01937, " iteration", false], [63469, 0.018726, " development", false], [59695, 0.016431, " extension", false]]], "qwen": [3019, 20, 0.005021218676120043, [[3110, 0.454865, " example", false], [62950, 0.143977, " manifestation", false], [323, 0.034289, " and", false], [2867, 0.031439, " instance", false], [315, 0.018749, " of", false], [7493, 0.01635, " expression", false], [3598, 0.014601, " major", false], [39034, 0.014404, " illustration", false], [11, 0.013451, ",", false], [2319, 0.011413, " version", false]]]}, "raw_delta": 0.016183471679687367, "tuned_delta": 0.022995749486785313}, {"byte_start": 3852, "byte_end": 3855, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 649, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "1.44% 1.44% 1.44%", "qwen": "1.46% 1.46% 1.46%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.7861080169677734]], "qwen": [[304, " in", "normal", 0.7840771675109863]]}, "loss": {"rwkv": 1.4382335816153808, "qwen": 1.4622185329127406}, "topk": {"rwkv": [4596, 1, 0.7861080169677734, [[4596, 0.786108, " in", false], [37678, 0.079524, " along", false], [4706, 0.049961, " of", false], [45, 0.011948, ",", false], [4712, 0.010425, " on", false], [53169, 0.008295, " towards", false], [47, 0.008271, ".", false], [47585, 0.006762, " toward", false], [30678, 0.006158, " down", false], [30211, 0.005264, " away", false]]], "qwen": [304, 1, 0.7840771675109863, [[304, 0.784077, " in", false], [6974, 0.047984, " towards", false], [3156, 0.033861, " along", false], [315, 0.021732, " of", false], [11, 0.021365, ",", false], [389, 0.013445, " on", false], [4637, 0.011178, " forward", false], [8841, 0.00769, " toward", false], [311, 0.007191, " to", false], [13, 0.006736, ".", false]]]}, "raw_delta": -0.0013300081094105992, "tuned_delta": 0.005482269697687348}, {"byte_start": 3855, "byte_end": 3860, "display": {"text": " this", "kind": "normal"}, "is_word": true, "word_id": 650, "word_key": " this", "bytes_hex": "20 74 68 69 73", "compression": {"rwkv": "1.54% 1.54% 1.54% 1.54% 1.54%", "qwen": "1.39% 1.39% 1.39% 1.39% 1.39%"}, "model_tokens": {"rwkv": [[32234, " this", "normal", 0.6485736966133118]], "qwen": [[419, " this", "normal", 0.6810057759284973]]}, "loss": {"rwkv": 1.5427256540756003, "qwen": 1.3856527166618726}, "topk": {"rwkv": [32234, 1, 0.6485736966133118, [[32234, 0.648574, " this", false], [32227, 0.168735, " that", false], [22590, 0.104184, " the", false], [332, 0.052524, " a", false], [4419, 0.005423, " an", false], [39936, 0.003695, " these", false], [32464, 0.002851, " what", false], [61774, 0.000961, " continuing", false], [59725, 0.000581, " following", false], [55531, 0.000514, " applying", false]]], "qwen": [419, 1, 0.6810057759284973, [[419, 0.681006, " this", false], [429, 0.131548, " that", false], [279, 0.095718, " the", false], [264, 0.054598, " a", false], [458, 0.004845, " an", false], [1128, 0.003424, " what", false], [1493, 0.001981, " these", false], [1741, 0.001159, " such", false], [14354, 0.001105, " continuing", false], [5810, 0.000941, " natural", false]]]}, "raw_delta": 0.008709973096847526, "tuned_delta": 0.015522250903945472}, {"byte_start": 3860, "byte_end": 3871, "display": {"text": " consistent", "kind": "normal"}, "is_word": true, "word_id": 651, "word_key": " consistent", "bytes_hex": "20 63 6f 6e 73 69 73 74 65 6e 74", "compression": {"rwkv": "18.44% 18.44% 18.44% 18.44% 18.44% 18.44% 18.44% 18.44% 18.44% 18.44% 18.44%", "qwen": "15.36% 15.36% 15.36% 15.36% 15.36% 15.36% 15.36% 15.36% 15.36% 15.36% 15.36%"}, "model_tokens": {"rwkv": [[61756, " consistent", "normal", 1.3380900782067329e-05]], "qwen": [[12966, " consistent", "normal", 8.523379074176773e-05]]}, "loss": {"rwkv": 18.443544556819138, "qwen": 15.361607635964383}, "topk": {"rwkv": [61756, 1016, 1.3380900782067329e-05, [[52571, 0.158304, " process", false], [31323, 0.138818, " long", false], [59657, 0.07911, " evolution", false], [40009, 0.063551, " trend", false], [59526, 0.037147, " direction", false], [51832, 0.03575, " general", false], [64386, 0.033156, " evolutionary", false], [63797, 0.031674, " progression", false], [45450, 0.02509, " change", false], [31937, 0.024758, " same", false]]], "qwen": [12966, 291, 8.523379074176773e-05, [[1882, 0.186448, " process", false], [9149, 0.135534, " trend", false], [1293, 0.100552, " long", false], [15379, 0.066108, " evolution", false], [5106, 0.0499, " direction", false], [2297, 0.042591, " change", false], [4586, 0.030231, " general", false], [9142, 0.027419, " transition", false], [32724, 0.022523, " progression", false], [5383, 0.02007, " pattern", false]]]}, "raw_delta": 0.1708988709883256, "tuned_delta": 0.17771114879542355}, {"byte_start": 3871, "byte_end": 3881, "display": {"text": " direction", "kind": "normal"}, "is_word": true, "word_id": 652, "word_key": " direction", "bytes_hex": "20 64 69 72 65 63 74 69 6f 6e", "compression": {"rwkv": "8.85% 8.85% 8.85% 8.85% 8.85% 8.85% 8.85% 8.85% 8.85% 8.85%", "qwen": "6.56% 6.56% 6.56% 6.56% 6.56% 6.56% 6.56% 6.56% 6.56% 6.56%"}, "model_tokens": {"rwkv": [[59526, " direction", "normal", 0.0074072773568332195]], "qwen": [[5106, " direction", "normal", 0.02627510018646717]]}, "loss": {"rwkv": 8.847778180451845, "qwen": 6.5626997328859815}, "topk": {"rwkv": [59526, 21, 0.0074072773568332195, [[52427, 0.24767, " pattern", false], [40009, 0.18833, " trend", false], [45, 0.062499, ",", false], [63797, 0.04444, " progression", false], [56950, 0.037044, " progress", false], [59657, 0.032632, " evolution", false], [21265, 0.030264, " and", false], [52571, 0.022616, " process", false], [45450, 0.017892, " change", false], [38974, 0.017754, " march", false]]], "qwen": [5106, 9, 0.02627510018646717, [[9149, 0.299869, " trend", false], [5383, 0.093218, " pattern", false], [2297, 0.054152, " change", false], [6407, 0.051961, " shift", false], [15379, 0.044662, " evolution", false], [1882, 0.03035, " process", false], [11, 0.029086, ",", false], [323, 0.026876, " and", false], [5106, 0.026275, " direction", false], [3271, 0.022239, " move", false]]]}, "raw_delta": 0.12671165466308595, "tuned_delta": 0.1335239324701839}, {"byte_start": 3881, "byte_end": 3882, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "5.42%", "qwen": "22.29%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.737638533115387]], "qwen": [[13, ".", "normal", 0.29059064388275146]]}, "loss": {"rwkv": 5.424195222092293, "qwen": 22.286748024105815}, "topk": {"rwkv": [47, 1, 0.737638533115387, [[47, 0.737639, ".", false], [45, 0.118772, ",", false], [4706, 0.071612, " of", false], [5346, 0.009323, "---", false], [21265, 0.008224, " and", false], [53169, 0.005947, " towards", false], [275, 0.005636, " (", false], [4596, 0.005036, " in", false], [32227, 0.004347, " that", false], [47585, 0.004286, " toward", false]]], "qwen": [13, 2, 0.29059064388275146, [[382, 0.405737, ".\n\n", false], [13, 0.290591, ".", false], [11, 0.135025, ",", false], [315, 0.061821, " of", false], [4421, 0.019762, "---", false], [320, 0.011173, " (", false], [624, 0.010594, ".\n", false], [323, 0.009096, " and", false], [26, 0.006324, ";", false], [304, 0.005766, " in", false]]]}, "raw_delta": -0.9350584745407104, "tuned_delta": -0.9282461967336125}, {"byte_start": 3882, "byte_end": 3887, "display": {"text": " Deep", "kind": "normal"}, "is_word": true, "word_id": 653, "word_key": " deep", "bytes_hex": "20 44 65 65 70", "compression": {"rwkv": "14.03% 14.03% 14.03% 14.03% 14.03%", "qwen": "11.75% 11.75% 11.75% 11.75% 11.75%"}, "model_tokens": {"rwkv": [[28753, " Deep", "normal", 0.02081853151321411]], "qwen": [[18183, " Deep", "normal", 0.03847718983888626]]}, "loss": {"rwkv": 14.032463483646556, "qwen": 11.749631989414219}, "topk": {"rwkv": [28753, 5, 0.02081853151321411, [[261, 0.634013, "\n\n", false], [20996, 0.043759, " The", false], [3918, 0.030083, " It", false], [267, 0.025413, "  ", false], [28753, 0.020819, " Deep", false], [3913, 0.019044, " In", false], [37451, 0.010926, " There", false], [36251, 0.009375, " Again", false], [29894, 0.009352, " This", false], [44900, 0.007609, " Speech", false]]], "qwen": [18183, 6, 0.03847718983888626, [[576, 0.116875, " The", false], [220, 0.098938, " ", false], [758, 0.08166, " In", false], [1084, 0.064057, " It", false], [1096, 0.03989, " This", false], [18183, 0.038477, " Deep", false], [2619, 0.035076, " There", false], [320, 0.027231, " (", false], [362, 0.017175, " A", false], [1634, 0.014003, " As", false]]]}, "raw_delta": 0.12658705711364737, "tuned_delta": 0.13339933492074532}, {"byte_start": 3887, "byte_end": 3896, "display": {"text": " learning", "kind": "normal"}, "is_word": true, "word_id": 654, "word_key": " learning", "bytes_hex": "20 6c 65 61 72 6e 69 6e 67", "compression": {"rwkv": "0.12% 0.12% 0.12% 0.12% 0.12% 0.12% 0.12% 0.12% 0.12%", "qwen": "0.13% 0.13% 0.13% 0.13% 0.13% 0.13% 0.13% 0.13% 0.13%"}, "model_tokens": {"rwkv": [[56537, " learning", "normal", 0.9419719576835632]], "qwen": [[6832, " learning", "normal", 0.9382525086402893]]}, "loss": {"rwkv": 0.11985279846794841, "qwen": 0.12771088284932422}, "topk": {"rwkv": [56537, 1, 0.9419719576835632, [[56537, 0.941972, " learning", false], [46658, 0.016119, " neural", false], [46, 0.015785, "-", false], [56705, 0.00253, " networks", false], [52224, 0.002389, " methods", false], [31510, 0.002199, " nets", false], [46587, 0.002005, " models", false], [47350, 0.001711, " speech", false], [1857, 0.001424, "er", false], [55122, 0.001209, " Learning", false]]], "qwen": [6832, 1, 0.9382525086402893, [[6832, 0.938253, " learning", false], [29728, 0.024987, " neural", false], [70756, 0.01787, "-learning", false], [14155, 0.00314, " networks", false], [52457, 0.00118, " nets", false], [4119, 0.000807, " models", false], [20909, 0.000775, " Learning", false], [5413, 0.000722, " methods", false], [11, 0.000584, ",", false], [71278, 0.000508, " reinforcement", false]]]}, "raw_delta": -0.000435744722684225, "tuned_delta": 0.006376533084413722}, {"byte_start": 3896, "byte_end": 3904, "display": {"text": " methods", "kind": "normal"}, "is_word": true, "word_id": 655, "word_key": " methods", "bytes_hex": "20 6d 65 74 68 6f 64 73", "compression": {"rwkv": "4.24% 4.24% 4.24% 4.24% 4.24% 4.24% 4.24% 4.24%", "qwen": "6.29% 6.29% 6.29% 6.29% 6.29% 6.29% 6.29% 6.29%"}, "model_tokens": {"rwkv": [[52224, " methods", "normal", 0.15244267880916595]], "qwen": [[5413, " methods", "normal", 0.061479464173316956]]}, "loss": {"rwkv": 4.244256651052736, "qwen": 6.287111723447028}, "topk": {"rwkv": [52224, 2, 0.15244267880916595, [[4600, 0.209829, " is", false], [52224, 0.152443, " methods", false], [45, 0.084794, ",", false], [21800, 0.077751, " has", false], [30659, 0.02684, " does", false], [32356, 0.024818, " uses", false], [21413, 0.023579, " can", false], [62633, 0.018085, " techniques", false], [22748, 0.017852, " was", false], [4596, 0.012773, " in", false]]], "qwen": [5413, 4, 0.061479464173316956, [[374, 0.355186, " is", false], [702, 0.088279, " has", false], [11, 0.080589, ",", false], [5413, 0.061479, " methods", false], [304, 0.034315, " in", false], [572, 0.032036, " was", false], [323, 0.024567, " and", false], [646, 0.016037, " can", false], [1558, 0.012097, " does", false], [320, 0.010785, " (", false]]]}, "raw_delta": -0.11327993869781494, "tuned_delta": -0.10646766089071699}, {"byte_start": 3904, "byte_end": 3909, "display": {"text": " rely", "kind": "normal"}, "is_word": true, "word_id": 656, "word_key": " rely", "bytes_hex": "20 72 65 6c 79", "compression": {"rwkv": "16.46% 16.46% 16.46% 16.46% 16.46%", "qwen": "19.16% 19.16% 19.16% 19.16% 19.16%"}, "model_tokens": {"rwkv": [[31856, " rely", "normal", 0.010330081917345524]], "qwen": [[17188, " rely", "normal", 0.0049310470931231976]]}, "loss": {"rwkv": 16.45574031013974, "qwen": 19.159725499544685}, "topk": {"rwkv": [31856, 13, 0.010330081917345524, [[21286, 0.248033, " are", false], [45, 0.121799, ",", false], [31059, 0.108374, " have", false], [4491, 0.049253, " do", false], [21413, 0.031626, " can", false], [22681, 0.02314, " use", false], [56540, 0.022566, " leverage", false], [32187, 0.016516, " take", false], [32462, 0.014282, " were", false], [32227, 0.012392, " that", false]]], "qwen": [17188, 23, 0.0049310470931231976, [[525, 0.272963, " are", false], [614, 0.124843, " have", false], [11, 0.080843, ",", false], [1033, 0.030006, " were", false], [646, 0.027957, " can", false], [429, 0.027579, " that", false], [653, 0.021692, " do", false], [369, 0.017541, " for", false], [304, 0.015921, " in", false], [320, 0.012085, " (", false]]]}, "raw_delta": -0.1499407768249511, "tuned_delta": -0.14312849901785316}, {"byte_start": 3909, "byte_end": 3914, "display": {"text": " even", "kind": "normal"}, "is_word": true, "word_id": 657, "word_key": " even", "bytes_hex": "20 65 76 65 6e", "compression": {"rwkv": "22.43% 22.43% 22.43% 22.43% 22.43%", "qwen": "14.45% 14.45% 14.45% 14.45% 14.45%"}, "model_tokens": {"rwkv": [[30788, " even", "normal", 0.002028294140473008]], "qwen": [[1496, " even", "normal", 0.01821867562830448]]}, "loss": {"rwkv": 22.429399463820598, "qwen": 14.44609551758368}, "topk": {"rwkv": [30788, 30, 0.002028294140473008, [[4712, 0.689636, " on", false], [51919, 0.128275, " heavily", false], [31458, 0.013272, " more", false], [32350, 0.012236, " upon", false], [4596, 0.011413, " in", false], [45, 0.010591, ",", false], [32386, 0.010225, " very", false], [31466, 0.009939, " much", false], [45145, 0.009526, " almost", false], [22187, 0.006943, " not", false]]], "qwen": [1496, 5, 0.01821867562830448, [[389, 0.546781, " on", false], [16916, 0.192428, " heavily", false], [803, 0.041072, " more", false], [1753, 0.027618, " much", false], [1496, 0.018219, " even", false], [2686, 0.014777, " less", false], [4558, 0.014529, " almost", false], [5193, 0.008048, " upon", false], [1602, 0.006943, " very", false], [15503, 0.006629, " primarily", false]]]}, "raw_delta": 0.4426883697509765, "tuned_delta": 0.4495006475580744}, {"byte_start": 3914, "byte_end": 3919, "display": {"text": " less", "kind": "normal"}, "is_word": true, "word_id": 658, "word_key": " less", "bytes_hex": "20 6c 65 73 73", "compression": {"rwkv": "11.95% 11.95% 11.95% 11.95% 11.95%", "qwen": "11.69% 11.69% 11.69% 11.69% 11.69%"}, "model_tokens": {"rwkv": [[31277, " less", "normal", 0.03611457720398903]], "qwen": [[2686, " less", "normal", 0.039091095328330994]]}, "loss": {"rwkv": 11.947318307361726, "qwen": 11.692540628633799}, "topk": {"rwkv": [31277, 2, 0.03611457720398903, [[31458, 0.95152, " more", false], [31277, 0.036115, " less", false], [51816, 0.006352, " further", false], [4712, 0.0017, " on", false], [31466, 0.000578, " much", false], [51918, 0.000515, " heavier", false], [45501, 0.000379, " closer", false], [51919, 0.000327, " heavily", false], [57326, 0.000316, " stronger", false], [4811, 0.000273, " to", false]]], "qwen": [2686, 2, 0.039091095328330994, [[803, 0.941949, " more", false], [2686, 0.039091, " less", false], [4623, 0.007461, " further", false], [1753, 0.002388, " much", false], [15750, 0.001907, " harder", false], [16245, 0.001344, " stronger", false], [16916, 0.000838, " heavily", false], [7046, 0.000763, " greater", false], [43822, 0.00046, " heavier", false], [389, 0.000449, " on", false]]]}, "raw_delta": 0.01412787437438967, "tuned_delta": 0.020940152181487617}, {"byte_start": 3919, "byte_end": 3922, "display": {"text": " on", "kind": "normal"}, "is_word": true, "word_id": 659, "word_key": " on", "bytes_hex": "20 6f 6e", "compression": {"rwkv": "0.71% 0.71% 0.71%", "qwen": "0.46% 0.46% 0.46%"}, "model_tokens": {"rwkv": [[4712, " on", "normal", 0.8889968395233154]], "qwen": [[389, " on", "normal", 0.9263618588447571]]}, "loss": {"rwkv": 0.7073761085087893, "qwen": 0.45980081239096365}, "topk": {"rwkv": [4712, 1, 0.8889968395233154, [[4712, 0.888997, " on", false], [32226, 0.072654, " than", false], [32350, 0.016559, " upon", false], [56003, 0.00726, " directly", false], [51919, 0.003581, " heavily", false], [45, 0.00257, ",", false], [275, 0.002065, " (", false], [61983, 0.001637, " explicitly", false], [4596, 0.000435, " in", false], [57327, 0.000383, " strongly", false]]], "qwen": [389, 1, 0.9263618588447571, [[389, 0.926362, " on", false], [1091, 0.018097, " than", false], [16916, 0.015518, " heavily", false], [5193, 0.011774, " upon", false], [5961, 0.005576, " directly", false], [11, 0.004045, ",", false], [320, 0.002729, " (", false], [20975, 0.002665, " explicitly", false], [16510, 0.001793, " strongly", false], [3738, 0.001346, " human", false]]]}, "raw_delta": 0.013728489478429159, "tuned_delta": 0.020540767285527107}, {"byte_start": 3922, "byte_end": 3928, "display": {"text": " human", "kind": "normal"}, "is_word": true, "word_id": 660, "word_key": " human", "bytes_hex": "20 68 75 6d 61 6e", "compression": {"rwkv": "1.06% 1.06% 1.06% 1.06% 1.06% 1.06%", "qwen": "0.68% 0.68% 0.68% 0.68% 0.68% 0.68%"}, "model_tokens": {"rwkv": [[38720, " human", "normal", 0.7045676708221436]], "qwen": [[3738, " human", "normal", 0.7977262735366821]]}, "loss": {"rwkv": 1.0566614069010962, "qwen": 0.6792380897031334}, "topk": {"rwkv": [38720, 1, 0.7045676708221436, [[38720, 0.704568, " human", false], [59943, 0.053962, " knowledge", false], [22590, 0.040797, " the", false], [45775, 0.021129, " domain", false], [52964, 0.014716, " special", false], [21273, 0.014588, " any", false], [65034, 0.012055, " understanding", false], [56179, 0.010619, " explicit", false], [39356, 0.008892, " prior", false], [63875, 0.00887, " specialized", false]]], "qwen": [3738, 1, 0.7977262735366821, [[3738, 0.797726, " human", false], [279, 0.021198, " the", false], [3281, 0.020519, " special", false], [11464, 0.01508, " explicit", false], [894, 0.014222, " any", false], [6540, 0.0102, " knowledge", false], [28464, 0.009826, " statistical", false], [4867, 0.007139, " prior", false], [27076, 0.004095, " specialized", false], [70601, 0.003108, " exploiting", false]]]}, "raw_delta": 0.020928792655467987, "tuned_delta": 0.027741070462565933}, {"byte_start": 3928, "byte_end": 3938, "display": {"text": " knowledge", "kind": "normal"}, "is_word": true, "word_id": 661, "word_key": " knowledge", "bytes_hex": "20 6b 6e 6f 77 6c 65 64 67 65", "compression": {"rwkv": "0.50% 0.50% 0.50% 0.50% 0.50% 0.50% 0.50% 0.50% 0.50% 0.50%", "qwen": "0.48% 0.48% 0.48% 0.48% 0.48% 0.48% 0.48% 0.48% 0.48% 0.48%"}, "model_tokens": {"rwkv": [[59943, " knowledge", "normal", 0.7575711011886597]], "qwen": [[6540, " knowledge", "normal", 0.7678873538970947]]}, "loss": {"rwkv": 0.5036752706228559, "qwen": 0.4762917629958522}, "topk": {"rwkv": [59943, 1, 0.7575711011886597, [[59943, 0.757571, " knowledge", false], [46, 0.094323, "-", false], [65034, 0.080265, " understanding", false], [38786, 0.035867, " input", false], [59683, 0.006336, " expertise", false], [46297, 0.001947, " inputs", false], [63637, 0.001847, " information", false], [45775, 0.001775, " domain", false], [52022, 0.001529, " insight", false], [62182, 0.000955, " linguistic", false]]], "qwen": [6540, 1, 0.7678873538970947, [[6540, 0.767887, " knowledge", false], [12646, 0.131365, "-k", false], [8660, 0.05767, " understanding", false], [1946, 0.018732, " input", false], [18726, 0.002581, " expertise", false], [71107, 0.001571, "-under", false], [1995, 0.000701, " information", false], [7947, 0.000522, " domain", false], [56251, 0.000467, " intuition", false], [12, 0.000397, "-", false]]]}, "raw_delta": 0.0015184640884399435, "tuned_delta": 0.00833074189553789}, {"byte_start": 3938, "byte_end": 3939, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "38.32%", "qwen": "43.23%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.11882831901311874]], "qwen": [[11, ",", "normal", 0.09096557646989822]]}, "loss": {"rwkv": 38.321587023613084, "qwen": 43.23169600531254}, "topk": {"rwkv": [45, 3, 0.11882831901311874, [[32226, 0.472818, " than", false], [21265, 0.148104, " and", false], [45, 0.118828, ",", false], [4706, 0.056397, " of", false], [47, 0.055694, ".", false], [5346, 0.035794, "---", false], [275, 0.023796, " (", false], [37598, 0.017207, " about", false], [4596, 0.01447, " in", false], [60, 0.006332, ";", false]]], "qwen": [11, 3, 0.09096557646989822, [[1091, 0.532951, " than", false], [323, 0.195286, " and", false], [11, 0.090966, ",", false], [315, 0.045367, " of", false], [13, 0.018696, ".", false], [382, 0.016803, ".\n\n", false], [320, 0.015955, " (", false], [911, 0.011983, " about", false], [4421, 0.009853, "---", false], [311, 0.009667, " to", false]]]}, "raw_delta": -0.2722742557525635, "tuned_delta": -0.26546197794546555}, {"byte_start": 3939, "byte_end": 3943, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 662, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"rwkv": "4.19% 4.19% 4.19% 4.19%", "qwen": "3.32% 3.32% 3.32% 3.32%"}, "model_tokens": {"rwkv": [[21265, " and", "normal", 0.3935020864009857]], "qwen": [[323, " and", "normal", 0.4790298044681549]]}, "loss": {"rwkv": 4.191423580707681, "qwen": 3.3181647414095763}, "topk": {"rwkv": [21265, 1, 0.3935020864009857, [[21265, 0.393502, " and", false], [21400, 0.139453, " but", false], [55495, 0.044477, " although", false], [39690, 0.028922, " since", false], [4423, 0.025428, " as", false], [52700, 0.022456, " relying", false], [40186, 0.020736, " which", false], [4596, 0.017916, " in", false], [30788, 0.015737, " even", false], [4788, 0.015698, " so", false]]], "qwen": [323, 1, 0.4790298044681549, [[323, 0.47903, " and", false], [714, 0.071377, " but", false], [476, 0.027249, " or", false], [892, 0.022689, " which", false], [304, 0.019728, " in", false], [1496, 0.017436, " even", false], [438, 0.01599, " as", false], [38561, 0.014133, " relying", false], [7892, 0.013545, " although", false], [525, 0.013027, " are", false]]]}, "raw_delta": 0.048423752188682556, "tuned_delta": 0.055236029995780506}, {"byte_start": 3943, "byte_end": 3947, "display": {"text": " use", "kind": "normal"}, "is_word": true, "word_id": 663, "word_key": " use", "bytes_hex": "20 75 73 65", "compression": {"rwkv": "21.27% 21.27% 21.27% 21.27%", "qwen": "18.30% 18.30% 18.30% 18.30%"}, "model_tokens": {"rwkv": [[22681, " use", "normal", 0.008961284533143044]], "qwen": [[990, " use", "normal", 0.017263662070035934]]}, "loss": {"rwkv": 21.274116325608734, "qwen": 18.300368609106183}, "topk": {"rwkv": [22681, 23, 0.008961284533143044, [[31458, 0.194105, " more", false], [21286, 0.111753, " are", false], [32232, 0.058315, " they", false], [30788, 0.044546, " even", false], [52028, 0.039558, " instead", false], [31059, 0.036987, " have", false], [22590, 0.025199, " the", false], [4596, 0.025115, " in", false], [31856, 0.020697, " rely", false], [4788, 0.017992, " so", false]]], "qwen": [990, 13, 0.017263662070035934, [[803, 0.107137, " more", false], [525, 0.079429, " are", false], [1496, 0.055057, " even", false], [1373, 0.044111, " require", false], [807, 0.043144, " they", false], [4518, 0.037029, " instead", false], [1753, 0.035006, " much", false], [304, 0.031479, " in", false], [614, 0.031112, " have", false], [279, 0.024103, " the", false]]]}, "raw_delta": 0.16489958763122559, "tuned_delta": 0.17171186543832354}, {"byte_start": 3947, "byte_end": 3952, "display": {"text": " even", "kind": "normal"}, "is_word": true, "word_id": 664, "word_key": " even", "bytes_hex": "20 65 76 65 6e", "compression": {"rwkv": "8.68% 8.68% 8.68% 8.68% 8.68%", "qwen": "5.53% 5.53% 5.53% 5.53% 5.53%"}, "model_tokens": {"rwkv": [[30788, " even", "normal", 0.0885762944817543]], "qwen": [[1496, " even", "normal", 0.2160256952047348]]}, "loss": {"rwkv": 8.67871235534767, "qwen": 5.52681297029586}, "topk": {"rwkv": [30788, 2, 0.0885762944817543, [[52195, 0.259482, " massive", false], [30788, 0.088576, " even", false], [31466, 0.075616, " much", false], [31458, 0.074716, " more", false], [63370, 0.058072, " computation", false], [21660, 0.03414, " far", false], [22590, 0.030917, " the", false], [332, 0.029221, " a", false], [31581, 0.022561, " only", false], [59988, 0.016307, " massively", false]]], "qwen": [1496, 1, 0.2160256952047348, [[1496, 0.216026, " even", false], [803, 0.132534, " more", false], [3041, 0.118427, " far", false], [1753, 0.10704, " much", false], [34447, 0.06405, " computation", false], [10951, 0.027769, " massive", false], [264, 0.02091, " a", false], [279, 0.015844, " the", false], [2058, 0.013601, " still", false], [1657, 0.013031, " many", false]]]}, "raw_delta": 0.17477841377258302, "tuned_delta": 0.18159069157968097}, {"byte_start": 3952, "byte_end": 3957, "display": {"text": " more", "kind": "normal"}, "is_word": true, "word_id": 665, "word_key": " more", "bytes_hex": "20 6d 6f 72 65", "compression": {"rwkv": "1.20% 1.20% 1.20% 1.20% 1.20%", "qwen": "0.44% 0.44% 0.44% 0.44% 0.44%"}, "model_tokens": {"rwkv": [[31458, " more", "normal", 0.7148230671882629]], "qwen": [[803, " more", "normal", 0.8862769603729248]]}, "loss": {"rwkv": 1.2045940038672498, "qwen": 0.4354261591556644}, "topk": {"rwkv": [31458, 1, 0.7148230671882629, [[31458, 0.714823, " more", false], [31277, 0.18002, " less", false], [46397, 0.021434, " larger", false], [38475, 0.020979, " fewer", false], [51867, 0.018614, " greater", false], [52195, 0.00622, " massive", false], [31466, 0.005098, " much", false], [45305, 0.004783, " bigger", false], [52932, 0.002955, " smaller", false], [51918, 0.002752, " heavier", false]]], "qwen": [803, 1, 0.8862769603729248, [[803, 0.886277, " more", false], [7046, 0.069768, " greater", false], [8131, 0.011515, " larger", false], [1753, 0.009957, " much", false], [2686, 0.005961, " less", false], [5080, 0.002148, " higher", false], [11243, 0.002051, " bigger", false], [19117, 0.001932, " deeper", false], [16745, 0.000835, " fewer", false], [3041, 0.000817, " far", false]]]}, "raw_delta": 0.04265172183513642, "tuned_delta": 0.04946399964223437}, {"byte_start": 3957, "byte_end": 3969, "display": {"text": " computation", "kind": "normal"}, "is_word": true, "word_id": 666, "word_key": " computation", "bytes_hex": "20 63 6f 6d 70 75 74 61 74 69 6f 6e", "compression": {"rwkv": "0.38% 0.38% 0.38% 0.38% 0.38% 0.38% 0.38% 0.38% 0.38% 0.38% 0.38% 0.38%", "qwen": "0.28% 0.28% 0.28% 0.28% 0.28% 0.28% 0.28% 0.28% 0.28% 0.28% 0.28% 0.28%"}, "model_tokens": {"rwkv": [[63370, " computation", "normal", 0.7772347331047058]], "qwen": [[34447, " computation", "normal", 0.8317679166793823]]}, "loss": {"rwkv": 0.3786370041395595, "qwen": 0.2768198933990527}, "topk": {"rwkv": [63370, 1, 0.7772347331047058, [[63370, 0.777235, " computation", false], [52195, 0.122068, " massive", false], [47202, 0.012902, " search", false], [4706, 0.011183, " of", false], [64862, 0.007744, " computational", false], [59346, 0.007227, " computing", false], [62577, 0.004433, " statistics", false], [56900, 0.004065, " powerful", false], [63885, 0.003947, " statistical", false], [64298, 0.00377, " computations", false]]], "qwen": [34447, 1, 0.8317679166793823, [[34447, 0.831768, " computation", false], [10951, 0.075317, " massive", false], [54480, 0.013324, " computational", false], [315, 0.012591, " of", false], [24231, 0.011308, " computing", false], [7988, 0.004662, " powerful", false], [6366, 0.003931, " computer", false], [63707, 0.00252, " massively", false], [82599, 0.002164, " computations", false], [320, 0.001896, " (", false]]]}, "raw_delta": 0.005645939459403357, "tuned_delta": 0.012458217266501304}, {"byte_start": 3969, "byte_end": 3970, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "15.50%", "qwen": "14.02%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.42279288172721863]], "qwen": [[11, ",", "normal", 0.4596511125564575]]}, "loss": {"rwkv": 15.49770063454941, "qwen": 14.017361042139353}, "topk": {"rwkv": [45, 1, 0.42279288172721863, [[45, 0.422793, ",", false], [47, 0.301978, ".", false], [32226, 0.175649, " than", false], [275, 0.021836, " (", false], [4811, 0.017561, " to", false], [5346, 0.01246, "---", false], [21265, 0.00936, " and", false], [22278, 0.006564, " per", false], [4596, 0.005681, " in", false], [21700, 0.003539, " for", false]]], "qwen": [11, 1, 0.4596511125564575, [[11, 0.459651, ",", false], [13, 0.147939, ".", false], [382, 0.145457, ".\n\n", false], [1091, 0.121472, " than", false], [311, 0.033275, " to", false], [320, 0.017124, " (", false], [4421, 0.013298, "---", false], [323, 0.01034, " and", false], [817, 0.00947, " per", false], [304, 0.007553, " in", false]]]}, "raw_delta": 0.0820874571800232, "tuned_delta": 0.08889973498712114}, {"byte_start": 3970, "byte_end": 3979, "display": {"text": " together", "kind": "normal"}, "is_word": true, "word_id": 667, "word_key": " together", "bytes_hex": "20 74 6f 67 65 74 68 65 72", "compression": {"rwkv": "22.42% 22.42% 22.42% 22.42% 22.42% 22.42% 22.42% 22.42% 22.42%", "qwen": "21.58% 21.58% 21.58% 21.58% 21.58% 21.58% 21.58% 21.58% 21.58%"}, "model_tokens": {"rwkv": [[57435, " together", "normal", 1.3906433196098078e-05]], "qwen": [[3786, " together", "normal", 2.100588972098194e-05]]}, "loss": {"rwkv": 22.41687606936844, "qwen": 21.581732138615322}, "topk": {"rwkv": [57435, 327, 1.3906433196098078e-05, [[32226, 0.460436, " than", false], [21265, 0.158987, " and", false], [21400, 0.138162, " but", false], [4788, 0.05136, " so", false], [4811, 0.040347, " to", false], [40186, 0.022182, " which", false], [4596, 0.012795, " in", false], [22797, 0.012748, " yet", false], [4423, 0.007598, " as", false], [46500, 0.007548, " making", false]]], "qwen": [3786, 322, 2.100588972098194e-05, [[1091, 0.619293, " than", false], [323, 0.154646, " and", false], [311, 0.065051, " to", false], [714, 0.024441, " but", false], [304, 0.014371, " in", false], [773, 0.010733, " so", false], [7707, 0.007883, " compared", false], [892, 0.007188, " which", false], [438, 0.007071, " as", false], [369, 0.004787, " for", false]]]}, "raw_delta": 0.04631021287706161, "tuned_delta": 0.05312249068415956}, {"byte_start": 3979, "byte_end": 3984, "display": {"text": " with", "kind": "normal"}, "is_word": true, "word_id": 668, "word_key": " with", "bytes_hex": "20 77 69 74 68", "compression": {"rwkv": "0.63% 0.63% 0.63% 0.63% 0.63%", "qwen": "0.70% 0.70% 0.70% 0.70% 0.70%"}, "model_tokens": {"rwkv": [[32487, " with", "normal", 0.8388382196426392]], "qwen": [[448, " with", "normal", 0.8225528001785278]]}, "loss": {"rwkv": 0.6339968441406577, "qwen": 0.7045495557269997}, "topk": {"rwkv": [32487, 1, 0.8388382196426392, [[32487, 0.838838, " with", false], [47, 0.027788, ".", false], [4811, 0.014477, " to", false], [57581, 0.009896, " yielding", false], [45, 0.009575, ",", false], [4596, 0.006776, " in", false], [38888, 0.00608, " lever", false], [56109, 0.006042, " enabling", false], [46500, 0.005698, " making", false], [60264, 0.005381, " producing", false]]], "qwen": [448, 1, 0.8225528001785278, [[448, 0.822553, " with", false], [311, 0.044499, " to", false], [11, 0.017739, ",", false], [13, 0.012832, ".", false], [382, 0.012299, ".\n\n", false], [27362, 0.008633, " enabling", false], [304, 0.007544, " in", false], [3259, 0.00511, " making", false], [1091, 0.004741, " than", false], [6388, 0.00336, " leading", false]]]}, "raw_delta": -0.003912273049354556, "tuned_delta": 0.002900004757743391}, {"byte_start": 3984, "byte_end": 3993, "display": {"text": " learning", "kind": "normal"}, "is_word": true, "word_id": 669, "word_key": " learning", "bytes_hex": "20 6c 65 61 72 6e 69 6e 67", "compression": {"rwkv": "7.83% 7.83% 7.83% 7.83% 7.83% 7.83% 7.83% 7.83% 7.83%", "qwen": "7.55% 7.55% 7.55% 7.55% 7.55% 7.55% 7.55% 7.55% 7.55%"}, "model_tokens": {"rwkv": [[56537, " learning", "normal", 0.019966255873441696]], "qwen": [[6832, " learning", "normal", 0.02309095859527588]]}, "loss": {"rwkv": 7.827121532600711, "qwen": 7.550733469424535}, "topk": {"rwkv": [56537, 8, 0.019966255873441696, [[52195, 0.251144, " massive", false], [22590, 0.076326, " the", false], [332, 0.063043, " a", false], [39193, 0.026879, " other", false], [38864, 0.025305, " large", false], [63885, 0.024895, " statistical", false], [31458, 0.023047, " more", false], [56537, 0.019966, " learning", false], [31466, 0.019637, " much", false], [45301, 0.014849, " better", false]]], "qwen": [6832, 7, 0.02309095859527588, [[264, 0.073963, " a", false], [803, 0.049149, " more", false], [279, 0.046292, " the", false], [1753, 0.030189, " much", false], [28464, 0.029183, " statistical", false], [1008, 0.024636, " other", false], [6832, 0.023091, " learning", false], [7988, 0.022235, " powerful", false], [5413, 0.020202, " methods", false], [1602, 0.01773, " very", false]]]}, "raw_delta": 0.015326208538479269, "tuned_delta": 0.022138486345577215}, {"byte_start": 3993, "byte_end": 3996, "display": {"text": " on", "kind": "normal"}, "is_word": true, "word_id": 670, "word_key": " on", "bytes_hex": "20 6f 6e", "compression": {"rwkv": "33.63% 33.63% 33.63%", "qwen": "37.45% 37.45% 37.45%"}, "model_tokens": {"rwkv": [[4712, " on", "normal", 0.0037526472005993128]], "qwen": [[389, " on", "normal", 0.001969738397747278]]}, "loss": {"rwkv": 33.625314104052656, "qwen": 37.44908463925589}, "topk": {"rwkv": [4712, 19, 0.0037526472005993128, [[47, 0.31302, ".", false], [4450, 0.187169, " by", false], [45, 0.138661, ",", false], [30917, 0.077622, " from", false], [4596, 0.031517, " in", false], [4811, 0.031451, " to", false], [61559, 0.024897, " algorithms", false], [21265, 0.022787, " and", false], [52224, 0.017445, " methods", false], [5346, 0.016807, "---", false]]], "qwen": [389, 23, 0.001969738397747278, [[553, 0.332966, " by", false], [11, 0.146714, ",", false], [13, 0.082028, ".", false], [382, 0.066914, ".\n\n", false], [311, 0.0633, " to", false], [504, 0.056364, " from", false], [323, 0.042003, " and", false], [5413, 0.028665, " methods", false], [12538, 0.026802, " techniques", false], [304, 0.026564, " in", false]]]}, "raw_delta": -0.21203486124674487, "tuned_delta": -0.20522258343964692}, {"byte_start": 3996, "byte_end": 4001, "display": {"text": " huge", "kind": "normal"}, "is_word": true, "word_id": 671, "word_key": " huge", "bytes_hex": "20 68 75 67 65", "compression": {"rwkv": "12.00% 12.00% 12.00% 12.00% 12.00%", "qwen": "13.87% 13.87% 13.87% 13.87% 13.87%"}, "model_tokens": {"rwkv": [[31118, " huge", "normal", 0.03614586591720581]], "qwen": [[6765, " huge", "normal", 0.021390043199062347]]}, "loss": {"rwkv": 12.003673582396452, "qwen": 13.867291345757915}, "topk": {"rwkv": [31118, 5, 0.03614586591720581, [[52195, 0.522662, " massive", false], [38864, 0.075508, " large", false], [22590, 0.075121, " the", false], [332, 0.072709, " a", false], [31118, 0.036146, " huge", false], [31466, 0.025598, " much", false], [32386, 0.025235, " very", false], [30579, 0.021335, " data", false], [32373, 0.011405, " vast", false], [4419, 0.010515, " an", false]]], "qwen": [6765, 7, 0.021390043199062347, [[264, 0.206652, " a", false], [656, 0.19224, " self", false], [3460, 0.116152, " large", false], [10951, 0.100546, " massive", false], [279, 0.081583, " the", false], [821, 0.028143, " data", false], [6765, 0.02139, " huge", false], [1753, 0.014829, " much", false], [458, 0.013544, " an", false], [1602, 0.013479, " very", false]]]}, "raw_delta": -0.10334091186523431, "tuned_delta": -0.09652863405813636}, {"byte_start": 4001, "byte_end": 4010, "display": {"text": " training", "kind": "normal"}, "is_word": true, "word_id": 672, "word_key": " training", "bytes_hex": "20 74 72 61 69 6e 69 6e 67", "compression": {"rwkv": "8.83% 8.83% 8.83% 8.83% 8.83% 8.83% 8.83% 8.83% 8.83%", "qwen": "7.17% 7.17% 7.17% 7.17% 7.17% 7.17% 7.17% 7.17% 7.17%"}, "model_tokens": {"rwkv": [[57453, " training", "normal", 0.01212191954255104]], "qwen": [[4862, " training", "normal", 0.027948863804340363]]}, "loss": {"rwkv": 8.828993088773602, "qwen": 7.1681480302589184}, "topk": {"rwkv": [57453, 10, 0.01212191954255104, [[50897, 0.589571, " amounts", false], [55913, 0.09411, " datasets", false], [30579, 0.085907, " data", false], [45588, 0.031936, " corpor", false], [59442, 0.029751, " databases", false], [62426, 0.025191, " quantities", false], [53304, 0.017902, " volumes", false], [45, 0.017816, ",", false], [63344, 0.013823, " collections", false], [57453, 0.012122, " training", false]]], "qwen": [4862, 5, 0.027948863804340363, [[14713, 0.489025, " amounts", false], [29425, 0.179325, " datasets", false], [821, 0.127879, " data", false], [32676, 0.028737, " quantities", false], [4862, 0.027949, " training", false], [8368, 0.022283, " corpor", false], [31806, 0.017646, " databases", false], [11, 0.011832, ",", false], [26282, 0.008516, " volumes", false], [7289, 0.007055, " sets", false]]]}, "raw_delta": 0.09209680557250977, "tuned_delta": 0.09890908337960772}, {"byte_start": 4010, "byte_end": 4015, "display": {"text": " sets", "kind": "normal"}, "is_word": true, "word_id": 673, "word_key": " sets", "bytes_hex": "20 73 65 74 73", "compression": {"rwkv": "2.49% 2.49% 2.49% 2.49% 2.49%", "qwen": "1.70% 1.70% 1.70% 1.70% 1.70%"}, "model_tokens": {"rwkv": [[31989, " sets", "normal", 0.5016396045684814]], "qwen": [[7289, " sets", "normal", 0.6247401833534241]]}, "loss": {"rwkv": 2.4937209202865867, "qwen": 1.6966794711376174}, "topk": {"rwkv": [31989, 1, 0.5016396045684814, [[31989, 0.50164, " sets", false], [30579, 0.234032, " data", false], [55913, 0.153342, " datasets", false], [45588, 0.075641, " corpor", false], [59442, 0.012919, " databases", false], [63344, 0.004689, " collections", false], [52800, 0.00466, " samples", false], [56162, 0.001739, " examples", false], [45590, 0.00138, " corpus", false], [21265, 0.001132, " and", false]]], "qwen": [7289, 1, 0.6247401833534241, [[7289, 0.62474, " sets", false], [821, 0.205242, " data", false], [29425, 0.120632, " datasets", false], [8368, 0.01474, " corpor", false], [31806, 0.006376, " databases", false], [10469, 0.004582, " samples", false], [10295, 0.003663, " examples", false], [323, 0.003389, " and", false], [738, 0.002761, " set", false], [15302, 0.001929, " collections", false]]]}, "raw_delta": 0.04419736266136169, "tuned_delta": 0.05100964046845964}, {"byte_start": 4015, "byte_end": 4016, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "36.63%", "qwen": "25.69%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.13274477422237396]], "qwen": [[11, ",", "normal", 0.24055695533752441]]}, "loss": {"rwkv": 36.63092877257133, "qwen": 25.694371422421927}, "topk": {"rwkv": [45, 2, 0.13274477422237396, [[47, 0.605503, ".", false], [45, 0.132745, ",", false], [4706, 0.119399, " of", false], [32227, 0.023762, " that", false], [275, 0.018305, " (", false], [21265, 0.013393, " and", false], [5346, 0.013082, "---", false], [4811, 0.012168, " to", false], [30917, 0.008171, " from", false], [4596, 0.004749, " in", false]]], "qwen": [11, 2, 0.24055695533752441, [[13, 0.279001, ".", false], [11, 0.240557, ",", false], [382, 0.232527, ".\n\n", false], [311, 0.071379, " to", false], [315, 0.041802, " of", false], [320, 0.027236, " (", false], [323, 0.025563, " and", false], [429, 0.01288, " that", false], [304, 0.007643, " in", false], [4421, 0.006589, "---", false]]]}, "raw_delta": 0.6064515113830566, "tuned_delta": 0.6132637891901546}, {"byte_start": 4016, "byte_end": 4019, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 674, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "5.68% 5.68% 5.68%", "qwen": "5.31% 5.31% 5.31%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.3835894763469696]], "qwen": [[311, " to", "normal", 0.4131651222705841]]}, "loss": {"rwkv": 5.682490232668117, "qwen": 5.313373543145382}, "topk": {"rwkv": [4811, 1, 0.3835894763469696, [[4811, 0.383589, " to", false], [21265, 0.17362, " and", false], [32226, 0.075228, " than", false], [4788, 0.046766, " so", false], [21400, 0.042778, " but", false], [40186, 0.04002, " which", false], [4596, 0.024924, " in", false], [4423, 0.018978, " as", false], [21700, 0.014156, " for", false], [30322, 0.006928, " both", false]]], "qwen": [311, 1, 0.4131651222705841, [[311, 0.413165, " to", false], [1091, 0.289355, " than", false], [323, 0.077884, " and", false], [304, 0.044376, " in", false], [892, 0.016596, " which", false], [773, 0.008746, " so", false], [429, 0.00852, " that", false], [438, 0.008271, " as", false], [369, 0.007668, " for", false], [714, 0.007464, " but", false]]]}, "raw_delta": 0.020468175411224365, "tuned_delta": 0.02728045321832231}, {"byte_start": 4019, "byte_end": 4027, "display": {"text": " produce", "kind": "normal"}, "is_word": true, "word_id": 675, "word_key": " produce", "bytes_hex": "20 70 72 6f 64 75 63 65", "compression": {"rwkv": "7.01% 7.01% 7.01% 7.01% 7.01% 7.01% 7.01% 7.01%", "qwen": "6.17% 6.17% 6.17% 6.17% 6.17% 6.17% 6.17% 6.17%"}, "model_tokens": {"rwkv": [[52573, " produce", "normal", 0.04442165791988373]], "qwen": [[8193, " produce", "normal", 0.06479889154434204]]}, "loss": {"rwkv": 7.009187332443938, "qwen": 6.168573756231406}, "topk": {"rwkv": [52573, 3, 0.04442165791988373, [[50848, 0.172778, " achieve", false], [31358, 0.064503, " make", false], [52573, 0.044422, " produce", false], [51982, 0.040168, " improve", false], [22249, 0.03758, " out", false], [4491, 0.026901, " do", false], [45851, 0.024691, " enable", false], [30256, 0.022928, " beat", false], [39740, 0.017962, " solve", false], [52597, 0.017603, " provide", false]]], "qwen": [8193, 2, 0.06479889154434204, [[11075, 0.208723, " achieve", false], [8193, 0.064799, " produce", false], [1281, 0.043523, " make", false], [700, 0.042999, " out", false], [9382, 0.038458, " beat", false], [7269, 0.036169, " improve", false], [653, 0.031651, " do", false], [2736, 0.031527, " perform", false], [11625, 0.023982, " solve", false], [3960, 0.021608, " learn", false]]]}, "raw_delta": 0.04661351442337036, "tuned_delta": 0.05342579223046831}, {"byte_start": 4027, "byte_end": 4040, "display": {"text": " dramatically", "kind": "normal"}, "is_word": true, "word_id": 676, "word_key": " dramatically", "bytes_hex": "20 64 72 61 6d 61 74 69 63 61 6c 6c 79", "compression": {"rwkv": "7.80% 7.80% 7.80% 7.80% 7.80% 7.80% 7.80% 7.80% 7.80% 7.80% 7.80% 7.80% 7.80%", "qwen": "6.95% 6.95% 6.95% 6.95% 6.95% 6.95% 6.95% 6.95% 6.95% 6.95% 6.95% 6.95% 6.95%"}, "model_tokens": {"rwkv": [[64374, " dramatically", "normal", 0.003586248029023409]], "qwen": [[27957, " dramatically", "normal", 0.006656334735453129]]}, "loss": {"rwkv": 7.803038081731168, "qwen": 6.952938422064054}, "topk": {"rwkv": [64374, 48, 0.003586248029023409, [[45301, 0.071216, " better", false], [22590, 0.065709, " the", false], [62084, 0.057952, " impressive", false], [52738, 0.057304, " results", false], [39802, 0.049907, " state", false], [32386, 0.044161, " very", false], [30992, 0.037509, " good", false], [31466, 0.029256, " much", false], [30789, 0.028708, " ever", false], [59660, 0.020758, " excellent", false]]], "qwen": [27957, 33, 0.006656334735453129, [[1584, 0.126618, " state", false], [2664, 0.055133, " better", false], [15978, 0.047918, " impressive", false], [3059, 0.047126, " results", false], [279, 0.040378, " the", false], [1602, 0.028198, " very", false], [9073, 0.027886, " excellent", false], [22804, 0.027785, " remarkable", false], [264, 0.025321, " a", false], [5942, 0.022768, " systems", false]]]}, "raw_delta": 0.04713953458345854, "tuned_delta": 0.05395181239055649}, {"byte_start": 4040, "byte_end": 4047, "display": {"text": " better", "kind": "normal"}, "is_word": true, "word_id": 677, "word_key": " better", "bytes_hex": "20 62 65 74 74 65 72", "compression": {"rwkv": "1.45% 1.45% 1.45% 1.45% 1.45% 1.45% 1.45%", "qwen": "1.41% 1.41% 1.41% 1.41% 1.41% 1.41% 1.41%"}, "model_tokens": {"rwkv": [[45301, " better", "normal", 0.5672803521156311]], "qwen": [[2664, " better", "normal", 0.5791397094726562]]}, "loss": {"rwkv": 1.4491356437500749, "qwen": 1.4071724911633026}, "topk": {"rwkv": [45301, 1, 0.5672803521156311, [[45301, 0.56728, " better", false], [56418, 0.233227, " improved", false], [31458, 0.077884, " more", false], [57350, 0.045865, " superior", false], [46198, 0.019862, " higher", false], [51867, 0.00997, " greater", false], [57326, 0.004041, " stronger", false], [62603, 0.00386, " successful", false], [59593, 0.003852, " effective", false], [30992, 0.003526, " good", false]]], "qwen": [2664, 1, 0.5791397094726562, [[2664, 0.57914, " better", false], [12944, 0.182639, " improved", false], [803, 0.081216, " more", false], [16353, 0.067956, " superior", false], [5080, 0.019567, " higher", false], [7046, 0.011218, " greater", false], [7172, 0.005289, " increased", false], [700, 0.005247, " out", false], [4722, 0.005004, " lower", false], [6849, 0.004503, " successful", false]]]}, "raw_delta": 0.0023269312722342395, "tuned_delta": 0.009139209079332185}, {"byte_start": 4047, "byte_end": 4054, "display": {"text": " speech", "kind": "normal"}, "is_word": true, "word_id": 678, "word_key": " speech", "bytes_hex": "20 73 70 65 65 63 68", "compression": {"rwkv": "6.84% 6.84% 6.84% 6.84% 6.84% 6.84% 6.84%", "qwen": "6.50% 6.50% 6.50% 6.50% 6.50% 6.50% 6.50%"}, "model_tokens": {"rwkv": [[47350, " speech", "normal", 0.06974088400602341]], "qwen": [[8806, " speech", "normal", 0.08017592877149582]]}, "loss": {"rwkv": 6.843140539930907, "qwen": 6.501226745540583}, "topk": {"rwkv": [47350, 3, 0.06974088400602341, [[52738, 0.459729, " results", false], [63750, 0.341999, " performance", false], [47350, 0.069741, " speech", false], [53087, 0.035582, " systems", false], [63821, 0.015172, " recognition", false], [52224, 0.007639, " methods", false], [55434, 0.005708, " accuracy", false], [46587, 0.005508, " models", false], [32497, 0.004431, " word", false], [56529, 0.003576, " language", false]]], "qwen": [8806, 3, 0.08017592877149582, [[3059, 0.494967, " results", false], [5068, 0.302497, " performance", false], [8806, 0.080176, " speech", false], [17843, 0.031126, " recognition", false], [5942, 0.018468, " systems", false], [4119, 0.010573, " models", false], [23675, 0.008674, " performances", false], [13403, 0.006383, " accuracy", false], [8084, 0.002414, " overall", false], [12205, 0.002009, " scores", false]]]}, "raw_delta": 0.018959726606096516, "tuned_delta": 0.025772004413194462}, {"byte_start": 4054, "byte_end": 4066, "display": {"text": " recognition", "kind": "normal"}, "is_word": true, "word_id": 679, "word_key": " recognition", "bytes_hex": "20 72 65 63 6f 67 6e 69 74 69 6f 6e", "compression": {"rwkv": "0.20% 0.20% 0.20% 0.20% 0.20% 0.20% 0.20% 0.20% 0.20% 0.20% 0.20% 0.20%", "qwen": "0.31% 0.31% 0.31% 0.31% 0.31% 0.31% 0.31% 0.31% 0.31% 0.31% 0.31% 0.31%"}, "model_tokens": {"rwkv": [[63821, " recognition", "normal", 0.8774782419204712]], "qwen": [[17843, " recognition", "normal", 0.8116647601127625]]}, "loss": {"rwkv": 0.19518884321923022, "qwen": 0.3135876343703854}, "topk": {"rwkv": [63821, 1, 0.8774782419204712, [[63821, 0.877478, " recognition", false], [46, 0.064021, "-", false], [60335, 0.015446, " recognize", false], [65034, 0.013321, " understanding", false], [53087, 0.008489, " systems", false], [62378, 0.003668, " processing", false], [21265, 0.002872, " and", false], [46587, 0.002378, " models", false], [64591, 0.001178, " technologies", false], [62634, 0.000823, " technology", false]]], "qwen": [17843, 1, 0.8116647601127625, [[17843, 0.811665, " recognition", false], [59172, 0.117195, "-rec", false], [5829, 0.02908, " recogn", false], [12, 0.015159, "-", false], [323, 0.003871, " and", false], [4686, 0.00245, "-to", false], [5504, 0.001691, "-re", false], [45840, 0.001459, " transcription", false], [8660, 0.001436, " understanding", false], [93159, 0.001286, " recognizer", false]]]}, "raw_delta": -0.006565423061450322, "tuned_delta": 0.0002468547456476247}, {"byte_start": 4066, "byte_end": 4074, "display": {"text": " systems", "kind": "normal"}, "is_word": true, "word_id": 680, "word_key": " systems", "bytes_hex": "20 73 79 73 74 65 6d 73", "compression": {"rwkv": "2.38% 2.38% 2.38% 2.38% 2.38% 2.38% 2.38% 2.38%", "qwen": "2.70% 2.70% 2.70% 2.70% 2.70% 2.70% 2.70% 2.70%"}, "model_tokens": {"rwkv": [[53087, " systems", "normal", 0.3466980755329132]], "qwen": [[5942, " systems", "normal", 0.3021843433380127]]}, "loss": {"rwkv": 2.3774881655274664, "qwen": 2.6976548304941583}, "topk": {"rwkv": [53087, 1, 0.3466980755329132, [[53087, 0.346698, " systems", false], [47, 0.225119, ".", false], [63750, 0.136223, " performance", false], [32226, 0.08005, " than", false], [52738, 0.069975, " results", false], [55434, 0.017668, " accuracy", false], [45, 0.017125, ",", false], [21265, 0.016375, " and", false], [51616, 0.013343, " engines", false], [46587, 0.009076, " models", false]]], "qwen": [5942, 1, 0.3021843433380127, [[5942, 0.302184, " systems", false], [1091, 0.180007, " than", false], [5068, 0.14868, " performance", false], [3059, 0.097481, " results", false], [13, 0.070357, ".", false], [382, 0.070091, ".\n\n", false], [13403, 0.015708, " accuracy", false], [11, 0.015176, ",", false], [323, 0.009859, " and", false], [12205, 0.008681, " scores", false]]]}, "raw_delta": -0.017753809690475464, "tuned_delta": -0.010941531883377518}, {"byte_start": 4074, "byte_end": 4075, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "5.78%", "qwen": "24.80%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.7246266007423401]], "qwen": [[13, ".", "normal", 0.25276753306388855]]}, "loss": {"rwkv": 5.776415691059325, "qwen": 24.80146114675672}, "topk": {"rwkv": [47, 1, 0.7246266007423401, [[47, 0.724627, ".", false], [32226, 0.184073, " than", false], [45, 0.027435, ",", false], [275, 0.008112, " (", false], [32227, 0.006617, " that", false], [5346, 0.006228, "---", false], [21265, 0.00594, " and", false], [4596, 0.005286, " in", false], [39971, 0.004394, " today", false], [21700, 0.003962, " for", false]]], "qwen": [13, 3, 0.25276753306388855, [[1091, 0.349262, " than", false], [382, 0.288776, ".\n\n", false], [13, 0.252768, ".", false], [11, 0.031671, ",", false], [320, 0.011297, " (", false], [304, 0.010227, " in", false], [624, 0.006941, ".\n", false], [429, 0.005702, " that", false], [4421, 0.005591, "---", false], [3351, 0.003167, " today", false]]]}, "raw_delta": -1.054972529411316, "tuned_delta": -1.0481602516042179}, {"byte_start": 4075, "byte_end": 4078, "display": {"text": " As", "kind": "normal"}, "is_word": true, "word_id": 681, "word_key": " as", "bytes_hex": "20 41 73", "compression": {"rwkv": "31.56% 31.56% 31.56%", "qwen": "25.03% 25.03% 25.03%"}, "model_tokens": {"rwkv": [[3641, " As", "normal", 0.005294226575642824]], "qwen": [[1634, " As", "normal", 0.015550422482192516]]}, "loss": {"rwkv": 31.55895401944607, "qwen": 25.028761300675168}, "topk": {"rwkv": [3641, 15, 0.005294226575642824, [[261, 0.673204, "\n\n", false], [20996, 0.040679, " The", false], [267, 0.028602, "  ", false], [29894, 0.016226, " This", false], [3913, 0.015558, " In", false], [3918, 0.012737, " It", false], [36251, 0.01138, " Again", false], [275, 0.009703, " (", false], [37453, 0.009239, " These", false], [28753, 0.008288, " Deep", false]]], "qwen": [1634, 11, 0.015550422482192516, [[576, 0.121241, " The", false], [220, 0.096089, " ", false], [1096, 0.088579, " This", false], [758, 0.065973, " In", false], [1084, 0.043178, " It", false], [18183, 0.032035, " Deep", false], [4220, 0.031349, " These", false], [2619, 0.029938, " There", false], [320, 0.023987, " (", false], [362, 0.016137, " A", false]]]}, "raw_delta": 0.3621107737223308, "tuned_delta": 0.3689230515294287}, {"byte_start": 4078, "byte_end": 4081, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 682, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "7.89% 7.89% 7.89%", "qwen": "7.85% 7.85% 7.85%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.268065869808197]], "qwen": [[304, " in", "normal", 0.27106383442878723]]}, "loss": {"rwkv": 7.889738504861517, "qwen": 7.847064593021805}, "topk": {"rwkv": [4596, 2, 0.268065869808197, [[32487, 0.278007, " with", false], [4596, 0.268066, " in", false], [332, 0.05145, " a", false], [22590, 0.037723, " the", false], [45150, 0.025453, " always", false], [45285, 0.015678, " before", false], [21700, 0.015058, " for", false], [30597, 0.014064, " deep", false], [47350, 0.013962, " speech", false], [4858, 0.012858, " we", false]]], "qwen": [304, 1, 0.27106383442878723, [[304, 0.271064, " in", false], [448, 0.141271, " with", false], [264, 0.106352, " a", false], [279, 0.039938, " the", false], [582, 0.020754, " we", false], [315, 0.019944, " of", false], [374, 0.018514, " is", false], [369, 0.016189, " for", false], [419, 0.014837, " this", false], [458, 0.012199, " an", false]]]}, "raw_delta": 0.0023663441340128766, "tuned_delta": 0.009178621941110823}, {"byte_start": 4081, "byte_end": 4085, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 683, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "8.17% 8.17% 8.17% 8.17%", "qwen": "8.97% 8.97% 8.97% 8.97%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.16366635262966156]], "qwen": [[279, " the", "normal", 0.13674281537532806]]}, "loss": {"rwkv": 8.171514880035144, "qwen": 8.970197473629971}, "topk": {"rwkv": [22590, 3, 0.16366635262966156, [[55809, 0.380032, " computer", false], [38013, 0.202131, " chess", false], [22590, 0.163666, " the", false], [3851, 0.052298, " Go", false], [39193, 0.049212, " other", false], [31370, 0.023334, " many", false], [21256, 0.018791, " all", false], [30322, 0.010496, " both", false], [3609, 0.010038, " AI", false], [56926, 0.009684, " previous", false]]], "qwen": [279, 3, 0.13674281537532806, [[6366, 0.37974, " computer", false], [5994, 0.182268, " Go", false], [279, 0.136743, " the", false], [32719, 0.101986, " chess", false], [1008, 0.060014, " other", false], [678, 0.031429, " all", false], [1657, 0.026397, " many", false], [8806, 0.014696, " speech", false], [5810, 0.004728, " natural", false], [773, 0.004164, " so", false]]]}, "raw_delta": -0.04428836703300476, "tuned_delta": -0.03747608922590681}, {"byte_start": 4085, "byte_end": 4091, "display": {"text": " games", "kind": "normal"}, "is_word": true, "word_id": 684, "word_key": " games", "bytes_hex": "20 67 61 6d 65 73", "compression": {"rwkv": "15.59% 15.59% 15.59% 15.59% 15.59% 15.59%", "qwen": "18.95% 18.95% 18.95% 18.95% 18.95% 18.95%"}, "model_tokens": {"rwkv": [[38576, " games", "normal", 0.005567724350839853]], "qwen": [[3868, " games", "normal", 0.0018289807485416532]]}, "loss": {"rwkv": 15.591626092940619, "qwen": 18.947384539917156}, "topk": {"rwkv": [38576, 18, 0.005567724350839853, [[39193, 0.346283, " other", false], [51551, 0.094811, " earlier", false], [38013, 0.091264, " chess", false], [30405, 0.080848, " case", false], [56926, 0.067201, " previous", false], [22638, 0.050122, " two", false], [55809, 0.045286, " computer", false], [37970, 0.033283, " cases", false], [3851, 0.014663, " Go", false], [56162, 0.01163, " examples", false]]], "qwen": [3868, 27, 0.0018289807485416532, [[1142, 0.338963, " case", false], [1008, 0.280844, " other", false], [6788, 0.07526, " earlier", false], [5994, 0.053692, " Go", false], [5048, 0.035354, " cases", false], [3681, 0.027521, " previous", false], [6366, 0.026768, " computer", false], [32719, 0.01479, " chess", false], [2070, 0.011252, " field", false], [4124, 0.01084, " early", false]]]}, "raw_delta": -0.18608276049296057, "tuned_delta": -0.17927048268586263}, {"byte_start": 4091, "byte_end": 4092, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "13.24%", "qwen": "13.51%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.4786360561847687]], "qwen": [[11, ",", "normal", 0.472660630941391]]}, "loss": {"rwkv": 13.243489633160404, "qwen": 13.514041990582097}, "topk": {"rwkv": [45, 1, 0.4786360561847687, [[45, 0.478636, ",", false], [4706, 0.146054, " of", false], [37599, 0.074151, " above", false], [21265, 0.063886, " and", false], [60003, 0.053267, " mentioned", false], [59546, 0.021996, " discussed", false], [56162, 0.017528, " examples", false], [31198, 0.012207, " just", false], [37970, 0.011742, " cases", false], [59488, 0.009408, " described", false]]], "qwen": [11, 1, 0.472660630941391, [[11, 0.472661, ",", false], [323, 0.207851, " and", false], [315, 0.160039, " of", false], [9733, 0.033301, " mentioned", false], [3403, 0.018764, " above", false], [14078, 0.015981, " discussed", false], [7947, 0.012767, " domain", false], [2070, 0.006106, " field", false], [7481, 0.005491, " described", false], [3110, 0.005347, " example", false]]]}, "raw_delta": -0.015002608299255371, "tuned_delta": -0.008190330492157425}, {"byte_start": 4092, "byte_end": 4104, "display": {"text": " researchers", "kind": "normal"}, "is_word": true, "word_id": 685, "word_key": " researchers", "bytes_hex": "20 72 65 73 65 61 72 63 68 65 72 73", "compression": {"rwkv": "5.82% 5.82% 5.82% 5.82% 5.82% 5.82% 5.82% 5.82% 5.82% 5.82% 5.82% 5.82%", "qwen": "6.37% 6.37% 6.37% 6.37% 6.37% 6.37% 6.37% 6.37% 6.37% 6.37% 6.37% 6.37%"}, "model_tokens": {"rwkv": [[63843, " researchers", "normal", 0.020743323490023613]], "qwen": [[11811, " researchers", "normal", 0.014395827427506447]]}, "loss": {"rwkv": 5.8233784202549295, "qwen": 6.3731309960591975}, "topk": {"rwkv": [63843, 9, 0.020743323490023613, [[22590, 0.323975, " the", false], [39934, 0.062611, " there", false], [4601, 0.055943, " it", false], [32234, 0.050356, " this", false], [38720, 0.042631, " human", false], [39936, 0.04171, " these", false], [56537, 0.030676, " learning", false], [30597, 0.030355, " deep", false], [63843, 0.020743, " researchers", false], [47202, 0.018919, " search", false]]], "qwen": [11811, 14, 0.014395827427506447, [[279, 0.297215, " the", false], [1052, 0.067666, " there", false], [419, 0.066505, " this", false], [432, 0.041822, " it", false], [304, 0.040851, " in", false], [3738, 0.033822, " human", false], [323, 0.022787, " and", false], [2711, 0.02126, " search", false], [264, 0.019594, " a", false], [6832, 0.018681, " learning", false]]]}, "raw_delta": -0.030484755833943666, "tuned_delta": -0.02367247802684572}, {"byte_start": 4104, "byte_end": 4111, "display": {"text": " always", "kind": "normal"}, "is_word": true, "word_id": 686, "word_key": " always", "bytes_hex": "20 61 6c 77 61 79 73", "compression": {"rwkv": "22.38% 22.38% 22.38% 22.38% 22.38% 22.38% 22.38%", "qwen": "22.92% 22.92% 22.92% 22.92% 22.92% 22.92% 22.92%"}, "model_tokens": {"rwkv": [[45150, " always", "normal", 0.00016837031580507755]], "qwen": [[2677, " always", "normal", 0.0001365811040159315]]}, "loss": {"rwkv": 22.381094942362264, "qwen": 22.924918825760535}, "topk": {"rwkv": [45150, 246, 0.00016837031580507755, [[40, 0.229051, "'", false], [22762, 0.203091, " who", false], [32462, 0.050163, " were", false], [59868, 0.037248, " initially", false], [4596, 0.034767, " in", false], [31059, 0.034657, " have", false], [21286, 0.034008, " are", false], [32487, 0.020336, " with", false], [4424, 0.017072, " at", false], [21795, 0.014331, " had", false]]], "qwen": [2677, 263, 0.0001365811040159315, [[6, 0.21676, "'", false], [879, 0.110363, " who", false], [15102, 0.091388, " initially", false], [304, 0.081451, " in", false], [1033, 0.065001, " were", false], [1030, 0.022644, " had", false], [614, 0.022178, " have", false], [525, 0.016846, " are", false], [9498, 0.013413, " learned", false], [6009, 0.011756, " began", false]]]}, "raw_delta": -0.030155999319893878, "tuned_delta": -0.023343721512795932}, {"byte_start": 4111, "byte_end": 4117, "display": {"text": " tried", "kind": "normal"}, "is_word": true, "word_id": 687, "word_key": " tried", "bytes_hex": "20 74 72 69 65 64", "compression": {"rwkv": "13.99% 13.99% 13.99% 13.99% 13.99% 13.99%", "qwen": "9.37% 9.37% 9.37% 9.37% 9.37% 9.37%"}, "model_tokens": {"rwkv": [[40013, " tried", "normal", 0.009444245137274265]], "qwen": [[6679, " tried", "normal", 0.04428163915872574]]}, "loss": {"rwkv": 13.994893300290073, "qwen": 9.369057308579267}, "topk": {"rwkv": [40013, 21, 0.009444245137274265, [[31059, 0.048877, " have", false], [21795, 0.04799, " had", false], [47763, 0.040149, " wanted", false], [31967, 0.030418, " seem", false], [32435, 0.027003, " want", false], [55800, 0.026306, " complain", false], [47211, 0.024234, " seemed", false], [32216, 0.023774, " tend", false], [22441, 0.022308, " say", false], [38709, 0.017319, " hoped", false]]], "qwen": [6679, 4, 0.04428163915872574, [[4829, 0.168017, " wanted", false], [1030, 0.070548, " had", false], [3381, 0.049538, " thought", false], [6679, 0.044282, " tried", false], [6966, 0.036923, " looked", false], [9324, 0.036395, " seemed", false], [11585, 0.032255, " believed", false], [2803, 0.022574, " seem", false], [14890, 0.019978, " preferred", false], [3855, 0.018211, " started", false]]]}, "raw_delta": 0.2565108140309651, "tuned_delta": 0.263323091838063}, {"byte_start": 4117, "byte_end": 4120, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 688, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "1.51% 1.51% 1.51%", "qwen": "1.01% 1.01% 1.01%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.7751625180244446]], "qwen": [[311, " to", "normal", 0.8456106185913086]]}, "loss": {"rwkv": 1.514548016558238, "qwen": 1.0080607221046183}, "topk": {"rwkv": [4811, 1, 0.7751625180244446, [[4811, 0.775163, " to", false], [22590, 0.03347, " the", false], [52224, 0.025909, " methods", false], [38720, 0.017968, " human", false], [39931, 0.012495, " their", false], [22249, 0.011287, " out", false], [21700, 0.008619, " for", false], [45, 0.008197, ",", false], [46162, 0.007944, " harder", false], [31048, 0.007349, " hard", false]]], "qwen": [311, 1, 0.8456106185913086, [[311, 0.845611, " to", false], [1156, 0.02425, " first", false], [3738, 0.017506, " human", false], [369, 0.011429, " for", false], [5413, 0.009274, " methods", false], [2588, 0.007665, " hard", false], [279, 0.006218, " the", false], [862, 0.005177, " their", false], [11, 0.004996, ",", false], [15750, 0.004074, " harder", false]]]}, "raw_delta": 0.0280856192111969, "tuned_delta": 0.03489789701829485}, {"byte_start": 4120, "byte_end": 4125, "display": {"text": " make", "kind": "normal"}, "is_word": true, "word_id": 689, "word_key": " make", "bytes_hex": "20 6d 61 6b 65", "compression": {"rwkv": "13.58% 13.58% 13.58% 13.58% 13.58%", "qwen": "12.03% 12.03% 12.03% 12.03% 12.03%"}, "model_tokens": {"rwkv": [[31358, " make", "normal", 0.023116925731301308]], "qwen": [[1281, " make", "normal", 0.035619549453258514]]}, "loss": {"rwkv": 13.581621283368756, "qwen": 12.027967851657332}, "topk": {"rwkv": [31358, 10, 0.023116925731301308, [[22681, 0.07581, " use", false], [30858, 0.062414, " find", false], [56540, 0.038126, " leverage", false], [32187, 0.036828, " take", false], [21751, 0.032398, " get", false], [37786, 0.031662, " avoid", false], [51982, 0.03055, " improve", false], [63623, 0.026955, " incorporate", false], [37730, 0.02675, " apply", false], [31358, 0.023117, " make", false]]], "qwen": [1281, 5, 0.035619549453258514, [[5648, 0.15674, " avoid", false], [32064, 0.111753, " leverage", false], [990, 0.087157, " use", false], [1896, 0.074023, " take", false], [1281, 0.03562, " make", false], [653, 0.034822, " do", false], [1477, 0.031611, " find", false], [32194, 0.024721, " exploit", false], [3164, 0.023025, " win", false], [633, 0.018305, " get", false]]]}, "raw_delta": 0.08615283966064458, "tuned_delta": 0.09296511746774253}, {"byte_start": 4125, "byte_end": 4133, "display": {"text": " systems", "kind": "normal"}, "is_word": true, "word_id": 690, "word_key": " systems", "bytes_hex": "20 73 79 73 74 65 6d 73", "compression": {"rwkv": "12.54% 12.54% 12.54% 12.54% 12.54% 12.54% 12.54% 12.54%", "qwen": "12.37% 12.37% 12.37% 12.37% 12.37% 12.37% 12.37% 12.37%"}, "model_tokens": {"rwkv": [[53087, " systems", "normal", 0.003799552796408534]], "qwen": [[5942, " systems", "normal", 0.00414033979177475]]}, "loss": {"rwkv": 12.539048695226342, "qwen": 12.368805218920382}, "topk": {"rwkv": [53087, 24, 0.003799552796408534, [[39931, 0.283851, " their", false], [22590, 0.185876, " the", false], [22681, 0.091865, " use", false], [38720, 0.052963, " human", false], [332, 0.047065, " a", false], [52224, 0.019942, " methods", false], [4601, 0.019816, " it", false], [47350, 0.018288, " speech", false], [32157, 0.018185, " sure", false], [39631, 0.018107, " sense", false]]], "qwen": [5942, 23, 0.00414033979177475, [[279, 0.224454, " the", false], [862, 0.147851, " their", false], [990, 0.093358, " use", false], [8806, 0.070922, " speech", false], [264, 0.043604, " a", false], [5098, 0.03824, " progress", false], [2664, 0.030784, " better", false], [5413, 0.026733, " methods", false], [653, 0.021345, " do", false], [3738, 0.020873, " human", false]]]}, "raw_delta": 0.009440302848815918, "tuned_delta": 0.016252580655913864}, {"byte_start": 4133, "byte_end": 4138, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 691, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"rwkv": "2.00% 2.00% 2.00% 2.00% 2.00%", "qwen": "2.36% 2.36% 2.36% 2.36% 2.36%"}, "model_tokens": {"rwkv": [[32227, " that", "normal", 0.5782291889190674]], "qwen": [[429, " that", "normal", 0.5194821357727051]]}, "loss": {"rwkv": 2.0006122637327417, "qwen": 2.3621350593066297}, "topk": {"rwkv": [32227, 1, 0.5782291889190674, [[32227, 0.578229, " that", false], [37810, 0.102704, " based", false], [32499, 0.03763, " work", false], [31458, 0.029833, " more", false], [32487, 0.029418, " with", false], [45301, 0.026531, " better", false], [40085, 0.016307, " using", false], [21700, 0.011903, " for", false], [4491, 0.010478, " do", false], [4423, 0.009184, " as", false]]], "qwen": [429, 1, 0.5194821357727051, [[429, 0.519482, " that", false], [3118, 0.150236, " based", false], [2664, 0.058277, " better", false], [803, 0.051618, " more", false], [448, 0.026351, " with", false], [975, 0.020437, " work", false], [9902, 0.015163, " ``", false], [1667, 0.007924, " using", false], [438, 0.006488, " as", false], [369, 0.006078, " for", false]]]}, "raw_delta": -0.020047080516815197, "tuned_delta": -0.01323480270971725}, {"byte_start": 4138, "byte_end": 4145, "display": {"text": " worked", "kind": "normal"}, "is_word": true, "word_id": 692, "word_key": " worked", "bytes_hex": "20 77 6f 72 6b 65 64", "compression": {"rwkv": "7.29% 7.29% 7.29% 7.29% 7.29% 7.29% 7.29%", "qwen": "8.39% 8.39% 8.39% 8.39% 8.39% 8.39% 8.39%"}, "model_tokens": {"rwkv": [[47812, " worked", "normal", 0.05958038941025734]], "qwen": [[6439, " worked", "normal", 0.03847305104136467]]}, "loss": {"rwkv": 7.2859319866323204, "qwen": 8.392871293065653}, "topk": {"rwkv": [47812, 6, 0.05958038941025734, [[32462, 0.125295, " were", false], [32354, 0.100851, " used", false], [38128, 0.092949, " could", false], [40219, 0.08355, " would", false], [21532, 0.073023, " did", false], [47812, 0.05958, " worked", false], [47054, 0.048828, " relied", false], [32272, 0.028311, " took", false], [56540, 0.02266, " leverage", false], [31351, 0.018014, " made", false]]], "qwen": [6439, 8, 0.03847305104136467, [[1033, 0.177715, " were", false], [1035, 0.086483, " would", false], [3867, 0.082084, " took", false], [1483, 0.047169, " used", false], [39913, 0.046838, " relied", false], [1410, 0.041457, " could", false], [27505, 0.03997, " lever", false], [6439, 0.038473, " worked", false], [1521, 0.032498, " did", false], [50663, 0.028108, " exploited", false]]]}, "raw_delta": -0.06138174874441965, "tuned_delta": -0.0545694709373217}, {"byte_start": 4145, "byte_end": 4149, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 693, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "19.72% 19.72% 19.72% 19.72%", "qwen": "25.85% 25.85% 25.85% 25.85%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.012511512264609337]], "qwen": [[279, " the", "normal", 0.0032348092645406723]]}, "loss": {"rwkv": 19.724346262153794, "qwen": 25.850323140441187}, "topk": {"rwkv": [22590, 14, 0.012511512264609337, [[32458, 0.24276, " well", false], [32487, 0.12519, " with", false], [4596, 0.093635, " in", false], [4450, 0.074297, " by", false], [45301, 0.067196, " better", false], [4712, 0.065375, " on", false], [53356, 0.045265, " without", false], [21700, 0.037214, " for", false], [37810, 0.033556, " based", false], [4423, 0.025853, " as", false]]], "qwen": [279, 28, 0.0032348092645406723, [[1632, 0.210527, " well", false], [553, 0.183147, " by", false], [2664, 0.122462, " better", false], [448, 0.090211, " with", false], [389, 0.036326, " on", false], [1850, 0.034978, " best", false], [2041, 0.032927, " without", false], [304, 0.030127, " in", false], [3118, 0.029257, " based", false], [1667, 0.022388, " using", false]]]}, "raw_delta": -0.3396962881088257, "tuned_delta": -0.33288401030172776}, {"byte_start": 4149, "byte_end": 4153, "display": {"text": " way", "kind": "normal"}, "is_word": true, "word_id": 694, "word_key": " way", "bytes_hex": "20 77 61 79", "compression": {"rwkv": "1.63% 1.63% 1.63% 1.63%", "qwen": "1.80% 1.80% 1.80% 1.80%"}, "model_tokens": {"rwkv": [[22752, " way", "normal", 0.6961622834205627]], "qwen": [[1616, " way", "normal", 0.6703117489814758]]}, "loss": {"rwkv": 1.6290196689725231, "qwen": 1.8034244536221318}, "topk": {"rwkv": [22752, 1, 0.6961622834205627, [[22752, 0.696162, " way", false], [30273, 0.111748, " best", false], [31937, 0.051159, " same", false], [4404, 0.023021, " ``", false], [39523, 0.021372, " right", false], [38720, 0.020225, " human", false], [38499, 0.018583, " first", false], [31461, 0.014402, " most", false], [51718, 0.004566, " fastest", false], [22221, 0.004411, " old", false]]], "qwen": [1616, 1, 0.6703117489814758, [[1616, 0.670312, " way", false], [1850, 0.105118, " best", false], [1852, 0.093585, " same", false], [3738, 0.023929, " human", false], [2310, 0.02321, " old", false], [9902, 0.017485, " ``", false], [1156, 0.013976, " first", false], [2588, 0.005618, " hard", false], [8606, 0.004595, " traditional", false], [1008, 0.002564, " other", false]]]}, "raw_delta": -0.009671054780483246, "tuned_delta": -0.002858776973385299}, {"byte_start": 4153, "byte_end": 4157, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 695, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "16.77% 16.77% 16.77% 16.77%", "qwen": "16.31% 16.31% 16.31% 16.31%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.024789826944470406]], "qwen": [[279, " the", "normal", 0.026834776625037193]]}, "loss": {"rwkv": 16.765694322830726, "qwen": 16.311725692938552}, "topk": {"rwkv": [22590, 6, 0.024789826944470406, [[32232, 0.444009, " they", false], [46227, 0.192123, " humans", false], [46787, 0.137287, " people", false], [32227, 0.066591, " that", false], [38720, 0.060403, " human", false], [22590, 0.02479, " the", false], [51685, 0.011488, " experts", false], [39931, 0.011323, " their", false], [332, 0.008097, " a", false], [4404, 0.006436, " ``", false]]], "qwen": [279, 6, 0.026834776625037193, [[1251, 0.338643, " people", false], [12677, 0.333696, " humans", false], [807, 0.124633, " they", false], [429, 0.074541, " that", false], [3738, 0.036561, " human", false], [279, 0.026835, " the", false], [264, 0.011034, " a", false], [862, 0.008604, " their", false], [582, 0.008014, " we", false], [1429, 0.00515, " most", false]]]}, "raw_delta": 0.0251733660697937, "tuned_delta": 0.03198564387689165}, {"byte_start": 4157, "byte_end": 4169, "display": {"text": " researchers", "kind": "normal"}, "is_word": true, "word_id": 696, "word_key": " researchers", "bytes_hex": "20 72 65 73 65 61 72 63 68 65 72 73", "compression": {"rwkv": "8.92% 8.92% 8.92% 8.92% 8.92% 8.92% 8.92% 8.92% 8.92% 8.92% 8.92% 8.92%", "qwen": "9.76% 9.76% 9.76% 9.76% 9.76% 9.76% 9.76% 9.76% 9.76% 9.76% 9.76% 9.76%"}, "model_tokens": {"rwkv": [[63843, " researchers", "normal", 0.0026391625870019197]], "qwen": [[11811, " researchers", "normal", 0.0015071507077664137]]}, "loss": {"rwkv": 8.922918547164814, "qwen": 9.764542163153973}, "topk": {"rwkv": [63843, 24, 0.0026391625870019197, [[38720, 0.522016, " human", false], [51685, 0.120319, " experts", false], [46227, 0.066931, " humans", false], [40213, 0.05397, " world", false], [45775, 0.022739, " domain", false], [53087, 0.011722, " systems", false], [4404, 0.011271, " ``", false], [30273, 0.010815, " best", false], [38478, 0.009476, " field", false], [47487, 0.009279, " system", false]]], "qwen": [11811, 28, 0.0015071507077664137, [[3738, 0.503164, " human", false], [12677, 0.108089, " humans", false], [1879, 0.094028, " world", false], [11647, 0.063805, " experts", false], [1850, 0.047976, " best", false], [1251, 0.022485, " people", false], [6203, 0.01531, " expert", false], [5461, 0.011294, " average", false], [8686, 0.006228, " majority", false], [33738, 0.00596, " champions", false]]]}, "raw_delta": -0.04666952292124432, "tuned_delta": -0.03985724511414637}, {"byte_start": 4169, "byte_end": 4177, "display": {"text": " thought", "kind": "normal"}, "is_word": true, "word_id": 697, "word_key": " thought", "bytes_hex": "20 74 68 6f 75 67 68 74", "compression": {"rwkv": "2.57% 2.57% 2.57% 2.57% 2.57% 2.57% 2.57% 2.57%", "qwen": "3.65% 3.65% 3.65% 3.65% 3.65% 3.65% 3.65% 3.65%"}, "model_tokens": {"rwkv": [[53137, " thought", "normal", 0.32436203956604004]], "qwen": [[3381, " thought", "normal", 0.19764433801174164]]}, "loss": {"rwkv": 2.571209423459334, "qwen": 3.654721084280602}, "topk": {"rwkv": [53137, 1, 0.32436203956604004, [[53137, 0.324362, " thought", false], [47763, 0.18766, " wanted", false], [31220, 0.156167, " knew", false], [62684, 0.073363, " understood", false], [55616, 0.048506, " believed", false], [21532, 0.028367, " did", false], [62643, 0.027522, " themselves", false], [40, 0.013661, "'", false], [56175, 0.012918, " expected", false], [40219, 0.012278, " would", false]]], "qwen": [3381, 2, 0.19764433801174164, [[4829, 0.216252, " wanted", false], [3381, 0.197644, " thought", false], [5577, 0.095206, " themselves", false], [6876, 0.091078, " knew", false], [6342, 0.039408, " played", false], [3601, 0.039298, " expected", false], [1521, 0.038354, " did", false], [15985, 0.033178, " understood", false], [1035, 0.025781, " would", false], [11585, 0.016411, " believed", false]]]}, "raw_delta": -0.06008264422416687, "tuned_delta": -0.05327036641706892}, {"byte_start": 4177, "byte_end": 4183, "display": {"text": " their", "kind": "normal"}, "is_word": true, "word_id": 698, "word_key": " their", "bytes_hex": "20 74 68 65 69 72", "compression": {"rwkv": "13.53% 13.53% 13.53% 13.53% 13.53% 13.53%", "qwen": "15.82% 15.82% 15.82% 15.82% 15.82% 15.82%"}, "model_tokens": {"rwkv": [[39931, " their", "normal", 0.010939007624983788]], "qwen": [[862, " their", "normal", 0.005176984239369631]]}, "loss": {"rwkv": 13.52526600833403, "qwen": 15.82015090665209}, "topk": {"rwkv": [39931, 18, 0.010939007624983788, [[22590, 0.175497, " the", false], [46227, 0.125633, " humans", false], [46787, 0.102735, " people", false], [32232, 0.098894, " they", false], [38720, 0.082869, " human", false], [47350, 0.076286, " speech", false], [22748, 0.041992, " was", false], [30273, 0.033429, " best", false], [4601, 0.025663, " it", false], [45, 0.023426, ",", false]]], "qwen": [862, 20, 0.005176984239369631, [[1251, 0.166699, " people", false], [807, 0.156441, " they", false], [279, 0.124674, " the", false], [12677, 0.096171, " humans", false], [572, 0.055338, " was", false], [11, 0.052921, ",", false], [1035, 0.051776, " would", false], [3738, 0.037222, " human", false], [429, 0.036515, " that", false], [264, 0.028396, " a", false]]]}, "raw_delta": -0.12725543975830078, "tuned_delta": -0.12044316195120283}, {"byte_start": 4183, "byte_end": 4187, "display": {"text": " own", "kind": "normal"}, "is_word": true, "word_id": 699, "word_key": " own", "bytes_hex": "20 6f 77 6e", "compression": {"rwkv": "17.12% 17.12% 17.12% 17.12%", "qwen": "9.08% 9.08% 9.08% 9.08%"}, "model_tokens": {"rwkv": [[22251, " own", "normal", 0.022488554939627647]], "qwen": [[1828, " own", "normal", 0.1334380805492401]]}, "loss": {"rwkv": 17.11791479179776, "qwen": 9.08049263485721}, "topk": {"rwkv": [22251, 7, 0.022488554939627647, [[53087, 0.308808, " systems", false], [38720, 0.140041, " human", false], [45775, 0.082776, " domain", false], [52224, 0.07627, " methods", false], [59943, 0.070576, " knowledge", false], [47487, 0.058603, " system", false], [22251, 0.022489, " own", false], [38478, 0.01297, " field", false], [52964, 0.010355, " special", false], [65034, 0.010129, " understanding", false]]], "qwen": [1828, 3, 0.1334380805492401, [[3738, 0.201269, " human", false], [5942, 0.165008, " systems", false], [1828, 0.133438, " own", false], [61440, 0.070908, " predecessors", false], [7947, 0.044888, " domain", false], [1849, 0.024061, " system", false], [3281, 0.019679, " special", false], [5413, 0.016345, " methods", false], [6540, 0.016087, " knowledge", false], [34102, 0.012111, " brains", false]]]}, "raw_delta": 0.44568932056427, "tuned_delta": 0.45250159837136794}, {"byte_start": 4187, "byte_end": 4193, "display": {"text": " minds", "kind": "normal"}, "is_word": true, "word_id": 700, "word_key": " minds", "bytes_hex": "20 6d 69 6e 64 73", "compression": {"rwkv": "14.46% 14.46% 14.46% 14.46% 14.46% 14.46%", "qwen": "9.01% 9.01% 9.01% 9.01% 9.01% 9.01%"}, "model_tokens": {"rwkv": [[39026, " minds", "normal", 0.008142104372382164]], "qwen": [[20062, " minds", "normal", 0.0499066598713398]]}, "loss": {"rwkv": 14.464520592246117, "qwen": 9.009633632918597}, "topk": {"rwkv": [39026, 16, 0.008142104372382164, [[53087, 0.168918, " systems", false], [38720, 0.163148, " human", false], [52224, 0.135503, " methods", false], [59943, 0.133976, " knowledge", false], [47487, 0.050235, " system", false], [45775, 0.024496, " domain", false], [47350, 0.019226, " speech", false], [65034, 0.018417, " understanding", false], [52964, 0.015487, " special", false], [59683, 0.013747, " expertise", false]]], "qwen": [20062, 5, 0.0499066598713398, [[3738, 0.156074, " human", false], [5942, 0.091684, " systems", false], [7947, 0.073352, " domain", false], [34102, 0.062548, " brains", false], [20062, 0.049907, " minds", false], [6540, 0.04608, " knowledge", false], [5413, 0.044033, " methods", false], [12677, 0.035771, " humans", false], [1616, 0.034793, " way", false], [3281, 0.025066, " special", false]]]}, "raw_delta": 0.30248316129048675, "tuned_delta": 0.30929543909758467}, {"byte_start": 4193, "byte_end": 4200, "display": {"text": " worked", "kind": "normal"}, "is_word": true, "word_id": 701, "word_key": " worked", "bytes_hex": "20 77 6f 72 6b 65 64", "compression": {"rwkv": "0.92% 0.92% 0.92% 0.92% 0.92% 0.92% 0.92%", "qwen": "0.70% 0.70% 0.70% 0.70% 0.70% 0.70% 0.70%"}, "model_tokens": {"rwkv": [[47812, " worked", "normal", 0.7008408308029175]], "qwen": [[6439, " worked", "normal", 0.7613739371299744]]}, "loss": {"rwkv": 0.9157732193142833, "qwen": 0.7023623279756674}, "topk": {"rwkv": [47812, 1, 0.7008408308029175, [[47812, 0.700841, " worked", false], [21532, 0.141316, " did", false], [40219, 0.056138, " would", false], [47266, 0.023857, " should", false], [53137, 0.013646, " thought", false], [32499, 0.009702, " work", false], [56760, 0.008167, " operated", false], [32462, 0.008034, " were", false], [39021, 0.006157, " might", false], [39196, 0.00442, " ought", false]]], "qwen": [6439, 1, 0.7613739371299744, [[6439, 0.761374, " worked", false], [1035, 0.091885, " would", false], [1521, 0.045518, " did", false], [1265, 0.037856, " should", false], [975, 0.008386, " work", false], [1030, 0.007429, " had", false], [21776, 0.005342, " ought", false], [1969, 0.004679, " must", false], [323, 0.004666, " and", false], [1033, 0.004177, " were", false]]]}, "raw_delta": 0.011834012610571723, "tuned_delta": 0.01864629041766967}, {"byte_start": 4200, "byte_end": 4203, "display": {"text": "---", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2d 2d 2d", "compression": {"rwkv": "14.37% 14.37% 14.37%", "qwen": "14.36% 14.36% 14.36%"}, "model_tokens": {"rwkv": [[5346, "---", "normal", 0.09081441164016724]], "qwen": [[4421, "---", "normal", 0.0916820615530014]]}, "loss": {"rwkv": 14.370595133854907, "qwen": 14.363403392671328}, "topk": {"rwkv": [5346, 3, 0.09081441164016724, [[45, 0.511898, ",", false], [47, 0.255632, ".", false], [5346, 0.090814, "---", false], [275, 0.028396, " (", false], [30273, 0.023297, " best", false], [60, 0.022758, ";", false], [21265, 0.017371, " and", false], [4596, 0.00619, " in", false], [21400, 0.005468, " but", false], [32465, 0.005402, " when", false]]], "qwen": [4421, 3, 0.0916820615530014, [[11, 0.463088, ",", false], [13, 0.217557, ".", false], [4421, 0.091682, "---", false], [320, 0.047334, " (", false], [323, 0.041853, " and", false], [382, 0.035104, ".\n\n", false], [26, 0.016768, ";", false], [304, 0.009855, " in", false], [979, 0.007711, " when", false], [714, 0.007509, " but", false]]]}, "raw_delta": 0.00039879480997717653, "tuned_delta": 0.007211072617075123}, {"byte_start": 4203, "byte_end": 4207, "display": {"text": "they", "kind": "normal"}, "is_word": true, "word_id": 702, "word_key": "they", "bytes_hex": "74 68 65 79", "compression": {"rwkv": "17.61% 17.61% 17.61% 17.61%", "qwen": "16.97% 16.97% 16.97% 16.97%"}, "model_tokens": {"rwkv": [[27148, "they", "normal", 0.02035820297896862]], "qwen": [[20069, "they", "normal", 0.023210639134049416]]}, "loss": {"rwkv": 17.611023448351602, "qwen": 16.96584343233859}, "topk": {"rwkv": [27148, 12, 0.02035820297896862, [[1950, 0.099, "in", false], [27142, 0.090219, "that", false], [7005, 0.065379, "and", false], [7195, 0.052916, "but", false], [1782, 0.048247, "by", false], [8801, 0.03756, "the", false], [27493, 0.036912, "with", false], [36003, 0.033404, "which", false], [98, 0.031564, "a", false], [35926, 0.021547, "using", false]]], "qwen": [20069, 12, 0.023210639134049416, [[9033, 0.113276, "that", false], [29939, 0.078263, "based", false], [437, 0.058803, "and", false], [970, 0.053, "using", false], [4197, 0.042315, "with", false], [1782, 0.039568, "the", false], [1694, 0.037741, "by", false], [258, 0.035452, "in", false], [64, 0.030492, "a", false], [8088, 0.027657, "but", false]]]}, "raw_delta": 0.035776376724243164, "tuned_delta": 0.042588654531341114}, {"byte_start": 4207, "byte_end": 4213, "display": {"text": " tried", "kind": "normal"}, "is_word": true, "word_id": 703, "word_key": " tried", "bytes_hex": "20 74 72 69 65 64", "compression": {"rwkv": "6.76% 6.76% 6.76% 6.76% 6.76% 6.76%", "qwen": "7.13% 7.13% 7.13% 7.13% 7.13% 7.13%"}, "model_tokens": {"rwkv": [[40013, " tried", "normal", 0.1057450994849205]], "qwen": [[6679, " tried", "normal", 0.09341413527727127]]}, "loss": {"rwkv": 6.762633004167015, "qwen": 7.125449037615954}, "topk": {"rwkv": [40013, 1, 0.1057450994849205, [[40013, 0.105745, " tried", false], [47763, 0.091194, " wanted", false], [32462, 0.084184, " were", false], [21532, 0.0785, " did", false], [32354, 0.050558, " used", false], [45150, 0.038569, " always", false], [53137, 0.038239, " thought", false], [21795, 0.024434, " had", false], [40219, 0.021412, " would", false], [39115, 0.018235, " never", false]]], "qwen": [6679, 3, 0.09341413527727127, [[4829, 0.184392, " wanted", false], [1521, 0.118051, " did", false], [6679, 0.093414, " tried", false], [1033, 0.086483, " were", false], [3381, 0.045878, " thought", false], [1483, 0.0269, " used", false], [11585, 0.02205, " believed", false], [1030, 0.020286, " had", false], [2581, 0.018875, " never", false], [3867, 0.015135, " took", false]]]}, "raw_delta": -0.020118792851765932, "tuned_delta": -0.013306515044667986}, {"byte_start": 4213, "byte_end": 4216, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 704, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "0.77% 0.77% 0.77%", "qwen": "0.75% 0.75% 0.75%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.8797710537910461]], "qwen": [[311, " to", "normal", 0.8823504447937012]]}, "loss": {"rwkv": 0.76901469057802, "qwen": 0.7524013456532673}, "topk": {"rwkv": [4811, 1, 0.8797710537910461, [[4811, 0.879771, " to", false], [52224, 0.011586, " methods", false], [31048, 0.008297, " hard", false], [38720, 0.007712, " human", false], [22590, 0.005493, " the", false], [38499, 0.005196, " first", false], [45, 0.004872, ",", false], [22249, 0.004528, " out", false], [21700, 0.00443, " for", false], [22187, 0.002971, " not", false]]], "qwen": [311, 1, 0.8823504447937012, [[311, 0.88235, " to", false], [3738, 0.023664, " human", false], [5413, 0.015564, " methods", false], [3281, 0.005675, " special", false], [2588, 0.004839, " hard", false], [537, 0.004669, " not", false], [369, 0.004409, " for", false], [1667, 0.004191, " using", false], [279, 0.003089, " the", false], [11, 0.003054, ",", false]]]}, "raw_delta": 0.0009212394555409703, "tuned_delta": 0.007733517262638917}, {"byte_start": 4216, "byte_end": 4220, "display": {"text": " put", "kind": "normal"}, "is_word": true, "word_id": 705, "word_key": " put", "bytes_hex": "20 70 75 74", "compression": {"rwkv": "20.57% 20.57% 20.57% 20.57%", "qwen": "23.32% 23.32% 23.32% 23.32%"}, "model_tokens": {"rwkv": [[22339, " put", "normal", 0.010296313092112541]], "qwen": [[2182, " put", "normal", 0.005670353304594755]]}, "loss": {"rwkv": 20.56967538767467, "qwen": 23.31983060957362}, "topk": {"rwkv": [22339, 25, 0.010296313092112541, [[31358, 0.069544, " make", false], [22681, 0.068844, " use", false], [37923, 0.056738, " build", false], [39025, 0.053163, " mimic", false], [39043, 0.029658, " model", false], [32187, 0.028034, " take", false], [4516, 0.022966, " em", false], [4404, 0.022095, " ``", false], [4491, 0.021205, " do", false], [45616, 0.018268, " create", false]]], "qwen": [2182, 32, 0.005670353304594755, [[1281, 0.136003, " make", false], [990, 0.085992, " use", false], [32064, 0.0754, " leverage", false], [1896, 0.066793, " take", false], [1936, 0.041364, " build", false], [32194, 0.029387, " exploit", false], [5648, 0.025347, " avoid", false], [653, 0.020886, " do", false], [9902, 0.019416, " ``", false], [65485, 0.019378, " emulate", false]]]}, "raw_delta": -0.15250098705291748, "tuned_delta": -0.14568870924581953}, {"byte_start": 4220, "byte_end": 4225, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 706, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"rwkv": "26.04% 26.04% 26.04% 26.04% 26.04%", "qwen": "23.14% 23.14% 23.14% 23.14% 23.14%"}, "model_tokens": {"rwkv": [[32227, " that", "normal", 0.0007272844086401165]], "qwen": [[429, " that", "normal", 0.001635799533687532]]}, "loss": {"rwkv": 26.03613706604301, "qwen": 23.139471113743912}, "topk": {"rwkv": [32227, 66, 0.0007272844086401165, [[4596, 0.202059, " in", false], [39931, 0.168383, " their", false], [22590, 0.111181, " the", false], [38720, 0.071648, " human", false], [57435, 0.062388, " together", false], [40210, 0.030028, " words", false], [21256, 0.029115, " all", false], [4404, 0.026525, " ``", false], [332, 0.023923, " a", false], [59943, 0.021314, " knowledge", false]]], "qwen": [429, 38, 0.001635799533687532, [[862, 0.155009, " their", false], [304, 0.148532, " in", false], [3738, 0.101256, " human", false], [279, 0.100274, " the", false], [5577, 0.09738, " themselves", false], [264, 0.042682, " a", false], [3786, 0.026835, " together", false], [6540, 0.024458, " knowledge", false], [12677, 0.021355, " humans", false], [1119, 0.015779, " into", false]]]}, "raw_delta": 0.16062526702880864, "tuned_delta": 0.1674375448359066}, {"byte_start": 4225, "byte_end": 4235, "display": {"text": " knowledge", "kind": "normal"}, "is_word": true, "word_id": 707, "word_key": " knowledge", "bytes_hex": "20 6b 6e 6f 77 6c 65 64 67 65", "compression": {"rwkv": "2.59% 2.59% 2.59% 2.59% 2.59% 2.59% 2.59% 2.59% 2.59% 2.59%", "qwen": "3.29% 3.29% 3.29% 3.29% 3.29% 3.29% 3.29% 3.29% 3.29% 3.29%"}, "model_tokens": {"rwkv": [[59943, " knowledge", "normal", 0.23611293733119965]], "qwen": [[6540, " knowledge", "normal", 0.16167356073856354]]}, "loss": {"rwkv": 2.592342651597356, "qwen": 3.286055311770598}, "topk": {"rwkv": [59943, 1, 0.23611293733119965, [[59943, 0.236113, " knowledge", false], [38720, 0.217094, " human", false], [31162, 0.046588, " into", false], [52964, 0.043139, " special", false], [4404, 0.039366, " ``", false], [4596, 0.023997, " in", false], [65034, 0.021795, " understanding", false], [47487, 0.01872, " system", false], [31427, 0.016928, " mind", false], [62293, 0.014425, " particular", false]]], "qwen": [6540, 2, 0.16167356073856354, [[3738, 0.232212, " human", false], [6540, 0.161674, " knowledge", false], [1119, 0.066522, " into", false], [8660, 0.053874, " understanding", false], [304, 0.053395, " in", false], [3093, 0.047307, " kind", false], [3281, 0.028993, " special", false], [1616, 0.027035, " way", false], [3381, 0.025701, " thought", false], [9902, 0.025343, " ``", false]]]}, "raw_delta": -0.03846759796142579, "tuned_delta": -0.03165532015432784}, {"byte_start": 4235, "byte_end": 4238, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 708, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "10.28% 10.28% 10.28%", "qwen": "17.62% 17.62% 17.62%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.1793327033519745]], "qwen": [[304, " in", "normal", 0.053343866020441055]]}, "loss": {"rwkv": 10.284837693837336, "qwen": 17.618891654628577}, "topk": {"rwkv": [4596, 2, 0.1793327033519745, [[31162, 0.529074, " into", false], [4596, 0.179333, " in", false], [4811, 0.108417, " to", false], [4706, 0.046474, " of", false], [32232, 0.032817, " they", false], [45, 0.013106, ",", false], [32227, 0.01072, " that", false], [56003, 0.008196, " directly", false], [21265, 0.008144, " and", false], [46301, 0.004764, " inside", false]]], "qwen": [304, 3, 0.053343866020441055, [[1119, 0.64124, " into", false], [311, 0.188813, " to", false], [304, 0.053344, " in", false], [5961, 0.017141, " directly", false], [315, 0.013351, " of", false], [518, 0.012458, " at", false], [11, 0.010536, ",", false], [389, 0.009964, " on", false], [4766, 0.00838, " inside", false], [323, 0.008258, " and", false]]]}, "raw_delta": -0.40668630599975586, "tuned_delta": -0.39987402819265794}, {"byte_start": 4238, "byte_end": 4244, "display": {"text": " their", "kind": "normal"}, "is_word": true, "word_id": 709, "word_key": " their", "bytes_hex": "20 74 68 65 69 72", "compression": {"rwkv": "6.62% 6.62% 6.62% 6.62% 6.62% 6.62%", "qwen": "5.88% 5.88% 5.88% 5.88% 5.88% 5.88%"}, "model_tokens": {"rwkv": [[39931, " their", "normal", 0.11075770109891891]], "qwen": [[862, " their", "normal", 0.14135323464870453]]}, "loss": {"rwkv": 6.621744816580202, "qwen": 5.8804651948313245}, "topk": {"rwkv": [39931, 2, 0.11075770109891891, [[22590, 0.602514, " the", false], [39931, 0.110758, " their", false], [45, 0.047365, ",", false], [332, 0.040292, " a", false], [47, 0.02859, ".", false], [4423, 0.013911, " as", false], [21265, 0.013516, " and", false], [56567, 0.009182, " machines", false], [4811, 0.008899, " to", false], [53087, 0.007918, " systems", false]]], "qwen": [862, 2, 0.14135323464870453, [[279, 0.568154, " the", false], [862, 0.141353, " their", false], [264, 0.072226, " a", false], [311, 0.030093, " to", false], [5942, 0.012445, " systems", false], [12645, 0.011967, " machines", false], [1992, 0.011912, " place", false], [11, 0.011863, ",", false], [6366, 0.010402, " computer", false], [13, 0.008414, ".", false]]]}, "raw_delta": 0.04110527038574219, "tuned_delta": 0.04791754819284014}, {"byte_start": 4244, "byte_end": 4252, "display": {"text": " systems", "kind": "normal"}, "is_word": true, "word_id": 710, "word_key": " systems", "bytes_hex": "20 73 79 73 74 65 6d 73", "compression": {"rwkv": "2.00% 2.00% 2.00% 2.00% 2.00% 2.00% 2.00% 2.00%", "qwen": "1.52% 1.52% 1.52% 1.52% 1.52% 1.52% 1.52% 1.52%"}, "model_tokens": {"rwkv": [[53087, " systems", "normal", 0.4149631857872009]], "qwen": [[5942, " systems", "normal", 0.5105169415473938]]}, "loss": {"rwkv": 1.998851161387907, "qwen": 1.5155768221501569}, "topk": {"rwkv": [53087, 1, 0.4149631857872009, [[53087, 0.414963, " systems", false], [46587, 0.142688, " models", false], [52224, 0.092091, " methods", false], [47487, 0.071087, " system", false], [61559, 0.055071, " algorithms", false], [56949, 0.02505, " programs", false], [56567, 0.023005, " machines", false], [47350, 0.017826, " speech", false], [30469, 0.012645, " code", false], [22251, 0.011456, " own", false]]], "qwen": [5942, 1, 0.5105169415473938, [[5942, 0.510517, " systems", false], [7468, 0.084851, " programs", false], [12645, 0.07608, " machines", false], [4119, 0.03891, " models", false], [8806, 0.036206, " speech", false], [1849, 0.034784, " system", false], [18495, 0.024004, " computers", false], [5413, 0.020255, " methods", false], [25185, 0.019073, " algorithms", false], [6366, 0.018461, " computer", false]]]}, "raw_delta": 0.026798419654369354, "tuned_delta": 0.033610697461467304}, {"byte_start": 4252, "byte_end": 4255, "display": {"text": "---", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2d 2d 2d", "compression": {"rwkv": "8.97% 8.97% 8.97%", "qwen": "8.18% 8.18% 8.18%"}, "model_tokens": {"rwkv": [[5346, "---", "normal", 0.2264254242181778]], "qwen": [[4421, "---", "normal", 0.2565803825855255]]}, "loss": {"rwkv": 8.969881276360416, "qwen": 8.177155194389064}, "topk": {"rwkv": [5346, 2, 0.2264254242181778, [[47, 0.34008, ".", false], [5346, 0.226425, "---", false], [45, 0.220464, ",", false], [21265, 0.053077, " and", false], [4596, 0.018111, " in", false], [4423, 0.014561, " as", false], [47001, 0.013335, " rather", false], [4450, 0.010121, " by", false], [52028, 0.01009, " instead", false], [4811, 0.009427, " to", false]]], "qwen": [4421, 2, 0.2565803825855255, [[13, 0.326225, ".", false], [4421, 0.25658, "---", false], [11, 0.202918, ",", false], [323, 0.047183, " and", false], [382, 0.031108, ".\n\n", false], [4518, 0.01422, " instead", false], [311, 0.013798, " to", false], [304, 0.01277, " in", false], [320, 0.010513, " (", false], [773, 0.010385, " so", false]]]}, "raw_delta": 0.043958067893981934, "tuned_delta": 0.05077034570107988}, {"byte_start": 4255, "byte_end": 4258, "display": {"text": "but", "kind": "normal"}, "is_word": true, "word_id": 711, "word_key": "but", "bytes_hex": "62 75 74", "compression": {"rwkv": "2.37% 2.37% 2.37%", "qwen": "4.04% 4.04% 4.04%"}, "model_tokens": {"rwkv": [[7195, "but", "normal", 0.6723535060882568]], "qwen": [[8088, "but", "normal", 0.5108304619789124]]}, "loss": {"rwkv": 2.3716178243780157, "qwen": 4.037848089647843}, "topk": {"rwkv": [7195, 1, 0.6723535060882568, [[7195, 0.672354, "but", false], [7005, 0.231232, "and", false], [35898, 0.012872, "until", false], [36003, 0.009888, "which", false], [36004, 0.006337, "while", false], [26476, 0.005456, "only", false], [2190, 0.005194, "so", false], [36002, 0.004715, "where", false], [27493, 0.003297, "with", false], [42135, 0.003148, "rather", false]]], "qwen": [8088, 1, 0.5108304619789124, [[8088, 0.51083, "but", false], [437, 0.291467, "and", false], [3243, 0.029564, "only", false], [38730, 0.02406, "until", false], [73203, 0.021517, "rather", false], [64837, 0.0121, "instead", false], [28996, 0.006618, "without", false], [14801, 0.006535, "before", false], [704, 0.006166, "so", false], [3472, 0.005263, "while", false]]]}, "raw_delta": -0.09239542484283447, "tuned_delta": -0.08558314703573652}, {"byte_start": 4258, "byte_end": 4261, "display": {"text": " it", "kind": "normal"}, "is_word": true, "word_id": 712, "word_key": " it", "bytes_hex": "20 69 74", "compression": {"rwkv": "16.62% 16.62% 16.62%", "qwen": "16.16% 16.16% 16.16%"}, "model_tokens": {"rwkv": [[4601, " it", "normal", 0.06284810602664948]], "qwen": [[432, " it", "normal", 0.06796281039714813]]}, "loss": {"rwkv": 16.62480613524391, "qwen": 16.162961058239414}, "topk": {"rwkv": [4601, 5, 0.06284810602664948, [[22590, 0.164955, " the", false], [32232, 0.10603, " they", false], [4596, 0.079075, " in", false], [32234, 0.065311, " this", false], [4601, 0.062848, " it", false], [30597, 0.043142, " deep", false], [32227, 0.041925, " that", false], [45, 0.036513, ",", false], [61959, 0.035209, " eventually", false], [4423, 0.026347, " as", false]]], "qwen": [432, 4, 0.06796281039714813, [[279, 0.138948, " the", false], [807, 0.087394, " they", false], [304, 0.079733, " in", false], [432, 0.067963, " it", false], [419, 0.061158, " this", false], [11, 0.044456, ",", false], [429, 0.039143, " that", false], [1172, 0.028256, " only", false], [979, 0.026061, " when", false], [438, 0.025101, " as", false]]]}, "raw_delta": 0.0256101290384928, "tuned_delta": 0.03242240684559075}, {"byte_start": 4261, "byte_end": 4268, "display": {"text": " proved", "kind": "normal"}, "is_word": true, "word_id": 713, "word_key": " proved", "bytes_hex": "20 70 72 6f 76 65 64", "compression": {"rwkv": "8.78% 8.78% 8.78% 8.78% 8.78% 8.78% 8.78%", "qwen": "8.43% 8.43% 8.43% 8.43% 8.43% 8.43% 8.43%"}, "model_tokens": {"rwkv": [[46936, " proved", "normal", 0.033210545778274536]], "qwen": [[18651, " proved", "normal", 0.037908583879470825]]}, "loss": {"rwkv": 8.77532139826434, "qwen": 8.430949480414185}, "topk": {"rwkv": [46936, 7, 0.033210545778274536, [[22748, 0.357498, " was", false], [47638, 0.086075, " turned", false], [4600, 0.082956, " is", false], [21532, 0.078778, " did", false], [40040, 0.040607, " turns", false], [39115, 0.034778, " never", false], [46936, 0.033211, " proved", false], [30633, 0.028917, " didn", false], [45150, 0.016244, " always", false], [32445, 0.016236, " wasn", false]]], "qwen": [18651, 5, 0.037908583879470825, [[572, 0.403749, " was", false], [6519, 0.079842, " turned", false], [1521, 0.075345, " did", false], [374, 0.066288, " is", false], [18651, 0.037909, " proved", false], [3867, 0.037231, " took", false], [2581, 0.036642, " never", false], [10577, 0.016711, " turns", false], [3207, 0.015634, " didn", false], [6116, 0.015539, " became", false]]]}, "raw_delta": 0.01909603391374859, "tuned_delta": 0.025908311720846535}, {"byte_start": 4268, "byte_end": 4279, "display": {"text": " ultimately", "kind": "normal"}, "is_word": true, "word_id": 714, "word_key": " ultimately", "bytes_hex": "20 75 6c 74 69 6d 61 74 65 6c 79", "compression": {"rwkv": "6.38% 6.38% 6.38% 6.38% 6.38% 6.38% 6.38% 6.38% 6.38% 6.38% 6.38%", "qwen": "7.08% 7.08% 7.08% 7.08% 7.08% 7.08% 7.08% 7.08% 7.08% 7.08% 7.08%"}, "model_tokens": {"rwkv": [[62676, " ultimately", "normal", 0.020636359229683876]], "qwen": [[13653, " ultimately", "normal", 0.013284618966281414]]}, "loss": {"rwkv": 6.378392492566615, "qwen": 7.08420381953233}, "topk": {"rwkv": [62676, 12, 0.020636359229683876, [[4811, 0.21053, " to", false], [22187, 0.075159, " not", false], [62082, 0.054852, " impossible", false], [62161, 0.045522, " irrelevant", false], [332, 0.045495, " a", false], [21719, 0.04316, " fut", false], [31466, 0.041271, " much", false], [32227, 0.034519, " that", false], [31277, 0.030359, " less", false], [31458, 0.026661, " more", false]]], "qwen": [13653, 17, 0.013284618966281414, [[311, 0.178685, " to", false], [11997, 0.07576, " impossible", false], [39715, 0.058243, " irrelevant", false], [537, 0.045833, " not", false], [264, 0.045779, " a", false], [54188, 0.043133, " ineffective", false], [429, 0.038112, " that", false], [84527, 0.025843, " futile", false], [1753, 0.025481, " much", false], [5000, 0.020392, " difficult", false]]]}, "raw_delta": -0.03913849050348456, "tuned_delta": -0.03232621269638661}, {"byte_start": 4279, "byte_end": 4287, "display": {"text": " counter", "kind": "normal"}, "is_word": true, "word_id": 715, "word_key": " counter", "bytes_hex": "20 63 6f 75 6e 74 65 72", "compression": {"rwkv": "10.28% 10.28% 10.28% 10.28% 10.28% 10.28% 10.28% 10.28%", "qwen": "8.72% 8.72% 8.72% 8.72% 8.72% 8.72% 8.72% 8.72%"}, "model_tokens": {"rwkv": [[51336, " counter", "normal", 0.010372607968747616]], "qwen": [[5546, " counter", "normal", 0.020920855924487114]]}, "loss": {"rwkv": 10.284837693837336, "qwen": 8.717053522596084}, "topk": {"rwkv": [51336, 16, 0.010372607968747616, [[4811, 0.209378, " to", false], [21719, 0.125147, " fut", false], [22187, 0.085774, " not", false], [62161, 0.085028, " irrelevant", false], [31458, 0.061743, " more", false], [31277, 0.039636, " less", false], [62082, 0.034192, " impossible", false], [4832, 0.029281, " un", false], [63631, 0.025199, " ineffective", false], [332, 0.024581, " a", false]]], "qwen": [5546, 12, 0.020920855924487114, [[39715, 0.214401, " irrelevant", false], [311, 0.13551, " to", false], [11997, 0.082176, " impossible", false], [54188, 0.055731, " ineffective", false], [84527, 0.043993, " futile", false], [650, 0.040503, " un", false], [264, 0.037476, " a", false], [537, 0.035118, " not", false], [28848, 0.030893, " useless", false], [2686, 0.029788, " less", false]]]}, "raw_delta": 0.08693641424179077, "tuned_delta": 0.09374869204888872}, {"byte_start": 4287, "byte_end": 4297, "display": {"text": "productive", "kind": "normal"}, "is_word": true, "word_id": 716, "word_key": "productive", "bytes_hex": "70 72 6f 64 75 63 74 69 76 65", "compression": {"rwkv": "0.22% 0.22% 0.22% 0.22% 0.22% 0.22% 0.22% 0.22% 0.22% 0.22%", "qwen": "0.29% 0.29% 0.29% 0.29% 0.29% 0.29% 0.29% 0.29% 0.29% 0.29%"}, "model_tokens": {"rwkv": [[61076, "productive", "normal", 0.884867250919342]], "qwen": [[33270, "productive", "normal", 0.8513615727424622]]}, "loss": {"rwkv": 0.22101834427681258, "qwen": 0.29019508716709524}, "topk": {"rwkv": [61076, 1, 0.884867250919342, [[61076, 0.884867, "productive", false], [46, 0.093282, "-", false], [62383, 0.017851, " productive", false], [4811, 0.002053, " to", false], [49587, 0.000305, "product", false], [59593, 0.000246, " effective", false], [59918, 0.000162, " intuitive", false], [25390, 0.000139, "fact", false], [47687, 0.000137, " useful", false], [7865, 0.00012, "int", false]]], "qwen": [33270, 1, 0.8513615727424622, [[33270, 0.851362, "productive", false], [28645, 0.090052, "-product", false], [26236, 0.045962, " productive", false], [311, 0.007526, " to", false], [69, 0.001049, "f", false], [3031, 0.000766, "product", false], [52321, 0.00068, "-effective", false], [396, 0.000502, "int", false], [20052, 0.000213, "-int", false], [1985, 0.000205, " product", false]]]}, "raw_delta": -0.0038359731435775755, "tuned_delta": 0.0029763046635203714}, {"byte_start": 4297, "byte_end": 4298, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "47.90%", "qwen": "32.14%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.07053526490926743]], "qwen": [[11, ",", "normal", 0.16827599704265594]]}, "loss": {"rwkv": 47.90198377951636, "qwen": 32.13873548268536}, "topk": {"rwkv": [45, 2, 0.07053526490926743, [[47, 0.779105, ".", false], [45, 0.070535, ",", false], [4811, 0.055831, " to", false], [21265, 0.027356, " and", false], [4596, 0.017287, " in", false], [4423, 0.007473, " as", false], [21700, 0.007473, " for", false], [51018, 0.005734, " because", false], [275, 0.004179, " (", false], [32465, 0.003289, " when", false]]], "qwen": [11, 3, 0.16827599704265594, [[13, 0.353762, ".", false], [382, 0.180349, ".\n\n", false], [11, 0.168276, ",", false], [311, 0.077022, " to", false], [304, 0.039872, " in", false], [323, 0.038458, " and", false], [1576, 0.023677, " because", false], [979, 0.021899, " when", false], [438, 0.017857, " as", false], [25, 0.017265, ":", false]]]}, "raw_delta": 0.8741000890731812, "tuned_delta": 0.8809123668802791}, {"byte_start": 4298, "byte_end": 4302, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 717, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"rwkv": "4.54% 4.54% 4.54% 4.54%", "qwen": "5.12% 5.12% 5.12% 5.12%"}, "model_tokens": {"rwkv": [[21265, " and", "normal", 0.36687585711479187]], "qwen": [[323, " and", "normal", 0.3214159905910492]]}, "loss": {"rwkv": 4.543644049674714, "qwen": 5.117144921482811}, "topk": {"rwkv": [21265, 1, 0.36687585711479187, [[21265, 0.366876, " and", false], [4423, 0.117239, " as", false], [51018, 0.053169, " because", false], [4596, 0.030435, " in", false], [30788, 0.025946, " even", false], [39690, 0.022659, " since", false], [22187, 0.020373, " not", false], [4424, 0.018097, " at", false], [61953, 0.017519, " especially", false], [40187, 0.015622, " while", false]]], "qwen": [323, 1, 0.3214159905910492, [[323, 0.321416, " and", false], [438, 0.148337, " as", false], [1576, 0.10391, " because", false], [304, 0.049118, " in", false], [2474, 0.042246, " since", false], [6388, 0.035436, " leading", false], [448, 0.014209, " with", false], [2176, 0.013179, " both", false], [5310, 0.012899, " especially", false], [537, 0.011847, " not", false]]]}, "raw_delta": -0.03180164098739624, "tuned_delta": -0.024989363180298294}, {"byte_start": 4302, "byte_end": 4304, "display": {"text": " a", "kind": "normal"}, "is_word": true, "word_id": 718, "word_key": " a", "bytes_hex": "20 61", "compression": {"rwkv": "34.66% 34.66%", "qwen": "41.39% 41.39%"}, "model_tokens": {"rwkv": [[332, " a", "normal", 0.021267078816890717]], "qwen": [[264, " a", "normal", 0.010144878178834915]]}, "loss": {"rwkv": 34.658494146355956, "qwen": 41.39440534614516}, "topk": {"rwkv": [332, 9, 0.021267078816890717, [[22590, 0.150841, " the", false], [32232, 0.115895, " they", false], [4601, 0.037224, " it", false], [4596, 0.035444, " in", false], [61959, 0.028432, " eventually", false], [22748, 0.026091, " was", false], [22190, 0.022099, " now", false], [31581, 0.021438, " only", false], [332, 0.021267, " a", false], [39931, 0.019496, " their", false]]], "qwen": [264, 15, 0.010144878178834915, [[279, 0.161362, " the", false], [807, 0.086711, " they", false], [304, 0.066773, " in", false], [432, 0.041896, " it", false], [1172, 0.023338, " only", false], [862, 0.021538, " their", false], [5538, 0.020492, " deep", false], [6069, 0.020044, " led", false], [2711, 0.016448, " search", false], [572, 0.01333, " was", false]]]}, "raw_delta": -0.3735182285308838, "tuned_delta": -0.36670595072378587}, {"byte_start": 4304, "byte_end": 4313, "display": {"text": " colossal", "kind": "normal"}, "is_word": true, "word_id": 719, "word_key": " colossal", "bytes_hex": "20 63 6f 6c 6f 73 73 61 6c", "compression": {"rwkv": "41.42% 41.42% 41.42% 41.42% 0.02% 0.02% 0.02% 0.02% 1.34%", "qwen": "18.90% 18.90% 18.90% 18.90% 18.90% 18.90% 18.90% 18.90% 18.90%"}, "model_tokens": {"rwkv": [[21454, " col", "normal", 9.958563168765977e-05], [26568, "ossa", "normal", 0.9957708716392517], [109, "l", "normal", 0.9287788271903992]], "qwen": [[96837, " colossal", "normal", 8.025064744288102e-05]]}, "loss": {"rwkv": 18.566604918585597, "qwen": 18.896010933456505}, "topk": {"rwkv": [21454, 799, 9.958563168765977e-05, [[38961, 0.058154, " major", false], [31466, 0.033978, " much", false], [22168, 0.033617, " new", false], [45301, 0.033333, " better", false], [31458, 0.020496, " more", false], [40166, 0.019678, " waste", false], [59513, 0.015755, " different", false], [32386, 0.014797, " very", false], [30585, 0.014215, " dead", false], [51832, 0.014018, " general", false]]], "qwen": [96837, 808, 8.025064744288102e-05, [[3598, 0.053847, " major", false], [2711, 0.046389, " search", false], [501, 0.041305, " new", false], [803, 0.038808, " more", false], [1753, 0.032122, " much", false], [2155, 0.027745, " different", false], [17755, 0.02686, " lesson", false], [2244, 0.026337, " great", false], [4586, 0.024132, " general", false], [5538, 0.017797, " deep", false]]]}, "raw_delta": -0.018266148037380543, "tuned_delta": -0.011453870230282596}, {"byte_start": 4313, "byte_end": 4319, "display": {"text": " waste", "kind": "normal"}, "is_word": true, "word_id": 720, "word_key": " waste", "bytes_hex": "20 77 61 73 74 65", "compression": {"rwkv": "0.53% 0.53% 0.53% 0.53% 0.53% 0.53%", "qwen": "2.68% 2.68% 2.68% 2.68% 2.68% 2.68%"}, "model_tokens": {"rwkv": [[40166, " waste", "normal", 0.8367379903793335]], "qwen": [[12291, " waste", "normal", 0.4097566604614258]]}, "loss": {"rwkv": 0.5283307034505481, "qwen": 2.6815848432569753}, "topk": {"rwkv": [40166, 1, 0.8367379903793335, [[40166, 0.836738, " waste", false], [52245, 0.061716, " mistake", false], [31333, 0.014152, " loss", false], [38392, 0.007847, " error", false], [51708, 0.007749, " failure", false], [32251, 0.006642, " time", false], [45157, 0.00514, " amount", false], [62157, 0.003225, " investment", false], [45829, 0.003068, " effort", false], [65126, 0.0024, " disappointment", false]]], "qwen": [12291, 1, 0.4097566604614258, [[12291, 0.409757, " waste", false], [16523, 0.093011, " mistake", false], [7901, 0.071587, " failure", false], [2393, 0.051838, " success", false], [54480, 0.019745, " computational", false], [4709, 0.019731, " loss", false], [1465, 0.015853, " error", false], [9162, 0.015468, " investment", false], [5041, 0.014599, " effort", false], [3311, 0.013996, " amount", false]]]}, "raw_delta": -0.11940176288286843, "tuned_delta": -0.11258948507577048}, {"byte_start": 4319, "byte_end": 4322, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 721, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "0.12% 0.12% 0.12%", "qwen": "0.21% 0.21% 0.21%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.9804679155349731]], "qwen": [[315, " of", "normal", 0.9657832384109497]]}, "loss": {"rwkv": 0.11740682298901069, "qwen": 0.20928595655784377}, "topk": {"rwkv": [4706, 1, 0.9804679155349731, [[4706, 0.980468, " of", false], [47, 0.009844, ".", false], [45, 0.003062, ",", false], [4596, 0.002587, " in", false], [4811, 0.000702, " to", false], [21700, 0.000325, " for", false], [4588, 0.000223, " if", false], [30322, 0.000209, " both", false], [32465, 0.000189, " when", false], [275, 0.000178, " (", false]]], "qwen": [315, 1, 0.9657832384109497, [[315, 0.965783, " of", false], [13, 0.009533, ".", false], [382, 0.00845, ".\n\n", false], [11, 0.006116, ",", false], [304, 0.002787, " in", false], [311, 0.000845, " to", false], [979, 0.000714, " when", false], [369, 0.00057, " for", false], [421, 0.000532, " if", false], [429, 0.000438, " that", false]]]}, "raw_delta": -0.005094860990842183, "tuned_delta": 0.0017174168162557638}, {"byte_start": 4322, "byte_end": 4333, "display": {"text": " researcher", "kind": "normal"}, "is_word": true, "word_id": 722, "word_key": " researcher", "bytes_hex": "20 72 65 73 65 61 72 63 68 65 72", "compression": {"rwkv": "11.83% 11.83% 11.83% 11.83% 11.83% 11.83% 11.83% 11.83% 11.83% 11.83% 11.83%", "qwen": "8.72% 8.72% 8.72% 8.72% 8.72% 8.72% 8.72% 8.72% 8.72% 8.72% 8.72%"}, "model_tokens": {"rwkv": [[62496, " researcher", "normal", 0.0007423393544740975]], "qwen": [[31085, " researcher", "normal", 0.004892498254776001]]}, "loss": {"rwkv": 11.834607757292277, "qwen": 8.721832783659178}, "topk": {"rwkv": [62496, 31, 0.0007423393544740975, [[32251, 0.416293, " time", false], [45829, 0.229427, " effort", false], [57103, 0.086245, " research", false], [60406, 0.085263, " resources", false], [38720, 0.044797, " human", false], [59346, 0.02158, " computing", false], [64862, 0.012538, " computational", false], [63370, 0.011158, " computation", false], [22590, 0.009033, " the", false], [39052, 0.006418, " money", false]]], "qwen": [31085, 16, 0.004892498254776001, [[882, 0.407485, " time", false], [5041, 0.179142, " effort", false], [3412, 0.074444, " research", false], [4963, 0.057635, " resources", false], [3738, 0.038905, " human", false], [54480, 0.034954, " computational", false], [24231, 0.02493, " computing", false], [34447, 0.024742, " computation", false], [279, 0.013204, " the", false], [862, 0.012156, " their", false]]]}, "raw_delta": 0.17260889573530716, "tuned_delta": 0.1794211735424051}, {"byte_start": 4333, "byte_end": 4335, "display": {"text": "'s", "kind": "normal"}, "is_word": true, "word_id": 723, "word_key": "'s", "bytes_hex": "27 73", "compression": {"rwkv": "26.06% 26.06%", "qwen": "24.62% 24.62%"}, "model_tokens": {"rwkv": [[460, "'s", "normal", 0.055417075753211975]], "qwen": [[594, "'s", "normal", 0.06518886238336563]]}, "loss": {"rwkv": 26.06431470356037, "qwen": 24.62019143274732}, "topk": {"rwkv": [460, 3, 0.055417075753211975, [[32251, 0.647081, " time", false], [45829, 0.178733, " effort", false], [460, 0.055417, "'s", false], [21265, 0.041125, " and", false], [45860, 0.016549, " energy", false], [60406, 0.009798, " resources", false], [46, 0.009498, "-", false], [51566, 0.00516, " efforts", false], [59193, 0.003137, " attention", false], [38853, 0.002716, " labor", false]]], "qwen": [594, 3, 0.06518886238336563, [[882, 0.681477, " time", false], [5041, 0.188081, " effort", false], [594, 0.065189, "'s", false], [4963, 0.014736, " resources", false], [4802, 0.01146, " energy", false], [323, 0.006305, " and", false], [8869, 0.004525, " efforts", false], [6529, 0.004199, " attention", false], [10772, 0.002837, " talent", false], [9327, 0.001501, " labor", false]]]}, "raw_delta": 0.08007919788360596, "tuned_delta": 0.0868914756907039}, {"byte_start": 4335, "byte_end": 4340, "display": {"text": " time", "kind": "normal"}, "is_word": true, "word_id": 724, "word_key": " time", "bytes_hex": "20 74 69 6d 65", "compression": {"rwkv": "0.55% 0.55% 0.55% 0.55% 0.55%", "qwen": "1.10% 1.10% 1.10% 1.10% 1.10%"}, "model_tokens": {"rwkv": [[32251, " time", "normal", 0.8586191534996033]], "qwen": [[882, " time", "normal", 0.7375895977020264]]}, "loss": {"rwkv": 0.5529861362782403, "qwen": 1.0977745045247913}, "topk": {"rwkv": [32251, 1, 0.8586191534996033, [[32251, 0.858619, " time", false], [45829, 0.042317, " effort", false], [21265, 0.023691, " and", false], [51566, 0.018567, " efforts", false], [45860, 0.006542, " energy", false], [38720, 0.00326, " human", false], [60406, 0.003074, " resources", false], [56903, 0.002584, " precious", false], [57516, 0.002465, " valuable", false], [59193, 0.002207, " attention", false]]], "qwen": [882, 1, 0.7375895977020264, [[882, 0.73759, " time", false], [5041, 0.128003, " effort", false], [8869, 0.025919, " efforts", false], [4802, 0.008823, " energy", false], [4963, 0.006566, " resources", false], [26400, 0.00652, " precious", false], [3738, 0.006044, " human", false], [6529, 0.005272, " attention", false], [323, 0.004589, " and", false], [15172, 0.004549, " valuable", false]]]}, "raw_delta": -0.030209481716156006, "tuned_delta": -0.02339720390905806}, {"byte_start": 4340, "byte_end": 4341, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "39.73%", "qwen": "40.43%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.11174280941486359]], "qwen": [[11, ",", "normal", 0.10624746233224869]]}, "loss": {"rwkv": 39.73046889948122, "qwen": 40.4312466069519}, "topk": {"rwkv": [45, 3, 0.11174280941486359, [[47, 0.657126, ".", false], [21265, 0.140788, " and", false], [45, 0.111743, ",", false], [4811, 0.023102, " to", false], [4596, 0.011414, " in", false], [275, 0.008161, " (", false], [32227, 0.00604, " that", false], [5346, 0.004063, "---", false], [4423, 0.003247, " as", false], [32465, 0.002621, " when", false]]], "qwen": [11, 4, 0.10624746233224869, [[323, 0.304828, " and", false], [13, 0.26084, ".", false], [382, 0.254418, ".\n\n", false], [11, 0.106247, ",", false], [304, 0.010195, " in", false], [311, 0.009514, " to", false], [320, 0.00708, " (", false], [624, 0.005238, ".\n", false], [4421, 0.004562, "---", false], [979, 0.004306, " when", false]]]}, "raw_delta": -0.03885936737060547, "tuned_delta": -0.03204708956350752}, {"byte_start": 4341, "byte_end": 4346, "display": {"text": " when", "kind": "normal"}, "is_word": true, "word_id": 725, "word_key": " when", "bytes_hex": "20 77 68 65 6e", "compression": {"rwkv": "12.40% 12.40% 12.40% 12.40% 12.40%", "qwen": "12.28% 12.28% 12.28% 12.28% 12.28%"}, "model_tokens": {"rwkv": [[32465, " when", "normal", 0.032588403671979904]], "qwen": [[979, " when", "normal", 0.03321311995387077]]}, "loss": {"rwkv": 12.398160507639528, "qwen": 12.280257801340529}, "topk": {"rwkv": [32465, 6, 0.032588403671979904, [[4811, 0.433315, " to", false], [51018, 0.069787, " because", false], [4423, 0.051815, " as", false], [4596, 0.04416, " in", false], [21265, 0.037578, " and", false], [32465, 0.032588, " when", false], [45860, 0.02982, " energy", false], [21700, 0.027544, " for", false], [22187, 0.025855, " not", false], [45829, 0.023528, " effort", false]]], "qwen": [979, 9, 0.03321311995387077, [[5041, 0.246581, " effort", false], [4802, 0.103955, " energy", false], [1576, 0.079911, " because", false], [438, 0.069456, " as", false], [323, 0.051911, " and", false], [3220, 0.050327, " money", false], [304, 0.041387, " in", false], [311, 0.035333, " to", false], [979, 0.033213, " when", false], [4963, 0.023515, " resources", false]]]}, "raw_delta": 0.006537914276123047, "tuned_delta": 0.013350192083220993}, {"byte_start": 4346, "byte_end": 4347, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "96.37%", "qwen": "80.84%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.004729280713945627]], "qwen": [[11, ",", "normal", 0.01130516454577446]]}, "loss": {"rwkv": 96.36752030937997, "qwen": 80.8359218943455}, "topk": {"rwkv": [45, 32, 0.004729280713945627, [[22590, 0.251335, " the", false], [32232, 0.087882, " they", false], [4601, 0.087281, " it", false], [30597, 0.037659, " deep", false], [32227, 0.028997, " that", false], [332, 0.028844, " a", false], [4596, 0.022671, " in", false], [31458, 0.017848, " more", false], [45301, 0.017509, " better", false], [53087, 0.014953, " systems", false]]], "qwen": [11, 14, 0.01130516454577446, [[279, 0.162434, " the", false], [7707, 0.108965, " compared", false], [432, 0.107384, " it", false], [807, 0.078017, " they", false], [2711, 0.070108, " search", false], [264, 0.035017, " a", false], [10951, 0.027206, " massive", false], [803, 0.022081, " more", false], [304, 0.018598, " in", false], [5538, 0.014809, " deep", false]]]}, "raw_delta": 0.8612546920776367, "tuned_delta": 0.8680669698847346}, {"byte_start": 4347, "byte_end": 4355, "display": {"text": " through", "kind": "normal"}, "is_word": true, "word_id": 726, "word_key": " through", "bytes_hex": "20 74 68 72 6f 75 67 68", "compression": {"rwkv": "13.95% 13.95% 13.95% 13.95% 13.95% 13.95% 13.95% 13.95%", "qwen": "15.75% 15.75% 15.75% 15.75% 15.75% 15.75% 15.75% 15.75%"}, "model_tokens": {"rwkv": [[53140, " through", "normal", 0.0020845341496169567]], "qwen": [[1526, " through", "normal", 0.0009252128074876964]]}, "loss": {"rwkv": 13.947930571094469, "qwen": 15.746761609962658}, "topk": {"rwkv": [53140, 39, 0.0020845341496169567, [[4596, 0.249379, " in", false], [52028, 0.171302, " instead", false], [4423, 0.089499, " as", false], [31578, 0.0381, " once", false], [4450, 0.035566, " by", false], [61959, 0.033788, " eventually", false], [32487, 0.033177, " with", false], [31601, 0.021918, " over", false], [4424, 0.02046, " at", false], [51744, 0.019397, " finally", false]]], "qwen": [1526, 62, 0.0009252128074876964, [[304, 0.329289, " in", false], [438, 0.123083, " as", false], [4518, 0.066681, " instead", false], [518, 0.054587, " at", false], [448, 0.034583, " with", false], [916, 0.0274, " over", false], [1283, 0.022602, " after", false], [553, 0.021075, " by", false], [389, 0.020413, " on", false], [3055, 0.018127, " once", false]]]}, "raw_delta": -0.09974837303161621, "tuned_delta": -0.09293609522451826}, {"byte_start": 4355, "byte_end": 4361, "display": {"text": " Moore", "kind": "normal"}, "is_word": true, "word_id": 727, "word_key": " moore", "bytes_hex": "20 4d 6f 6f 72 65", "compression": {"rwkv": "13.81% 13.81% 13.81% 13.81% 13.81% 13.81%", "qwen": "16.54% 16.54% 16.54% 16.54% 16.54% 16.54%"}, "model_tokens": {"rwkv": [[37045, " Moore", "normal", 0.01026393286883831]], "qwen": [[20219, " Moore", "normal", 0.0040683140978217125]]}, "loss": {"rwkv": 13.807042383507657, "qwen": 16.54448593772471}, "topk": {"rwkv": [37045, 17, 0.01026393286883831, [[22590, 0.198646, " the", false], [52195, 0.121743, " massive", false], [56537, 0.07133, " learning", false], [63370, 0.058153, " computation", false], [30597, 0.04493, " deep", false], [63885, 0.025077, " statistical", false], [332, 0.022732, " a", false], [51832, 0.018274, " general", false], [39660, 0.017623, " sheer", false], [4692, 0.015363, " no", false]]], "qwen": [20219, 27, 0.0040683140978217125, [[279, 0.237795, " the", false], [10951, 0.09182, " massive", false], [6832, 0.059796, " learning", false], [32538, 0.048165, " sheer", false], [2711, 0.044429, " search", false], [34447, 0.035206, " computation", false], [5538, 0.024726, " deep", false], [264, 0.02464, " a", false], [1753, 0.015854, " much", false], [990, 0.013902, " use", false]]]}, "raw_delta": -0.1517961025238037, "tuned_delta": -0.14498382471670576}, {"byte_start": 4361, "byte_end": 4363, "display": {"text": "'s", "kind": "normal"}, "is_word": true, "word_id": 728, "word_key": "'s", "bytes_hex": "27 73", "compression": {"rwkv": "0.04% 0.04%", "qwen": "0.03% 0.03%"}, "model_tokens": {"rwkv": [[460, "'s", "normal", 0.9959465861320496]], "qwen": [[594, "'s", "normal", 0.9965344667434692]]}, "loss": {"rwkv": 0.03632273586222518, "qwen": 0.03130233932751536}, "topk": {"rwkv": [460, 1, 0.9959465861320496, [[460, 0.995947, "'s", false], [116, 0.002293, "s", false], [28309, 0.00056, "’s", false], [40, 0.000215, "'", false], [21265, 0.000194, " and", false], [45, 0.000151, ",", false], [46, 0.000133, "-", false], [439, 3e-05, "''", false], [21988, 2.7e-05, " law", false], [4522, 2.5e-05, " et", false]]], "qwen": [594, 1, 0.9965344667434692, [[594, 0.996534, "'s", false], [748, 0.000975, "’s", false], [11, 0.000548, ",", false], [2329, 0.000432, " law", false], [6, 0.000262, "'", false], [12681, 0.000169, "-like", false], [323, 0.000102, " and", false], [4605, 9.1e-05, "''", false], [11297, 6.5e-05, "-style", false], [364, 4.8e-05, " '", false]]]}, "raw_delta": 0.0002783898962661624, "tuned_delta": 0.007090667703364109}, {"byte_start": 4363, "byte_end": 4367, "display": {"text": " law", "kind": "normal"}, "is_word": true, "word_id": 729, "word_key": " law", "bytes_hex": "20 6c 61 77", "compression": {"rwkv": "0.29% 0.29% 0.29% 0.29%", "qwen": "0.30% 0.30% 0.30% 0.30%"}, "model_tokens": {"rwkv": [[21988, " law", "normal", 0.9370143413543701]], "qwen": [[2329, " law", "normal", 0.9363114237785339]]}, "loss": {"rwkv": 0.29278326482884537, "qwen": 0.29668629688294773}, "topk": {"rwkv": [21988, 1, 0.9370143413543701, [[21988, 0.937014, " law", false], [20267, 0.061032, " Law", false], [31259, 0.000202, " laws", false], [21265, 0.000191, " and", false], [45828, 0.000133, " effect", false], [46, 0.000113, "-", false], [45, 9.1e-05, ",", false], [53127, 7.5e-05, " theorem", false], [31907, 7e-05, " rule", false], [4715, 5.6e-05, " or", false]]], "qwen": [2329, 1, 0.9363114237785339, [[2329, 0.936311, " law", false], [7506, 0.050916, " Law", false], [6872, 0.003729, " laws", false], [220, 0.000412, " ", false], [5912, 0.000322, " rule", false], [323, 0.000269, " and", false], [5098, 0.000241, " progress", false], [320, 0.000219, " (", false], [30312, 0.000192, "-law", false], [10963, 0.000187, " magic", false]]]}, "raw_delta": -0.00021643005311489105, "tuned_delta": 0.006595847753983056}, {"byte_start": 4367, "byte_end": 4368, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "2.34%", "qwen": "2.48%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.8773338198661804]], "qwen": [[11, ",", "normal", 0.8713169097900391]]}, "loss": {"rwkv": 2.342266118630763, "qwen": 2.4841316513756824}, "topk": {"rwkv": [45, 1, 0.8773338198661804, [[45, 0.877334, ",", false], [21265, 0.083238, " and", false], [4706, 0.011959, " of", false], [4715, 0.007851, " or", false], [46, 0.004767, "-", false], [275, 0.003495, " (", false], [460, 0.001001, "'s", false], [22590, 0.00058, " the", false], [4596, 0.000577, " in", false], [45796, 0.000546, " driven", false]]], "qwen": [11, 1, 0.8713169097900391, [[11, 0.871317, ",", false], [323, 0.097784, " and", false], [320, 0.006191, " (", false], [476, 0.002729, " or", false], [31405, 0.002712, "-driven", false], [315, 0.001506, " of", false], [594, 0.001459, "'s", false], [304, 0.001161, " in", false], [10856, 0.00105, " combined", false], [12681, 0.001013, "-like", false]]]}, "raw_delta": -0.007866695523262024, "tuned_delta": -0.001054417716164077}, {"byte_start": 4368, "byte_end": 4376, "display": {"text": " massive", "kind": "normal"}, "is_word": true, "word_id": 730, "word_key": " massive", "bytes_hex": "20 6d 61 73 73 69 76 65", "compression": {"rwkv": "6.97% 6.97% 6.97% 6.97% 6.97% 6.97% 6.97% 6.97%", "qwen": "6.46% 6.46% 6.46% 6.46% 6.46% 6.46% 6.46% 6.46%"}, "model_tokens": {"rwkv": [[52195, " massive", "normal", 0.04572311043739319]], "qwen": [[10951, " massive", "normal", 0.057061079889535904]]}, "loss": {"rwkv": 6.9739652855472345, "qwen": 6.455233363797967}, "topk": {"rwkv": [52195, 5, 0.04572311043739319, [[22590, 0.258517, " the", false], [63370, 0.124595, " computation", false], [32232, 0.060972, " they", false], [31458, 0.052711, " more", false], [52195, 0.045723, " massive", false], [4601, 0.039022, " it", false], [332, 0.02519, " a", false], [32227, 0.022812, " that", false], [45301, 0.022689, " better", false], [30597, 0.018372, " deep", false]]], "qwen": [10951, 5, 0.057061079889535904, [[279, 0.17426, " the", false], [807, 0.081228, " they", false], [803, 0.074922, " more", false], [34447, 0.072744, " computation", false], [10951, 0.057061, " massive", false], [1753, 0.047729, " much", false], [432, 0.04672, " it", false], [264, 0.032111, " a", false], [862, 0.018677, " their", false], [1052, 0.016162, " there", false]]]}, "raw_delta": 0.02876460552215576, "tuned_delta": 0.03557688332925371}, {"byte_start": 4376, "byte_end": 4388, "display": {"text": " computation", "kind": "normal"}, "is_word": true, "word_id": 731, "word_key": " computation", "bytes_hex": "20 63 6f 6d 70 75 74 61 74 69 6f 6e", "compression": {"rwkv": "2.24% 2.24% 2.24% 2.24% 2.24% 2.24% 2.24% 2.24% 2.24% 2.24% 2.24% 2.24%", "qwen": "1.84% 1.84% 1.84% 1.84% 1.84% 1.84% 1.84% 1.84% 1.84% 1.84% 1.84% 1.84%"}, "model_tokens": {"rwkv": [[63370, " computation", "normal", 0.22585022449493408]], "qwen": [[34447, " computation", "normal", 0.2932566702365875]]}, "loss": {"rwkv": 2.2424703190901036, "qwen": 1.8435042490241822}, "topk": {"rwkv": [63370, 2, 0.22585022449493408, [[50897, 0.404789, " amounts", false], [63370, 0.22585, " computation", false], [64423, 0.032298, " improvements", false], [22168, 0.031798, " new", false], [45, 0.023341, ",", false], [64862, 0.023207, " computational", false], [59847, 0.019355, " increases", false], [31458, 0.018579, " more", false], [63621, 0.016658, " improvement", false], [61535, 0.016598, " additional", false]]], "qwen": [34447, 2, 0.2932566702365875, [[14713, 0.427977, " amounts", false], [34447, 0.293257, " computation", false], [54480, 0.049017, " computational", false], [24231, 0.022304, " computing", false], [11, 0.02115, ",", false], [5107, 0.014191, " additional", false], [32676, 0.012414, " quantities", false], [12703, 0.01168, " increases", false], [803, 0.011543, " more", false], [501, 0.009909, " new", false]]]}, "raw_delta": 0.02212337652842203, "tuned_delta": 0.028935654335519975}, {"byte_start": 4388, "byte_end": 4395, "display": {"text": " became", "kind": "normal"}, "is_word": true, "word_id": 732, "word_key": " became", "bytes_hex": "20 62 65 63 61 6d 65", "compression": {"rwkv": "2.33% 2.33% 2.33% 2.33% 2.33% 2.33% 2.33%", "qwen": "2.41% 2.41% 2.41% 2.41% 2.41% 2.41% 2.41%"}, "model_tokens": {"rwkv": [[45283, " became", "normal", 0.4029938280582428]], "qwen": [[6116, " became", "normal", 0.39302074909210205]]}, "loss": {"rwkv": 2.3347185371528982, "qwen": 2.405933328200484}, "topk": {"rwkv": [45283, 1, 0.4029938280582428, [[45283, 0.402994, " became", false], [22748, 0.229425, " was", false], [30383, 0.048071, " came", false], [38128, 0.048021, " could", false], [21265, 0.047609, " and", false], [51744, 0.022415, " finally", false], [4600, 0.015112, " is", false], [21795, 0.013363, " had", false], [51019, 0.009749, " becomes", false], [45, 0.00943, ",", false]]], "qwen": [6116, 1, 0.39302074909210205, [[6116, 0.393021, " became", false], [572, 0.194667, " was", false], [1410, 0.040672, " could", false], [3697, 0.03836, " came", false], [9583, 0.036963, " eventually", false], [323, 0.022499, " and", false], [9044, 0.021965, " becomes", false], [374, 0.019237, " is", false], [1035, 0.015391, " would", false], [5499, 0.014598, " finally", false]]]}, "raw_delta": -0.003948986530303955, "tuned_delta": 0.002863291276793992}, {"byte_start": 4395, "byte_end": 4405, "display": {"text": " available", "kind": "normal"}, "is_word": true, "word_id": 733, "word_key": " available", "bytes_hex": "20 61 76 61 69 6c 61 62 6c 65", "compression": {"rwkv": "0.75% 0.75% 0.75% 0.75% 0.75% 0.75% 0.75% 0.75% 0.75% 0.75%", "qwen": "0.83% 0.83% 0.83% 0.83% 0.83% 0.83% 0.83% 0.83% 0.83% 0.83%"}, "model_tokens": {"rwkv": [[59206, " available", "normal", 0.660444438457489]], "qwen": [[2500, " available", "normal", 0.6327334046363831]]}, "loss": {"rwkv": 0.7537518035894487, "qwen": 0.8254128896160231}, "topk": {"rwkv": [59206, 1, 0.660444438457489, [[59206, 0.660444, " available", false], [22590, 0.075782, " the", false], [31458, 0.036878, " more", false], [332, 0.021705, " a", false], [52648, 0.014498, " readily", false], [59758, 0.014291, " generally", false], [56895, 0.013713, " possible", false], [64430, 0.010863, " increasingly", false], [46042, 0.009401, " freely", false], [31466, 0.008684, " much", false]]], "qwen": [2500, 1, 0.6327334046363831, [[2500, 0.632733, " available", false], [30268, 0.039508, " readily", false], [279, 0.037552, " the", false], [803, 0.032959, " more", false], [3204, 0.02564, " possible", false], [1753, 0.019598, " much", false], [773, 0.017614, " so", false], [13570, 0.013775, " widely", false], [14756, 0.01292, " increasingly", false], [264, 0.01292, " a", false]]]}, "raw_delta": -0.003973734378814701, "tuned_delta": 0.0028385434282832455}, {"byte_start": 4405, "byte_end": 4409, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 734, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"rwkv": "13.24% 13.24% 13.24% 13.24%", "qwen": "11.87% 11.87% 11.87% 11.87%"}, "model_tokens": {"rwkv": [[21265, " and", "normal", 0.052669163793325424]], "qwen": [[323, " and", "normal", 0.07190161198377609]]}, "loss": {"rwkv": 13.243489633160404, "qwen": 11.868226065969685}, "topk": {"rwkv": [21265, 4, 0.052669163793325424, [[47, 0.401778, ".", false], [4811, 0.186808, " to", false], [4424, 0.092223, " at", false], [21265, 0.052669, " and", false], [45, 0.048373, ",", false], [21700, 0.038557, " for", false], [52028, 0.036553, " instead", false], [4596, 0.035934, " in", false], [32227, 0.026736, " that", false], [4423, 0.00933, " as", false]]], "qwen": [323, 5, 0.07190161198377609, [[382, 0.23149, ".\n\n", false], [13, 0.215409, ".", false], [311, 0.10388, " to", false], [429, 0.0986, " that", false], [323, 0.071902, " and", false], [11, 0.058201, ",", false], [304, 0.038352, " in", false], [518, 0.032441, " at", false], [369, 0.027997, " for", false], [4518, 0.015276, " instead", false]]]}, "raw_delta": 0.07626080513000488, "tuned_delta": 0.08307308293710283}, {"byte_start": 4409, "byte_end": 4411, "display": {"text": " a", "kind": "normal"}, "is_word": true, "word_id": 735, "word_key": " a", "bytes_hex": "20 61", "compression": {"rwkv": "43.96% 43.96%", "qwen": "37.09% 37.09%"}, "model_tokens": {"rwkv": [[332, " a", "normal", 0.0076840342953801155]], "qwen": [[264, " a", "normal", 0.01634964533150196]]}, "loss": {"rwkv": 43.9571145270856, "qwen": 37.0912317384731}, "topk": {"rwkv": [332, 22, 0.0076840342953801155, [[22590, 0.137738, " the", false], [38128, 0.094137, " could", false], [22748, 0.075995, " was", false], [4601, 0.042632, " it", false], [31351, 0.033765, " made", false], [50887, 0.019717, " allowed", false], [51596, 0.018341, " enabled", false], [22249, 0.017491, " out", false], [45, 0.015518, ",", false], [38720, 0.014595, " human", false]]], "qwen": [264, 10, 0.01634964533150196, [[279, 0.120917, " the", false], [1410, 0.117716, " could", false], [572, 0.067555, " was", false], [432, 0.034898, " it", false], [4362, 0.022412, " needed", false], [2711, 0.020414, " search", false], [429, 0.019385, " that", false], [803, 0.017654, " more", false], [5538, 0.017278, " deep", false], [264, 0.01635, " a", false]]]}, "raw_delta": 0.3807253837585449, "tuned_delta": 0.38753766156564284}, {"byte_start": 4411, "byte_end": 4417, "display": {"text": " means", "kind": "normal"}, "is_word": true, "word_id": 736, "word_key": " means", "bytes_hex": "20 6d 65 61 6e 73", "compression": {"rwkv": "28.55% 28.55% 28.55% 28.55% 28.55% 28.55%", "qwen": "27.04% 27.04% 27.04% 27.04% 27.04% 27.04%"}, "model_tokens": {"rwkv": [[38989, " means", "normal", 7.385296339634806e-05]], "qwen": [[3363, " means", "normal", 0.0001237821561517194]]}, "loss": {"rwkv": 28.553339350927395, "qwen": 27.041477130100134}, "topk": {"rwkv": [38989, 519, 7.385296339634806e-05, [[59513, 0.129398, " different", false], [45301, 0.113497, " better", false], [22168, 0.089964, " new", false], [31466, 0.059709, " much", false], [63885, 0.058156, " statistical", false], [31458, 0.057527, " more", false], [47202, 0.024261, " search", false], [51832, 0.021527, " general", false], [47708, 0.021364, " vastly", false], [52907, 0.015232, " simpler", false]]], "qwen": [3363, 346, 0.0001237821561517194, [[2711, 0.096738, " search", false], [2155, 0.089491, " different", false], [501, 0.086501, " new", false], [1753, 0.050604, " much", false], [2664, 0.050082, " better", false], [803, 0.047499, " more", false], [4285, 0.04206, " simple", false], [4586, 0.039017, " general", false], [28464, 0.035356, " statistical", false], [1714, 0.027322, " method", false]]]}, "raw_delta": 0.08383544286092115, "tuned_delta": 0.0906477206680191}, {"byte_start": 4417, "byte_end": 4421, "display": {"text": " was", "kind": "normal"}, "is_word": true, "word_id": 737, "word_key": " was", "bytes_hex": "20 77 61 73", "compression": {"rwkv": "10.78% 10.78% 10.78% 10.78%", "qwen": "10.58% 10.58% 10.58% 10.58%"}, "model_tokens": {"rwkv": [[22748, " was", "normal", 0.09214911609888077]], "qwen": [[572, " was", "normal", 0.09576229751110077]]}, "loss": {"rwkv": 10.777946350391181, "qwen": 10.576245097459278}, "topk": {"rwkv": [22748, 3, 0.09214911609888077, [[4706, 0.526162, " of", false], [4811, 0.257438, " to", false], [22748, 0.092149, " was", false], [21700, 0.068776, " for", false], [38128, 0.011346, " could", false], [4450, 0.010506, " by", false], [51680, 0.005162, " existed", false], [21795, 0.002487, " had", false], [32227, 0.002302, " that", false], [38547, 0.002106, " found", false]]], "qwen": [572, 4, 0.09576229751110077, [[315, 0.379491, " of", false], [311, 0.286611, " to", false], [369, 0.135096, " for", false], [572, 0.095762, " was", false], [1410, 0.023275, " could", false], [429, 0.01598, " that", false], [1030, 0.009299, " had", false], [553, 0.00645, " by", false], [803, 0.003219, " more", false], [2664, 0.002605, " better", false]]]}, "raw_delta": 0.0111846923828125, "tuned_delta": 0.017996970189910446}, {"byte_start": 4421, "byte_end": 4427, "display": {"text": " found", "kind": "normal"}, "is_word": true, "word_id": 738, "word_key": " found", "bytes_hex": "20 66 6f 75 6e 64", "compression": {"rwkv": "0.52% 0.52% 0.52% 0.52% 0.52% 0.52%", "qwen": "1.24% 1.24% 1.24% 1.24% 1.24% 1.24%"}, "model_tokens": {"rwkv": [[38547, " found", "normal", 0.8433468341827393]], "qwen": [[1730, " found", "normal", 0.6622791886329651]]}, "loss": {"rwkv": 0.5195251917263722, "qwen": 1.2385177429836738}, "topk": {"rwkv": [38547, 1, 0.8433468341827393, [[38547, 0.843347, " found", false], [61885, 0.044637, " discovered", false], [59506, 0.01836, " developed", false], [51744, 0.017864, " finally", false], [56976, 0.017676, " provided", false], [51458, 0.008815, " devised", false], [59206, 0.005873, " available", false], [56492, 0.004515, " invented", false], [4424, 0.004499, " at", false], [61959, 0.003491, " eventually", false]]], "qwen": [1730, 1, 0.6622791886329651, [[1730, 0.662279, " found", false], [11105, 0.070285, " discovered", false], [3897, 0.054142, " provided", false], [4362, 0.043026, " needed", false], [5499, 0.015155, " finally", false], [3465, 0.011804, " created", false], [2500, 0.00995, " available", false], [518, 0.009313, " at", false], [9555, 0.008666, " established", false], [7881, 0.008553, " developed", false]]]}, "raw_delta": -0.039869412779808044, "tuned_delta": -0.033057134972710095}, {"byte_start": 4427, "byte_end": 4430, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 739, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "1.23% 1.23% 1.23%", "qwen": "0.98% 0.98% 0.98%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.8154839873313904]], "qwen": [[311, " to", "normal", 0.8500741124153137]]}, "loss": {"rwkv": 1.2327716413846121, "qwen": 0.976414391582807}, "topk": {"rwkv": [4811, 1, 0.8154839873313904, [[4811, 0.815484, " to", false], [4706, 0.082028, " of", false], [21700, 0.043404, " for", false], [275, 0.014388, " (", false], [45, 0.011061, ",", false], [32227, 0.009429, " that", false], [4450, 0.007763, " by", false], [5346, 0.003003, "---", false], [4596, 0.001402, " in", false], [22187, 0.001344, " not", false]]], "qwen": [311, 1, 0.8500741124153137, [[311, 0.850074, " to", false], [369, 0.070927, " for", false], [315, 0.019311, " of", false], [429, 0.013787, " that", false], [11, 0.006648, ",", false], [553, 0.005246, " by", false], [304, 0.004791, " in", false], [320, 0.002589, " (", false], [537, 0.002422, " not", false], [1526, 0.002282, " through", false]]]}, "raw_delta": 0.014215464393297829, "tuned_delta": 0.021027742200395775}, {"byte_start": 4430, "byte_end": 4434, "display": {"text": " put", "kind": "normal"}, "is_word": true, "word_id": 740, "word_key": " put", "bytes_hex": "20 70 75 74", "compression": {"rwkv": "13.38% 13.38% 13.38% 13.38%", "qwen": "10.10% 10.10% 10.10% 10.10%"}, "model_tokens": {"rwkv": [[22339, " put", "normal", 0.0510951429605484]], "qwen": [[2182, " put", "normal", 0.10636377334594727]]}, "loss": {"rwkv": 13.384377820747218, "qwen": 10.102878974332917}, "topk": {"rwkv": [22339, 6, 0.0510951429605484, [[22681, 0.138468, " use", false], [31358, 0.102752, " make", false], [56540, 0.09336, " leverage", false], [32187, 0.086116, " take", false], [53251, 0.060811, " utilize", false], [22339, 0.051095, " put", false], [37911, 0.049184, " bring", false], [37730, 0.041801, " apply", false], [51690, 0.025603, " exploit", false], [21751, 0.023724, " get", false]]], "qwen": [2182, 1, 0.10636377334594727, [[2182, 0.106364, " put", false], [32064, 0.095979, " leverage", false], [1896, 0.090858, " take", false], [1281, 0.090596, " make", false], [990, 0.085173, " use", false], [32408, 0.044063, " harness", false], [32194, 0.036651, " exploit", false], [4446, 0.033395, " bring", false], [3796, 0.030367, " apply", false], [28066, 0.025767, " utilize", false]]]}, "raw_delta": 0.1819649338722229, "tuned_delta": 0.18877721167932085}, {"byte_start": 4434, "byte_end": 4437, "display": {"text": " it", "kind": "normal"}, "is_word": true, "word_id": 741, "word_key": " it", "bytes_hex": "20 69 74", "compression": {"rwkv": "5.52% 5.52% 5.52%", "qwen": "3.44% 3.44% 3.44%"}, "model_tokens": {"rwkv": [[4601, " it", "normal", 0.39347437024116516]], "qwen": [[432, " it", "normal", 0.5642081499099731]]}, "loss": {"rwkv": 5.518120680483502, "qwen": 3.44041941494408}, "topk": {"rwkv": [4601, 2, 0.39347437024116516, [[32227, 0.415094, " that", false], [4601, 0.393474, " it", false], [22590, 0.048413, " the", false], [52195, 0.02259, " massive", false], [21256, 0.01442, " all", false], [32234, 0.011916, " this", false], [332, 0.009699, " a", false], [63370, 0.009585, " computation", false], [31466, 0.009323, " much", false], [32139, 0.008515, " such", false]]], "qwen": [432, 1, 0.5642081499099731, [[432, 0.564208, " it", false], [429, 0.290662, " that", false], [419, 0.021829, " this", false], [279, 0.014798, " the", false], [678, 0.013609, " all", false], [803, 0.010546, " more", false], [10951, 0.010346, " massive", false], [34447, 0.009711, " computation", false], [1496, 0.005578, " even", false], [264, 0.005563, " a", false]]]}, "raw_delta": 0.11521222194035846, "tuned_delta": 0.12202449974745641}, {"byte_start": 4437, "byte_end": 4440, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 742, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "2.40% 2.40% 2.40%", "qwen": "0.97% 0.97% 0.97%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.6676056385040283]], "qwen": [[311, " to", "normal", 0.8510703444480896]]}, "loss": {"rwkv": 2.3950991889758177, "qwen": 0.9693738518131108}, "topk": {"rwkv": [4811, 1, 0.6676056385040283, [[4811, 0.667606, " to", false], [4596, 0.121844, " in", false], [21256, 0.056667, " all", false], [31162, 0.054442, " into", false], [39934, 0.046419, " there", false], [4424, 0.014691, " at", false], [46301, 0.00557, " inside", false], [40185, 0.004974, " where", false], [63507, 0.003536, " effectively", false], [56003, 0.002809, " directly", false]]], "qwen": [311, 1, 0.8510703444480896, [[311, 0.85107, " to", false], [304, 0.050348, " in", false], [1119, 0.038508, " into", false], [13444, 0.021227, " effectively", false], [5961, 0.009136, " directly", false], [990, 0.002848, " use", false], [518, 0.002263, " at", false], [29720, 0.002102, " efficiently", false], [678, 0.001641, " all", false], [7225, 0.001396, " fully", false]]]}, "raw_delta": 0.07905899981657663, "tuned_delta": 0.08587127762367458}, {"byte_start": 4440, "byte_end": 4445, "display": {"text": " good", "kind": "normal"}, "is_word": true, "word_id": 743, "word_key": " good", "bytes_hex": "20 67 6f 6f 64", "compression": {"rwkv": "8.17% 8.17% 8.17% 8.17% 8.17%", "qwen": "8.16% 8.16% 8.16% 8.16% 8.16%"}, "model_tokens": {"rwkv": [[30992, " good", "normal", 0.10217726230621338]], "qwen": [[1661, " good", "normal", 0.10399079322814941]]}, "loss": {"rwkv": 8.171514880035144, "qwen": 8.163681070288343}, "topk": {"rwkv": [30992, 3, 0.10217726230621338, [[22681, 0.332075, " use", false], [32499, 0.237896, " work", false], [30992, 0.102177, " good", false], [59593, 0.08404, " effective", false], [45301, 0.076392, " better", false], [31466, 0.020722, " much", false], [22590, 0.019238, " the", false], [62383, 0.018498, " productive", false], [30273, 0.010043, " best", false], [31458, 0.006543, " more", false]]], "qwen": [1661, 3, 0.10399079322814941, [[990, 0.247732, " use", false], [975, 0.241505, " work", false], [1661, 0.103991, " good", false], [2664, 0.088417, " better", false], [7373, 0.053809, " effective", false], [279, 0.039391, " the", false], [1850, 0.03241, " best", false], [1753, 0.018473, " much", false], [803, 0.014827, " more", false], [26236, 0.01261, " productive", false]]]}, "raw_delta": 0.0004343986511230469, "tuned_delta": 0.007246676458220994}, {"byte_start": 4445, "byte_end": 4449, "display": {"text": " use", "kind": "normal"}, "is_word": true, "word_id": 744, "word_key": " use", "bytes_hex": "20 75 73 65", "compression": {"rwkv": "0.16% 0.16% 0.16% 0.16%", "qwen": "0.16% 0.16% 0.16% 0.16%"}, "model_tokens": {"rwkv": [[22681, " use", "normal", 0.9643017053604126]], "qwen": [[990, " use", "normal", 0.9658353328704834]]}, "loss": {"rwkv": 0.1640026558627743, "qwen": 0.15672154192403911}, "topk": {"rwkv": [22681, 1, 0.9643017053604126, [[22681, 0.964302, " use", false], [45828, 0.007026, " effect", false], [45, 0.005204, ",", false], [59093, 0.003475, " advantage", false], [32499, 0.002191, " work", false], [21265, 0.001903, " and", false], [51832, 0.001314, " general", false], [50845, 0.001, " account", false], [275, 0.000837, " (", false], [60212, 0.000712, " practical", false]]], "qwen": [990, 1, 0.9658353328704834, [[990, 0.965835, " use", false], [2456, 0.0087, " effect", false], [975, 0.007098, " work", false], [2692, 0.002582, " account", false], [9423, 0.001591, " advantage", false], [323, 0.001557, " and", false], [11, 0.001498, ",", false], [5711, 0.00129, " uses", false], [7428, 0.001177, " purpose", false], [320, 0.001028, " (", false]]]}, "raw_delta": 0.0004037506878376007, "tuned_delta": 0.007216028494935548}, {"byte_start": 4449, "byte_end": 4451, "display": {"text": ".\n", "kind": "control"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e 0a", "compression": {"rwkv": "3.58% 1.98%", "qwen": "4.00% 4.00%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.8181652426719666], [261, "\n\n", "control", 0.8008716106414795]], "qwen": [[382, ".\n\n", "control", 0.5144608616828918]]}, "loss": {"rwkv": 2.7781389489774653, "qwen": 3.9952780839930266}, "topk": {"rwkv": [47, 1, 0.8181652426719666, [[47, 0.818165, ".", false], [4596, 0.060635, " in", false], [45, 0.026597, ",", false], [5346, 0.016723, "---", false], [53356, 0.014185, " without", false], [52028, 0.009658, " instead", false], [275, 0.005792, " (", false], [4450, 0.005722, " by", false], [4712, 0.003364, " on", false], [21700, 0.002988, " for", false]]], "qwen": [382, 1, 0.5144608616828918, [[382, 0.514461, ".\n\n", false], [13, 0.244287, ".", false], [304, 0.056674, " in", false], [11, 0.029495, ",", false], [624, 0.01973, ".\n", false], [553, 0.017578, " by", false], [2041, 0.017143, " without", false], [4192, 0.014547, ".\n\n\n", false], [4421, 0.014191, "---", false], [1526, 0.009009, " through", false]]]}, "raw_delta": -0.06749252478281656, "tuned_delta": -0.06068024697571861}, {"byte_start": 4451, "byte_end": 4452, "display": {"text": "\n", "kind": "control"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "0a", "compression": {"rwkv": "1.98%", "qwen": "4.00%"}, "model_tokens": {"rwkv": [[261, "\n\n", "control", 0.8008716106414795]], "qwen": [[382, ".\n\n", "control", 0.5144608616828918]]}, "loss": {"rwkv": 1.9812401379395552, "qwen": 3.9952780839930266}, "topk": {"rwkv": [261, 1, 0.8008716106414795, [[261, 0.800872, "\n\n", false], [267, 0.026143, "  ", false], [20996, 0.018942, " The", false], [0, 0.01307, "[0]", false], [3913, 0.010173, " In", false], [11, 0.009906, "\n", false], [3328, 0.009204, "\n\n\n", false], [3918, 0.007727, " It", false], [3336, 0.007469, " \n\n", false], [29894, 0.005156, " This", false]]], "qwen": [382, 1, 0.5144608616828918, [[382, 0.514461, ".\n\n", false], [13, 0.244287, ".", false], [304, 0.056674, " in", false], [11, 0.029495, ",", false], [624, 0.01973, ".\n", false], [553, 0.017578, " by", false], [2041, 0.017143, " without", false], [4192, 0.014547, ".\n\n\n", false], [4421, 0.014191, "---", false], [1526, 0.009009, " through", false]]]}, "raw_delta": -0.11168197790781656, "tuned_delta": -0.10486970010071861}, {"byte_start": 4452, "byte_end": 4454, "display": {"text": "In", "kind": "normal"}, "is_word": true, "word_id": 745, "word_key": "in", "bytes_hex": "49 6e", "compression": {"rwkv": "10.92% 10.92%", "qwen": "11.56% 11.56%"}, "model_tokens": {"rwkv": [[1136, "In", "normal", 0.30026009678840637]], "qwen": [[641, "In", "normal", 0.2775447964668274]]}, "loss": {"rwkv": 10.918834537977993, "qwen": 11.557545856535429}, "topk": {"rwkv": [1136, 1, 0.30026009678840637, [[1136, 0.30026, "In", false], [6699, 0.118154, "The", false], [66, 0.065747, "A", false], [33504, 0.061939, "There", false], [33505, 0.029534, "These", false], [48358, 0.027682, "Another", false], [1141, 0.023174, "It", false], [24242, 0.015261, "This", false], [6393, 0.012917, "One", false], [5559, 0.01022, "All", false]]], "qwen": [641, 1, 0.2775447964668274, [[641, 0.277545, "In", false], [785, 0.116033, "The", false], [32, 0.040546, "A", false], [3862, 0.038229, "There", false], [9485, 0.028259, "These", false], [14037, 0.017428, "Another", false], [67691, 0.016609, "Similarly", false], [1986, 0.015898, "This", false], [2132, 0.014444, "It", false], [33464, 0.012972, "Deep", false]]]}, "raw_delta": -0.03541767597198486, "tuned_delta": -0.028605398164886917}, {"byte_start": 4454, "byte_end": 4463, "display": {"text": " computer", "kind": "normal"}, "is_word": true, "word_id": 746, "word_key": " computer", "bytes_hex": "20 63 6f 6d 70 75 74 65 72", "compression": {"rwkv": "2.77% 2.77% 2.77% 2.77% 2.77% 2.77% 2.77% 2.77% 2.77%", "qwen": "3.91% 3.91% 3.91% 3.91% 3.91% 3.91% 3.91% 3.91% 3.91%"}, "model_tokens": {"rwkv": [[55809, " computer", "normal", 0.252360463142395]], "qwen": [[6366, " computer", "normal", 0.1419302076101303]]}, "loss": {"rwkv": 2.770801022540652, "qwen": 3.9121478810505597}, "topk": {"rwkv": [55809, 1, 0.252360463142395, [[55809, 0.25236, " computer", false], [52766, 0.137943, " robotic", false], [22590, 0.086159, " the", false], [52299, 0.049953, " natural", false], [52167, 0.025386, " machine", false], [38744, 0.020041, " image", false], [21256, 0.018911, " all", false], [52209, 0.018144, " medical", false], [65003, 0.017441, " reinforcement", false], [31370, 0.017068, " many", false]]], "qwen": [6366, 1, 0.1419302076101303, [[6366, 0.14193, " computer", false], [279, 0.130395, " the", false], [73606, 0.125936, " robotics", false], [5662, 0.046521, " machine", false], [678, 0.036918, " all", false], [71278, 0.034866, " reinforcement", false], [11129, 0.030967, " vision", false], [12305, 0.027495, " robot", false], [5810, 0.025839, " natural", false], [2168, 0.024849, " image", false]]]}, "raw_delta": -0.06328970856136745, "tuned_delta": -0.0564774307542695}, {"byte_start": 4463, "byte_end": 4470, "display": {"text": " vision", "kind": "normal"}, "is_word": true, "word_id": 747, "word_key": " vision", "bytes_hex": "20 76 69 73 69 6f 6e", "compression": {"rwkv": "0.13% 0.13% 0.13% 0.13% 0.13% 0.13% 0.13%", "qwen": "0.56% 0.56% 0.56% 0.56% 0.56% 0.56% 0.56%"}, "model_tokens": {"rwkv": [[47732, " vision", "normal", 0.9510149359703064]], "qwen": [[11129, " vision", "normal", 0.8056734204292297]]}, "loss": {"rwkv": 0.12956681537001533, "qwen": 0.5566659584607483}, "topk": {"rwkv": [47732, 1, 0.9510149359703064, [[47732, 0.951015, " vision", false], [52814, 0.006039, " science", false], [63944, 0.0044, " translation", false], [46, 0.004011, "-", false], [56329, 0.003237, " graphics", false], [52766, 0.002913, " robotic", false], [31044, 0.002566, " hand", false], [56529, 0.002559, " language", false], [38744, 0.002122, " image", false], [59139, 0.001072, " animation", false]]], "qwen": [11129, 1, 0.8056734204292297, [[11129, 0.805673, " vision", false], [5994, 0.035949, " Go", false], [3868, 0.02343, " games", false], [1809, 0.018173, " game", false], [8038, 0.007636, " science", false], [73606, 0.006905, " robotics", false], [8273, 0.006662, "-v", false], [14181, 0.006551, " graphics", false], [20814, 0.005766, " poker", false], [2766, 0.005482, " video", false]]]}, "raw_delta": -0.02368340534823282, "tuned_delta": -0.016871127541134873}, {"byte_start": 4470, "byte_end": 4471, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "1.44%", "qwen": "1.78%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.92279452085495]], "qwen": [[11, ",", "normal", 0.9061692357063293]]}, "loss": {"rwkv": 1.4441039227648313, "qwen": 1.7768446692927307}, "topk": {"rwkv": [45, 1, 0.92279452085495, [[45, 0.922795, ",", false], [21265, 0.033721, " and", false], [275, 0.009319, " (", false], [39934, 0.006733, " there", false], [57103, 0.003816, " research", false], [5346, 0.003556, "---", false], [22590, 0.002891, " the", false], [22614, 0.002402, " too", false], [53087, 0.001415, " systems", false], [4423, 0.00105, " as", false]]], "qwen": [11, 1, 0.9061692357063293, [[11, 0.906169, ",", false], [323, 0.034152, " and", false], [1052, 0.011199, " there", false], [320, 0.011075, " (", false], [3412, 0.004476, " research", false], [279, 0.00315, " the", false], [4421, 0.002759, "---", false], [438, 0.002543, " as", false], [304, 0.002428, " in", false], [11811, 0.002211, " researchers", false]]]}, "raw_delta": -0.018451064825057983, "tuned_delta": -0.011638787017960037}, {"byte_start": 4471, "byte_end": 4477, "display": {"text": " there", "kind": "normal"}, "is_word": true, "word_id": 748, "word_key": " there", "bytes_hex": "20 74 68 65 72 65", "compression": {"rwkv": "5.89% 5.89% 5.89% 5.89% 5.89% 5.89%", "qwen": "5.20% 5.20% 5.20% 5.20% 5.20% 5.20%"}, "model_tokens": {"rwkv": [[39934, " there", "normal", 0.13935674726963043]], "qwen": [[1052, " there", "normal", 0.1774648129940033]]}, "loss": {"rwkv": 5.8938225140483365, "qwen": 5.19665644224577}, "topk": {"rwkv": [39934, 2, 0.13935674726963043, [[22590, 0.325649, " the", false], [39934, 0.139357, " there", false], [332, 0.0652, " a", false], [63843, 0.038665, " researchers", false], [4601, 0.022431, " it", false], [50919, 0.020676, " another", false], [37635, 0.01581, " again", false], [52224, 0.014061, " methods", false], [4596, 0.01355, " in", false], [22226, 0.011708, " one", false]]], "qwen": [1052, 2, 0.1774648129940033, [[279, 0.208848, " the", false], [1052, 0.177465, " there", false], [11811, 0.082833, " researchers", false], [264, 0.054324, " a", false], [4124, 0.053299, " early", false], [304, 0.021776, " in", false], [5413, 0.016807, " methods", false], [3738, 0.015499, " human", false], [432, 0.01524, " it", false], [458, 0.013534, " an", false]]]}, "raw_delta": 0.038659095764160156, "tuned_delta": 0.045471373571258106}, {"byte_start": 4477, "byte_end": 4481, "display": {"text": " has", "kind": "normal"}, "is_word": true, "word_id": 749, "word_key": " has", "bytes_hex": "20 68 61 73", "compression": {"rwkv": "8.98% 8.98% 8.98% 8.98%", "qwen": "10.06% 10.06% 10.06% 10.06%"}, "model_tokens": {"rwkv": [[21800, " has", "normal", 0.1380673199892044]], "qwen": [[702, " has", "normal", 0.10737162828445435]]}, "loss": {"rwkv": 8.981621958659318, "qwen": 10.06035948858179}, "topk": {"rwkv": [21800, 3, 0.1380673199892044, [[22748, 0.393495, " was", false], [32462, 0.223291, " were", false], [21800, 0.138067, " has", false], [31059, 0.103546, " have", false], [4600, 0.074456, " is", false], [21286, 0.041317, " are", false], [21795, 0.003924, " had", false], [22614, 0.003028, " too", false], [37635, 0.002218, " again", false], [30135, 0.002156, " also", false]]], "qwen": [702, 3, 0.10737162828445435, [[572, 0.514358, " was", false], [1033, 0.172868, " were", false], [702, 0.107372, " has", false], [374, 0.077177, " is", false], [614, 0.052585, " have", false], [525, 0.039749, " are", false], [1030, 0.007536, " had", false], [1083, 0.006672, " also", false], [1549, 0.003572, " again", false], [2238, 0.002997, " too", false]]]}, "raw_delta": -0.05981791019439697, "tuned_delta": -0.05300563238729902}, {"byte_start": 4481, "byte_end": 4486, "display": {"text": " been", "kind": "normal"}, "is_word": true, "word_id": 750, "word_key": " been", "bytes_hex": "20 62 65 65 6e", "compression": {"rwkv": "0.90% 0.90% 0.90% 0.90% 0.90%", "qwen": "0.81% 0.81% 0.81% 0.81% 0.81%"}, "model_tokens": {"rwkv": [[30259, " been", "normal", 0.7793910503387451]], "qwen": [[1012, " been", "normal", 0.7988281846046448]]}, "loss": {"rwkv": 0.8981621958659317, "qwen": 0.8101072398579089}, "topk": {"rwkv": [30259, 1, 0.7793910503387451, [[30259, 0.779391, " been", false], [30135, 0.132125, " also", false], [45150, 0.016753, " always", false], [22187, 0.011837, " not", false], [31323, 0.010833, " long", false], [56548, 0.005996, " likewise", false], [57036, 0.005167, " recently", false], [37635, 0.004394, " again", false], [45, 0.003834, ",", false], [60505, 0.003623, " similarly", false]]], "qwen": [1012, 1, 0.7988281846046448, [[1012, 0.798828, " been", false], [1083, 0.083231, " also", false], [2677, 0.046376, " always", false], [1293, 0.017368, " long", false], [2581, 0.007312, " never", false], [537, 0.00695, " not", false], [34801, 0.003097, " historically", false], [1549, 0.00252, " again", false], [35242, 0.002296, " traditionally", false], [5926, 0.001962, " recently", false]]]}, "raw_delta": 0.004882803559303282, "tuned_delta": 0.011695081366401228}, {"byte_start": 4486, "byte_end": 4488, "display": {"text": " a", "kind": "normal"}, "is_word": true, "word_id": 751, "word_key": " a", "bytes_hex": "20 61", "compression": {"rwkv": "3.84% 3.84%", "qwen": "4.90% 4.90%"}, "model_tokens": {"rwkv": [[332, " a", "normal", 0.6520881056785583]], "qwen": [[264, " a", "normal", 0.5807908177375793]]}, "loss": {"rwkv": 3.839203111740649, "qwen": 4.899434233538717}, "topk": {"rwkv": [332, 1, 0.6520881056785583, [[332, 0.652088, " a", false], [4419, 0.122319, " an", false], [52906, 0.022684, " similar", false], [31466, 0.017288, " much", false], [50919, 0.015506, " another", false], [22590, 0.014139, " the", false], [30788, 0.013172, " even", false], [45, 0.011857, ",", false], [4692, 0.007782, " no", false], [32074, 0.007001, " some", false]]], "qwen": [264, 1, 0.5807908177375793, [[264, 0.580791, " a", false], [458, 0.147467, " an", false], [1753, 0.035839, " much", false], [4428, 0.027938, " similar", false], [1045, 0.012506, " some", false], [29193, 0.009416, " similarly", false], [902, 0.008481, " no", false], [279, 0.007541, " the", false], [23839, 0.00746, " considerable", false], [803, 0.007214, " more", false]]]}, "raw_delta": -0.05879169702529907, "tuned_delta": -0.05197941921820112}, {"byte_start": 4488, "byte_end": 4496, "display": {"text": " similar", "kind": "normal"}, "is_word": true, "word_id": 752, "word_key": " similar", "bytes_hex": "20 73 69 6d 69 6c 61 72", "compression": {"rwkv": "1.80% 1.80% 1.80% 1.80% 1.80% 1.80% 1.80% 1.80%", "qwen": "2.80% 2.80% 2.80% 2.80% 2.80% 2.80% 2.80% 2.80%"}, "model_tokens": {"rwkv": [[52906, " similar", "normal", 0.45075634121894836]], "qwen": [[4428, " similar", "normal", 0.28896403312683105]]}, "loss": {"rwkv": 1.7963243917318634, "qwen": 2.7984971265504583}, "topk": {"rwkv": [52906, 1, 0.45075634121894836, [[52906, 0.450756, " similar", false], [31323, 0.121579, " long", false], [32386, 0.022152, " very", false], [52427, 0.016412, " pattern", false], [47405, 0.014575, " steady", false], [60505, 0.014117, " similarly", false], [38961, 0.012023, " major", false], [61774, 0.010748, " continuing", false], [61756, 0.009781, " consistent", false], [31466, 0.009341, " much", false]]], "qwen": [4428, 1, 0.28896403312683105, [[4428, 0.288964, " similar", false], [1293, 0.235387, " long", false], [29193, 0.019415, " similarly", false], [3598, 0.018889, " major", false], [2244, 0.017125, " great", false], [1602, 0.016404, " very", false], [12966, 0.013811, " consistent", false], [2696, 0.012967, " lot", false], [5383, 0.012706, " pattern", false], [24020, 0.011707, " steady", false]]]}, "raw_delta": -0.055572256445884705, "tuned_delta": -0.048759978638786755}, {"byte_start": 4496, "byte_end": 4504, "display": {"text": " pattern", "kind": "normal"}, "is_word": true, "word_id": 753, "word_key": " pattern", "bytes_hex": "20 70 61 74 74 65 72 6e", "compression": {"rwkv": "1.86% 1.86% 1.86% 1.86% 1.86% 1.86% 1.86% 1.86%", "qwen": "2.23% 2.23% 2.23% 2.23% 2.23% 2.23% 2.23% 2.23%"}, "model_tokens": {"rwkv": [[52427, " pattern", "normal", 0.44279417395591736]], "qwen": [[5383, " pattern", "normal", 0.3711734712123871]]}, "loss": {"rwkv": 1.857962973801094, "qwen": 2.234116440973038}, "topk": {"rwkv": [52427, 1, 0.44279417395591736, [[52427, 0.442794, " pattern", false], [39831, 0.085791, " story", false], [51929, 0.067133, " history", false], [45, 0.048783, ",", false], [63797, 0.018711, " progression", false], [39664, 0.015034, " shift", false], [62660, 0.014264, " transition", false], [59657, 0.013276, " evolution", false], [57328, 0.012698, " struggle", false], [63361, 0.012207, " competition", false]]], "qwen": [5383, 1, 0.3711734712123871, [[5383, 0.371173, " pattern", false], [9149, 0.085054, " trend", false], [3364, 0.058034, " story", false], [6407, 0.041732, " shift", false], [32724, 0.033134, " progression", false], [2297, 0.022624, " change", false], [1293, 0.02091, " long", false], [9142, 0.01898, " transition", false], [3840, 0.017896, " history", false], [11, 0.013164, ",", false]]]}, "raw_delta": -0.02085837721824646, "tuned_delta": -0.014046099411148514}, {"byte_start": 4504, "byte_end": 4505, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "15.78%", "qwen": "22.93%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.4214591681957245]], "qwen": [[13, ".", "normal", 0.2804797291755676]]}, "loss": {"rwkv": 15.779477009723035, "qwen": 22.925394849169177}, "topk": {"rwkv": [47, 1, 0.4214591681957245, [[47, 0.421459, ".", false], [4706, 0.321083, " of", false], [45, 0.142107, ",", false], [31601, 0.022263, " over", false], [59, 0.016097, ":", false], [4596, 0.015199, " in", false], [5346, 0.006903, "---", false], [39690, 0.006062, " since", false], [32487, 0.005365, " with", false], [21700, 0.004504, " for", false]]], "qwen": [13, 2, 0.2804797291755676, [[315, 0.466759, " of", false], [13, 0.28048, ".", false], [11, 0.082198, ",", false], [311, 0.037578, " to", false], [304, 0.027072, " in", false], [916, 0.01584, " over", false], [25, 0.013909, ":", false], [4421, 0.010026, "---", false], [504, 0.00752, " from", false], [369, 0.007465, " for", false]]]}, "raw_delta": -0.3962538242340088, "tuned_delta": -0.38944154642691087}, {"byte_start": 4505, "byte_end": 4511, "display": {"text": " Early", "kind": "normal"}, "is_word": true, "word_id": 754, "word_key": " early", "bytes_hex": "20 45 61 72 6c 79", "compression": {"rwkv": "5.54% 5.54% 5.54% 5.54% 5.54% 5.54%", "qwen": "5.03% 5.03% 5.03% 5.03% 5.03% 5.03%"}, "model_tokens": {"rwkv": [[36607, " Early", "normal", 0.15650245547294617]], "qwen": [[22752, " Early", "normal", 0.18737633526325226]]}, "loss": {"rwkv": 5.541602045081304, "qwen": 5.033310903428166}, "topk": {"rwkv": [36607, 1, 0.15650245547294617, [[36607, 0.156502, " Early", false], [20996, 0.156437, " The", false], [3913, 0.089804, " In", false], [37451, 0.04673, " There", false], [63222, 0.037153, " Researchers", false], [19907, 0.034091, " For", false], [50438, 0.026153, " Methods", false], [54932, 0.01869, " Computer", false], [36809, 0.017474, " Human", false], [58864, 0.0174, " Initially", false]]], "qwen": [22752, 1, 0.18737633526325226, [[22752, 0.187376, " Early", false], [758, 0.112628, " In", false], [576, 0.098623, " The", false], [2619, 0.094991, " There", false], [58150, 0.057391, " Researchers", false], [58556, 0.028442, " Initially", false], [1752, 0.025186, " For", false], [362, 0.024925, " A", false], [2411, 0.017526, " At", false], [11097, 0.01484, " Human", false]]]}, "raw_delta": 0.028185645739237486, "tuned_delta": 0.034997923546335435}, {"byte_start": 4511, "byte_end": 4519, "display": {"text": " methods", "kind": "normal"}, "is_word": true, "word_id": 755, "word_key": " methods", "bytes_hex": "20 6d 65 74 68 6f 64 73", "compression": {"rwkv": "3.36% 3.36% 3.36% 3.36% 3.36% 3.36% 3.36% 3.36%", "qwen": "4.38% 4.38% 4.38% 4.38% 4.38% 4.38% 4.38% 4.38%"}, "model_tokens": {"rwkv": [[52224, " methods", "normal", 0.2254432737827301]], "qwen": [[5413, " methods", "normal", 0.1432800143957138]]}, "loss": {"rwkv": 3.363705478635156, "qwen": 4.379829231113428}, "topk": {"rwkv": [52224, 1, 0.2254432737827301, [[52224, 0.225443, " methods", false], [55809, 0.11258, " computer", false], [51566, 0.106458, " efforts", false], [57103, 0.102813, " research", false], [32499, 0.068972, " work", false], [61590, 0.051917, " approaches", false], [63843, 0.041076, " researchers", false], [55572, 0.033606, " attempts", false], [4596, 0.029597, " in", false], [4712, 0.027457, " on", false]]], "qwen": [5413, 1, 0.1432800143957138, [[5413, 0.14328, " methods", false], [304, 0.120413, " in", false], [975, 0.118516, " work", false], [8869, 0.092872, " efforts", false], [6366, 0.087719, " computer", false], [11811, 0.059996, " researchers", false], [3412, 0.051687, " research", false], [11129, 0.049252, " vision", false], [19827, 0.043755, " approaches", false], [389, 0.037572, " on", false]]]}, "raw_delta": -0.0563458651304245, "tuned_delta": -0.04953358732332655}, {"byte_start": 4519, "byte_end": 4529, "display": {"text": " conceived", "kind": "normal"}, "is_word": true, "word_id": 756, "word_key": " conceived", "bytes_hex": "20 63 6f 6e 63 65 69 76 65 64", "compression": {"rwkv": "18.94% 18.94% 18.94% 18.94% 18.94% 18.94% 18.94% 18.94% 18.94% 18.94%", "qwen": "18.27% 18.27% 18.27% 18.27% 18.27% 18.27% 18.27% 18.27% 18.27% 18.27%"}, "model_tokens": {"rwkv": [[59348, " conceived", "normal", 2.7580983442021534e-05]], "qwen": [[49078, " conceived", "normal", 3.9800819649826735e-05]]}, "loss": {"rwkv": 18.935372411667647, "qwen": 18.27105330635336}, "topk": {"rwkv": [59348, 470, 2.7580983442021534e-05, [[32462, 0.18121, " were", false], [47054, 0.116609, " relied", false], [45, 0.088755, ",", false], [4596, 0.084191, " in", false], [32354, 0.070689, " used", false], [21700, 0.050481, " for", false], [32227, 0.039116, " that", false], [40013, 0.034913, " tried", false], [4706, 0.025102, " of", false], [56427, 0.024824, " included", false]]], "qwen": [49078, 410, 3.9800819649826735e-05, [[1033, 0.22463, " were", false], [39913, 0.084109, " relied", false], [304, 0.066021, " in", false], [369, 0.064234, " for", false], [3867, 0.063007, " took", false], [11, 0.057171, ",", false], [429, 0.040702, " that", false], [3118, 0.038395, " based", false], [10735, 0.038008, " focused", false], [315, 0.026742, " of", false]]]}, "raw_delta": 0.03683767318725595, "tuned_delta": 0.0436499509943539}, {"byte_start": 4529, "byte_end": 4532, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 757, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "5.66% 5.66% 5.66%", "qwen": "9.18% 9.18% 9.18%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.39385607838630676]], "qwen": [[315, " of", "normal", 0.21719248592853546]]}, "loss": {"rwkv": 5.659008868070314, "qwen": 9.178974916901904}, "topk": {"rwkv": [4706, 1, 0.39385607838630676, [[4706, 0.393856, " of", false], [4450, 0.206618, " by", false], [4596, 0.094423, " in", false], [4811, 0.046595, " to", false], [4423, 0.03474, " as", false], [21265, 0.033587, " and", false], [30917, 0.014336, " from", false], [332, 0.010566, " a", false], [4712, 0.010504, " on", false], [32487, 0.009947, " with", false]]], "qwen": [315, 1, 0.21719248592853546, [[315, 0.217192, " of", false], [304, 0.155638, " in", false], [438, 0.152512, " as", false], [323, 0.076464, " and", false], [553, 0.074736, " by", false], [311, 0.05731, " to", false], [389, 0.032373, " on", false], [448, 0.032037, " with", false], [279, 0.015105, " the", false], [3118, 0.014067, " based", false]]]}, "raw_delta": -0.1951883633931478, "tuned_delta": -0.18837608558604985}, {"byte_start": 4532, "byte_end": 4539, "display": {"text": " vision", "kind": "normal"}, "is_word": true, "word_id": 758, "word_key": " vision", "bytes_hex": "20 76 69 73 69 6f 6e", "compression": {"rwkv": "7.97% 7.97% 7.97% 7.97% 7.97% 7.97% 7.97%", "qwen": "6.55% 6.55% 6.55% 6.55% 6.55% 6.55% 6.55%"}, "model_tokens": {"rwkv": [[47732, " vision", "normal", 0.045227184891700745]], "qwen": [[11129, " vision", "normal", 0.07862947881221771]]}, "loss": {"rwkv": 7.970246040625409, "qwen": 6.551403298153559}, "topk": {"rwkv": [47732, 7, 0.045227184891700745, [[4423, 0.198934, " as", false], [4450, 0.096176, " by", false], [22590, 0.090657, " the", false], [332, 0.081678, " a", false], [55809, 0.05007, " computer", false], [4596, 0.048479, " in", false], [47732, 0.045227, " vision", false], [47734, 0.02025, " visual", false], [38744, 0.01849, " image", false], [59345, 0.017479, " computers", false]]], "qwen": [11129, 3, 0.07862947881221771, [[438, 0.122214, " as", false], [279, 0.107035, " the", false], [11129, 0.078629, " vision", false], [264, 0.064636, " a", false], [6366, 0.062212, " computer", false], [1667, 0.031913, " using", false], [4633, 0.028064, " taking", false], [304, 0.024232, " in", false], [3738, 0.023334, " human", false], [9902, 0.018649, " ``", false]]]}, "raw_delta": 0.07867734772818429, "tuned_delta": 0.08548962553528223}, {"byte_start": 4539, "byte_end": 4542, "display": {"text": " as", "kind": "normal"}, "is_word": true, "word_id": 759, "word_key": " as", "bytes_hex": "20 61 73", "compression": {"rwkv": "2.56% 2.56% 2.56%", "qwen": "1.65% 1.65% 1.65%"}, "model_tokens": {"rwkv": [[4423, " as", "normal", 0.6551750898361206]], "qwen": [[438, " as", "normal", 0.7599860429763794]]}, "loss": {"rwkv": 2.559468741160433, "qwen": 1.64981326720481}, "topk": {"rwkv": [4423, 1, 0.6551750898361206, [[4423, 0.655175, " as", false], [4596, 0.136047, " in", false], [53087, 0.049044, " systems", false], [56939, 0.02691, " problems", false], [39898, 0.024551, " tasks", false], [4450, 0.00794, " by", false], [30917, 0.007507, " from", false], [62378, 0.00626, " processing", false], [21265, 0.005958, " and", false], [45, 0.005832, ",", false]]], "qwen": [438, 1, 0.7599860429763794, [[438, 0.759986, " as", false], [304, 0.108452, " in", false], [5942, 0.014882, " systems", false], [5322, 0.009305, " problems", false], [11, 0.006321, ",", false], [25185, 0.005025, " algorithms", false], [553, 0.005003, " by", false], [9079, 0.004906, " tasks", false], [3118, 0.003904, " based", false], [323, 0.003779, " and", false]]]}, "raw_delta": 0.050442010164260885, "tuned_delta": 0.057254287971358835}, {"byte_start": 4542, "byte_end": 4552, "display": {"text": " searching", "kind": "normal"}, "is_word": true, "word_id": 760, "word_key": " searching", "bytes_hex": "20 73 65 61 72 63 68 69 6e 67", "compression": {"rwkv": "15.10% 15.10% 15.10% 15.10% 15.10% 15.10% 15.10% 15.10% 15.10% 15.10%", "qwen": "12.93% 12.93% 12.93% 12.93% 12.93% 12.93% 12.93% 12.93% 12.93% 12.93%"}, "model_tokens": {"rwkv": [[60463, " searching", "normal", 0.0002269329415867105]], "qwen": [[15039, " searching", "normal", 0.0007701599388383329]]}, "loss": {"rwkv": 15.103213709306337, "qwen": 12.928192979420364}, "topk": {"rwkv": [60463, 151, 0.0002269329415867105, [[332, 0.475588, " a", false], [37832, 0.093851, " being", false], [4419, 0.066042, " an", false], [22590, 0.032269, " the", false], [60522, 0.027031, " something", false], [63541, 0.019331, " essentially", false], [52906, 0.016214, " similar", false], [59134, 0.013704, " analogous", false], [59927, 0.010833, " involving", false], [46170, 0.010259, " having", false]]], "qwen": [15039, 85, 0.0007701599388383329, [[264, 0.487278, " a", false], [458, 0.071254, " an", false], [279, 0.06089, " the", false], [1660, 0.035027, " being", false], [2494, 0.020415, " something", false], [15860, 0.01772, " involving", false], [9902, 0.01342, " ``", false], [3432, 0.012937, " having", false], [4633, 0.01076, " taking", false], [15791, 0.007221, " essentially", false]]]}, "raw_delta": 0.1206087589263917, "tuned_delta": 0.12742103673348965}, {"byte_start": 4552, "byte_end": 4556, "display": {"text": " for", "kind": "normal"}, "is_word": true, "word_id": 761, "word_key": " for", "bytes_hex": "20 66 6f 72", "compression": {"rwkv": "3.79% 3.79% 3.79% 3.79%", "qwen": "3.44% 3.44% 3.44% 3.44%"}, "model_tokens": {"rwkv": [[21700, " for", "normal", 0.4315313994884491]], "qwen": [[369, " for", "normal", 0.46674421429634094]]}, "loss": {"rwkv": 3.7863700413955943, "qwen": 3.4352999751290993}, "topk": {"rwkv": [21700, 1, 0.4315313994884491, [[21700, 0.431531, " for", false], [53140, 0.138795, " through", false], [332, 0.100864, " a", false], [22590, 0.05256, " the", false], [4596, 0.045291, " in", false], [31601, 0.038004, " over", false], [45, 0.026408, ",", false], [4419, 0.015323, " an", false], [5346, 0.015249, "---", false], [21265, 0.010203, " and", false]]], "qwen": [369, 1, 0.46674421429634094, [[369, 0.466744, " for", false], [1526, 0.183925, " through", false], [11, 0.047437, ",", false], [304, 0.046804, " in", false], [264, 0.044039, " a", false], [323, 0.028121, " and", false], [279, 0.024204, " the", false], [916, 0.021524, " over", false], [553, 0.009388, " by", false], [13, 0.008407, ".", false]]]}, "raw_delta": 0.019467458128929138, "tuned_delta": 0.026279735936027084}, {"byte_start": 4556, "byte_end": 4562, "display": {"text": " edges", "kind": "normal"}, "is_word": true, "word_id": 762, "word_key": " edges", "bytes_hex": "20 65 64 67 65 73", "compression": {"rwkv": "11.08% 11.08% 11.08% 11.08% 11.08% 11.08%", "qwen": "16.52% 16.52% 16.52% 16.52% 16.52% 16.52%"}, "model_tokens": {"rwkv": [[38332, " edges", "normal", 0.025061361491680145]], "qwen": [[12822, " edges", "normal", 0.004106951877474785]]}, "loss": {"rwkv": 11.083204090162608, "qwen": 16.516075836990932}, "topk": {"rwkv": [38332, 7, 0.025061361491680145, [[52342, 0.247908, " objects", false], [56215, 0.063244, " features", false], [56832, 0.062096, " patterns", false], [332, 0.039706, " a", false], [57271, 0.029351, " specific", false], [47734, 0.025504, " visual", false], [38332, 0.025061, " edges", false], [22590, 0.024301, " the", false], [4404, 0.01988, " ``", false], [46691, 0.0174, " object", false]]], "qwen": [12822, 35, 0.004106951877474785, [[12624, 0.108482, " patterns", false], [4419, 0.107189, " features", false], [6171, 0.101189, " objects", false], [264, 0.056917, " a", false], [279, 0.037417, " the", false], [3151, 0.02735, " specific", false], [4274, 0.01985, " sal", false], [3281, 0.017533, " special", false], [9124, 0.016381, " visual", false], [3738, 0.01627, " human", false]]]}, "raw_delta": -0.30126237869262695, "tuned_delta": -0.29445010088552903}, {"byte_start": 4562, "byte_end": 4563, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "22.26%", "qwen": "14.23%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.29281607270240784]], "qwen": [[11, ",", "normal", 0.45429813861846924]]}, "loss": {"rwkv": 22.260333638716425, "qwen": 14.228608407085709}, "topk": {"rwkv": [45, 1, 0.29281607270240784, [[45, 0.292816, ",", false], [21265, 0.287899, " and", false], [4596, 0.161365, " in", false], [4715, 0.100437, " or", false], [47, 0.034578, ".", false], [5346, 0.026178, "---", false], [275, 0.023738, " (", false], [4706, 0.012034, " of", false], [4811, 0.009489, " to", false], [32227, 0.007131, " that", false]]], "qwen": [11, 1, 0.45429813861846924, [[11, 0.454298, ",", false], [323, 0.403713, " and", false], [476, 0.040795, " or", false], [304, 0.040111, " in", false], [320, 0.015853, " (", false], [13, 0.01289, ".", false], [4421, 0.003669, "---", false], [26, 0.002524, ";", false], [389, 0.002163, " on", false], [315, 0.002136, " of", false]]]}, "raw_delta": 0.44537341594696045, "tuned_delta": 0.45218569375405837}, {"byte_start": 4563, "byte_end": 4566, "display": {"text": " or", "kind": "normal"}, "is_word": true, "word_id": 763, "word_key": " or", "bytes_hex": "20 6f 72", "compression": {"rwkv": "8.92% 8.92% 8.92%", "qwen": "12.30% 12.30% 12.30%"}, "model_tokens": {"rwkv": [[4715, " or", "normal", 0.2288012057542801]], "qwen": [[476, " or", "normal", 0.12923438847064972]]}, "loss": {"rwkv": 8.922918547164812, "qwen": 12.299742002494527}, "topk": {"rwkv": [4715, 1, 0.2288012057542801, [[4715, 0.228801, " or", false], [21265, 0.193901, " and", false], [51327, 0.074179, " corners", false], [32230, 0.033803, " then", false], [40186, 0.028879, " which", false], [38905, 0.0288, " lines", false], [21700, 0.02683, " for", false], [40085, 0.018692, " using", false], [47253, 0.017881, " shapes", false], [57413, 0.01475, " textures", false]]], "qwen": [476, 2, 0.12923438847064972, [[323, 0.188974, " and", false], [476, 0.129234, " or", false], [23462, 0.072278, " corners", false], [1221, 0.052065, " then", false], [20816, 0.035317, " shapes", false], [49031, 0.032121, " contours", false], [5128, 0.031306, " lines", false], [76899, 0.028993, " blobs", false], [369, 0.026087, " for", false], [4419, 0.025871, " features", false]]]}, "raw_delta": -0.18725085258483878, "tuned_delta": -0.18043857477774083}, {"byte_start": 4566, "byte_end": 4578, "display": {"text": " generalized", "kind": "normal"}, "is_word": true, "word_id": 764, "word_key": " generalized", "bytes_hex": "20 67 65 6e 65 72 61 6c 69 7a 65 64", "compression": {"rwkv": "14.46% 14.46% 14.46% 14.46% 14.46% 14.46% 14.46% 14.46% 14.46% 14.46% 14.46% 14.46%", "qwen": "14.96% 14.96% 14.96% 14.96% 14.96% 14.96% 14.96% 14.96% 14.96% 14.96% 14.96% 14.96%"}, "model_tokens": {"rwkv": [[63594, " generalized", "normal", 6.557611777679995e-05]], "qwen": [[66117, " generalized", "normal", 4.747543061967008e-05]]}, "loss": {"rwkv": 14.464520592246117, "qwen": 14.960895485977597}, "topk": {"rwkv": [63594, 610, 6.557611777679995e-05, [[21700, 0.244851, " for", false], [39193, 0.088707, " other", false], [38905, 0.035568, " lines", false], [47253, 0.028061, " shapes", false], [51327, 0.026745, " corners", false], [57413, 0.023991, " textures", false], [4423, 0.023606, " as", false], [31458, 0.02226, " more", false], [32074, 0.019728, " some", false], [56215, 0.018275, " features", false]]], "qwen": [66117, 800, 4.747543061967008e-05, [[315, 0.154972, " of", false], [438, 0.084378, " as", false], [76899, 0.062551, " blobs", false], [369, 0.050894, " for", false], [23462, 0.042371, " corners", false], [20816, 0.039494, " shapes", false], [1008, 0.028485, " other", false], [4419, 0.025384, " features", false], [49031, 0.022003, " contours", false], [29853, 0.020409, " textures", false]]]}, "raw_delta": -0.02752486864725745, "tuned_delta": -0.020712590840159504}, {"byte_start": 4578, "byte_end": 4588, "display": {"text": " cylinders", "kind": "normal"}, "is_word": true, "word_id": 765, "word_key": " cylinders", "bytes_hex": "20 63 79 6c 69 6e 64 65 72 73", "compression": {"rwkv": "19.61% 19.61% 19.61% 19.61% 19.61% 19.61% 19.61% 19.61% 19.61% 19.61%", "qwen": "14.63% 14.63% 14.63% 14.63% 14.63% 14.63% 14.63% 14.63% 14.63% 14.63%"}, "model_tokens": {"rwkv": [[59439, " cylinders", "normal", 1.8456506950315088e-05]], "qwen": [[74321, " cylinders", "normal", 0.00029981572879478335]]}, "loss": {"rwkv": 19.611635712084347, "qwen": 14.629545971606023}, "topk": {"rwkv": [59439, 956, 1.8456506950315088e-05, [[38332, 0.41643, " edges", false], [47253, 0.057832, " shapes", false], [30729, 0.051184, " edge", false], [57527, 0.029107, " versions", false], [32229, 0.024074, " them", false], [56215, 0.021036, " features", false], [22590, 0.020065, " the", false], [4811, 0.017995, " to", false], [38905, 0.017969, " lines", false], [32227, 0.016106, " that", false]]], "qwen": [74321, 155, 0.00029981572879478335, [[12822, 0.516086, " edges", false], [4419, 0.114138, " features", false], [20816, 0.039735, " shapes", false], [10795, 0.018152, " versions", false], [311, 0.013885, " to", false], [12624, 0.011384, " patterns", false], [7586, 0.010593, " forms", false], [5335, 0.008431, " images", false], [76899, 0.00804, " blobs", false], [49031, 0.007564, " contours", false]]]}, "raw_delta": 0.2762657165527342, "tuned_delta": 0.2830779943598321}, {"byte_start": 4588, "byte_end": 4589, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "12.12%", "qwen": "8.56%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.5149906873703003]], "qwen": [[11, ",", "normal", 0.6220842599868774]]}, "loss": {"rwkv": 12.116384132465903, "qwen": 8.560225767948992}, "topk": {"rwkv": [45, 1, 0.5149906873703003, [[45, 0.514991, ",", false], [47, 0.085839, ".", false], [4715, 0.065328, " or", false], [275, 0.058753, " (", false], [4596, 0.055471, " in", false], [21265, 0.051512, " and", false], [4706, 0.030435, " of", false], [5346, 0.021946, "---", false], [32227, 0.019334, " that", false], [21700, 0.010089, " for", false]]], "qwen": [11, 1, 0.6220842599868774, [[11, 0.622084, ",", false], [476, 0.072416, " or", false], [13, 0.071301, ".", false], [320, 0.061127, " (", false], [323, 0.044242, " and", false], [304, 0.04152, " in", false], [315, 0.022199, " of", false], [429, 0.008502, " that", false], [4421, 0.007446, "---", false], [26, 0.005209, ";", false]]]}, "raw_delta": 0.19719529151916504, "tuned_delta": 0.204007569326263}, {"byte_start": 4589, "byte_end": 4592, "display": {"text": " or", "kind": "normal"}, "is_word": true, "word_id": 766, "word_key": " or", "bytes_hex": "20 6f 72", "compression": {"rwkv": "4.74% 4.74% 4.74%", "qwen": "2.07% 2.07% 2.07%"}, "model_tokens": {"rwkv": [[4715, " or", "normal", 0.4550006687641144]], "qwen": [[476, " or", "normal", 0.7081467509269714]]}, "loss": {"rwkv": 4.743235648756031, "qwen": 2.0744988052614812}, "topk": {"rwkv": [4715, 1, 0.4550006687641144, [[4715, 0.455001, " or", false], [21265, 0.128794, " and", false], [4596, 0.119501, " in", false], [21643, 0.068453, " etc", false], [32227, 0.019151, " that", false], [40186, 0.01789, " which", false], [4811, 0.015911, " to", false], [4423, 0.011601, " as", false], [32487, 0.008663, " with", false], [40085, 0.006642, " using", false]]], "qwen": [476, 1, 0.7081467509269714, [[476, 0.708147, " or", false], [323, 0.091256, " and", false], [304, 0.034837, " in", false], [4992, 0.033548, " etc", false], [892, 0.009402, " which", false], [429, 0.006675, " that", false], [3118, 0.005765, " based", false], [448, 0.005734, " with", false], [1667, 0.005297, " using", false], [438, 0.004923, " as", false]]]}, "raw_delta": 0.14798619349797565, "tuned_delta": 0.1547984713050736}, {"byte_start": 4592, "byte_end": 4595, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 767, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "33.06% 33.06% 33.06%", "qwen": "29.69% 29.69% 29.69%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.004140828736126423]], "qwen": [[304, " in", "normal", 0.007163698319345713]]}, "loss": {"rwkv": 33.06176135370541, "qwen": 29.687831506476456}, "topk": {"rwkv": [4596, 36, 0.004140828736126423, [[39193, 0.162659, " other", false], [63594, 0.09939, " generalized", false], [32074, 0.076327, " some", false], [38905, 0.029375, " lines", false], [22590, 0.019356, " the", false], [30788, 0.017665, " even", false], [31458, 0.01672, " more", false], [57564, 0.016022, " whatever", false], [37865, 0.013853, " blobs", false], [52906, 0.011918, " similar", false]]], "qwen": [304, 23, 0.007163698319345713, [[1008, 0.095454, " other", false], [76899, 0.049573, " blobs", false], [315, 0.041197, " of", false], [1045, 0.028895, " some", false], [2494, 0.028273, " something", false], [66117, 0.027925, " generalized", false], [20816, 0.020533, " shapes", false], [8820, 0.020296, " whatever", false], [438, 0.018271, " as", false], [12300, 0.016067, " faces", false]]]}, "raw_delta": 0.18709039688110352, "tuned_delta": 0.19390267468820147}, {"byte_start": 4595, "byte_end": 4601, "display": {"text": " terms", "kind": "normal"}, "is_word": true, "word_id": 768, "word_key": " terms", "bytes_hex": "20 74 65 72 6d 73", "compression": {"rwkv": "10.75% 10.75% 10.75% 10.75% 10.75% 10.75%", "qwen": "10.86% 10.86% 10.86% 10.86% 10.86% 10.86%"}, "model_tokens": {"rwkv": [[39920, " terms", "normal", 0.027818266302347183]], "qwen": [[3793, " terms", "normal", 0.02695387974381447]]}, "loss": {"rwkv": 10.754464985793378, "qwen": 10.861173054709965}, "topk": {"rwkv": [39920, 6, 0.027818266302347183, [[32074, 0.310544, " some", false], [39193, 0.249482, " other", false], [22590, 0.066779, " the", false], [51832, 0.048652, " general", false], [332, 0.04852, " a", false], [39920, 0.027818, " terms", false], [31458, 0.024129, " more", false], [31370, 0.016701, " many", false], [53265, 0.015423, " various", false], [22226, 0.014815, " one", false]]], "qwen": [3793, 7, 0.02695387974381447, [[1045, 0.208606, " some", false], [279, 0.132075, " the", false], [1008, 0.123278, " other", false], [264, 0.050137, " a", false], [4586, 0.029927, " general", false], [220, 0.028146, " ", false], [3793, 0.026954, " terms", false], [54611, 0.019275, "variants", false], [947, 0.018864, "var", false], [803, 0.013371, " more", false]]]}, "raw_delta": -0.005917151769002316, "tuned_delta": 0.0008951260380956312}, {"byte_start": 4601, "byte_end": 4604, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 769, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "0.08% 0.08% 0.08%", "qwen": "0.05% 0.05% 0.05%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.9861178994178772]], "qwen": [[315, " of", "normal", 0.9919356107711792]]}, "loss": {"rwkv": 0.08401925770151077, "qwen": 0.04867343032269244}, "topk": {"rwkv": [4706, 1, 0.9861178994178772, [[4706, 0.986118, " of", false], [32227, 0.002991, " that", false], [31458, 0.002092, " more", false], [39193, 0.001539, " other", false], [52906, 0.000906, " similar", false], [31296, 0.000441, " like", false], [52693, 0.000286, " related", false], [32139, 0.000189, " such", false], [56205, 0.000167, " familiar", false], [45, 0.000154, ",", false]]], "qwen": [315, 1, 0.9919356107711792, [[315, 0.991936, " of", false], [429, 0.002911, " that", false], [3118, 0.000341, " based", false], [4428, 0.000316, " similar", false], [803, 0.000269, " more", false], [5435, 0.000265, " related", false], [1075, 0.000195, " like", false], [15860, 0.000164, " involving", false], [1008, 0.000144, " other", false], [1602, 8.6e-05, " very", false]]]}, "raw_delta": 0.0019599888473749156, "tuned_delta": 0.008772266654472862}, {"byte_start": 4604, "byte_end": 4609, "display": {"text": " SIFT", "kind": "normal"}, "is_word": true, "word_id": 770, "word_key": " sift", "bytes_hex": "20 53 49 46 54", "compression": {"rwkv": "47.90% 47.90% 47.90% 0.01% 0.01%", "qwen": "73.93% 73.93% 0.86% 0.86% 0.86%"}, "model_tokens": {"rwkv": [[4191, " SI", "normal", 0.00034497177693992853], [1023, "FT", "normal", 0.9991699457168579]], "qwen": [[328, " S", "normal", 0.00027484563179314137], [14292, "IFT", "normal", 0.8664654493331909]]}, "loss": {"rwkv": 28.744162127916724, "qwen": 30.089691130898576}, "topk": {"rwkv": [4191, 328, 0.00034497177693992853, [[332, 0.084557, " a", false], [22590, 0.059582, " the", false], [39193, 0.03829, " other", false], [38720, 0.037371, " human", false], [31044, 0.030103, " hand", false], [32074, 0.027972, " some", false], [51725, 0.015069, " feature", false], [59767, 0.014567, " geometric", false], [63885, 0.014159, " statistical", false], [46691, 0.011179, " object", false]]], "qwen": [328, 446, 0.00027484563179314137, [[279, 0.059039, " the", false], [3738, 0.05651, " human", false], [264, 0.042507, " a", false], [4419, 0.025916, " features", false], [4565, 0.022914, " feature", false], [2205, 0.020055, " local", false], [1045, 0.016433, " some", false], [1008, 0.014731, " other", false], [1894, 0.014299, " color", false], [4285, 0.014204, " simple", false]]]}, "raw_delta": -0.07461197078227999, "tuned_delta": -0.06779969297518204}, {"byte_start": 4609, "byte_end": 4618, "display": {"text": " features", "kind": "normal"}, "is_word": true, "word_id": 771, "word_key": " features", "bytes_hex": "20 66 65 61 74 75 72 65 73", "compression": {"rwkv": "3.08% 3.08% 3.08% 3.08% 3.08% 3.08% 3.08% 3.08% 3.08%", "qwen": "1.16% 1.16% 1.16% 1.16% 1.16% 1.16% 1.16% 1.16% 1.16%"}, "model_tokens": {"rwkv": [[56215, " features", "normal", 0.214545339345932]], "qwen": [[4419, " features", "normal", 0.5602641105651855]]}, "loss": {"rwkv": 3.0838858838446805, "qwen": 1.1608624703841681}, "topk": {"rwkv": [56215, 1, 0.214545339345932, [[56215, 0.214545, " features", false], [45, 0.169355, ",", false], [275, 0.102136, " (", false], [4715, 0.088354, " or", false], [21265, 0.085354, " and", false], [63458, 0.075411, " descriptors", false], [47, 0.049387, ".", false], [59940, 0.028508, " keypoints", false], [46, 0.019867, "-", false], [51725, 0.016247, " feature", false]]], "qwen": [4419, 1, 0.5602641105651855, [[4419, 0.560264, " features", false], [47517, 0.058171, " descriptors", false], [320, 0.049761, " (", false], [82, 0.040318, "s", false], [11, 0.039659, ",", false], [476, 0.036471, " or", false], [12681, 0.031961, "-like", false], [323, 0.01962, " and", false], [13, 0.019555, ".", false], [3501, 0.009528, " points", false]]]}, "raw_delta": 0.10663506057527329, "tuned_delta": 0.11344733838237124}, {"byte_start": 4618, "byte_end": 4619, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "20.29%", "qwen": "17.12%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.3233961760997772]], "qwen": [[13, ".", "normal", 0.3871019184589386]]}, "loss": {"rwkv": 20.287899012501047, "qwen": 17.115182417432173}, "topk": {"rwkv": [47, 2, 0.3233961760997772, [[45, 0.367269, ",", false], [47, 0.323396, ".", false], [275, 0.073599, " (", false], [21265, 0.061237, " and", false], [4715, 0.048878, " or", false], [5346, 0.045826, "---", false], [32227, 0.021136, " that", false], [60, 0.006611, ";", false], [4596, 0.00528, " in", false], [4706, 0.004459, " of", false]]], "qwen": [13, 1, 0.3871019184589386, [[13, 0.387102, ".", false], [11, 0.377043, ",", false], [320, 0.066533, " (", false], [323, 0.048637, " and", false], [476, 0.046631, " or", false], [4421, 0.016091, "---", false], [429, 0.010928, " that", false], [26, 0.009214, ";", false], [304, 0.005007, " in", false], [508, 0.002577, " [", false]]]}, "raw_delta": 0.17593276500701904, "tuned_delta": 0.182745042814117}, {"byte_start": 4619, "byte_end": 4623, "display": {"text": " But", "kind": "normal"}, "is_word": true, "word_id": 772, "word_key": " but", "bytes_hex": "20 42 75 74", "compression": {"rwkv": "15.99% 15.99% 15.99% 15.99%", "qwen": "17.70% 17.70% 17.70% 17.70%"}, "model_tokens": {"rwkv": [[19555, " But", "normal", 0.029107827693223953]], "qwen": [[1988, " But", "normal", 0.019717730581760406]]}, "loss": {"rwkv": 15.990809291103256, "qwen": 17.701133758271173}, "topk": {"rwkv": [19555, 7, 0.029107827693223953, [[37453, 0.229669, " These", false], [20996, 0.066106, " The", false], [36918, 0.055009, " Later", false], [29890, 0.042702, " Then", false], [29894, 0.038061, " This", false], [3913, 0.032604, " In", false], [19555, 0.029108, " But", false], [19407, 0.026404, " All", false], [29421, 0.021861, " More", false], [37451, 0.021054, " There", false]]], "qwen": [1988, 10, 0.019717730581760406, [[4220, 0.179589, " These", false], [24885, 0.126057, " Later", false], [576, 0.057926, " The", false], [2619, 0.040932, " There", false], [2009, 0.036093, " All", false], [758, 0.033983, " In", false], [4398, 0.030353, " More", false], [5005, 0.028521, " Then", false], [1096, 0.026708, " This", false], [1988, 0.019718, " But", false]]]}, "raw_delta": -0.09484052658081055, "tuned_delta": -0.0880282487737126}, {"byte_start": 4623, "byte_end": 4629, "display": {"text": " today", "kind": "normal"}, "is_word": true, "word_id": 773, "word_key": " today", "bytes_hex": "20 74 6f 64 61 79", "compression": {"rwkv": "21.98% 21.98% 21.98% 21.98% 21.98% 21.98%", "qwen": "19.59% 19.59% 19.59% 19.59% 19.59% 19.59%"}, "model_tokens": {"rwkv": [[39971, " today", "normal", 0.0006651352159678936]], "qwen": [[3351, " today", "normal", 0.0014754984294995666]]}, "loss": {"rwkv": 21.9785572635428, "qwen": 19.592878424267994}, "topk": {"rwkv": [39971, 99, 0.0006651352159678936, [[22590, 0.117836, " the", false], [39936, 0.100132, " these", false], [45, 0.086531, ",", false], [4423, 0.061127, " as", false], [4596, 0.052696, " in", false], [32487, 0.032721, " with", false], [4601, 0.030664, " it", false], [32465, 0.026821, " when", false], [4450, 0.023177, " by", false], [32230, 0.02071, " then", false]]], "qwen": [3351, 61, 0.0014754984294995666, [[1493, 0.162007, " these", false], [279, 0.083008, " the", false], [11, 0.069522, ",", false], [678, 0.054504, " all", false], [1846, 0.04808, " those", false], [432, 0.040395, " it", false], [438, 0.032433, " as", false], [419, 0.031545, " this", false], [2711, 0.028393, " search", false], [304, 0.027728, " in", false]]]}, "raw_delta": 0.13229012489318848, "tuned_delta": 0.13910240270028643}, {"byte_start": 4629, "byte_end": 4633, "display": {"text": " all", "kind": "normal"}, "is_word": true, "word_id": 774, "word_key": " all", "bytes_hex": "20 61 6c 6c", "compression": {"rwkv": "23.25% 23.25% 23.25% 23.25%", "qwen": "24.88% 24.88% 24.88% 24.88%"}, "model_tokens": {"rwkv": [[21256, " all", "normal", 0.005730296950787306]], "qwen": [[678, " all", "normal", 0.004013643134385347]]}, "loss": {"rwkv": 23.246550951824116, "qwen": 24.877724703498696}, "topk": {"rwkv": [21256, 12, 0.005730296950787306, [[45, 0.494763, ",", false], [460, 0.264499, "'s", false], [22590, 0.057846, " the", false], [4601, 0.019822, " it", false], [4858, 0.017574, " we", false], [39934, 0.016592, " there", false], [39936, 0.013198, " these", false], [31461, 0.011217, " most", false], [30597, 0.009579, " deep", false], [47732, 0.008722, " vision", false]]], "qwen": [678, 13, 0.004013643134385347, [[11, 0.467636, ",", false], [594, 0.310312, "'s", false], [279, 0.045603, " the", false], [582, 0.021165, " we", false], [432, 0.014184, " it", false], [1052, 0.013138, " there", false], [5538, 0.010651, " deep", false], [1429, 0.01032, " most", false], [6366, 0.009914, " computer", false], [11129, 0.007534, " vision", false]]]}, "raw_delta": -0.09045147895812988, "tuned_delta": -0.08363920115103193}, {"byte_start": 4633, "byte_end": 4638, "display": {"text": " this", "kind": "normal"}, "is_word": true, "word_id": 775, "word_key": " this", "bytes_hex": "20 74 68 69 73", "compression": {"rwkv": "14.43% 14.43% 14.43% 14.43% 14.43%", "qwen": "12.47% 12.47% 12.47% 12.47% 12.47%"}, "model_tokens": {"rwkv": [[32234, " this", "normal", 0.017875730991363525]], "qwen": [[419, " this", "normal", 0.031515933573246]]}, "loss": {"rwkv": 14.426950408889633, "qwen": 12.469436997463111}, "topk": {"rwkv": [32234, 12, 0.017875730991363525, [[22590, 0.196943, " the", false], [4706, 0.165134, " of", false], [52224, 0.084055, " methods", false], [39936, 0.08361, " these", false], [55809, 0.041515, " computer", false], [32227, 0.032939, " that", false], [39944, 0.029611, " those", false], [62603, 0.027232, " successful", false], [38961, 0.026953, " major", false], [47732, 0.02519, " vision", false]]], "qwen": [419, 9, 0.031515933573246, [[315, 0.226157, " of", false], [279, 0.127321, " the", false], [6366, 0.115761, " computer", false], [429, 0.090816, " that", false], [1846, 0.039523, " those", false], [5413, 0.036473, " methods", false], [3598, 0.035435, " major", false], [1493, 0.033718, " these", false], [419, 0.031516, " this", false], [11129, 0.028523, " vision", false]]]}, "raw_delta": 0.10854759216308596, "tuned_delta": 0.11535986997018391}, {"byte_start": 4638, "byte_end": 4641, "display": {"text": " is", "kind": "normal"}, "is_word": true, "word_id": 776, "word_key": " is", "bytes_hex": "20 69 73", "compression": {"rwkv": "5.87% 5.87% 5.87%", "qwen": "7.06% 7.06% 7.06%"}, "model_tokens": {"rwkv": [[4600, " is", "normal", 0.3781265318393707]], "qwen": [[374, " is", "normal", 0.3087458312511444]]}, "loss": {"rwkv": 5.8703411494505335, "qwen": 7.064618774005778}, "topk": {"rwkv": [4600, 1, 0.3781265318393707, [[4600, 0.378127, " is", false], [21800, 0.190367, " has", false], [39620, 0.060713, " seems", false], [32499, 0.057806, " work", false], [57103, 0.044081, " research", false], [38720, 0.040622, " human", false], [45829, 0.013191, " effort", false], [59943, 0.012187, " knowledge", false], [31615, 0.0089, " pale", false], [22748, 0.008694, " was", false]]], "qwen": [374, 1, 0.3087458312511444, [[374, 0.308746, " is", false], [702, 0.20507, " has", false], [6540, 0.059443, " knowledge", false], [3738, 0.055794, " human", false], [975, 0.049138, " work", false], [3412, 0.038615, " research", false], [5041, 0.020935, " effort", false], [2711, 0.015505, " search", false], [11129, 0.013739, " vision", false], [15039, 0.007819, " searching", false]]]}, "raw_delta": -0.06622481346130371, "tuned_delta": -0.05941253565420576}, {"byte_start": 4641, "byte_end": 4651, "display": {"text": " discarded", "kind": "normal"}, "is_word": true, "word_id": 777, "word_key": " discarded", "bytes_hex": "20 64 69 73 63 61 72 64 65 64", "compression": {"rwkv": "11.55% 11.55% 11.55% 11.55% 11.55% 11.55% 11.55% 11.55% 11.55% 11.55%", "qwen": "11.54% 11.54% 11.54% 11.54% 11.54% 11.54% 11.54% 11.54% 11.54% 11.54%"}, "model_tokens": {"rwkv": [[59536, " discarded", "normal", 0.001632553874514997]], "qwen": [[43210, " discarded", "normal", 0.0016657938249409199]]}, "loss": {"rwkv": 11.55283138211865, "qwen": 11.536967702403063}, "topk": {"rwkv": [59536, 96, 0.001632553874514997, [[45290, 0.052817, " behind", false], [332, 0.04451, " a", false], [62161, 0.043321, " irrelevant", false], [31968, 0.039785, " seen", false], [30666, 0.032341, " done", false], [56738, 0.025978, " obsolete", false], [57059, 0.024785, " regarded", false], [61755, 0.024527, " considered", false], [52094, 0.022572, " largely", false], [4596, 0.020255, " in", false]]], "qwen": [43210, 93, 0.0016657938249409199, [[2814, 0.106711, " done", false], [46066, 0.081737, " obsolete", false], [264, 0.044212, " a", false], [39715, 0.026981, " irrelevant", false], [13771, 0.026165, " largely", false], [3884, 0.024434, " seen", false], [1660, 0.023346, " being", false], [12575, 0.021129, " replaced", false], [1632, 0.015291, " well", false], [6509, 0.014365, " considered", false]]]}, "raw_delta": 0.0008796691894531472, "tuned_delta": 0.007691946996551094}, {"byte_start": 4651, "byte_end": 4652, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "39.17%", "qwen": "45.59%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.11439065635204315]], "qwen": [[13, ".", "normal", 0.07983085513114929]]}, "loss": {"rwkv": 39.16691614913396, "qwen": 45.58637497176933}, "topk": {"rwkv": [47, 3, 0.11439065635204315, [[4596, 0.371518, " in", false], [45, 0.21439, ",", false], [47, 0.114391, ".", false], [21265, 0.094207, " and", false], [4423, 0.084228, " as", false], [21700, 0.023126, " for", false], [5346, 0.018726, "---", false], [60, 0.015994, ";", false], [51018, 0.013521, " because", false], [4450, 0.010597, " by", false]]], "qwen": [13, 4, 0.07983085513114929, [[304, 0.359606, " in", false], [11, 0.254916, ",", false], [323, 0.151327, " and", false], [13, 0.079831, ".", false], [438, 0.028933, " as", false], [4421, 0.024645, "---", false], [369, 0.020899, " for", false], [26, 0.015377, ";", false], [553, 0.012128, " by", false], [25, 0.007039, ":", false]]]}, "raw_delta": -0.3559703826904297, "tuned_delta": -0.34915810488333177}, {"byte_start": 4652, "byte_end": 4659, "display": {"text": " Modern", "kind": "normal"}, "is_word": true, "word_id": 778, "word_key": " modern", "bytes_hex": "20 4d 6f 64 65 72 6e", "compression": {"rwkv": "11.03% 11.03% 11.03% 11.03% 11.03% 11.03% 11.03%", "qwen": "10.06% 10.06% 10.06% 10.06% 10.06% 10.06% 10.06%"}, "model_tokens": {"rwkv": [[44593, " Modern", "normal", 0.013722049072384834]], "qwen": [[18265, " Modern", "normal", 0.020121648907661438]]}, "loss": {"rwkv": 11.029532399653347, "qwen": 10.062692617507867}, "topk": {"rwkv": [44593, 13, 0.013722049072384834, [[50342, 0.216507, " Instead", false], [20996, 0.171607, " The", false], [28753, 0.043714, " Deep", false], [45032, 0.036115, " Vision", false], [3918, 0.031324, " It", false], [3913, 0.028528, " In", false], [36607, 0.028389, " Early", false], [37451, 0.021651, " There", false], [54932, 0.018325, " Computer", false], [20530, 0.017461, " Now", false]]], "qwen": [18265, 8, 0.020121648907661438, [[12090, 0.211263, " Instead", false], [576, 0.121408, " The", false], [30441, 0.099468, " Vision", false], [2619, 0.037192, " There", false], [758, 0.035085, " In", false], [18183, 0.031522, " Deep", false], [1084, 0.020505, " It", false], [18265, 0.020122, " Modern", false], [17407, 0.018563, " Computer", false], [18801, 0.015824, " Methods", false]]]}, "raw_delta": 0.05361298152378635, "tuned_delta": 0.0604252593308843}, {"byte_start": 4659, "byte_end": 4664, "display": {"text": " deep", "kind": "normal"}, "is_word": true, "word_id": 779, "word_key": " deep", "bytes_hex": "20 64 65 65 70", "compression": {"rwkv": "13.41% 13.41% 13.41% 13.41% 13.41%", "qwen": "11.38% 11.38% 11.38% 11.38% 11.38%"}, "model_tokens": {"rwkv": [[30597, " deep", "normal", 0.024010201916098595]], "qwen": [[5538, " deep", "normal", 0.042633719742298126]]}, "loss": {"rwkv": 13.412555458264581, "qwen": 11.379653451832345}, "topk": {"rwkv": [30597, 7, 0.024010201916098595, [[52224, 0.401931, " methods", false], [55809, 0.18879, " computer", false], [47732, 0.099353, " vision", false], [53087, 0.065186, " systems", false], [61590, 0.06073, " approaches", false], [57103, 0.026363, " research", false], [30597, 0.02401, " deep", false], [38744, 0.011162, " image", false], [45, 0.011156, ",", false], [62633, 0.009787, " techniques", false]]], "qwen": [5538, 6, 0.042633719742298126, [[5413, 0.268403, " methods", false], [6366, 0.264064, " computer", false], [11129, 0.13221, " vision", false], [5942, 0.080928, " systems", false], [19827, 0.067449, " approaches", false], [5538, 0.042634, " deep", false], [12538, 0.016512, " techniques", false], [975, 0.010687, " work", false], [3412, 0.010184, " research", false], [25185, 0.006606, " algorithms", false]]]}, "raw_delta": 0.11272802352905276, "tuned_delta": 0.1195403013361507}, {"byte_start": 4664, "byte_end": 4673, "display": {"text": "-learning", "kind": "normal"}, "is_word": true, "word_id": 780, "word_key": "-learning", "bytes_hex": "2d 6c 65 61 72 6e 69 6e 67", "compression": {"rwkv": "42.83% 0.08% 0.08% 0.08% 0.08% 0.08% 0.08% 0.08% 0.08%", "qwen": "3.60% 3.60% 3.60% 3.60% 3.60% 3.60% 3.60% 3.60% 3.60%"}, "model_tokens": {"rwkv": [[46, "-", "normal", 0.09346193820238113], [54126, "learning", "normal", 0.9642153382301331]], "qwen": [[70756, "-learning", "normal", 0.16620495915412903]]}, "loss": {"rwkv": 4.831290765997789, "qwen": 3.5957841227348726}, "topk": {"rwkv": [46, 2, 0.09346193820238113, [[56537, 0.630672, " learning", false], [46, 0.093462, "-", false], [63421, 0.075963, " convolution", false], [46658, 0.059385, " neural", false], [47732, 0.030662, " vision", false], [56705, 0.028546, " networks", false], [19593, 0.020878, " CNN", false], [52224, 0.011699, " methods", false], [47734, 0.006579, " visual", false], [52307, 0.006423, " network", false]]], "qwen": [70756, 2, 0.16620495915412903, [[6832, 0.627562, " learning", false], [70756, 0.166205, "-learning", false], [29728, 0.074835, " neural", false], [14155, 0.035269, " networks", false], [55712, 0.022559, " convolution", false], [11129, 0.014643, " vision", false], [5413, 0.007685, " methods", false], [12, 0.005075, "-", false], [3922, 0.004662, " network", false], [52457, 0.004097, " nets", false]]]}, "raw_delta": 0.06851103570726187, "tuned_delta": 0.07532331351435982}, {"byte_start": 4673, "byte_end": 4680, "display": {"text": " neural", "kind": "normal"}, "is_word": true, "word_id": 781, "word_key": " neural", "bytes_hex": "20 6e 65 75 72 61 6c", "compression": {"rwkv": "15.94% 15.94% 15.94% 15.94% 15.94% 15.94% 15.94%", "qwen": "16.49% 16.49% 16.49% 16.49% 16.49% 16.49% 16.49%"}, "model_tokens": {"rwkv": [[46658, " neural", "normal", 0.002079566242173314]], "qwen": [[29728, " neural", "normal", 0.0016614794731140137]]}, "loss": {"rwkv": 15.940492081250818, "qwen": 16.488063957990402}, "topk": {"rwkv": [46658, 19, 0.002079566242173314, [[52224, 0.44855, " methods", false], [46, 0.163841, "-", false], [47732, 0.081831, " vision", false], [61590, 0.079851, " approaches", false], [53087, 0.072592, " systems", false], [55809, 0.046444, " computer", false], [62633, 0.016565, " techniques", false], [46587, 0.012046, " models", false], [37810, 0.009521, " based", false], [56705, 0.009037, " networks", false]]], "qwen": [29728, 21, 0.0016614794731140137, [[5413, 0.297083, " methods", false], [5980, 0.277579, "-based", false], [5942, 0.09559, " systems", false], [19827, 0.068918, " approaches", false], [11129, 0.056684, " vision", false], [6366, 0.050089, " computer", false], [12538, 0.027737, " techniques", false], [3118, 0.026534, " based", false], [4119, 0.01504, " models", false], [77235, 0.009815, " architectures", false]]]}, "raw_delta": -0.030363832201276586, "tuned_delta": -0.02355155439417864}, {"byte_start": 4680, "byte_end": 4689, "display": {"text": " networks", "kind": "normal"}, "is_word": true, "word_id": 782, "word_key": " networks", "bytes_hex": "20 6e 65 74 77 6f 72 6b 73", "compression": {"rwkv": "0.99% 0.99% 0.99% 0.99% 0.99% 0.99% 0.99% 0.99% 0.99%", "qwen": "1.12% 1.12% 1.12% 1.12% 1.12% 1.12% 1.12% 1.12% 1.12%"}, "model_tokens": {"rwkv": [[56705, " networks", "normal", 0.6098425388336182]], "qwen": [[14155, " networks", "normal", 0.5725714564323425]]}, "loss": {"rwkv": 0.9940444346402906, "qwen": 1.1173226736703195}, "topk": {"rwkv": [56705, 1, 0.6098425388336182, [[56705, 0.609843, " networks", false], [46, 0.124239, "-", false], [52307, 0.120411, " network", false], [31510, 0.105101, " nets", false], [22166, 0.018297, " net", false], [53087, 0.00496, " systems", false], [47732, 0.003379, " vision", false], [61590, 0.002833, " approaches", false], [64833, 0.002553, " architectures", false], [52224, 0.001733, " methods", false]]], "qwen": [14155, 1, 0.5725714564323425, [[14155, 0.572571, " networks", false], [3922, 0.180329, " network", false], [56732, 0.095167, "-network", false], [52457, 0.089963, " nets", false], [4179, 0.025765, " net", false], [66496, 0.019738, "-net", false], [77235, 0.002377, " architectures", false], [5413, 0.001393, " methods", false], [4119, 0.001261, " models", false], [11129, 0.000954, " vision", false]]]}, "raw_delta": -0.006835997104644775, "tuned_delta": -2.3719297546828493e-05}, {"byte_start": 4689, "byte_end": 4693, "display": {"text": " use", "kind": "normal"}, "is_word": true, "word_id": 783, "word_key": " use", "bytes_hex": "20 75 73 65", "compression": {"rwkv": "16.27% 16.27% 16.27% 16.27%", "qwen": "20.07% 20.07% 20.07% 20.07%"}, "model_tokens": {"rwkv": [[22681, " use", "normal", 0.02724544331431389]], "qwen": [[990, " use", "normal", 0.011658454313874245]]}, "loss": {"rwkv": 16.272585666276882, "qwen": 20.070248518484753}, "topk": {"rwkv": [22681, 8, 0.02724544331431389, [[21286, 0.132009, " are", false], [45, 0.129453, ",", false], [31059, 0.106996, " have", false], [38877, 0.053619, " learn", false], [21413, 0.050002, " can", false], [4491, 0.032159, " do", false], [32227, 0.029976, " that", false], [22681, 0.027245, " use", false], [32499, 0.021196, " work", false], [32187, 0.017642, " take", false]]], "qwen": [990, 16, 0.011658454313874245, [[525, 0.195085, " are", false], [614, 0.08028, " have", false], [11, 0.079562, ",", false], [369, 0.045916, " for", false], [653, 0.037626, " do", false], [429, 0.036058, " that", false], [646, 0.035558, " can", false], [3960, 0.028118, " learn", false], [8193, 0.024127, " produce", false], [975, 0.020111, " work", false]]]}, "raw_delta": -0.21058714389801025, "tuned_delta": -0.2037748660909123}, {"byte_start": 4693, "byte_end": 4698, "display": {"text": " only", "kind": "normal"}, "is_word": true, "word_id": 784, "word_key": " only", "bytes_hex": "20 6f 6e 6c 79", "compression": {"rwkv": "14.99% 14.99% 14.99% 14.99% 14.99%", "qwen": "14.56% 14.56% 14.56% 14.56% 14.56%"}, "model_tokens": {"rwkv": [[31581, " only", "normal", 0.015781084075570107]], "qwen": [[1172, " only", "normal", 0.01767251081764698]]}, "loss": {"rwkv": 14.990503159236885, "qwen": 14.555872043629412}, "topk": {"rwkv": [31581, 10, 0.015781084075570107, [[52195, 0.338386, " massive", false], [332, 0.062769, " a", false], [63421, 0.049194, " convolution", false], [31118, 0.028597, " huge", false], [22590, 0.022992, " the", false], [59988, 0.019934, " massively", false], [56640, 0.01921, " millions", false], [56125, 0.017415, " enormous", false], [31370, 0.016007, " many", false], [31581, 0.015781, " only", false]]], "qwen": [1172, 14, 0.01767251081764698, [[10951, 0.12976, " massive", false], [264, 0.099447, " a", false], [34447, 0.044404, " computation", false], [1657, 0.032764, " many", false], [1753, 0.030882, " much", false], [1602, 0.027839, " very", false], [6765, 0.023795, " huge", false], [3460, 0.022523, " large", false], [902, 0.02079, " no", false], [279, 0.020385, " the", false]]]}, "raw_delta": 0.024101066589355513, "tuned_delta": 0.03091334439645346}, {"byte_start": 4698, "byte_end": 4702, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 785, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "11.55% 11.55% 11.55% 11.55%", "qwen": "13.86% 13.86% 13.86% 13.86%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.0759284570813179]], "qwen": [[279, " the", "normal", 0.04623117297887802]]}, "loss": {"rwkv": 11.55283138211865, "qwen": 13.859344457418173}, "topk": {"rwkv": [22590, 2, 0.0759284570813179, [[332, 0.2508, " a", false], [22590, 0.075928, " the", false], [32386, 0.047775, " very", false], [52195, 0.040326, " massive", false], [63421, 0.039779, " convolution", false], [22363, 0.022558, " raw", false], [63885, 0.02175, " statistical", false], [62577, 0.019798, " statistics", false], [22226, 0.018726, " one", false], [47284, 0.018322, " simple", false]]], "qwen": [279, 4, 0.04623117297887802, [[34447, 0.191654, " computation", false], [264, 0.084767, " a", false], [10951, 0.058609, " massive", false], [279, 0.046231, " the", false], [825, 0.040496, " one", false], [2205, 0.032466, " local", false], [15751, 0.027486, " pixels", false], [1602, 0.020954, " very", false], [4285, 0.019496, " simple", false], [1378, 0.018379, " two", false]]]}, "raw_delta": -0.12790024280548096, "tuned_delta": -0.12108796499838301}, {"byte_start": 4702, "byte_end": 4710, "display": {"text": " notions", "kind": "normal"}, "is_word": true, "word_id": 786, "word_key": " notions", "bytes_hex": "20 6e 6f 74 69 6f 6e 73", "compression": {"rwkv": "19.58% 19.58% 19.58% 19.58% 19.58% 19.58% 19.58% 19.58%", "qwen": "21.11% 21.11% 21.11% 21.11% 21.11% 21.11% 21.11% 21.11%"}, "model_tokens": {"rwkv": [[52326, " notions", "normal", 0.0001687364565441385]], "qwen": [[58582, " notions", "normal", 8.57186532812193e-05]]}, "loss": {"rwkv": 19.58345807456698, "qwen": 21.109423589359373}, "topk": {"rwkv": [52326, 488, 0.0001687364565441385, [[22363, 0.137045, " raw", false], [63370, 0.052826, " computation", false], [30579, 0.034723, " data", false], [63885, 0.029296, " statistical", false], [62577, 0.027051, " statistics", false], [52195, 0.02665, " massive", false], [37812, 0.025413, " basic", false], [31461, 0.024938, " most", false], [46826, 0.023344, " pixels", false], [39289, 0.018212, " pixel", false]]], "qwen": [58582, 710, 8.57186532812193e-05, [[7112, 0.240242, " raw", false], [1946, 0.050263, " input", false], [1429, 0.04968, " most", false], [34447, 0.040505, " computation", false], [821, 0.030689, " data", false], [15751, 0.021541, " pixels", false], [44548, 0.013875, " simplest", false], [54480, 0.01277, " computational", false], [2550, 0.012747, " output", false], [1995, 0.011851, " information", false]]]}, "raw_delta": -0.0846174955368042, "tuned_delta": -0.07780521772970625}, {"byte_start": 4710, "byte_end": 4713, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 787, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "0.64% 0.64% 0.64%", "qwen": "0.50% 0.50% 0.50%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.8982996940612793]], "qwen": [[315, " of", "normal", 0.9205737113952637]]}, "loss": {"rwkv": 0.6398671852901082, "qwen": 0.4974787177974093}, "topk": {"rwkv": [4706, 1, 0.8982996940612793, [[4706, 0.8983, " of", false], [32227, 0.055552, " that", false], [30917, 0.004412, " from", false], [21265, 0.004116, " and", false], [4404, 0.00267, " ``", false], [52112, 0.00233, " learned", false], [38547, 0.001869, " found", false], [45, 0.001576, ",", false], [56412, 0.001291, " implicit", false], [4858, 0.001233, " we", false]]], "qwen": [315, 1, 0.9205737113952637, [[315, 0.920574, " of", false], [429, 0.042324, " that", false], [9902, 0.005987, " ``", false], [323, 0.004754, " and", false], [11, 0.001434, ",", false], [504, 0.001303, " from", false], [304, 0.001071, " in", false], [2500, 0.000902, " available", false], [1730, 0.000823, " found", false], [3897, 0.000765, " provided", false]]]}, "raw_delta": 0.007895693182945255, "tuned_delta": 0.014707970990043201}, {"byte_start": 4713, "byte_end": 4725, "display": {"text": " convolution", "kind": "normal"}, "is_word": true, "word_id": 788, "word_key": " convolution", "bytes_hex": "20 63 6f 6e 76 6f 6c 75 74 69 6f 6e", "compression": {"rwkv": "2.44% 2.44% 2.44% 2.44% 2.44% 2.44% 2.44% 2.44% 2.44% 2.44% 2.44% 2.44%", "qwen": "7.81% 7.81% 7.81% 7.81% 7.81% 7.81% 7.81% 7.81% 7.81% 7.81% 7.81% 7.81%"}, "model_tokens": {"rwkv": [[63421, " convolution", "normal", 0.19524215161800385]], "qwen": [[55712, " convolution", "normal", 0.005531262140721083]]}, "loss": {"rwkv": 2.4420619181714227, "qwen": 7.810599254878239}, "topk": {"rwkv": [63421, 1, 0.19524215161800385, [[63421, 0.195242, " convolution", false], [4404, 0.094242, " ``", false], [332, 0.042184, " a", false], [56324, 0.039084, " gradient", false], [46826, 0.033435, " pixels", false], [38332, 0.023855, " edges", false], [38924, 0.01801, " local", false], [46442, 0.017876, " linear", false], [52962, 0.017321, " spatial", false], [59770, 0.016181, " gradients", false]]], "qwen": [55712, 21, 0.005531262140721083, [[15751, 0.210336, " pixels", false], [9902, 0.163015, " ``", false], [1946, 0.080249, " input", false], [12955, 0.049233, " pixel", false], [11127, 0.038684, " inputs", false], [821, 0.02286, " data", false], [264, 0.022442, " a", false], [2168, 0.017997, " image", false], [5335, 0.01565, " images", false], [13617, 0.014336, " layers", false]]]}, "raw_delta": -0.2976949214935303, "tuned_delta": -0.29088264368643235}, {"byte_start": 4725, "byte_end": 4729, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 789, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"rwkv": "2.85% 2.85% 2.85% 2.85%", "qwen": "2.59% 2.59% 2.59% 2.59%"}, "model_tokens": {"rwkv": [[21265, " and", "normal", 0.5329932570457458]], "qwen": [[323, " and", "normal", 0.563117504119873]]}, "loss": {"rwkv": 2.8529857986329596, "qwen": 2.5890375750044}, "topk": {"rwkv": [21265, 1, 0.5329932570457458, [[21265, 0.532993, " and", false], [116, 0.175405, "s", false], [45, 0.148523, ",", false], [1744, 0.06127, "al", false], [275, 0.019235, " (", false], [32487, 0.006133, " with", false], [4706, 0.005644, " of", false], [4596, 0.00458, " in", false], [5346, 0.004128, "---", false], [4715, 0.004019, " or", false]]], "qwen": [323, 1, 0.563117504119873, [[323, 0.563118, " and", false], [11, 0.249865, ",", false], [278, 0.088523, "al", false], [320, 0.033634, " (", false], [448, 0.007711, " with", false], [304, 0.007127, " in", false], [315, 0.006006, " of", false], [4421, 0.005023, "---", false], [311, 0.003296, " to", false], [476, 0.002801, " or", false]]]}, "raw_delta": 0.014636397361755371, "tuned_delta": 0.021448675168853317}, {"byte_start": 4729, "byte_end": 4737, "display": {"text": " certain", "kind": "normal"}, "is_word": true, "word_id": 790, "word_key": " certain", "bytes_hex": "20 63 65 72 74 61 69 6e", "compression": {"rwkv": "19.72% 19.72% 19.72% 19.72% 19.72% 19.72% 19.72% 19.72%", "qwen": "22.03% 22.03% 22.03% 22.03% 22.03% 22.03% 22.03% 22.03%"}, "model_tokens": {"rwkv": [[51161, " certain", "normal", 0.00015908072236925364]], "qwen": [[3654, " certain", "normal", 5.696467269444838e-05]]}, "loss": {"rwkv": 19.724346262153794, "qwen": 22.0305820154288}, "topk": {"rwkv": [51161, 278, 0.00015908072236925364, [[52513, 0.55968, " pooling", false], [56324, 0.027298, " gradient", false], [61531, 0.018319, " activation", false], [30218, 0.01655, " back", false], [46442, 0.015669, " linear", false], [22073, 0.01461, " max", false], [22590, 0.014503, " the", false], [332, 0.014234, " a", false], [46528, 0.012476, " matrix", false], [51725, 0.009805, " feature", false]]], "qwen": [3654, 512, 5.696467269444838e-05, [[74410, 0.323474, " pooling", false], [1182, 0.152139, " back", false], [15099, 0.053239, " activation", false], [1932, 0.031181, " max", false], [7608, 0.024382, " rect", false], [315, 0.020933, " of", false], [20169, 0.020894, " gradient", false], [279, 0.015892, " the", false], [2205, 0.01021, " local", false], [2477, 0.009828, " non", false]]]}, "raw_delta": -0.1278848648071289, "tuned_delta": -0.12107258700003096}, {"byte_start": 4737, "byte_end": 4743, "display": {"text": " kinds", "kind": "normal"}, "is_word": true, "word_id": 791, "word_key": " kinds", "bytes_hex": "20 6b 69 6e 64 73", "compression": {"rwkv": "7.84% 7.84% 7.84% 7.84% 7.84% 7.84%", "qwen": "7.10% 7.10% 7.10% 7.10% 7.10% 7.10%"}, "model_tokens": {"rwkv": [[38841, " kinds", "normal", 0.07323897629976273]], "qwen": [[12829, " kinds", "normal", 0.09435734152793884]]}, "loss": {"rwkv": 7.842775775665913, "qwen": 7.095252467096338}, "topk": {"rwkv": [38841, 3, 0.07323897629976273, [[39193, 0.137678, " other", false], [40050, 0.083065, " types", false], [38841, 0.073239, " kinds", false], [38541, 0.044416, " forms", false], [57520, 0.037435, " variants", false], [47284, 0.032336, " simple", false], [65135, 0.025633, " generalization", false], [37812, 0.024383, " basic", false], [46442, 0.015337, " linear", false], [64481, 0.015307, " mathematical", false]]], "qwen": [12829, 2, 0.09435734152793884, [[1008, 0.125553, " other", false], [12829, 0.094357, " kinds", false], [4494, 0.07733, " types", false], [15099, 0.043503, " activation", false], [4285, 0.025572, " simple", false], [13482, 0.019895, " linear", false], [7525, 0.018981, " operations", false], [13617, 0.018745, " layers", false], [2477, 0.016965, " non", false], [6770, 0.016653, " basic", false]]]}, "raw_delta": 0.04145149389902747, "tuned_delta": 0.04826377170612542}, {"byte_start": 4743, "byte_end": 4746, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 792, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "0.01% 0.01% 0.01%", "qwen": "0.01% 0.01% 0.01%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.9987050294876099]], "qwen": [[315, " of", "normal", 0.99803227186203]]}, "loss": {"rwkv": 0.0077506847988839086, "qwen": 0.011840085975758403}, "topk": {"rwkv": [4706, 1, 0.9987050294876099, [[4706, 0.998705, " of", false], [21265, 0.00021, " and", false], [275, 0.000186, " (", false], [45, 3.9e-05, ",", false], [4715, 3.9e-05, " or", false], [46442, 2.3e-05, " linear", false], [11, 2e-05, "\n", false], [4588, 2e-05, " if", false], [63421, 1.7e-05, " convolution", false], [59751, 1.5e-05, " functions", false]]], "qwen": [315, 1, 0.99803227186203, [[315, 0.998032, " of", false], [323, 0.000492, " and", false], [320, 0.000466, " (", false], [476, 0.000258, " or", false], [11, 0.000107, ",", false], [198, 5.8e-05, "\n", false], [220, 2.7e-05, " ", false], [4421, 1.4e-05, "---", false], [369, 1.3e-05, " for", false], [389, 1.2e-05, " on", false]]]}, "raw_delta": -0.00022676455167432627, "tuned_delta": 0.006585513255423621}, {"byte_start": 4746, "byte_end": 4758, "display": {"text": " invariances", "kind": "normal"}, "is_word": true, "word_id": 793, "word_key": " invariances", "bytes_hex": "20 69 6e 76 61 72 69 61 6e 63 65 73", "compression": {"rwkv": "13.53% 13.53% 13.53% 13.53% 13.53% 13.53% 13.53% 9.24% 9.24% 9.24% 9.24% 9.24%", "qwen": "45.30% 45.30% 45.30% 0.94% 0.94% 0.94% 5.83% 5.83% 5.83% 5.83% 5.83% 5.83%"}, "model_tokens": {"rwkv": [[46326, " invari", "normal", 0.0052588265389204025], [33764, "ances", "normal", 0.07771234214305878]], "qwen": [[304, " in", "normal", 0.0005338663468137383], [947, "var", "normal", 0.855250895023346], [21813, "iances", "normal", 0.14363746345043182]]}, "loss": {"rwkv": 11.740682298901069, "qwen": 14.475323252503442}, "topk": {"rwkv": [46326, 28, 0.0052588265389204025, [[52513, 0.188379, " pooling", false], [61531, 0.086497, " activation", false], [31333, 0.030715, " loss", false], [60060, 0.026381, " nonlinear", false], [51743, 0.023604, " filters", false], [22184, 0.021874, " non", false], [51725, 0.019997, " feature", false], [46442, 0.016582, " linear", false], [46528, 0.015971, " matrix", false], [60342, 0.015415, " recurrent", false]]], "qwen": [304, 149, 0.0005338663468137383, [[74410, 0.326134, " pooling", false], [15099, 0.094545, " activation", false], [2477, 0.030159, " non", false], [13617, 0.025877, " layers", false], [73998, 0.020388, " nonlinear", false], [1182, 0.019519, " back", false], [2205, 0.01408, " local", false], [6193, 0.014002, " layer", false], [13482, 0.013913, " linear", false], [20169, 0.012127, " gradient", false]]]}, "raw_delta": -0.15164069334665933, "tuned_delta": -0.14482841553956138}, {"byte_start": 4758, "byte_end": 4759, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "22.96%", "qwen": "22.09%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.27840277552604675]], "qwen": [[11, ",", "normal", 0.29383400082588196]]}, "loss": {"rwkv": 22.96477457665049, "qwen": 22.086583866116}, "topk": {"rwkv": [45, 1, 0.27840277552604675, [[45, 0.278403, ",", false], [4811, 0.148758, " to", false], [47, 0.141171, ".", false], [32227, 0.101321, " that", false], [275, 0.083358, " (", false], [5346, 0.039119, "---", false], [21265, 0.037337, " and", false], [4596, 0.020327, " in", false], [4706, 0.014202, " of", false], [4423, 0.010588, " as", false]]], "qwen": [11, 1, 0.29383400082588196, [[11, 0.293834, ",", false], [311, 0.188356, " to", false], [13, 0.157803, ".", false], [320, 0.106901, " (", false], [4421, 0.052737, "---", false], [323, 0.043261, " and", false], [304, 0.021859, " in", false], [315, 0.020711, " of", false], [429, 0.014442, " that", false], [369, 0.013225, " for", false]]]}, "raw_delta": 0.04869723320007324, "tuned_delta": 0.05550951100717119}, {"byte_start": 4759, "byte_end": 4763, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 794, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"rwkv": "4.39% 4.39% 4.39% 4.39%", "qwen": "3.81% 3.81% 3.81% 3.81%"}, "model_tokens": {"rwkv": [[21265, " and", "normal", 0.3791503310203552]], "qwen": [[323, " and", "normal", 0.4295869469642639]]}, "loss": {"rwkv": 4.385144838639549, "qwen": 3.8093060776712857}, "topk": {"rwkv": [21265, 1, 0.3791503310203552, [[21265, 0.37915, " and", false], [21400, 0.177188, " but", false], [32139, 0.051698, " such", false], [40186, 0.045415, " which", false], [32487, 0.025175, " with", false], [53356, 0.022609, " without", false], [22797, 0.01705, " yet", false], [22187, 0.016155, " not", false], [4423, 0.015981, " as", false], [31296, 0.012842, " like", false]]], "qwen": [323, 1, 0.4295869469642639, [[323, 0.429587, " and", false], [892, 0.107556, " which", false], [2041, 0.049767, " without", false], [448, 0.047513, " with", false], [1741, 0.036292, " such", false], [714, 0.035953, " but", false], [438, 0.015502, " as", false], [3156, 0.012447, " along", false], [304, 0.011674, " in", false], [311, 0.011388, " to", false]]]}, "raw_delta": 0.031931281089782715, "tuned_delta": 0.038743558896880664}, {"byte_start": 4763, "byte_end": 4771, "display": {"text": " perform", "kind": "normal"}, "is_word": true, "word_id": 795, "word_key": " perform", "bytes_hex": "20 70 65 72 66 6f 72 6d", "compression": {"rwkv": "12.26% 12.26% 12.26% 12.26% 12.26% 12.26% 12.26% 12.26%", "qwen": "10.87% 10.87% 10.87% 10.87% 10.87% 10.87% 10.87% 10.87%"}, "model_tokens": {"rwkv": [[52446, " perform", "normal", 0.004361615516245365]], "qwen": [[2736, " perform", "normal", 0.008039688691496849]]}, "loss": {"rwkv": 12.257272320052715, "qwen": 10.872882923450586}, "topk": {"rwkv": [52446, 39, 0.004361615516245365, [[32232, 0.152991, " they", false], [39936, 0.088245, " these", false], [22590, 0.061236, " the", false], [21286, 0.036178, " are", false], [22797, 0.034759, " yet", false], [4491, 0.031984, " do", false], [31059, 0.027632, " have", false], [38877, 0.025865, " learn", false], [39944, 0.024365, " those", false], [4596, 0.017586, " in", false]]], "qwen": [2736, 27, 0.008039688691496849, [[807, 0.101894, " they", false], [1493, 0.078591, " these", false], [525, 0.053959, " are", false], [279, 0.049706, " the", false], [653, 0.038032, " do", false], [614, 0.034809, " have", false], [3960, 0.026716, " learn", false], [678, 0.021493, " all", false], [990, 0.018424, " use", false], [304, 0.014912, " in", false]]]}, "raw_delta": 0.07676684856414795, "tuned_delta": 0.0835791263712459}, {"byte_start": 4771, "byte_end": 4776, "display": {"text": " much", "kind": "normal"}, "is_word": true, "word_id": 796, "word_key": " much", "bytes_hex": "20 6d 75 63 68", "compression": {"rwkv": "11.95% 11.95% 11.95% 11.95% 11.95%", "qwen": "12.78% 12.78% 12.78% 12.78% 12.78%"}, "model_tokens": {"rwkv": [[31466, " much", "normal", 0.03614165261387825]], "qwen": [[1753, " much", "normal", 0.02893921546638012]]}, "loss": {"rwkv": 11.947318307361726, "qwen": 12.777076123673485}, "topk": {"rwkv": [31466, 6, 0.03614165261387825, [[22590, 0.085432, " the", false], [39931, 0.074771, " their", false], [50892, 0.054455, " amazing", false], [32386, 0.052282, " very", false], [32458, 0.044924, " well", false], [31466, 0.036142, " much", false], [59699, 0.035376, " extremely", false], [332, 0.034585, " a", false], [62478, 0.029972, " remarkably", false], [45301, 0.023731, " better", false]]], "qwen": [1753, 6, 0.02893921546638012, [[10951, 0.108828, " massive", false], [264, 0.058312, " a", false], [34447, 0.051205, " computation", false], [279, 0.036593, " the", false], [82599, 0.032326, " computations", false], [1753, 0.028939, " much", false], [678, 0.028153, " all", false], [1172, 0.024633, " only", false], [63707, 0.023228, " massively", false], [3041, 0.022704, " far", false]]]}, "raw_delta": -0.04601154327392576, "tuned_delta": -0.03919926546682781}, {"byte_start": 4776, "byte_end": 4783, "display": {"text": " better", "kind": "normal"}, "is_word": true, "word_id": 797, "word_key": " better", "bytes_hex": "20 62 65 74 74 65 72", "compression": {"rwkv": "0.56% 0.56% 0.56% 0.56% 0.56% 0.56% 0.56%", "qwen": "13.20% 13.20% 13.20% 13.20% 13.20% 13.20% 13.20%"}, "model_tokens": {"rwkv": [[45301, " better", "normal", 0.8042033314704895]], "qwen": [[2664, " better", "normal", 0.005944317672401667]]}, "loss": {"rwkv": 0.5560051688693864, "qwen": 13.204058925107585}, "topk": {"rwkv": [45301, 1, 0.8042033314704895, [[45301, 0.804203, " better", false], [31458, 0.128882, " more", false], [45, 0.021248, ",", false], [31466, 0.007929, " much", false], [4706, 0.006735, " of", false], [22590, 0.004396, " the", false], [46198, 0.00268, " higher", false], [31277, 0.002679, " less", false], [45961, 0.0019, " faster", false], [4715, 0.001842, " or", false]]], "qwen": [2664, 10, 0.005944317672401667, [[803, 0.738744, " more", false], [11, 0.077369, ",", false], [7046, 0.036871, " greater", false], [34447, 0.032189, " computation", false], [8131, 0.022939, " larger", false], [1753, 0.014226, " much", false], [315, 0.012348, " of", false], [2686, 0.009427, " less", false], [19117, 0.007091, " deeper", false], [2664, 0.005944, " better", false]]]}, "raw_delta": -0.7013570240565709, "tuned_delta": -0.6945447462494729}, {"byte_start": 4783, "byte_end": 4785, "display": {"text": ".\n", "kind": "control"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e 0a", "compression": {"rwkv": "16.91% 23.81%", "qwen": "23.55% 23.55%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.39157339930534363], [261, "\n\n", "control", 0.0713324025273323]], "qwen": [[382, ".\n\n", "control", 0.019882136955857277]]}, "loss": {"rwkv": 20.358343106294452, "qwen": 23.551598012848235}, "topk": {"rwkv": [47, 1, 0.39157339930534363, [[47, 0.391573, ".", false], [32226, 0.230781, " than", false], [4712, 0.075455, " on", false], [45, 0.064032, ",", false], [4596, 0.043581, " in", false], [5346, 0.027273, "---", false], [4424, 0.02656, " at", false], [32487, 0.020676, " with", false], [4423, 0.011813, " as", false], [21265, 0.011764, " and", false]]], "qwen": [382, 8, 0.019882136955857277, [[1091, 0.471128, " than", false], [13, 0.246018, ".", false], [11, 0.053335, ",", false], [304, 0.03831, " in", false], [389, 0.03272, " on", false], [518, 0.025199, " at", false], [323, 0.020144, " and", false], [382, 0.019882, ".\n\n", false], [320, 0.01196, " (", false], [4421, 0.011649, "---", false]]]}, "raw_delta": -0.17707165082295728, "tuned_delta": -0.17025937301585933}, {"byte_start": 4785, "byte_end": 4786, "display": {"text": "\n", "kind": "control"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "0a", "compression": {"rwkv": "23.81%", "qwen": "23.55%"}, "model_tokens": {"rwkv": [[261, "\n\n", "control", 0.0713324025273323]], "qwen": [[382, ".\n\n", "control", 0.019882136955857277]]}, "loss": {"rwkv": 23.810103702171368, "qwen": 23.551598012848235}, "topk": {"rwkv": [261, 3, 0.0713324025273323, [[20996, 0.136027, " The", false], [29894, 0.082697, " This", false], [261, 0.071332, "\n\n", false], [36251, 0.060116, " Again", false], [3913, 0.044614, " In", false], [3918, 0.035474, " It", false], [37451, 0.034215, " There", false], [29893, 0.028133, " They", false], [3641, 0.024055, " As", false], [37453, 0.023938, " These", false]]], "qwen": [382, 8, 0.019882136955857277, [[1091, 0.471128, " than", false], [13, 0.246018, ".", false], [11, 0.053335, ",", false], [304, 0.03831, " in", false], [389, 0.03272, " on", false], [518, 0.025199, " at", false], [323, 0.020144, " and", false], [382, 0.019882, ".\n\n", false], [320, 0.01196, " (", false], [4421, 0.011649, "---", false]]]}, "raw_delta": 0.014334599177042717, "tuned_delta": 0.021146876984140663}, {"byte_start": 4786, "byte_end": 4790, "display": {"text": "This", "kind": "normal"}, "is_word": true, "word_id": 798, "word_key": "this", "bytes_hex": "54 68 69 73", "compression": {"rwkv": "17.54% 17.54% 17.54% 17.54%", "qwen": "18.53% 18.53% 18.53% 18.53%"}, "model_tokens": {"rwkv": [[24242, "This", "normal", 0.02079060487449169]], "qwen": [[1986, "This", "normal", 0.016417063772678375]]}, "loss": {"rwkv": 17.540579354558197, "qwen": 18.527063240774723}, "topk": {"rwkv": [24242, 8, 0.02079060487449169, [[1136, 0.237851, "In", false], [6699, 0.11747, "The", false], [33504, 0.074841, "There", false], [33505, 0.044683, "These", false], [66, 0.040628, "A", false], [1141, 0.033346, "It", false], [5559, 0.023667, "All", false], [24242, 0.020791, "This", false], [1461, 0.015596, "So", false], [853, 0.013117, "As", false]]], "qwen": [1986, 8, 0.016417063772678375, [[641, 0.367578, "In", false], [785, 0.092108, "The", false], [3862, 0.037181, "There", false], [9485, 0.026937, "These", false], [32, 0.026351, "A", false], [2403, 0.01976, "All", false], [2132, 0.018167, "It", false], [1986, 0.016417, "This", false], [67691, 0.016169, "Similarly", false], [23949, 0.012105, "Finally", false]]]}, "raw_delta": -0.0547022819519043, "tuned_delta": -0.04789000414480635}, {"byte_start": 4790, "byte_end": 4793, "display": {"text": " is", "kind": "normal"}, "is_word": true, "word_id": 799, "word_key": " is", "bytes_hex": "20 69 73", "compression": {"rwkv": "8.31% 8.31% 8.31%", "qwen": "11.80% 11.80% 11.80%"}, "model_tokens": {"rwkv": [[4600, " is", "normal", 0.24774423241615295]], "qwen": [[374, " is", "normal", 0.14036953449249268]]}, "loss": {"rwkv": 8.312403067621956, "qwen": 11.802909204955125}, "topk": {"rwkv": [4600, 1, 0.24774423241615295, [[4600, 0.247744, " is", false], [52427, 0.243614, " pattern", false], [51832, 0.018878, " general", false], [51929, 0.015552, " history", false], [46430, 0.015296, " lesson", false], [30659, 0.01513, " does", false], [21800, 0.014576, " has", false], [31307, 0.014172, " list", false], [39831, 0.012394, " story", false], [38875, 0.011288, " leads", false]]], "qwen": [374, 2, 0.14036953449249268, [[5383, 0.312502, " pattern", false], [374, 0.14037, " is", false], [25180, 0.084028, " bitter", false], [9149, 0.038647, " trend", false], [1852, 0.025313, " same", false], [17755, 0.017518, " lesson", false], [572, 0.015478, " was", false], [702, 0.013894, " has", false], [4586, 0.013448, " general", false], [78996, 0.009663, " bitterness", false]]]}, "raw_delta": -0.19355475902557373, "tuned_delta": -0.18674248121847578}, {"byte_start": 4793, "byte_end": 4795, "display": {"text": " a", "kind": "normal"}, "is_word": true, "word_id": 800, "word_key": " a", "bytes_hex": "20 61", "compression": {"rwkv": "19.16% 19.16%", "qwen": "16.10% 16.10%"}, "model_tokens": {"rwkv": [[332, " a", "normal", 0.11822513490915298]], "qwen": [[264, " a", "normal", 0.16762448847293854]]}, "loss": {"rwkv": 19.160793511806542, "qwen": 16.104344712961908}, "topk": {"rwkv": [332, 2, 0.11822513490915298, [[22187, 0.459982, " not", false], [332, 0.118225, " a", false], [22590, 0.070127, " the", false], [31198, 0.03874, " just", false], [21256, 0.032423, " all", false], [4419, 0.026745, " an", false], [31581, 0.017417, " only", false], [4450, 0.017143, " by", false], [32313, 0.014062, " true", false], [45, 0.013436, ",", false]]], "qwen": [264, 2, 0.16762448847293854, [[537, 0.305703, " not", false], [264, 0.167624, " a", false], [279, 0.080188, " the", false], [830, 0.049772, " true", false], [458, 0.044748, " an", false], [1101, 0.033786, " just", false], [1083, 0.030415, " also", false], [678, 0.026734, " all", false], [1172, 0.017125, " only", false], [825, 0.015389, " one", false]]]}, "raw_delta": 0.16948550939559937, "tuned_delta": 0.17629778720269731}, {"byte_start": 4795, "byte_end": 4799, "display": {"text": " big", "kind": "normal"}, "is_word": true, "word_id": 801, "word_key": " big", "bytes_hex": "20 62 69 67", "compression": {"rwkv": "23.67% 23.67% 23.67% 23.67%", "qwen": "18.40% 18.40% 18.40% 18.40%"}, "model_tokens": {"rwkv": [[21357, " big", "normal", 0.005245042033493519]], "qwen": [[2409, " big", "normal", 0.016895288601517677]]}, "loss": {"rwkv": 23.669215514584554, "qwen": 18.397609749687152}, "topk": {"rwkv": [21357, 28, 0.005245042033493519, [[52427, 0.183384, " pattern", false], [51832, 0.114431, " general", false], [32386, 0.070681, " very", false], [46430, 0.046162, " lesson", false], [45534, 0.025313, " common", false], [31323, 0.024797, " long", false], [30992, 0.017608, " good", false], [21365, 0.016361, " bit", false], [38049, 0.015163, " clear", false], [61756, 0.014418, " consistent", false]]], "qwen": [2409, 6, 0.016895288601517677, [[5383, 0.145758, " pattern", false], [25180, 0.106271, " bitter", false], [4586, 0.053672, " general", false], [1602, 0.04959, " very", false], [1293, 0.028695, " long", false], [2409, 0.016895, " big", false], [1661, 0.01616, " good", false], [45250, 0.014066, " recurring", false], [4185, 0.013676, " common", false], [12126, 0.013605, " summary", false]]]}, "raw_delta": 0.2923198938369751, "tuned_delta": 0.299132171644073}, {"byte_start": 4799, "byte_end": 4806, "display": {"text": " lesson", "kind": "normal"}, "is_word": true, "word_id": 802, "word_key": " lesson", "bytes_hex": "20 6c 65 73 73 6f 6e", "compression": {"rwkv": "2.28% 2.28% 2.28% 2.28% 2.28% 2.28% 2.28%", "qwen": "2.75% 2.75% 2.75% 2.75% 2.75% 2.75% 2.75%"}, "model_tokens": {"rwkv": [[46430, " lesson", "normal", 0.40872642397880554]], "qwen": [[17755, " lesson", "normal", 0.34429696202278137]]}, "loss": {"rwkv": 2.2844013273004657, "qwen": 2.746919184055841}, "topk": {"rwkv": [46430, 1, 0.40872642397880554, [[46430, 0.408726, " lesson", false], [45450, 0.053, " change", false], [39932, 0.035947, " theme", false], [45, 0.033989, ",", false], [39831, 0.032178, " story", false], [30587, 0.031735, " deal", false], [31633, 0.029572, " part", false], [52427, 0.023543, " pattern", false], [39981, 0.022922, " topic", false], [52569, 0.020494, " problem", false]]], "qwen": [17755, 1, 0.34429696202278137, [[17755, 0.344297, " lesson", false], [5383, 0.15431, " pattern", false], [6802, 0.054268, " picture", false], [2297, 0.05139, " change", false], [6912, 0.033931, " theme", false], [3364, 0.032475, " story", false], [4586, 0.019287, " general", false], [11, 0.018384, ",", false], [323, 0.018098, " and", false], [3491, 0.016748, " problem", false]]]}, "raw_delta": -0.025647435869489393, "tuned_delta": -0.018835158062391447}, {"byte_start": 4806, "byte_end": 4807, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "29.87%", "qwen": "24.30%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.19243782758712769]], "qwen": [[13, ".", "normal", 0.25993290543556213]]}, "loss": {"rwkv": 29.868295768404316, "qwen": 24.297360649029603}, "topk": {"rwkv": [47, 1, 0.19243782758712769, [[47, 0.192438, ".", false], [45, 0.179535, ",", false], [21700, 0.157419, " for", false], [32227, 0.087892, " that", false], [4596, 0.077698, " in", false], [4811, 0.069318, " to", false], [59, 0.060496, ":", false], [37598, 0.029774, " about", false], [4706, 0.028779, " of", false], [30917, 0.028518, " from", false]]], "qwen": [13, 1, 0.25993290543556213, [[13, 0.259933, ".", false], [369, 0.230987, " for", false], [11, 0.149982, ",", false], [25, 0.080439, ":", false], [311, 0.076702, " to", false], [429, 0.042925, " that", false], [304, 0.033457, " in", false], [911, 0.020299, " about", false], [315, 0.013647, " of", false], [4421, 0.013556, "---", false]]]}, "raw_delta": 0.3089182376861572, "tuned_delta": 0.31573051549325515}, {"byte_start": 4807, "byte_end": 4810, "display": {"text": " As", "kind": "normal"}, "is_word": true, "word_id": 803, "word_key": " as", "bytes_hex": "20 41 73", "compression": {"rwkv": "25.74% 25.74% 25.74%", "qwen": "25.48% 25.48% 25.48%"}, "model_tokens": {"rwkv": [[3641, " As", "normal", 0.013856192119419575]], "qwen": [[1634, " As", "normal", 0.014417086727917194]]}, "loss": {"rwkv": 25.73557559919114, "qwen": 25.483652545829788}, "topk": {"rwkv": [3641, 9, 0.013856192119419575, [[3918, 0.186243, " It", false], [20996, 0.153579, " The", false], [3913, 0.042413, " In", false], [3908, 0.039519, " If", false], [37451, 0.030495, " There", false], [30032, 0.027615, " When", false], [4331, 0.021803, " We", false], [63222, 0.015549, " Researchers", false], [3641, 0.013856, " As", false], [300, 0.013818, " A", false]]], "qwen": [1634, 10, 0.014417086727917194, [[1084, 0.165845, " It", false], [576, 0.106745, " The", false], [758, 0.058878, " In", false], [1416, 0.035811, " If", false], [2619, 0.029166, " There", false], [1205, 0.024241, " We", false], [3197, 0.022053, " When", false], [58150, 0.018399, " Researchers", false], [11097, 0.01658, " Human", false], [1634, 0.014417, " As", false]]]}, "raw_delta": 0.013969580332438003, "tuned_delta": 0.02078185813953595}, {"byte_start": 4810, "byte_end": 4812, "display": {"text": " a", "kind": "normal"}, "is_word": true, "word_id": 804, "word_key": " a", "bytes_hex": "20 61", "compression": {"rwkv": "22.12% 22.12%", "qwen": "25.17% 25.17%"}, "model_tokens": {"rwkv": [[332, " a", "normal", 0.08615144342184067]], "qwen": [[264, " a", "normal", 0.06133865565061569]]}, "loss": {"rwkv": 22.11944545112961, "qwen": 25.169123507988093}, "topk": {"rwkv": [332, 1, 0.08615144342184067, [[332, 0.086151, " a", false], [3609, 0.075876, " AI", false], [22590, 0.073396, " the", false], [31323, 0.065232, " long", false], [4858, 0.052143, " we", false], [4596, 0.040095, " in", false], [308, 0.033985, " I", false], [63843, 0.025554, " researchers", false], [32487, 0.021785, " with", false], [21660, 0.021604, " far", false]]], "qwen": [264, 3, 0.06133865565061569, [[20219, 0.109935, " Moore", false], [304, 0.062056, " in", false], [264, 0.061339, " a", false], [279, 0.060003, " the", false], [582, 0.052603, " we", false], [1293, 0.04475, " long", false], [358, 0.031471, " I", false], [448, 0.024315, " with", false], [15235, 0.023857, " AI", false], [11811, 0.020073, " researchers", false]]]}, "raw_delta": -0.16911005973815918, "tuned_delta": -0.16229778193106123}, {"byte_start": 4812, "byte_end": 4818, "display": {"text": " field", "kind": "normal"}, "is_word": true, "word_id": 805, "word_key": " field", "bytes_hex": "20 66 69 65 6c 64", "compression": {"rwkv": "12.87% 12.87% 12.87% 12.87% 12.87% 12.87%", "qwen": "9.42% 9.42% 9.42% 9.42% 9.42% 9.42%"}, "model_tokens": {"rwkv": [[38478, " field", "normal", 0.01381897833198309]], "qwen": [[2070, " field", "normal", 0.043501608073711395]]}, "loss": {"rwkv": 12.86778779959557, "qwen": 9.422473686748498}, "topk": {"rwkv": [38478, 10, 0.01381897833198309, [[51832, 0.231617, " general", false], [47092, 0.067003, " result", false], [62496, 0.056945, " researcher", false], [31907, 0.037355, " rule", false], [46530, 0.031451, " matter", false], [60212, 0.02284, " practical", false], [21458, 0.021287, " cor", false], [57103, 0.018254, " research", false], [52942, 0.016917, " society", false], [38478, 0.013819, " field", false]]], "qwen": [2070, 5, 0.043501608073711395, [[1102, 0.13028, " result", false], [4586, 0.081515, " general", false], [5912, 0.055403, " rule", false], [28674, 0.047317, " consequence", false], [2070, 0.043502, " field", false], [31085, 0.04242, " researcher", false], [1829, 0.032466, " cor", false], [6366, 0.02916, " computer", false], [3108, 0.020903, " side", false], [14976, 0.020808, " practical", false]]]}, "raw_delta": 0.19104878107706702, "tuned_delta": 0.19786105888416497}, {"byte_start": 4818, "byte_end": 4819, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "8.52%", "qwen": "4.97%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.6238812208175659]], "qwen": [[11, ",", "normal", 0.7591410279273987]]}, "loss": {"rwkv": 8.523735349002175, "qwen": 4.969501577837577}, "topk": {"rwkv": [45, 1, 0.6238812208175659, [[45, 0.623881, ",", false], [4706, 0.118001, " of", false], [4858, 0.050035, " we", false], [46531, 0.028742, " mature", false], [32227, 0.02218, " that", false], [38642, 0.021745, " grows", false], [55981, 0.013377, " develops", false], [39072, 0.009967, " moves", false], [62394, 0.008973, " progresses", false], [4596, 0.005554, " in", false]]], "qwen": [11, 1, 0.7591410279273987, [[11, 0.759141, ",", false], [315, 0.071774, " of", false], [88626, 0.035103, " matures", false], [429, 0.014541, " that", false], [582, 0.013315, " we", false], [27715, 0.009727, " grows", false], [702, 0.005493, " has", false], [91954, 0.005326, " evolves", false], [432, 0.004382, " it", false], [9044, 0.003944, " becomes", false]]]}, "raw_delta": 0.1970885694026947, "tuned_delta": 0.20390084720979265}, {"byte_start": 4819, "byte_end": 4822, "display": {"text": " we", "kind": "normal"}, "is_word": true, "word_id": 806, "word_key": " we", "bytes_hex": "20 77 65", "compression": {"rwkv": "7.94% 7.94% 7.94%", "qwen": "11.50% 11.50% 11.50%"}, "model_tokens": {"rwkv": [[4858, " we", "normal", 0.2629750967025757]], "qwen": [[582, " we", "normal", 0.14750812947750092]]}, "loss": {"rwkv": 7.936701234057122, "qwen": 11.504723535106052}, "topk": {"rwkv": [4858, 2, 0.2629750967025757, [[3609, 0.379272, " AI", false], [4858, 0.262975, " we", false], [55809, 0.131233, " computer", false], [4601, 0.040056, " it", false], [61594, 0.02095, " artificial", false], [52167, 0.019389, " machine", false], [22590, 0.017422, " the", false], [22248, 0.009236, " our", false], [21265, 0.008995, " and", false], [39934, 0.006689, " there", false]]], "qwen": [582, 2, 0.14750812947750092, [[15235, 0.45968, " AI", false], [582, 0.147508, " we", false], [6366, 0.123506, " computer", false], [279, 0.039406, " the", false], [5662, 0.032863, " machine", false], [432, 0.026634, " it", false], [20443, 0.018288, " artificial", false], [11129, 0.007375, " vision", false], [5538, 0.006872, " deep", false], [323, 0.006621, " and", false]]]}, "raw_delta": -0.19785316785176596, "tuned_delta": -0.191040890044668}, {"byte_start": 4822, "byte_end": 4828, "display": {"text": " still", "kind": "normal"}, "is_word": true, "word_id": 807, "word_key": " still", "bytes_hex": "20 73 74 69 6c 6c", "compression": {"rwkv": "17.38% 17.38% 17.38% 17.38% 17.38% 17.38%", "qwen": "16.40% 16.40% 16.40% 16.40% 16.40% 16.40%"}, "model_tokens": {"rwkv": [[39820, " still", "normal", 0.0030238674953579903]], "qwen": [[2058, " still", "normal", 0.00426615821197629]]}, "loss": {"rwkv": 17.37620980237358, "qwen": 16.40176470171745}, "topk": {"rwkv": [39820, 29, 0.0030238674953579903, [[31059, 0.23552, " have", false], [31506, 0.170123, " need", false], [47266, 0.150594, " should", false], [21286, 0.09665, " are", false], [31475, 0.043053, " must", false], [21413, 0.026329, " can", false], [32216, 0.021008, " tend", false], [4491, 0.015176, " do", false], [39196, 0.011395, " ought", false], [5231, 0.009406, "'ve", false]]], "qwen": [2058, 25, 0.00426615821197629, [[614, 0.341647, " have", false], [1184, 0.100251, " need", false], [525, 0.09699, " are", false], [1265, 0.090401, " should", false], [1969, 0.046019, " must", false], [646, 0.017051, " can", false], [3003, 0.014424, "'ve", false], [1033, 0.014299, " were", false], [8376, 0.013918, " tend", false], [1431, 0.012259, " now", false]]]}, "raw_delta": 0.05403470993041992, "tuned_delta": 0.06084698773751787}, {"byte_start": 4828, "byte_end": 4833, "display": {"text": " have", "kind": "normal"}, "is_word": true, "word_id": 808, "word_key": " have", "bytes_hex": "20 68 61 76 65", "compression": {"rwkv": "4.82% 4.82% 4.82% 4.82% 4.82%", "qwen": "3.75% 3.75% 3.75% 3.75% 3.75%"}, "model_tokens": {"rwkv": [[31059, " have", "normal", 0.26352280378341675]], "qwen": [[614, " have", "normal", 0.35401177406311035]]}, "loss": {"rwkv": 4.818376015468999, "qwen": 3.745326811723812}, "topk": {"rwkv": [31059, 1, 0.26352280378341675, [[31059, 0.263523, " have", false], [32216, 0.08879, " tend", false], [31506, 0.063767, " need", false], [4491, 0.050497, " do", false], [39942, 0.031211, " think", false], [31967, 0.021512, " seem", false], [39761, 0.01838, " spend", false], [57328, 0.017694, " struggle", false], [39171, 0.014665, " often", false], [21556, 0.014553, " don", false]]], "qwen": [614, 1, 0.35401177406311035, [[614, 0.354012, " have", false], [1184, 0.089251, " need", false], [653, 0.062919, " do", false], [8376, 0.039788, " tend", false], [1744, 0.02565, " think", false], [4411, 0.025608, " believe", false], [2803, 0.02214, " seem", false], [1513, 0.015161, " don", false], [8990, 0.014136, " haven", false], [1430, 0.012707, " try", false]]]}, "raw_delta": 0.059502482414245626, "tuned_delta": 0.06631476022134357}, {"byte_start": 4833, "byte_end": 4837, "display": {"text": " not", "kind": "normal"}, "is_word": true, "word_id": 809, "word_key": " not", "bytes_hex": "20 6e 6f 74", "compression": {"rwkv": "8.17% 8.17% 8.17% 8.17%", "qwen": "11.42% 11.42% 11.42% 11.42%"}, "model_tokens": {"rwkv": [[22187, " not", "normal", 0.1652144193649292]], "qwen": [[537, " not", "normal", 0.07942873239517212]]}, "loss": {"rwkv": 8.171514880035144, "qwen": 11.419359946350298}, "topk": {"rwkv": [22187, 2, 0.1652144193649292, [[332, 0.324754, " a", false], [22187, 0.165214, " not", false], [31466, 0.088066, " much", false], [4811, 0.06226, " to", false], [31370, 0.053733, " many", false], [32074, 0.037329, " some", false], [22590, 0.024532, " the", false], [4419, 0.017326, " an", false], [22614, 0.013633, " too", false], [31335, 0.011268, " lots", false]]], "qwen": [537, 3, 0.07942873239517212, [[264, 0.426092, " a", false], [1753, 0.093368, " much", false], [537, 0.079429, " not", false], [311, 0.049156, " to", false], [1657, 0.03934, " many", false], [1045, 0.03253, " some", false], [458, 0.023293, " an", false], [279, 0.021844, " the", false], [2238, 0.01847, " too", false], [975, 0.009718, " work", false]]]}, "raw_delta": -0.1800987720489502, "tuned_delta": -0.17328649424185225}, {"byte_start": 4837, "byte_end": 4848, "display": {"text": " thoroughly", "kind": "normal"}, "is_word": true, "word_id": 810, "word_key": " thoroughly", "bytes_hex": "20 74 68 6f 72 6f 75 67 68 6c 79", "compression": {"rwkv": "11.01% 11.01% 11.01% 11.01% 11.01% 11.01% 11.01% 11.01% 11.01% 11.01% 11.01%", "qwen": "11.96% 11.96% 11.96% 11.96% 11.96% 11.96% 11.96% 11.96% 11.96% 11.96% 11.96%"}, "model_tokens": {"rwkv": [[62646, " thoroughly", "normal", 0.001196402939967811]], "qwen": [[26364, " thoroughly", "normal", 0.0006773083587177098]]}, "loss": {"rwkv": 11.014894665878096, "qwen": 11.963522043682426}, "topk": {"rwkv": [62646, 72, 0.001196402939967811, [[38566, 0.230158, " fully", false], [52112, 0.198171, " learned", false], [22797, 0.037944, " yet", false], [56098, 0.033831, " embraced", false], [56480, 0.02799, " internal", false], [30482, 0.024785, " come", false], [39423, 0.024161, " quite", false], [31351, 0.020097, " made", false], [61717, 0.019282, " completely", false], [46112, 0.018802, " gotten", false]]], "qwen": [26364, 96, 0.0006773083587177098, [[9498, 0.296307, " learned", false], [7225, 0.056839, " fully", false], [3602, 0.054157, " yet", false], [17019, 0.035025, " gotten", false], [2167, 0.029621, " really", false], [24692, 0.027863, " figured", false], [2525, 0.026812, " come", false], [5008, 0.024497, " quite", false], [70225, 0.022509, " mastered", false], [42503, 0.020379, " embraced", false]]]}, "raw_delta": -0.052603071386163824, "tuned_delta": -0.045790793579065875}, {"byte_start": 4848, "byte_end": 4856, "display": {"text": " learned", "kind": "normal"}, "is_word": true, "word_id": 811, "word_key": " learned", "bytes_hex": "20 6c 65 61 72 6e 65 64", "compression": {"rwkv": "4.58% 4.58% 4.58% 4.58% 4.58% 4.58% 4.58% 4.58%", "qwen": "3.39% 3.39% 3.39% 3.39% 3.39% 3.39% 3.39% 3.39%"}, "model_tokens": {"rwkv": [[52112, " learned", "normal", 0.12958821654319763]], "qwen": [[9498, " learned", "normal", 0.22197359800338745]]}, "loss": {"rwkv": 4.578866096571416, "qwen": 3.393031207836185}, "topk": {"rwkv": [52112, 2, 0.12958821654319763, [[56480, 0.220386, " internal", false], [52112, 0.129588, " learned", false], [56098, 0.116475, " embraced", false], [62684, 0.076385, " understood", false], [55423, 0.065955, " absorbed", false], [45746, 0.034043, " digest", false], [37761, 0.027321, " assim", false], [38625, 0.027103, " grasp", false], [62141, 0.024378, " integrated", false], [63289, 0.017062, " appreciated", false]]], "qwen": [9498, 1, 0.22197359800338745, [[9498, 0.221974, " learned", false], [42503, 0.174885, " embraced", false], [5306, 0.10591, " internal", false], [15985, 0.089439, " understood", false], [70225, 0.066635, " mastered", false], [41001, 0.047362, " absorbed", false], [48987, 0.040584, " gras", false], [35031, 0.013365, " explored", false], [24692, 0.012867, " figured", false], [11666, 0.010591, " accepted", false]]]}, "raw_delta": 0.0657566487789154, "tuned_delta": 0.07256892658601335}, {"byte_start": 4856, "byte_end": 4859, "display": {"text": " it", "kind": "normal"}, "is_word": true, "word_id": 812, "word_key": " it", "bytes_hex": "20 69 74", "compression": {"rwkv": "2.27% 2.27% 2.27%", "qwen": "5.48% 5.48% 5.48%"}, "model_tokens": {"rwkv": [[4601, " it", "normal", 0.6899352669715881]], "qwen": [[432, " it", "normal", 0.4015727937221527]]}, "loss": {"rwkv": 2.265951683687906, "qwen": 5.484444327661428}, "topk": {"rwkv": [4601, 1, 0.6899352669715881, [[4601, 0.689935, " it", false], [32234, 0.113367, " this", false], [22590, 0.048972, " the", false], [32227, 0.030005, " that", false], [4811, 0.027193, " to", false], [30917, 0.023517, " from", false], [21835, 0.019073, " how", false], [32464, 0.010475, " what", false], [21265, 0.005885, " and", false], [21256, 0.004717, " all", false]]], "qwen": [432, 1, 0.4015727937221527, [[432, 0.401573, " it", false], [1246, 0.116987, " how", false], [279, 0.11032, " the", false], [419, 0.089393, " this", false], [504, 0.053228, " from", false], [429, 0.047667, " that", false], [311, 0.042615, " to", false], [1128, 0.022051, " what", false], [911, 0.019256, " about", false], [1039, 0.015275, " our", false]]]}, "raw_delta": -0.17847112814585367, "tuned_delta": -0.17165885033875572}, {"byte_start": 4859, "byte_end": 4860, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "27.90%", "qwen": "22.17%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.21512676775455475]], "qwen": [[11, ",", "normal", 0.2925507724285126]]}, "loss": {"rwkv": 27.895861142188938, "qwen": 22.16551530372949}, "topk": {"rwkv": [45, 2, 0.21512676775455475, [[47, 0.698023, ".", false], [45, 0.215127, ",", false], [21265, 0.0156, " and", false], [22797, 0.014021, " yet", false], [5346, 0.011033, "---", false], [60, 0.005665, ";", false], [4596, 0.004879, " in", false], [4715, 0.004877, " or", false], [59, 0.004745, ":", false], [275, 0.003949, " (", false]]], "qwen": [11, 2, 0.2925507724285126, [[13, 0.547799, ".", false], [11, 0.292551, ",", false], [382, 0.042821, ".\n\n", false], [323, 0.01752, " and", false], [3602, 0.014398, " yet", false], [624, 0.0134, ".\n", false], [4421, 0.011376, "---", false], [25, 0.011239, ":", false], [26, 0.00771, ";", false], [320, 0.005204, " (", false]]]}, "raw_delta": 0.31775784492492676, "tuned_delta": 0.3245701227320247}, {"byte_start": 4860, "byte_end": 4863, "display": {"text": " as", "kind": "normal"}, "is_word": true, "word_id": 813, "word_key": " as", "bytes_hex": "20 61 73", "compression": {"rwkv": "25.74% 25.74% 25.74%", "qwen": "26.90% 26.90% 26.90%"}, "model_tokens": {"rwkv": [[4423, " as", "normal", 0.013858417049050331]], "qwen": [[438, " as", "normal", 0.011395213194191456]]}, "loss": {"rwkv": 25.73557559919114, "qwen": 26.89761650903091}, "topk": {"rwkv": [4423, 10, 0.013858417049050331, [[21265, 0.372837, " and", false], [21400, 0.289604, " but", false], [55495, 0.046085, " although", false], [4715, 0.04049, " or", false], [30788, 0.027124, " even", false], [22185, 0.019075, " nor", false], [51018, 0.01864, " because", false], [47544, 0.01503, " though", false], [51450, 0.014407, " despite", false], [4423, 0.013858, " as", false]]], "qwen": [438, 11, 0.011395213194191456, [[323, 0.414459, " and", false], [714, 0.295449, " but", false], [7892, 0.052773, " although", false], [476, 0.032967, " or", false], [6329, 0.023723, " nor", false], [1496, 0.020777, " even", false], [3498, 0.014762, " though", false], [8818, 0.01382, " despite", false], [1576, 0.012854, " because", false], [773, 0.012796, " so", false]]]}, "raw_delta": -0.06443723042806004, "tuned_delta": -0.057624952620962094}, {"byte_start": 4863, "byte_end": 4866, "display": {"text": " we", "kind": "normal"}, "is_word": true, "word_id": 814, "word_key": " we", "bytes_hex": "20 77 65", "compression": {"rwkv": "12.02% 12.02% 12.02%", "qwen": "8.57% 8.57% 8.57%"}, "model_tokens": {"rwkv": [[4858, " we", "normal", 0.13641372323036194]], "qwen": [[582, " we", "normal", 0.24048909544944763]]}, "loss": {"rwkv": 12.022458674074693, "qwen": 8.566485936440397}, "topk": {"rwkv": [4858, 2, 0.13641372323036194, [[4601, 0.145102, " it", false], [4858, 0.136414, " we", false], [59655, 0.130704, " evidenced", false], [332, 0.049719, " a", false], [39934, 0.04864, " there", false], [22590, 0.036055, " the", false], [4600, 0.030224, " is", false], [31370, 0.024296, " many", false], [3609, 0.021138, " AI", false], [31466, 0.016736, " much", false]]], "qwen": [582, 1, 0.24048909544944763, [[582, 0.240489, " we", false], [68357, 0.109104, " evidenced", false], [1052, 0.062233, " there", false], [279, 0.055876, " the", false], [432, 0.052813, " it", false], [264, 0.03345, " a", false], [1657, 0.022085, " many", false], [3602, 0.020279, " yet", false], [374, 0.018945, " is", false], [1039, 0.01833, " our", false]]]}, "raw_delta": 0.1916398207346598, "tuned_delta": 0.19845209854175774}, {"byte_start": 4866, "byte_end": 4870, "display": {"text": " are", "kind": "normal"}, "is_word": true, "word_id": 815, "word_key": " are", "bytes_hex": "20 61 72 65", "compression": {"rwkv": "12.33% 12.33% 12.33% 12.33%", "qwen": "12.75% 12.75% 12.75% 12.75%"}, "model_tokens": {"rwkv": [[21286, " are", "normal", 0.0650373324751854]], "qwen": [[525, " are", "normal", 0.05910564213991165]]}, "loss": {"rwkv": 12.327716413846122, "qwen": 12.751750388464055}, "topk": {"rwkv": [21286, 4, 0.0650373324751854, [[31059, 0.257711, " have", false], [47266, 0.097978, " should", false], [39820, 0.091119, " still", false], [21286, 0.065037, " are", false], [55851, 0.039023, " continue", false], [21532, 0.024621, " did", false], [21413, 0.020748, " can", false], [22449, 0.019788, " see", false], [31506, 0.018327, " need", false], [32475, 0.016912, " will", false]]], "qwen": [525, 3, 0.05910564213991165, [[614, 0.339705, " have", false], [2058, 0.161847, " still", false], [525, 0.059106, " are", false], [3060, 0.03749, " continue", false], [1521, 0.033827, " did", false], [1265, 0.032813, " should", false], [686, 0.015527, " will", false], [653, 0.014244, " do", false], [1033, 0.010461, " were", false], [1030, 0.009776, " had", false]]]}, "raw_delta": -0.023513436317443848, "tuned_delta": -0.0167011585103459}, {"byte_start": 4870, "byte_end": 4881, "display": {"text": " continuing", "kind": "normal"}, "is_word": true, "word_id": 816, "word_key": " continuing", "bytes_hex": "20 63 6f 6e 74 69 6e 75 69 6e 67", "compression": {"rwkv": "8.76% 8.76% 8.76% 8.76% 8.76% 8.76% 8.76% 8.76% 8.76% 8.76% 8.76%", "qwen": "8.10% 8.10% 8.10% 8.10% 8.10% 8.10% 8.10% 8.10% 8.10% 8.10% 8.10%"}, "model_tokens": {"rwkv": [[61774, " continuing", "normal", 0.004712753463536501]], "qwen": [[14354, " continuing", "normal", 0.007154079619795084]]}, "loss": {"rwkv": 8.760683664489086, "qwen": 8.098884261357814}, "topk": {"rwkv": [61774, 17, 0.004712753463536501, [[39820, 0.601655, " still", false], [22187, 0.026609, " not", false], [21256, 0.025001, " all", false], [4596, 0.017507, " in", false], [4788, 0.015622, " so", false], [22614, 0.014591, " too", false], [22190, 0.01291, " now", false], [39364, 0.012661, " prone", false], [39171, 0.007968, " often", false], [31581, 0.007585, " only", false]]], "qwen": [14354, 20, 0.007154079619795084, [[2058, 0.387489, " still", false], [537, 0.032653, " not", false], [304, 0.030534, " in", false], [1431, 0.029945, " now", false], [1172, 0.025649, " only", false], [3545, 0.024299, " often", false], [1101, 0.019831, " just", false], [2238, 0.019285, " too", false], [6301, 0.01608, " slow", false], [3602, 0.013849, " yet", false]]]}, "raw_delta": 0.036697951230135806, "tuned_delta": 0.043510229037233755}, {"byte_start": 4881, "byte_end": 4884, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 817, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "0.50% 0.50% 0.50%", "qwen": "0.67% 0.67% 0.67%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.9203104972839355]], "qwen": [[311, " to", "normal", 0.8951485753059387]]}, "loss": {"rwkv": 0.49604382712857015, "qwen": 0.6658374165262169}, "topk": {"rwkv": [4811, 1, 0.9203104972839355, [[4811, 0.92031, " to", false], [45, 0.012706, ",", false], [22590, 0.012267, " the", false], [22248, 0.006624, " our", false], [4596, 0.006189, " in", false], [32487, 0.005142, " with", false], [332, 0.004368, " a", false], [4712, 0.00283, " on", false], [51566, 0.00262, " efforts", false], [57103, 0.0019, " research", false]]], "qwen": [311, 1, 0.8951485753059387, [[311, 0.895149, " to", false], [448, 0.020321, " with", false], [1039, 0.013346, " our", false], [1495, 0.010645, " down", false], [304, 0.009115, " in", false], [389, 0.006475, " on", false], [279, 0.005177, " the", false], [11, 0.003922, ",", false], [3412, 0.003907, " research", false], [264, 0.002929, " a", false]]]}, "raw_delta": -0.00941535582145055, "tuned_delta": -0.0026030780143526033}, {"byte_start": 4884, "byte_end": 4889, "display": {"text": " make", "kind": "normal"}, "is_word": true, "word_id": 818, "word_key": " make", "bytes_hex": "20 6d 61 6b 65", "compression": {"rwkv": "12.79% 12.79% 12.79% 12.79% 12.79%", "qwen": "9.57% 9.57% 9.57% 9.57% 9.57%"}, "model_tokens": {"rwkv": [[31358, " make", "normal", 0.028829652816057205]], "qwen": [[1281, " make", "normal", 0.07037892192602158]]}, "loss": {"rwkv": 12.792647432882603, "qwen": 9.5717812850083}, "topk": {"rwkv": [31358, 4, 0.028829652816057205, [[46330, 0.081484, " invest", false], [22626, 0.062185, " try", false], [46960, 0.042131, " pursue", false], [31358, 0.02883, " make", false], [39761, 0.027448, " spend", false], [22339, 0.02648, " put", false], [4435, 0.023318, " be", false], [40166, 0.022359, " waste", false], [4491, 0.020793, " do", false], [51456, 0.019793, " develop", false]]], "qwen": [1281, 3, 0.07037892192602158, [[22729, 0.090621, " pursue", false], [1430, 0.080991, " try", false], [1281, 0.070379, " make", false], [2725, 0.056145, " invest", false], [8329, 0.031418, " spend", false], [387, 0.031217, " be", false], [12291, 0.02088, " waste", false], [2225, 0.020268, " develop", false], [990, 0.020147, " use", false], [653, 0.019984, " do", false]]]}, "raw_delta": 0.17860274314880364, "tuned_delta": 0.1854150209559016}, {"byte_start": 4889, "byte_end": 4893, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 819, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "12.54% 12.54% 12.54% 12.54%", "qwen": "11.47% 11.47% 11.47% 11.47%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.06185101345181465]], "qwen": [[279, " the", "normal", 0.07849346101284027]]}, "loss": {"rwkv": 12.539048695226342, "qwen": 11.472761634334766}, "topk": {"rwkv": [22590, 3, 0.06185101345181465, [[51566, 0.08921, " efforts", false], [56950, 0.071317, " progress", false], [22590, 0.061851, " the", false], [52224, 0.05928, " methods", false], [56652, 0.032342, " mistakes", false], [57103, 0.027495, " research", false], [22681, 0.023416, " use", false], [332, 0.019399, " a", false], [38720, 0.018452, " human", false], [63678, 0.01664, " investments", false]]], "qwen": [279, 3, 0.07849346101284027, [[5098, 0.106727, " progress", false], [20643, 0.085339, " mistakes", false], [279, 0.078493, " the", false], [2244, 0.032022, " great", false], [8869, 0.02644, " efforts", false], [5413, 0.024356, " methods", false], [264, 0.020544, " a", false], [5089, 0.018895, " significant", false], [1657, 0.018697, " many", false], [2989, 0.015426, " important", false]]]}, "raw_delta": 0.05912750959396362, "tuned_delta": 0.06593978740106157}, {"byte_start": 4893, "byte_end": 4898, "display": {"text": " same", "kind": "normal"}, "is_word": true, "word_id": 820, "word_key": " same", "bytes_hex": "20 73 61 6d 65", "compression": {"rwkv": "3.09% 3.09% 3.09% 3.09% 3.09%", "qwen": "3.22% 3.22% 3.22% 3.22% 3.22%"}, "model_tokens": {"rwkv": [[31937, " same", "normal", 0.42126205563545227]], "qwen": [[1852, " same", "normal", 0.40971702337265015]]}, "loss": {"rwkv": 3.0854513081512005, "qwen": 3.218250506732995}, "topk": {"rwkv": [31937, 1, 0.42126205563545227, [[31937, 0.421262, " same", false], [52245, 0.22086, " mistake", false], [56652, 0.044597, " mistakes", false], [38720, 0.023123, " human", false], [22221, 0.015086, " old", false], [38392, 0.010939, " error", false], [31461, 0.008538, " most", false], [45315, 0.008074, " bitter", false], [45829, 0.007815, " effort", false], [40229, 0.006192, " wrong", false]]], "qwen": [1852, 1, 0.40971702337265015, [[1852, 0.409717, " same", false], [16523, 0.186574, " mistake", false], [20643, 0.049671, " mistakes", false], [3738, 0.044813, " human", false], [4969, 0.020748, " wrong", false], [1465, 0.012287, " error", false], [2310, 0.011683, " old", false], [1429, 0.011365, " most", false], [9142, 0.009277, " transition", false], [1850, 0.008689, " best", false]]]}, "raw_delta": -0.007363951206207281, "tuned_delta": -0.000551673399109334}, {"byte_start": 4898, "byte_end": 4903, "display": {"text": " kind", "kind": "normal"}, "is_word": true, "word_id": 821, "word_key": " kind", "bytes_hex": "20 6b 69 6e 64", "compression": {"rwkv": "18.15% 18.15% 18.15% 18.15% 18.15%", "qwen": "18.33% 18.33% 18.33% 18.33% 18.33%"}, "model_tokens": {"rwkv": [[31214, " kind", "normal", 0.006629901006817818]], "qwen": [[3093, " kind", "normal", 0.006207973230630159]]}, "loss": {"rwkv": 18.146398561181492, "qwen": 18.329154205294348}, "topk": {"rwkv": [31214, 7, 0.006629901006817818, [[56652, 0.686162, " mistakes", false], [52245, 0.153492, " mistake", false], [38841, 0.019924, " kinds", false], [45888, 0.015084, " errors", false], [22221, 0.009375, " old", false], [39745, 0.006914, " sorts", false], [31214, 0.00663, " kind", false], [38392, 0.005062, " error", false], [37812, 0.005001, " basic", false], [21325, 0.004854, " bad", false]]], "qwen": [3093, 10, 0.006207973230630159, [[20643, 0.750139, " mistakes", false], [5975, 0.035275, " errors", false], [12829, 0.023533, " kinds", false], [16523, 0.016307, " mistake", false], [2310, 0.010712, " old", false], [20853, 0.010077, " sorts", false], [4124, 0.008521, " early", false], [3738, 0.008324, " human", false], [2856, 0.008138, " initial", false], [3093, 0.006208, " kind", false]]]}, "raw_delta": -0.010134124755859286, "tuned_delta": -0.0033218469487613393}, {"byte_start": 4903, "byte_end": 4906, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 822, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "0.02% 0.02% 0.02%", "qwen": "0.01% 0.01% 0.01%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.9964361190795898]], "qwen": [[315, " of", "normal", 0.9986101388931274]]}, "loss": {"rwkv": 0.021463434827678516, "qwen": 0.008360422639164542}, "topk": {"rwkv": [4706, 1, 0.9964361190795898, [[4706, 0.996436, " of", false], [56652, 0.00137, " mistakes", false], [45888, 0.000467, " errors", false], [46, 0.000312, "-", false], [45, 0.000154, ",", false], [275, 9.8e-05, " (", false], [21265, 7.7e-05, " and", false], [4715, 7e-05, " or", false], [51566, 6.6e-05, " efforts", false], [38392, 4.7e-05, " error", false]]], "qwen": [315, 1, 0.9986101388931274, [[315, 0.99861, " of", false], [323, 0.000309, " and", false], [20643, 0.000172, " mistakes", false], [476, 0.000135, " or", false], [320, 0.000128, " (", false], [11, 0.000117, ",", false], [5975, 7.1e-05, " errors", false], [8869, 3.4e-05, " efforts", false], [220, 2.5e-05, " ", false], [198, 2.4e-05, "\n", false]]]}, "raw_delta": 0.0007265852764248848, "tuned_delta": 0.007538863083522832}, {"byte_start": 4906, "byte_end": 4915, "display": {"text": " mistakes", "kind": "normal"}, "is_word": true, "word_id": 823, "word_key": " mistakes", "bytes_hex": "20 6d 69 73 74 61 6b 65 73", "compression": {"rwkv": "1.35% 1.35% 1.35% 1.35% 1.35% 1.35% 1.35% 1.35% 1.35%", "qwen": "1.49% 1.49% 1.49% 1.49% 1.49% 1.49% 1.49% 1.49% 1.49%"}, "model_tokens": {"rwkv": [[56652, " mistakes", "normal", 0.51158607006073]], "qwen": [[20643, " mistakes", "normal", 0.4746242165565491]]}, "loss": {"rwkv": 1.3462649036073224, "qwen": 1.4932533397067185}, "topk": {"rwkv": [56652, 1, 0.51158607006073, [[56652, 0.511586, " mistakes", false], [52245, 0.06073, " mistake", false], [57103, 0.030352, " research", false], [45888, 0.027223, " errors", false], [51566, 0.026975, " efforts", false], [45829, 0.023429, " effort", false], [52224, 0.022549, " methods", false], [63678, 0.017824, " investments", false], [38392, 0.012602, " error", false], [62157, 0.012381, " investment", false]]], "qwen": [20643, 1, 0.4746242165565491, [[20643, 0.474624, " mistakes", false], [16523, 0.065973, " mistake", false], [5975, 0.056037, " errors", false], [3738, 0.039857, " human", false], [4124, 0.029794, " early", false], [1465, 0.026912, " error", false], [9162, 0.021732, " investment", false], [21786, 0.017071, " investments", false], [5098, 0.014993, " progress", false], [2856, 0.01144, " initial", false]]]}, "raw_delta": -0.00815076960457696, "tuned_delta": -0.0013384917974790132}, {"byte_start": 4915, "byte_end": 4916, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "31.14%", "qwen": "28.04%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.17702710628509521]], "qwen": [[13, ".", "normal", 0.21126553416252136]]}, "loss": {"rwkv": 31.13628945668563, "qwen": 28.03588296717203}, "topk": {"rwkv": [47, 2, 0.17702710628509521, [[4596, 0.208164, " in", false], [47, 0.177027, ".", false], [31601, 0.152328, " over", false], [32227, 0.103825, " that", false], [45, 0.086929, ",", false], [4423, 0.042897, " as", false], [37635, 0.028794, " again", false], [4858, 0.02804, " we", false], [32487, 0.020131, " with", false], [62482, 0.011705, " repeatedly", false]]], "qwen": [13, 1, 0.21126553416252136, [[13, 0.211266, ".", false], [916, 0.195751, " over", false], [11, 0.095069, ",", false], [429, 0.074492, " that", false], [304, 0.072692, " in", false], [438, 0.048917, " as", false], [4421, 0.042336, "---", false], [582, 0.035252, " we", false], [1549, 0.028672, " again", false], [323, 0.021516, " and", false]]]}, "raw_delta": 0.17192304134368896, "tuned_delta": 0.17873531915078691}, {"byte_start": 4916, "byte_end": 4919, "display": {"text": " To", "kind": "normal"}, "is_word": true, "word_id": 824, "word_key": " to", "bytes_hex": "20 54 6f", "compression": {"rwkv": "31.00% 31.00% 31.00%", "qwen": "28.46% 28.46% 28.46%"}, "model_tokens": {"rwkv": [[4255, " To", "normal", 0.0057165841571986675]], "qwen": [[2014, " To", "normal", 0.008780253119766712]]}, "loss": {"rwkv": 30.99540126909882, "qwen": 28.464673695275074}, "topk": {"rwkv": [4255, 29, 0.0057165841571986675, [[4331, 0.12092, " We", false], [20996, 0.088467, " The", false], [261, 0.074463, "\n\n", false], [3913, 0.060044, " In", false], [19555, 0.051779, " But", false], [3918, 0.046363, " It", false], [37451, 0.045119, " There", false], [19907, 0.026024, " For", false], [29894, 0.023116, " This", false], [308, 0.020513, " I", false]]], "qwen": [2014, 18, 0.008780253119766712, [[1205, 0.111953, " We", false], [1988, 0.093285, " But", false], [576, 0.089017, " The", false], [1084, 0.063892, " It", false], [758, 0.048323, " In", false], [2619, 0.039947, " There", false], [1096, 0.032974, " This", false], [1597, 0.031907, " And", false], [358, 0.026578, " I", false], [1752, 0.022181, " For", false]]]}, "raw_delta": 0.14033333460489916, "tuned_delta": 0.1471456124119971}, {"byte_start": 4919, "byte_end": 4923, "display": {"text": " see", "kind": "normal"}, "is_word": true, "word_id": 825, "word_key": " see", "bytes_hex": "20 73 65 65", "compression": {"rwkv": "16.70% 16.70% 16.70% 16.70%", "qwen": "19.52% 19.52% 19.52% 19.52%"}, "model_tokens": {"rwkv": [[22449, " see", "normal", 0.024635866284370422]], "qwen": [[1490, " see", "normal", 0.013163922354578972]]}, "loss": {"rwkv": 16.69525022903732, "qwen": 19.522709502715966}, "topk": {"rwkv": [22449, 9, 0.024635866284370422, [[4435, 0.097001, " be", false], [31358, 0.058039, " make", false], [32187, 0.048736, " take", false], [22590, 0.038463, " the", false], [21751, 0.028956, " get", false], [32074, 0.02838, " some", false], [4491, 0.027863, " do", false], [62683, 0.026767, " understand", false], [22449, 0.024636, " see", false], [22339, 0.022782, " put", false]]], "qwen": [1490, 17, 0.013163922354578972, [[387, 0.110351, " be", false], [3960, 0.067301, " learn", false], [5648, 0.063263, " avoid", false], [1281, 0.062849, " make", false], [3535, 0.030926, " understand", false], [653, 0.02404, " do", false], [279, 0.02172, " the", false], [633, 0.021199, " get", false], [1896, 0.020937, " take", false], [13153, 0.020529, " repeat", false]]]}, "raw_delta": -0.15678763389587402, "tuned_delta": -0.14997535608877607}, {"byte_start": 4923, "byte_end": 4928, "display": {"text": " this", "kind": "normal"}, "is_word": true, "word_id": 826, "word_key": " this", "bytes_hex": "20 74 68 69 73", "compression": {"rwkv": "7.66% 7.66% 7.66% 7.66% 7.66%", "qwen": "6.74% 6.74% 6.74% 6.74% 6.74%"}, "model_tokens": {"rwkv": [[32234, " this", "normal", 0.11996731907129288]], "qwen": [[419, " this", "normal", 0.15444213151931763]]}, "loss": {"rwkv": 7.664317404722617, "qwen": 6.737154634354944}, "topk": {"rwkv": [32234, 4, 0.11996731907129288, [[22763, 0.174443, " why", false], [22590, 0.16167, " the", false], [21835, 0.125785, " how", false], [32234, 0.119967, " this", false], [4601, 0.072586, " it", false], [32464, 0.060606, " what", false], [32227, 0.048748, " that", false], [332, 0.033742, " a", false], [4419, 0.020283, " an", false], [4588, 0.012825, " if", false]]], "qwen": [419, 1, 0.15444213151931763, [[419, 0.154442, " this", false], [3170, 0.139609, " why", false], [279, 0.133873, " the", false], [1246, 0.12847, " how", false], [1128, 0.07713, " what", false], [429, 0.055649, " that", false], [264, 0.035625, " a", false], [1045, 0.034062, " some", false], [432, 0.033593, " it", false], [1380, 0.028605, " where", false]]]}, "raw_delta": 0.05141282081604004, "tuned_delta": 0.05822509862313799}, {"byte_start": 4928, "byte_end": 4929, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "10.07%", "qwen": "8.79%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.5703551769256592]], "qwen": [[11, ",", "normal", 0.6143350005149841]]}, "loss": {"rwkv": 10.073505412457116, "qwen": 8.786281376580419}, "topk": {"rwkv": [45, 1, 0.5703551769256592, [[45, 0.570355, ",", false], [46430, 0.091504, " lesson", false], [31458, 0.050393, " more", false], [4596, 0.046178, " in", false], [51208, 0.036391, " clearly", false], [52427, 0.031151, " pattern", false], [4423, 0.011579, " as", false], [4600, 0.010003, " is", false], [4858, 0.009475, " we", false], [31461, 0.008364, " most", false]]], "qwen": [11, 1, 0.6143350005149841, [[11, 0.614335, ",", false], [304, 0.049511, " in", false], [9355, 0.0491, " clearly", false], [17755, 0.031125, " lesson", false], [5383, 0.025883, " pattern", false], [803, 0.020151, " more", false], [374, 0.012446, " is", false], [2664, 0.011206, " better", false], [1459, 0.007334, " point", false], [369, 0.007332, " for", false]]]}, "raw_delta": 0.07137885689735413, "tuned_delta": 0.07819113470445208}, {"byte_start": 4929, "byte_end": 4933, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 827, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"rwkv": "24.09% 24.09% 24.09% 24.09%", "qwen": "25.09% 25.09% 25.09% 25.09%"}, "model_tokens": {"rwkv": [[21265, " and", "normal", 0.004786238539963961]], "qwen": [[323, " and", "normal", 0.0038293139077723026]]}, "loss": {"rwkv": 24.091880077344992, "qwen": 25.089682571771426}, "topk": {"rwkv": [21265, 20, 0.004786238539963961, [[55832, 0.201158, " consider", false], [4858, 0.169553, " we", false], [4601, 0.143979, " it", false], [22001, 0.075209, " let", false], [22226, 0.068284, " one", false], [31324, 0.049972, " look", false], [31198, 0.044558, " just", false], [51250, 0.02943, " compare", false], [32187, 0.022614, " take", false], [39942, 0.01727, " think", false]]], "qwen": [323, 26, 0.0038293139077723026, [[2908, 0.195418, " consider", false], [1401, 0.155159, " look", false], [432, 0.101601, " it", false], [582, 0.080695, " we", false], [825, 0.057995, " one", false], [1077, 0.041057, " let", false], [5185, 0.036375, " note", false], [1101, 0.03611, " just", false], [1896, 0.025511, " take", false], [9429, 0.025018, " compare", false]]]}, "raw_delta": -0.05532991886138916, "tuned_delta": -0.04851764105429121}, {"byte_start": 4933, "byte_end": 4936, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 828, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "3.24% 3.24% 3.24%", "qwen": "3.45% 3.45% 3.45%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.580833375453949]], "qwen": [[311, " to", "normal", 0.5629984140396118]]}, "loss": {"rwkv": 3.240428314496695, "qwen": 3.4533216967306837}, "topk": {"rwkv": [4811, 1, 0.580833375453949, [[4811, 0.580833, " to", false], [22590, 0.052701, " the", false], [38877, 0.021734, " learn", false], [22763, 0.019149, " why", false], [21835, 0.018642, " how", false], [30135, 0.016786, " also", false], [22449, 0.013836, " see", false], [62683, 0.012719, " understand", false], [52448, 0.011535, " perhaps", false], [32464, 0.010169, " what", false]]], "qwen": [311, 1, 0.5629984140396118, [[311, 0.562998, " to", false], [279, 0.091902, " the", false], [1246, 0.030864, " how", false], [1083, 0.022423, " also", false], [1008, 0.021903, " other", false], [3170, 0.021149, " why", false], [264, 0.017367, " a", false], [1128, 0.014932, " what", false], [369, 0.01095, " for", false], [1045, 0.010928, " some", false]]]}, "raw_delta": -0.011805315812428802, "tuned_delta": -0.004993038005330855}, {"byte_start": 4936, "byte_end": 4948, "display": {"text": " effectively", "kind": "normal"}, "is_word": true, "word_id": 829, "word_key": " effectively", "bytes_hex": "20 65 66 66 65 63 74 69 76 65 6c 79", "compression": {"rwkv": "13.53% 13.53% 13.53% 13.53% 13.53% 13.53% 13.53% 13.53% 13.53% 13.53% 13.53% 13.53%", "qwen": "13.85% 13.85% 13.85% 13.85% 13.85% 13.85% 13.85% 13.85% 13.85% 13.85% 13.85% 13.85%"}, "model_tokens": {"rwkv": [[63507, " effectively", "normal", 0.00012822926510125399]], "qwen": [[13444, " effectively", "normal", 9.947544458555058e-05]]}, "loss": {"rwkv": 13.52526600833403, "qwen": 13.849271290238262}, "topk": {"rwkv": [63507, 337, 0.00012822926510125399, [[22449, 0.22845, " see", false], [62683, 0.141332, " understand", false], [38877, 0.079946, " learn", false], [37786, 0.0516, " avoid", false], [61588, 0.039045, " appreciate", false], [4435, 0.03508, " be", false], [31358, 0.029419, " make", false], [21751, 0.029337, " get", false], [31059, 0.016596, " have", false], [31223, 0.012826, " know", false]]], "qwen": [13444, 431, 9.947544458555058e-05, [[3535, 0.19748, " understand", false], [1490, 0.11596, " see", false], [3960, 0.075994, " learn", false], [387, 0.03856, " be", false], [5648, 0.03285, " avoid", false], [15401, 0.029415, " appreciate", false], [1281, 0.024992, " make", false], [633, 0.023834, " get", false], [614, 0.021632, " have", false], [15282, 0.016598, " recognize", false]]]}, "raw_delta": -0.01796666781107581, "tuned_delta": -0.011154390003977863}, {"byte_start": 4948, "byte_end": 4955, "display": {"text": " resist", "kind": "normal"}, "is_word": true, "word_id": 830, "word_key": " resist", "bytes_hex": "20 72 65 73 69 73 74", "compression": {"rwkv": "14.09% 14.09% 14.09% 14.09% 14.09% 14.09% 14.09%", "qwen": "19.98% 19.98% 19.98% 19.98% 19.98% 19.98% 19.98%"}, "model_tokens": {"rwkv": [[47087, " resist", "normal", 0.004245252814143896]], "qwen": [[22106, " resist", "normal", 0.00042875210056081414]]}, "loss": {"rwkv": 14.088818758681281, "qwen": 19.97780200852034}, "topk": {"rwkv": [47087, 32, 0.004245252814143896, [[38877, 0.115312, " learn", false], [37730, 0.099845, " apply", false], [37786, 0.078318, " avoid", false], [22681, 0.055303, " use", false], [50855, 0.036807, " address", false], [56540, 0.034767, " leverage", false], [51336, 0.029124, " counter", false], [45522, 0.025424, " combat", false], [32187, 0.025165, " take", false], [53251, 0.023326, " utilize", false]]], "qwen": [22106, 164, 0.00042875210056081414, [[3960, 0.262567, " learn", false], [5648, 0.123221, " avoid", false], [3796, 0.078308, " apply", false], [32064, 0.030248, " leverage", false], [3271, 0.028553, " move", false], [990, 0.022574, " use", false], [1896, 0.020608, " take", false], [1281, 0.020517, " make", false], [4538, 0.017982, " teach", false], [4211, 0.017053, " implement", false]]]}, "raw_delta": -0.32655457087925505, "tuned_delta": -0.3197422930721571}, {"byte_start": 4955, "byte_end": 4958, "display": {"text": " it", "kind": "normal"}, "is_word": true, "word_id": 831, "word_key": " it", "bytes_hex": "20 69 74", "compression": {"rwkv": "14.28% 14.28% 14.28%", "qwen": "12.15% 12.15% 12.15%"}, "model_tokens": {"rwkv": [[4601, " it", "normal", 0.09207085520029068]], "qwen": [[432, " it", "normal", 0.1325092613697052]]}, "loss": {"rwkv": 14.276669675463697, "qwen": 12.1493130773511}, "topk": {"rwkv": [4601, 2, 0.09207085520029068, [[22590, 0.437578, " the", false], [4601, 0.092071, " it", false], [32234, 0.082268, " this", false], [39936, 0.055236, " these", false], [46500, 0.053033, " making", false], [32229, 0.022381, " them", false], [60384, 0.018986, " repeating", false], [39944, 0.017363, " those", false], [32139, 0.015576, " such", false], [51709, 0.015185, " falling", false]]], "qwen": [432, 2, 0.1325092613697052, [[279, 0.322693, " the", false], [432, 0.132509, " it", false], [1493, 0.083273, " these", false], [419, 0.069625, " this", false], [1105, 0.037731, " them", false], [1741, 0.032003, " such", false], [1181, 0.025679, " its", false], [15679, 0.018607, " falling", false], [3259, 0.018244, " making", false], [1846, 0.017832, " those", false]]]}, "raw_delta": 0.1179656982421875, "tuned_delta": 0.12477797604928545}, {"byte_start": 4958, "byte_end": 4959, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "0.77%", "qwen": "1.24%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.9578274488449097]], "qwen": [[11, ",", "normal", 0.9333043098449707]]}, "loss": {"rwkv": 0.7748850317274705, "qwen": 1.2447570854509522}, "topk": {"rwkv": [45, 1, 0.9578274488449097, [[45, 0.957827, ",", false], [4596, 0.010493, " in", false], [275, 0.00383, " (", false], [4423, 0.002868, " as", false], [4600, 0.00285, " is", false], [57102, 0.002161, " requires", false], [32465, 0.002061, " when", false], [5346, 0.001367, "---", false], [21265, 0.001284, " and", false], [38606, 0.000779, " going", false]]], "qwen": [11, 1, 0.9333043098449707, [[11, 0.933304, ",", false], [304, 0.029313, " in", false], [979, 0.003033, " when", false], [320, 0.002939, " (", false], [323, 0.002854, " and", false], [504, 0.002625, " from", false], [2087, 0.002564, " going", false], [369, 0.002483, " for", false], [438, 0.00187, " as", false], [518, 0.001153, " at", false]]]}, "raw_delta": -0.026055239140987396, "tuned_delta": -0.01924296133388945}, {"byte_start": 4959, "byte_end": 4962, "display": {"text": " we", "kind": "normal"}, "is_word": true, "word_id": 832, "word_key": " we", "bytes_hex": "20 77 65", "compression": {"rwkv": "4.93% 4.93% 4.93%", "qwen": "6.28% 6.28% 6.28%"}, "model_tokens": {"rwkv": [[4858, " we", "normal", 0.43833810091018677]], "qwen": [[582, " we", "normal", 0.35177427530288696]]}, "loss": {"rwkv": 4.931086565538449, "qwen": 6.280325574681734}, "topk": {"rwkv": [4858, 1, 0.43833810091018677, [[4858, 0.438338, " we", false], [4601, 0.168389, " it", false], [22226, 0.103295, " one", false], [57102, 0.066508, " requires", false], [4600, 0.038867, " is", false], [22590, 0.023206, " the", false], [22799, 0.018069, " you", false], [308, 0.01604, " I", false], [332, 0.01345, " a", false], [39934, 0.010183, " there", false]]], "qwen": [582, 1, 0.35177427530288696, [[582, 0.351774, " we", false], [432, 0.128463, " it", false], [825, 0.091517, " one", false], [7460, 0.063632, " requires", false], [498, 0.041468, " you", false], [279, 0.033669, " the", false], [374, 0.031293, " is", false], [11811, 0.021768, " researchers", false], [264, 0.020178, " a", false], [2908, 0.017095, " consider", false]]]}, "raw_delta": -0.074817697207133, "tuned_delta": -0.06800541940003504}, {"byte_start": 4962, "byte_end": 4967, "display": {"text": " have", "kind": "normal"}, "is_word": true, "word_id": 833, "word_key": " have", "bytes_hex": "20 68 61 76 65", "compression": {"rwkv": "9.92% 9.92% 9.92% 9.92% 9.92%", "qwen": "11.52% 11.52% 11.52% 11.52% 11.52%"}, "model_tokens": {"rwkv": [[31059, " have", "normal", 0.06238732486963272]], "qwen": [[614, " have", "normal", 0.04098060354590416]]}, "loss": {"rwkv": 9.918528406111623, "qwen": 11.522287263325417}, "topk": {"rwkv": [31059, 3, 0.06238732486963272, [[31506, 0.629968, " need", false], [31475, 0.157773, " must", false], [31059, 0.062387, " have", false], [47266, 0.047083, " should", false], [21413, 0.023559, " can", false], [32475, 0.01588, " will", false], [38499, 0.01051, " first", false], [40219, 0.006677, " would", false], [22074, 0.005099, " may", false], [39021, 0.004807, " might", false]]], "qwen": [614, 3, 0.04098060354590416, [[1184, 0.608809, " need", false], [1969, 0.254305, " must", false], [614, 0.040981, " have", false], [686, 0.027231, " will", false], [1265, 0.024201, " should", false], [646, 0.009551, " can", false], [1035, 0.003053, " would", false], [1156, 0.003053, " first", false], [525, 0.002076, " are", false], [1083, 0.001956, " also", false]]]}, "raw_delta": -0.08893127441406246, "tuned_delta": -0.0821189966069645}, {"byte_start": 4967, "byte_end": 4970, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 834, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "0.30% 0.30% 0.30%", "qwen": "0.25% 0.25% 0.25%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.951839029788971]], "qwen": [[311, " to", "normal", 0.9586803913116455]]}, "loss": {"rwkv": 0.29645222804725196, "qwen": 0.25365889127563124}, "topk": {"rwkv": [4811, 1, 0.951839029788971, [[4811, 0.951839, " to", false], [31581, 0.009348, " only", false], [332, 0.00645, " a", false], [22638, 0.002951, " two", false], [32074, 0.001215, " some", false], [30259, 0.00115, " been", false], [38499, 0.00103, " first", false], [4419, 0.001017, " an", false], [39946, 0.001005, " three", false], [4424, 0.000783, " at", false]]], "qwen": [311, 1, 0.9586803913116455, [[311, 0.95868, " to", false], [264, 0.005949, " a", false], [1378, 0.005568, " two", false], [1172, 0.002125, " only", false], [3807, 0.00138, " several", false], [2326, 0.001378, " three", false], [279, 0.001253, " the", false], [518, 0.00111, " at", false], [537, 0.001098, " not", false], [1045, 0.001079, " some", false]]]}, "raw_delta": 0.0023729664584000894, "tuned_delta": 0.009185244265498035}, {"byte_start": 4970, "byte_end": 4981, "display": {"text": " understand", "kind": "normal"}, "is_word": true, "word_id": 835, "word_key": " understand", "bytes_hex": "20 75 6e 64 65 72 73 74 61 6e 64", "compression": {"rwkv": "2.78% 2.78% 2.78% 2.78% 2.78% 2.78% 2.78% 2.78% 2.78% 2.78% 2.78%", "qwen": "3.93% 3.93% 3.93% 3.93% 3.93% 3.93% 3.93% 3.93% 3.93% 3.93% 3.93%"}, "model_tokens": {"rwkv": [[62683, " understand", "normal", 0.18447467684745789]], "qwen": [[3535, " understand", "normal", 0.09098818153142929]]}, "loss": {"rwkv": 2.779339700576216, "qwen": 3.9297465052446636}, "topk": {"rwkv": [62683, 1, 0.18447467684745789, [[62683, 0.184475, " understand", false], [4435, 0.077312, " be", false], [31324, 0.045221, " look", false], [60335, 0.041644, " recognize", false], [31059, 0.036131, " have", false], [38877, 0.028954, " learn", false], [39942, 0.028227, " think", false], [22449, 0.027639, " see", false], [21295, 0.026039, " ask", false], [31205, 0.021527, " keep", false]]], "qwen": [3535, 2, 0.09098818153142929, [[387, 0.107454, " be", false], [3535, 0.090988, " understand", false], [1401, 0.068165, " look", false], [15282, 0.044598, " recognize", false], [3960, 0.037387, " learn", false], [1744, 0.029901, " think", false], [614, 0.027115, " have", false], [1490, 0.025923, " see", false], [1281, 0.021878, " make", false], [728, 0.021751, " go", false]]]}, "raw_delta": -0.06379209865223279, "tuned_delta": -0.05697982084513484}, {"byte_start": 4981, "byte_end": 4985, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 836, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "4.97% 4.97% 4.97% 4.97%", "qwen": "6.04% 6.04% 6.04% 6.04%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.32909300923347473]], "qwen": [[279, " the", "normal", 0.26193827390670776]]}, "loss": {"rwkv": 4.966308612435152, "qwen": 6.039691032566385}, "topk": {"rwkv": [22590, 1, 0.32909300923347473, [[22590, 0.329093, " the", false], [32464, 0.155662, " what", false], [22763, 0.115061, " why", false], [21835, 0.085955, " how", false], [4601, 0.064537, " it", false], [32227, 0.023963, " that", false], [332, 0.016359, " a", false], [21265, 0.014725, " and", false], [21902, 0.013728, " its", false], [32234, 0.013628, " this", false]]], "qwen": [279, 1, 0.26193827390670776, [[279, 0.261938, " the", false], [1128, 0.127375, " what", false], [3170, 0.11478, " why", false], [432, 0.090524, " it", false], [1246, 0.058081, " how", false], [429, 0.055388, " that", false], [1181, 0.033889, " its", false], [1378, 0.019473, " two", false], [419, 0.016042, " this", false], [1045, 0.014734, " some", false]]]}, "raw_delta": -0.05952095985412598, "tuned_delta": -0.05270868204702803}, {"byte_start": 4985, "byte_end": 4992, "display": {"text": " appeal", "kind": "normal"}, "is_word": true, "word_id": 837, "word_key": " appeal", "bytes_hex": "20 61 70 70 65 61 6c", "compression": {"rwkv": "21.25% 21.25% 21.25% 21.25% 21.25% 21.25% 21.25%", "qwen": "25.58% 25.58% 25.58% 25.58% 25.58% 25.58% 25.58%"}, "model_tokens": {"rwkv": [[45184, " appeal", "normal", 0.0002531547797843814]], "qwen": [[14303, " appeal", "normal", 4.866080416832119e-05]]}, "loss": {"rwkv": 21.253989441667763, "qwen": 25.583714099514278}, "topk": {"rwkv": [45184, 331, 0.0002531547797843814, [[46642, 0.115922, " nature", false], [46430, 0.037444, " lesson", false], [51832, 0.030288, " general", false], [52654, 0.030151, " reasons", false], [52127, 0.02992, " lessons", false], [37812, 0.023718, " basic", false], [62418, 0.023137, " psychology", false], [51929, 0.02253, " history", false], [52427, 0.021763, " pattern", false], [62680, 0.018941, " underlying", false]]], "qwen": [14303, 1067, 4.866080416832119e-05, [[7966, 0.083915, " reasons", false], [6993, 0.045704, " nature", false], [6672, 0.027063, " difference", false], [3840, 0.025021, " history", false], [25180, 0.023007, " bitter", false], [16533, 0.021936, " underlying", false], [15811, 0.020883, " fundamental", false], [1378, 0.020182, " two", false], [29918, 0.013321, " psychology", false], [3491, 0.011962, " problem", false]]]}, "raw_delta": -0.24009091513497482, "tuned_delta": -0.23327863732787688}, {"byte_start": 4992, "byte_end": 4995, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 838, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "0.95% 0.95% 0.95%", "qwen": "0.62% 0.62% 0.62%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.853665292263031]], "qwen": [[315, " of", "normal", 0.9012525081634521]]}, "loss": {"rwkv": 0.9509952662109865, "qwen": 0.624986207275609}, "topk": {"rwkv": [4706, 1, 0.853665292263031, [[4706, 0.853665, " of", false], [4811, 0.051862, " to", false], [21265, 0.033101, " and", false], [32227, 0.016251, " that", false], [45, 0.014329, ",", false], [47, 0.005899, ".", false], [21700, 0.005039, " for", false], [5346, 0.003081, "---", false], [4715, 0.001513, " or", false], [275, 0.001419, " (", false]]], "qwen": [315, 1, 0.9012525081634521, [[315, 0.901253, " of", false], [323, 0.02613, " and", false], [429, 0.023416, " that", false], [311, 0.021789, " to", false], [11, 0.010386, ",", false], [369, 0.002979, " for", false], [304, 0.00221, " in", false], [320, 0.001709, " (", false], [4421, 0.001039, "---", false], [13, 0.000806, ".", false]]]}, "raw_delta": 0.01807778080304464, "tuned_delta": 0.024890058610142585}, {"byte_start": 4995, "byte_end": 5001, "display": {"text": " these", "kind": "normal"}, "is_word": true, "word_id": 839, "word_key": " these", "bytes_hex": "20 74 68 65 73 65", "compression": {"rwkv": "9.91% 9.91% 9.91% 9.91% 9.91% 9.91%", "qwen": "11.26% 11.26% 11.26% 11.26% 11.26% 11.26%"}, "model_tokens": {"rwkv": [[39936, " these", "normal", 0.03638976067304611]], "qwen": [[1493, " these", "normal", 0.023618167266249657]]}, "loss": {"rwkv": 9.909135860272501, "qwen": 11.258248032210776}, "topk": {"rwkv": [39936, 4, 0.03638976067304611, [[22590, 0.310993, " the", false], [38720, 0.223317, " human", false], [52224, 0.082794, " methods", false], [39936, 0.03639, " these", false], [47629, 0.016827, " trying", false], [57103, 0.014899, " research", false], [22248, 0.013043, " our", false], [332, 0.01252, " a", false], [47497, 0.012457, " taking", false], [61590, 0.011091, " approaches", false]]], "qwen": [1493, 5, 0.023618167266249657, [[279, 0.309243, " the", false], [3738, 0.306688, " human", false], [3281, 0.033718, " special", false], [5413, 0.030899, " methods", false], [1493, 0.023618, " these", false], [1039, 0.012996, " our", false], [1045, 0.012859, " some", false], [264, 0.009896, " a", false], [1817, 0.009332, " each", false], [3654, 0.00927, " certain", false]]]}, "raw_delta": -0.07481066385904955, "tuned_delta": -0.0679983860519516}, {"byte_start": 5001, "byte_end": 5010, "display": {"text": " mistakes", "kind": "normal"}, "is_word": true, "word_id": 840, "word_key": " mistakes", "bytes_hex": "20 6d 69 73 74 61 6b 65 73", "compression": {"rwkv": "12.34% 12.34% 12.34% 12.34% 12.34% 12.34% 12.34% 12.34% 12.34%", "qwen": "10.98% 10.98% 10.98% 10.98% 10.98% 10.98% 10.98% 10.98% 10.98%"}, "model_tokens": {"rwkv": [[56652, " mistakes", "normal", 0.0020945463329553604]], "qwen": [[20643, " mistakes", "normal", 0.004172160755842924]]}, "loss": {"rwkv": 12.335543535378722, "qwen": 10.979152675472264}, "topk": {"rwkv": [56652, 40, 0.0020945463329553604, [[38720, 0.192882, " human", false], [39193, 0.11916, " other", false], [52224, 0.073444, " methods", false], [51551, 0.072072, " earlier", false], [22221, 0.060897, " old", false], [63277, 0.039229, " alternative", false], [39174, 0.034501, " older", false], [61590, 0.030935, " approaches", false], [22638, 0.025365, " two", false], [52964, 0.022491, " special", false]]], "qwen": [20643, 20, 0.004172160755842924, [[3738, 0.209033, " human", false], [3281, 0.137328, " special", false], [4124, 0.075919, " early", false], [6788, 0.071177, " earlier", false], [5413, 0.063224, " methods", false], [1008, 0.050898, " other", false], [19827, 0.048362, " approaches", false], [2310, 0.043633, " old", false], [9014, 0.036111, " older", false], [10555, 0.017361, " alternative", false]]]}, "raw_delta": 0.07521428002251518, "tuned_delta": 0.08202655782961313}, {"byte_start": 5010, "byte_end": 5011, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "10.07%", "qwen": "18.89%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.5719759464263916]], "qwen": [[13, ".", "normal", 0.3507641553878784]]}, "loss": {"rwkv": 10.073505412457116, "qwen": 18.892835942629745}, "topk": {"rwkv": [47, 1, 0.5719759464263916, [[47, 0.571976, ".", false], [45, 0.22827, ",", false], [21265, 0.110057, " and", false], [5346, 0.015679, "---", false], [4596, 0.015, " in", false], [4811, 0.013098, " to", false], [59, 0.005555, ":", false], [4423, 0.005168, " as", false], [21700, 0.003924, " for", false], [275, 0.003868, " (", false]]], "qwen": [13, 1, 0.3507641553878784, [[13, 0.350764, ".", false], [11, 0.283279, ",", false], [323, 0.138152, " and", false], [382, 0.08834, ".\n\n", false], [304, 0.02879, " in", false], [4421, 0.028449, "---", false], [438, 0.00939, " as", false], [624, 0.007296, ".\n", false], [25, 0.005875, ":", false], [311, 0.005231, " to", false]]]}, "raw_delta": -0.4890475273132324, "tuned_delta": -0.4822352495061345}, {"byte_start": 5011, "byte_end": 5014, "display": {"text": " We", "kind": "normal"}, "is_word": true, "word_id": 841, "word_key": " we", "bytes_hex": "20 57 65", "compression": {"rwkv": "18.32% 18.32% 18.32%", "qwen": "14.90% 14.90% 14.90%"}, "model_tokens": {"rwkv": [[4331, " We", "normal", 0.04718706011772156]], "qwen": [[1205, " We", "normal", 0.08380118012428284]]}, "loss": {"rwkv": 18.315464386285665, "qwen": 14.903689756734355}, "topk": {"rwkv": [4331, 3, 0.04718706011772156, [[261, 0.392596, "\n\n", false], [20996, 0.095643, " The", false], [4331, 0.047187, " We", false], [37451, 0.02774, " There", false], [3913, 0.027048, " In", false], [29893, 0.026366, " They", false], [3918, 0.025858, " It", false], [20556, 0.022847, " One", false], [267, 0.019879, "  ", false], [19417, 0.017439, " And", false]]], "qwen": [1205, 2, 0.08380118012428284, [[576, 0.111714, " The", false], [1205, 0.083801, " We", false], [8429, 0.070663, " Why", false], [1084, 0.06605, " It", false], [220, 0.059405, " ", false], [758, 0.046129, " In", false], [2619, 0.037961, " There", false], [3776, 0.036161, " One", false], [2379, 0.033422, " They", false], [1096, 0.033081, " This", false]]]}, "raw_delta": 0.18918895721435547, "tuned_delta": 0.19600123502145342}, {"byte_start": 5014, "byte_end": 5019, "display": {"text": " have", "kind": "normal"}, "is_word": true, "word_id": 842, "word_key": " have", "bytes_hex": "20 68 61 76 65", "compression": {"rwkv": "3.92% 3.92% 3.92% 3.92% 3.92%", "qwen": "3.33% 3.33% 3.33% 3.33% 3.33%"}, "model_tokens": {"rwkv": [[31059, " have", "normal", 0.33543044328689575]], "qwen": [[614, " have", "normal", 0.397343248128891]]}, "loss": {"rwkv": 3.9166916149133963, "qwen": 3.328855774177571}, "topk": {"rwkv": [31059, 1, 0.33543044328689575, [[31059, 0.33543, " have", false], [31506, 0.108497, " need", false], [21413, 0.093985, " can", false], [32475, 0.064471, " will", false], [31475, 0.050948, " must", false], [21286, 0.046141, " are", false], [47266, 0.025252, " should", false], [30135, 0.016499, " also", false], [4491, 0.016188, " do", false], [31223, 0.014857, " know", false]]], "qwen": [614, 1, 0.397343248128891, [[614, 0.397343, " have", false], [1184, 0.100606, " need", false], [1969, 0.078978, " must", false], [686, 0.051475, " will", false], [646, 0.046523, " can", false], [1083, 0.042537, " also", false], [1265, 0.024587, " should", false], [525, 0.022719, " are", false], [678, 0.017195, " all", false], [653, 0.017034, " do", false]]]}, "raw_delta": 0.032596540451049816, "tuned_delta": 0.039408818258147765}, {"byte_start": 5019, "byte_end": 5022, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 843, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "0.95% 0.95% 0.95%", "qwen": "1.06% 1.06% 1.06%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.8532204031944275]], "qwen": [[311, " to", "normal", 0.8381847143173218]]}, "loss": {"rwkv": 0.9509952662109865, "qwen": 1.0610827942170276}, "topk": {"rwkv": [4811, 1, 0.8532204031944275, [[4811, 0.85322, " to", false], [332, 0.017824, " a", false], [31968, 0.012778, " seen", false], [50888, 0.009405, " already", false], [30259, 0.006357, " been", false], [22590, 0.005199, " the", false], [30135, 0.004612, " also", false], [22638, 0.004494, " two", false], [21256, 0.003794, " all", false], [4419, 0.003327, " an", false]]], "qwen": [311, 1, 0.8381847143173218, [[311, 0.838185, " to", false], [264, 0.017542, " a", false], [3884, 0.015281, " seen", false], [1012, 0.010706, " been", false], [1083, 0.007613, " also", false], [537, 0.006748, " not", false], [2669, 0.005927, " already", false], [11, 0.005638, ",", false], [458, 0.004663, " an", false], [678, 0.003852, " all", false]]]}, "raw_delta": -0.006104548772176109, "tuned_delta": 0.0007077290349218378}, {"byte_start": 5022, "byte_end": 5028, "display": {"text": " learn", "kind": "normal"}, "is_word": true, "word_id": 844, "word_key": " learn", "bytes_hex": "20 6c 65 61 72 6e", "compression": {"rwkv": "12.68% 12.68% 12.68% 12.68% 12.68% 12.68%", "qwen": "13.20% 13.20% 13.20% 13.20% 13.20% 13.20%"}, "model_tokens": {"rwkv": [[38877, " learn", "normal", 0.014827738516032696]], "qwen": [[3960, " learn", "normal", 0.012385758571326733]]}, "loss": {"rwkv": 12.679936882813154, "qwen": 13.198279693814845}, "topk": {"rwkv": [38877, 7, 0.014827738516032696, [[62683, 0.667598, " understand", false], [22449, 0.06206, " see", false], [31223, 0.021024, " know", false], [4435, 0.019506, " be", false], [60335, 0.018771, " recognize", false], [21295, 0.016299, " ask", false], [38877, 0.014828, " learn", false], [31324, 0.011975, " look", false], [52653, 0.009458, " realize", false], [61588, 0.006988, " appreciate", false]]], "qwen": [3960, 8, 0.012385758571326733, [[3535, 0.416839, " understand", false], [1490, 0.093795, " see", false], [387, 0.080511, " be", false], [15282, 0.071187, " recognize", false], [1414, 0.048619, " know", false], [13083, 0.024323, " realize", false], [15401, 0.014749, " appreciate", false], [3960, 0.012386, " learn", false], [614, 0.011074, " have", false], [22106, 0.009968, " resist", false]]]}, "raw_delta": -0.02874302864074707, "tuned_delta": -0.021930750833649124}, {"byte_start": 5028, "byte_end": 5032, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 845, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "10.43% 10.43% 10.43% 10.43%", "qwen": "9.99% 9.99% 9.99% 9.99%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.10107507556676865]], "qwen": [[279, " the", "normal", 0.10899939388036728]]}, "loss": {"rwkv": 10.425725881424148, "qwen": 9.992525231515227}, "topk": {"rwkv": [22590, 3, 0.10107507556676865, [[4811, 0.295844, " to", false], [22763, 0.124275, " why", false], [22590, 0.101075, " the", false], [21835, 0.100312, " how", false], [32464, 0.080572, " what", false], [32227, 0.053056, " that", false], [30917, 0.048509, " from", false], [37598, 0.041181, " about", false], [22187, 0.017714, " not", false], [45, 0.014454, ",", false]]], "qwen": [279, 2, 0.10899939388036728, [[311, 0.280491, " to", false], [279, 0.108999, " the", false], [3170, 0.097243, " why", false], [504, 0.096747, " from", false], [1246, 0.095497, " how", false], [1128, 0.084064, " what", false], [429, 0.062275, " that", false], [911, 0.026732, " about", false], [537, 0.024654, " not", false], [862, 0.012204, " their", false]]]}, "raw_delta": 0.02402174472808838, "tuned_delta": 0.030834022535186325}, {"byte_start": 5032, "byte_end": 5039, "display": {"text": " bitter", "kind": "normal"}, "is_word": true, "word_id": 846, "word_key": " bitter", "bytes_hex": "20 62 69 74 74 65 72", "compression": {"rwkv": "5.96% 5.96% 5.96% 5.96% 5.96% 5.96% 5.96%", "qwen": "6.93% 6.93% 6.93% 6.93% 6.93% 6.93% 6.93%"}, "model_tokens": {"rwkv": [[45315, " bitter", "normal", 0.09903859347105026]], "qwen": [[25180, " bitter", "normal", 0.06782101839780807]]}, "loss": {"rwkv": 5.957557646528085, "qwen": 6.932363910751027}, "topk": {"rwkv": [45315, 3, 0.09903859347105026, [[46430, 0.132374, " lesson", false], [52127, 0.106222, " lessons", false], [45315, 0.099039, " bitter", false], [52654, 0.045764, " reasons", false], [62418, 0.022464, " psychology", false], [64997, 0.017105, " psychological", false], [51832, 0.016626, " general", false], [47009, 0.016469, " reason", false], [51929, 0.014298, " history", false], [46642, 0.013004, " nature", false]]], "qwen": [25180, 2, 0.06782101839780807, [[18366, 0.074521, " lessons", false], [25180, 0.067821, " bitter", false], [29918, 0.056861, " psychology", false], [7966, 0.049741, " reasons", false], [17755, 0.045587, " lesson", false], [3840, 0.026809, " history", false], [23187, 0.019314, " psychological", false], [6672, 0.015804, " difference", false], [5510, 0.014425, " ways", false], [3738, 0.012123, " human", false]]]}, "raw_delta": -0.05405473709106445, "tuned_delta": -0.047242459283966504}, {"byte_start": 5039, "byte_end": 5046, "display": {"text": " lesson", "kind": "normal"}, "is_word": true, "word_id": 847, "word_key": " lesson", "bytes_hex": "20 6c 65 73 73 6f 6e", "compression": {"rwkv": "1.30% 1.30% 1.30% 1.30% 1.30% 1.30% 1.30%", "qwen": "0.83% 0.83% 0.83% 0.83% 0.83% 0.83% 0.83%"}, "model_tokens": {"rwkv": [[46430, " lesson", "normal", 0.604305624961853]], "qwen": [[17755, " lesson", "normal", 0.7237542867660522]]}, "loss": {"rwkv": 1.2981840141927752, "qwen": 0.8329073714504341}, "topk": {"rwkv": [46430, 1, 0.604305624961853, [[46430, 0.604306, " lesson", false], [52127, 0.33049, " lessons", false], [45, 0.01169, ",", false], [7513, 0.009699, "est", false], [40029, 0.008138, " truth", false], [21265, 0.004407, " and", false], [39899, 0.003109, " taste", false], [51929, 0.001292, " history", false], [39831, 0.001208, " story", false], [61979, 0.001129, " experience", false]]], "qwen": [17755, 1, 0.7237542867660522, [[17755, 0.723754, " lesson", false], [18366, 0.11963, " lessons", false], [8046, 0.027578, " truth", false], [11, 0.016569, ",", false], [12656, 0.015943, " taste", false], [3139, 0.009252, " experience", false], [3840, 0.007859, " history", false], [323, 0.005836, " and", false], [8729, 0.002913, " reality", false], [512, 0.002361, " le", false]]]}, "raw_delta": 0.025800415447780056, "tuned_delta": 0.032612693254878006}, {"byte_start": 5046, "byte_end": 5051, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 848, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"rwkv": "7.83% 7.83% 7.83% 7.83% 7.83%", "qwen": "7.36% 7.36% 7.36% 7.36% 7.36%"}, "model_tokens": {"rwkv": [[32227, " that", "normal", 0.11491511762142181]], "qwen": [[429, " that", "normal", 0.1298098862171173]]}, "loss": {"rwkv": 7.833383229826793, "qwen": 7.363818998176066}, "topk": {"rwkv": [32227, 3, 0.11491511762142181, [[47, 0.320672, ".", false], [4706, 0.16793, " of", false], [32227, 0.114915, " that", false], [45, 0.111262, ",", false], [21265, 0.060403, " and", false], [59, 0.036382, ":", false], [37598, 0.020293, " about", false], [5346, 0.015608, "---", false], [30917, 0.015089, " from", false], [4596, 0.013116, " in", false]]], "qwen": [429, 2, 0.1298098862171173, [[382, 0.154984, ".\n\n", false], [429, 0.12981, " that", false], [13, 0.129599, ".", false], [315, 0.094392, " of", false], [11, 0.087151, ",", false], [323, 0.042616, " and", false], [1632, 0.037236, " well", false], [624, 0.026237, ".\n", false], [504, 0.025933, " from", false], [304, 0.024922, " in", false]]]}, "raw_delta": 0.026038169860839844, "tuned_delta": 0.03285044766793779}, {"byte_start": 5051, "byte_end": 5060, "display": {"text": " building", "kind": "normal"}, "is_word": true, "word_id": 849, "word_key": " building", "bytes_hex": "20 62 75 69 6c 64 69 6e 67", "compression": {"rwkv": "19.41% 19.41% 19.41% 19.41% 19.41% 19.41% 19.41% 19.41% 19.41%", "qwen": "14.69% 14.69% 14.69% 14.69% 14.69% 14.69% 14.69% 14.69% 14.69%"}, "model_tokens": {"rwkv": [[55666, " building", "normal", 6.308580486802384e-05]], "qwen": [[4752, " building", "normal", 0.0006548331002704799]]}, "loss": {"rwkv": 19.41126140084977, "qwen": 14.68970129885748}, "topk": {"rwkv": [55666, 549, 6.308580486802384e-05, [[22590, 0.104655, " the", false], [4858, 0.091558, " we", false], [63370, 0.067783, " computation", false], [51832, 0.065083, " general", false], [52195, 0.057885, " massive", false], [45, 0.046066, ",", false], [37045, 0.044762, " Moore", false], [47202, 0.041361, " search", false], [4601, 0.032059, " it", false], [39936, 0.015474, " these", false]]], "qwen": [4752, 142, 0.0006548331002704799, [[279, 0.103325, " the", false], [4586, 0.063643, " general", false], [432, 0.060562, " it", false], [582, 0.052497, " we", false], [11, 0.051867, ",", false], [3738, 0.037563, " human", false], [1052, 0.022888, " there", false], [374, 0.02135, " is", false], [1493, 0.018889, " these", false], [304, 0.016522, " in", false]]]}, "raw_delta": 0.26181888580322266, "tuned_delta": 0.2686311636103206}, {"byte_start": 5060, "byte_end": 5063, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 850, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "28.55% 28.55% 28.55%", "qwen": "33.67% 33.67% 33.67%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.00860393326729536]], "qwen": [[304, " in", "normal", 0.0036908648908138275]]}, "loss": {"rwkv": 28.553339350927395, "qwen": 33.674271831998276}, "topk": {"rwkv": [4596, 15, 0.00860393326729536, [[52224, 0.176928, " methods", false], [53087, 0.129841, " systems", false], [332, 0.116315, " a", false], [51832, 0.049685, " general", false], [38720, 0.044558, " human", false], [3609, 0.037774, " AI", false], [22248, 0.037464, " our", false], [4712, 0.036056, " on", false], [22590, 0.019393, " the", false], [4419, 0.017072, " an", false]]], "qwen": [304, 37, 0.0036908648908138275, [[5942, 0.208604, " systems", false], [264, 0.125894, " a", false], [5413, 0.058349, " methods", false], [15235, 0.057395, " AI", false], [458, 0.03022, " an", false], [4119, 0.025556, " models", false], [24514, 0.022974, " intelligent", false], [389, 0.022105, " on", false], [4586, 0.02147, " general", false], [2664, 0.017385, " better", false]]]}, "raw_delta": -0.28396479288736987, "tuned_delta": -0.27715251508027194}, {"byte_start": 5063, "byte_end": 5067, "display": {"text": " how", "kind": "normal"}, "is_word": true, "word_id": 851, "word_key": " how", "bytes_hex": "20 68 6f 77", "compression": {"rwkv": "43.96% 43.96% 43.96% 43.96%", "qwen": "38.38% 38.38% 38.38% 38.38%"}, "model_tokens": {"rwkv": [[21835, " how", "normal", 5.8160956541541964e-05]], "qwen": [[1246, " how", "normal", 0.00020085007417947054]]}, "loss": {"rwkv": 43.9571145270856, "qwen": 38.379979433147284}, "topk": {"rwkv": [21835, 366, 5.8160956541541964e-05, [[38720, 0.402025, " human", false], [52195, 0.090533, " massive", false], [51832, 0.055874, " general", false], [22590, 0.040844, " the", false], [22248, 0.034306, " our", false], [332, 0.030529, " a", false], [59943, 0.02302, " knowledge", false], [31458, 0.022674, " more", false], [63370, 0.022098, " computation", false], [47202, 0.02191, " search", false]]], "qwen": [1246, 180, 0.00020085007417947054, [[3738, 0.52517, " human", false], [279, 0.077771, " the", false], [1039, 0.054292, " our", false], [6540, 0.04219, " knowledge", false], [264, 0.02268, " a", false], [7947, 0.015423, " domain", false], [25312, 0.015209, "human", false], [3281, 0.012182, " special", false], [4867, 0.008671, " prior", false], [323, 0.007345, " and", false]]]}, "raw_delta": 0.3092620372772217, "tuned_delta": 0.3160743150843196}, {"byte_start": 5067, "byte_end": 5070, "display": {"text": " we", "kind": "normal"}, "is_word": true, "word_id": 852, "word_key": " we", "bytes_hex": "20 77 65", "compression": {"rwkv": "8.41% 8.41% 8.41%", "qwen": "9.51% 9.51% 9.51%"}, "model_tokens": {"rwkv": [[4858, " we", "normal", 0.24840596318244934]], "qwen": [[582, " we", "normal", 0.2055639922618866]]}, "loss": {"rwkv": 8.406328526013164, "qwen": 9.50975201568386}, "topk": {"rwkv": [4858, 1, 0.24840596318244934, [[4858, 0.248406, " we", false], [46227, 0.163302, " humans", false], [46787, 0.090036, " people", false], [4811, 0.082331, " to", false], [22590, 0.058703, " the", false], [38720, 0.053385, " human", false], [22248, 0.049751, " our", false], [332, 0.036374, " a", false], [63370, 0.036266, " computation", false], [22226, 0.030367, " one", false]]], "qwen": [582, 2, 0.2055639922618866, [[279, 0.246858, " the", false], [582, 0.205564, " we", false], [12677, 0.134287, " humans", false], [1039, 0.085343, " our", false], [1251, 0.076924, " people", false], [264, 0.066651, " a", false], [311, 0.043537, " to", false], [3738, 0.032875, " human", false], [825, 0.014076, " one", false], [2513, 0.009328, " things", false]]]}, "raw_delta": -0.06118679046630865, "tuned_delta": -0.0543745126592107}, {"byte_start": 5070, "byte_end": 5076, "display": {"text": " think", "kind": "normal"}, "is_word": true, "word_id": 853, "word_key": " think", "bytes_hex": "20 74 68 69 6e 6b", "compression": {"rwkv": "2.34% 2.34% 2.34% 2.34% 2.34% 2.34%", "qwen": "1.44% 1.44% 1.44% 1.44% 1.44% 1.44%"}, "model_tokens": {"rwkv": [[39942, " think", "normal", 0.464500367641449]], "qwen": [[1744, " think", "normal", 0.6184293031692505]]}, "loss": {"rwkv": 2.336395777481312, "qwen": 1.444415283022331}, "topk": {"rwkv": [39942, 1, 0.464500367641449, [[39942, 0.4645, " think", false], [62683, 0.133726, " understand", false], [31223, 0.076102, " know", false], [32435, 0.036423, " want", false], [45, 0.019486, ",", false], [60112, 0.017035, " ourselves", false], [22449, 0.015795, " see", false], [46227, 0.013864, " humans", false], [22681, 0.012916, " use", false], [51968, 0.012355, " imagine", false]]], "qwen": [1744, 1, 0.6184293031692505, [[1744, 0.618429, " think", false], [3535, 0.038989, " understand", false], [4411, 0.034441, " believe", false], [1720, 0.032975, " expect", false], [975, 0.025085, " work", false], [12677, 0.01914, " humans", false], [1366, 0.017792, " want", false], [1414, 0.01713, " know", false], [653, 0.014336, " do", false], [525, 0.009446, " are", false]]]}, "raw_delta": 0.04946190118789672, "tuned_delta": 0.05627417899499467}, {"byte_start": 5076, "byte_end": 5079, "display": {"text": " we", "kind": "normal"}, "is_word": true, "word_id": 854, "word_key": " we", "bytes_hex": "20 77 65", "compression": {"rwkv": "9.72% 9.72% 9.72%", "qwen": "17.15% 17.15% 17.15%"}, "model_tokens": {"rwkv": [[4858, " we", "normal", 0.19963987171649933]], "qwen": [[582, " we", "normal", 0.057669106870889664]]}, "loss": {"rwkv": 9.721284943490085, "qwen": 17.150238931027424}, "topk": {"rwkv": [4858, 2, 0.19963987171649933, [[37598, 0.20763, " about", false], [4858, 0.19964, " we", false], [4600, 0.144226, " is", false], [22248, 0.139503, " our", false], [45, 0.053972, ",", false], [22590, 0.030168, " the", false], [21265, 0.021412, " and", false], [4706, 0.016943, " of", false], [5346, 0.016036, "---", false], [47539, 0.012381, " things", false]]], "qwen": [582, 5, 0.057669106870889664, [[374, 0.197221, " is", false], [1039, 0.178334, " our", false], [911, 0.084625, " about", false], [11, 0.061796, ",", false], [582, 0.057669, " we", false], [279, 0.050208, " the", false], [323, 0.028571, " and", false], [12677, 0.026298, " humans", false], [686, 0.023324, " will", false], [4421, 0.019348, "---", false]]]}, "raw_delta": -0.41194868087768555, "tuned_delta": -0.4051364030705876}, {"byte_start": 5079, "byte_end": 5085, "display": {"text": " think", "kind": "normal"}, "is_word": true, "word_id": 855, "word_key": " think", "bytes_hex": "20 74 68 69 6e 6b", "compression": {"rwkv": "2.88% 2.88% 2.88% 2.88% 2.88% 2.88%", "qwen": "1.35% 1.35% 1.35% 1.35% 1.35% 1.35%"}, "model_tokens": {"rwkv": [[39942, " think", "normal", 0.3830876648426056]], "qwen": [[1744, " think", "normal", 0.6386187672615051]]}, "loss": {"rwkv": 2.8764671632307617, "qwen": 1.3478607294303546}, "topk": {"rwkv": [39942, 1, 0.3830876648426056, [[39942, 0.383088, " think", false], [21286, 0.154328, " are", false], [47266, 0.073529, " should", false], [31223, 0.046877, " know", false], [32475, 0.045257, " will", false], [62683, 0.037752, " understand", false], [21413, 0.032514, " can", false], [4491, 0.018779, " do", false], [5230, 0.018591, "'re", false], [22449, 0.017741, " see", false]]], "qwen": [1744, 1, 0.6386187672615051, [[1744, 0.638619, " think", false], [1414, 0.071785, " know", false], [3535, 0.049039, " understand", false], [975, 0.045229, " work", false], [1265, 0.035646, " should", false], [653, 0.0287, " do", false], [525, 0.015335, " are", false], [12677, 0.012244, " humans", false], [646, 0.010578, " can", false], [21776, 0.007312, " ought", false]]]}, "raw_delta": 0.08476393918196361, "tuned_delta": 0.09157621698906156}, {"byte_start": 5085, "byte_end": 5090, "display": {"text": " does", "kind": "normal"}, "is_word": true, "word_id": 856, "word_key": " does", "bytes_hex": "20 64 6f 65 73", "compression": {"rwkv": "16.79% 16.79% 16.79% 16.79% 16.79%", "qwen": "17.11% 17.11% 17.11% 17.11% 17.11%"}, "model_tokens": {"rwkv": [[30659, " does", "normal", 0.009473237209022045]], "qwen": [[1558, " does", "normal", 0.008711479604244232]]}, "loss": {"rwkv": 16.79387196034809, "qwen": 17.10716587611883}, "topk": {"rwkv": [30659, 14, 0.009473237209022045, [[4600, 0.408714, " is", false], [45, 0.141388, ",", false], [5346, 0.041655, "---", false], [37598, 0.033621, " about", false], [38964, 0.02906, " makes", false], [38686, 0.028177, " helps", false], [32475, 0.026475, " will", false], [21265, 0.019441, " and", false], [275, 0.01623, " (", false], [4811, 0.014391, " to", false]]], "qwen": [1558, 16, 0.008711479604244232, [[374, 0.427321, " is", false], [11, 0.107602, ",", false], [4421, 0.075485, "---", false], [686, 0.042633, " will", false], [320, 0.034348, " (", false], [323, 0.020956, " and", false], [11508, 0.017248, " leads", false], [646, 0.016237, " can", false], [1119, 0.015159, " into", false], [911, 0.014814, " about", false]]]}, "raw_delta": -0.01737270355224607, "tuned_delta": -0.010560425745148126}, {"byte_start": 5090, "byte_end": 5094, "display": {"text": " not", "kind": "normal"}, "is_word": true, "word_id": 857, "word_key": " not", "bytes_hex": "20 6e 6f 74", "compression": {"rwkv": "0.32% 0.32% 0.32% 0.32%", "qwen": "0.58% 0.58% 0.58% 0.58%"}, "model_tokens": {"rwkv": [[22187, " not", "normal", 0.9313557744026184]], "qwen": [[537, " not", "normal", 0.8796513676643372]]}, "loss": {"rwkv": 0.32140117793241674, "qwen": 0.5781132315259238}, "topk": {"rwkv": [22187, 1, 0.9313557744026184, [[22187, 0.931356, " not", false], [4835, 0.014048, " us", false], [31458, 0.009263, " more", false], [31466, 0.004488, " much", false], [21660, 0.003029, " far", false], [4692, 0.002972, " no", false], [332, 0.002609, " a", false], [45, 0.002231, ",", false], [4788, 0.001551, " so", false], [52323, 0.001431, " nothing", false]]], "qwen": [537, 1, 0.8796513676643372, [[537, 0.879651, " not", false], [601, 0.026351, " us", false], [803, 0.015866, " more", false], [902, 0.011103, " no", false], [2632, 0.010846, " little", false], [4302, 0.009943, " nothing", false], [279, 0.004964, " the", false], [2686, 0.003646, " less", false], [264, 0.002525, " a", false], [1602, 0.002124, " very", false]]]}, "raw_delta": -0.014235138893127441, "tuned_delta": -0.0074228610860294945}, {"byte_start": 5094, "byte_end": 5099, "display": {"text": " work", "kind": "normal"}, "is_word": true, "word_id": 858, "word_key": " work", "bytes_hex": "20 77 6f 72 6b", "compression": {"rwkv": "4.54% 4.54% 4.54% 4.54% 4.54%", "qwen": "4.62% 4.62% 4.62% 4.62% 4.62%"}, "model_tokens": {"rwkv": [[32499, " work", "normal", 0.2811814546585083]], "qwen": [[975, " work", "normal", 0.27795347571372986]]}, "loss": {"rwkv": 4.536599640295373, "qwen": 4.6177118179217995}, "topk": {"rwkv": [32499, 1, 0.2811814546585083, [[32499, 0.281181, " work", false], [31073, 0.127616, " help", false], [31358, 0.121175, " make", false], [31262, 0.058827, " lead", false], [22269, 0.032641, " pay", false], [51982, 0.020678, " improve", false], [63717, 0.020269, " necessarily", false], [40239, 0.020134, " yield", false], [45150, 0.01778, " always", false], [30972, 0.015155, " give", false]]], "qwen": [975, 1, 0.27795347571372986, [[975, 0.277953, " work", false], [1492, 0.141885, " help", false], [1281, 0.130175, " make", false], [14312, 0.047249, " necessarily", false], [2677, 0.039702, " always", false], [2990, 0.034625, " lead", false], [2291, 0.028309, " pay", false], [7269, 0.019406, " improve", false], [5452, 0.01876, " scale", false], [8193, 0.016406, " produce", false]]]}, "raw_delta": -0.004497814178466786, "tuned_delta": 0.002314463628631161}, {"byte_start": 5099, "byte_end": 5102, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 859, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "22.82% 22.82% 22.82%", "qwen": "14.61% 14.61% 14.61%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.023037761449813843]], "qwen": [[304, " in", "normal", 0.08799804002046585]]}, "loss": {"rwkv": 22.823886389063677, "qwen": 14.609937656305648}, "topk": {"rwkv": [4596, 6, 0.023037761449813843, [[47, 0.563995, ".", false], [45, 0.171368, ",", false], [4423, 0.04515, " as", false], [21265, 0.033248, " and", false], [32458, 0.029443, " well", false], [4596, 0.023038, " in", false], [32386, 0.016051, " very", false], [21700, 0.015212, " for", false], [5346, 0.015019, "---", false], [60, 0.010065, ";", false]]], "qwen": [304, 4, 0.08799804002046585, [[11, 0.228025, ",", false], [13, 0.186119, ".", false], [1632, 0.11878, " well", false], [304, 0.087998, " in", false], [382, 0.056287, ".\n\n", false], [979, 0.046167, " when", false], [369, 0.033962, " for", false], [4421, 0.032596, "---", false], [323, 0.027918, " and", false], [1602, 0.02747, " very", false]]]}, "raw_delta": 0.455478032430013, "tuned_delta": 0.4622903102371109}, {"byte_start": 5102, "byte_end": 5106, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 860, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "7.96% 7.96% 7.96% 7.96%", "qwen": "5.12% 5.12% 5.12% 5.12%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.16879157721996307]], "qwen": [[279, " the", "normal", 0.3210839331150055]]}, "loss": {"rwkv": 7.960182598654924, "qwen": 5.121805113875409}, "topk": {"rwkv": [22590, 3, 0.16879157721996307, [[51832, 0.275629, " general", false], [3609, 0.22535, " AI", false], [22590, 0.168792, " the", false], [56901, 0.059632, " practice", false], [332, 0.041496, " a", false], [32234, 0.027117, " this", false], [31461, 0.018702, " most", false], [55809, 0.015825, " computer", false], [52167, 0.012662, " machine", false], [39936, 0.007521, " these", false]]], "qwen": [279, 1, 0.3210839331150055, [[279, 0.321084, " the", false], [15235, 0.237011, " AI", false], [4586, 0.070292, " general", false], [264, 0.049939, " a", false], [419, 0.04585, " this", false], [6588, 0.034317, " practice", false], [458, 0.020227, " an", false], [6366, 0.019437, " computer", false], [1657, 0.015189, " many", false], [1429, 0.014388, " most", false]]]}, "raw_delta": 0.15739306807518005, "tuned_delta": 0.164205345882278}, {"byte_start": 5106, "byte_end": 5111, "display": {"text": " long", "kind": "normal"}, "is_word": true, "word_id": 861, "word_key": " long", "bytes_hex": "20 6c 6f 6e 67", "compression": {"rwkv": "1.80% 1.80% 1.80% 1.80% 1.80%", "qwen": "2.14% 2.14% 2.14% 2.14% 2.14%"}, "model_tokens": {"rwkv": [[31323, " long", "normal", 0.6038972735404968]], "qwen": [[1293, " long", "normal", 0.5521554946899414]]}, "loss": {"rwkv": 1.8033688011112041, "qwen": 2.1421337774313574}, "topk": {"rwkv": [31323, 1, 0.6038972735404968, [[31323, 0.603897, " long", false], [51832, 0.04834, " general", false], [31835, 0.042379, " real", false], [30807, 0.037014, " face", false], [21616, 0.032837, " end", false], [46470, 0.021682, " longer", false], [31937, 0.017586, " same", false], [22752, 0.015126, " way", false], [3609, 0.012237, " AI", false], [56916, 0.011913, " presence", false]]], "qwen": [1293, 1, 0.5521554946899414, [[1293, 0.552155, " long", false], [3579, 0.056277, " face", false], [1852, 0.040254, " same", false], [1616, 0.039427, " way", false], [2266, 0.035569, " context", false], [835, 0.029098, " end", false], [1879, 0.022416, " world", false], [4586, 0.020575, " general", false], [4231, 0.017114, " age", false], [1931, 0.016012, " real", false]]]}, "raw_delta": -0.01878511905670166, "tuned_delta": -0.011972841249603714}, {"byte_start": 5111, "byte_end": 5115, "display": {"text": " run", "kind": "normal"}, "is_word": true, "word_id": 862, "word_key": " run", "bytes_hex": "20 72 75 6e", "compression": {"rwkv": "0.62% 0.62% 0.62% 0.62%", "qwen": "0.81% 0.81% 0.81% 0.81%"}, "model_tokens": {"rwkv": [[22418, " run", "normal", 0.8720044493675232]], "qwen": [[1598, " run", "normal", 0.8350721001625061]]}, "loss": {"rwkv": 0.6163858206923061, "qwen": 0.812585509856842}, "topk": {"rwkv": [22418, 1, 0.8720044493675232, [[22418, 0.872004, " run", false], [32219, 0.115971, " term", false], [46, 0.006743, "-", false], [31057, 0.002468, " haul", false], [45, 0.000371, ",", false], [4715, 0.000336, " or", false], [21265, 0.000304, " and", false], [39438, 0.000225, " range", false], [8661, 0.000137, "run", false], [27132, 9.1e-05, "term", false]]], "qwen": [1598, 1, 0.8350721001625061, [[1598, 0.835072, " run", false], [4647, 0.149661, " term", false], [22973, 0.006208, "-run", false], [9663, 0.00508, "-term", false], [1809, 0.000577, " game", false], [37868, 0.000539, " haul", false], [11, 0.00049, ",", false], [1651, 0.000252, " view", false], [835, 0.000126, " end", false], [1424, 0.000122, " hand", false]]]}, "raw_delta": -0.010879620909690857, "tuned_delta": -0.00406734310259291}, {"byte_start": 5115, "byte_end": 5116, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "6.27%", "qwen": "17.50%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.7055197954177856]], "qwen": [[13, ".", "normal", 0.3790284991264343]]}, "loss": {"rwkv": 6.269524347613171, "qwen": 17.495271600079956}, "topk": {"rwkv": [47, 1, 0.7055197954177856, [[47, 0.70552, ".", false], [45, 0.184635, ",", false], [21265, 0.043854, " and", false], [5346, 0.011425, "---", false], [60, 0.011398, ";", false], [4423, 0.004177, " as", false], [4588, 0.003889, " if", false], [275, 0.003672, " (", false], [4596, 0.003465, " in", false], [51018, 0.003164, " because", false]]], "qwen": [13, 1, 0.3790284991264343, [[13, 0.379028, ".", false], [11, 0.312495, ",", false], [382, 0.143711, ".\n\n", false], [323, 0.029924, " and", false], [4421, 0.02744, "---", false], [26, 0.020779, ";", false], [979, 0.016691, " when", false], [624, 0.013268, ".\n", false], [320, 0.006766, " (", false], [369, 0.006157, " for", false]]]}, "raw_delta": -0.6224876046180725, "tuned_delta": -0.6156753268109746}, {"byte_start": 5116, "byte_end": 5120, "display": {"text": " The", "kind": "normal"}, "is_word": true, "word_id": 863, "word_key": " the", "bytes_hex": "20 54 68 65", "compression": {"rwkv": "12.19% 12.19% 12.19% 12.19%", "qwen": "11.54% 11.54% 11.54% 11.54%"}, "model_tokens": {"rwkv": [[20996, " The", "normal", 0.06747724860906601]], "qwen": [[576, " The", "normal", 0.07735802233219147]]}, "loss": {"rwkv": 12.186828226259308, "qwen": 11.53845363250652}, "topk": {"rwkv": [20996, 3, 0.06747724860906601, [[261, 0.349487, "\n\n", false], [4331, 0.102759, " We", false], [20996, 0.067477, " The", false], [3918, 0.045971, " It", false], [29894, 0.030018, " This", false], [19417, 0.029136, " And", false], [0, 0.024389, "[0]", false], [267, 0.023468, "  ", false], [3913, 0.021666, " In", false], [19555, 0.017047, " But", false]]], "qwen": [576, 3, 0.07735802233219147, [[1205, 0.201504, " We", false], [1084, 0.085766, " It", false], [576, 0.077358, " The", false], [220, 0.049018, " ", false], [1597, 0.043184, " And", false], [758, 0.04095, " In", false], [12090, 0.036267, " Instead", false], [1096, 0.031497, " This", false], [2014, 0.020006, " To", false], [1416, 0.018401, " If", false]]]}, "raw_delta": 0.035953521728515625, "tuned_delta": 0.042765799535613575}, {"byte_start": 5120, "byte_end": 5127, "display": {"text": " bitter", "kind": "normal"}, "is_word": true, "word_id": 864, "word_key": " bitter", "bytes_hex": "20 62 69 74 74 65 72", "compression": {"rwkv": "8.17% 8.17% 8.17% 8.17% 8.17% 8.17% 8.17%", "qwen": "11.57% 11.57% 11.57% 11.57% 11.57% 11.57% 11.57%"}, "model_tokens": {"rwkv": [[45315, " bitter", "normal", 0.0421920083463192]], "qwen": [[25180, " bitter", "normal", 0.011190979741513729]]}, "loss": {"rwkv": 8.171514880035144, "qwen": 11.574142489455566}, "topk": {"rwkv": [45315, 3, 0.0421920083463192, [[46430, 0.06948, " lesson", false], [45184, 0.049638, " appeal", false], [45315, 0.042192, " bitter", false], [31461, 0.030164, " most", false], [31581, 0.025309, " only", false], [38720, 0.024705, " human", false], [47009, 0.02435, " reason", false], [21357, 0.018104, " big", false], [30273, 0.014821, " best", false], [52127, 0.014589, " lessons", false]]], "qwen": [25180, 12, 0.011190979741513729, [[1172, 0.059374, " only", false], [3738, 0.059229, " human", false], [17755, 0.042784, " lesson", false], [1850, 0.034479, " best", false], [1429, 0.026778, " most", false], [2070, 0.024099, " field", false], [2874, 0.019449, " reason", false], [1616, 0.018545, " way", false], [803, 0.015485, " more", false], [1376, 0.012972, " key", false]]]}, "raw_delta": -0.1886817387172154, "tuned_delta": -0.18186946091011746}, {"byte_start": 5127, "byte_end": 5134, "display": {"text": " lesson", "kind": "normal"}, "is_word": true, "word_id": 865, "word_key": " lesson", "bytes_hex": "20 6c 65 73 73 6f 6e", "compression": {"rwkv": "0.46% 0.46% 0.46% 0.46% 0.46% 0.46% 0.46%", "qwen": "0.27% 0.27% 0.27% 0.27% 0.27% 0.27% 0.27%"}, "model_tokens": {"rwkv": [[46430, " lesson", "normal", 0.8362085223197937]], "qwen": [[17755, " lesson", "normal", 0.9021850824356079]]}, "loss": {"rwkv": 0.4604024701497633, "qwen": 0.2651869017991099}, "topk": {"rwkv": [46430, 1, 0.8362085223197937, [[46430, 0.836209, " lesson", false], [52127, 0.050987, " lessons", false], [7513, 0.040797, "est", false], [31633, 0.010316, " part", false], [40029, 0.006771, " truth", false], [39899, 0.005879, " taste", false], [46, 0.002587, "-", false], [45, 0.002271, ",", false], [47009, 0.002113, " reason", false], [31683, 0.002005, " pill", false]]], "qwen": [17755, 1, 0.9021850824356079, [[17755, 0.902185, " lesson", false], [18366, 0.020929, " lessons", false], [8046, 0.011496, " truth", false], [11, 0.004877, ",", false], [477, 0.004274, "est", false], [12656, 0.003808, " taste", false], [3139, 0.003217, " experience", false], [949, 0.00215, " part", false], [374, 0.001937, " is", false], [323, 0.001742, " and", false]]]}, "raw_delta": 0.010825049664293014, "tuned_delta": 0.017637327471390962}, {"byte_start": 5134, "byte_end": 5137, "display": {"text": " is", "kind": "normal"}, "is_word": true, "word_id": 866, "word_key": " is", "bytes_hex": "20 69 73", "compression": {"rwkv": "2.83% 2.83% 2.83%", "qwen": "4.62% 4.62% 4.62%"}, "model_tokens": {"rwkv": [[4600, " is", "normal", 0.6271616220474243]], "qwen": [[374, " is", "normal", 0.4638510048389435]]}, "loss": {"rwkv": 2.829504434035157, "qwen": 4.617777529626316}, "topk": {"rwkv": [4600, 1, 0.6271616220474243, [[4600, 0.627162, " is", false], [32227, 0.050645, " that", false], [4706, 0.043425, " of", false], [45, 0.032363, ",", false], [21800, 0.025485, " has", false], [30135, 0.016604, " also", false], [21413, 0.015847, " can", false], [22748, 0.009981, " was", false], [4596, 0.009969, " in", false], [21700, 0.007206, " for", false]]], "qwen": [374, 1, 0.4638510048389435, [[374, 0.463851, " is", false], [429, 0.060347, " that", false], [315, 0.045223, " of", false], [702, 0.037756, " has", false], [11, 0.030756, ",", false], [1231, 0.021503, " may", false], [646, 0.019577, " can", false], [1083, 0.01896, " also", false], [686, 0.015643, " will", false], [572, 0.013588, " was", false]]]}, "raw_delta": -0.0991629163424174, "tuned_delta": -0.09235063853531945}, {"byte_start": 5137, "byte_end": 5143, "display": {"text": " based", "kind": "normal"}, "is_word": true, "word_id": 867, "word_key": " based", "bytes_hex": "20 62 61 73 65 64", "compression": {"rwkv": "18.97% 18.97% 18.97% 18.97% 18.97% 18.97%", "qwen": "21.48% 21.48% 21.48% 21.48% 21.48% 21.48%"}, "model_tokens": {"rwkv": [[37810, " based", "normal", 0.0018387966556474566]], "qwen": [[3118, " based", "normal", 0.0007878189207985997]]}, "loss": {"rwkv": 18.972942595024126, "qwen": 21.47885020595085}, "topk": {"rwkv": [37810, 38, 0.0018387966556474566, [[32227, 0.486322, " that", false], [22590, 0.057378, " the", false], [22187, 0.055879, " not", false], [30135, 0.035226, " also", false], [32234, 0.030083, " this", false], [332, 0.026531, " a", false], [59, 0.018463, ":", false], [4811, 0.017381, " to", false], [45, 0.015693, ",", false], [37598, 0.013931, " about", false]]], "qwen": [3118, 87, 0.0007878189207985997, [[429, 0.420396, " that", false], [537, 0.060272, " not", false], [264, 0.042158, " a", false], [1083, 0.040813, " also", false], [279, 0.035126, " the", false], [25180, 0.026915, " bitter", false], [419, 0.024569, " this", false], [825, 0.021177, " one", false], [11, 0.015526, ",", false], [25, 0.013466, ":", false]]]}, "raw_delta": -0.13895702362060547, "tuned_delta": -0.13214474581350752}, {"byte_start": 5143, "byte_end": 5146, "display": {"text": " on", "kind": "normal"}, "is_word": true, "word_id": 868, "word_key": " on", "bytes_hex": "20 6f 6e", "compression": {"rwkv": "0.54% 0.54% 0.54%", "qwen": "0.63% 0.63% 0.63%"}, "model_tokens": {"rwkv": [[4712, " on", "normal", 0.9140609502792358]], "qwen": [[389, " on", "normal", 0.9003555178642273]]}, "loss": {"rwkv": 0.5400713857494491, "qwen": 0.6309720544814594}, "topk": {"rwkv": [4712, 1, 0.9140609502792358, [[4712, 0.914061, " on", false], [4596, 0.035357, " in", false], [22187, 0.013511, " not", false], [32350, 0.009348, " upon", false], [45, 0.006967, ",", false], [45202, 0.001567, " around", false], [46768, 0.001562, " partly", false], [30322, 0.001222, " both", false], [31458, 0.001103, " more", false], [60247, 0.000881, " primarily", false]]], "qwen": [389, 1, 0.9003555178642273, [[389, 0.900356, " on", false], [304, 0.02386, " in", false], [537, 0.01802, " not", false], [11, 0.010356, ",", false], [5193, 0.009928, " upon", false], [1172, 0.00229, " only", false], [11368, 0.002201, " entirely", false], [803, 0.002024, " more", false], [13771, 0.001939, " largely", false], [2163, 0.001594, " around", false]]]}, "raw_delta": -0.00504060337940852, "tuned_delta": 0.0017716744276894273}, {"byte_start": 5146, "byte_end": 5150, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 869, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "4.49% 4.49% 4.49% 4.49%", "qwen": "5.10% 5.10% 5.10% 5.10%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.36900147795677185]], "qwen": [[279, " the", "normal", 0.32240262627601624]]}, "loss": {"rwkv": 4.490810979329659, "qwen": 5.103327190377551}, "topk": {"rwkv": [22590, 1, 0.36900147795677185, [[22590, 0.369001, " the", false], [332, 0.146473, " a", false], [37045, 0.087066, " Moore", false], [22638, 0.054982, " two", false], [4419, 0.029601, " an", false], [32464, 0.018348, " what", false], [39946, 0.016287, " three", false], [32234, 0.015369, " this", false], [21835, 0.01068, " how", false], [56537, 0.010508, " learning", false]]], "qwen": [279, 1, 0.32240262627601624, [[279, 0.322403, " the", false], [264, 0.118365, " a", false], [1378, 0.048474, " two", false], [20219, 0.045589, " Moore", false], [458, 0.021637, " an", false], [1128, 0.020198, " what", false], [3139, 0.017951, " experience", false], [2326, 0.017125, " three", false], [1039, 0.012978, " our", false], [3738, 0.00938, " human", false]]]}, "raw_delta": -0.033965110778808594, "tuned_delta": -0.027152832971710648}, {"byte_start": 5150, "byte_end": 5161, "display": {"text": " historical", "kind": "normal"}, "is_word": true, "word_id": 870, "word_key": " historical", "bytes_hex": "20 68 69 73 74 6f 72 69 63 61 6c", "compression": {"rwkv": "11.27% 11.27% 11.27% 11.27% 11.27% 11.27% 11.27% 11.27% 11.27% 11.27% 11.27%", "qwen": "9.95% 9.95% 9.95% 9.95% 9.95% 9.95% 9.95% 9.95% 9.95% 9.95% 9.95%"}, "model_tokens": {"rwkv": [[62061, " historical", "normal", 0.0010477923788130283]], "qwen": [[13656, " historical", "normal", 0.002314023906365037]]}, "loss": {"rwkv": 11.271055006945026, "qwen": 9.949296415046708}, "topk": {"rwkv": [62061, 134, 0.0010477923788130283, [[30808, 0.117634, " fact", false], [63729, 0.066414, " observation", false], [59725, 0.049144, " following", false], [51832, 0.025658, " general", false], [31135, 0.023906, " idea", false], [60250, 0.020521, " principle", false], [61979, 0.015461, " experience", false], [46681, 0.015048, " notion", false], [47284, 0.014016, " simple", false], [63820, 0.013429, " realization", false]]], "qwen": [13656, 51, 0.002314023906365037, [[2097, 0.133914, " fact", false], [21930, 0.114291, " observation", false], [2701, 0.046345, " following", false], [4285, 0.033885, " simple", false], [4522, 0.023517, " idea", false], [24335, 0.022318, " assumption", false], [17508, 0.021572, " principle", false], [15811, 0.016477, " fundamental", false], [48703, 0.015829, " realization", false], [17843, 0.012666, " recognition", false]]]}, "raw_delta": 0.07329385930841614, "tuned_delta": 0.08010613711551409}, {"byte_start": 5161, "byte_end": 5174, "display": {"text": " observations", "kind": "normal"}, "is_word": true, "word_id": 871, "word_key": " observations", "bytes_hex": "20 6f 62 73 65 72 76 61 74 69 6f 6e 73", "compression": {"rwkv": "6.68% 6.68% 6.68% 6.68% 6.68% 6.68% 6.68% 6.68% 6.68% 6.68% 6.68% 6.68% 6.68%", "qwen": "8.09% 8.09% 8.09% 8.09% 8.09% 8.09% 8.09% 8.09% 8.09% 8.09% 8.09% 8.09% 8.09%"}, "model_tokens": {"rwkv": [[64495, " observations", "normal", 0.008158502168953419]], "qwen": [[23722, " observations", "normal", 0.002941312501206994]]}, "loss": {"rwkv": 6.675932581036667, "qwen": 8.085888687000958}, "topk": {"rwkv": [64495, 16, 0.008158502168953419, [[52427, 0.179869, " pattern", false], [30808, 0.10292, " fact", false], [47024, 0.089666, " record", false], [56157, 0.066366, " evidence", false], [61979, 0.064787, " experience", false], [56162, 0.057148, " examples", false], [51668, 0.033223, " example", false], [38440, 0.019762, " facts", false], [52127, 0.018977, " lessons", false], [63729, 0.01867, " observation", false]]], "qwen": [23722, 34, 0.002941312501206994, [[2097, 0.276674, " fact", false], [3255, 0.119615, " record", false], [3139, 0.067845, " experience", false], [5904, 0.037318, " evidence", false], [5383, 0.035484, " pattern", false], [8729, 0.034271, " reality", false], [21930, 0.024844, " observation", false], [2393, 0.017481, " success", false], [4401, 0.016759, " development", false], [323, 0.014835, " and", false]]]}, "raw_delta": -0.07818456796499396, "tuned_delta": -0.071372290157896}, {"byte_start": 5174, "byte_end": 5179, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 872, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"rwkv": "3.37% 3.37% 3.37% 3.37% 3.37%", "qwen": "3.07% 3.07% 3.07% 3.07% 3.07%"}, "model_tokens": {"rwkv": [[32227, " that", "normal", 0.3940374553203583]], "qwen": [[429, " that", "normal", 0.42726224660873413]]}, "loss": {"rwkv": 3.3672276833248262, "qwen": 3.067015627891962}, "topk": {"rwkv": [32227, 1, 0.3940374553203583, [[32227, 0.394037, " that", false], [4706, 0.15418, " of", false], [45, 0.045693, ",", false], [37599, 0.037398, " above", false], [47, 0.033078, ".", false], [59488, 0.030246, " described", false], [4596, 0.027885, " in", false], [37598, 0.026327, " about", false], [21265, 0.024616, " and", false], [31351, 0.021238, " made", false]]], "qwen": [429, 1, 0.42726224660873413, [[429, 0.427262, " that", false], [315, 0.291769, " of", false], [323, 0.027302, " and", false], [1865, 0.027231, " made", false], [11, 0.024236, ",", false], [3403, 0.020542, " above", false], [304, 0.019367, " in", false], [911, 0.018508, " about", false], [7481, 0.010782, " described", false], [68629, 0.008892, " summarized", false]]]}, "raw_delta": 0.016647291183471663, "tuned_delta": 0.02345956899056961}, {"byte_start": 5179, "byte_end": 5181, "display": {"text": " 1", "kind": "normal"}, "is_word": true, "word_id": 873, "word_key": " 1", "bytes_hex": "20 31", "compression": {"rwkv": "44.80% 44.80%", "qwen": "89.94% 5.89%"}, "model_tokens": {"rwkv": [[284, " 1", "normal", 0.007051203865557909]], "qwen": [[220, " ", "normal", 0.006822048686444759], [16, "1", "normal", 0.7212427258491516]]}, "loss": {"rwkv": 44.80244365260648, "qwen": 47.918891555156414}, "topk": {"rwkv": [284, 25, 0.007051203865557909, [[22590, 0.097747, " the", false], [59, 0.069376, ":", false], [4858, 0.062193, " we", false], [45, 0.061293, ",", false], [47202, 0.034502, " search", false], [63370, 0.032118, " computation", false], [275, 0.029055, " (", false], [38720, 0.027117, " human", false], [52195, 0.024746, " massive", false], [37045, 0.02277, " Moore", false]]], "qwen": [220, 31, 0.006822048686444759, [[279, 0.114873, " the", false], [11, 0.074743, ",", false], [582, 0.039058, " we", false], [3738, 0.037648, " human", false], [1052, 0.032026, " there", false], [11811, 0.025722, " researchers", false], [304, 0.022724, " in", false], [614, 0.018306, " have", false], [1429, 0.018006, " most", false], [1447, 0.01739, ":\n\n", false]]]}, "raw_delta": -0.1728125661611557, "tuned_delta": -0.16600028835405775}, {"byte_start": 5181, "byte_end": 5182, "display": {"text": ")", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "29", "compression": {"rwkv": "1.64%", "qwen": "2.71%"}, "model_tokens": {"rwkv": [[42, ")", "normal", 0.913972795009613]], "qwen": [[8, ")", "normal", 0.8606036901473999]]}, "loss": {"rwkv": 1.637825180696699, "qwen": 2.7072382949905966}, "topk": {"rwkv": [42, 1, 0.913972795009613, [[42, 0.913973, ")", false], [47, 0.059754, ".", false], [580, 0.008894, ".)", false], [45, 0.00387, ",", false], [48, 0.00342, "/", false], [46, 0.001914, "-", false], [59, 0.001023, ":", false], [499, 0.001004, ").", false], [276, 0.000467, " )", false], [497, 0.000347, "),", false]]], "qwen": [8, 1, 0.8606036901473999, [[8, 0.860604, ")", false], [13, 0.071884, ".", false], [24, 0.027879, "9", false], [15, 0.009732, "0", false], [6138, 0.005238, ".)", false], [11, 0.001529, ",", false], [25, 0.001528, ":", false], [279, 0.001499, " the", false], [14, 0.001431, "/", false], [12, 0.001183, "-", false]]]}, "raw_delta": -0.05930085480213165, "tuned_delta": -0.0524885769950337}, {"byte_start": 5182, "byte_end": 5185, "display": {"text": " AI", "kind": "normal"}, "is_word": true, "word_id": 874, "word_key": " ai", "bytes_hex": "20 41 49", "compression": {"rwkv": "28.93% 28.93% 28.93%", "qwen": "35.42% 35.42% 35.42%"}, "model_tokens": {"rwkv": [[3609, " AI", "normal", 0.00800922978669405]], "qwen": [[15235, " AI", "normal", 0.002759526250883937]]}, "loss": {"rwkv": 28.929041184492235, "qwen": 35.42234935740809}, "topk": {"rwkv": [3609, 22, 0.00800922978669405, [[52195, 0.118688, " massive", false], [22590, 0.112816, " the", false], [47202, 0.059643, " search", false], [63370, 0.049694, " computation", false], [38720, 0.038383, " human", false], [52224, 0.033285, " methods", false], [37045, 0.028708, " Moore", false], [39934, 0.025223, " there", false], [51832, 0.021682, " general", false], [4596, 0.019195, " in", false]]], "qwen": [15235, 51, 0.002759526250883937, [[279, 0.12742, " the", false], [3738, 0.091542, " human", false], [1052, 0.030641, " there", false], [1429, 0.029236, " most", false], [304, 0.026788, " in", false], [582, 0.026313, " we", false], [4586, 0.024561, " general", false], [5413, 0.022817, " methods", false], [432, 0.017832, " it", false], [979, 0.016287, " when", false]]]}, "raw_delta": -0.3600654602050781, "tuned_delta": -0.3532531823979802}, {"byte_start": 5185, "byte_end": 5197, "display": {"text": " researchers", "kind": "normal"}, "is_word": true, "word_id": 875, "word_key": " researchers", "bytes_hex": "20 72 65 73 65 61 72 63 68 65 72 73", "compression": {"rwkv": "2.65% 2.65% 2.65% 2.65% 2.65% 2.65% 2.65% 2.65% 2.65% 2.65% 2.65% 2.65%", "qwen": "1.30% 1.30% 1.30% 1.30% 1.30% 1.30% 1.30% 1.30% 1.30% 1.30% 1.30% 1.30%"}, "model_tokens": {"rwkv": [[63843, " researchers", "normal", 0.17306967079639435]], "qwen": [[11811, " researchers", "normal", 0.4211137890815735]]}, "loss": {"rwkv": 2.653394199551642, "qwen": 1.2997062142088494}, "topk": {"rwkv": [63843, 2, 0.17306967079639435, [[57103, 0.370212, " research", false], [63843, 0.17307, " researchers", false], [52224, 0.098356, " methods", false], [53087, 0.049574, " systems", false], [4600, 0.038188, " is", false], [56950, 0.022421, " progress", false], [21800, 0.022174, " has", false], [56949, 0.013912, " programs", false], [62633, 0.010901, " techniques", false], [22748, 0.007508, " was", false]]], "qwen": [11811, 1, 0.4211137890815735, [[11811, 0.421114, " researchers", false], [3412, 0.241596, " research", false], [702, 0.051568, " has", false], [374, 0.045421, " is", false], [5413, 0.030513, " methods", false], [572, 0.024486, " was", false], [5942, 0.016856, " systems", false], [594, 0.005651, "'s", false], [646, 0.004245, " can", false], [304, 0.004208, " in", false]]]}, "raw_delta": 0.0750644008318583, "tuned_delta": 0.08187667863895624}, {"byte_start": 5197, "byte_end": 5202, "display": {"text": " have", "kind": "normal"}, "is_word": true, "word_id": 876, "word_key": " have", "bytes_hex": "20 68 61 76 65", "compression": {"rwkv": "6.48% 6.48% 6.48% 6.48% 6.48%", "qwen": "6.84% 6.84% 6.84% 6.84% 6.84%"}, "model_tokens": {"rwkv": [[31059, " have", "normal", 0.1640906035900116]], "qwen": [[614, " have", "normal", 0.15027377009391785]]}, "loss": {"rwkv": 6.48085662899339, "qwen": 6.835836989550142}, "topk": {"rwkv": [31059, 1, 0.1640906035900116, [[31059, 0.164091, " have", false], [40, 0.144779, "'", false], [21286, 0.100172, " are", false], [32216, 0.049074, " tend", false], [45, 0.031709, ",", false], [22762, 0.027623, " who", false], [4491, 0.024867, " do", false], [39171, 0.017945, " often", false], [45150, 0.015386, " always", false], [4596, 0.014548, " in", false]]], "qwen": [614, 1, 0.15027377009391785, [[614, 0.150274, " have", false], [525, 0.076383, " are", false], [6, 0.065294, "'", false], [8376, 0.048428, " tend", false], [879, 0.039182, " who", false], [1033, 0.037454, " were", false], [2677, 0.02672, " always", false], [653, 0.024378, " do", false], [11, 0.023063, ",", false], [3545, 0.021426, " often", false]]]}, "raw_delta": -0.01968429088592527, "tuned_delta": -0.012872013078827325}, {"byte_start": 5202, "byte_end": 5208, "display": {"text": " often", "kind": "normal"}, "is_word": true, "word_id": 877, "word_key": " often", "bytes_hex": "20 6f 66 74 65 6e", "compression": {"rwkv": "12.02% 12.02% 12.02% 12.02% 12.02% 12.02%", "qwen": "10.20% 10.20% 10.20% 10.20% 10.20% 10.20%"}, "model_tokens": {"rwkv": [[39171, " often", "normal", 0.018070193007588387]], "qwen": [[3545, " often", "normal", 0.033567722886800766]]}, "loss": {"rwkv": 12.022458674074693, "qwen": 10.201628187783637}, "topk": {"rwkv": [39171, 8, 0.018070193007588387, [[30259, 0.169202, " been", false], [22187, 0.083332, " not", false], [332, 0.071883, " a", false], [45150, 0.059261, " always", false], [21795, 0.026805, " had", false], [47518, 0.026504, " tended", false], [31351, 0.018812, " made", false], [39171, 0.01807, " often", false], [56495, 0.017312, " invested", false], [39762, 0.016161, " spent", false]]], "qwen": [3545, 6, 0.033567722886800766, [[1012, 0.116053, " been", false], [2677, 0.102586, " always", false], [537, 0.060681, " not", false], [48790, 0.050558, " tended", false], [264, 0.035441, " a", false], [3545, 0.033568, " often", false], [1865, 0.03193, " made", false], [8789, 0.03124, " generally", false], [6679, 0.025189, " tried", false], [7391, 0.021125, " spent", false]]]}, "raw_delta": 0.10096828142801917, "tuned_delta": 0.10778055923511712}, {"byte_start": 5208, "byte_end": 5214, "display": {"text": " tried", "kind": "normal"}, "is_word": true, "word_id": 878, "word_key": " tried", "bytes_hex": "20 74 72 69 65 64", "compression": {"rwkv": "9.02% 9.02% 9.02% 9.02% 9.02% 9.02%", "qwen": "7.22% 7.22% 7.22% 7.22% 7.22% 7.22%"}, "model_tokens": {"rwkv": [[40013, " tried", "normal", 0.05015047639608383]], "qwen": [[6679, " tried", "normal", 0.09043993800878525]]}, "loss": {"rwkv": 9.01684400555602, "qwen": 7.2227009271126}, "topk": {"rwkv": [40013, 3, 0.05015047639608383, [[30259, 0.209247, " been", false], [31351, 0.056803, " made", false], [40013, 0.05015, " tried", false], [21795, 0.040118, " had", false], [22187, 0.033109, " not", false], [45953, 0.026621, " failed", false], [53137, 0.025243, " thought", false], [37924, 0.023376, " built", false], [56651, 0.02031, " mistaken", false], [56495, 0.019745, " invested", false]]], "qwen": [6679, 2, 0.09043993800878525, [[1012, 0.204918, " been", false], [6679, 0.09044, " tried", false], [1865, 0.062135, " made", false], [7391, 0.025583, " spent", false], [11585, 0.020182, " believed", false], [1030, 0.019235, " had", false], [3381, 0.019098, " thought", false], [4641, 0.018346, " failed", false], [45431, 0.016739, " pursued", false], [10735, 0.016659, " focused", false]]]}, "raw_delta": 0.09948841730753583, "tuned_delta": 0.10630069511463378}, {"byte_start": 5214, "byte_end": 5217, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 879, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "1.81% 1.81% 1.81%", "qwen": "0.87% 0.87% 0.87%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.7415645718574524]], "qwen": [[311, " to", "normal", 0.8649898171424866]]}, "loss": {"rwkv": 1.8080650740307647, "qwen": 0.8718540455931668}, "topk": {"rwkv": [4811, 1, 0.7415645718574524, [[4811, 0.741565, " to", false], [52224, 0.096034, " methods", false], [39931, 0.015755, " their", false], [45, 0.011854, ",", false], [22590, 0.009759, " the", false], [61590, 0.006733, " approaches", false], [38720, 0.005505, " human", false], [21700, 0.005152, " for", false], [32448, 0.004081, " ways", false], [332, 0.003675, " a", false]]], "qwen": [311, 1, 0.8649898171424866, [[311, 0.86499, " to", false], [5413, 0.01351, " methods", false], [11, 0.010121, ",", false], [3738, 0.007356, " human", false], [323, 0.006901, " and", false], [304, 0.004482, " in", false], [2588, 0.004469, " hard", false], [279, 0.004439, " the", false], [2238, 0.004154, " too", false], [1602, 0.004112, " very", false]]]}, "raw_delta": 0.05191456278165182, "tuned_delta": 0.05872684058874977}, {"byte_start": 5217, "byte_end": 5223, "display": {"text": " build", "kind": "normal"}, "is_word": true, "word_id": 880, "word_key": " build", "bytes_hex": "20 62 75 69 6c 64", "compression": {"rwkv": "6.15% 6.15% 6.15% 6.15% 6.15% 6.15%", "qwen": "4.01% 4.01% 4.01% 4.01% 4.01% 4.01%"}, "model_tokens": {"rwkv": [[37923, " build", "normal", 0.1273563802242279]], "qwen": [[1936, " build", "normal", 0.2630777955055237]]}, "loss": {"rwkv": 6.15211752462416, "qwen": 4.013413654526509}, "topk": {"rwkv": [37923, 1, 0.1273563802242279, [[37923, 0.127356, " build", false], [31358, 0.069989, " make", false], [22339, 0.066593, " put", false], [56540, 0.051722, " leverage", false], [22681, 0.049166, " use", false], [32187, 0.04533, " take", false], [39740, 0.028145, " solve", false], [4491, 0.027308, " do", false], [51982, 0.02559, " improve", false], [37730, 0.024906, " apply", false]]], "qwen": [1936, 1, 0.2630777955055237, [[1936, 0.263078, " build", false], [1281, 0.147193, " make", false], [32064, 0.035578, " leverage", false], [2182, 0.035405, " put", false], [990, 0.032568, " use", false], [65485, 0.025452, " emulate", false], [11625, 0.02464, " solve", false], [653, 0.023266, " do", false], [55359, 0.016776, " mimic", false], [3796, 0.016032, " apply", false]]]}, "raw_delta": 0.11859492460886635, "tuned_delta": 0.1254072024159643}, {"byte_start": 5223, "byte_end": 5233, "display": {"text": " knowledge", "kind": "normal"}, "is_word": true, "word_id": 881, "word_key": " knowledge", "bytes_hex": "20 6b 6e 6f 77 6c 65 64 67 65", "compression": {"rwkv": "8.90% 8.90% 8.90% 8.90% 8.90% 8.90% 8.90% 8.90% 8.90% 8.90%", "qwen": "11.44% 11.44% 11.44% 11.44% 11.44% 11.44% 11.44% 11.44% 11.44% 11.44%"}, "model_tokens": {"rwkv": [[59943, " knowledge", "normal", 0.007153502199798822]], "qwen": [[6540, " knowledge", "normal", 0.001757561694830656]]}, "loss": {"rwkv": 8.904133455486571, "qwen": 11.440260997909652}, "topk": {"rwkv": [59943, 14, 0.007153502199798822, [[53087, 0.157943, " systems", false], [4596, 0.151179, " in", false], [3609, 0.147982, " AI", false], [52224, 0.139567, " methods", false], [39931, 0.110343, " their", false], [64452, 0.023314, " intelligence", false], [332, 0.022846, " a", false], [63659, 0.01873, " intelligent", false], [22590, 0.018227, " the", false], [51832, 0.012364, " general", false]]], "qwen": [6540, 38, 0.001757561694830656, [[5942, 0.383208, " systems", false], [304, 0.147803, " in", false], [5413, 0.048333, " methods", false], [15235, 0.036416, " AI", false], [264, 0.036301, " a", false], [12645, 0.028511, " machines", false], [4119, 0.023244, " models", false], [862, 0.022203, " their", false], [24514, 0.020137, " intelligent", false], [279, 0.015744, " the", false]]]}, "raw_delta": -0.1406327724456787, "tuned_delta": -0.13382049463858076}, {"byte_start": 5233, "byte_end": 5238, "display": {"text": " into", "kind": "normal"}, "is_word": true, "word_id": 882, "word_key": " into", "bytes_hex": "20 69 6e 74 6f", "compression": {"rwkv": "3.42% 3.42% 3.42% 3.42% 3.42%", "qwen": "2.58% 2.58% 2.58% 2.58% 2.58%"}, "model_tokens": {"rwkv": [[31162, " into", "normal", 0.38057181239128113]], "qwen": [[1119, " into", "normal", 0.4887540638446808]]}, "loss": {"rwkv": 3.4235829583595514, "qwen": 2.5820486300299623}, "topk": {"rwkv": [31162, 1, 0.38057181239128113, [[31162, 0.380572, " into", false], [46, 0.342631, "-", false], [4706, 0.044114, " of", false], [53087, 0.035356, " systems", false], [21265, 0.028804, " and", false], [4596, 0.027112, " in", false], [37598, 0.018635, " about", false], [56003, 0.01545, " directly", false], [45, 0.010937, ",", false], [4715, 0.010237, " or", false]]], "qwen": [1119, 1, 0.4887540638446808, [[1119, 0.488754, " into", false], [5980, 0.177835, "-based", false], [5961, 0.056711, " directly", false], [304, 0.044363, " in", false], [23092, 0.020867, " bases", false], [12, 0.017732, "-", false], [11, 0.013609, ",", false], [13042, 0.011556, " representation", false], [43613, 0.011007, " representations", false], [323, 0.010619, " and", false]]]}, "raw_delta": 0.046664571762084966, "tuned_delta": 0.053476849569182916}, {"byte_start": 5238, "byte_end": 5244, "display": {"text": " their", "kind": "normal"}, "is_word": true, "word_id": 883, "word_key": " their", "bytes_hex": "20 74 68 65 69 72", "compression": {"rwkv": "1.80% 1.80% 1.80% 1.80% 1.80% 1.80%", "qwen": "2.35% 2.35% 2.35% 2.35% 2.35% 2.35%"}, "model_tokens": {"rwkv": [[39931, " their", "normal", 0.5497502088546753]], "qwen": [[862, " their", "normal", 0.45808759331703186]]}, "loss": {"rwkv": 1.7963243917318634, "qwen": 2.3464680489182497}, "topk": {"rwkv": [39931, 1, 0.5497502088546753, [[39931, 0.54975, " their", false], [3609, 0.143627, " AI", false], [53087, 0.076798, " systems", false], [22590, 0.065444, " the", false], [52224, 0.063206, " methods", false], [56949, 0.009916, " programs", false], [332, 0.008628, " a", false], [56567, 0.006798, " machines", false], [61559, 0.005423, " algorithms", false], [4419, 0.004179, " an", false]]], "qwen": [862, 1, 0.45808759331703186, [[862, 0.458088, " their", false], [5942, 0.145753, " systems", false], [15235, 0.106452, " AI", false], [279, 0.098164, " the", false], [5413, 0.032825, " methods", false], [264, 0.022574, " a", false], [12645, 0.013158, " machines", false], [25185, 0.011579, " algorithms", false], [458, 0.009804, " an", false], [13009, 0.009332, " agents", false]]]}, "raw_delta": -0.030506441990534455, "tuned_delta": -0.02369416418343651}, {"byte_start": 5244, "byte_end": 5251, "display": {"text": " agents", "kind": "normal"}, "is_word": true, "word_id": 884, "word_key": " agents", "bytes_hex": "20 61 67 65 6e 74 73", "compression": {"rwkv": "13.12% 13.12% 13.12% 13.12% 13.12% 13.12% 13.12%", "qwen": "9.16% 9.16% 9.16% 9.16% 9.16% 9.16% 9.16%"}, "model_tokens": {"rwkv": [[45124, " agents", "normal", 0.006238637957721949]], "qwen": [[13009, " agents", "normal", 0.02860068529844284]]}, "loss": {"rwkv": 13.122728329514564, "qwen": 9.156797344590643}, "topk": {"rwkv": [45124, 11, 0.006238637957721949, [[53087, 0.37968, " systems", false], [52224, 0.317781, " methods", false], [3609, 0.082391, " AI", false], [56949, 0.049003, " programs", false], [61590, 0.022027, " approaches", false], [61559, 0.021825, " algorithms", false], [57103, 0.015872, " research", false], [46587, 0.015506, " models", false], [32499, 0.012279, " work", false], [56567, 0.006976, " machines", false]]], "qwen": [13009, 5, 0.02860068529844284, [[5942, 0.584944, " systems", false], [5413, 0.162817, " methods", false], [15235, 0.040642, " AI", false], [25185, 0.035244, " algorithms", false], [13009, 0.028601, " agents", false], [7468, 0.026119, " programs", false], [4119, 0.013486, " models", false], [12645, 0.012212, " machines", false], [19827, 0.011931, " approaches", false], [1849, 0.00816, " system", false]]]}, "raw_delta": 0.21991791043962744, "tuned_delta": 0.2267301882467254}, {"byte_start": 5251, "byte_end": 5252, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "13.60%", "qwen": "16.14%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.47047632932662964]], "qwen": [[11, ",", "normal", 0.4085323214530945]]}, "loss": {"rwkv": 13.595710102127438, "qwen": 16.1434739907079}, "topk": {"rwkv": [45, 1, 0.47047632932662964, [[45, 0.470476, ",", false], [21265, 0.135232, " and", false], [4596, 0.051803, " in", false], [60, 0.04622, ";", false], [4811, 0.045629, " to", false], [275, 0.039404, " (", false], [5346, 0.015125, "---", false], [45285, 0.01472, " before", false], [32227, 0.014542, " that", false], [21400, 0.014385, " but", false]]], "qwen": [11, 1, 0.4085323214530945, [[11, 0.408532, ",", false], [323, 0.095241, " and", false], [304, 0.061851, " in", false], [26, 0.057017, ";", false], [320, 0.038999, " (", false], [438, 0.028618, " as", false], [429, 0.028383, " that", false], [2041, 0.024179, " without", false], [553, 0.023365, " by", false], [4421, 0.022919, "---", false]]]}, "raw_delta": -0.14127802848815918, "tuned_delta": -0.13446575068106123}, {"byte_start": 5252, "byte_end": 5254, "display": {"text": " 2", "kind": "normal"}, "is_word": true, "word_id": 885, "word_key": " 2", "bytes_hex": "20 32", "compression": {"rwkv": "19.44% 19.44%", "qwen": "37.18% 0.11%"}, "model_tokens": {"rwkv": [[285, " 2", "normal", 0.11578607559204102]], "qwen": [[220, " ", "normal", 0.1272447109222412], [17, "2", "normal", 0.994102418422699]]}, "loss": {"rwkv": 19.44256988698017, "qwen": 18.642849443588588}, "topk": {"rwkv": [285, 2, 0.11578607559204102, [[21265, 0.456648, " and", false], [285, 0.115786, " 2", false], [21400, 0.05376, " but", false], [4596, 0.034355, " in", false], [30788, 0.024812, " even", false], [4423, 0.021732, " as", false], [4715, 0.020775, " or", false], [40186, 0.017952, " which", false], [4811, 0.014695, " to", false], [47001, 0.014022, " rather", false]]], "qwen": [220, 2, 0.1272447109222412, [[323, 0.393957, " and", false], [220, 0.127245, " ", false], [714, 0.073304, " but", false], [4751, 0.029262, " rather", false], [304, 0.024752, " in", false], [438, 0.022122, " as", false], [448, 0.020125, " with", false], [2987, 0.01689, " either", false], [1496, 0.014024, " even", false], [892, 0.012988, " which", false]]]}, "raw_delta": 0.04434591764584184, "tuned_delta": 0.051158195452939786}, {"byte_start": 5254, "byte_end": 5255, "display": {"text": ")", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "29", "compression": {"rwkv": "0.02%", "qwen": "0.02%"}, "model_tokens": {"rwkv": [[42, ")", "normal", 0.9988056421279907]], "qwen": [[8, ")", "normal", 0.9990455508232117]]}, "loss": {"rwkv": 0.02160102094836876, "qwen": 0.017220137660109158}, "topk": {"rwkv": [42, 1, 0.9988056421279907, [[42, 0.998806, ")", false], [497, 0.000576, "),", false], [276, 9.5e-05, " )", false], [98, 9.3e-05, "a", false], [499, 7.1e-05, ").", false], [580, 6.4e-05, ".)", false], [47, 5.5e-05, ".", false], [48, 2.2e-05, "/", false], [45, 2.2e-05, ",", false], [46, 1.7e-05, "-", false]]], "qwen": [8, 1, 0.9990455508232117, [[8, 0.999046, ")", false], [701, 0.00022, "),", false], [64, 0.000148, "a", false], [873, 0.000108, " )", false], [13, 4.8e-05, ".", false], [6138, 3.7e-05, ".)", false], [11, 3.5e-05, ",", false], [15, 3.4e-05, "0", false], [323, 2.6e-05, " and", false], [429, 1.9e-05, " that", false]]]}, "raw_delta": 0.00024292775196954608, "tuned_delta": 0.007055205559067493}, {"byte_start": 5255, "byte_end": 5260, "display": {"text": " this", "kind": "normal"}, "is_word": true, "word_id": 886, "word_key": " this", "bytes_hex": "20 74 68 69 73", "compression": {"rwkv": "8.62% 8.62% 8.62% 8.62% 8.62%", "qwen": "9.24% 9.24% 9.24% 9.24% 9.24%"}, "model_tokens": {"rwkv": [[32234, " this", "normal", 0.09067230671644211]], "qwen": [[419, " this", "normal", 0.07725539803504944]]}, "loss": {"rwkv": 8.622357080312945, "qwen": 9.235550903005239}, "topk": {"rwkv": [32234, 3, 0.09067230671644211, [[32227, 0.19087, " that", false], [22590, 0.101166, " the", false], [32234, 0.090672, " this", false], [39936, 0.046081, " these", false], [32465, 0.037144, " when", false], [32232, 0.033835, " they", false], [59943, 0.028419, " knowledge", false], [32139, 0.028218, " such", false], [4596, 0.026618, " in", false], [21265, 0.019788, " and", false]]], "qwen": [419, 3, 0.07725539803504944, [[279, 0.106956, " the", false], [807, 0.088234, " they", false], [419, 0.077255, " this", false], [429, 0.070534, " that", false], [6540, 0.044582, " knowledge", false], [1493, 0.042293, " these", false], [1846, 0.035526, " those", false], [304, 0.034022, " in", false], [862, 0.026684, " their", false], [15235, 0.026366, " AI", false]]]}, "raw_delta": -0.03400268554687502, "tuned_delta": -0.027190407739777076}, {"byte_start": 5260, "byte_end": 5267, "display": {"text": " always", "kind": "normal"}, "is_word": true, "word_id": 887, "word_key": " always", "bytes_hex": "20 61 6c 77 61 79 73", "compression": {"rwkv": "11.92% 11.92% 11.92% 11.92% 11.92% 11.92% 11.92%", "qwen": "16.09% 16.09% 16.09% 16.09% 16.09% 16.09% 16.09%"}, "model_tokens": {"rwkv": [[45150, " always", "normal", 0.009881863370537758]], "qwen": [[2677, " always", "normal", 0.0019399260636419058]]}, "loss": {"rwkv": 11.91511529305617, "qwen": 16.088897139127845}, "topk": {"rwkv": [45150, 12, 0.009881863370537758, [[59943, 0.27828, " knowledge", false], [21800, 0.142419, " has", false], [4600, 0.085502, " is", false], [55532, 0.050803, " approach", false], [45829, 0.040372, " effort", false], [39171, 0.035588, " often", false], [30659, 0.027305, " does", false], [22748, 0.024309, " was", false], [38964, 0.017924, " makes", false], [38720, 0.015685, " human", false]]], "qwen": [2677, 40, 0.0019399260636419058, [[702, 0.303916, " has", false], [6540, 0.21361, " knowledge", false], [374, 0.076746, " is", false], [5486, 0.04863, " approach", false], [3545, 0.043218, " often", false], [572, 0.026249, " was", false], [5041, 0.01478, " effort", false], [3093, 0.013744, " kind", false], [1558, 0.012532, " does", false], [27236, 0.009465, " tends", false]]]}, "raw_delta": -0.2314436095101493, "tuned_delta": -0.22463133170305136}, {"byte_start": 5267, "byte_end": 5273, "display": {"text": " helps", "kind": "normal"}, "is_word": true, "word_id": 888, "word_key": " helps", "bytes_hex": "20 68 65 6c 70 73", "compression": {"rwkv": "21.51% 21.51% 21.51% 21.51% 21.51% 21.51%", "qwen": "17.04% 17.04% 17.04% 17.04% 17.04% 17.04%"}, "model_tokens": {"rwkv": [[38686, " helps", "normal", 0.0007882298668846488]], "qwen": [[8609, " helps", "normal", 0.0034472723491489887]]}, "loss": {"rwkv": 21.508929971586756, "qwen": 17.04235134776367}, "topk": {"rwkv": [38686, 110, 0.0007882298668846488, [[38442, 0.067399, " fails", false], [21800, 0.062707, " has", false], [38964, 0.061933, " makes", false], [40040, 0.055154, " turns", false], [38875, 0.051412, " leads", false], [46936, 0.042019, " proved", false], [39888, 0.037922, " takes", false], [40212, 0.033227, " works", false], [46938, 0.030616, " proves", false], [39620, 0.030028, " seems", false]]], "qwen": [8609, 48, 0.0034472723491489887, [[11508, 0.082167, " leads", false], [702, 0.055408, " has", false], [4977, 0.051891, " seems", false], [14525, 0.044846, " fails", false], [4041, 0.041755, " comes", false], [6069, 0.035197, " led", false], [18651, 0.033772, " proved", false], [3643, 0.030163, " makes", false], [4641, 0.028432, " failed", false], [10335, 0.025981, " ends", false]]]}, "raw_delta": 0.2476797103881835, "tuned_delta": 0.25449198819528146}, {"byte_start": 5273, "byte_end": 5276, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 889, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "8.74% 8.74% 8.74%", "qwen": "6.63% 6.63% 6.63%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.23434625566005707]], "qwen": [[304, " in", "normal", 0.3321073055267334]]}, "loss": {"rwkv": 8.735067630382394, "qwen": 6.626161187735484}, "topk": {"rwkv": [4596, 1, 0.23434625566005707, [[4596, 0.234346, " in", false], [32229, 0.105781, " them", false], [45, 0.062981, ",", false], [31581, 0.061227, " only", false], [332, 0.05218, " a", false], [22590, 0.048793, " the", false], [4811, 0.047887, " to", false], [4424, 0.03934, " at", false], [21700, 0.03531, " for", false], [31277, 0.022473, " less", false]]], "qwen": [304, 1, 0.3321073055267334, [[304, 0.332107, " in", false], [279, 0.083113, " the", false], [1105, 0.073144, " them", false], [264, 0.042835, " a", false], [11, 0.033876, ",", false], [311, 0.032151, " to", false], [979, 0.02858, " when", false], [369, 0.026255, " for", false], [15102, 0.02395, " initially", false], [4124, 0.019933, " early", false]]]}, "raw_delta": 0.11694260438283283, "tuned_delta": 0.12375488218993078}, {"byte_start": 5276, "byte_end": 5280, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 890, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "1.34% 1.34% 1.34% 1.34%", "qwen": "0.72% 0.72% 0.72% 0.72%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.7426591515541077]], "qwen": [[279, " the", "normal", 0.8523589968681335]]}, "loss": {"rwkv": 1.3384377820747217, "qwen": 0.7202089926085409}, "topk": {"rwkv": [22590, 1, 0.7426591515541077, [[22590, 0.742659, " the", false], [32074, 0.080681, " some", false], [39675, 0.026962, " short", false], [332, 0.01274, " a", false], [46639, 0.005923, " narrow", false], [52964, 0.004641, " special", false], [39720, 0.003984, " small", false], [63875, 0.003756, " specialized", false], [57453, 0.003281, " training", false], [22226, 0.002974, " one", false]]], "qwen": [279, 1, 0.8523589968681335, [[279, 0.852359, " the", false], [2805, 0.01926, " short", false], [1045, 0.019121, " some", false], [264, 0.010473, " a", false], [6588, 0.00565, " practice", false], [4862, 0.004612, " training", false], [2613, 0.004378, " small", false], [3793, 0.004265, " terms", false], [3259, 0.003964, " making", false], [862, 0.002562, " their", false]]]}, "raw_delta": 0.034281883388757706, "tuned_delta": 0.041094161195855655}, {"byte_start": 5280, "byte_end": 5286, "display": {"text": " short", "kind": "normal"}, "is_word": true, "word_id": 891, "word_key": " short", "bytes_hex": "20 73 68 6f 72 74", "compression": {"rwkv": "0.27% 0.27% 0.27% 0.27% 0.27% 0.27%", "qwen": "0.38% 0.38% 0.38% 0.38% 0.38% 0.38%"}, "model_tokens": {"rwkv": [[39675, " short", "normal", 0.912328839302063]], "qwen": [[2805, " short", "normal", 0.8821887969970703]]}, "loss": {"rwkv": 0.2744384487368125, "qwen": 0.37675137560658395}, "topk": {"rwkv": [39675, 1, 0.912328839302063, [[39675, 0.912329, " short", false], [59220, 0.013476, " beginning", false], [52888, 0.012062, " shorter", false], [38328, 0.009595, " early", false], [31323, 0.006449, " long", false], [38499, 0.004911, " first", false], [32386, 0.004718, " very", false], [52013, 0.004134, " initial", false], [31503, 0.004063, " near", false], [59816, 0.003531, " immediate", false]]], "qwen": [2805, 1, 0.8821887969970703, [[2805, 0.882189, " short", false], [4124, 0.03014, " early", false], [23327, 0.010896, " shorter", false], [13922, 0.009542, " immediate", false], [1602, 0.009541, " very", false], [2856, 0.007255, " initial", false], [7167, 0.005843, " beginning", false], [3143, 0.005533, " near", false], [1293, 0.003011, " long", false], [11051, 0.002668, " medium", false]]]}, "raw_delta": -0.005673433343569436, "tuned_delta": 0.0011388444635285107}, {"byte_start": 5286, "byte_end": 5291, "display": {"text": " term", "kind": "normal"}, "is_word": true, "word_id": 892, "word_key": " term", "bytes_hex": "20 74 65 72 6d", "compression": {"rwkv": "3.40% 3.40% 3.40% 3.40% 3.40%", "qwen": "2.27% 2.27% 2.27% 2.27% 2.27%"}, "model_tokens": {"rwkv": [[32219, " term", "normal", 0.39172711968421936]], "qwen": [[4647, " term", "normal", 0.5326520204544067]]}, "loss": {"rwkv": 3.395405320842189, "qwen": 2.2718368583409934}, "topk": {"rwkv": [32219, 2, 0.39172711968421936, [[22418, 0.580629, " run", false], [32219, 0.391727, " term", false], [46, 0.023013, "-", false], [4811, 0.000617, " to", false], [4715, 0.000537, " or", false], [21265, 0.000442, " and", false], [8661, 0.000379, "run", false], [32251, 0.000254, " time", false], [45, 0.000192, ",", false], [27132, 0.000185, "term", false]]], "qwen": [4647, 1, 0.5326520204544067, [[4647, 0.532652, " term", false], [1598, 0.433524, " run", false], [9663, 0.017027, "-term", false], [22973, 0.007456, "-run", false], [311, 0.001493, " to", false], [882, 0.001204, " time", false], [323, 0.001141, " and", false], [11, 0.000983, ",", false], [12, 0.000648, "-", false], [4686, 0.000535, "-to", false]]]}, "raw_delta": 0.06230386495590212, "tuned_delta": 0.06911614276300007}, {"byte_start": 5291, "byte_end": 5292, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "4.68%", "qwen": "7.41%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.7691308856010437]], "qwen": [[11, ",", "normal", 0.6631759405136108]]}, "loss": {"rwkv": 4.684532237261526, "qwen": 7.406705344419314}, "topk": {"rwkv": [45, 1, 0.7691308856010437, [[45, 0.769131, ",", false], [21400, 0.110205, " but", false], [275, 0.034443, " (", false], [21265, 0.033418, " and", false], [32465, 0.007516, " when", false], [4596, 0.003974, " in", false], [5346, 0.00372, "---", false], [4450, 0.003258, " by", false], [51018, 0.002564, " because", false], [31581, 0.002513, " only", false]]], "qwen": [11, 1, 0.6631759405136108, [[11, 0.663176, ",", false], [714, 0.176976, " but", false], [320, 0.032339, " (", false], [323, 0.030976, " and", false], [220, 0.013957, " ", false], [979, 0.011009, " when", false], [553, 0.010002, " by", false], [4421, 0.009404, "---", false], [1576, 0.007255, " because", false], [304, 0.005778, " in", false]]]}, "raw_delta": -0.15094932913780212, "tuned_delta": -0.14413705133070417}, {"byte_start": 5292, "byte_end": 5296, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 893, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"rwkv": "6.13% 6.13% 6.13% 6.13%", "qwen": "6.55% 6.55% 6.55% 6.55%"}, "model_tokens": {"rwkv": [[21265, " and", "normal", 0.25717324018478394]], "qwen": [[323, " and", "normal", 0.23368458449840546]]}, "loss": {"rwkv": 6.128636160026358, "qwen": 6.55426742351418}, "topk": {"rwkv": [21265, 3, 0.25717324018478394, [[21400, 0.376293, " but", false], [286, 0.268081, " 3", false], [21265, 0.257173, " and", false], [30788, 0.007704, " even", false], [40076, 0.005742, " until", false], [4423, 0.005682, " as", false], [32465, 0.005666, " when", false], [51018, 0.004894, " because", false], [4596, 0.004368, " in", false], [39171, 0.003828, " often", false]]], "qwen": [323, 3, 0.23368458449840546, [[714, 0.386545, " but", false], [220, 0.264845, " ", false], [323, 0.233685, " and", false], [1496, 0.014745, " even", false], [979, 0.008836, " when", false], [1576, 0.006399, " because", false], [438, 0.006186, " as", false], [518, 0.004264, " at", false], [3602, 0.00402, " yet", false], [5310, 0.003229, " especially", false]]]}, "raw_delta": -0.023602008819580078, "tuned_delta": -0.016789731012482132}, {"byte_start": 5296, "byte_end": 5299, "display": {"text": " is", "kind": "normal"}, "is_word": true, "word_id": 894, "word_key": " is", "bytes_hex": "20 69 73", "compression": {"rwkv": "34.19% 34.19% 34.19%", "qwen": "36.50% 36.50% 36.50%"}, "model_tokens": {"rwkv": [[4600, " is", "normal", 0.0033270451240241528]], "qwen": [[374, " is", "normal", 0.0023053758777678013]]}, "loss": {"rwkv": 34.18886685439991, "qwen": 36.50326031808084}, "topk": {"rwkv": [4600, 8, 0.0033270451240241528, [[286, 0.902242, " 3", false], [45, 0.010524, ",", false], [39171, 0.008376, " often", false], [31581, 0.00591, " only", false], [60523, 0.005862, " sometimes", false], [32227, 0.005227, " that", false], [4596, 0.004323, " in", false], [4600, 0.003327, " is", false], [32230, 0.003036, " then", false], [61959, 0.00269, " eventually", false]]], "qwen": [374, 10, 0.0023053758777678013, [[220, 0.928814, " ", false], [1172, 0.006544, " only", false], [1221, 0.005395, " then", false], [304, 0.005333, " in", false], [11, 0.003971, ",", false], [7025, 0.002931, " sometimes", false], [429, 0.002917, " that", false], [279, 0.002799, " the", false], [3545, 0.002413, " often", false], [374, 0.002305, " is", false]]]}, "raw_delta": -0.1283372243245442, "tuned_delta": -0.12152494651744625}, {"byte_start": 5299, "byte_end": 5310, "display": {"text": " personally", "kind": "normal"}, "is_word": true, "word_id": 895, "word_key": " personally", "bytes_hex": "20 70 65 72 73 6f 6e 61 6c 6c 79", "compression": {"rwkv": "13.32% 13.32% 13.32% 13.32% 13.32% 13.32% 13.32% 13.32% 13.32% 13.32% 13.32%", "qwen": "17.72% 17.72% 17.72% 17.72% 17.72% 17.72% 17.72% 17.72% 17.72% 17.72% 17.72%"}, "model_tokens": {"rwkv": [[62309, " personally", "normal", 0.00029775072471238673]], "qwen": [[15726, " personally", "normal", 2.0252231479389593e-05]]}, "loss": {"rwkv": 13.32033773548048, "qwen": 17.717680834502143}, "topk": {"rwkv": [62309, 247, 0.00029775072471238673, [[39171, 0.142186, " often", false], [332, 0.057683, " a", false], [60645, 0.045776, " therefore", false], [22187, 0.044113, " not", false], [60523, 0.027202, " sometimes", false], [45150, 0.027057, " always", false], [32386, 0.024779, " very", false], [53248, 0.022133, " usually", false], [32239, 0.022106, " thus", false], [57403, 0.020271, " tempting", false]]], "qwen": [15726, 1258, 2.0252231479389593e-05, [[3545, 0.115149, " often", false], [264, 0.065454, " a", false], [279, 0.055977, " the", false], [6966, 0.035276, " looked", false], [2677, 0.031695, " always", false], [7025, 0.025693, " sometimes", false], [8916, 0.023796, " therefore", false], [537, 0.022601, " not", false], [3884, 0.020386, " seen", false], [5310, 0.019291, " especially", false]]]}, "raw_delta": -0.24384047768332734, "tuned_delta": -0.2370281998762294}, {"byte_start": 5310, "byte_end": 5321, "display": {"text": " satisfying", "kind": "normal"}, "is_word": true, "word_id": 896, "word_key": " satisfying", "bytes_hex": "20 73 61 74 69 73 66 79 69 6e 67", "compression": {"rwkv": "1.22% 1.22% 1.22% 1.22% 1.22% 1.22% 1.22% 1.22% 1.22% 1.22% 1.22%", "qwen": "0.86% 0.86% 0.86% 0.86% 0.86% 0.86% 0.86% 0.86% 0.86% 0.86% 0.86%"}, "model_tokens": {"rwkv": [[62527, " satisfying", "normal", 0.479510635137558]], "qwen": [[36054, " satisfying", "normal", 0.5923541188240051]]}, "loss": {"rwkv": 1.2167616200679292, "qwen": 0.858486580051204}, "topk": {"rwkv": [62527, 1, 0.479510635137558, [[62527, 0.479511, " satisfying", false], [60428, 0.118831, " rewarding", false], [31004, 0.106235, " grat", false], [59154, 0.076181, " appealing", false], [61694, 0.026415, " comforting", false], [32386, 0.024649, " very", false], [56874, 0.021334, " pleasing", false], [21265, 0.021032, " and", false], [61617, 0.016064, " attractive", false], [62029, 0.007025, " fulfilling", false]]], "qwen": [36054, 1, 0.5923541188240051, [[36054, 0.592354, " satisfying", false], [40993, 0.13555, " rewarding", false], [8728, 0.07889, " grat", false], [49598, 0.032174, " fulfilling", false], [1602, 0.013924, " very", false], [32252, 0.01271, " appealing", false], [68030, 0.008722, " comforting", false], [88589, 0.008718, " motivating", false], [18879, 0.007923, " attractive", false], [5390, 0.007654, " useful", false]]]}, "raw_delta": 0.01986698670820757, "tuned_delta": 0.026679264515305515}, {"byte_start": 5321, "byte_end": 5324, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 897, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "8.31% 8.31% 8.31%", "qwen": "10.03% 10.03% 10.03%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.26158419251441956]], "qwen": [[311, " to", "normal", 0.18857607245445251]]}, "loss": {"rwkv": 8.312403067621956, "qwen": 10.02825677701511}, "topk": {"rwkv": [4811, 2, 0.26158419251441956, [[45, 0.556778, ",", false], [4811, 0.261584, " to", false], [21700, 0.062158, " for", false], [21265, 0.03139, " and", false], [4596, 0.02166, " in", false], [275, 0.011182, " (", false], [4423, 0.009985, " as", false], [51018, 0.007227, " because", false], [47, 0.005069, ".", false], [21400, 0.004858, " but", false]]], "qwen": [311, 2, 0.18857607245445251, [[11, 0.56908, ",", false], [311, 0.188576, " to", false], [369, 0.075684, " for", false], [304, 0.048536, " in", false], [323, 0.025997, " and", false], [320, 0.018352, " (", false], [1576, 0.011494, " because", false], [979, 0.007177, " when", false], [714, 0.006805, " but", false], [518, 0.006291, " at", false]]]}, "raw_delta": -0.09514713287353516, "tuned_delta": -0.0883348550664372}, {"byte_start": 5324, "byte_end": 5328, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 898, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "2.76% 2.76% 2.76% 2.76%", "qwen": "2.68% 2.68% 2.68% 2.68%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.5438103675842285]], "qwen": [[279, " the", "normal", 0.5514378547668457]]}, "loss": {"rwkv": 2.7649306813912014, "qwen": 2.6835307552920504}, "topk": {"rwkv": [22590, 1, 0.5438103675842285, [[22590, 0.54381, " the", false], [63843, 0.098851, " researchers", false], [4491, 0.079052, " do", false], [39944, 0.056416, " those", false], [32229, 0.035571, " them", false], [31059, 0.016067, " have", false], [32499, 0.013773, " work", false], [31370, 0.008858, " many", false], [3609, 0.007519, " AI", false], [39931, 0.007372, " their", false]]], "qwen": [279, 1, 0.5514378547668457, [[279, 0.551438, " the", false], [11811, 0.121601, " researchers", false], [653, 0.081151, " do", false], [1846, 0.069355, " those", false], [1936, 0.029654, " build", false], [1105, 0.010795, " them", false], [1430, 0.008679, " try", false], [1657, 0.007836, " many", false], [15235, 0.004722, " AI", false], [1490, 0.004643, " see", false]]]}, "raw_delta": 0.004513770341873169, "tuned_delta": 0.011326048148971115}, {"byte_start": 5328, "byte_end": 5339, "display": {"text": " researcher", "kind": "normal"}, "is_word": true, "word_id": 899, "word_key": " researcher", "bytes_hex": "20 72 65 73 65 61 72 63 68 65 72", "compression": {"rwkv": "1.54% 1.54% 1.54% 1.54% 1.54% 1.54% 1.54% 1.54% 1.54% 1.54% 1.54%", "qwen": "2.10% 2.10% 2.10% 2.10% 2.10% 2.10% 2.10% 2.10% 2.10% 2.10% 2.10%"}, "model_tokens": {"rwkv": [[62496, " researcher", "normal", 0.39260151982307434]], "qwen": [[31085, " researcher", "normal", 0.2772934138774872]]}, "loss": {"rwkv": 1.5433660549282677, "qwen": 2.1028576694971903}, "topk": {"rwkv": [62496, 1, 0.39260151982307434, [[62496, 0.392602, " researcher", false], [63843, 0.389547, " researchers", false], [37636, 0.062765, " agent", false], [3609, 0.036783, " AI", false], [45124, 0.017104, " agents", false], [38720, 0.012953, " human", false], [62105, 0.010654, " individual", false], [46787, 0.007508, " people", false], [46795, 0.00444, " person", false], [64951, 0.004375, " investigators", false]]], "qwen": [31085, 2, 0.2772934138774872, [[11811, 0.537529, " researchers", false], [31085, 0.277293, " researcher", false], [3738, 0.018354, " human", false], [13402, 0.012415, " developers", false], [8315, 0.01054, " agent", false], [1251, 0.010197, " people", false], [15235, 0.007937, " AI", false], [3412, 0.007739, " research", false], [3842, 0.007146, " individual", false], [12014, 0.007041, " authors", false]]]}, "raw_delta": -0.03102480281483044, "tuned_delta": -0.024212525007732494}, {"byte_start": 5339, "byte_end": 5340, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "3.05%", "qwen": "4.25%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.8436170220375061]], "qwen": [[11, ",", "normal", 0.7900545597076416]]}, "loss": {"rwkv": 3.046707056564827, "qwen": 4.249697752169408}, "topk": {"rwkv": [45, 1, 0.8436170220375061, [[45, 0.843617, ",", false], [22762, 0.02834, " who", false], [21265, 0.021318, " and", false], [275, 0.017901, " (", false], [47, 0.009963, ".", false], [4596, 0.009333, " in", false], [4811, 0.007672, " to", false], [51018, 0.006822, " because", false], [21700, 0.005362, " for", false], [286, 0.004501, " 3", false]]], "qwen": [11, 1, 0.7900545597076416, [[11, 0.790055, ",", false], [879, 0.068329, " who", false], [320, 0.024808, " (", false], [4421, 0.010228, "---", false], [323, 0.00911, " and", false], [4460, 0.008482, " trying", false], [311, 0.007447, " to", false], [13, 0.006437, ".", false], [3730, 0.00533, " doing", false], [1576, 0.004422, " because", false]]]}, "raw_delta": -0.06670796871185303, "tuned_delta": -0.05989569090475508}, {"byte_start": 5340, "byte_end": 5344, "display": {"text": " but", "kind": "normal"}, "is_word": true, "word_id": 900, "word_key": " but", "bytes_hex": "20 62 75 74", "compression": {"rwkv": "6.20% 6.20% 6.20% 6.20%", "qwen": "4.45% 4.45% 4.45% 4.45%"}, "model_tokens": {"rwkv": [[21400, " but", "normal", 0.2517353296279907]], "qwen": [[714, " but", "normal", 0.37229880690574646]]}, "loss": {"rwkv": 6.199080253819764, "qwen": 4.45458444626276}, "topk": {"rwkv": [21400, 3, 0.2517353296279907, [[286, 0.386485, " 3", false], [21265, 0.318788, " and", false], [21400, 0.251735, " but", false], [22762, 0.006499, " who", false], [30788, 0.004208, " even", false], [51018, 0.003328, " because", false], [4423, 0.002545, " as", false], [40187, 0.00222, " while", false], [4788, 0.002016, " so", false], [55495, 0.001375, " although", false]]], "qwen": [714, 1, 0.37229880690574646, [[714, 0.372299, " but", false], [323, 0.322522, " and", false], [220, 0.249809, " ", false], [1496, 0.006742, " even", false], [1576, 0.006304, " because", false], [3602, 0.003455, " yet", false], [438, 0.003381, " as", false], [1393, 0.002528, " while", false], [773, 0.002484, " so", false], [5310, 0.001837, " especially", false]]]}, "raw_delta": 0.0967353880405426, "tuned_delta": 0.10354766584764055}, {"byte_start": 5344, "byte_end": 5346, "display": {"text": " 3", "kind": "normal"}, "is_word": true, "word_id": 901, "word_key": " 3", "bytes_hex": "20 33", "compression": {"rwkv": "2.92% 2.92%", "qwen": "4.66% 0.05%"}, "model_tokens": {"rwkv": [[286, " 3", "normal", 0.7230032086372375]], "qwen": [[220, " ", "normal", 0.7723115682601929], [18, "3", "normal", 0.9974400997161865]]}, "loss": {"rwkv": 2.923429892426366, "qwen": 2.35276879806534}, "topk": {"rwkv": [286, 1, 0.7230032086372375, [[286, 0.723003, " 3", false], [45, 0.043533, ",", false], [4600, 0.025437, " is", false], [4596, 0.021002, " in", false], [4601, 0.019516, " it", false], [32227, 0.01902, " that", false], [62676, 0.013016, " ultimately", false], [61959, 0.010637, " eventually", false], [30659, 0.009494, " does", false], [31601, 0.00896, " over", false]]], "qwen": [220, 1, 0.7723115682601929, [[220, 0.772312, " ", false], [374, 0.023632, " is", false], [1558, 0.023287, " does", false], [304, 0.022494, " in", false], [432, 0.015446, " it", false], [537, 0.010833, " not", false], [2581, 0.007654, " never", false], [1172, 0.007199, " only", false], [13653, 0.006963, " ultimately", false], [279, 0.00546, " the", false]]]}, "raw_delta": 0.03164417028892785, "tuned_delta": 0.0384564480960258}, {"byte_start": 5346, "byte_end": 5347, "display": {"text": ")", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "29", "compression": {"rwkv": "0.02%", "qwen": "0.01%"}, "model_tokens": {"rwkv": [[42, ")", "normal", 0.9989625215530396]], "qwen": [[8, ")", "normal", 0.9994556307792664]]}, "loss": {"rwkv": 0.018711712413873576, "qwen": 0.009819685564566784}, "topk": {"rwkv": [42, 1, 0.9989625215530396, [[42, 0.998963, ")", false], [497, 0.000469, "),", false], [499, 6.7e-05, ").", false], [47, 6.2e-05, ".", false], [276, 5.6e-05, " )", false], [45, 4.9e-05, ",", false], [98, 3.4e-05, "a", false], [4600, 1.9e-05, " is", false], [580, 1.5e-05, ".)", false], [492, 1.5e-05, ")'", false]]], "qwen": [8, 1, 0.9994556307792664, [[8, 0.999456, ")", false], [64, 0.000158, "a", false], [701, 4.8e-05, "),", false], [873, 3e-05, " )", false], [11, 2.3e-05, ",", false], [65, 1.3e-05, "b", false], [13, 1.3e-05, ".", false], [340, 1.2e-05, ")\n", false], [692, 1.1e-05, ")\n\n", false], [568, 1e-05, ").", false]]]}, "raw_delta": 0.0004930786672048271, "tuned_delta": 0.007305356474302774}, {"byte_start": 5347, "byte_end": 5350, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 902, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "12.40% 12.40% 12.40%", "qwen": "12.09% 12.09% 12.09%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.12543824315071106]], "qwen": [[304, " in", "normal", 0.1338699460029602]]}, "loss": {"rwkv": 12.398160507639528, "qwen": 12.087900939105507}, "topk": {"rwkv": [4596, 2, 0.12543824315071106, [[4601, 0.210644, " it", false], [4596, 0.125438, " in", false], [22590, 0.115548, " the", false], [32234, 0.06191, " this", false], [31601, 0.036936, " over", false], [32227, 0.033839, " that", false], [32465, 0.026285, " when", false], [61959, 0.025041, " eventually", false], [4423, 0.015617, " as", false], [37045, 0.015268, " Moore", false]]], "qwen": [304, 2, 0.1338699460029602, [[432, 0.22157, " it", false], [304, 0.13387, " in", false], [279, 0.106598, " the", false], [419, 0.075664, " this", false], [9583, 0.036889, " eventually", false], [916, 0.021513, " over", false], [979, 0.021205, " when", false], [438, 0.015544, " as", false], [13653, 0.013909, " ultimately", false], [1493, 0.012713, " these", false]]]}, "raw_delta": 0.017204443613688114, "tuned_delta": 0.02401672142078606}, {"byte_start": 5350, "byte_end": 5354, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 903, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "0.67% 0.67% 0.67% 0.67%", "qwen": "0.35% 0.35% 0.35% 0.35%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.8619719743728638]], "qwen": [[279, " the", "normal", 0.9242848753929138]]}, "loss": {"rwkv": 0.6692188910373609, "qwen": 0.35497037750131616}, "topk": {"rwkv": [22590, 1, 0.8619719743728638, [[22590, 0.861972, " the", false], [51832, 0.030893, " general", false], [56901, 0.02817, " practice", false], [332, 0.014914, " a", false], [31461, 0.008222, " most", false], [30808, 0.004221, " fact", false], [31323, 0.003421, " long", false], [45145, 0.003114, " almost", false], [39920, 0.002722, " terms", false], [31370, 0.002714, " many", false]]], "qwen": [279, 1, 0.9242848753929138, [[279, 0.924285, " the", false], [6588, 0.021992, " practice", false], [4586, 0.005897, " general", false], [2097, 0.004719, " fact", false], [76553, 0.003382, " retrospect", false], [8729, 0.003154, " reality", false], [1429, 0.003066, " most", false], [264, 0.002704, " a", false], [1657, 0.002187, " many", false], [3793, 0.002115, " terms", false]]]}, "raw_delta": 0.01742563769221306, "tuned_delta": 0.024237915499311005}, {"byte_start": 5354, "byte_end": 5359, "display": {"text": " long", "kind": "normal"}, "is_word": true, "word_id": 904, "word_key": " long", "bytes_hex": "20 6c 6f 6e 67", "compression": {"rwkv": "0.56% 0.56% 0.56% 0.56% 0.56%", "qwen": "0.23% 0.23% 0.23% 0.23% 0.23%"}, "model_tokens": {"rwkv": [[31323, " long", "normal", 0.8555818796157837]], "qwen": [[1293, " long", "normal", 0.9382081031799316]]}, "loss": {"rwkv": 0.5600305456575809, "qwen": 0.23005022816518658}, "topk": {"rwkv": [31323, 1, 0.8555818796157837, [[31323, 0.855582, " long", false], [46470, 0.10688, " longer", false], [21616, 0.010545, " end", false], [32386, 0.005052, " very", false], [46536, 0.002158, " medium", false], [50837, 0.001622, " absence", false], [31466, 0.001515, " much", false], [46397, 0.001137, " larger", false], [30405, 0.000782, " case", false], [30807, 0.000732, " face", false]]], "qwen": [1293, 1, 0.9382081031799316, [[1293, 0.938208, " long", false], [5021, 0.030905, " longer", false], [835, 0.014702, " end", false], [11051, 0.003611, " medium", false], [1602, 0.001793, " very", false], [2805, 0.001152, " short", false], [3930, 0.000565, " limit", false], [3853, 0.000481, " future", false], [1931, 0.000452, " real", false], [19265, 0.000355, " absence", false]]]}, "raw_delta": 0.018297994136810304, "tuned_delta": 0.02511027194390825}, {"byte_start": 5359, "byte_end": 5363, "display": {"text": " run", "kind": "normal"}, "is_word": true, "word_id": 905, "word_key": " run", "bytes_hex": "20 72 75 6e", "compression": {"rwkv": "1.55% 1.55% 1.55% 1.55%", "qwen": "1.93% 1.93% 1.93% 1.93%"}, "model_tokens": {"rwkv": [[22418, " run", "normal", 0.7089329361915588]], "qwen": [[1598, " run", "normal", 0.6518276333808899]]}, "loss": {"rwkv": 1.549770063454941, "qwen": 1.929492304993734}, "topk": {"rwkv": [22418, 1, 0.7089329361915588, [[22418, 0.708933, " run", false], [32219, 0.280961, " term", false], [46, 0.006166, "-", false], [31057, 0.00091, " haul", false], [45, 0.000262, ",", false], [32251, 0.000218, " time", false], [27132, 0.000171, "term", false], [39438, 0.000158, " range", false], [39920, 0.000132, " terms", false], [21265, 0.000125, " and", false]]], "qwen": [1598, 1, 0.6518276333808899, [[1598, 0.651828, " run", false], [4647, 0.340334, " term", false], [9663, 0.004076, "-term", false], [22973, 0.00116, "-run", false], [11, 0.000488, ",", false], [37868, 0.000388, " haul", false], [882, 0.000245, " time", false], [3793, 0.000145, " terms", false], [320, 9.5e-05, " (", false], [835, 7.2e-05, " end", false]]]}, "raw_delta": -0.021056272089481354, "tuned_delta": -0.014243994282383408}, {"byte_start": 5363, "byte_end": 5366, "display": {"text": " it", "kind": "normal"}, "is_word": true, "word_id": 906, "word_key": " it", "bytes_hex": "20 69 74", "compression": {"rwkv": "10.28% 10.28% 10.28%", "qwen": "9.72% 9.72% 9.72%"}, "model_tokens": {"rwkv": [[4601, " it", "normal", 0.18106570839881897]], "qwen": [[432, " it", "normal", 0.19834871590137482]]}, "loss": {"rwkv": 10.284837693837336, "qwen": 9.724538281968906}, "topk": {"rwkv": [4601, 2, 0.18106570839881897, [[45, 0.585331, ",", false], [4601, 0.181066, " it", false], [32234, 0.061491, " this", false], [22590, 0.046421, " the", false], [32139, 0.0106, " such", false], [39936, 0.010133, " these", false], [275, 0.006519, " (", false], [63370, 0.005729, " computation", false], [32227, 0.00546, " that", false], [4600, 0.00419, " is", false]]], "qwen": [432, 2, 0.19834871590137482, [[11, 0.483205, ",", false], [432, 0.198349, " it", false], [279, 0.080016, " the", false], [419, 0.063814, " this", false], [34447, 0.010684, " computation", false], [1052, 0.00918, " there", false], [1493, 0.007101, " these", false], [678, 0.006852, " all", false], [6540, 0.006494, " knowledge", false], [320, 0.006237, " (", false]]]}, "raw_delta": 0.031069596608479855, "tuned_delta": 0.037881874415577804}, {"byte_start": 5366, "byte_end": 5375, "display": {"text": " plateaus", "kind": "normal"}, "is_word": true, "word_id": 907, "word_key": " plateaus", "bytes_hex": "20 70 6c 61 74 65 61 75 73", "compression": {"rwkv": "29.30% 29.30% 29.30% 29.30% 29.30% 29.30% 29.30% 29.30% 0.15%", "qwen": "45.10% 45.10% 45.10% 45.10% 45.10% 45.10% 0.02% 0.02% 0.02%"}, "model_tokens": {"rwkv": [[52488, " plateau", "normal", 2.2434560378314927e-06], [116, "s", "normal", 0.9914444088935852]], "qwen": [[11968, " plate", "normal", 3.0405055895244004e-07], [11855, "aus", "normal", 0.9973642230033875]]}, "loss": {"rwkv": 26.065659990073787, "qwen": 30.073601910940067}, "topk": {"rwkv": [52488, 1383, 2.2434560378314927e-06, [[4600, 0.336429, " is", false], [30659, 0.119423, " does", false], [45150, 0.059601, " always", false], [39115, 0.051416, " never", false], [21800, 0.025387, " has", false], [39914, 0.018975, " tends", false], [45145, 0.018496, " almost", false], [38964, 0.017391, " makes", false], [53248, 0.016176, " usually", false], [40040, 0.014237, " turns", false]]], "qwen": [11968, 3160, 3.0405055895244004e-07, [[374, 0.266822, " is", false], [1558, 0.1476, " does", false], [2677, 0.056765, " always", false], [43064, 0.033064, " hurts", false], [9044, 0.026317, " becomes", false], [702, 0.025968, " has", false], [305, 0.023234, " h", false], [1172, 0.021983, " only", false], [2581, 0.021418, " never", false], [83396, 0.020202, " harms", false]]]}, "raw_delta": -0.22224749138371797, "tuned_delta": -0.21543521357662002}, {"byte_start": 5375, "byte_end": 5379, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 908, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"rwkv": "6.06% 6.06% 6.06% 6.06%", "qwen": "6.21% 6.21% 6.21% 6.21%"}, "model_tokens": {"rwkv": [[21265, " and", "normal", 0.26158949732780457]], "qwen": [[323, " and", "normal", 0.25207898020744324]]}, "loss": {"rwkv": 6.058192066232952, "qwen": 6.212663121117438}, "topk": {"rwkv": [21265, 2, 0.26158949732780457, [[45, 0.370186, ",", false], [21265, 0.261589, " and", false], [4715, 0.199378, " or", false], [22249, 0.040051, " out", false], [4596, 0.024003, " in", false], [275, 0.015808, " (", false], [4424, 0.011965, " at", false], [47, 0.01093, ".", false], [4423, 0.006969, " as", false], [5346, 0.005124, "---", false]]], "qwen": [323, 2, 0.25207898020744324, [[11, 0.284829, ",", false], [323, 0.252079, " and", false], [476, 0.094555, " or", false], [4421, 0.054411, "---", false], [5068, 0.052599, " performance", false], [518, 0.037941, " at", false], [279, 0.025653, " the", false], [304, 0.02063, " in", false], [320, 0.018466, " (", false], [13, 0.016911, ".", false]]]}, "raw_delta": -0.008565694093704224, "tuned_delta": -0.0017534162866062767}, {"byte_start": 5379, "byte_end": 5384, "display": {"text": " even", "kind": "normal"}, "is_word": true, "word_id": 909, "word_key": " even", "bytes_hex": "20 65 76 65 6e", "compression": {"rwkv": "14.26% 14.26% 14.26% 14.26% 14.26%", "qwen": "10.78% 10.78% 10.78% 10.78% 10.78%"}, "model_tokens": {"rwkv": [[30788, " even", "normal", 0.0192644614726305]], "qwen": [[1496, " even", "normal", 0.05034052953124046]]}, "loss": {"rwkv": 14.257884583785458, "qwen": 10.780339488977937}, "topk": {"rwkv": [30788, 9, 0.0192644614726305, [[4600, 0.100094, " is", false], [32230, 0.086973, " then", false], [30659, 0.074066, " does", false], [51019, 0.059416, " becomes", false], [61959, 0.045946, " eventually", false], [22590, 0.045234, " the", false], [39171, 0.022665, " often", false], [39115, 0.021451, " never", false], [30788, 0.019264, " even", false], [38442, 0.018043, " fails", false]]], "qwen": [1496, 5, 0.05034052953124046, [[1221, 0.112166, " then", false], [9044, 0.086393, " becomes", false], [374, 0.068139, " is", false], [1558, 0.066127, " does", false], [1496, 0.050341, " even", false], [14525, 0.038145, " fails", false], [9583, 0.037363, " eventually", false], [3545, 0.026048, " often", false], [279, 0.025496, " the", false], [17066, 0.022589, " falls", false]]]}, "raw_delta": 0.19283604621887207, "tuned_delta": 0.19964832402597002}, {"byte_start": 5384, "byte_end": 5393, "display": {"text": " inhibits", "kind": "normal"}, "is_word": true, "word_id": 910, "word_key": " inhibits", "bytes_hex": "20 69 6e 68 69 62 69 74 73", "compression": {"rwkv": "10.64% 10.64% 10.64% 10.64% 10.64% 10.64% 10.64% 10.64% 0.00%", "qwen": "20.57% 20.57% 20.57% 20.57% 20.57% 20.57% 0.00% 0.00% 0.00%"}, "model_tokens": {"rwkv": [[52011, " inhibit", "normal", 0.00903643760830164], [116, "s", "normal", 0.9997283816337585]], "qwen": [[20142, " inhib", "normal", 0.0010657573584467173], [1199, "its", "normal", 0.9995834231376648]]}, "loss": {"rwkv": 9.455713155864421, "qwen": 13.714591980118762}, "topk": {"rwkv": [52011, 31, 0.00903643760830164, [[55929, 0.079534, " declines", false], [38724, 0.07181, " hurts", false], [52688, 0.063334, " regress", false], [46201, 0.05782, " hinder", false], [51417, 0.0408, " degrade", false], [51019, 0.040362, " becomes", false], [40216, 0.030208, " worse", false], [47396, 0.028928, " starts", false], [38447, 0.026684, " falls", false], [30965, 0.025192, " gets", false]]], "qwen": [20142, 91, 0.0010657573584467173, [[56954, 0.174928, " declines", false], [46193, 0.106602, " wors", false], [17066, 0.083355, " falls", false], [38336, 0.071724, " deterior", false], [9044, 0.038606, " becomes", false], [42054, 0.033706, " decreases", false], [5221, 0.029796, " gets", false], [5780, 0.026763, " goes", false], [14525, 0.019451, " fails", false], [69170, 0.017272, " slows", false]]]}, "raw_delta": -0.23616238795026817, "tuned_delta": -0.22935011014317022}, {"byte_start": 5393, "byte_end": 5401, "display": {"text": " further", "kind": "normal"}, "is_word": true, "word_id": 911, "word_key": " further", "bytes_hex": "20 66 75 72 74 68 65 72", "compression": {"rwkv": "6.45% 6.45% 6.45% 6.45% 6.45% 6.45% 6.45% 6.45%", "qwen": "5.51% 5.51% 5.51% 5.51% 5.51% 5.51% 5.51% 5.51%"}, "model_tokens": {"rwkv": [[51816, " further", "normal", 0.057413067668676376]], "qwen": [[4623, " further", "normal", 0.0866326093673706]]}, "loss": {"rwkv": 6.4456345820966865, "qwen": 5.513978227529439}, "topk": {"rwkv": [51816, 3, 0.057413067668676376, [[56950, 0.657974, " progress", false], [22590, 0.062632, " the", false], [51816, 0.057413, " further", false], [63750, 0.055049, " performance", false], [63621, 0.023253, " improvement", false], [45, 0.01831, ",", false], [57103, 0.017816, " research", false], [56537, 0.016495, " learning", false], [63469, 0.006175, " development", false], [59593, 0.005508, " effective", false]]], "qwen": [4623, 3, 0.0866326093673706, [[5098, 0.393611, " progress", false], [5068, 0.238207, " performance", false], [4623, 0.086633, " further", false], [279, 0.064738, " the", false], [15673, 0.021279, " improvement", false], [3853, 0.013209, " future", false], [3412, 0.01273, " research", false], [2393, 0.009553, " success", false], [1293, 0.009438, " long", false], [11, 0.009293, ",", false]]]}, "raw_delta": 0.05166199803352356, "tuned_delta": 0.05847427584062151}, {"byte_start": 5401, "byte_end": 5410, "display": {"text": " progress", "kind": "normal"}, "is_word": true, "word_id": 912, "word_key": " progress", "bytes_hex": "20 70 72 6f 67 72 65 73 73", "compression": {"rwkv": "0.47% 0.47% 0.47% 0.47% 0.47% 0.47% 0.47% 0.47% 0.47%", "qwen": "0.73% 0.73% 0.73% 0.73% 0.73% 0.73% 0.73% 0.73% 0.73%"}, "model_tokens": {"rwkv": [[56950, " progress", "normal", 0.7903551459312439]], "qwen": [[5098, " progress", "normal", 0.6947980523109436]]}, "loss": {"rwkv": 0.4696272919560427, "qwen": 0.7296311412600225}, "topk": {"rwkv": [56950, 1, 0.7903551459312439, [[56950, 0.790355, " progress", false], [63621, 0.06504, " improvement", false], [63469, 0.025939, " development", false], [57103, 0.02243, " research", false], [63750, 0.014427, " performance", false], [56537, 0.010148, " learning", false], [64423, 0.008856, " improvements", false], [55465, 0.007953, " advances", false], [53052, 0.005556, " success", false], [50862, 0.005283, " advance", false]]], "qwen": [5098, 1, 0.6947980523109436, [[5098, 0.694798, " progress", false], [15673, 0.081768, " improvement", false], [5068, 0.06162, " performance", false], [19619, 0.038062, " gains", false], [18142, 0.027084, " improvements", false], [29903, 0.015329, " advances", false], [4401, 0.011739, " development", false], [2393, 0.011474, " success", false], [3412, 0.004793, " research", false], [11912, 0.004657, " advance", false]]]}, "raw_delta": -0.01441767480638292, "tuned_delta": -0.007605396999284974}, {"byte_start": 5410, "byte_end": 5411, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "17.05%", "qwen": "24.12%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.38352957367897034]], "qwen": [[11, ",", "normal", 0.2625139057636261]]}, "loss": {"rwkv": 17.04747069800435, "qwen": 24.11917802360319}, "topk": {"rwkv": [45, 2, 0.38352957367897034, [[47, 0.444229, ".", false], [45, 0.38353, ",", false], [21265, 0.023249, " and", false], [5346, 0.019962, "---", false], [4423, 0.015026, " as", false], [4596, 0.014846, " in", false], [4450, 0.014409, " by", false], [51018, 0.014292, " because", false], [275, 0.013497, " (", false], [60, 0.010277, ";", false]]], "qwen": [11, 2, 0.2625139057636261, [[13, 0.474898, ".", false], [11, 0.262514, ",", false], [382, 0.117923, ".\n\n", false], [304, 0.022742, " in", false], [1576, 0.016775, " because", false], [320, 0.014746, " (", false], [323, 0.010745, " and", false], [553, 0.010258, " by", false], [4421, 0.008457, "---", false], [624, 0.007372, ".\n", false]]]}, "raw_delta": -0.3921387195587158, "tuned_delta": -0.3853264417516179}, {"byte_start": 5411, "byte_end": 5415, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 913, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"rwkv": "2.87% 2.87% 2.87% 2.87%", "qwen": "2.82% 2.82% 2.82% 2.82%"}, "model_tokens": {"rwkv": [[21265, " and", "normal", 0.5254080891609192]], "qwen": [[323, " and", "normal", 0.535361111164093]]}, "loss": {"rwkv": 2.8705968220813114, "qwen": 2.8169242614217325}, "topk": {"rwkv": [21265, 1, 0.5254080891609192, [[21265, 0.525408, " and", false], [287, 0.139477, " 4", false], [51018, 0.051058, " because", false], [40187, 0.045087, " while", false], [4423, 0.034939, " as", false], [53339, 0.022221, " whereas", false], [61953, 0.008102, " especially", false], [4715, 0.007804, " or", false], [40186, 0.00734, " which", false], [32465, 0.006825, " when", false]]], "qwen": [323, 1, 0.535361111164093, [[323, 0.535361, " and", false], [220, 0.107731, " ", false], [1576, 0.095174, " because", false], [438, 0.060538, " as", false], [1393, 0.013686, " while", false], [1496, 0.010414, " even", false], [4152, 0.009644, " due", false], [2474, 0.009604, " since", false], [304, 0.008119, " in", false], [773, 0.007076, " so", false]]]}, "raw_delta": 0.00297623872756958, "tuned_delta": 0.009788516534667526}, {"byte_start": 5415, "byte_end": 5417, "display": {"text": " 4", "kind": "normal"}, "is_word": true, "word_id": 914, "word_key": " 4", "bytes_hex": "20 34", "compression": {"rwkv": "1.44% 1.44%", "qwen": "2.80% 0.02%"}, "model_tokens": {"rwkv": [[287, " 4", "normal", 0.8527243733406067]], "qwen": [[220, " ", "normal", 0.8563111424446106], [19, "4", "normal", 0.9990171194076538]]}, "loss": {"rwkv": 1.4441039227648313, "qwen": 1.407572999090544}, "topk": {"rwkv": [287, 1, 0.8527243733406067, [[287, 0.852724, " 4", false], [4600, 0.011337, " is", false], [32227, 0.010944, " that", false], [22590, 0.008691, " the", false], [45, 0.007795, ",", false], [51744, 0.007107, " finally", false], [61959, 0.007002, " eventually", false], [4601, 0.006508, " it", false], [4596, 0.004808, " in", false], [30788, 0.003126, " even", false]]], "qwen": [220, 1, 0.8563111424446106, [[220, 0.856311, " ", false], [429, 0.02449, " that", false], [374, 0.014326, " is", false], [304, 0.01074, " in", false], [279, 0.009291, " the", false], [5499, 0.005781, " finally", false], [11, 0.005532, ",", false], [432, 0.003642, " it", false], [3545, 0.002983, " often", false], [9583, 0.002595, " eventually", false]]]}, "raw_delta": 0.002025704539846629, "tuned_delta": 0.008837982346944575}, {"byte_start": 5417, "byte_end": 5418, "display": {"text": ")", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "29", "compression": {"rwkv": "0.02%", "qwen": "0.01%"}, "model_tokens": {"rwkv": [[42, ")", "normal", 0.9987653493881226]], "qwen": [[8, ")", "normal", 0.9994415640830994]]}, "loss": {"rwkv": 0.02215136543112975, "qwen": 0.010073219314950659}, "topk": {"rwkv": [42, 1, 0.9987653493881226, [[42, 0.998765, ")", false], [497, 0.000249, "),", false], [499, 0.000183, ").", false], [276, 0.000137, " )", false], [47, 0.000133, ".", false], [45, 9.5e-05, ",", false], [98, 7.7e-05, "a", false], [580, 4.7e-05, ".)", false], [22590, 2.9e-05, " the", false], [32227, 2.1e-05, " that", false]]], "qwen": [8, 1, 0.9994415640830994, [[8, 0.999442, ")", false], [701, 0.000149, "),", false], [11, 4.9e-05, ",", false], [64, 4.9e-05, "a", false], [873, 4.5e-05, " )", false], [568, 1.8e-05, ").", false], [13, 1.6e-05, ".", false], [6138, 1.3e-05, ".)", false], [323, 1.3e-05, " and", false], [692, 1.2e-05, ")\n\n", false]]]}, "raw_delta": 0.0006697546341456473, "tuned_delta": 0.007482032441243594}, {"byte_start": 5418, "byte_end": 5431, "display": {"text": " breakthrough", "kind": "normal"}, "is_word": true, "word_id": 915, "word_key": " breakthrough", "bytes_hex": "20 62 72 65 61 6b 74 68 72 6f 75 67 68", "compression": {"rwkv": "12.74% 12.74% 12.74% 12.74% 12.74% 12.74% 12.74% 12.74% 12.74% 12.74% 12.74% 12.74% 12.74%", "qwen": "12.14% 12.14% 12.14% 12.14% 12.14% 12.14% 12.14% 12.14% 12.14% 12.14% 12.14% 12.14% 12.14%"}, "model_tokens": {"rwkv": [[64266, " breakthrough", "normal", 9.907703497447073e-05]], "qwen": [[41345, " breakthrough", "normal", 0.00015804381109774113]]}, "loss": {"rwkv": 12.744962200160916, "qwen": 12.14171849988146}, "topk": {"rwkv": [64266, 327, 9.907703497447073e-05, [[22590, 0.213965, " the", false], [4601, 0.07255, " it", false], [4596, 0.063779, " in", false], [52028, 0.059363, " instead", false], [39934, 0.037005, " there", false], [32234, 0.028181, " this", false], [32465, 0.023713, " when", false], [332, 0.023134, " a", false], [52224, 0.021983, " methods", false], [32227, 0.020168, " that", false]]], "qwen": [41345, 300, 0.00015804381109774113, [[279, 0.178854, " the", false], [304, 0.09324, " in", false], [432, 0.061079, " it", false], [419, 0.046795, " this", false], [1052, 0.037482, " there", false], [979, 0.030111, " when", false], [438, 0.018218, " as", false], [582, 0.016687, " we", false], [429, 0.016293, " that", false], [20219, 0.015668, " Moore", false]]]}, "raw_delta": 0.03345093360314011, "tuned_delta": 0.04026321141023806}, {"byte_start": 5431, "byte_end": 5440, "display": {"text": " progress", "kind": "normal"}, "is_word": true, "word_id": 916, "word_key": " progress", "bytes_hex": "20 70 72 6f 67 72 65 73 73", "compression": {"rwkv": "4.92% 4.92% 4.92% 4.92% 4.92% 4.92% 4.92% 4.92% 4.92%", "qwen": "6.42% 6.42% 6.42% 6.42% 6.42% 6.42% 6.42% 6.42% 6.42%"}, "model_tokens": {"rwkv": [[56950, " progress", "normal", 0.08595788478851318]], "qwen": [[5098, " progress", "normal", 0.040597595274448395]]}, "loss": {"rwkv": 4.915432322473246, "qwen": 6.420086081581431}, "topk": {"rwkv": [56950, 2, 0.08595788478851318, [[116, 0.771242, "s", false], [56950, 0.085958, " progress", false], [52224, 0.056857, " methods", false], [64423, 0.009838, " improvements", false], [63750, 0.008194, " performance", false], [62633, 0.007258, " techniques", false], [57103, 0.007104, " research", false], [55465, 0.005727, " advances", false], [52738, 0.005079, " results", false], [61590, 0.004333, " approaches", false]]], "qwen": [5098, 2, 0.040597595274448395, [[82, 0.860475, "s", false], [5098, 0.040598, " progress", false], [5413, 0.019827, " methods", false], [3059, 0.011784, " results", false], [29903, 0.004517, " advances", false], [3412, 0.004024, " research", false], [18142, 0.003056, " improvements", false], [15235, 0.003025, " AI", false], [4041, 0.002972, " comes", false], [5068, 0.002947, " performance", false]]]}, "raw_delta": -0.08343572086758089, "tuned_delta": -0.07662344306048294}, {"byte_start": 5440, "byte_end": 5451, "display": {"text": " eventually", "kind": "normal"}, "is_word": true, "word_id": 917, "word_key": " eventually", "bytes_hex": "20 65 76 65 6e 74 75 61 6c 6c 79", "compression": {"rwkv": "10.86% 10.86% 10.86% 10.86% 10.86% 10.86% 10.86% 10.86% 10.86% 10.86% 10.86%", "qwen": "7.91% 7.91% 7.91% 7.91% 7.91% 7.91% 7.91% 7.91% 7.91% 7.91% 7.91%"}, "model_tokens": {"rwkv": [[61959, " eventually", "normal", 0.001304662087932229]], "qwen": [[9583, " eventually", "normal", 0.008022933267056942]]}, "loss": {"rwkv": 10.861198461237937, "qwen": 7.910971326589175}, "topk": {"rwkv": [61959, 45, 0.001304662087932229, [[4600, 0.267451, " is", false], [38087, 0.138832, " comes", false], [21800, 0.077033, " has", false], [4596, 0.073551, " in", false], [45150, 0.058714, " always", false], [21413, 0.053326, " can", false], [45, 0.02651, ",", false], [57102, 0.025184, " requires", false], [46697, 0.02337, " occurs", false], [45145, 0.016299, " almost", false]]], "qwen": [9583, 19, 0.008022933267056942, [[374, 0.216913, " is", false], [4041, 0.17991, " comes", false], [304, 0.122485, " in", false], [702, 0.053817, " has", false], [13666, 0.036241, " occurs", false], [2677, 0.034178, " always", false], [7460, 0.031665, " requires", false], [8573, 0.028992, " happens", false], [646, 0.028319, " can", false], [3545, 0.019932, " often", false]]]}, "raw_delta": 0.1635953296314587, "tuned_delta": 0.17040760743855665}, {"byte_start": 5451, "byte_end": 5459, "display": {"text": " arrives", "kind": "normal"}, "is_word": true, "word_id": 918, "word_key": " arrives", "bytes_hex": "20 61 72 72 69 76 65 73", "compression": {"rwkv": "8.88% 8.88% 8.88% 8.88% 8.88% 8.88% 8.88% 8.88%", "qwen": "8.48% 8.48% 8.48% 8.48% 8.48% 8.48% 8.48% 8.48%"}, "model_tokens": {"rwkv": [[50956, " arrives", "normal", 0.019006382673978806]], "qwen": [[29682, " arrives", "normal", 0.02329213172197342]]}, "loss": {"rwkv": 8.875955817969208, "qwen": 8.475021263145285}, "topk": {"rwkv": [50956, 7, 0.019006382673978806, [[38087, 0.630791, " comes", false], [46697, 0.066474, " occurs", false], [57102, 0.04228, " requires", false], [51896, 0.03281, " happens", false], [30659, 0.028737, " does", false], [4600, 0.021119, " is", false], [50956, 0.019006, " arrives", false], [45199, 0.014949, " arises", false], [51586, 0.011348, " emerges", false], [51775, 0.008644, " follows", false]]], "qwen": [29682, 7, 0.02329213172197342, [[4041, 0.635852, " comes", false], [8573, 0.055551, " happens", false], [13666, 0.050596, " occurs", false], [7460, 0.040678, " requires", false], [3697, 0.023872, " came", false], [3059, 0.023389, " results", false], [29682, 0.023292, " arrives", false], [13798, 0.013052, " depends", false], [33644, 0.009571, " relies", false], [702, 0.009373, " has", false]]]}, "raw_delta": 0.022232532501220703, "tuned_delta": 0.02904481030831865}, {"byte_start": 5459, "byte_end": 5462, "display": {"text": " by", "kind": "normal"}, "is_word": true, "word_id": 919, "word_key": " by", "bytes_hex": "20 62 79", "compression": {"rwkv": "13.81% 13.81% 13.81%", "qwen": "13.84% 13.84% 13.84%"}, "model_tokens": {"rwkv": [[4450, " by", "normal", 0.10076436400413513]], "qwen": [[553, " by", "normal", 0.0999731495976448]]}, "loss": {"rwkv": 13.807042383507657, "qwen": 13.842981024782954}, "topk": {"rwkv": [4450, 3, 0.10076436400413513, [[32465, 0.203016, " when", false], [30917, 0.152782, " from", false], [4450, 0.100764, " by", false], [53140, 0.085689, " through", false], [31581, 0.079468, " only", false], [45, 0.042088, ",", false], [22705, 0.035633, " via", false], [4596, 0.032141, " in", false], [32487, 0.030022, " with", false], [32227, 0.027819, " that", false]]], "qwen": [553, 3, 0.0999731495976448, [[979, 0.241971, " when", false], [504, 0.153203, " from", false], [553, 0.099973, " by", false], [1526, 0.089356, " through", false], [11, 0.072803, ",", false], [304, 0.045917, " in", false], [1172, 0.044993, " only", false], [448, 0.036462, " with", false], [518, 0.023641, " at", false], [429, 0.023147, " that", false]]]}, "raw_delta": -0.0019928614298502234, "tuned_delta": 0.0048194163772477235}, {"byte_start": 5462, "byte_end": 5465, "display": {"text": " an", "kind": "normal"}, "is_word": true, "word_id": 920, "word_key": " an", "bytes_hex": "20 61 6e", "compression": {"rwkv": "34.56% 34.56% 34.56%", "qwen": "35.53% 35.53% 35.53%"}, "model_tokens": {"rwkv": [[4419, " an", "normal", 0.003179091727361083]], "qwen": [[458, " an", "normal", 0.0027115787379443645]]}, "loss": {"rwkv": 34.564568687964744, "qwen": 35.52771166208167}, "topk": {"rwkv": [4419, 47, 0.003179091727361083, [[38888, 0.120086, " lever", false], [59611, 0.075403, " embracing", false], [40085, 0.069471, " using", false], [47497, 0.069171, " taking", false], [46500, 0.043216, " making", false], [55666, 0.04053, " building", false], [38989, 0.039682, " means", false], [39193, 0.034427, " other", false], [332, 0.029234, " a", false], [22590, 0.018636, " the", false]]], "qwen": [458, 61, 0.0027115787379443645, [[76482, 0.117065, " leveraging", false], [1667, 0.062866, " using", false], [55401, 0.034076, " embracing", false], [4752, 0.031185, " building", false], [18950, 0.026335, " applying", false], [264, 0.025556, " a", false], [4633, 0.025075, " taking", false], [77239, 0.025066, " abandoning", false], [7218, 0.022691, " moving", false], [4936, 0.022481, " simply", false]]]}, "raw_delta": -0.05340798695882154, "tuned_delta": -0.04659570915172359}, {"byte_start": 5465, "byte_end": 5474, "display": {"text": " opposing", "kind": "normal"}, "is_word": true, "word_id": 921, "word_key": " opposing", "bytes_hex": "20 6f 70 70 6f 73 69 6e 67", "compression": {"rwkv": "14.09% 14.09% 14.09% 14.09% 14.09% 14.09% 14.09% 14.09% 14.09%", "qwen": "17.69% 17.69% 17.69% 17.69% 17.69% 17.69% 17.69% 17.69% 17.69%"}, "model_tokens": {"rwkv": [[56766, " opposing", "normal", 0.0008809858118183911]], "qwen": [[30222, " opposing", "normal", 0.00014682918845210224]]}, "loss": {"rwkv": 14.088818758681281, "qwen": 17.685518689032}, "topk": {"rwkv": [56766, 60, 0.0008809858118183911, [[63277, 0.389899, " alternative", false], [56131, 0.245481, " entirely", false], [55532, 0.078474, " approach", false], [63627, 0.016598, " independent", false], [59121, 0.015998, " alternate", false], [39193, 0.012396, " other", false], [62688, 0.009879, " unexpected", false], [56767, 0.008487, " opposite", false], [56438, 0.008075, " indirect", false], [37636, 0.00747, " agent", false]]], "qwen": [30222, 267, 0.00014682918845210224, [[11368, 0.350579, " entirely", false], [5486, 0.224518, " approach", false], [10555, 0.062742, " alternative", false], [7373, 0.0206, " effective", false], [9489, 0.020104, " independent", false], [650, 0.017477, " un", false], [16500, 0.016767, " unexpected", false], [3766, 0.016207, " application", false], [30055, 0.015551, " altogether", false], [4558, 0.010551, " almost", false]]]}, "raw_delta": -0.1994433932834201, "tuned_delta": -0.19263111547632214}, {"byte_start": 5474, "byte_end": 5483, "display": {"text": " approach", "kind": "normal"}, "is_word": true, "word_id": 922, "word_key": " approach", "bytes_hex": "20 61 70 70 72 6f 61 63 68", "compression": {"rwkv": "4.88% 4.88% 4.88% 4.88% 4.88% 4.88% 4.88% 4.88% 4.88%", "qwen": "3.28% 3.28% 3.28% 3.28% 3.28% 3.28% 3.28% 3.28% 3.28%"}, "model_tokens": {"rwkv": [[55532, " approach", "normal", 0.08837983012199402]], "qwen": [[5486, " approach", "normal", 0.19462503492832184]]}, "loss": {"rwkv": 4.884123836342844, "qwen": 3.279487246561189}, "topk": {"rwkv": [55532, 3, 0.08837983012199402, [[39552, 0.432948, " route", false], [46561, 0.105174, " method", false], [55532, 0.08838, " approach", false], [31637, 0.074926, " path", false], [45, 0.055661, ",", false], [57317, 0.032264, " strategy", false], [38536, 0.023886, " force", false], [38989, 0.022402, " means", false], [59526, 0.018884, " direction", false], [51832, 0.014562, " general", false]]], "qwen": [5486, 2, 0.19462503492832184, [[6021, 0.198698, " route", false], [5486, 0.194625, " approach", false], [1714, 0.128327, " method", false], [3363, 0.111152, " means", false], [1815, 0.099305, " path", false], [11, 0.036819, ",", false], [5344, 0.02711, " force", false], [8282, 0.026197, " strategy", false], [16953, 0.015982, " mechanism", false], [1882, 0.014992, " process", false]]]}, "raw_delta": 0.08897994624243842, "tuned_delta": 0.09579222404953637}, {"byte_start": 5483, "byte_end": 5489, "display": {"text": " based", "kind": "normal"}, "is_word": true, "word_id": 923, "word_key": " based", "bytes_hex": "20 62 61 73 65 64", "compression": {"rwkv": "10.61% 10.61% 10.61% 10.61% 10.61% 10.61%", "qwen": "11.40% 11.40% 11.40% 11.40% 11.40% 11.40%"}, "model_tokens": {"rwkv": [[37810, " based", "normal", 0.02955791912972927]], "qwen": [[3118, " based", "normal", 0.022526785731315613]]}, "loss": {"rwkv": 10.613576798206566, "qwen": 11.400447587510417}, "topk": {"rwkv": [37810, 5, 0.02955791912972927, [[32227, 0.329468, " that", false], [45, 0.259394, ",", false], [47, 0.135472, ".", false], [5346, 0.113402, "---", false], [37810, 0.029558, " based", false], [59, 0.024104, ":", false], [4706, 0.017315, " of", false], [275, 0.014436, " (", false], [21265, 0.011146, " and", false], [4811, 0.009477, " to", false]]], "qwen": [3118, 8, 0.022526785731315613, [[429, 0.246227, " that", false], [11, 0.240545, ",", false], [4421, 0.184119, "---", false], [13, 0.09639, ".", false], [25, 0.051621, ":", false], [315, 0.030846, " of", false], [382, 0.028947, ".\n\n", false], [3118, 0.022527, " based", false], [320, 0.021723, " (", false], [311, 0.01038, " to", false]]]}, "raw_delta": -0.04363338152567553, "tuned_delta": -0.03682110371857758}, {"byte_start": 5489, "byte_end": 5492, "display": {"text": " on", "kind": "normal"}, "is_word": true, "word_id": 924, "word_key": " on", "bytes_hex": "20 6f 6e", "compression": {"rwkv": "0.50% 0.50% 0.50%", "qwen": "0.40% 0.40% 0.40%"}, "model_tokens": {"rwkv": [[4712, " on", "normal", 0.9206304550170898]], "qwen": [[389, " on", "normal", 0.9363231658935547]]}, "loss": {"rwkv": 0.49604382712857015, "qwen": 0.39550657634180847}, "topk": {"rwkv": [4712, 1, 0.9206304550170898, [[4712, 0.92063, " on", false], [31581, 0.012818, " only", false], [47330, 0.010895, " solely", false], [22187, 0.009562, " not", false], [31458, 0.008651, " more", false], [46957, 0.005907, " purely", false], [52028, 0.004397, " instead", false], [4596, 0.003275, " in", false], [56131, 0.003021, " entirely", false], [47285, 0.001811, " simply", false]]], "qwen": [389, 1, 0.9363231658935547, [[389, 0.936323, " on", false], [21063, 0.011515, " solely", false], [31127, 0.005355, " purely", false], [1172, 0.004652, " only", false], [537, 0.004412, " not", false], [803, 0.004253, " more", false], [304, 0.003795, " in", false], [11368, 0.003471, " entirely", false], [13771, 0.002031, " largely", false], [4558, 0.001982, " almost", false]]]}, "raw_delta": 0.00557496895392736, "tuned_delta": 0.012387246761025306}, {"byte_start": 5492, "byte_end": 5500, "display": {"text": " scaling", "kind": "normal"}, "is_word": true, "word_id": 925, "word_key": " scaling", "bytes_hex": "20 73 63 61 6c 69 6e 67", "compression": {"rwkv": "15.92% 15.92% 15.92% 15.92% 15.92% 15.92% 15.92% 15.92%", "qwen": "12.54% 12.54% 12.54% 12.54% 12.54% 12.54% 12.54% 12.54%"}, "model_tokens": {"rwkv": [[52805, " scaling", "normal", 0.0008395435870625079]], "qwen": [[26943, " scaling", "normal", 0.003844857681542635]]}, "loss": {"rwkv": 15.920365197309849, "qwen": 12.535710082016466}, "topk": {"rwkv": [52805, 54, 0.0008395435870625079, [[52195, 0.410274, " massive", false], [63370, 0.205527, " computation", false], [22590, 0.037853, " the", false], [59988, 0.037352, " massively", false], [38888, 0.031274, " lever", false], [51832, 0.021609, " general", false], [47202, 0.019047, " search", false], [31458, 0.012588, " more", false], [332, 0.012211, " a", false], [31466, 0.010783, " much", false]]], "qwen": [26943, 27, 0.003844857681542635, [[76482, 0.224468, " leveraging", false], [34447, 0.194775, " computation", false], [10951, 0.113851, " massive", false], [279, 0.040022, " the", false], [63707, 0.024968, " massively", false], [2711, 0.022049, " search", false], [32064, 0.02161, " leverage", false], [4586, 0.019638, " general", false], [6832, 0.014682, " learning", false], [54480, 0.013875, " computational", false]]]}, "raw_delta": 0.18768513202667236, "tuned_delta": 0.1944974098337703}, {"byte_start": 5500, "byte_end": 5512, "display": {"text": " computation", "kind": "normal"}, "is_word": true, "word_id": 926, "word_key": " computation", "bytes_hex": "20 63 6f 6d 70 75 74 61 74 69 6f 6e", "compression": {"rwkv": "1.20% 1.20% 1.20% 1.20% 1.20% 1.20% 1.20% 1.20% 1.20% 1.20% 1.20% 1.20%", "qwen": "2.47% 2.47% 2.47% 2.47% 2.47% 2.47% 2.47% 2.47% 2.47% 2.47% 2.47% 2.47%"}, "model_tokens": {"rwkv": [[63370, " computation", "normal", 0.4485929310321808]], "qwen": [[34447, " computation", "normal", 0.1930505931377411]]}, "loss": {"rwkv": 1.1975495944879089, "qwen": 2.471822082714474}, "topk": {"rwkv": [63370, 1, 0.4485929310321808, [[63370, 0.448593, " computation", false], [4833, 0.266571, " up", false], [21265, 0.058838, " and", false], [45, 0.036224, ",", false], [47, 0.021775, ".", false], [52195, 0.016199, " massive", false], [4706, 0.015598, " of", false], [22590, 0.010932, " the", false], [64862, 0.010784, " computational", false], [46, 0.007356, "-", false]]], "qwen": [34447, 2, 0.1930505931377411, [[705, 0.524018, " up", false], [34447, 0.193051, " computation", false], [5239, 0.053742, "-up", false], [279, 0.033484, " the", false], [63707, 0.019079, " massively", false], [323, 0.01254, " and", false], [700, 0.010937, " out", false], [990, 0.010724, " use", false], [315, 0.010249, " of", false], [10951, 0.009639, " massive", false]]]}, "raw_delta": -0.070660670598348, "tuned_delta": -0.06384839279125006}, {"byte_start": 5512, "byte_end": 5515, "display": {"text": " by", "kind": "normal"}, "is_word": true, "word_id": 927, "word_key": " by", "bytes_hex": "20 62 79", "compression": {"rwkv": "26.30% 26.30% 26.30%", "qwen": "23.53% 23.53% 23.53%"}, "model_tokens": {"rwkv": [[4450, " by", "normal", 0.012633548118174076]], "qwen": [[553, " by", "normal", 0.019953183829784393]]}, "loss": {"rwkv": 26.299128349538393, "qwen": 23.530156075851913}, "topk": {"rwkv": [4450, 11, 0.012633548118174076, [[21265, 0.278919, " and", false], [47, 0.262554, ".", false], [45, 0.15231, ",", false], [4811, 0.052233, " to", false], [4833, 0.034109, " up", false], [275, 0.023741, " (", false], [47001, 0.023192, " rather", false], [5346, 0.018419, "---", false], [4596, 0.017409, " in", false], [4715, 0.013143, " or", false]]], "qwen": [553, 8, 0.019953183829784393, [[13, 0.347101, ".", false], [382, 0.137095, ".\n\n", false], [11, 0.105796, ",", false], [311, 0.075456, " to", false], [323, 0.055648, " and", false], [705, 0.049668, " up", false], [4421, 0.022753, "---", false], [553, 0.019953, " by", false], [320, 0.015454, " (", false], [4751, 0.014441, " rather", false]]]}, "raw_delta": 0.15354442596435547, "tuned_delta": 0.16035670377145342}, {"byte_start": 5515, "byte_end": 5522, "display": {"text": " search", "kind": "normal"}, "is_word": true, "word_id": 928, "word_key": " search", "bytes_hex": "20 73 65 61 72 63 68", "compression": {"rwkv": "11.83% 11.83% 11.83% 11.83% 11.83% 11.83% 11.83%", "qwen": "17.54% 17.54% 17.54% 17.54% 17.54% 17.54% 17.54%"}, "model_tokens": {"rwkv": [[47202, " search", "normal", 0.010258347727358341]], "qwen": [[2711, " search", "normal", 0.001106332871131599]]}, "loss": {"rwkv": 11.834607757292277, "qwen": 17.53571224553878}, "topk": {"rwkv": [47202, 11, 0.010258347727358341, [[37045, 0.320335, " Moore", false], [52195, 0.168199, " massive", false], [332, 0.069284, " a", false], [59988, 0.051606, " massively", false], [38888, 0.038846, " lever", false], [40085, 0.026923, " using", false], [22590, 0.021971, " the", false], [4419, 0.015295, " an", false], [38989, 0.012689, " means", false], [51832, 0.011641, " general", false]]], "qwen": [2711, 77, 0.001106332871131599, [[20219, 0.245247, " Moore", false], [264, 0.113989, " a", false], [76482, 0.085343, " leveraging", false], [279, 0.025898, " the", false], [63707, 0.024991, " massively", false], [10951, 0.02362, " massive", false], [1667, 0.023573, " using", false], [803, 0.022908, " more", false], [10163, 0.020346, " orders", false], [458, 0.019338, " an", false]]]}, "raw_delta": -0.31613636016845703, "tuned_delta": -0.3093240823613591}, {"byte_start": 5522, "byte_end": 5526, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 929, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"rwkv": "4.21% 4.21% 4.21% 4.21%", "qwen": "1.60% 1.60% 1.60% 1.60%"}, "model_tokens": {"rwkv": [[21265, " and", "normal", 0.39545053243637085]], "qwen": [[323, " and", "normal", 0.7012136578559875]]}, "loss": {"rwkv": 4.209034604156033, "qwen": 1.600231116832549}, "topk": {"rwkv": [21265, 1, 0.39545053243637085, [[21265, 0.395451, " and", false], [4715, 0.35659, " or", false], [45, 0.094249, ",", false], [47, 0.075493, ".", false], [275, 0.02638, " (", false], [5346, 0.007559, "---", false], [48, 0.006871, "/", false], [4596, 0.005542, " in", false], [52224, 0.002801, " methods", false], [4811, 0.002346, " to", false]]], "qwen": [323, 1, 0.7012136578559875, [[323, 0.701214, " and", false], [476, 0.160536, " or", false], [11, 0.06367, ",", false], [13, 0.02418, ".", false], [320, 0.011431, " (", false], [382, 0.009288, ".\n\n", false], [9777, 0.003663, "-and", false], [5413, 0.003568, " methods", false], [5980, 0.002035, "-based", false], [4421, 0.001439, "---", false]]]}, "raw_delta": 0.1446627825498581, "tuned_delta": 0.15147506035695604}, {"byte_start": 5526, "byte_end": 5535, "display": {"text": " learning", "kind": "normal"}, "is_word": true, "word_id": 930, "word_key": " learning", "bytes_hex": "20 6c 65 61 72 6e 69 6e 67", "compression": {"rwkv": "0.94% 0.94% 0.94% 0.94% 0.94% 0.94% 0.94% 0.94% 0.94%", "qwen": "0.42% 0.42% 0.42% 0.42% 0.42% 0.42% 0.42% 0.42% 0.42%"}, "model_tokens": {"rwkv": [[56537, " learning", "normal", 0.6259421110153198]], "qwen": [[6832, " learning", "normal", 0.8108955025672913]]}, "loss": {"rwkv": 0.9353410231457849, "qwen": 0.4200167166734307}, "topk": {"rwkv": [56537, 1, 0.6259421110153198, [[56537, 0.625942, " learning", false], [48, 0.146653, "/", false], [4450, 0.076676, " by", false], [38888, 0.017778, " lever", false], [31978, 0.017546, " self", false], [56540, 0.007821, " leverage", false], [45, 0.00769, ",", false], [63885, 0.007332, " statistical", false], [62577, 0.006025, " statistics", false], [22590, 0.005483, " the", false]]], "qwen": [6832, 1, 0.8108955025672913, [[6832, 0.810896, " learning", false], [5144, 0.053234, "/or", false], [553, 0.026637, " by", false], [76482, 0.009203, " leveraging", false], [389, 0.00778, " on", false], [5538, 0.007117, " deep", false], [5662, 0.006245, " machine", false], [1008, 0.004239, " other", false], [656, 0.004126, " self", false], [1221, 0.004103, " then", false]]]}, "raw_delta": 0.028575647208425734, "tuned_delta": 0.03538792501552368}, {"byte_start": 5535, "byte_end": 5536, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "9.16%", "qwen": "10.93%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.5960796475410461]], "qwen": [[13, ".", "normal", 0.5454769134521484]]}, "loss": {"rwkv": 9.157732193142833, "qwen": 10.930124124115569}, "topk": {"rwkv": [47, 1, 0.5960796475410461, [[47, 0.59608, ".", false], [45, 0.180868, ",", false], [5346, 0.051828, "---", false], [4450, 0.037889, " by", false], [21265, 0.024873, " and", false], [275, 0.019384, " (", false], [4596, 0.00956, " in", false], [47001, 0.007583, " rather", false], [4811, 0.006358, " to", false], [4712, 0.004398, " on", false]]], "qwen": [13, 1, 0.5454769134521484, [[13, 0.545477, ".", false], [382, 0.178999, ".\n\n", false], [11, 0.11097, ",", false], [320, 0.025356, " (", false], [624, 0.016818, ".\n", false], [5413, 0.016496, " methods", false], [4421, 0.014729, "---", false], [323, 0.010313, " and", false], [12538, 0.008433, " techniques", false], [4751, 0.006221, " rather", false]]]}, "raw_delta": -0.09828227758407593, "tuned_delta": -0.09146999977697798}, {"byte_start": 5536, "byte_end": 5540, "display": {"text": " The", "kind": "normal"}, "is_word": true, "word_id": 931, "word_key": " the", "bytes_hex": "20 54 68 65", "compression": {"rwkv": "11.69% 11.69% 11.69% 11.69%", "qwen": "8.76% 8.76% 8.76% 8.76%"}, "model_tokens": {"rwkv": [[20996, " The", "normal", 0.07707926630973816]], "qwen": [[576, " The", "normal", 0.14312496781349182]]}, "loss": {"rwkv": 11.693719569705465, "qwen": 8.76454008228244}, "topk": {"rwkv": [20996, 2, 0.07707926630973816, [[261, 0.518138, "\n\n", false], [20996, 0.077079, " The", false], [267, 0.044123, "  ", false], [29894, 0.041145, " This", false], [4331, 0.031341, " We", false], [3913, 0.018932, " In", false], [3918, 0.018053, " It", false], [37453, 0.016947, " These", false], [0, 0.011522, "[0]", false], [4255, 0.009218, " To", false]]], "qwen": [576, 2, 0.14312496781349182, [[220, 0.151022, " ", false], [576, 0.143125, " The", false], [1096, 0.06928, " This", false], [1205, 0.054866, " We", false], [1084, 0.044859, " It", false], [4220, 0.043008, " These", false], [758, 0.041557, " In", false], [2014, 0.022343, " To", false], [2619, 0.02132, " There", false], [1634, 0.01157, " As", false]]]}, "raw_delta": 0.16242820024490356, "tuned_delta": 0.16924047805200151}, {"byte_start": 5540, "byte_end": 5549, "display": {"text": " eventual", "kind": "normal"}, "is_word": true, "word_id": 932, "word_key": " eventual", "bytes_hex": "20 65 76 65 6e 74 75 61 6c", "compression": {"rwkv": "16.41% 16.41% 16.41% 16.41% 16.41% 16.41% 16.41% 16.41% 16.41%", "qwen": "14.95% 14.95% 14.95% 14.95% 14.95% 14.95% 14.95% 14.95% 14.95%"}, "model_tokens": {"rwkv": [[56154, " eventual", "normal", 0.0002758874325081706]], "qwen": [[41735, " eventual", "normal", 0.0005762152140960097]]}, "loss": {"rwkv": 16.405646732331093, "qwen": 14.945978379663178}, "topk": {"rwkv": [56154, 339, 0.0002758874325081706, [[45315, 0.215287, " bitter", false], [46430, 0.091631, " lesson", false], [47009, 0.022974, " reason", false], [21952, 0.020128, " key", false], [45184, 0.019976, " appeal", false], [52127, 0.017456, " lessons", false], [38499, 0.013913, " first", false], [31461, 0.012977, " most", false], [46405, 0.012925, " latter", false], [21357, 0.010807, " big", false]]], "qwen": [41735, 191, 0.0005762152140960097, [[25180, 0.315766, " bitter", false], [17755, 0.034954, " lesson", false], [78996, 0.024005, " bitterness", false], [1376, 0.015684, " key", false], [1429, 0.014092, " most", false], [1156, 0.013176, " first", false], [1172, 0.011851, " only", false], [2874, 0.009096, " reason", false], [1293, 0.00799, " long", false], [1537, 0.007683, " last", false]]]}, "raw_delta": 0.08094120025634766, "tuned_delta": 0.0877534780634456}, {"byte_start": 5549, "byte_end": 5557, "display": {"text": " success", "kind": "normal"}, "is_word": true, "word_id": 933, "word_key": " success", "bytes_hex": "20 73 75 63 63 65 73 73", "compression": {"rwkv": "4.72% 4.72% 4.72% 4.72% 4.72% 4.72% 4.72% 4.72%", "qwen": "7.22% 7.22% 7.22% 7.22% 7.22% 7.22% 7.22% 7.22%"}, "model_tokens": {"rwkv": [[53052, " success", "normal", 0.12446437031030655]], "qwen": [[2393, " success", "normal", 0.04058763012290001]]}, "loss": {"rwkv": 4.719754284158229, "qwen": 7.22314987349079}, "topk": {"rwkv": [53052, 1, 0.12446437031030655, [[53052, 0.124464, " success", false], [64266, 0.096241, " breakthrough", false], [57260, 0.037867, " solution", false], [7933, 0.028496, "ity", false], [47798, 0.026838, " winner", false], [56950, 0.02561, " progress", false], [53198, 0.024814, " triumph", false], [46430, 0.018522, " lesson", false], [47092, 0.018278, " result", false], [53283, 0.017192, " victory", false]]], "qwen": [2393, 4, 0.04058763012290001, [[41345, 0.226281, " breakthrough", false], [5486, 0.093374, " approach", false], [37486, 0.045089, " triumph", false], [2393, 0.040588, " success", false], [5098, 0.026488, " progress", false], [18647, 0.015863, " arrival", false], [13632, 0.015807, " winner", false], [15274, 0.014492, " outcome", false], [48079, 0.012363, " emergence", false], [12560, 0.011613, " victory", false]]]}, "raw_delta": -0.13881772756576538, "tuned_delta": -0.13200544975866743}, {"byte_start": 5557, "byte_end": 5560, "display": {"text": " is", "kind": "normal"}, "is_word": true, "word_id": 934, "word_key": " is", "bytes_hex": "20 69 73", "compression": {"rwkv": "17.00% 17.00% 17.00%", "qwen": "18.80% 18.80% 18.80%"}, "model_tokens": {"rwkv": [[4600, " is", "normal", 0.058833371847867966]], "qwen": [[374, " is", "normal", 0.04383223131299019]]}, "loss": {"rwkv": 17.000507968808748, "qwen": 18.799433598134907}, "topk": {"rwkv": [4600, 2, 0.058833371847867966, [[4706, 0.779352, " of", false], [4600, 0.058833, " is", false], [4596, 0.039236, " in", false], [38087, 0.012085, " comes", false], [45, 0.007552, ",", false], [51434, 0.006819, " depends", false], [22748, 0.005982, " was", false], [21800, 0.005771, " has", false], [32475, 0.005468, " will", false], [4450, 0.004753, " by", false]]], "qwen": [374, 3, 0.04383223131299019, [[315, 0.707315, " of", false], [304, 0.068246, " in", false], [374, 0.043832, " is", false], [702, 0.016581, " has", false], [553, 0.014604, " by", false], [572, 0.013944, " was", false], [429, 0.013445, " that", false], [448, 0.01158, " with", false], [11, 0.009154, ",", false], [4041, 0.008134, " comes", false]]]}, "raw_delta": -0.09975361824035633, "tuned_delta": -0.09294134043325838}, {"byte_start": 5560, "byte_end": 5565, "display": {"text": " ting", "kind": "normal"}, "is_word": true, "word_id": 935, "word_key": " ting", "bytes_hex": "20 74 69 6e 67", "compression": {"rwkv": "49.14% 49.14% 49.14% 49.14% 49.14%", "qwen": "39.10% 39.10% 39.10% 39.10% 39.10%"}, "model_tokens": {"rwkv": [[32252, " ting", "normal", 1.214848907693522e-06]], "qwen": [[42227, " ting", "normal", 1.9561890439945273e-05]]}, "loss": {"rwkv": 49.14179983028031, "qwen": 39.103987697183264}, "topk": {"rwkv": [32252, 4627, 1.214848907693522e-06, [[22187, 0.146218, " not", false], [37810, 0.113287, " based", false], [45150, 0.071532, " always", false], [21572, 0.055513, " due", false], [332, 0.044743, " a", false], [22590, 0.036943, " the", false], [39171, 0.016711, " often", false], [4596, 0.016548, " in", false], [62109, 0.016129, " inevitable", false], [4450, 0.013903, " by", false]]], "qwen": [42227, 1268, 1.9561890439945273e-05, [[3118, 0.144691, " based", false], [537, 0.08893, " not", false], [4152, 0.060983, " due", false], [2677, 0.049161, " always", false], [264, 0.041665, " a", false], [3545, 0.040587, " often", false], [16994, 0.029664, " achieved", false], [553, 0.027469, " by", false], [279, 0.026745, " the", false], [304, 0.019998, " in", false]]]}, "raw_delta": 0.5566144943237306, "tuned_delta": 0.5634267721308285}, {"byte_start": 5565, "byte_end": 5567, "display": {"text": "ed", "kind": "normal"}, "is_word": true, "word_id": 936, "word_key": "ed", "bytes_hex": "65 64", "compression": {"rwkv": "0.01% 0.01%", "qwen": "0.01% 0.01%"}, "model_tokens": {"rwkv": [[1843, "ed", "normal", 0.9994226694107056]], "qwen": [[291, "ed", "normal", 0.9991808533668518]]}, "loss": {"rwkv": 0.005228272586229382, "qwen": 0.007389000931368411}, "topk": {"rwkv": [1843, 1, 0.9994226694107056, [[1843, 0.999423, "ed", false], [25206, 9.8e-05, "eing", false], [1858, 8.3e-05, "es", false], [7856, 8.3e-05, "ing", false], [102, 7.3e-05, "e", false], [8067, 7.2e-05, "led", false], [2030, 2.4e-05, "ly", false], [101, 1.8e-05, "d", false], [26151, 1.3e-05, "ling", false], [7612, 1.3e-05, "ged", false]]], "qwen": [291, 1, 0.9991808533668518, [[291, 0.999181, "ed", false], [2718, 0.000341, "ling", false], [832, 0.000193, "led", false], [3556, 4.4e-05, "ged", false], [75, 2.1e-05, "l", false], [1151, 1.4e-05, "red", false], [12336, 1.2e-05, "ered", false], [3018, 1.2e-05, "ored", false], [3260, 9e-06, "ued", false], [2181, 8e-06, "iled", false]]]}, "raw_delta": -0.00011981622083112597, "tuned_delta": 0.006692461586266821}, {"byte_start": 5567, "byte_end": 5572, "display": {"text": " with", "kind": "normal"}, "is_word": true, "word_id": 937, "word_key": " with", "bytes_hex": "20 77 69 74 68", "compression": {"rwkv": "0.49% 0.49% 0.49% 0.49% 0.49%", "qwen": "0.47% 0.47% 0.47% 0.47% 0.47%"}, "model_tokens": {"rwkv": [[32487, " with", "normal", 0.8731797337532043]], "qwen": [[448, " with", "normal", 0.8772037029266357]]}, "loss": {"rwkv": 0.48958645186417454, "qwen": 0.47254039142390725}, "topk": {"rwkv": [32487, 1, 0.8731797337532043, [[32487, 0.87318, " with", false], [4450, 0.094979, " by", false], [45, 0.009868, ",", false], [4596, 0.006063, " in", false], [57263, 0.002079, " somewhat", false], [332, 0.001745, " a", false], [57245, 0.00113, " slightly", false], [22187, 0.001038, " not", false], [4706, 0.00091, " of", false], [30322, 0.000733, " both", false]]], "qwen": [448, 1, 0.8772037029266357, [[448, 0.877204, " with", false], [553, 0.096491, " by", false], [11, 0.009353, ",", false], [304, 0.002796, " in", false], [264, 0.001064, " a", false], [537, 0.001013, " not", false], [14400, 0.000839, " somewhat", false], [315, 0.000753, " of", false], [311, 0.000588, " to", false], [320, 0.000395, " (", false]]]}, "raw_delta": 0.0009452342987060561, "tuned_delta": 0.007757512105804003}, {"byte_start": 5572, "byte_end": 5583, "display": {"text": " bitterness", "kind": "normal"}, "is_word": true, "word_id": 938, "word_key": " bitterness", "bytes_hex": "20 62 69 74 74 65 72 6e 65 73 73", "compression": {"rwkv": "4.30% 4.30% 4.30% 4.30% 4.30% 4.30% 4.30% 4.30% 4.30% 4.30% 4.30%", "qwen": "1.50% 1.50% 1.50% 1.50% 1.50% 1.50% 1.50% 1.50% 1.50% 1.50% 1.50%"}, "model_tokens": {"rwkv": [[61640, " bitterness", "normal", 0.07246692478656769]], "qwen": [[78996, " bitterness", "normal", 0.40061235427856445]]}, "loss": {"rwkv": 4.303493729924466, "qwen": 1.4996831456310211}, "topk": {"rwkv": [61640, 4, 0.07246692478656769, [[332, 0.145198, " a", false], [22590, 0.103055, " the", false], [52793, 0.088475, " sadness", false], [61640, 0.072467, " bitterness", false], [38805, 0.064923, " irony", false], [45315, 0.063263, " bitter", false], [53178, 0.057606, " tragedy", false], [47048, 0.057172, " regret", false], [65126, 0.050159, " disappointment", false], [63588, 0.031111, " frustration", false]]], "qwen": [78996, 1, 0.40061235427856445, [[78996, 0.400612, " bitterness", false], [50878, 0.184147, " sadness", false], [22231, 0.077142, " regret", false], [264, 0.058002, " a", false], [25180, 0.050059, " bitter", false], [279, 0.027139, " the", false], [50605, 0.026256, " irony", false], [40598, 0.02382, " disappointment", false], [57496, 0.012962, " sorrow", false], [86063, 0.007106, " melanch", false]]]}, "raw_delta": 0.15547627210617065, "tuned_delta": 0.1622885499132686}, {"byte_start": 5583, "byte_end": 5584, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "18.60%", "qwen": "22.51%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.3615263104438782]], "qwen": [[11, ",", "normal", 0.28709185123443604]]}, "loss": {"rwkv": 18.597240761459293, "qwen": 22.50519823744862}, "topk": {"rwkv": [45, 1, 0.3615263104438782, [[45, 0.361526, ",", false], [51018, 0.22655, " because", false], [21700, 0.106693, " for", false], [47, 0.056001, ".", false], [5346, 0.031248, "---", false], [21265, 0.028214, " and", false], [4423, 0.026388, " as", false], [4596, 0.022106, " in", false], [59, 0.018258, ":", false], [32227, 0.016988, " that", false]]], "qwen": [11, 2, 0.28709185123443604, [[1576, 0.375146, " because", false], [11, 0.287092, ",", false], [553, 0.066923, " by", false], [13, 0.044343, ".", false], [369, 0.032616, " for", false], [323, 0.026326, " and", false], [438, 0.023125, " as", false], [382, 0.015253, ".\n\n", false], [518, 0.013712, " at", false], [304, 0.013023, " in", false]]]}, "raw_delta": -0.21670317649841309, "tuned_delta": -0.20989089869131514}, {"byte_start": 5584, "byte_end": 5588, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 939, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"rwkv": "12.82% 12.82% 12.82% 12.82%", "qwen": "9.34% 9.34% 9.34% 9.34%"}, "model_tokens": {"rwkv": [[21265, " and", "normal", 0.057391051203012466]], "qwen": [[323, " and", "normal", 0.1260937601327896]]}, "loss": {"rwkv": 12.820825070399966, "qwen": 9.335722412978594}, "topk": {"rwkv": [21265, 4, 0.057391051203012466, [[21400, 0.309516, " but", false], [51018, 0.286315, " because", false], [4423, 0.154445, " as", false], [21265, 0.057391, " and", false], [21700, 0.026413, " for", false], [4596, 0.023379, " in", false], [39690, 0.016109, " since", false], [22187, 0.014858, " not", false], [40186, 0.007831, " which", false], [22590, 0.007535, " the", false]]], "qwen": [323, 3, 0.1260937601327896, [[1576, 0.302206, " because", false], [438, 0.175248, " as", false], [323, 0.126094, " and", false], [714, 0.084405, " but", false], [369, 0.046944, " for", false], [537, 0.036781, " not", false], [2474, 0.03465, " since", false], [892, 0.015301, " which", false], [304, 0.013924, " in", false], [773, 0.010399, " so", false]]]}, "raw_delta": 0.19325512647628784, "tuned_delta": 0.2000674042833858}, {"byte_start": 5588, "byte_end": 5594, "display": {"text": " often", "kind": "normal"}, "is_word": true, "word_id": 940, "word_key": " often", "bytes_hex": "20 6f 66 74 65 6e", "compression": {"rwkv": "15.12% 15.12% 15.12% 15.12% 15.12% 15.12%", "qwen": "11.66% 11.66% 11.66% 11.66% 11.66% 11.66%"}, "model_tokens": {"rwkv": [[39171, " often", "normal", 0.006607616785913706]], "qwen": [[3545, " often", "normal", 0.020638203248381615]]}, "loss": {"rwkv": 15.121998800984576, "qwen": 11.663622605804472}, "topk": {"rwkv": [39171, 22, 0.006607616785913706, [[22590, 0.16801, " the", false], [4601, 0.082448, " it", false], [4600, 0.066655, " is", false], [4858, 0.065325, " we", false], [32234, 0.049426, " this", false], [32227, 0.028576, " that", false], [63843, 0.024322, " researchers", false], [39934, 0.021166, " there", false], [4788, 0.018938, " so", false], [22797, 0.01875, " yet", false]]], "qwen": [3545, 9, 0.020638203248381615, [[279, 0.181648, " the", false], [419, 0.066944, " this", false], [432, 0.062067, " it", false], [374, 0.05647, " is", false], [582, 0.040288, " we", false], [429, 0.040272, " that", false], [773, 0.023409, " so", false], [264, 0.021673, " a", false], [3545, 0.020638, " often", false], [304, 0.019978, " in", false]]]}, "raw_delta": 0.19177309672037757, "tuned_delta": 0.19858537452747552}, {"byte_start": 5594, "byte_end": 5607, "display": {"text": " incompletely", "kind": "normal"}, "is_word": true, "word_id": 941, "word_key": " incompletely", "bytes_hex": "20 69 6e 63 6f 6d 70 6c 65 74 65 6c 79", "compression": {"rwkv": "12.45% 12.45% 12.45% 12.45% 12.45% 12.45% 12.45% 12.45% 12.45% 12.45% 12.45% 14.79% 14.79%", "qwen": "25.61% 25.61% 25.61% 25.61% 25.61% 25.61% 10.83% 10.83% 10.83% 10.83% 10.83% 10.83% 10.83%"}, "model_tokens": {"rwkv": [[62091, " incomplete", "normal", 0.0004967009299434721], [2030, "ly", "normal", 0.19108188152313232]], "qwen": [[52890, " incom", "normal", 0.00019925166270695627], [49168, "pletely", "normal", 0.014954663813114166]]}, "loss": {"rwkv": 12.809987517508672, "qwen": 17.650366464151663}, "topk": {"rwkv": [62091, 203, 0.0004967009299434721, [[32487, 0.073275, " with", false], [22590, 0.067255, " the", false], [56501, 0.044113, " involves", false], [4600, 0.034168, " is", false], [4601, 0.028739, " it", false], [332, 0.027073, " a", false], [38087, 0.021295, " comes", false], [39934, 0.021103, " there", false], [57102, 0.020288, " requires", false], [38875, 0.0196, " leads", false]]], "qwen": [52890, 448, 0.00019925166270695627, [[448, 0.113979, " with", false], [279, 0.073731, " the", false], [374, 0.044957, " is", false], [23943, 0.031305, " accompanied", false], [4041, 0.030687, " comes", false], [432, 0.024818, " it", false], [11811, 0.020573, " researchers", false], [264, 0.018769, " a", false], [11508, 0.015304, " leads", false], [17601, 0.013093, " involves", false]]]}, "raw_delta": -0.2684076015765851, "tuned_delta": -0.2615953237694872}, {"byte_start": 5607, "byte_end": 5616, "display": {"text": " digested", "kind": "normal"}, "is_word": true, "word_id": 942, "word_key": " digested", "bytes_hex": "20 64 69 67 65 73 74 65 64", "compression": {"rwkv": "18.28% 18.28% 18.28% 18.28% 18.28% 18.28% 18.28% 0.04% 0.04%", "qwen": "40.72% 40.72% 40.72% 40.72% 0.00% 0.00% 0.00% 0.00% 0.00%"}, "model_tokens": {"rwkv": [[45746, " digest", "normal", 0.0008220847230404615], [1843, "ed", "normal", 0.9958569407463074]], "qwen": [[4078, " dig", "normal", 0.00011939474643440917], [9980, "ested", "normal", 0.9998053908348083]]}, "loss": {"rwkv": 14.222307870444311, "qwen": 18.100352509323848}, "topk": {"rwkv": [45746, 45, 0.0008220847230404615, [[62684, 0.481108, " understood", false], [63289, 0.248035, " appreciated", false], [62438, 0.06116, " recognized", false], [64238, 0.033001, " acknowledged", false], [57027, 0.01562, " realized", false], [55428, 0.013286, " accepted", false], [38625, 0.007311, " grasp", false], [59684, 0.00563, " explained", false], [56098, 0.005587, " embraced", false], [52112, 0.005136, " learned", false]]], "qwen": [4078, 214, 0.00011939474643440917, [[15985, 0.482853, " understood", false], [25498, 0.044029, " acknowledged", false], [9498, 0.037975, " learned", false], [14975, 0.036413, " recognized", false], [25808, 0.033701, " appreciated", false], [11247, 0.031423, " explained", false], [773, 0.02678, " so", false], [15043, 0.024798, " realized", false], [34416, 0.021106, " justified", false], [26471, 0.019687, " remembered", false]]]}, "raw_delta": -0.21504445660199661, "tuned_delta": -0.20823217879489866}, {"byte_start": 5616, "byte_end": 5617, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "17.12%", "qwen": "27.08%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.38460394740104675]], "qwen": [[11, ",", "normal", 0.22278772294521332]]}, "loss": {"rwkv": 17.11791479179776, "qwen": 27.07822767280638}, "topk": {"rwkv": [45, 1, 0.38460394740104675, [[45, 0.384604, ",", false], [4450, 0.226197, " by", false], [47, 0.203053, ".", false], [4596, 0.022458, " in", false], [5346, 0.019713, "---", false], [21265, 0.017436, " and", false], [40076, 0.010587, " until", false], [4423, 0.010322, " as", false], [4424, 0.010115, " at", false], [32465, 0.009335, " when", false]]], "qwen": [11, 2, 0.22278772294521332, [[553, 0.285165, " by", false], [11, 0.222788, ",", false], [13, 0.206131, ".", false], [382, 0.079159, ".\n\n", false], [304, 0.021819, " in", false], [518, 0.019729, " at", false], [323, 0.017123, " and", false], [369, 0.011375, " for", false], [438, 0.010354, " as", false], [476, 0.010326, " or", false]]]}, "raw_delta": -0.5523170232772827, "tuned_delta": -0.5455047454701848}, {"byte_start": 5617, "byte_end": 5625, "display": {"text": " because", "kind": "normal"}, "is_word": true, "word_id": 943, "word_key": " because", "bytes_hex": "20 62 65 63 61 75 73 65", "compression": {"rwkv": "3.38% 3.38% 3.38% 3.38% 3.38% 3.38% 3.38% 3.38%", "qwen": "3.01% 3.01% 3.01% 3.01% 3.01% 3.01% 3.01% 3.01%"}, "model_tokens": {"rwkv": [[51018, " because", "normal", 0.2244386374950409]], "qwen": [[1576, " because", "normal", 0.26296961307525635]]}, "loss": {"rwkv": 3.3813165020835076, "qwen": 3.0109873348721896}, "topk": {"rwkv": [51018, 2, 0.2244386374950409, [[21400, 0.367675, " but", false], [51018, 0.224439, " because", false], [4423, 0.092419, " as", false], [4450, 0.04888, " by", false], [21265, 0.042396, " and", false], [21700, 0.028623, " for", false], [4596, 0.019392, " in", false], [4788, 0.01837, " so", false], [40076, 0.013526, " until", false], [30788, 0.012168, " even", false]]], "qwen": [1576, 1, 0.26296961307525635, [[1576, 0.26297, " because", false], [714, 0.15885, " but", false], [438, 0.139906, " as", false], [323, 0.089964, " and", false], [553, 0.056858, " by", false], [369, 0.040796, " for", false], [773, 0.025334, " so", false], [2474, 0.021178, " since", false], [304, 0.01481, " in", false], [1496, 0.012878, " even", false]]]}, "raw_delta": 0.020535409450531006, "tuned_delta": 0.027347687257628952}, {"byte_start": 5625, "byte_end": 5628, "display": {"text": " it", "kind": "normal"}, "is_word": true, "word_id": 944, "word_key": " it", "bytes_hex": "20 69 74", "compression": {"rwkv": "10.10% 10.10% 10.10%", "qwen": "9.17% 9.17% 9.17%"}, "model_tokens": {"rwkv": [[4601, " it", "normal", 0.187827929854393]], "qwen": [[432, " it", "normal", 0.2176695615053177]]}, "loss": {"rwkv": 10.09698677705492, "qwen": 9.165785280769484}, "topk": {"rwkv": [4601, 2, 0.187827929854393, [[22590, 0.318348, " the", false], [4601, 0.187828, " it", false], [4858, 0.087823, " we", false], [4706, 0.086161, " of", false], [63843, 0.047376, " researchers", false], [284, 0.026062, " 1", false], [39934, 0.015829, " there", false], [46787, 0.010831, " people", false], [4596, 0.010242, " in", false], [332, 0.009424, " a", false]]], "qwen": [432, 2, 0.2176695615053177, [[279, 0.285832, " the", false], [432, 0.21767, " it", false], [315, 0.098557, " of", false], [11811, 0.038652, " researchers", false], [582, 0.033831, " we", false], [220, 0.029431, " ", false], [1052, 0.021834, " there", false], [304, 0.018553, " in", false], [11, 0.010721, ",", false], [1429, 0.00928, " most", false]]]}, "raw_delta": 0.051636775334676144, "tuned_delta": 0.05844905314177409}, {"byte_start": 5628, "byte_end": 5631, "display": {"text": " is", "kind": "normal"}, "is_word": true, "word_id": 945, "word_key": " is", "bytes_hex": "20 69 73", "compression": {"rwkv": "7.09% 7.09% 7.09%", "qwen": "7.18% 7.18% 7.18%"}, "model_tokens": {"rwkv": [[4600, " is", "normal", 0.3049885034561157]], "qwen": [[374, " is", "normal", 0.3027406334877014]]}, "loss": {"rwkv": 7.0913721085362456, "qwen": 7.182690596578126}, "topk": {"rwkv": [4600, 1, 0.3049885034561157, [[4600, 0.304989, " is", false], [22748, 0.062991, " was", false], [30659, 0.060783, " does", false], [21800, 0.035801, " has", false], [38087, 0.033634, " comes", false], [56501, 0.032503, " involves", false], [39888, 0.029616, " takes", false], [57102, 0.026581, " requires", false], [39620, 0.023651, " seems", false], [31908, 0.013796, " runs", false]]], "qwen": [374, 1, 0.3027406334877014, [[374, 0.302741, " is", false], [4041, 0.105995, " comes", false], [29682, 0.065926, " arrives", false], [1558, 0.04941, " does", false], [572, 0.02891, " was", false], [7460, 0.028253, " requires", false], [4990, 0.026667, " takes", false], [702, 0.020119, " has", false], [8573, 0.015152, " happens", false], [3697, 0.012295, " came", false]]]}, "raw_delta": -0.005063772201538086, "tuned_delta": 0.001748505605559861}, {"byte_start": 5631, "byte_end": 5639, "display": {"text": " success", "kind": "normal"}, "is_word": true, "word_id": 946, "word_key": " success", "bytes_hex": "20 73 75 63 63 65 73 73", "compression": {"rwkv": "22.26% 22.26% 22.26% 22.26% 22.26% 22.26% 22.26% 22.26%", "qwen": "22.30% 22.30% 22.30% 22.30% 22.30% 22.30% 22.30% 22.30%"}, "model_tokens": {"rwkv": [[53052, " success", "normal", 5.098820838611573e-05]], "qwen": [[2393, " success", "normal", 5.052114283898845e-05]]}, "loss": {"rwkv": 22.260333638716425, "qwen": 22.301177368513205}, "topk": {"rwkv": [53052, 726, 5.098820838611573e-05, [[22187, 0.142353, " not", false], [4788, 0.104589, " so", false], [332, 0.082359, " a", false], [45315, 0.054789, " bitter", false], [31048, 0.053604, " hard", false], [22590, 0.045219, " the", false], [51336, 0.040799, " counter", false], [37810, 0.031194, " based", false], [59516, 0.022433, " difficult", false], [31968, 0.019994, " seen", false]]], "qwen": [2393, 891, 5.052114283898845e-05, [[537, 0.12214, " not", false], [264, 0.085189, " a", false], [3118, 0.077157, " based", false], [773, 0.071189, " so", false], [279, 0.042447, " the", false], [3545, 0.025751, " often", false], [5546, 0.024856, " counter", false], [2238, 0.022544, " too", false], [2588, 0.021346, " hard", false], [16500, 0.017735, " unexpected", false]]]}, "raw_delta": -0.002264857292175293, "tuned_delta": 0.004547420514922654}, {"byte_start": 5639, "byte_end": 5644, "display": {"text": " over", "kind": "normal"}, "is_word": true, "word_id": 947, "word_key": " over", "bytes_hex": "20 6f 76 65 72", "compression": {"rwkv": "22.32% 22.32% 22.32% 22.32% 22.32%", "qwen": "14.60% 14.60% 14.60% 14.60% 14.60%"}, "model_tokens": {"rwkv": [[31601, " over", "normal", 0.0020557441748678684]], "qwen": [[916, " over", "normal", 0.01744821108877659]]}, "loss": {"rwkv": 22.31668891375115, "qwen": 14.601942756142542}, "topk": {"rwkv": [31601, 40, 0.0020557441748678684, [[37810, 0.13049, " based", false], [32227, 0.120944, " that", false], [4596, 0.083542, " in", false], [4450, 0.067594, " by", false], [37634, 0.051811, " after", false], [4424, 0.046853, " at", false], [31581, 0.042302, " only", false], [50870, 0.040711, " against", false], [55437, 0.03728, " achieved", false], [53140, 0.035696, " through", false]]], "qwen": [916, 14, 0.01744821108877659, [[304, 0.155545, " in", false], [429, 0.120506, " that", false], [518, 0.07092, " at", false], [2348, 0.067026, " against", false], [553, 0.062182, " by", false], [16994, 0.051364, " achieved", false], [3118, 0.048459, " based", false], [315, 0.036886, " of", false], [1283, 0.032752, " after", false], [369, 0.032327, " for", false]]]}, "raw_delta": 0.4277963638305664, "tuned_delta": 0.43460864163766433}, {"byte_start": 5644, "byte_end": 5646, "display": {"text": " a", "kind": "normal"}, "is_word": true, "word_id": 948, "word_key": " a", "bytes_hex": "20 61", "compression": {"rwkv": "12.26% 12.26%", "qwen": "10.54% 10.54%"}, "model_tokens": {"rwkv": [[332, " a", "normal", 0.2538456320762634]], "qwen": [[264, " a", "normal", 0.3108728528022766]]}, "loss": {"rwkv": 12.257272320052715, "qwen": 10.535021930939031}, "topk": {"rwkv": [332, 1, 0.2538456320762634, [[332, 0.253846, " a", false], [22590, 0.171898, " the", false], [38720, 0.081272, " human", false], [4419, 0.052716, " an", false], [60522, 0.027063, " something", false], [32464, 0.022242, " what", false], [32251, 0.020702, " time", false], [59943, 0.018091, " knowledge", false], [51396, 0.013326, " decades", false], [22226, 0.01315, " one", false]]], "qwen": [264, 1, 0.3108728528022766, [[264, 0.310873, " a", false], [279, 0.133102, " the", false], [458, 0.105017, " an", false], [10793, 0.034139, " decades", false], [1128, 0.025159, " what", false], [882, 0.023667, " time", false], [1657, 0.022911, " many", false], [2494, 0.017569, " something", false], [892, 0.015761, " which", false], [3738, 0.012052, " human", false]]]}, "raw_delta": 0.0955018401145935, "tuned_delta": 0.10231411792169146}, {"byte_start": 5646, "byte_end": 5654, "display": {"text": " favored", "kind": "normal"}, "is_word": true, "word_id": 949, "word_key": " favored", "bytes_hex": "20 66 61 76 6f 72 65 64", "compression": {"rwkv": "23.67% 23.67% 23.67% 23.67% 23.67% 23.67% 23.67% 23.67%", "qwen": "23.85% 23.85% 23.85% 23.85% 23.85% 23.85% 23.85% 23.85%"}, "model_tokens": {"rwkv": [[51722, " favored", "normal", 2.7700531063601375e-05]], "qwen": [[45503, " favored", "normal", 2.53817252087174e-05]]}, "loss": {"rwkv": 23.669215514584554, "qwen": 23.852890835922896}, "topk": {"rwkv": [51722, 1001, 2.7700531063601375e-05, [[31323, 0.303219, " long", false], [46470, 0.096108, " longer", false], [32386, 0.083106, " very", false], [31466, 0.080297, " much", false], [38864, 0.01588, " large", false], [47708, 0.014281, " vastly", false], [31118, 0.013727, " huge", false], [62471, 0.013389, " relatively", false], [46397, 0.011481, " larger", false], [38720, 0.011196, " human", false]]], "qwen": [45503, 1111, 2.53817252087174e-05, [[1293, 0.219826, " long", false], [1602, 0.085832, " very", false], [1753, 0.078482, " much", false], [4168, 0.072124, " period", false], [882, 0.056071, " time", false], [5021, 0.048234, " longer", false], [2155, 0.021774, " different", false], [12767, 0.011735, " vast", false], [1714, 0.010897, " method", false], [3460, 0.010863, " large", false]]]}, "raw_delta": -0.0101851224899292, "tuned_delta": -0.0033728446828312523}, {"byte_start": 5654, "byte_end": 5655, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "64.53%", "qwen": "59.41%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.02833106368780136]], "qwen": [[11, ",", "normal", 0.03708159551024437]]}, "loss": {"rwkv": 64.52678991476027, "qwen": 59.41441213738106}, "topk": {"rwkv": [45, 5, 0.02833106368780136, [[55532, 0.482477, " approach", false], [46561, 0.131459, " method", false], [22752, 0.039478, " way", false], [38720, 0.035731, " human", false], [45, 0.028331, ",", false], [21400, 0.028207, " but", false], [21265, 0.018529, " and", false], [57317, 0.016124, " strategy", false], [63277, 0.010291, " alternative", false], [60624, 0.009345, " technique", false]]], "qwen": [11, 3, 0.03708159551024437, [[5486, 0.512128, " approach", false], [1815, 0.046588, " path", false], [11, 0.037082, ",", false], [1714, 0.029168, " method", false], [323, 0.024596, " and", false], [1616, 0.019403, " way", false], [714, 0.014412, " but", false], [10555, 0.013887, " alternative", false], [2856, 0.013755, " initial", false], [2309, 0.013726, " position", false]]]}, "raw_delta": 0.2834904193878174, "tuned_delta": 0.2903026971949153}, {"byte_start": 5655, "byte_end": 5661, "display": {"text": " human", "kind": "normal"}, "is_word": true, "word_id": 950, "word_key": " human", "bytes_hex": "20 68 75 6d 61 6e", "compression": {"rwkv": "5.59% 5.59% 5.59% 5.59% 5.59% 5.59%", "qwen": "7.77% 7.77% 7.77% 7.77% 7.77% 7.77%"}, "model_tokens": {"rwkv": [[38720, " human", "normal", 0.15802103281021118]], "qwen": [[3738, " human", "normal", 0.07525920867919922]]}, "loss": {"rwkv": 5.588564774276908, "qwen": 7.774975198535144}, "topk": {"rwkv": [38720, 2, 0.15802103281021118, [[21400, 0.212901, " but", false], [38720, 0.158021, " human", false], [21265, 0.0711, " and", false], [56847, 0.047572, " personal", false], [39675, 0.029158, " short", false], [31323, 0.024263, " long", false], [47544, 0.019211, " though", false], [56205, 0.018433, " familiar", false], [45132, 0.017664, " albeit", false], [62309, 0.013444, " personally", false]]], "qwen": [3738, 2, 0.07525920867919922, [[714, 0.151215, " but", false], [3738, 0.075259, " human", false], [323, 0.063641, " and", false], [1293, 0.049341, " long", false], [3281, 0.018588, " special", false], [81044, 0.017409, " entrenched", false], [2805, 0.013023, " short", false], [4345, 0.011846, " personal", false], [15102, 0.011559, " initially", false], [4124, 0.011314, " early", false]]]}, "raw_delta": -0.12124033768971765, "tuned_delta": -0.1144280598826197}, {"byte_start": 5661, "byte_end": 5669, "display": {"text": "-centric", "kind": "normal"}, "is_word": true, "word_id": 951, "word_key": "-centric", "bytes_hex": "2d 63 65 6e 74 72 69 63", "compression": {"rwkv": "5.71% 8.09% 8.09% 8.09% 8.09% 8.09% 8.09% 8.09%", "qwen": "7.71% 7.71% 7.71% 7.71% 7.71% 7.71% 7.71% 7.71%"}, "model_tokens": {"rwkv": [[46, "-", "normal", 0.729418933391571], [48948, "centric", "normal", 0.0432516448199749]], "qwen": [[64424, "-centric", "normal", 0.032710764557123184]]}, "loss": {"rwkv": 7.792877875895585, "qwen": 7.709516810130813}, "topk": {"rwkv": [46, 1, 0.729418933391571, [[46, 0.729419, "-", false], [55532, 0.060391, " approach", false], [22752, 0.046, " way", false], [45, 0.03092, ",", false], [2030, 0.028869, "ly", false], [34864, 0.01389, "istic", false], [46561, 0.009892, " method", false], [65034, 0.008196, " understanding", false], [59943, 0.006551, " knowledge", false], [7919, 0.006261, "ist", false]]], "qwen": [64424, 4, 0.032710764557123184, [[12646, 0.578206, "-k", false], [49382, 0.05646, "-centered", false], [71107, 0.045622, "-under", false], [64424, 0.032711, "-centric", false], [12681, 0.023995, "-like", false], [35085, 0.021641, "-oriented", false], [6540, 0.017246, " knowledge", false], [5980, 0.016713, "-based", false], [12, 0.014339, "-", false], [3419, 0.010668, "-in", false]]]}, "raw_delta": 0.004622519016265883, "tuned_delta": 0.011434796823363829}, {"byte_start": 5669, "byte_end": 5678, "display": {"text": " approach", "kind": "normal"}, "is_word": true, "word_id": 952, "word_key": " approach", "bytes_hex": "20 61 70 70 72 6f 61 63 68", "compression": {"rwkv": "1.23% 1.23% 1.23% 1.23% 1.23% 1.23% 1.23% 1.23% 1.23%", "qwen": "1.34% 1.34% 1.34% 1.34% 1.34% 1.34% 1.34% 1.34% 1.34%"}, "model_tokens": {"rwkv": [[55532, " approach", "normal", 0.5463082790374756]], "qwen": [[5486, " approach", "normal", 0.5117776393890381]]}, "loss": {"rwkv": 1.2288580806183116, "qwen": 1.342237523767222}, "topk": {"rwkv": [55532, 1, 0.5463082790374756, [[55532, 0.546308, " approach", false], [45, 0.12535, ",", false], [46561, 0.061281, " method", false], [22752, 0.037185, " way", false], [32398, 0.036651, " view", false], [57317, 0.014534, " strategy", false], [46681, 0.012899, " notion", false], [63708, 0.009236, " methodology", false], [39043, 0.00805, " model", false], [56810, 0.008027, " paradigm", false]]], "qwen": [5486, 1, 0.5117776393890381, [[5486, 0.511778, " approach", false], [11, 0.194958, ",", false], [1651, 0.037037, " view", false], [1616, 0.025717, " way", false], [13057, 0.025309, " perspective", false], [11129, 0.017677, " vision", false], [1714, 0.013919, " method", false], [48240, 0.010254, " paradigm", false], [1614, 0.008498, " model", false], [42556, 0.006575, " conception", false]]]}, "raw_delta": -0.006287091308169901, "tuned_delta": 0.000525186498928046}, {"byte_start": 5678, "byte_end": 5680, "display": {"text": ".\n", "kind": "control"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e 0a", "compression": {"rwkv": "10.99% 9.72%", "qwen": "13.81% 13.81%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.5384615063667297], [261, "\n\n", "control", 0.34098631143569946]], "qwen": [[382, ".\n\n", "control", 0.10044247657060623]]}, "loss": {"rwkv": 10.355281787630743, "qwen": 13.814827464836712}, "topk": {"rwkv": [47, 1, 0.5384615063667297, [[47, 0.538462, ".", false], [45, 0.157105, ",", false], [32227, 0.153189, " that", false], [4811, 0.050192, " to", false], [21265, 0.016149, " and", false], [5346, 0.009527, "---", false], [47001, 0.009288, " rather", false], [60, 0.007531, ";", false], [4596, 0.007096, " in", false], [275, 0.005938, " (", false]]], "qwen": [382, 4, 0.10044247657060623, [[13, 0.279323, ".", false], [11, 0.207899, ",", false], [429, 0.159146, " that", false], [382, 0.100442, ".\n\n", false], [311, 0.059556, " to", false], [4421, 0.037203, "---", false], [323, 0.026511, " and", false], [4751, 0.016863, " rather", false], [3118, 0.014959, " based", false], [320, 0.011289, " (", false]]]}, "raw_delta": -0.1918379465738932, "tuned_delta": -0.18502566876679524}, {"byte_start": 5680, "byte_end": 5681, "display": {"text": "\n", "kind": "control"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "0a", "compression": {"rwkv": "9.72%", "qwen": "13.81%"}, "model_tokens": {"rwkv": [[261, "\n\n", "control", 0.34098631143569946]], "qwen": [[382, ".\n\n", "control", 0.10044247657060623]]}, "loss": {"rwkv": 9.721284943490085, "qwen": 13.814827464836712}, "topk": {"rwkv": [261, 1, 0.34098631143569946, [[261, 0.340986, "\n\n", false], [19555, 0.151825, " But", false], [20996, 0.085689, " The", false], [3918, 0.042795, " It", false], [29894, 0.039985, " This", false], [4331, 0.033291, " We", false], [267, 0.024923, "  ", false], [3913, 0.016929, " In", false], [0, 0.011039, "[0]", false], [19417, 0.010675, " And", false]]], "qwen": [382, 4, 0.10044247657060623, [[13, 0.279323, ".", false], [11, 0.207899, ",", false], [429, 0.159146, " that", false], [382, 0.100442, ".\n\n", false], [311, 0.059556, " to", false], [4421, 0.037203, "---", false], [323, 0.026511, " and", false], [4751, 0.016863, " rather", false], [3118, 0.014959, " based", false], [320, 0.011289, " (", false]]]}, "raw_delta": -0.2269941965738932, "tuned_delta": -0.22018191876679524}, {"byte_start": 5681, "byte_end": 5684, "display": {"text": "One", "kind": "normal"}, "is_word": true, "word_id": 953, "word_key": "one", "bytes_hex": "4f 6e 65", "compression": {"rwkv": "24.61% 24.61% 24.61%", "qwen": "25.47% 25.47% 25.47%"}, "model_tokens": {"rwkv": [[6393, "One", "normal", 0.016813155263662338]], "qwen": [[3966, "One", "normal", 0.014451012015342712]]}, "loss": {"rwkv": 24.60847009849664, "qwen": 25.46952417106141}, "topk": {"rwkv": [6393, 12, 0.016813155263662338, [[6699, 0.179398, "The", false], [1136, 0.062702, "In", false], [24242, 0.05548, "This", false], [33504, 0.043683, "There", false], [1589, 0.040733, "We", false], [66, 0.037632, "A", false], [1500, 0.033576, "To", false], [1141, 0.032114, "It", false], [74, 0.02581, "I", false], [24326, 0.020866, "What", false]]], "qwen": [3966, 12, 0.014451012015342712, [[785, 0.170455, "The", false], [1986, 0.064505, "This", false], [641, 0.054122, "In", false], [3862, 0.035957, "There", false], [2132, 0.034442, "It", false], [1654, 0.034082, "We", false], [32, 0.026993, "A", false], [1249, 0.026394, "To", false], [40, 0.018889, "I", false], [3983, 0.016479, "But", false]]]}, "raw_delta": -0.04774697621663426, "tuned_delta": -0.04093469840953631}, {"byte_start": 5684, "byte_end": 5690, "display": {"text": " thing", "kind": "normal"}, "is_word": true, "word_id": 954, "word_key": " thing", "bytes_hex": "20 74 68 69 6e 67", "compression": {"rwkv": "11.65% 11.65% 11.65% 11.65% 11.65% 11.65%", "qwen": "11.64% 11.64% 11.64% 11.64% 11.64% 11.64%"}, "model_tokens": {"rwkv": [[39941, " thing", "normal", 0.02082565799355507]], "qwen": [[3166, " thing", "normal", 0.020781708881258965]]}, "loss": {"rwkv": 11.64675684050986, "qwen": 11.642795506784987}, "topk": {"rwkv": [39941, 7, 0.02082565799355507, [[4706, 0.175676, " of", false], [22752, 0.109945, " way", false], [47009, 0.063649, " reason", false], [21413, 0.044641, " can", false], [39021, 0.032323, " might", false], [51668, 0.021373, " example", false], [39941, 0.020826, " thing", false], [46430, 0.018778, " lesson", false], [59829, 0.0174, " important", false], [56895, 0.015566, " possible", false]]], "qwen": [3166, 5, 0.020781708881258965, [[315, 0.175248, " of", false], [2874, 0.116729, " reason", false], [1616, 0.105777, " way", false], [646, 0.042688, " can", false], [3166, 0.020782, " thing", false], [2578, 0.019364, " might", false], [2989, 0.016264, " important", false], [5486, 0.014129, " approach", false], [1590, 0.01315, " final", false], [803, 0.013112, " more", false]]]}, "raw_delta": 0.0002196629842122766, "tuned_delta": 0.0070319407913102235}, {"byte_start": 5690, "byte_end": 5695, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 955, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"rwkv": "2.38% 2.38% 2.38% 2.38% 2.38%", "qwen": "2.65% 2.65% 2.65% 2.65% 2.65%"}, "model_tokens": {"rwkv": [[32227, " that", "normal", 0.5173326730728149]], "qwen": [[429, " that", "normal", 0.47998541593551636]]}, "loss": {"rwkv": 2.3810103702171364, "qwen": 2.6473437782348497}, "topk": {"rwkv": [32227, 1, 0.5173326730728149, [[32227, 0.517333, " that", false], [4858, 0.151678, " we", false], [4811, 0.084082, " to", false], [32234, 0.033252, " this", false], [4600, 0.030572, " is", false], [308, 0.027385, " I", false], [22590, 0.023427, " the", false], [3609, 0.009917, " AI", false], [37598, 0.009299, " about", false], [39936, 0.005718, " these", false]]], "qwen": [429, 1, 0.47998541593551636, [[429, 0.479985, " that", false], [311, 0.16196, " to", false], [582, 0.093175, " we", false], [374, 0.059273, " is", false], [358, 0.025259, " I", false], [911, 0.022871, " about", false], [279, 0.016734, " the", false], [419, 0.014615, " this", false], [5802, 0.008468, " worth", false], [15235, 0.00763, " AI", false]]]}, "raw_delta": -0.014768660068511963, "tuned_delta": -0.007956382261414017}, {"byte_start": 5695, "byte_end": 5702, "display": {"text": " should", "kind": "normal"}, "is_word": true, "word_id": 956, "word_key": " should", "bytes_hex": "20 73 68 6f 75 6c 64", "compression": {"rwkv": "11.67% 11.67% 11.67% 11.67% 11.67% 11.67% 11.67%", "qwen": "11.03% 11.03% 11.03% 11.03% 11.03% 11.03% 11.03%"}, "model_tokens": {"rwkv": [[47266, " should", "normal", 0.010883018374443054]], "qwen": [[1265, " should", "normal", 0.013812181539833546]]}, "loss": {"rwkv": 11.673592685764493, "qwen": 11.031991751560685}, "topk": {"rwkv": [47266, 16, 0.010883018374443054, [[4600, 0.188579, " is", false], [21800, 0.083894, " has", false], [38964, 0.055846, " makes", false], [4858, 0.049832, " we", false], [21413, 0.042511, " can", false], [22590, 0.027503, " the", false], [38686, 0.022351, " helps", false], [22074, 0.021569, " may", false], [3609, 0.019856, " AI", false], [39021, 0.019209, " might", false]]], "qwen": [1265, 15, 0.013812181539833546, [[374, 0.176985, " is", false], [646, 0.06568, " can", false], [582, 0.061963, " we", false], [702, 0.052179, " has", false], [3643, 0.036484, " makes", false], [279, 0.036215, " the", false], [8609, 0.036166, " helps", false], [1558, 0.028032, " does", false], [11811, 0.024418, " researchers", false], [358, 0.023333, " I", false]]]}, "raw_delta": 0.035577910287039605, "tuned_delta": 0.042390188094137554}, {"byte_start": 5702, "byte_end": 5705, "display": {"text": " be", "kind": "normal"}, "is_word": true, "word_id": 957, "word_key": " be", "bytes_hex": "20 62 65", "compression": {"rwkv": "2.37% 2.37% 2.37%", "qwen": "3.09% 3.09% 3.09%"}, "model_tokens": {"rwkv": [[4435, " be", "normal", 0.6735323071479797]], "qwen": [[387, " be", "normal", 0.5976617932319641]]}, "loss": {"rwkv": 2.3716178243780157, "qwen": 3.094161369504148}, "topk": {"rwkv": [4435, 1, 0.6735323071479797, [[4435, 0.673532, " be", false], [31073, 0.065436, " help", false], [22187, 0.048732, " not", false], [31059, 0.024721, " have", false], [31358, 0.014367, " make", false], [30135, 0.011811, " also", false], [30482, 0.01141, " come", false], [45284, 0.011396, " become", false], [47428, 0.007314, " strike", false], [39797, 0.006973, " stand", false]]], "qwen": [387, 1, 0.5976617932319641, [[387, 0.597662, " be", false], [537, 0.079499, " not", false], [1492, 0.06085, " help", false], [1281, 0.035471, " make", false], [614, 0.023218, " have", false], [1083, 0.012459, " also", false], [2525, 0.011101, " come", false], [2968, 0.008135, " give", false], [3635, 0.007961, " become", false], [32944, 0.006529, " emerge", false]]]}, "raw_delta": -0.04006632169087729, "tuned_delta": -0.03325404388377934}, {"byte_start": 5705, "byte_end": 5713, "display": {"text": " learned", "kind": "normal"}, "is_word": true, "word_id": 958, "word_key": " learned", "bytes_hex": "20 6c 65 61 72 6e 65 64", "compression": {"rwkv": "5.32% 5.32% 5.32% 5.32% 5.32% 5.32% 5.32% 5.32%", "qwen": "7.63% 7.63% 7.63% 7.63% 7.63% 7.63% 7.63% 7.63%"}, "model_tokens": {"rwkv": [[52112, " learned", "normal", 0.09416224807500839]], "qwen": [[9498, " learned", "normal", 0.033842235803604126]]}, "loss": {"rwkv": 5.3185290814021835, "qwen": 7.632860917966555}, "topk": {"rwkv": [52112, 2, 0.09416224807500839, [[38049, 0.325036, " clear", false], [52112, 0.094162, " learned", false], [39140, 0.074927, " noted", false], [52346, 0.04606, " obvious", false], [61934, 0.03229, " emphasized", false], [31207, 0.027261, " kept", false], [62684, 0.027225, " understood", false], [62479, 0.019751, " remembered", false], [55524, 0.019514, " apparent", false], [31351, 0.01855, " made", false]]], "qwen": [9498, 7, 0.033842235803604126, [[2797, 0.275875, " clear", false], [10342, 0.093688, " noted", false], [8036, 0.061994, " obvious", false], [3694, 0.059659, " added", false], [1053, 0.05515, " said", false], [45628, 0.043568, " emphasized", false], [9498, 0.033842, " learned", false], [31547, 0.029003, " stressed", false], [29476, 0.021034, " evident", false], [9733, 0.019105, " mentioned", false]]]}, "raw_delta": -0.12833380699157715, "tuned_delta": -0.1215215291844792}, {"byte_start": 5713, "byte_end": 5718, "display": {"text": " from", "kind": "normal"}, "is_word": true, "word_id": 959, "word_key": " from", "bytes_hex": "20 66 72 6f 6d", "compression": {"rwkv": "2.18% 2.18% 2.18% 2.18% 2.18%", "qwen": "2.05% 2.05% 2.05% 2.05% 2.05%"}, "model_tokens": {"rwkv": [[30917, " from", "normal", 0.5513564348220825]], "qwen": [[504, " from", "normal", 0.5667757391929626]]}, "loss": {"rwkv": 2.1837669075955985, "qwen": 2.0478752459729774}, "topk": {"rwkv": [30917, 1, 0.5513564348220825, [[30917, 0.551356, " from", false], [4600, 0.270245, " is", false], [45, 0.042907, ",", false], [31077, 0.025919, " here", false], [37598, 0.016309, " about", false], [4596, 0.012773, " in", false], [4450, 0.012052, " by", false], [32458, 0.008092, " well", false], [21265, 0.006178, " and", false], [59, 0.004373, ":", false]]], "qwen": [504, 1, 0.5667757391929626, [[504, 0.566776, " from", false], [374, 0.260513, " is", false], [11, 0.046342, ",", false], [304, 0.019425, " in", false], [1588, 0.018739, " here", false], [553, 0.014429, " by", false], [911, 0.012014, " about", false], [323, 0.004805, " and", false], [438, 0.004626, " as", false], [518, 0.004103, " at", false]]]}, "raw_delta": 0.00753543376922608, "tuned_delta": 0.014347711576324026}, {"byte_start": 5718, "byte_end": 5722, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 960, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "6.16% 6.16% 6.16% 6.16%", "qwen": "7.25% 7.25% 7.25% 7.25%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.25201302766799927]], "qwen": [[279, " the", "normal", 0.20029723644256592]]}, "loss": {"rwkv": 6.163858206923061, "qwen": 7.249329932518381}, "topk": {"rwkv": [22590, 2, 0.25201302766799927, [[32234, 0.360995, " this", false], [22590, 0.252013, " the", false], [39936, 0.193663, " these", false], [21256, 0.07407, " all", false], [3609, 0.025531, " AI", false], [51929, 0.007848, " history", false], [45315, 0.00736, " bitter", false], [55809, 0.006129, " computer", false], [57331, 0.004081, " studying", false], [52157, 0.003654, " looking", false]]], "qwen": [279, 2, 0.20029723644256592, [[419, 0.461009, " this", false], [279, 0.200297, " the", false], [1493, 0.151398, " these", false], [678, 0.087104, " all", false], [6366, 0.00636, " computer", false], [15235, 0.004603, " AI", false], [3840, 0.003931, " history", false], [20219, 0.003923, " Moore", false], [1817, 0.003834, " each", false], [264, 0.003543, " a", false]]]}, "raw_delta": -0.060191333293914795, "tuned_delta": -0.053379055486816845}, {"byte_start": 5722, "byte_end": 5729, "display": {"text": " bitter", "kind": "normal"}, "is_word": true, "word_id": 961, "word_key": " bitter", "bytes_hex": "20 62 69 74 74 65 72", "compression": {"rwkv": "1.00% 1.00% 1.00% 1.00% 1.00% 1.00% 1.00%", "qwen": "0.45% 0.45% 0.45% 0.45% 0.45% 0.45% 0.45%"}, "model_tokens": {"rwkv": [[45315, " bitter", "normal", 0.6747808456420898]], "qwen": [[25180, " bitter", "normal", 0.8381265997886658]]}, "loss": {"rwkv": 0.9962807550781762, "qwen": 0.45492843128433225}, "topk": {"rwkv": [45315, 1, 0.6747808456420898, [[45315, 0.674781, " bitter", false], [51929, 0.056225, " history", false], [37599, 0.01613, " above", false], [3609, 0.016129, " AI", false], [60587, 0.010441, " successes", false], [31636, 0.010188, " past", false], [56162, 0.009431, " examples", false], [52427, 0.008836, " pattern", false], [62061, 0.008791, " historical", false], [52127, 0.007107, " lessons", false]]], "qwen": [25180, 1, 0.8381265997886658, [[25180, 0.838127, " bitter", false], [3840, 0.020017, " history", false], [3403, 0.01126, " above", false], [78996, 0.010213, " bitterness", false], [6366, 0.008315, " computer", false], [18366, 0.00567, " lessons", false], [3139, 0.005327, " experience", false], [13656, 0.004365, " historical", false], [3267, 0.004178, " past", false], [4124, 0.003944, " early", false]]]}, "raw_delta": 0.030018946954182217, "tuned_delta": 0.03683122476128017}, {"byte_start": 5729, "byte_end": 5736, "display": {"text": " lesson", "kind": "normal"}, "is_word": true, "word_id": 962, "word_key": " lesson", "bytes_hex": "20 6c 65 73 73 6f 6e", "compression": {"rwkv": "2.07% 2.07% 2.07% 2.07% 2.07% 2.07% 2.07%", "qwen": "0.52% 0.52% 0.52% 0.52% 0.52% 0.52% 0.52%"}, "model_tokens": {"rwkv": [[46430, " lesson", "normal", 0.4484836757183075]], "qwen": [[17755, " lesson", "normal", 0.8182079195976257]]}, "loss": {"rwkv": 2.073069045920245, "qwen": 0.5168938955571559}, "topk": {"rwkv": [46430, 2, 0.4484836757183075, [[52127, 0.480081, " lessons", false], [46430, 0.448484, " lesson", false], [61979, 0.018733, " experience", false], [51929, 0.006338, " history", false], [63558, 0.006228, " experiences", false], [46, 0.004394, "-", false], [31636, 0.002278, " past", false], [56652, 0.001595, " mistakes", false], [39899, 0.001543, " taste", false], [39831, 0.001356, " story", false]]], "qwen": [17755, 1, 0.8182079195976257, [[17755, 0.818208, " lesson", false], [18366, 0.105563, " lessons", false], [3139, 0.03114, " experience", false], [3840, 0.013571, " history", false], [11449, 0.004299, " experiences", false], [15235, 0.003162, " AI", false], [11, 0.001942, ",", false], [13656, 0.00183, " historical", false], [3267, 0.001488, " past", false], [323, 0.000688, " and", false]]]}, "raw_delta": 0.08629267343452997, "tuned_delta": 0.09310495124162792}, {"byte_start": 5736, "byte_end": 5739, "display": {"text": " is", "kind": "normal"}, "is_word": true, "word_id": 963, "word_key": " is", "bytes_hex": "20 69 73", "compression": {"rwkv": "1.11% 1.11% 1.11%", "qwen": "1.21% 1.21% 1.21%"}, "model_tokens": {"rwkv": [[4600, " is", "normal", 0.8315290212631226]], "qwen": [[374, " is", "normal", 0.817969799041748]]}, "loss": {"rwkv": 1.109494477246151, "qwen": 1.2078356797725596}, "topk": {"rwkv": [4600, 1, 0.8315290212631226, [[4600, 0.831529, " is", false], [4706, 0.054079, " of", false], [45, 0.045634, ",", false], [4596, 0.013274, " in", false], [32227, 0.011725, " that", false], [37598, 0.009437, " about", false], [59, 0.005898, ":", false], [21265, 0.003657, " and", false], [4712, 0.00225, " on", false], [5346, 0.002029, "---", false]]], "qwen": [374, 1, 0.817969799041748, [[374, 0.81797, " is", false], [315, 0.068726, " of", false], [11, 0.038809, ",", false], [304, 0.012614, " in", false], [911, 0.007968, " about", false], [429, 0.006566, " that", false], [25, 0.006301, ":", false], [4421, 0.005378, "---", false], [323, 0.004139, " and", false], [389, 0.002969, " on", false]]]}, "raw_delta": -0.005453194181124374, "tuned_delta": 0.001359083625973573}, {"byte_start": 5739, "byte_end": 5743, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 964, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "10.99% 10.99% 10.99% 10.99%", "qwen": "10.35% 10.35% 10.35% 10.35%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.08722482621669769]], "qwen": [[279, " the", "normal", 0.10073703527450562]]}, "loss": {"rwkv": 10.9892786317714, "qwen": 10.347918780390678}, "topk": {"rwkv": [22590, 2, 0.08722482621669769, [[32227, 0.692081, " that", false], [22590, 0.087225, " the", false], [4811, 0.085881, " to", false], [22187, 0.029908, " not", false], [21835, 0.022602, " how", false], [32234, 0.014255, " this", false], [332, 0.011486, " a", false], [32464, 0.005007, " what", false], [59, 0.004854, ":", false], [45, 0.004818, ",", false]]], "qwen": [279, 2, 0.10073703527450562, [[429, 0.677339, " that", false], [279, 0.100737, " the", false], [311, 0.073085, " to", false], [1246, 0.036996, " how", false], [537, 0.025421, " not", false], [264, 0.013102, " a", false], [419, 0.009452, " this", false], [1128, 0.009201, " what", false], [911, 0.00403, " about", false], [1101, 0.003283, " just", false]]]}, "raw_delta": 0.035564541816711426, "tuned_delta": 0.042376819623809375}, {"byte_start": 5743, "byte_end": 5749, "display": {"text": " great", "kind": "normal"}, "is_word": true, "word_id": 965, "word_key": " great", "bytes_hex": "20 67 72 65 61 74", "compression": {"rwkv": "16.25% 16.25% 16.25% 16.25% 16.25% 16.25%", "qwen": "13.41% 13.41% 13.41% 13.41% 13.41% 13.41%"}, "model_tokens": {"rwkv": [[38629, " great", "normal", 0.004441915545612574]], "qwen": [[2244, " great", "normal", 0.011553216725587845]]}, "loss": {"rwkv": 16.24910430167908, "qwen": 13.40742062958532}, "topk": {"rwkv": [38629, 25, 0.004441915545612574, [[62079, 0.246643, " importance", false], [31506, 0.096788, " need", false], [40093, 0.039812, " value", false], [59725, 0.017854, " following", false], [30808, 0.013766, " fact", false], [21719, 0.013026, " fut", false], [45661, 0.012723, " danger", false], [63820, 0.009317, " realization", false], [31135, 0.009073, " idea", false], [60051, 0.00823, " necessity", false]]], "qwen": [2244, 10, 0.011553216725587845, [[12650, 0.178247, " importance", false], [1184, 0.076754, " need", false], [897, 0.037843, " value", false], [2355, 0.019332, " power", false], [2097, 0.017897, " fact", false], [3476, 0.012779, " role", false], [6672, 0.012589, " difference", false], [23389, 0.012551, " wisdom", false], [17755, 0.012181, " lesson", false], [2244, 0.011553, " great", false]]]}, "raw_delta": 0.15757640202840162, "tuned_delta": 0.16438867983549957}, {"byte_start": 5749, "byte_end": 5755, "display": {"text": " power", "kind": "normal"}, "is_word": true, "word_id": 966, "word_key": " power", "bytes_hex": "20 70 6f 77 65 72", "compression": {"rwkv": "7.65% 7.65% 7.65% 7.65% 7.65% 7.65%", "qwen": "6.64% 6.64% 6.64% 6.64% 6.64% 6.64%"}, "model_tokens": {"rwkv": [[39339, " power", "normal", 0.07788023352622986]], "qwen": [[2355, " power", "normal", 0.10960918664932251]]}, "loss": {"rwkv": 7.654924858883497, "qwen": 6.644915179217694}, "topk": {"rwkv": [39339, 3, 0.07788023352622986, [[62079, 0.283139, " importance", false], [40093, 0.195854, " value", false], [39339, 0.07788, " power", false], [60211, 0.028379, " potential", false], [59093, 0.023897, " advantage", false], [45661, 0.021826, " danger", false], [51030, 0.02164, " benefit", false], [61865, 0.015167, " difficulty", false], [31506, 0.014795, " need", false], [30510, 0.012255, " cost", false]]], "qwen": [2355, 3, 0.10960918664932251, [[12650, 0.233723, " importance", false], [897, 0.15247, " value", false], [2355, 0.109609, " power", false], [4650, 0.025403, " potential", false], [16829, 0.025179, " difficulty", false], [6672, 0.019781, " difference", false], [1184, 0.019257, " need", false], [9423, 0.014658, " advantage", false], [7978, 0.011806, " danger", false], [8760, 0.011559, " benefit", false]]]}, "raw_delta": 0.056006828943888365, "tuned_delta": 0.06281910675098631}, {"byte_start": 5755, "byte_end": 5758, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 967, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "1.30% 1.30% 1.30%", "qwen": "0.86% 0.86% 0.86%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.8083624243736267]], "qwen": [[315, " of", "normal", 0.8665686249732971]]}, "loss": {"rwkv": 1.2973453940285682, "qwen": 0.8608919430866092}, "topk": {"rwkv": [4706, 1, 0.8083624243736267, [[4706, 0.808362, " of", false], [32227, 0.079862, " that", false], [21265, 0.038674, " and", false], [4596, 0.0159, " in", false], [45, 0.009265, ",", false], [4811, 0.006768, " to", false], [4858, 0.003603, " we", false], [59206, 0.003391, " available", false], [56454, 0.002304, " inherent", false], [52349, 0.001456, " offered", false]]], "qwen": [315, 1, 0.8665686249732971, [[315, 0.866569, " of", false], [429, 0.055394, " that", false], [323, 0.03366, " and", false], [304, 0.016253, " in", false], [11, 0.004085, ",", false], [2500, 0.002322, " available", false], [582, 0.001572, " we", false], [36988, 0.001447, " inherent", false], [320, 0.001337, " (", false], [311, 0.001265, " to", false]]]}, "raw_delta": 0.024202118317286178, "tuned_delta": 0.031014396124384124}, {"byte_start": 5758, "byte_end": 5766, "display": {"text": " general", "kind": "normal"}, "is_word": true, "word_id": 968, "word_key": " general", "bytes_hex": "20 67 65 6e 65 72 61 6c", "compression": {"rwkv": "7.26% 7.26% 7.26% 7.26% 7.26% 7.26% 7.26% 7.26%", "qwen": "8.35% 8.35% 8.35% 8.35% 8.35% 8.35% 8.35% 8.35%"}, "model_tokens": {"rwkv": [[51832, " general", "normal", 0.03980078175663948]], "qwen": [[4586, " general", "normal", 0.02458660677075386]]}, "loss": {"rwkv": 7.25574166072086, "qwen": 8.353099537273936}, "topk": {"rwkv": [51832, 7, 0.03980078175663948, [[63370, 0.120643, " computation", false], [22590, 0.113525, " the", false], [47202, 0.089489, " search", false], [56537, 0.057001, " learning", false], [52195, 0.056844, " massive", false], [37045, 0.041016, " Moore", false], [51832, 0.039801, " general", false], [30597, 0.036189, " deep", false], [38720, 0.031698, " human", false], [38888, 0.026426, " lever", false]]], "qwen": [4586, 8, 0.02458660677075386, [[2711, 0.130795, " search", false], [34447, 0.084417, " computation", false], [6832, 0.075878, " learning", false], [26943, 0.074503, " scaling", false], [279, 0.052316, " the", false], [76482, 0.037135, " leveraging", false], [3738, 0.027417, " human", false], [4586, 0.024587, " general", false], [5538, 0.022336, " deep", false], [20219, 0.017969, " Moore", false]]]}, "raw_delta": -0.060850441455841064, "tuned_delta": -0.054038163648743115}, {"byte_start": 5766, "byte_end": 5774, "display": {"text": " purpose", "kind": "normal"}, "is_word": true, "word_id": 969, "word_key": " purpose", "bytes_hex": "20 70 75 72 70 6f 73 65", "compression": {"rwkv": "16.13% 16.13% 16.13% 16.13% 16.13% 16.13% 16.13% 16.13%", "qwen": "13.16% 13.16% 13.16% 13.16% 13.16% 13.16% 13.16% 13.16%"}, "model_tokens": {"rwkv": [[52610, " purpose", "normal", 0.0007706015021540225]], "qwen": [[7428, " purpose", "normal", 0.0029112529009580612]]}, "loss": {"rwkv": 16.131697478690068, "qwen": 13.162725505423662}, "topk": {"rwkv": [52610, 27, 0.0007706015021540225, [[52224, 0.755087, " methods", false], [7933, 0.035419, "ity", false], [45, 0.033137, ",", false], [61590, 0.024939, " approaches", false], [47202, 0.02309, " search", false], [63370, 0.022996, " computation", false], [46, 0.012211, "-", false], [62633, 0.010878, " techniques", false], [64862, 0.00693, " computational", false], [61559, 0.005756, " algorithms", false]]], "qwen": [7428, 16, 0.0029112529009580612, [[5413, 0.702868, " methods", false], [58238, 0.059669, "-purpose", false], [2022, 0.028043, "ization", false], [11, 0.025752, ",", false], [12538, 0.025624, " techniques", false], [19827, 0.023412, " approaches", false], [34447, 0.018258, " computation", false], [4849, 0.013943, "izing", false], [2711, 0.010966, " search", false], [16170, 0.00461, " principles", false]]]}, "raw_delta": 0.16463476419448853, "tuned_delta": 0.17144704200158647}, {"byte_start": 5774, "byte_end": 5782, "display": {"text": " methods", "kind": "normal"}, "is_word": true, "word_id": 970, "word_key": " methods", "bytes_hex": "20 6d 65 74 68 6f 64 73", "compression": {"rwkv": "3.63% 3.63% 3.63% 3.63% 3.63% 3.63% 3.63% 3.63%", "qwen": "1.14% 1.14% 1.14% 1.14% 1.14% 1.14% 1.14% 1.14%"}, "model_tokens": {"rwkv": [[52224, " methods", "normal", 0.19827412068843842]], "qwen": [[5413, " methods", "normal", 0.6017976403236389]]}, "loss": {"rwkv": 3.62787083036043, "qwen": 1.1447650286248554}, "topk": {"rwkv": [52224, 2, 0.19827412068843842, [[63370, 0.410394, " computation", false], [52224, 0.198274, " methods", false], [45, 0.07129, ",", false], [47202, 0.056473, " search", false], [59346, 0.040187, " computing", false], [56537, 0.018931, " learning", false], [52167, 0.018679, " machine", false], [61590, 0.014547, " approaches", false], [61559, 0.014153, " algorithms", false], [64862, 0.012586, " computational", false]]], "qwen": [5413, 1, 0.6017976403236389, [[5413, 0.601798, " methods", false], [34447, 0.076976, " computation", false], [11, 0.038898, ",", false], [12538, 0.035484, " techniques", false], [6832, 0.021442, " learning", false], [19827, 0.019211, " approaches", false], [2711, 0.018296, " search", false], [24231, 0.017946, " computing", false], [25185, 0.015499, " algorithms", false], [7375, 0.010698, " tools", false]]]}, "raw_delta": 0.1376926228404045, "tuned_delta": 0.14450490064750246}, {"byte_start": 5782, "byte_end": 5783, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "35.22%", "qwen": "36.43%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.1434570550918579]], "qwen": [[11, ",", "normal", 0.1326359212398529]]}, "loss": {"rwkv": 35.222046896703205, "qwen": 36.430706570436854}, "topk": {"rwkv": [45, 3, 0.1434570550918579, [[47, 0.293534, ".", false], [32227, 0.15925, " that", false], [45, 0.143457, ",", false], [37810, 0.119883, " based", false], [21700, 0.033108, " for", false], [38888, 0.027616, " lever", false], [4811, 0.024652, " to", false], [31296, 0.024474, " like", false], [4596, 0.023773, " in", false], [21265, 0.019546, " and", false]]], "qwen": [11, 3, 0.1326359212398529, [[429, 0.30262, " that", false], [13, 0.202239, ".", false], [11, 0.132636, ",", false], [3118, 0.076307, " based", false], [369, 0.057671, " for", false], [76482, 0.053195, " leveraging", false], [4421, 0.025408, "---", false], [323, 0.017669, " and", false], [320, 0.012069, " (", false], [315, 0.009734, " of", false]]]}, "raw_delta": -0.06702232360839844, "tuned_delta": -0.06021004580130049}, {"byte_start": 5783, "byte_end": 5786, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 971, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "26.11% 26.11% 26.11%", "qwen": "27.84% 27.84% 27.84%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.012859586626291275]], "qwen": [[315, " of", "normal", 0.009746178984642029]]}, "loss": {"rwkv": 26.111277432755976, "qwen": 27.83728098492755}, "topk": {"rwkv": [4706, 15, 0.012859586626291275, [[21265, 0.201421, " and", false], [40186, 0.082505, " which", false], [37810, 0.076082, " based", false], [32139, 0.060965, " such", false], [31296, 0.052949, " like", false], [61953, 0.048573, " especially", false], [4423, 0.033297, " as", false], [4596, 0.029207, " in", false], [32227, 0.018836, " that", false], [30788, 0.018702, " even", false]]], "qwen": [315, 21, 0.009746178984642029, [[323, 0.2285, " and", false], [892, 0.108199, " which", false], [1741, 0.049188, " such", false], [5310, 0.043817, " especially", false], [5413, 0.043779, " methods", false], [429, 0.04067, " that", false], [3118, 0.03595, " based", false], [304, 0.033636, " in", false], [438, 0.024886, " as", false], [1075, 0.021069, " like", false]]]}, "raw_delta": -0.0957099596659341, "tuned_delta": -0.08889768185883615}, {"byte_start": 5786, "byte_end": 5794, "display": {"text": " methods", "kind": "normal"}, "is_word": true, "word_id": 972, "word_key": " methods", "bytes_hex": "20 6d 65 74 68 6f 64 73", "compression": {"rwkv": "2.40% 2.40% 2.40% 2.40% 2.40% 2.40% 2.40% 2.40%", "qwen": "1.69% 1.69% 1.69% 1.69% 1.69% 1.69% 1.69% 1.69%"}, "model_tokens": {"rwkv": [[52224, " methods", "normal", 0.34382155537605286]], "qwen": [[5413, " methods", "normal", 0.4725334644317627]]}, "loss": {"rwkv": 2.3950991889758177, "qwen": 1.6898617563899454}, "topk": {"rwkv": [52224, 1, 0.34382155537605286, [[52224, 0.343822, " methods", false], [63370, 0.065561, " computation", false], [51832, 0.060928, " general", false], [22590, 0.058702, " the", false], [47202, 0.045145, " search", false], [38888, 0.029995, " lever", false], [56537, 0.021006, " learning", false], [52195, 0.017721, " massive", false], [39944, 0.015075, " those", false], [59346, 0.014732, " computing", false]]], "qwen": [5413, 1, 0.4725334644317627, [[5413, 0.472533, " methods", false], [76482, 0.103653, " leveraging", false], [2711, 0.027005, " search", false], [892, 0.024523, " which", false], [12538, 0.022774, " techniques", false], [279, 0.018274, " the", false], [4586, 0.016407, " general", false], [1667, 0.015324, " using", false], [26943, 0.014974, " scaling", false], [34447, 0.013791, " computation", false]]]}, "raw_delta": 0.039106667041778564, "tuned_delta": 0.045918944848876514}, {"byte_start": 5794, "byte_end": 5799, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 973, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"rwkv": "1.26% 1.26% 1.26% 1.26% 1.26%", "qwen": "0.76% 0.76% 0.76% 0.76% 0.76%"}, "model_tokens": {"rwkv": [[32227, " that", "normal", 0.7069332003593445]], "qwen": [[429, " that", "normal", 0.8100671768188477]]}, "loss": {"rwkv": 1.2609492789019747, "qwen": 0.7597162156659493}, "topk": {"rwkv": [32227, 1, 0.7069332003593445, [[32227, 0.706933, " that", false], [37810, 0.109959, " based", false], [22187, 0.016179, " not", false], [31296, 0.015188, " like", false], [37924, 0.012147, " built", false], [55966, 0.007684, " designed", false], [38888, 0.00763, " lever", false], [32487, 0.007564, " with", false], [21700, 0.007049, " for", false], [4596, 0.006979, " in", false]]], "qwen": [429, 1, 0.8100671768188477, [[429, 0.810067, " that", false], [3118, 0.062734, " based", false], [76482, 0.010371, " leveraging", false], [537, 0.009305, " not", false], [892, 0.007798, " which", false], [369, 0.006217, " for", false], [304, 0.004875, " in", false], [6693, 0.004694, " whose", false], [315, 0.004501, " of", false], [448, 0.004247, " with", false]]]}, "raw_delta": 0.027794262766838062, "tuned_delta": 0.03460654057393601}, {"byte_start": 5799, "byte_end": 5808, "display": {"text": " continue", "kind": "normal"}, "is_word": true, "word_id": 974, "word_key": " continue", "bytes_hex": "20 63 6f 6e 74 69 6e 75 65", "compression": {"rwkv": "20.91% 20.91% 20.91% 20.91% 20.91% 20.91% 20.91% 20.91% 20.91%", "qwen": "17.37% 17.37% 17.37% 17.37% 17.37% 17.37% 17.37% 17.37% 17.37%"}, "model_tokens": {"rwkv": [[55851, " continue", "normal", 2.8940708943991922e-05]], "qwen": [[3060, " continue", "normal", 0.00017152675718534738]]}, "loss": {"rwkv": 20.914068735109105, "qwen": 17.373998869850823}, "topk": {"rwkv": [55851, 559, 2.8940708943991922e-05, [[21286, 0.21133, " are", false], [21413, 0.134525, " can", false], [4491, 0.12327, " do", false], [56540, 0.080361, " leverage", false], [32499, 0.050046, " work", false], [22681, 0.034484, " use", false], [32187, 0.032347, " take", false], [31358, 0.030104, " make", false], [39590, 0.023588, " scale", false], [37730, 0.015, " apply", false]]], "qwen": [3060, 229, 0.00017152675718534738, [[32064, 0.184149, " leverage", false], [646, 0.143933, " can", false], [653, 0.121026, " do", false], [525, 0.112008, " are", false], [1896, 0.035563, " take", false], [5452, 0.028873, " scale", false], [975, 0.026423, " work", false], [1281, 0.025458, " make", false], [990, 0.024203, " use", false], [32194, 0.013727, " exploit", false]]]}, "raw_delta": 0.1963031556871203, "tuned_delta": 0.20311543349421826}, {"byte_start": 5808, "byte_end": 5811, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 975, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "0.42% 0.42% 0.42%", "qwen": "0.29% 0.29% 0.29%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.9331287145614624]], "qwen": [[311, " to", "normal", 0.9529430270195007]]}, "loss": {"rwkv": 0.41679422161098795, "qwen": 0.28974210546681106}, "topk": {"rwkv": [4811, 1, 0.9331287145614624, [[4811, 0.933129, " to", false], [38888, 0.004344, " lever", false], [22590, 0.003987, " the", false], [52805, 0.003806, " scaling", false], [45, 0.003313, ",", false], [53362, 0.002289, " working", false], [4712, 0.002139, " on", false], [39931, 0.002068, " their", false], [4596, 0.001974, " in", false], [30788, 0.001769, " even", false]]], "qwen": [311, 1, 0.9529430270195007, [[311, 0.952943, " to", false], [26943, 0.00323, " scaling", false], [6832, 0.002523, " learning", false], [3238, 0.002497, " working", false], [40928, 0.002333, " evolving", false], [18392, 0.001735, " improving", false], [15039, 0.001664, " searching", false], [279, 0.001274, " the", false], [862, 0.001127, " their", false], [304, 0.001102, " in", false]]]}, "raw_delta": 0.007045265287160873, "tuned_delta": 0.01385754309425882}, {"byte_start": 5811, "byte_end": 5817, "display": {"text": " scale", "kind": "normal"}, "is_word": true, "word_id": 976, "word_key": " scale", "bytes_hex": "20 73 63 61 6c 65", "compression": {"rwkv": "5.17% 5.17% 5.17% 5.17% 5.17% 5.17%", "qwen": "8.58% 8.58% 8.58% 8.58% 8.58% 8.58%"}, "model_tokens": {"rwkv": [[39590, " scale", "normal", 0.17739887535572052]], "qwen": [[5452, " scale", "normal", 0.05761812999844551]]}, "loss": {"rwkv": 5.16590021151647, "qwen": 8.577778030658298}, "topk": {"rwkv": [39590, 1, 0.17739887535572052, [[39590, 0.177399, " scale", false], [32499, 0.125975, " work", false], [51982, 0.10729, " improve", false], [4435, 0.090943, " be", false], [56540, 0.047824, " leverage", false], [31017, 0.024858, " grow", false], [21751, 0.022334, " get", false], [38877, 0.01866, " learn", false], [52573, 0.017909, " produce", false], [31358, 0.017461, " make", false]]], "qwen": [5452, 4, 0.05761812999844551, [[387, 0.151001, " be", false], [975, 0.120046, " work", false], [7269, 0.116449, " improve", false], [5452, 0.057618, " scale", false], [37580, 0.044474, " evolve", false], [1281, 0.040973, " make", false], [3063, 0.036439, " grow", false], [32064, 0.021143, " leverage", false], [8760, 0.01922, " benefit", false], [3960, 0.013668, " learn", false]]]}, "raw_delta": -0.1891946792602539, "tuned_delta": -0.18238240145315596}, {"byte_start": 5817, "byte_end": 5822, "display": {"text": " with", "kind": "normal"}, "is_word": true, "word_id": 977, "word_key": " with", "bytes_hex": "20 77 69 74 68", "compression": {"rwkv": "6.59% 6.59% 6.59% 6.59% 6.59%", "qwen": "4.33% 4.33% 4.33% 4.33% 4.33%"}, "model_tokens": {"rwkv": [[32487, " with", "normal", 0.16215091943740845]], "qwen": [[448, " with", "normal", 0.3008979856967926]]}, "loss": {"rwkv": 6.593567179062839, "qwen": 4.331634156650095}, "topk": {"rwkv": [32487, 1, 0.16215091943740845, [[32487, 0.162151, " with", false], [4596, 0.102987, " in", false], [4423, 0.092265, " as", false], [45, 0.071062, ",", false], [21265, 0.070587, " and", false], [63370, 0.060163, " computation", false], [64911, 0.042516, " exponentially", false], [47, 0.041178, ".", false], [4833, 0.027142, " up", false], [32458, 0.01891, " well", false]]], "qwen": [448, 1, 0.3008979856967926, [[448, 0.300898, " with", false], [438, 0.116872, " as", false], [705, 0.065229, " up", false], [323, 0.064483, " and", false], [11, 0.062953, ",", false], [13, 0.04911, ".", false], [34447, 0.038239, " computation", false], [304, 0.036669, " in", false], [1632, 0.029503, " well", false], [553, 0.024149, " by", false]]]}, "raw_delta": 0.12542819976806638, "tuned_delta": 0.13224047757516433}, {"byte_start": 5822, "byte_end": 5832, "display": {"text": " increased", "kind": "normal"}, "is_word": true, "word_id": 978, "word_key": " increased", "bytes_hex": "20 69 6e 63 72 65 61 73 65 64", "compression": {"rwkv": "6.11% 6.11% 6.11% 6.11% 6.11% 6.11% 6.11% 6.11% 6.11% 6.11%", "qwen": "7.67% 7.67% 7.67% 7.67% 7.67% 7.67% 7.67% 7.67% 7.67% 7.67%"}, "model_tokens": {"rwkv": [[59846, " increased", "normal", 0.03409373387694359]], "qwen": [[7172, " increased", "normal", 0.014236995950341225]]}, "loss": {"rwkv": 6.114547341267675, "qwen": 7.667763937045909}, "topk": {"rwkv": [59846, 8, 0.03409373387694359, [[22590, 0.205659, " the", false], [63370, 0.137363, " computation", false], [31458, 0.06791, " more", false], [62092, 0.066224, " increasing", false], [30789, 0.06546, " ever", false], [52195, 0.038237, " massive", false], [37045, 0.035179, " Moore", false], [59846, 0.034094, " increased", false], [61535, 0.021898, " additional", false], [51816, 0.021308, " further", false]]], "qwen": [7172, 8, 0.014236995950341225, [[20219, 0.292234, " Moore", false], [279, 0.172921, " the", false], [34447, 0.141059, " computation", false], [7703, 0.047749, " increasing", false], [2500, 0.027034, " available", false], [54480, 0.016824, " computational", false], [803, 0.015453, " more", false], [7172, 0.014237, " increased", false], [10951, 0.012732, " massive", false], [501, 0.01187, " new", false]]]}, "raw_delta": -0.08612861633300783, "tuned_delta": -0.07931633852590989}, {"byte_start": 5832, "byte_end": 5844, "display": {"text": " computation", "kind": "normal"}, "is_word": true, "word_id": 979, "word_key": " computation", "bytes_hex": "20 63 6f 6d 70 75 74 61 74 69 6f 6e", "compression": {"rwkv": "1.29% 1.29% 1.29% 1.29% 1.29% 1.29% 1.29% 1.29% 1.29% 1.29% 1.29% 1.29%", "qwen": "0.65% 0.65% 0.65% 0.65% 0.65% 0.65% 0.65% 0.65% 0.65% 0.65% 0.65% 0.65%"}, "model_tokens": {"rwkv": [[63370, " computation", "normal", 0.4258326292037964]], "qwen": [[34447, " computation", "normal", 0.6468513011932373]]}, "loss": {"rwkv": 1.285604711729667, "qwen": 0.6546811617302088}, "topk": {"rwkv": [63370, 1, 0.4258326292037964, [[63370, 0.425833, " computation", false], [64862, 0.11862, " computational", false], [59346, 0.086296, " computing", false], [60406, 0.050221, " resources", false], [50897, 0.026543, " amounts", false], [51266, 0.022981, " compute", false], [30579, 0.015786, " data", false], [39339, 0.015436, " power", false], [59206, 0.015103, " available", false], [56353, 0.013328, " hardware", false]]], "qwen": [34447, 1, 0.6468513011932373, [[34447, 0.646851, " computation", false], [54480, 0.09894, " computational", false], [14713, 0.078807, " amounts", false], [24231, 0.046903, " computing", false], [2500, 0.015446, " available", false], [18048, 0.013459, " availability", false], [6366, 0.010488, " computer", false], [2783, 0.006107, " cost", false], [4963, 0.005944, " resources", false], [11773, 0.005312, " hardware", false]]]}, "raw_delta": 0.03498583038647969, "tuned_delta": 0.04179810819357764}, {"byte_start": 5844, "byte_end": 5849, "display": {"text": " even", "kind": "normal"}, "is_word": true, "word_id": 980, "word_key": " even", "bytes_hex": "20 65 76 65 6e", "compression": {"rwkv": "17.36% 17.36% 17.36% 17.36% 17.36%", "qwen": "19.09% 19.09% 19.09% 19.09% 19.09%"}, "model_tokens": {"rwkv": [[30788, " even", "normal", 0.00839312095195055]], "qwen": [[1496, " even", "normal", 0.005025168415158987]]}, "loss": {"rwkv": 17.35742471069534, "qwen": 19.091530938824565}, "topk": {"rwkv": [30788, 8, 0.00839312095195055, [[47, 0.456622, ".", false], [45, 0.259501, ",", false], [21265, 0.13499, " and", false], [5346, 0.015027, "---", false], [31601, 0.010863, " over", false], [275, 0.009032, " (", false], [4423, 0.00861, " as", false], [30788, 0.008393, " even", false], [4596, 0.007243, " in", false], [59206, 0.006392, " available", false]]], "qwen": [1496, 15, 0.005025168415158987, [[13, 0.533932, ".", false], [11, 0.231739, ",", false], [323, 0.065042, " and", false], [2355, 0.018454, " power", false], [2500, 0.016098, " available", false], [320, 0.012527, " (", false], [304, 0.01184, " in", false], [438, 0.010132, " as", false], [4421, 0.00899, "---", false], [382, 0.007814, ".\n\n", false]]]}, "raw_delta": -0.09615926742553704, "tuned_delta": -0.0893469896184391}, {"byte_start": 5849, "byte_end": 5852, "display": {"text": " as", "kind": "normal"}, "is_word": true, "word_id": 981, "word_key": " as", "bytes_hex": "20 61 73", "compression": {"rwkv": "7.23% 7.23% 7.23%", "qwen": "6.94% 6.94% 6.94%"}, "model_tokens": {"rwkv": [[4423, " as", "normal", 0.3060115575790405]], "qwen": [[438, " as", "normal", 0.3154607117176056]]}, "loss": {"rwkv": 7.232260296123059, "qwen": 6.935282804396296}, "topk": {"rwkv": [4423, 1, 0.3060115575790405, [[4423, 0.306012, " as", false], [32465, 0.255101, " when", false], [4596, 0.114583, " in", false], [4588, 0.073319, " if", false], [37634, 0.0707, " after", false], [47544, 0.055122, " though", false], [40187, 0.023917, " while", false], [21700, 0.008448, " for", false], [31601, 0.007516, " over", false], [4424, 0.007026, " at", false]]], "qwen": [438, 1, 0.3154607117176056, [[438, 0.315461, " as", false], [979, 0.261261, " when", false], [421, 0.124773, " if", false], [1283, 0.103627, " after", false], [304, 0.055037, " in", false], [3498, 0.036656, " though", false], [1393, 0.022834, " while", false], [7797, 0.017056, " beyond", false], [2041, 0.010729, " without", false], [518, 0.007943, " at", false]]]}, "raw_delta": 0.016467928886413574, "tuned_delta": 0.02328020669351152}, {"byte_start": 5852, "byte_end": 5856, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 982, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "5.60% 5.60% 5.60% 5.60%", "qwen": "5.45% 5.45% 5.45% 5.45%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.28766265511512756]], "qwen": [[279, " the", "normal", 0.2983497083187103]]}, "loss": {"rwkv": 5.60030545657581, "qwen": 5.452886765268265}, "topk": {"rwkv": [22590, 1, 0.28766265511512756, [[22590, 0.287663, " the", false], [32232, 0.164699, " they", false], [4858, 0.080366, " we", false], [38720, 0.054512, " human", false], [39931, 0.03953, " their", false], [39193, 0.029763, " other", false], [63370, 0.027043, " computation", false], [31458, 0.023145, " more", false], [22248, 0.018226, " our", false], [57103, 0.010005, " research", false]]], "qwen": [279, 1, 0.2983497083187103, [[279, 0.29835, " the", false], [807, 0.211722, " they", false], [3738, 0.084128, " human", false], [862, 0.071106, " their", false], [34447, 0.025875, " computation", false], [803, 0.025603, " more", false], [582, 0.01675, " we", false], [501, 0.016648, " new", false], [3151, 0.015792, " specific", false], [11811, 0.012698, " researchers", false]]]}, "raw_delta": 0.008174628019332886, "tuned_delta": 0.014986905826430832}, {"byte_start": 5856, "byte_end": 5866, "display": {"text": " available", "kind": "normal"}, "is_word": true, "word_id": 983, "word_key": " available", "bytes_hex": "20 61 76 61 69 6c 61 62 6c 65", "compression": {"rwkv": "8.28% 8.28% 8.28% 8.28% 8.28% 8.28% 8.28% 8.28% 8.28% 8.28%", "qwen": "8.28% 8.28% 8.28% 8.28% 8.28% 8.28% 8.28% 8.28% 8.28% 8.28%"}, "model_tokens": {"rwkv": [[59206, " available", "normal", 0.01008719950914383]], "qwen": [[2500, " available", "normal", 0.010146329179406166]]}, "loss": {"rwkv": 8.284225430104593, "qwen": 8.278623095252737}, "topk": {"rwkv": [59206, 20, 0.01008719950914383, [[45775, 0.11094, " domain", false], [52569, 0.102032, " problem", false], [38720, 0.05125, " human", false], [52224, 0.037469, " methods", false], [38478, 0.028777, " field", false], [45157, 0.026422, " amount", false], [62680, 0.025807, " underlying", false], [56939, 0.023275, " problems", false], [57103, 0.021682, " research", false], [30579, 0.019065, " data", false]]], "qwen": [2500, 19, 0.010146329179406166, [[34447, 0.102133, " computation", false], [3738, 0.094568, " human", false], [3311, 0.074239, " amount", false], [7947, 0.047311, " domain", false], [3151, 0.036203, " specific", false], [5413, 0.034137, " methods", false], [3491, 0.030156, " problem", false], [6540, 0.021283, " knowledge", false], [54480, 0.019491, " computational", false], [6993, 0.016969, " nature", false]]]}, "raw_delta": 0.00031065940856933594, "tuned_delta": 0.007122937215667283}, {"byte_start": 5866, "byte_end": 5878, "display": {"text": " computation", "kind": "normal"}, "is_word": true, "word_id": 984, "word_key": " computation", "bytes_hex": "20 63 6f 6d 70 75 74 61 74 69 6f 6e", "compression": {"rwkv": "2.77% 2.77% 2.77% 2.77% 2.77% 2.77% 2.77% 2.77% 2.77% 2.77% 2.77% 2.77%", "qwen": "1.13% 1.13% 1.13% 1.13% 1.13% 1.13% 1.13% 1.13% 1.13% 1.13% 1.13% 1.13%"}, "model_tokens": {"rwkv": [[63370, " computation", "normal", 0.15976355969905853]], "qwen": [[34447, " computation", "normal", 0.47061216831207275]]}, "loss": {"rwkv": 2.7708010225406516, "qwen": 1.132697444927869}, "topk": {"rwkv": [63370, 2, 0.15976355969905853, [[38720, 0.371718, " human", false], [63370, 0.159764, " computation", false], [59943, 0.157219, " knowledge", false], [30579, 0.066279, " data", false], [45775, 0.035313, " domain", false], [63637, 0.033545, " information", false], [64862, 0.01085, " computational", false], [45157, 0.010375, " amount", false], [60406, 0.009886, " resources", false], [59346, 0.008755, " computing", false]]], "qwen": [34447, 1, 0.47061216831207275, [[34447, 0.470612, " computation", false], [6540, 0.165297, " knowledge", false], [3738, 0.115396, " human", false], [3311, 0.043473, " amount", false], [54480, 0.022194, " computational", false], [5413, 0.011345, " methods", false], [11773, 0.007348, " hardware", false], [7947, 0.0073, " domain", false], [821, 0.00552, " data", false], [1995, 0.005116, " information", false]]]}, "raw_delta": 0.09083575010299684, "tuned_delta": 0.09764802791009479}, {"byte_start": 5878, "byte_end": 5886, "display": {"text": " becomes", "kind": "normal"}, "is_word": true, "word_id": 985, "word_key": " becomes", "bytes_hex": "20 62 65 63 6f 6d 65 73", "compression": {"rwkv": "8.31% 8.31% 8.31% 8.31% 8.31% 8.31% 8.31% 8.31%", "qwen": "6.26% 6.26% 6.26% 6.26% 6.26% 6.26% 6.26% 6.26%"}, "model_tokens": {"rwkv": [[51019, " becomes", "normal", 0.025265585631132126]], "qwen": [[9044, " becomes", "normal", 0.06228700652718544]]}, "loss": {"rwkv": 8.312403067621956, "qwen": 6.257695165908513}, "topk": {"rwkv": [51019, 8, 0.025265585631132126, [[59847, 0.472686, " increases", false], [38642, 0.159179, " grows", false], [47181, 0.078581, " scales", false], [4600, 0.036097, " is", false], [46342, 0.034755, " itself", false], [30659, 0.029694, " does", false], [59393, 0.02816, " continues", false], [51019, 0.025266, " becomes", false], [51682, 0.007021, " expands", false], [39529, 0.006328, " rises", false]]], "qwen": [9044, 4, 0.06228700652718544, [[12703, 0.253245, " increases", false], [5086, 0.142313, " itself", false], [27715, 0.085325, " grows", false], [9044, 0.062287, " becomes", false], [374, 0.053701, " is", false], [9539, 0.046072, " continues", false], [28405, 0.03588, " scales", false], [39296, 0.033377, " doubles", false], [37168, 0.017151, " rises", false], [5221, 0.016072, " gets", false]]]}, "raw_delta": 0.11393719911575317, "tuned_delta": 0.12074947692285112}, {"byte_start": 5886, "byte_end": 5891, "display": {"text": " very", "kind": "normal"}, "is_word": true, "word_id": 986, "word_key": " very", "bytes_hex": "20 76 65 72 79", "compression": {"rwkv": "16.91% 16.91% 16.91% 16.91% 16.91%", "qwen": "15.78% 15.78% 15.78% 15.78% 15.78%"}, "model_tokens": {"rwkv": [[32386, " very", "normal", 0.009276221506297588]], "qwen": [[1602, " very", "normal", 0.012585463002324104]]}, "loss": {"rwkv": 16.90658251041754, "qwen": 15.780244052345884}, "topk": {"rwkv": [32386, 17, 0.009276221506297588, [[31458, 0.274075, " more", false], [64430, 0.091459, " increasingly", false], [59206, 0.050145, " available", false], [51178, 0.047175, " cheaper", false], [51867, 0.038125, " greater", false], [46397, 0.037079, " larger", false], [47708, 0.036601, " vastly", false], [30789, 0.035016, " ever", false], [59988, 0.034363, " massively", false], [31277, 0.031094, " less", false]]], "qwen": [1602, 14, 0.012585463002324104, [[803, 0.190779, " more", false], [23048, 0.136486, " cheaper", false], [74151, 0.043393, " exponentially", false], [2686, 0.043111, " less", false], [3512, 0.039846, " ever", false], [14756, 0.035201, " increasingly", false], [1753, 0.026386, " much", false], [52008, 0.024412, " vastly", false], [9155, 0.018486, " smaller", false], [8131, 0.017435, " larger", false]]]}, "raw_delta": 0.0624574661254883, "tuned_delta": 0.06926974393258625}, {"byte_start": 5891, "byte_end": 5897, "display": {"text": " great", "kind": "normal"}, "is_word": true, "word_id": 987, "word_key": " great", "bytes_hex": "20 67 72 65 61 74", "compression": {"rwkv": "16.16% 16.16% 16.16% 16.16% 16.16% 16.16%", "qwen": "14.65% 14.65% 14.65% 14.65% 14.65% 14.65%"}, "model_tokens": {"rwkv": [[38629, " great", "normal", 0.00458681071177125]], "qwen": [[2244, " great", "normal", 0.00763477198779583]]}, "loss": {"rwkv": 16.15517884328787, "qwen": 14.652497629639166}, "topk": {"rwkv": [38629, 17, 0.00458681071177125, [[38864, 0.598953, " large", false], [31466, 0.063656, " much", false], [59682, 0.043693, " expensive", false], [52195, 0.034596, " massive", false], [38006, 0.030191, " cheap", false], [45, 0.022719, ",", false], [52140, 0.021351, " limited", false], [55425, 0.019658, " abundant", false], [56900, 0.013137, " powerful", false], [31082, 0.012406, " high", false]]], "qwen": [2244, 12, 0.00763477198779583, [[3460, 0.591815, " large", false], [11392, 0.079838, " expensive", false], [11872, 0.058693, " cheap", false], [33248, 0.030851, " costly", false], [10951, 0.025125, " massive", false], [1753, 0.021907, " much", false], [1550, 0.015571, " high", false], [2155, 0.015023, " different", false], [11, 0.01191, ",", false], [2613, 0.010517, " small", false]]]}, "raw_delta": 0.08332633972167969, "tuned_delta": 0.09013861752877764}, {"byte_start": 5897, "byte_end": 5898, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "3.06%", "qwen": "4.96%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.8445093631744385]], "qwen": [[13, ".", "normal", 0.7596530914306641]]}, "loss": {"rwkv": 3.064318080013179, "qwen": 4.957342404421576}, "topk": {"rwkv": [47, 1, 0.8445093631744385, [[47, 0.844509, ".", false], [45, 0.087243, ",", false], [21265, 0.016805, " and", false], [5346, 0.016698, "---", false], [275, 0.010022, " (", false], [46272, 0.005243, " indeed", false], [4596, 0.003899, " in", false], [59, 0.002177, ":", false], [57070, 0.001574, " relative", false], [4715, 0.001494, " or", false]]], "qwen": [13, 1, 0.7596530914306641, [[13, 0.759653, ".", false], [11, 0.090143, ",", false], [12824, 0.03693, " indeed", false], [323, 0.028389, " and", false], [382, 0.018928, ".\n\n", false], [320, 0.013618, " (", false], [304, 0.013529, " in", false], [4421, 0.007694, "---", false], [7707, 0.004819, " compared", false], [624, 0.002992, ".\n", false]]]}, "raw_delta": -0.10497155785560608, "tuned_delta": -0.09815928004850813}, {"byte_start": 5898, "byte_end": 5902, "display": {"text": " The", "kind": "normal"}, "is_word": true, "word_id": 988, "word_key": " the", "bytes_hex": "20 54 68 65", "compression": {"rwkv": "8.91% 8.91% 8.91% 8.91%", "qwen": "9.63% 9.63% 9.63% 9.63%"}, "model_tokens": {"rwkv": [[20996, " The", "normal", 0.13770712912082672]], "qwen": [[576, " The", "normal", 0.11811265349388123]]}, "loss": {"rwkv": 8.91117786486591, "qwen": 9.63051465014783}, "topk": {"rwkv": [20996, 1, 0.13770712912082672, [[20996, 0.137707, " The", false], [29894, 0.090312, " This", false], [37453, 0.070147, " These", false], [49964, 0.047968, " Another", false], [3913, 0.044648, " In", false], [3918, 0.040281, " It", false], [4331, 0.032427, " We", false], [300, 0.026347, " A", false], [37451, 0.023923, " There", false], [20556, 0.023614, " One", false]]], "qwen": [576, 1, 0.11811265349388123, [[576, 0.118113, " The", false], [4220, 0.089386, " These", false], [1096, 0.089242, " This", false], [758, 0.044741, " In", false], [1084, 0.040934, " It", false], [18801, 0.036011, " Methods", false], [3251, 0.02725, " General", false], [15132, 0.026036, " Such", false], [1205, 0.022733, " We", false], [362, 0.021711, " A", false]]]}, "raw_delta": -0.03988850116729736, "tuned_delta": -0.033076223360199414}, {"byte_start": 5902, "byte_end": 5906, "display": {"text": " two", "kind": "normal"}, "is_word": true, "word_id": 989, "word_key": " two", "bytes_hex": "20 74 77 6f", "compression": {"rwkv": "25.22% 25.22% 25.22% 25.22%", "qwen": "22.49% 22.49% 22.49% 22.49%"}, "model_tokens": {"rwkv": [[22638, " two", "normal", 0.0037750103510916233]], "qwen": [[1378, " two", "normal", 0.006819556001573801]]}, "loss": {"rwkv": 25.218985578039494, "qwen": 22.487832289277748}, "topk": {"rwkv": [22638, 43, 0.0037750103510916233, [[52224, 0.050579, " methods", false], [45315, 0.043658, " bitter", false], [39193, 0.038873, " other", false], [51832, 0.033008, " general", false], [31461, 0.030215, " most", false], [46430, 0.02493, " lesson", false], [38720, 0.024263, " human", false], [39339, 0.023678, " power", false], [38629, 0.020144, " great", false], [31458, 0.013191, " more", false]]], "qwen": [1378, 22, 0.006819556001573801, [[25180, 0.054846, " bitter", false], [2244, 0.045813, " great", false], [2355, 0.035684, " power", false], [1429, 0.035433, " most", false], [1008, 0.02844, " other", false], [803, 0.023813, " more", false], [1850, 0.019804, " best", false], [17755, 0.019538, " lesson", false], [4586, 0.018616, " general", false], [16724, 0.018521, " ultimate", false]]]}, "raw_delta": 0.15144729614257812, "tuned_delta": 0.15825957394967607}, {"byte_start": 5906, "byte_end": 5914, "display": {"text": " methods", "kind": "normal"}, "is_word": true, "word_id": 990, "word_key": " methods", "bytes_hex": "20 6d 65 74 68 6f 64 73", "compression": {"rwkv": "6.23% 6.23% 6.23% 6.23% 6.23% 6.23% 6.23% 6.23%", "qwen": "7.09% 7.09% 7.09% 7.09% 7.09% 7.09% 7.09% 7.09%"}, "model_tokens": {"rwkv": [[52224, " methods", "normal", 0.06277221441268921]], "qwen": [[5413, " methods", "normal", 0.04310791566967964]]}, "loss": {"rwkv": 6.234302300716467, "qwen": 7.0873491476948125}, "topk": {"rwkv": [52224, 3, 0.06277221441268921, [[31461, 0.228635, " most", false], [56162, 0.087916, " examples", false], [52224, 0.062772, " methods", false], [61590, 0.052657, " approaches", false], [31356, 0.042911, " main", false], [51832, 0.038115, " general", false], [39193, 0.026055, " other", false], [21357, 0.024227, " big", false], [38841, 0.021855, " kinds", false], [51200, 0.020609, " classes", false]]], "qwen": [5413, 3, 0.04310791566967964, [[1429, 0.319986, " most", false], [2244, 0.061233, " great", false], [5413, 0.043108, " methods", false], [1850, 0.038617, " best", false], [1887, 0.037959, " main", false], [19827, 0.027477, " approaches", false], [6846, 0.022287, " classes", false], [10295, 0.02201, " examples", false], [3598, 0.021598, " major", false], [4586, 0.016298, " general", false]]]}, "raw_delta": -0.047302961349487305, "tuned_delta": -0.040490683542389355}, {"byte_start": 5914, "byte_end": 5919, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 991, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"rwkv": "2.09% 2.09% 2.09% 2.09% 2.09%", "qwen": "1.54% 1.54% 1.54% 1.54% 1.54%"}, "model_tokens": {"rwkv": [[32227, " that", "normal", 0.5586978793144226]], "qwen": [[429, " that", "normal", 0.651837944984436]]}, "loss": {"rwkv": 2.0851451762848296, "qwen": 1.5435369822310456}, "topk": {"rwkv": [32227, 1, 0.5586978793144226, [[32227, 0.558698, " that", false], [31461, 0.039686, " most", false], [60003, 0.037093, " mentioned", false], [45, 0.036928, ",", false], [4596, 0.034776, " in", false], [21286, 0.028525, " are", false], [4706, 0.025622, " of", false], [59546, 0.022228, " discussed", false], [4858, 0.016763, " we", false], [5346, 0.012166, "---", false]]], "qwen": [429, 1, 0.651837944984436, [[429, 0.651838, " that", false], [315, 0.050855, " of", false], [1429, 0.033235, " most", false], [11, 0.026012, ",", false], [448, 0.022792, " with", false], [369, 0.017932, " for", false], [304, 0.012973, " in", false], [582, 0.011556, " we", false], [4421, 0.010776, "---", false], [525, 0.009607, " are", false]]]}, "raw_delta": 0.030033135414123547, "tuned_delta": 0.03684541322122149}, {"byte_start": 5919, "byte_end": 5924, "display": {"text": " seem", "kind": "normal"}, "is_word": true, "word_id": 992, "word_key": " seem", "bytes_hex": "20 73 65 65 6d", "compression": {"rwkv": "17.70% 17.70% 17.70% 17.70% 17.70%", "qwen": "14.39% 14.39% 14.39% 14.39% 14.39%"}, "model_tokens": {"rwkv": [[31967, " seem", "normal", 0.007489132694900036]], "qwen": [[2803, " seem", "normal", 0.01850428618490696]]}, "loss": {"rwkv": 17.69555636090369, "qwen": 14.389991337219216}, "topk": {"rwkv": [31967, 17, 0.007489132694900036, [[31059, 0.226369, " have", false], [21286, 0.099244, " are", false], [56041, 0.086935, " dominate", false], [22777, 0.037631, " won", false], [56540, 0.036752, " leverage", false], [22770, 0.025204, " win", false], [39590, 0.023196, " scale", false], [4491, 0.022573, " do", false], [31461, 0.016046, " most", false], [52597, 0.013783, " provide", false]]], "qwen": [2803, 5, 0.01850428618490696, [[614, 0.365672, " have", false], [525, 0.109491, " are", false], [40736, 0.044416, " dominate", false], [582, 0.019356, " we", false], [2803, 0.018504, " seem", false], [653, 0.01835, " do", false], [358, 0.015936, " I", false], [1033, 0.015454, " were", false], [975, 0.013802, " work", false], [29701, 0.01267, " dominated", false]]]}, "raw_delta": 0.18329944610595694, "tuned_delta": 0.1901117239130549}, {"byte_start": 5924, "byte_end": 5927, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 993, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "2.88% 2.88% 2.88%", "qwen": "2.36% 2.36% 2.36%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.6248975396156311]], "qwen": [[311, " to", "normal", 0.6752561926841736]]}, "loss": {"rwkv": 2.8764671632307617, "qwen": 2.360387894722458}, "topk": {"rwkv": [4811, 1, 0.6248975396156311, [[4811, 0.624898, " to", false], [31461, 0.196703, " most", false], [46439, 0.017868, " likely", false], [30273, 0.017616, " best", false], [22590, 0.011961, " the", false], [31296, 0.009185, " like", false], [45, 0.007808, ",", false], [55971, 0.006953, " destined", false], [61953, 0.006528, " especially", false], [64507, 0.004505, " particularly", false]]], "qwen": [311, 1, 0.6752561926841736, [[311, 0.675256, " to", false], [1429, 0.155037, " most", false], [1850, 0.035498, " best", false], [4363, 0.016922, " likely", false], [279, 0.012212, " the", false], [7945, 0.004961, " particularly", false], [5310, 0.003635, " especially", false], [3245, 0.0036, " least", false], [2677, 0.0034, " always", false], [1075, 0.002733, " like", false]]]}, "raw_delta": 0.02861751119295758, "tuned_delta": 0.03542978900005553}, {"byte_start": 5927, "byte_end": 5933, "display": {"text": " scale", "kind": "normal"}, "is_word": true, "word_id": 994, "word_key": " scale", "bytes_hex": "20 73 63 61 6c 65", "compression": {"rwkv": "12.96% 12.96% 12.96% 12.96% 12.96% 12.96%", "qwen": "11.71% 11.71% 11.71% 11.71% 11.71% 11.71%"}, "model_tokens": {"rwkv": [[39590, " scale", "normal", 0.013419545255601406]], "qwen": [[5452, " scale", "normal", 0.02033877931535244]]}, "loss": {"rwkv": 12.96171325798678, "qwen": 11.707547691429212}, "topk": {"rwkv": [39590, 11, 0.013419545255601406, [[4435, 0.229017, " be", false], [31059, 0.178862, " have", false], [56041, 0.089998, " dominate", false], [22770, 0.035637, " win", false], [4491, 0.033506, " do", false], [32499, 0.026822, " work", false], [52597, 0.019016, " provide", false], [39169, 0.01608, " offer", false], [4660, 0.015953, " me", false], [31461, 0.015083, " most", false]]], "qwen": [5452, 6, 0.02033877931535244, [[614, 0.291799, " have", false], [387, 0.190763, " be", false], [975, 0.063204, " work", false], [40736, 0.052469, " dominate", false], [653, 0.026229, " do", false], [5452, 0.020339, " scale", false], [3010, 0.016682, " offer", false], [6359, 0.01375, " deliver", false], [1850, 0.013632, " best", false], [3410, 0.01356, " provide", false]]]}, "raw_delta": 0.06954570611317956, "tuned_delta": 0.07635798392027751}, {"byte_start": 5933, "byte_end": 5945, "display": {"text": " arbitrarily", "kind": "normal"}, "is_word": true, "word_id": 995, "word_key": " arbitrarily", "bytes_hex": "20 61 72 62 69 74 72 61 72 69 6c 79", "compression": {"rwkv": "16.62% 16.62% 16.62% 16.62% 16.62% 16.62% 16.62% 16.62% 16.62% 16.62% 16.62% 16.62%", "qwen": "15.63% 15.63% 15.63% 15.63% 15.63% 15.63% 15.63% 15.63% 15.63% 15.63% 15.63% 15.63%"}, "model_tokens": {"rwkv": [[63293, " arbitrarily", "normal", 1.606444493518211e-05]], "qwen": [[85657, " arbitrarily", "normal", 3.0418892492889427e-05]]}, "loss": {"rwkv": 16.62480613524391, "qwen": 15.62986786854872}, "topk": {"rwkv": [63293, 526, 1.606444493518211e-05, [[30273, 0.244124, " best", false], [31461, 0.181753, " most", false], [32487, 0.129193, " with", false], [22590, 0.0861, " the", false], [4596, 0.067824, " in", false], [21286, 0.034138, " are", false], [4811, 0.016759, " to", false], [32234, 0.014585, " this", false], [45, 0.013214, ",", false], [4788, 0.012663, " so", false]]], "qwen": [85657, 371, 3.0418892492889427e-05, [[279, 0.217243, " the", false], [1850, 0.180104, " best", false], [1429, 0.147235, " most", false], [1632, 0.076015, " well", false], [773, 0.056074, " so", false], [448, 0.047299, " with", false], [304, 0.03944, " in", false], [525, 0.015779, " are", false], [1602, 0.011276, " very", false], [311, 0.010897, " to", false]]]}, "raw_delta": 0.055171092351277706, "tuned_delta": 0.061983370158375656}, {"byte_start": 5945, "byte_end": 5948, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 996, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "24.98% 24.98% 24.98%", "qwen": "19.13% 19.13% 19.13%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.015737194567918777]], "qwen": [[304, " in", "normal", 0.04151996970176697]]}, "loss": {"rwkv": 24.984171932061475, "qwen": 19.125211734531785}, "topk": {"rwkv": [4596, 7, 0.015737194567918777, [[32458, 0.476776, " well", false], [21286, 0.199652, " are", false], [45, 0.08903, ",", false], [32487, 0.075016, " with", false], [5346, 0.021921, "---", false], [30826, 0.016116, " fast", false], [4596, 0.015737, " in", false], [275, 0.011467, " (", false], [21265, 0.008432, " and", false], [31466, 0.008316, " much", false]]], "qwen": [304, 5, 0.04151996970176697, [[1632, 0.421549, " well", false], [448, 0.154494, " with", false], [525, 0.142794, " are", false], [11, 0.07809, ",", false], [304, 0.04152, " in", false], [323, 0.027385, " and", false], [320, 0.014245, " (", false], [4421, 0.01004, "---", false], [438, 0.008332, " as", false], [311, 0.007703, " to", false]]]}, "raw_delta": 0.32488973935445165, "tuned_delta": 0.33170201716154957}, {"byte_start": 5948, "byte_end": 5953, "display": {"text": " this", "kind": "normal"}, "is_word": true, "word_id": 997, "word_key": " this", "bytes_hex": "20 74 68 69 73", "compression": {"rwkv": "2.13% 2.13% 2.13% 2.13% 2.13%", "qwen": "3.12% 3.12% 3.12% 3.12% 3.12%"}, "model_tokens": {"rwkv": [[32234, " this", "normal", 0.5535080432891846]], "qwen": [[419, " this", "normal", 0.42092493176460266]]}, "loss": {"rwkv": 2.1274116325608734, "qwen": 3.1209128408892304}, "topk": {"rwkv": [32234, 1, 0.5535080432891846, [[32234, 0.553508, " this", false], [22590, 0.104314, " the", false], [39339, 0.039404, " power", false], [32227, 0.035338, " that", false], [332, 0.032027, " a", false], [21256, 0.01801, " all", false], [3609, 0.016401, " AI", false], [63370, 0.014511, " computation", false], [39920, 0.013304, " terms", false], [39931, 0.011872, " their", false]]], "qwen": [419, 1, 0.42092493176460266, [[419, 0.420925, " this", false], [279, 0.199113, " the", false], [264, 0.028031, " a", false], [3793, 0.022434, " terms", false], [429, 0.019819, " that", false], [15235, 0.015791, " AI", false], [6588, 0.015505, " practice", false], [862, 0.015268, " their", false], [678, 0.014585, " all", false], [34447, 0.011417, " computation", false]]]}, "raw_delta": -0.055091404914855965, "tuned_delta": -0.048279127107758016}, {"byte_start": 5953, "byte_end": 5957, "display": {"text": " way", "kind": "normal"}, "is_word": true, "word_id": 998, "word_key": " way", "bytes_hex": "20 77 61 79", "compression": {"rwkv": "0.93% 0.93% 0.93% 0.93%", "qwen": "1.40% 1.40% 1.40% 1.40%"}, "model_tokens": {"rwkv": [[22752, " way", "normal", 0.8144123554229736]], "qwen": [[1616, " way", "normal", 0.7331099510192871]]}, "loss": {"rwkv": 0.928981486900547, "qwen": 1.3996826851072117}, "topk": {"rwkv": [22752, 1, 0.8144123554229736, [[22752, 0.814412, " way", false], [51717, 0.053353, " fashion", false], [46505, 0.041816, " manner", false], [39631, 0.024686, " sense", false], [47043, 0.02076, " regard", false], [52731, 0.014053, " respect", false], [59526, 0.00807, " direction", false], [51310, 0.002755, " context", false], [30405, 0.002493, " case", false], [32375, 0.001623, " vein", false]]], "qwen": [1616, 1, 0.7331099510192871, [[1616, 0.73311, " way", false], [5530, 0.073809, " sense", false], [11566, 0.067566, " manner", false], [5091, 0.025314, " respect", false], [5250, 0.023959, " regard", false], [11153, 0.023104, " fashion", false], [4586, 0.003667, " general", false], [5106, 0.003347, " direction", false], [2266, 0.003034, " context", false], [8913, 0.002671, " spirit", false]]]}, "raw_delta": -0.026101216673851013, "tuned_delta": -0.019288938866753067}, {"byte_start": 5957, "byte_end": 5961, "display": {"text": " are", "kind": "normal"}, "is_word": true, "word_id": 999, "word_key": " are", "bytes_hex": "20 61 72 65", "compression": {"rwkv": "0.91% 0.91% 0.91% 0.91%", "qwen": "1.42% 1.42% 1.42% 1.42%"}, "model_tokens": {"rwkv": [[21286, " are", "normal", 0.8177302479743958]], "qwen": [[525, " are", "normal", 0.7301681637763977]]}, "loss": {"rwkv": 0.9069677075901075, "qwen": 1.4178103283153818}, "topk": {"rwkv": [21286, 1, 0.8177302479743958, [[21286, 0.81773, " are", false], [45, 0.087533, ",", false], [5346, 0.025124, "---", false], [4596, 0.013658, " in", false], [275, 0.011878, " (", false], [21265, 0.008041, " and", false], [31059, 0.003917, " have", false], [32462, 0.001929, " were", false], [21700, 0.001804, " for", false], [32227, 0.001577, " that", false]]], "qwen": [525, 1, 0.7301681637763977, [[525, 0.730168, " are", false], [11, 0.117868, ",", false], [4421, 0.057707, "---", false], [320, 0.011839, " (", false], [323, 0.009408, " and", false], [614, 0.008631, " have", false], [304, 0.008361, " in", false], [313, 0.004455, "--", false], [1033, 0.003958, " were", false], [448, 0.002738, " with", false]]]}, "raw_delta": -0.028327129781246185, "tuned_delta": -0.02151485197414824}, {"byte_start": 5961, "byte_end": 5968, "display": {"text": " search", "kind": "normal"}, "is_word": true, "word_id": 1000, "word_key": " search", "bytes_hex": "20 73 65 61 72 63 68", "compression": {"rwkv": "1.92% 1.92% 1.92% 1.92% 1.92% 1.92% 1.92%", "qwen": "1.19% 1.19% 1.19% 1.19% 1.19% 1.19% 1.19%"}, "model_tokens": {"rwkv": [[47202, " search", "normal", 0.473209947347641]], "qwen": [[2711, " search", "normal", 0.6300439238548279]]}, "loss": {"rwkv": 1.922117416362946, "qwen": 1.190135069230555}, "topk": {"rwkv": [47202, 1, 0.473209947347641, [[47202, 0.47321, " search", false], [56537, 0.205765, " learning", false], [30597, 0.056139, " deep", false], [22590, 0.024061, " the", false], [51832, 0.019412, " general", false], [275, 0.013867, " (", false], [52224, 0.012761, " methods", false], [59, 0.012481, ":", false], [284, 0.011654, " 1", false], [31978, 0.010081, " self", false]]], "qwen": [2711, 1, 0.6300439238548279, [[2711, 0.630044, " search", false], [5538, 0.037948, " deep", false], [220, 0.03342, " ", false], [71278, 0.0333, " reinforcement", false], [6832, 0.030104, " learning", false], [279, 0.020244, " the", false], [320, 0.019229, " (", false], [29728, 0.015948, " neural", false], [5413, 0.006827, " methods", false], [4586, 0.006082, " general", false]]]}, "raw_delta": 0.040589720010757446, "tuned_delta": 0.047401997817855396}, {"byte_start": 5968, "byte_end": 5972, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 1001, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"rwkv": "0.78% 0.78% 0.78% 0.78%", "qwen": "0.94% 0.94% 0.94% 0.94%"}, "model_tokens": {"rwkv": [[21265, " and", "normal", 0.840074896812439]], "qwen": [[323, " and", "normal", 0.8115851879119873]]}, "loss": {"rwkv": 0.7836905434516463, "qwen": 0.9412047507262832}, "topk": {"rwkv": [21265, 1, 0.840074896812439, [[21265, 0.840075, " and", false], [45, 0.03934, ",", false], [275, 0.038061, " (", false], [4450, 0.017494, " by", false], [52224, 0.007763, " methods", false], [4596, 0.007524, " in", false], [48, 0.007513, "/", false], [21700, 0.007366, " for", false], [46, 0.007194, "-", false], [5346, 0.005268, "---", false]]], "qwen": [323, 1, 0.8115851879119873, [[323, 0.811585, " and", false], [11, 0.049152, ",", false], [5980, 0.035495, "-based", false], [320, 0.035066, " (", false], [5413, 0.017255, " methods", false], [3118, 0.00808, " based", false], [448, 0.006759, " with", false], [304, 0.004219, " in", false], [553, 0.004205, " by", false], [4421, 0.003902, "---", false]]]}, "raw_delta": -0.008734442293643951, "tuned_delta": -0.0019221644865460045}, {"byte_start": 5972, "byte_end": 5981, "display": {"text": " learning", "kind": "normal"}, "is_word": true, "word_id": 1002, "word_key": " learning", "bytes_hex": "20 6c 65 61 72 6e 69 6e 67", "compression": {"rwkv": "0.11% 0.11% 0.11% 0.11% 0.11% 0.11% 0.11% 0.11% 0.11%", "qwen": "0.45% 0.45% 0.45% 0.45% 0.45% 0.45% 0.45% 0.45% 0.45%"}, "model_tokens": {"rwkv": [[56537, " learning", "normal", 0.947810173034668]], "qwen": [[6832, " learning", "normal", 0.7982138395309448]]}, "loss": {"rwkv": 0.10762292107325978, "qwen": 0.4516011214976917}, "topk": {"rwkv": [56537, 1, 0.947810173034668, [[56537, 0.94781, " learning", false], [30597, 0.009785, " deep", false], [31978, 0.008204, " self", false], [63885, 0.003209, " statistical", false], [63370, 0.003004, " computation", false], [22590, 0.002413, " the", false], [62577, 0.00187, " statistics", false], [52167, 0.001845, " machine", false], [45, 0.001423, ",", false], [51832, 0.001074, " general", false]]], "qwen": [6832, 1, 0.7982138395309448, [[6832, 0.798214, " learning", false], [5538, 0.078967, " deep", false], [5662, 0.018328, " machine", false], [71278, 0.009165, " reinforcement", false], [29728, 0.007465, " neural", false], [4586, 0.007452, " general", false], [279, 0.006766, " the", false], [656, 0.006574, " self", false], [28464, 0.004518, " statistical", false], [11, 0.004284, ",", false]]]}, "raw_delta": -0.019074201583862305, "tuned_delta": -0.012261923776764359}, {"byte_start": 5981, "byte_end": 5983, "display": {"text": ".\n", "kind": "control"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e 0a", "compression": {"rwkv": "7.11% 29.45%", "qwen": "20.61% 20.61%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.6763617992401123], [261, "\n\n", "control", 0.038585204631090164]], "qwen": [[382, ".\n\n", "control", 0.03244423121213913]]}, "loss": {"rwkv": 18.280242339388963, "qwen": 20.607891365885145}, "topk": {"rwkv": [47, 1, 0.6763617992401123, [[47, 0.676362, ".", false], [45, 0.129314, ",", false], [4450, 0.095429, " by", false], [5346, 0.041833, "---", false], [275, 0.022056, " (", false], [60, 0.007513, ";", false], [37810, 0.003502, " based", false], [22705, 0.002626, " via", false], [4596, 0.002519, " in", false], [59, 0.002457, ":", false]]], "qwen": [382, 4, 0.03244423121213913, [[13, 0.64142, ".", false], [11, 0.169912, ",", false], [553, 0.05934, " by", false], [382, 0.032444, ".\n\n", false], [320, 0.022388, " (", false], [4421, 0.014733, "---", false], [26, 0.010116, ";", false], [25, 0.006254, ":", false], [624, 0.004282, ".\n", false], [389, 0.003554, " on", false]]]}, "raw_delta": -0.12907226880391431, "tuned_delta": -0.12225999099681636}, {"byte_start": 5983, "byte_end": 5984, "display": {"text": "\n", "kind": "control"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "0a", "compression": {"rwkv": "29.45%", "qwen": "20.61%"}, "model_tokens": {"rwkv": [[261, "\n\n", "control", 0.038585204631090164]], "qwen": [[382, ".\n\n", "control", 0.03244423121213913]]}, "loss": {"rwkv": 29.445631205643878, "qwen": 20.607891365885145}, "topk": {"rwkv": [261, 6, 0.038585204631090164, [[20996, 0.122226, " The", false], [44844, 0.094718, " Search", false], [37453, 0.067758, " These", false], [29893, 0.049292, " They", false], [3913, 0.038789, " In", false], [261, 0.038585, "\n\n", false], [29894, 0.03134, " This", false], [37451, 0.029414, " There", false], [3918, 0.029161, " It", false], [28530, 0.028818, " Both", false]]], "qwen": [382, 4, 0.03244423121213913, [[13, 0.64142, ".", false], [11, 0.169912, ",", false], [553, 0.05934, " by", false], [382, 0.032444, ".\n\n", false], [320, 0.022388, " (", false], [4421, 0.014733, "---", false], [26, 0.010116, ";", false], [25, 0.006254, ":", false], [624, 0.004282, ".\n", false], [389, 0.003554, " on", false]]]}, "raw_delta": 0.4900683561960857, "tuned_delta": 0.4968806340031836}, {"byte_start": 5984, "byte_end": 5987, "display": {"text": "The", "kind": "normal"}, "is_word": true, "word_id": 1003, "word_key": "the", "bytes_hex": "54 68 65", "compression": {"rwkv": "10.71% 10.71% 10.71%", "qwen": "11.43% 11.43% 11.43%"}, "model_tokens": {"rwkv": [[6699, "The", "normal", 0.16899217665195465]], "qwen": [[785, "The", "normal", 0.14927057921886444]]}, "loss": {"rwkv": 10.707502256597774, "qwen": 11.433325654194736}, "topk": {"rwkv": [6699, 1, 0.16899217665195465, [[6699, 0.168992, "The", false], [48358, 0.069605, "Another", false], [1136, 0.064038, "In", false], [66, 0.062628, "A", false], [40754, 0.059403, "Search", false], [33504, 0.041702, "There", false], [1141, 0.028412, "It", false], [24242, 0.028314, "This", false], [1589, 0.024375, "We", false], [6393, 0.020194, "One", false]]], "qwen": [785, 1, 0.14927057921886444, [[785, 0.149271, "The", false], [5890, 0.131513, "Search", false], [641, 0.051216, "In", false], [14037, 0.033545, "Another", false], [32, 0.029603, "A", false], [3862, 0.029517, "There", false], [2132, 0.018916, "It", false], [1986, 0.01801, "This", false], [3966, 0.017081, "One", false], [1654, 0.015245, "We", false]]]}, "raw_delta": -0.040248195330301884, "tuned_delta": -0.033435917523203934}, {"byte_start": 5987, "byte_end": 5994, "display": {"text": " second", "kind": "normal"}, "is_word": true, "word_id": 1004, "word_key": " second", "bytes_hex": "20 73 65 63 6f 6e 64", "compression": {"rwkv": "6.88% 6.88% 6.88% 6.88% 6.88% 6.88% 6.88%", "qwen": "7.41% 7.41% 7.41% 7.41% 7.41% 7.41% 7.41%"}, "model_tokens": {"rwkv": [[47205, " second", "normal", 0.06916861981153488]], "qwen": [[2086, " second", "normal", 0.05633553862571716]]}, "loss": {"rwkv": 6.883394307812853, "qwen": 7.410376790125389}, "topk": {"rwkv": [47205, 2, 0.06916861981153488, [[39193, 0.091451, " other", false], [47205, 0.069169, " second", false], [45315, 0.048326, " bitter", false], [47202, 0.036932, " search", false], [38499, 0.035915, " first", false], [46430, 0.022249, " lesson", false], [31515, 0.020069, " next", false], [19523, 0.018819, " Bit", false], [45184, 0.018172, " appeal", false], [31461, 0.016726, " most", false]]], "qwen": [2086, 3, 0.05633553862571716, [[25180, 0.123237, " bitter", false], [1008, 0.085452, " other", false], [2086, 0.056336, " second", false], [17755, 0.025586, " lesson", false], [1156, 0.024374, " first", false], [425, 0.024121, " B", false], [1378, 0.023931, " two", false], [2711, 0.02016, " search", false], [1790, 0.019953, " next", false], [1429, 0.018854, " most", false]]]}, "raw_delta": -0.02922211374555317, "tuned_delta": -0.022409835938455223}, {"byte_start": 5994, "byte_end": 6002, "display": {"text": " general", "kind": "normal"}, "is_word": true, "word_id": 1005, "word_key": " general", "bytes_hex": "20 67 65 6e 65 72 61 6c", "compression": {"rwkv": "12.89% 12.89% 12.89% 12.89% 12.89% 12.89% 12.89% 12.89%", "qwen": "13.77% 13.77% 13.77% 13.77% 13.77% 13.77% 13.77% 13.77%"}, "model_tokens": {"rwkv": [[51832, " general", "normal", 0.003289558459073305]], "qwen": [[4586, " general", "normal", 0.0022193738259375095]]}, "loss": {"rwkv": 12.891269164193373, "qwen": 13.774423723988388}, "topk": {"rwkv": [51832, 20, 0.003289558459073305, [[46430, 0.413227, " lesson", false], [39941, 0.324533, " thing", false], [21357, 0.032612, " big", false], [45, 0.032051, ",", false], [59829, 0.026184, " important", false], [38629, 0.018079, " great", false], [45315, 0.012816, " bitter", false], [4600, 0.011624, " is", false], [38961, 0.011437, " major", false], [21365, 0.008381, " bit", false]]], "qwen": [4586, 32, 0.0022193738259375095, [[17755, 0.239377, " lesson", false], [3166, 0.11453, " thing", false], [25180, 0.067352, " bitter", false], [2409, 0.06589, " big", false], [1429, 0.053341, " most", false], [2989, 0.039198, " important", false], [2244, 0.033994, " great", false], [949, 0.02987, " part", false], [374, 0.025651, " is", false], [1459, 0.022695, " point", false]]]}, "raw_delta": -0.048972487449645996, "tuned_delta": -0.04216020964254805}, {"byte_start": 6002, "byte_end": 6008, "display": {"text": " point", "kind": "normal"}, "is_word": true, "word_id": 1006, "word_key": " point", "bytes_hex": "20 70 6f 69 6e 74", "compression": {"rwkv": "12.59% 12.59% 12.59% 12.59% 12.59% 12.59%", "qwen": "13.17% 13.17% 13.17% 13.17% 13.17% 13.17%"}, "model_tokens": {"rwkv": [[39310, " point", "normal", 0.015390230342745781]], "qwen": [[1459, " point", "normal", 0.012501237913966179]]}, "loss": {"rwkv": 12.586011424421944, "qwen": 13.170385541033655}, "topk": {"rwkv": [39310, 4, 0.015390230342745781, [[46430, 0.800983, " lesson", false], [46561, 0.046896, " method", false], [60250, 0.019973, " principle", false], [39310, 0.01539, " point", false], [63729, 0.015363, " observation", false], [52022, 0.009797, " insight", false], [38046, 0.007357, " class", false], [61735, 0.005877, " conclusion", false], [46, 0.005865, "-", false], [55532, 0.004892, " approach", false]]], "qwen": [1459, 8, 0.012501237913966179, [[17755, 0.291199, " lesson", false], [1714, 0.180131, " method", false], [58238, 0.152266, "-purpose", false], [2022, 0.074681, "ization", false], [7428, 0.073605, " purpose", false], [17508, 0.0455, " principle", false], [5486, 0.015525, " approach", false], [1459, 0.012501, " point", false], [5912, 0.009425, " rule", false], [8335, 0.008556, "izable", false]]]}, "raw_delta": -0.03240458170572924, "tuned_delta": -0.025592303898631295}, {"byte_start": 6008, "byte_end": 6011, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 1007, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "13.34% 13.34% 13.34%", "qwen": "10.77% 10.77% 10.77%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.1100921556353569]], "qwen": [[311, " to", "normal", 0.16670064628124237]]}, "loss": {"rwkv": 13.337415091551614, "qwen": 10.769451840627315}, "topk": {"rwkv": [4811, 3, 0.1100921556353569, [[4600, 0.549363, " is", false], [32227, 0.147492, " that", false], [4811, 0.110092, " to", false], [45, 0.042519, ",", false], [4706, 0.029514, " of", false], [30917, 0.019319, " from", false], [4858, 0.017795, " we", false], [37598, 0.011336, " about", false], [47266, 0.010408, " should", false], [55817, 0.004495, " concerns", false]]], "qwen": [311, 3, 0.16670064628124237, [[374, 0.369789, " is", false], [429, 0.215947, " that", false], [311, 0.166701, " to", false], [911, 0.052649, " about", false], [315, 0.040486, " of", false], [504, 0.027561, " from", false], [11, 0.024677, ",", false], [582, 0.01348, " we", false], [304, 0.010125, " in", false], [358, 0.009444, " I", false]]]}, "raw_delta": 0.14239811897277832, "tuned_delta": 0.14921039677987627}, {"byte_start": 6011, "byte_end": 6014, "display": {"text": " be", "kind": "normal"}, "is_word": true, "word_id": 1008, "word_key": " be", "bytes_hex": "20 62 65", "compression": {"rwkv": "4.25% 4.25% 4.25%", "qwen": "4.18% 4.18% 4.18%"}, "model_tokens": {"rwkv": [[4435, " be", "normal", 0.4932868778705597]], "qwen": [[387, " be", "normal", 0.4988078474998474]]}, "loss": {"rwkv": 4.250126992202187, "qwen": 4.1810164805473455}, "topk": {"rwkv": [4435, 1, 0.4932868778705597, [[4435, 0.493287, " be", false], [38877, 0.18477, " learn", false], [32187, 0.108555, " take", false], [31358, 0.032324, " make", false], [31539, 0.029765, " note", false], [62683, 0.023968, " understand", false], [30681, 0.01337, " draw", false], [45846, 0.011189, " emerge", false], [30482, 0.010128, " come", false], [38625, 0.008339, " grasp", false]]], "qwen": [387, 1, 0.4988078474998474, [[387, 0.498808, " be", false], [3960, 0.15009, " learn", false], [1281, 0.088365, " make", false], [1896, 0.042628, " take", false], [5185, 0.040671, " note", false], [3535, 0.036939, " understand", false], [32944, 0.021993, " emerge", false], [4038, 0.017, " draw", false], [2908, 0.011306, " consider", false], [2525, 0.009433, " come", false]]]}, "raw_delta": 0.0038323005040486746, "tuned_delta": 0.01064457831114662}, {"byte_start": 6014, "byte_end": 6022, "display": {"text": " learned", "kind": "normal"}, "is_word": true, "word_id": 1009, "word_key": " learned", "bytes_hex": "20 6c 65 61 72 6e 65 64", "compression": {"rwkv": "0.43% 0.43% 0.43% 0.43% 0.43% 0.43% 0.43% 0.43%", "qwen": "0.95% 0.95% 0.95% 0.95% 0.95% 0.95% 0.95% 0.95%"}, "model_tokens": {"rwkv": [[52112, " learned", "normal", 0.8249779939651489]], "qwen": [[9498, " learned", "normal", 0.6572651267051697]]}, "loss": {"rwkv": 0.4336714524156582, "qwen": 0.9460197275046579}, "topk": {"rwkv": [52112, 1, 0.8249779939651489, [[52112, 0.824978, " learned", false], [31351, 0.068919, " made", false], [38297, 0.03882, " drawn", false], [51438, 0.010926, " derived", false], [39887, 0.008519, " taken", false], [62684, 0.007748, " understood", false], [59697, 0.006574, " extracted", false], [39140, 0.00359, " noted", false], [46071, 0.003196, " gained", false], [31968, 0.002395, " seen", false]]], "qwen": [9498, 1, 0.6572651267051697, [[9498, 0.657265, " learned", false], [1865, 0.20109, " made", false], [14764, 0.041951, " drawn", false], [15985, 0.020831, " understood", false], [4429, 0.011879, " taken", false], [94016, 0.009719, " glean", false], [14257, 0.008286, " derived", false], [49250, 0.004656, " learnt", false], [10342, 0.004631, " noted", false], [27432, 0.004047, " extracted", false]]]}, "raw_delta": -0.028410620987415314, "tuned_delta": -0.021598343180317368}, {"byte_start": 6022, "byte_end": 6027, "display": {"text": " from", "kind": "normal"}, "is_word": true, "word_id": 1010, "word_key": " from", "bytes_hex": "20 66 72 6f 6d", "compression": {"rwkv": "3.38% 3.38% 3.38% 3.38% 3.38%", "qwen": "2.35% 2.35% 2.35% 2.35% 2.35%"}, "model_tokens": {"rwkv": [[30917, " from", "normal", 0.39024385809898376]], "qwen": [[504, " from", "normal", 0.5210452675819397]]}, "loss": {"rwkv": 3.3813165020835076, "qwen": 2.3512986474540782}, "topk": {"rwkv": [30917, 2, 0.39024385809898376, [[4600, 0.543692, " is", false], [30917, 0.390244, " from", false], [45, 0.024794, ",", false], [4450, 0.006589, " by", false], [37598, 0.004177, " about", false], [4596, 0.003888, " in", false], [31077, 0.003631, " here", false], [21800, 0.002592, " has", false], [47266, 0.001916, " should", false], [52694, 0.001646, " relates", false]]], "qwen": [504, 1, 0.5210452675819397, [[504, 0.521045, " from", false], [374, 0.421965, " is", false], [11, 0.026251, ",", false], [911, 0.004493, " about", false], [1588, 0.004179, " here", false], [304, 0.004135, " in", false], [320, 0.002605, " (", false], [553, 0.001493, " by", false], [429, 0.000956, " that", false], [702, 0.000948, " has", false]]]}, "raw_delta": 0.057116317749023426, "tuned_delta": 0.06392859555612138}, {"byte_start": 6027, "byte_end": 6031, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 1011, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "0.91% 0.91% 0.91% 0.91%", "qwen": "1.49% 1.49% 1.49% 1.49%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.8172225952148438]], "qwen": [[279, " the", "normal", 0.7185409665107727]]}, "loss": {"rwkv": 0.9069677075901075, "qwen": 1.4901802247141136}, "topk": {"rwkv": [22590, 1, 0.8172225952148438, [[22590, 0.817223, " the", false], [32234, 0.112814, " this", false], [39936, 0.01326, " these", false], [45315, 0.012509, " bitter", false], [3609, 0.00621, " AI", false], [51929, 0.003808, " history", false], [21256, 0.002581, " all", false], [3543, 0.002498, " 70", false], [62061, 0.002228, " historical", false], [31636, 0.001442, " past", false]]], "qwen": [279, 1, 0.7185409665107727, [[279, 0.718541, " the", false], [419, 0.167578, " this", false], [1493, 0.048285, " these", false], [678, 0.017376, " all", false], [25180, 0.007513, " bitter", false], [20219, 0.003286, " Moore", false], [220, 0.00309, " ", false], [264, 0.002845, " a", false], [15235, 0.002356, " AI", false], [1039, 0.002221, " our", false]]]}, "raw_delta": -0.032340168952941895, "tuned_delta": -0.02552789114584395}, {"byte_start": 6031, "byte_end": 6038, "display": {"text": " bitter", "kind": "normal"}, "is_word": true, "word_id": 1012, "word_key": " bitter", "bytes_hex": "20 62 69 74 74 65 72", "compression": {"rwkv": "0.12% 0.12% 0.12% 0.12% 0.12% 0.12% 0.12%", "qwen": "0.06% 0.06% 0.06% 0.06% 0.06% 0.06% 0.06%"}, "model_tokens": {"rwkv": [[45315, " bitter", "normal", 0.9539890289306641]], "qwen": [[25180, " bitter", "normal", 0.9765259623527527]]}, "loss": {"rwkv": 0.121390268768995, "qwen": 0.061195885097820216}, "topk": {"rwkv": [45315, 1, 0.9539890289306641, [[45315, 0.953989, " bitter", false], [61640, 0.01117, " bitterness", false], [51929, 0.003832, " history", false], [62061, 0.002373, " historical", false], [21365, 0.00234, " bit", false], [52127, 0.001435, " lessons", false], [19523, 0.001419, " Bit", false], [31636, 0.001342, " past", false], [46430, 0.001016, " lesson", false], [52427, 0.000859, " pattern", false]]], "qwen": [25180, 1, 0.9765259623527527, [[25180, 0.976526, " bitter", false], [78996, 0.005516, " bitterness", false], [17755, 0.001699, " lesson", false], [3840, 0.001541, " history", false], [425, 0.001217, " B", false], [3403, 0.00092, " above", false], [18366, 0.000657, " lessons", false], [13656, 0.000452, " historical", false], [3412, 0.000375, " research", false], [3139, 0.000287, " experience", false]]]}, "raw_delta": 0.0033378853861774716, "tuned_delta": 0.010150163193275418}, {"byte_start": 6038, "byte_end": 6045, "display": {"text": " lesson", "kind": "normal"}, "is_word": true, "word_id": 1013, "word_key": " lesson", "bytes_hex": "20 6c 65 73 73 6f 6e", "compression": {"rwkv": "0.16% 0.16% 0.16% 0.16% 0.16% 0.16% 0.16%", "qwen": "0.08% 0.08% 0.08% 0.08% 0.08% 0.08% 0.08%"}, "model_tokens": {"rwkv": [[46430, " lesson", "normal", 0.9406444430351257]], "qwen": [[17755, " lesson", "normal", 0.970899760723114]]}, "loss": {"rwkv": 0.1559833505425428, "qwen": 0.07608165533722623}, "topk": {"rwkv": [46430, 1, 0.9406444430351257, [[46430, 0.940644, " lesson", false], [52127, 0.051667, " lessons", false], [61979, 0.003533, " experience", false], [46, 0.000542, "-", false], [39899, 0.000202, " taste", false], [26127, 0.000191, "less", false], [51929, 0.000167, " history", false], [39831, 0.000143, " story", false], [4600, 0.000138, " is", false], [31636, 0.000129, " past", false]]], "qwen": [17755, 1, 0.970899760723114, [[17755, 0.9709, " lesson", false], [18366, 0.014189, " lessons", false], [3139, 0.006979, " experience", false], [3840, 0.001089, " history", false], [11, 0.000636, ",", false], [15235, 0.000578, " AI", false], [323, 0.000363, " and", false], [320, 0.000222, " (", false], [12, 0.000184, "-", false], [512, 0.000149, " le", false]]]}, "raw_delta": 0.0044306907802820214, "tuned_delta": 0.011242968587379968}, {"byte_start": 6045, "byte_end": 6048, "display": {"text": " is", "kind": "normal"}, "is_word": true, "word_id": 1014, "word_key": " is", "bytes_hex": "20 69 73", "compression": {"rwkv": "0.30% 0.30% 0.30%", "qwen": "0.40% 0.40% 0.40%"}, "model_tokens": {"rwkv": [[4600, " is", "normal", 0.9510601162910461]], "qwen": [[374, " is", "normal", 0.9348880052566528]]}, "loss": {"rwkv": 0.30085498390933985, "qwen": 0.4047272649340828}, "topk": {"rwkv": [4600, 1, 0.9510601162910461, [[4600, 0.95106, " is", false], [45, 0.018804, ",", false], [21800, 0.004104, " has", false], [4706, 0.003093, " of", false], [55817, 0.002787, " concerns", false], [47266, 0.002247, " should", false], [4596, 0.002134, " in", false], [32227, 0.001306, " that", false], [275, 0.001263, " (", false], [52694, 0.001127, " relates", false]]], "qwen": [374, 1, 0.9348880052566528, [[374, 0.934888, " is", false], [11, 0.019629, ",", false], [315, 0.014443, " of", false], [10520, 0.003587, " concerns", false], [320, 0.002818, " (", false], [429, 0.002524, " that", false], [304, 0.00217, " in", false], [702, 0.002084, " has", false], [911, 0.002025, " about", false], [4421, 0.001162, "---", false]]]}, "raw_delta": -0.00575990229845047, "tuned_delta": 0.001052375508647477}, {"byte_start": 6048, "byte_end": 6053, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 1015, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"rwkv": "1.00% 1.00% 1.00% 1.00% 1.00%", "qwen": "1.29% 1.29% 1.29% 1.29% 1.29%"}, "model_tokens": {"rwkv": [[32227, " that", "normal", 0.7583821415901184]], "qwen": [[429, " that", "normal", 0.6995595693588257]]}, "loss": {"rwkv": 1.0003061318663709, "qwen": 1.2887028716958038}, "topk": {"rwkv": [32227, 1, 0.7583821415901184, [[32227, 0.758382, " that", false], [22590, 0.141973, " the", false], [21835, 0.016936, " how", false], [4811, 0.011965, " to", false], [32234, 0.010705, " this", false], [332, 0.009552, " a", false], [37598, 0.005526, " about", false], [45, 0.005284, ",", false], [32464, 0.004995, " what", false], [22763, 0.002669, " why", false]]], "qwen": [429, 1, 0.6995595693588257, [[429, 0.69956, " that", false], [279, 0.185011, " the", false], [911, 0.015583, " about", false], [311, 0.014676, " to", false], [419, 0.011509, " this", false], [264, 0.008822, " a", false], [1246, 0.00828, " how", false], [537, 0.005344, " not", false], [1128, 0.005076, " what", false], [825, 0.00361, " one", false]]]}, "raw_delta": -0.015992110967636114, "tuned_delta": -0.009179833160538168}, {"byte_start": 6053, "byte_end": 6057, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 1016, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "7.82% 7.82% 7.82% 7.82%", "qwen": "8.51% 8.51% 8.51% 8.51%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.17741811275482178]], "qwen": [[279, " the", "normal", 0.1515452116727829]]}, "loss": {"rwkv": 7.819294411068111, "qwen": 8.506812256157275}, "topk": {"rwkv": [22590, 1, 0.17741811275482178, [[22590, 0.177418, " the", false], [45, 0.063955, ",", false], [38720, 0.056911, " human", false], [4601, 0.052147, " it", false], [39934, 0.050541, " there", false], [4858, 0.028305, " we", false], [4596, 0.024017, " in", false], [47202, 0.020797, " search", false], [52224, 0.020039, " methods", false], [332, 0.016518, " a", false]]], "qwen": [279, 1, 0.1515452116727829, [[279, 0.151545, " the", false], [1052, 0.060307, " there", false], [3738, 0.059422, " human", false], [432, 0.053269, " it", false], [11, 0.04297, ",", false], [582, 0.033542, " we", false], [304, 0.030668, " in", false], [4586, 0.024622, " general", false], [5413, 0.017795, " methods", false], [264, 0.017794, " a", false]]]}, "raw_delta": -0.03812408447265625, "tuned_delta": -0.0313118066655583}, {"byte_start": 6057, "byte_end": 6064, "display": {"text": " actual", "kind": "normal"}, "is_word": true, "word_id": 1017, "word_key": " actual", "bytes_hex": "20 61 63 74 75 61 6c", "compression": {"rwkv": "18.19% 18.19% 18.19% 18.19% 18.19% 18.19% 18.19%", "qwen": "18.34% 18.34% 18.34% 18.34% 18.34% 18.34% 18.34%"}, "model_tokens": {"rwkv": [[45098, " actual", "normal", 0.0008587700431235135]], "qwen": [[5042, " actual", "normal", 0.0008084636065177619]]}, "loss": {"rwkv": 18.194703082639826, "qwen": 18.343802213357833}, "topk": {"rwkv": [45098, 166, 0.0008587700431235135, [[38720, 0.10158, " human", false], [52224, 0.045526, " methods", false], [22638, 0.034782, " two", false], [31461, 0.029837, " most", false], [45184, 0.02263, " appeal", false], [47202, 0.018637, " search", false], [30273, 0.014544, " best", false], [22752, 0.013786, " way", false], [22681, 0.01343, " use", false], [31581, 0.0126, " only", false]]], "qwen": [5042, 193, 0.0008084636065177619, [[3738, 0.05743, " human", false], [1429, 0.036709, " most", false], [1850, 0.02961, " best", false], [1378, 0.027693, " two", false], [2070, 0.019168, " field", false], [25180, 0.013765, " bitter", false], [803, 0.013295, " more", false], [5413, 0.013289, " methods", false], [2711, 0.013264, " search", false], [1172, 0.013, " only", false]]]}, "raw_delta": -0.008267811366490019, "tuned_delta": -0.001455533559392072}, {"byte_start": 6064, "byte_end": 6073, "display": {"text": " contents", "kind": "normal"}, "is_word": true, "word_id": 1018, "word_key": " contents", "bytes_hex": "20 63 6f 6e 74 65 6e 74 73", "compression": {"rwkv": "13.53% 13.53% 13.53% 13.53% 13.53% 13.53% 13.53% 13.53% 13.53%", "qwen": "15.03% 15.03% 15.03% 15.03% 15.03% 15.03% 15.03% 15.03% 15.03%"}, "model_tokens": {"rwkv": [[55847, " contents", "normal", 0.0011853490723297]], "qwen": [[8794, " contents", "normal", 0.0005515777156688273]]}, "loss": {"rwkv": 13.52526600833403, "qwen": 15.03353856905412}, "topk": {"rwkv": [55847, 135, 0.0011853490723297, [[52224, 0.092816, " methods", false], [56950, 0.029543, " progress", false], [57103, 0.023498, " research", false], [38720, 0.020575, " human", false], [62633, 0.019326, " techniques", false], [63370, 0.019165, " computation", false], [53052, 0.01795, " success", false], [51308, 0.017488, " content", false], [60572, 0.014597, " structure", false], [22752, 0.014066, " way", false]]], "qwen": [8794, 287, 0.0005515777156688273, [[3738, 0.026625, " human", false], [3311, 0.024815, " amount", false], [5413, 0.023012, " methods", false], [5068, 0.02043, " performance", false], [2393, 0.017845, " success", false], [8129, 0.016658, " implementation", false], [897, 0.01486, " value", false], [11, 0.013857, ",", false], [6832, 0.013082, " learning", false], [990, 0.013004, " use", false]]]}, "raw_delta": -0.08363638983832467, "tuned_delta": -0.07682411203122672}, {"byte_start": 6073, "byte_end": 6076, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 1019, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "0.23% 0.23% 0.23%", "qwen": "0.24% 0.24% 0.24%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.961908757686615]], "qwen": [[315, " of", "normal", 0.9605894684791565]]}, "loss": {"rwkv": 0.23334606069065872, "qwen": 0.24170031949848864}, "topk": {"rwkv": [4706, 1, 0.961908757686615, [[4706, 0.961909, " of", false], [21265, 0.015749, " and", false], [45, 0.004857, ",", false], [4715, 0.004075, " or", false], [32227, 0.003746, " that", false], [275, 0.001559, " (", false], [4596, 0.00095, " in", false], [21286, 0.000947, " are", false], [46530, 0.00073, " matter", false], [5346, 0.000684, "---", false]]], "qwen": [315, 1, 0.9605894684791565, [[315, 0.960589, " of", false], [323, 0.017903, " and", false], [11, 0.005787, ",", false], [429, 0.002832, " that", false], [320, 0.002554, " (", false], [476, 0.002003, " or", false], [525, 0.001233, " are", false], [4925, 0.000675, " matter", false], [4421, 0.00062, "---", false], [304, 0.000604, " in", false]]]}, "raw_delta": -0.0004632584750652313, "tuned_delta": 0.006349019332032716}, {"byte_start": 6076, "byte_end": 6082, "display": {"text": " minds", "kind": "normal"}, "is_word": true, "word_id": 1020, "word_key": " minds", "bytes_hex": "20 6d 69 6e 64 73", "compression": {"rwkv": "22.45% 22.45% 22.45% 22.45% 22.45% 22.45%", "qwen": "22.99% 22.99% 22.99% 22.99% 22.99% 22.99%"}, "model_tokens": {"rwkv": [[39026, " minds", "normal", 0.0005769323906861246]], "qwen": [[20062, " minds", "normal", 0.0004761377349495888]]}, "loss": {"rwkv": 22.448184555498845, "qwen": 22.992360593848883}, "topk": {"rwkv": [39026, 63, 0.0005769323906861246, [[22590, 0.370388, " the", false], [332, 0.09195, " a", false], [59943, 0.086016, " knowledge", false], [38720, 0.063386, " human", false], [3609, 0.062688, " AI", false], [32464, 0.025156, " what", false], [39936, 0.024545, " these", false], [22248, 0.024246, " our", false], [52224, 0.023642, " methods", false], [4419, 0.022477, " an", false]]], "qwen": [20062, 80, 0.0004761377349495888, [[279, 0.313124, " the", false], [3738, 0.179506, " human", false], [6540, 0.121824, " knowledge", false], [264, 0.092694, " a", false], [1039, 0.031638, " our", false], [458, 0.027065, " an", false], [1128, 0.023767, " what", false], [894, 0.013029, " any", false], [825, 0.012983, " one", false], [15235, 0.012561, " AI", false]]]}, "raw_delta": -0.030175526936848884, "tuned_delta": -0.02336324912975094}, {"byte_start": 6082, "byte_end": 6086, "display": {"text": " are", "kind": "normal"}, "is_word": true, "word_id": 1021, "word_key": " are", "bytes_hex": "20 61 72 65", "compression": {"rwkv": "5.67% 5.67% 5.67% 5.67%", "qwen": "4.95% 4.95% 4.95% 4.95%"}, "model_tokens": {"rwkv": [[21286, " are", "normal", 0.28460344672203064]], "qwen": [[525, " are", "normal", 0.3335510194301605]]}, "loss": {"rwkv": 5.670749550369216, "qwen": 4.950064313615376}, "topk": {"rwkv": [21286, 1, 0.28460344672203064, [[21286, 0.284603, " are", false], [45, 0.178012, ",", false], [21265, 0.076206, " and", false], [5346, 0.068842, "---", false], [4491, 0.053291, " do", false], [4600, 0.046088, " is", false], [4706, 0.026356, " of", false], [4715, 0.023511, " or", false], [275, 0.02336, " (", false], [46530, 0.021116, " matter", false]]], "qwen": [525, 1, 0.3335510194301605, [[525, 0.333551, " are", false], [11, 0.114802, ",", false], [4421, 0.079364, "---", false], [323, 0.063299, " and", false], [4925, 0.05121, " matter", false], [653, 0.043679, " do", false], [320, 0.036484, " (", false], [646, 0.036335, " can", false], [1745, 0.021339, " differ", false], [429, 0.018434, " that", false]]]}, "raw_delta": 0.03996327519416809, "tuned_delta": 0.04677555300126604}, {"byte_start": 6086, "byte_end": 6099, "display": {"text": " tremendously", "kind": "normal"}, "is_word": true, "word_id": 1022, "word_key": " tremendously", "bytes_hex": "20 74 72 65 6d 65 6e 64 6f 75 73 6c 79", "compression": {"rwkv": "14.34% 14.34% 14.34% 14.34% 14.34% 14.34% 14.34% 14.34% 14.34% 14.34% 14.34% 0.06% 0.06%", "qwen": "12.55% 12.55% 12.55% 12.55% 12.55% 12.55% 12.55% 12.55% 12.55% 12.55% 12.55% 12.55% 12.55%"}, "model_tokens": {"rwkv": [[62670, " tremendous", "normal", 0.0001536386989755556], [2030, "ly", "normal", 0.9932757616043091]], "qwen": [[71323, " tremendously", "normal", 0.00011814780737040564]]}, "loss": {"rwkv": 12.147415094455424, "qwen": 12.545307540774282}, "topk": {"rwkv": [62670, 269, 0.0001536386989755556, [[22187, 0.269946, " not", false], [62161, 0.11482, " irrelevant", false], [32386, 0.038165, " very", false], [39171, 0.035386, " often", false], [31466, 0.029687, " much", false], [31277, 0.025203, " less", false], [4706, 0.023047, " of", false], [332, 0.020514, " a", false], [59516, 0.014992, " difficult", false], [45, 0.014658, ",", false]]], "qwen": [71323, 309, 0.00011814780737040564, [[537, 0.245593, " not", false], [39715, 0.157858, " irrelevant", false], [2686, 0.040909, " less", false], [3545, 0.037021, " often", false], [315, 0.036599, " of", false], [4893, 0.025389, " imm", false], [13771, 0.022763, " largely", false], [650, 0.02013, " un", false], [264, 0.015697, " a", false], [11, 0.014247, ",", false]]]}, "raw_delta": -0.022063842186561083, "tuned_delta": -0.015251564379463137}, {"byte_start": 6099, "byte_end": 6100, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "98.06%", "qwen": "102.99%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.004298156127333641]], "qwen": [[11, ",", "normal", 0.003309671999886632]]}, "loss": {"rwkv": 98.05817856042172, "qwen": 102.98869758321233}, "topk": {"rwkv": [45, 17, 0.004298156127333641, [[51258, 0.181353, " complex", false], [59516, 0.174671, " difficult", false], [63366, 0.154382, " complicated", false], [31048, 0.103525, " hard", false], [31458, 0.049568, " more", false], [59829, 0.039545, " important", false], [51507, 0.033287, " diverse", false], [47705, 0.023596, " varied", false], [31277, 0.022385, " less", false], [57518, 0.02197, " variable", false]]], "qwen": [11, 36, 0.003309671999886632, [[2989, 0.192251, " important", false], [2686, 0.099634, " less", false], [6351, 0.078771, " complex", false], [39715, 0.076917, " irrelevant", false], [2155, 0.043931, " different", false], [16965, 0.038716, " complicated", false], [803, 0.037987, " more", false], [5000, 0.034358, " difficult", false], [2588, 0.022752, " hard", false], [650, 0.022206, " un", false]]]}, "raw_delta": -0.2734060287475586, "tuned_delta": -0.26659375094046067}, {"byte_start": 6100, "byte_end": 6105, "display": {"text": " irre", "kind": "normal"}, "is_word": true, "word_id": 1023, "word_key": " irre", "bytes_hex": "20 69 72 72 65", "compression": {"rwkv": "20.18% 20.18% 20.18% 20.18% 20.18%", "qwen": "16.00% 16.00% 16.00% 16.00% 16.00%"}, "model_tokens": {"rwkv": [[31170, " irre", "normal", 0.003656002227216959]], "qwen": [[24870, " irre", "normal", 0.011836192570626736]]}, "loss": {"rwkv": 20.175188462431596, "qwen": 16.001626999842525}, "topk": {"rwkv": [31170, 50, 0.003656002227216959, [[21265, 0.084478, " and", false], [46269, 0.056005, " incomp", false], [52448, 0.041087, " perhaps", false], [59988, 0.03487, " massively", false], [47708, 0.034147, " vastly", false], [30788, 0.033354, " even", false], [64911, 0.028406, " exponentially", false], [45145, 0.018636, " almost", false], [59817, 0.01837, " immensely", false], [46225, 0.017273, " hugely", false]]], "qwen": [24870, 15, 0.011836192570626736, [[323, 0.207878, " and", false], [714, 0.051271, " but", false], [1496, 0.050814, " even", false], [421, 0.023342, " if", false], [52890, 0.022976, " incom", false], [8365, 0.02207, " perhaps", false], [3498, 0.020079, " though", false], [83544, 0.018703, " unknow", false], [4558, 0.015977, " almost", false], [71323, 0.015372, " tremendously", false]]]}, "raw_delta": 0.23143138885498038, "tuned_delta": 0.23824366666207833}, {"byte_start": 6105, "byte_end": 6113, "display": {"text": "deemably", "kind": "normal"}, "is_word": true, "word_id": 1024, "word_key": "deemably", "bytes_hex": "64 65 65 6d 61 62 6c 79", "compression": {"rwkv": "22.54% 22.54% 22.54% 0.07% 0.07% 0.02% 0.02% 0.02%", "qwen": "26.66% 26.66% 0.01% 0.01% 0.01% 0.01% 0.01% 0.01%"}, "model_tokens": {"rwkv": [[7333, "dee", "normal", 0.023599615320563316], [2034, "ma", "normal", 0.9926789999008179], [7166, "bly", "normal", 0.9964050054550171]], "qwen": [[450, "de", "normal", 0.051972292363643646], [336, "em", "normal", 0.9987937211990356], [2845, "ably", "normal", 0.9985482096672058]]}, "loss": {"rwkv": 8.477919170812322, "qwen": 6.671797688020069}, "topk": {"rwkv": [7333, 6, 0.023599615320563316, [[7387, 0.666184, "duc", false], [27190, 0.093328, "trie", false], [27418, 0.059764, "vers", false], [35986, 0.030174, "vocab", false], [35389, 0.024881, "place", false], [7333, 0.0236, "dee", false], [34176, 0.017564, "cover", false], [25053, 0.016446, "conc", false], [35054, 0.01044, "media", false], [26645, 0.009264, "para", false]]], "qwen": [450, 5, 0.051972292363643646, [[7545, 0.391993, "duc", false], [8927, 0.16819, "trie", false], [3004, 0.134581, "vers", false], [78285, 0.059703, "ducible", false], [450, 0.051972, "de", false], [40446, 0.049267, "conc", false], [1732, 0.029554, "par", false], [3449, 0.025845, "lev", false], [273, 0.024408, "le", false], [32094, 0.020225, "levance", false]]]}, "raw_delta": 0.10015264108369593, "tuned_delta": 0.10696491889079388}, {"byte_start": 6113, "byte_end": 6121, "display": {"text": " complex", "kind": "normal"}, "is_word": true, "word_id": 1025, "word_key": " complex", "bytes_hex": "20 63 6f 6d 70 6c 65 78", "compression": {"rwkv": "5.14% 5.14% 5.14% 5.14% 5.14% 5.14% 5.14% 5.14%", "qwen": "5.27% 5.27% 5.27% 5.27% 5.27% 5.27% 5.27% 5.27%"}, "model_tokens": {"rwkv": [[51258, " complex", "normal", 0.10402525961399078]], "qwen": [[6351, " complex", "normal", 0.09666675329208374]]}, "loss": {"rwkv": 5.142418846918668, "qwen": 5.2669321363602055}, "topk": {"rwkv": [51258, 3, 0.10402525961399078, [[59516, 0.153956, " difficult", false], [45, 0.120661, ",", false], [51258, 0.104025, " complex", false], [31048, 0.098144, " hard", false], [39011, 0.08366, " messy", false], [63366, 0.083379, " complicated", false], [59829, 0.024029, " important", false], [46706, 0.023909, " opaque", false], [62234, 0.015535, " mysterious", false], [59513, 0.01305, " different", false]]], "qwen": [6351, 2, 0.09666675329208374, [[11, 0.242719, ",", false], [6351, 0.096667, " complex", false], [2155, 0.091925, " different", false], [16965, 0.03225, " complicated", false], [2989, 0.031886, " important", false], [39715, 0.025306, " irrelevant", false], [650, 0.024848, " un", false], [5000, 0.020229, " difficult", false], [869, 0.017272, " private", false], [46484, 0.014961, " opaque", false]]]}, "raw_delta": -0.006904482841491699, "tuned_delta": -9.220503439375232e-05}, {"byte_start": 6121, "byte_end": 6122, "display": {"text": ";", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "3b", "compression": {"rwkv": "83.41%", "qwen": "82.18%"}, "model_tokens": {"rwkv": [[60, ";", "normal", 0.009987857192754745]], "qwen": [[26, ";", "normal", 0.010491050779819489]]}, "loss": {"rwkv": 83.40580705139318, "qwen": 82.18371553262716}, "topk": {"rwkv": [60, 5, 0.009987857192754745, [[47, 0.466855, ".", false], [45, 0.283585, ",", false], [5346, 0.105515, "---", false], [21265, 0.075125, " and", false], [60, 0.009988, ";", false], [4596, 0.008481, " in", false], [275, 0.008167, " (", false], [4811, 0.006927, " to", false], [21700, 0.005511, " for", false], [59, 0.004792, ":", false]]], "qwen": [26, 5, 0.010491050779819489, [[13, 0.562278, ".", false], [11, 0.241227, ",", false], [323, 0.091116, " and", false], [4421, 0.037604, "---", false], [26, 0.010491, ";", false], [320, 0.00747, " (", false], [311, 0.00652, " to", false], [382, 0.005579, ".\n\n", false], [25, 0.004955, ":", false], [2513, 0.004913, " things", false]]]}, "raw_delta": 0.06776714324951172, "tuned_delta": 0.07457942105660967}, {"byte_start": 6122, "byte_end": 6125, "display": {"text": " we", "kind": "normal"}, "is_word": true, "word_id": 1026, "word_key": " we", "bytes_hex": "20 77 65", "compression": {"rwkv": "18.13% 18.13% 18.13%", "qwen": "14.50% 14.50% 14.50%"}, "model_tokens": {"rwkv": [[4858, " we", "normal", 0.049027830362319946]], "qwen": [[582, " we", "normal", 0.08956600725650787]]}, "loss": {"rwkv": 18.12761346950325, "qwen": 14.503769899550523}, "topk": {"rwkv": [4858, 6, 0.049027830362319946, [[32232, 0.106346, " they", false], [22590, 0.089336, " the", false], [21265, 0.077074, " and", false], [39934, 0.07172, " there", false], [32227, 0.064004, " that", false], [4858, 0.049028, " we", false], [4601, 0.047841, " it", false], [32234, 0.032604, " this", false], [4596, 0.027914, " in", false], [4692, 0.024862, " no", false]]], "qwen": [582, 2, 0.08956600725650787, [[323, 0.130866, " and", false], [582, 0.089566, " we", false], [279, 0.07098, " the", false], [432, 0.067737, " it", false], [807, 0.059452, " they", false], [429, 0.053745, " that", false], [1052, 0.030598, " there", false], [419, 0.028595, " this", false], [304, 0.025112, " in", false], [773, 0.018137, " so", false]]]}, "raw_delta": 0.20094855626424146, "tuned_delta": 0.2077608340713394}, {"byte_start": 6125, "byte_end": 6132, "display": {"text": " should", "kind": "normal"}, "is_word": true, "word_id": 1027, "word_key": " should", "bytes_hex": "20 73 68 6f 75 6c 64", "compression": {"rwkv": "9.14% 9.14% 9.14% 9.14% 9.14% 9.14% 9.14%", "qwen": "6.97% 6.97% 6.97% 6.97% 6.97% 6.97% 6.97%"}, "model_tokens": {"rwkv": [[47266, " should", "normal", 0.02852259948849678]], "qwen": [[1265, " should", "normal", 0.06674191355705261]]}, "loss": {"rwkv": 9.137605309201863, "qwen": 6.973683971068322}, "topk": {"rwkv": [47266, 8, 0.02852259948849678, [[4491, 0.168477, " do", false], [31059, 0.145455, " have", false], [45409, 0.109503, " cannot", false], [21286, 0.107978, " are", false], [21413, 0.088601, " can", false], [32475, 0.044538, " will", false], [31223, 0.034523, " know", false], [47266, 0.028523, " should", false], [46227, 0.027768, " humans", false], [47285, 0.02194, " simply", false]]], "qwen": [1265, 6, 0.06674191355705261, [[653, 0.17182, " do", false], [614, 0.130978, " have", false], [4157, 0.13019, " cannot", false], [646, 0.105554, " can", false], [525, 0.073844, " are", false], [1265, 0.066742, " should", false], [1414, 0.033922, " know", false], [1513, 0.027113, " don", false], [686, 0.020999, " will", false], [4936, 0.019961, " simply", false]]]}, "raw_delta": 0.11999327795846126, "tuned_delta": 0.1268055557655592}, {"byte_start": 6132, "byte_end": 6137, "display": {"text": " stop", "kind": "normal"}, "is_word": true, "word_id": 1028, "word_key": " stop", "bytes_hex": "20 73 74 6f 70", "compression": {"rwkv": "15.55% 15.55% 15.55% 15.55% 15.55%", "qwen": "17.86% 17.86% 17.86% 17.86% 17.86%"}, "model_tokens": {"rwkv": [[32122, " stop", "normal", 0.013539984822273254]], "qwen": [[2936, " stop", "normal", 0.00706950668245554]]}, "loss": {"rwkv": 15.554055909584136, "qwen": 17.860436128285865}, "topk": {"rwkv": [32122, 9, 0.013539984822273254, [[22187, 0.429959, " not", false], [39115, 0.125609, " never", false], [45926, 0.060014, " expect", false], [4435, 0.055315, " be", false], [60645, 0.022665, " therefore", false], [31059, 0.021511, " have", false], [45084, 0.02025, " accept", false], [45150, 0.014175, " always", false], [32122, 0.01354, " stop", false], [38877, 0.008237, " learn", false]]], "qwen": [2936, 13, 0.00706950668245554, [[537, 0.530159, " not", false], [387, 0.074207, " be", false], [2581, 0.044176, " never", false], [8916, 0.022915, " therefore", false], [5648, 0.019162, " avoid", false], [1430, 0.013761, " try", false], [1720, 0.010714, " expect", false], [614, 0.008325, " have", false], [2677, 0.007854, " always", false], [5274, 0.007544, " leave", false]]]}, "raw_delta": -0.12789287567138663, "tuned_delta": -0.12108059786428868}, {"byte_start": 6137, "byte_end": 6144, "display": {"text": " trying", "kind": "normal"}, "is_word": true, "word_id": 1029, "word_key": " trying", "bytes_hex": "20 74 72 79 69 6e 67", "compression": {"rwkv": "1.34% 1.34% 1.34% 1.34% 1.34% 1.34% 1.34%", "qwen": "1.79% 1.79% 1.79% 1.79% 1.79% 1.79% 1.79%"}, "model_tokens": {"rwkv": [[47629, " trying", "normal", 0.5925014019012451]], "qwen": [[4460, " trying", "normal", 0.4985191822052002]]}, "loss": {"rwkv": 1.3384377820747217, "qwen": 1.7933555412213442}, "topk": {"rwkv": [47629, 1, 0.5925014019012451, [[47629, 0.592501, " trying", false], [57419, 0.085318, " thinking", false], [62360, 0.046852, " pretending", false], [53320, 0.020385, " wasting", false], [59681, 0.016488, " expecting", false], [52157, 0.014199, " looking", false], [46500, 0.013438, " making", false], [59224, 0.010858, " believing", false], [46217, 0.009106, " hoping", false], [55562, 0.007775, " assuming", false]]], "qwen": [4460, 1, 0.4985191822052002, [[4460, 0.498519, " trying", false], [7274, 0.087178, " thinking", false], [47797, 0.028093, " wasting", false], [39776, 0.019131, " worrying", false], [3259, 0.018178, " making", false], [54806, 0.017214, " pretending", false], [3330, 0.016465, " looking", false], [26625, 0.016464, " treating", false], [10161, 0.015371, " asking", false], [25538, 0.014384, " assuming", false]]]}, "raw_delta": -0.02522599697113037, "tuned_delta": -0.018413719164032425}, {"byte_start": 6144, "byte_end": 6147, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 1030, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "0.19% 0.19% 0.19%", "qwen": "0.14% 0.14% 0.14%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.9686253070831299]], "qwen": [[311, " to", "normal", 0.9774839878082275]]}, "loss": {"rwkv": 0.19078608735714236, "qwen": 0.13689611868117005}, "topk": {"rwkv": [4811, 1, 0.9686253070831299, [[4811, 0.968625, " to", false], [47, 0.006963, ".", false], [4788, 0.005063, " so", false], [45, 0.004779, ",", false], [21265, 0.001802, " and", false], [4596, 0.001793, " in", false], [275, 0.000875, " (", false], [21700, 0.000859, " for", false], [63461, 0.000716, " desperately", false], [22614, 0.000518, " too", false]]], "qwen": [311, 1, 0.9774839878082275, [[311, 0.977484, " to", false], [11, 0.003888, ",", false], [773, 0.002972, " so", false], [37543, 0.001506, " desperately", false], [304, 0.00114, " in", false], [323, 0.001132, " and", false], [369, 0.001086, " for", false], [320, 0.000969, " (", false], [13, 0.000955, ".", false], [2238, 0.000853, " too", false]]]}, "raw_delta": 0.002988294387857119, "tuned_delta": 0.009800572194955066}, {"byte_start": 6147, "byte_end": 6152, "display": {"text": " find", "kind": "normal"}, "is_word": true, "word_id": 1031, "word_key": " find", "bytes_hex": "20 66 69 6e 64", "compression": {"rwkv": "17.47% 17.47% 17.47% 17.47% 17.47%", "qwen": "17.29% 17.29% 17.29% 17.29% 17.29%"}, "model_tokens": {"rwkv": [[30858, " find", "normal", 0.007957223802804947]], "qwen": [[1477, " find", "normal", 0.008287807926535606]]}, "loss": {"rwkv": 17.47013526076479, "qwen": 17.28698405655495}, "topk": {"rwkv": [30858, 23, 0.007957223802804947, [[62683, 0.088428, " understand", false], [39043, 0.080751, " model", false], [37923, 0.064274, " build", false], [22339, 0.058672, " put", false], [31358, 0.050864, " make", false], [47030, 0.034506, " reduce", false], [51133, 0.021327, " capture", false], [39025, 0.0178, " mimic", false], [63292, 0.017163, " approximate", false], [57235, 0.016674, " simplify", false]]], "qwen": [1477, 12, 0.008287807926535606, [[3535, 0.28374, " understand", false], [1614, 0.094508, " model", false], [1936, 0.090455, " build", false], [1281, 0.026458, " make", false], [2182, 0.02417, " put", false], [4009, 0.016793, " represent", false], [12322, 0.016563, " capture", false], [633, 0.015462, " get", false], [7949, 0.014764, " reduce", false], [7512, 0.013279, " describe", false]]]}, "raw_delta": 0.010156059265136741, "tuned_delta": 0.016968337072234687}, {"byte_start": 6152, "byte_end": 6159, "display": {"text": " simple", "kind": "normal"}, "is_word": true, "word_id": 1032, "word_key": " simple", "bytes_hex": "20 73 69 6d 70 6c 65", "compression": {"rwkv": "5.68% 5.68% 5.68% 5.68% 5.68% 5.68% 5.68%", "qwen": "5.90% 5.90% 5.90% 5.90% 5.90% 5.90% 5.90%"}, "model_tokens": {"rwkv": [[47284, " simple", "normal", 0.11054639518260956]], "qwen": [[4285, " simple", "normal", 0.10120167583227158]]}, "loss": {"rwkv": 5.6757812713544595, "qwen": 5.901241313279305}, "topk": {"rwkv": [47284, 2, 0.11054639518260956, [[332, 0.134907, " a", false], [47284, 0.110546, " simple", false], [32448, 0.098011, " ways", false], [22590, 0.063928, " the", false], [22249, 0.03836, " out", false], [51832, 0.030124, " general", false], [4419, 0.025902, " an", false], [30724, 0.021418, " easy", false], [32229, 0.019047, " them", false], [32074, 0.016279, " some", false]]], "qwen": [4285, 3, 0.10120167583227158, [[700, 0.118878, " out", false], [264, 0.101372, " a", false], [4285, 0.101202, " simple", false], [5510, 0.095032, " ways", false], [1105, 0.049416, " them", false], [279, 0.049007, " the", false], [458, 0.016485, " an", false], [1661, 0.01402, " good", false], [894, 0.01358, " any", false], [11464, 0.013484, " explicit", false]]]}, "raw_delta": -0.012502159391130752, "tuned_delta": -0.005689881584032805}, {"byte_start": 6159, "byte_end": 6164, "display": {"text": " ways", "kind": "normal"}, "is_word": true, "word_id": 1033, "word_key": " ways", "bytes_hex": "20 77 61 79 73", "compression": {"rwkv": "8.06% 8.06% 8.06% 8.06% 8.06%", "qwen": "10.46% 10.46% 10.46% 10.46% 10.46%"}, "model_tokens": {"rwkv": [[32448, " ways", "normal", 0.10766562819480896]], "qwen": [[5510, " ways", "normal", 0.05498006194829941]]}, "loss": {"rwkv": 8.058804329965694, "qwen": 10.462368505016979}, "topk": {"rwkv": [32448, 2, 0.10766562819480896, [[45, 0.202483, ",", false], [32448, 0.107666, " ways", false], [46587, 0.073324, " models", false], [64392, 0.065985, " explanations", false], [39558, 0.05957, " rules", false], [64351, 0.037833, " descriptions", false], [65275, 0.034398, " representations", false], [60521, 0.033911, " solutions", false], [51832, 0.01861, " general", false], [52224, 0.016028, " methods", false]]], "qwen": [5510, 5, 0.05498006194829941, [[11, 0.200505, ",", false], [4119, 0.119313, " models", false], [43613, 0.083355, " representations", false], [40841, 0.072082, " explanations", false], [5510, 0.05498, " ways", false], [323, 0.034541, " and", false], [10502, 0.028146, " mental", false], [27787, 0.025921, " descriptions", false], [5601, 0.019599, " rules", false], [23400, 0.014106, " analog", false]]]}, "raw_delta": -0.1332818984985351, "tuned_delta": -0.12646962069143716}, {"byte_start": 6164, "byte_end": 6167, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 1034, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "1.66% 1.66% 1.66%", "qwen": "1.91% 1.91% 1.91%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.7588887810707092]], "qwen": [[311, " to", "normal", 0.7277523875236511]]}, "loss": {"rwkv": 1.6554362041450505, "qwen": 1.9103352739607122}, "topk": {"rwkv": [4811, 1, 0.7588887810707092, [[4811, 0.758889, " to", false], [4706, 0.175323, " of", false], [21700, 0.023419, " for", false], [4596, 0.013488, " in", false], [45202, 0.007282, " around", false], [32227, 0.004665, " that", false], [45, 0.003102, ",", false], [31162, 0.002611, " into", false], [22249, 0.00232, " out", false], [275, 0.001953, " (", false]]], "qwen": [311, 1, 0.7277523875236511, [[311, 0.727752, " to", false], [315, 0.238862, " of", false], [304, 0.005255, " in", false], [429, 0.00495, " that", false], [369, 0.004693, " for", false], [1119, 0.00412, " into", false], [11, 0.003879, ",", false], [700, 0.002278, " out", false], [320, 0.001997, " (", false], [2163, 0.001271, " around", false]]]}, "raw_delta": -0.014134605725606278, "tuned_delta": -0.007322327918508331}, {"byte_start": 6167, "byte_end": 6173, "display": {"text": " think", "kind": "normal"}, "is_word": true, "word_id": 1035, "word_key": " think", "bytes_hex": "20 74 68 69 6e 6b", "compression": {"rwkv": "15.22% 15.22% 15.22% 15.22% 15.22% 15.22%", "qwen": "13.14% 13.14% 13.14% 13.14% 13.14% 13.14%"}, "model_tokens": {"rwkv": [[39942, " think", "normal", 0.006377914920449257]], "qwen": [[1744, " think", "normal", 0.012629715725779533]]}, "loss": {"rwkv": 15.215924259375784, "qwen": 13.139653674513227}, "topk": {"rwkv": [39942, 19, 0.006377914920449257, [[60389, 0.146641, " represent", false], [55961, 0.125155, " describe", false], [39043, 0.085752, " model", false], [51133, 0.063238, " capture", false], [22339, 0.055039, " put", false], [62683, 0.048221, " understand", false], [51688, 0.029482, " explain", false], [31358, 0.026077, " make", false], [37923, 0.025161, " build", false], [45854, 0.022454, " encode", false]]], "qwen": [1744, 10, 0.012629715725779533, [[4009, 0.175052, " represent", false], [3535, 0.125118, " understand", false], [1614, 0.116433, " model", false], [7512, 0.06857, " describe", false], [12322, 0.057066, " capture", false], [1936, 0.050149, " build", false], [16164, 0.022086, " encode", false], [10339, 0.019037, " explain", false], [633, 0.013144, " get", false], [1744, 0.01263, " think", false]]]}, "raw_delta": 0.11513288815816247, "tuned_delta": 0.12194516596526042}, {"byte_start": 6173, "byte_end": 6179, "display": {"text": " about", "kind": "normal"}, "is_word": true, "word_id": 1036, "word_key": " about", "bytes_hex": "20 61 62 6f 75 74", "compression": {"rwkv": "2.00% 2.00% 2.00% 2.00% 2.00% 2.00%", "qwen": "3.15% 3.15% 3.15% 3.15% 3.15% 3.15%"}, "model_tokens": {"rwkv": [[37598, " about", "normal", 0.5126259326934814]], "qwen": [[911, " about", "normal", 0.35096195340156555]]}, "loss": {"rwkv": 1.9959159908131816, "qwen": 3.1471112447329133}, "topk": {"rwkv": [37598, 1, 0.5126259326934814, [[37598, 0.512626, " about", false], [31296, 0.171189, " like", false], [47, 0.053354, ".", false], [21265, 0.041991, " and", false], [45, 0.036394, ",", false], [4706, 0.034531, " of", false], [32227, 0.034473, " that", false], [4596, 0.015083, " in", false], [4715, 0.01176, " or", false], [22248, 0.008011, " our", false]]], "qwen": [911, 1, 0.35096195340156555, [[911, 0.350962, " about", false], [13, 0.1403, ".", false], [11, 0.080916, ",", false], [429, 0.079425, " that", false], [323, 0.075951, " and", false], [315, 0.051051, " of", false], [1075, 0.042088, " like", false], [476, 0.022743, " or", false], [304, 0.022563, " in", false], [382, 0.012704, ".\n\n", false]]]}, "raw_delta": -0.0638358195622762, "tuned_delta": -0.05702354175517825}, {"byte_start": 6179, "byte_end": 6183, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 1037, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "9.51% 9.51% 9.51% 9.51%", "qwen": "12.21% 12.21% 12.21% 12.21%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.12204141169786453]], "qwen": [[279, " the", "normal", 0.06668713688850403]]}, "loss": {"rwkv": 9.509952662109866, "qwen": 12.207648875929388}, "topk": {"rwkv": [22590, 2, 0.12204141169786453, [[32229, 0.427391, " them", false], [22590, 0.122041, " the", false], [39026, 0.111291, " minds", false], [21835, 0.046522, " how", false], [4601, 0.033975, " it", false], [21265, 0.023746, " and", false], [51258, 0.022434, " complex", false], [22248, 0.022301, " our", false], [32464, 0.021302, " what", false], [47539, 0.017144, " things", false]]], "qwen": [279, 3, 0.06668713688850403, [[1105, 0.503293, " them", false], [20062, 0.069343, " minds", false], [279, 0.066687, " the", false], [1128, 0.034867, " what", false], [1246, 0.030605, " how", false], [15235, 0.024006, " AI", false], [6351, 0.020271, " complex", false], [419, 0.017523, " this", false], [323, 0.017303, " and", false], [476, 0.016512, " or", false]]]}, "raw_delta": -0.14959204196929932, "tuned_delta": -0.14277976416220137}, {"byte_start": 6183, "byte_end": 6192, "display": {"text": " contents", "kind": "normal"}, "is_word": true, "word_id": 1038, "word_key": " contents", "bytes_hex": "20 63 6f 6e 74 65 6e 74 73", "compression": {"rwkv": "4.41% 4.41% 4.41% 4.41% 4.41% 4.41% 4.41% 4.41% 4.41%", "qwen": "3.10% 3.10% 3.10% 3.10% 3.10% 3.10% 3.10% 3.10% 3.10%"}, "model_tokens": {"rwkv": [[55847, " contents", "normal", 0.11047838628292084]], "qwen": [[8794, " contents", "normal", 0.2131236046552658]]}, "loss": {"rwkv": 4.414496544386801, "qwen": 3.0975522941036595}, "topk": {"rwkv": [55847, 3, 0.11047838628292084, [[31427, 0.263605, " mind", false], [40213, 0.262418, " world", false], [55847, 0.110478, " contents", false], [39026, 0.076542, " minds", false], [38720, 0.041866, " human", false], [51258, 0.040963, " complex", false], [61720, 0.030561, " complexity", false], [37898, 0.012364, " brain", false], [22752, 0.010491, " way", false], [52569, 0.007645, " problem", false]]], "qwen": [8794, 1, 0.2131236046552658, [[8794, 0.213124, " contents", false], [3971, 0.117353, " mind", false], [1879, 0.113957, " world", false], [20062, 0.074614, " minds", false], [23094, 0.047547, " complexity", false], [6351, 0.021124, " complex", false], [2213, 0.020462, " content", false], [3491, 0.019065, " problem", false], [3738, 0.018264, " human", false], [5322, 0.015819, " problems", false]]]}, "raw_delta": 0.07302689552307129, "tuned_delta": 0.07983917333016924}, {"byte_start": 6192, "byte_end": 6195, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 1039, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "0.56% 0.56% 0.56%", "qwen": "0.67% 0.67% 0.67%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.9104469418525696]], "qwen": [[315, " of", "normal", 0.8948466181755066]]}, "loss": {"rwkv": 0.5635527503472513, "qwen": 0.6678653786176408}, "topk": {"rwkv": [4706, 1, 0.9104469418525696, [[4706, 0.910447, " of", false], [47, 0.037022, ".", false], [45, 0.018428, ",", false], [21265, 0.01453, " and", false], [4596, 0.003267, " in", false], [32227, 0.002615, " that", false], [60, 0.002114, ";", false], [4715, 0.001643, " or", false], [275, 0.001303, " (", false], [5346, 0.001223, "---", false]]], "qwen": [315, 1, 0.8948466181755066, [[315, 0.894847, " of", false], [13, 0.047853, ".", false], [11, 0.01782, ",", false], [323, 0.01475, " and", false], [382, 0.004503, ".\n\n", false], [4421, 0.00264, "---", false], [429, 0.002627, " that", false], [320, 0.001751, " (", false], [304, 0.001715, " in", false], [476, 0.00163, " or", false]]]}, "raw_delta": -0.005784320334593453, "tuned_delta": 0.0010279574725044942}, {"byte_start": 6195, "byte_end": 6201, "display": {"text": " minds", "kind": "normal"}, "is_word": true, "word_id": 1040, "word_key": " minds", "bytes_hex": "20 6d 69 6e 64 73", "compression": {"rwkv": "0.37% 0.37% 0.37% 0.37% 0.37% 0.37%", "qwen": "0.79% 0.79% 0.79% 0.79% 0.79% 0.79%"}, "model_tokens": {"rwkv": [[39026, " minds", "normal", 0.8845391869544983]], "qwen": [[20062, " minds", "normal", 0.7699849605560303]]}, "loss": {"rwkv": 0.36689632184065835, "qwen": 0.7856205112617974}, "topk": {"rwkv": [39026, 1, 0.8845391869544983, [[39026, 0.884539, " minds", false], [22248, 0.033639, " our", false], [22590, 0.019636, " the", false], [38720, 0.012428, " human", false], [332, 0.010383, " a", false], [39193, 0.005692, " other", false], [31427, 0.00317, " mind", false], [39931, 0.002365, " their", false], [39944, 0.002264, " those", false], [46787, 0.00195, " people", false]]], "qwen": [20062, 1, 0.7699849605560303, [[20062, 0.769985, " minds", false], [1039, 0.059714, " our", false], [279, 0.039389, " the", false], [3738, 0.021807, " human", false], [264, 0.0203, " a", false], [1846, 0.007593, " those", false], [3971, 0.007428, " mind", false], [1493, 0.006947, " these", false], [1008, 0.006242, " other", false], [1251, 0.004898, " people", false]]]}, "raw_delta": -0.02321899930636088, "tuned_delta": -0.016406721499262936}, {"byte_start": 6201, "byte_end": 6202, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "26.91%", "qwen": "27.39%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.22671803832054138]], "qwen": [[11, ",", "normal", 0.21901921927928925]]}, "loss": {"rwkv": 26.909643829081247, "qwen": 27.385883137368587}, "topk": {"rwkv": [45, 2, 0.22671803832054138, [[47, 0.486121, ".", false], [45, 0.226718, ",", false], [21265, 0.115517, " and", false], [32227, 0.033073, " that", false], [60, 0.021931, ";", false], [4596, 0.020346, " in", false], [275, 0.016568, " (", false], [5346, 0.014048, "---", false], [4423, 0.01075, " as", false], [51018, 0.006741, " because", false]]], "qwen": [11, 2, 0.21901921927928925, [[13, 0.494029, ".", false], [11, 0.219019, ",", false], [323, 0.098597, " and", false], [382, 0.051394, ".\n\n", false], [4421, 0.019468, "---", false], [429, 0.017928, " that", false], [320, 0.014993, " (", false], [26, 0.014264, ";", false], [304, 0.013559, " in", false], [476, 0.010207, " or", false]]]}, "raw_delta": -0.02640831470489502, "tuned_delta": -0.019596036897797074}, {"byte_start": 6202, "byte_end": 6207, "display": {"text": " such", "kind": "normal"}, "is_word": true, "word_id": 1041, "word_key": " such", "bytes_hex": "20 73 75 63 68", "compression": {"rwkv": "17.13% 17.13% 17.13% 17.13% 17.13%", "qwen": "14.75% 14.75% 14.75% 14.75% 14.75%"}, "model_tokens": {"rwkv": [[32139, " such", "normal", 0.008677098900079727]], "qwen": [[1741, " such", "normal", 0.016764383763074875]]}, "loss": {"rwkv": 17.13200361055644, "qwen": 14.746141609758464}, "topk": {"rwkv": [32139, 13, 0.008677098900079727, [[21265, 0.571325, " and", false], [51018, 0.0622, " because", false], [4715, 0.058783, " or", false], [4423, 0.027124, " as", false], [40186, 0.017063, " which", false], [4596, 0.017011, " in", false], [4811, 0.016613, " to", false], [21400, 0.016225, " but", false], [4858, 0.015759, " we", false], [30788, 0.011313, " even", false]]], "qwen": [1741, 8, 0.016764383763074875, [[323, 0.5002, " and", false], [476, 0.087305, " or", false], [1576, 0.081886, " because", false], [438, 0.050973, " as", false], [892, 0.023271, " which", false], [2474, 0.018089, " since", false], [714, 0.017288, " but", false], [1741, 0.016764, " such", false], [1496, 0.015244, " even", false], [311, 0.015047, " to", false]]]}, "raw_delta": 0.13230028152465811, "tuned_delta": 0.13911255933175606}, {"byte_start": 6207, "byte_end": 6210, "display": {"text": " as", "kind": "normal"}, "is_word": true, "word_id": 1042, "word_key": " as", "bytes_hex": "20 61 73", "compression": {"rwkv": "0.16% 0.16% 0.16%", "qwen": "0.03% 0.03% 0.03%"}, "model_tokens": {"rwkv": [[4423, " as", "normal", 0.9733675122261047]], "qwen": [[438, " as", "normal", 0.9950841069221497]]}, "loss": {"rwkv": 0.16216817425357102, "qwen": 0.02962327542236265}, "topk": {"rwkv": [4423, 1, 0.9733675122261047, [[4423, 0.973368, " as", false], [32227, 0.019107, " that", false], [4450, 0.001112, " by", false], [332, 0.000749, " a", false], [52224, 0.000637, " methods", false], [32448, 0.000488, " ways", false], [47284, 0.000336, " simple", false], [4419, 0.00033, " an", false], [61590, 0.000275, " approaches", false], [4600, 0.000272, " is", false]]], "qwen": [438, 1, 0.9950841069221497, [[438, 0.995084, " as", false], [429, 0.00189, " that", false], [264, 0.000488, " a", false], [5510, 0.000193, " ways", false], [7274, 0.000175, " thinking", false], [5413, 0.000133, " methods", false], [374, 9.6e-05, " is", false], [553, 8.8e-05, " by", false], [4285, 8.8e-05, " simple", false], [4460, 8.3e-05, " trying", false]]]}, "raw_delta": 0.007349849833796422, "tuned_delta": 0.014162127640894369}, {"byte_start": 6210, "byte_end": 6217, "display": {"text": " simple", "kind": "normal"}, "is_word": true, "word_id": 1043, "word_key": " simple", "bytes_hex": "20 73 69 6d 70 6c 65", "compression": {"rwkv": "8.86% 8.86% 8.86% 8.86% 8.86% 8.86% 8.86%", "qwen": "14.47% 14.47% 14.47% 14.47% 14.47% 14.47% 14.47%"}, "model_tokens": {"rwkv": [[47284, " simple", "normal", 0.03216380998492241]], "qwen": [[4285, " simple", "normal", 0.003632637206465006]]}, "loss": {"rwkv": 8.855828934028233, "qwen": 14.472798281025144}, "topk": {"rwkv": [47284, 6, 0.03216380998492241, [[4450, 0.198376, " by", false], [4596, 0.10668, " in", false], [22590, 0.082008, " the", false], [4404, 0.048015, " ``", false], [53140, 0.033778, " through", false], [47284, 0.032164, " simple", false], [40085, 0.021013, " using", false], [47629, 0.019154, " trying", false], [55666, 0.016439, " building", false], [32487, 0.014855, " with", false]]], "qwen": [4285, 37, 0.003632637206465006, [[279, 0.133687, " the", false], [4460, 0.052323, " trying", false], [553, 0.03949, " by", false], [304, 0.03373, " in", false], [7274, 0.031925, " thinking", false], [9902, 0.026922, " ``", false], [6540, 0.024552, " knowledge", false], [15039, 0.02171, " searching", false], [4752, 0.017244, " building", false], [3738, 0.016192, " human", false]]]}, "raw_delta": -0.31147091729300364, "tuned_delta": -0.3046586394859057}, {"byte_start": 6217, "byte_end": 6222, "display": {"text": " ways", "kind": "normal"}, "is_word": true, "word_id": 1044, "word_key": " ways", "bytes_hex": "20 77 61 79 73", "compression": {"rwkv": "13.75% 13.75% 13.75% 13.75% 13.75%", "qwen": "19.04% 19.04% 19.04% 19.04% 19.04%"}, "model_tokens": {"rwkv": [[32448, " ways", "normal", 0.021922007203102112]], "qwen": [[5510, " ways", "normal", 0.005097561050206423]]}, "loss": {"rwkv": 13.75068710847293, "qwen": 19.039943022871757}, "topk": {"rwkv": [32448, 8, 0.021922007203102112, [[46587, 0.084374, " models", false], [65275, 0.075587, " representations", false], [39558, 0.055473, " rules", false], [59943, 0.032368, " knowledge", false], [45, 0.03198, ",", false], [46658, 0.031238, " neural", false], [57375, 0.028082, " symbolic", false], [32448, 0.021922, " ways", false], [38720, 0.017126, " human", false], [46545, 0.015244, " mental", false]]], "qwen": [5510, 30, 0.005097561050206423, [[43613, 0.065501, " representations", false], [6540, 0.05868, " knowledge", false], [5601, 0.054789, " rules", false], [4119, 0.040498, " models", false], [35296, 0.029279, " symbolic", false], [11, 0.024659, ",", false], [24970, 0.017899, " theories", false], [4419, 0.016319, " features", false], [10502, 0.014763, " mental", false], [29728, 0.01381, " neural", false]]]}, "raw_delta": -0.29329862594604506, "tuned_delta": -0.28648634813894713}, {"byte_start": 6222, "byte_end": 6225, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 1045, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "1.17% 1.17% 1.17%", "qwen": "1.92% 1.92% 1.92%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.8226362466812134]], "qwen": [[311, " to", "normal", 0.7263924479484558]]}, "loss": {"rwkv": 1.1740682298901068, "qwen": 1.921578818909463}, "topk": {"rwkv": [4811, 1, 0.8226362466812134, [[4811, 0.822636, " to", false], [4706, 0.154224, " of", false], [21700, 0.013013, " for", false], [32227, 0.003261, " that", false], [4596, 0.002177, " in", false], [275, 0.000483, " (", false], [45, 0.000439, ",", false], [31296, 0.000379, " like", false], [37810, 0.00037, " based", false], [4858, 0.000271, " we", false]]], "qwen": [311, 1, 0.7263924479484558, [[311, 0.726392, " to", false], [315, 0.224225, " of", false], [429, 0.014931, " that", false], [304, 0.011929, " in", false], [369, 0.005449, " for", false], [3118, 0.004559, " based", false], [1119, 0.001091, " into", false], [11, 0.000979, ",", false], [1075, 0.000975, " like", false], [320, 0.00066, " (", false]]]}, "raw_delta": -0.04145078857739766, "tuned_delta": -0.03463851077029971}, {"byte_start": 6225, "byte_end": 6231, "display": {"text": " think", "kind": "normal"}, "is_word": true, "word_id": 1046, "word_key": " think", "bytes_hex": "20 74 68 69 6e 6b", "compression": {"rwkv": "7.04% 7.04% 7.04% 7.04% 7.04% 7.04%", "qwen": "4.14% 4.14% 4.14% 4.14% 4.14% 4.14%"}, "model_tokens": {"rwkv": [[39942, " think", "normal", 0.0959053635597229]], "qwen": [[1744, " think", "normal", 0.2525695562362671]]}, "loss": {"rwkv": 7.044409379340641, "qwen": 4.135931945218039}, "topk": {"rwkv": [39942, 2, 0.0959053635597229, [[60389, 0.141885, " represent", false], [39942, 0.095905, " think", false], [55961, 0.0525, " describe", false], [37923, 0.044331, " build", false], [22339, 0.034142, " put", false], [39043, 0.034074, " model", false], [45688, 0.031803, " define", false], [45854, 0.023668, " encode", false], [62683, 0.02171, " understand", false], [64276, 0.019558, " characterize", false]]], "qwen": [1744, 1, 0.2525695562362671, [[1744, 0.25257, " think", false], [4009, 0.241383, " represent", false], [16164, 0.048848, " encode", false], [7512, 0.036788, " describe", false], [1614, 0.031156, " model", false], [1936, 0.020897, " build", false], [3535, 0.020736, " understand", false], [12322, 0.013109, " capture", false], [3158, 0.012055, " express", false], [2415, 0.010918, " map", false]]]}, "raw_delta": 0.16128023465474448, "tuned_delta": 0.16809251246184242}, {"byte_start": 6231, "byte_end": 6237, "display": {"text": " about", "kind": "normal"}, "is_word": true, "word_id": 1047, "word_key": " about", "bytes_hex": "20 61 62 6f 75 74", "compression": {"rwkv": "0.22% 0.22% 0.22% 0.22% 0.22% 0.22%", "qwen": "0.26% 0.26% 0.26% 0.26% 0.26% 0.26%"}, "model_tokens": {"rwkv": [[37598, " about", "normal", 0.9294415712356567]], "qwen": [[911, " about", "normal", 0.9184801578521729]]}, "loss": {"rwkv": 0.22013779310439502, "qwen": 0.25558232016207766}, "topk": {"rwkv": [37598, 1, 0.9294415712356567, [[37598, 0.929442, " about", false], [4706, 0.038356, " of", false], [32227, 0.008654, " that", false], [4596, 0.008469, " in", false], [31296, 0.000921, " like", false], [32464, 0.000801, " what", false], [21265, 0.000797, " and", false], [21835, 0.000644, " how", false], [45, 0.000428, ",", false], [4715, 0.000423, " or", false]]], "qwen": [911, 1, 0.9184801578521729, [[911, 0.91848, " about", false], [315, 0.066512, " of", false], [304, 0.004573, " in", false], [429, 0.001382, " that", false], [1075, 0.000739, " like", false], [476, 0.000675, " or", false], [11, 0.00053, ",", false], [1246, 0.000372, " how", false], [279, 0.000333, " the", false], [323, 0.000302, " and", false]]]}, "raw_delta": -0.0019654619197050725, "tuned_delta": 0.0048468158873928744}, {"byte_start": 6237, "byte_end": 6243, "display": {"text": " space", "kind": "normal"}, "is_word": true, "word_id": 1048, "word_key": " space", "bytes_hex": "20 73 70 61 63 65", "compression": {"rwkv": "20.48% 20.48% 20.48% 20.48% 20.48% 20.48%", "qwen": "23.57% 23.57% 23.57% 23.57% 23.57% 23.57%"}, "model_tokens": {"rwkv": [[39750, " space", "normal", 0.0010954843601211905]], "qwen": [[3550, " space", "normal", 0.00039288686821237206]]}, "loss": {"rwkv": 20.475749929283463, "qwen": 23.569997290113044}, "topk": {"rwkv": [39750, 95, 0.0010954843601211905, [[22590, 0.220878, " the", false], [21835, 0.113337, " how", false], [32464, 0.072664, " what", false], [47732, 0.036648, " vision", false], [38720, 0.033235, " human", false], [59943, 0.029979, " knowledge", false], [62300, 0.022099, " perception", false], [4404, 0.017109, " ``", false], [56529, 0.012742, " language", false], [55816, 0.011585, " concepts", false]]], "qwen": [3550, 166, 0.00039288686821237206, [[279, 0.177559, " the", false], [1246, 0.083276, " how", false], [3738, 0.082368, " human", false], [6540, 0.076958, " knowledge", false], [11129, 0.057263, " vision", false], [1128, 0.055498, " what", false], [4244, 0.027448, " words", false], [4128, 0.024734, " language", false], [8806, 0.019701, " speech", false], [862, 0.016263, " their", false]]]}, "raw_delta": -0.17158150672912598, "tuned_delta": -0.16476922892202803}, {"byte_start": 6243, "byte_end": 6244, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "18.74%", "qwen": "16.97%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.35376182198524475]], "qwen": [[11, ",", "normal", 0.39013928174972534]]}, "loss": {"rwkv": 18.738128949046104, "qwen": 16.97423511080913}, "topk": {"rwkv": [45, 1, 0.35376182198524475, [[45, 0.353762, ",", false], [21265, 0.18272, " and", false], [4715, 0.181214, " or", false], [47, 0.158893, ".", false], [4596, 0.02178, " in", false], [275, 0.020531, " (", false], [4423, 0.015395, " as", false], [46, 0.006965, "-", false], [5346, 0.00587, "---", false], [32227, 0.004598, " that", false]]], "qwen": [11, 1, 0.39013928174972534, [[11, 0.390139, ",", false], [323, 0.262821, " and", false], [476, 0.154869, " or", false], [13, 0.087858, ".", false], [320, 0.025548, " (", false], [7246, 0.02115, "-time", false], [304, 0.019751, " in", false], [382, 0.007857, ".\n\n", false], [315, 0.003637, " of", false], [26, 0.003188, ";", false]]]}, "raw_delta": 0.09781104326248169, "tuned_delta": 0.10462332106957964}, {"byte_start": 6244, "byte_end": 6252, "display": {"text": " objects", "kind": "normal"}, "is_word": true, "word_id": 1049, "word_key": " objects", "bytes_hex": "20 6f 62 6a 65 63 74 73", "compression": {"rwkv": "10.43% 10.43% 10.43% 10.43% 10.43% 10.43% 10.43% 10.43%", "qwen": "11.01% 11.01% 11.01% 11.01% 11.01% 11.01% 11.01% 11.01%"}, "model_tokens": {"rwkv": [[52342, " objects", "normal", 0.009674837812781334]], "qwen": [[6171, " objects", "normal", 0.007564160972833633]]}, "loss": {"rwkv": 10.425725881424148, "qwen": 11.010318559321329}, "topk": {"rwkv": [52342, 10, 0.009674837812781334, [[4715, 0.352642, " or", false], [21265, 0.126372, " and", false], [47284, 0.119993, " simple", false], [37598, 0.051097, " about", false], [32251, 0.040858, " time", false], [32139, 0.03059, " such", false], [4423, 0.025031, " as", false], [4811, 0.016073, " to", false], [51018, 0.014967, " because", false], [52342, 0.009675, " objects", false]]], "qwen": [6171, 12, 0.007564160972833633, [[476, 0.347496, " or", false], [882, 0.303176, " time", false], [323, 0.0296, " and", false], [911, 0.027436, " about", false], [4128, 0.022497, " language", false], [438, 0.018997, " as", false], [1894, 0.018668, " color", false], [1741, 0.016463, " such", false], [311, 0.013976, " to", false], [4285, 0.012753, " simple", false]]]}, "raw_delta": -0.032416701316833496, "tuned_delta": -0.02560442350973555}, {"byte_start": 6252, "byte_end": 6253, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "1.26%", "qwen": "0.86%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.9326483011245728]], "qwen": [[11, ",", "normal", 0.9531685709953308]]}, "loss": {"rwkv": 1.2591881765571395, "qwen": 0.8649585266108387}, "topk": {"rwkv": [45, 1, 0.9326483011245728, [[45, 0.932648, ",", false], [21265, 0.036121, " and", false], [4596, 0.012842, " in", false], [4715, 0.010227, " or", false], [275, 0.001684, " (", false], [4706, 0.00116, " of", false], [32227, 0.000638, " that", false], [32487, 0.000636, " with", false], [4423, 0.000419, " as", false], [21643, 0.000287, " etc", false]]], "qwen": [11, 1, 0.9531685709953308, [[11, 0.953169, ",", false], [323, 0.025544, " and", false], [476, 0.008522, " or", false], [304, 0.007181, " in", false], [320, 0.001544, " (", false], [315, 0.000549, " of", false], [429, 0.000304, " that", false], [4992, 0.000284, " etc", false], [438, 0.000209, " as", false], [13, 0.000204, ".", false]]]}, "raw_delta": 0.02186073362827301, "tuned_delta": 0.028673011435370956}, {"byte_start": 6253, "byte_end": 6262, "display": {"text": " multiple", "kind": "normal"}, "is_word": true, "word_id": 1050, "word_key": " multiple", "bytes_hex": "20 6d 75 6c 74 69 70 6c 65", "compression": {"rwkv": "21.54% 21.54% 21.54% 21.54% 21.54% 21.54% 21.54% 21.54% 21.54%", "qwen": "21.59% 21.59% 21.59% 21.59% 21.59% 21.59% 21.59% 21.59% 21.59%"}, "model_tokens": {"rwkv": [[56679, " multiple", "normal", 2.206568024121225e-05]], "qwen": [[5248, " multiple", "normal", 2.091510032187216e-05]]}, "loss": {"rwkv": 21.54023845771716, "qwen": 21.590409618810526}, "topk": {"rwkv": [56679, 808, 2.206568024121225e-05, [[21265, 0.165334, " and", false], [4715, 0.128876, " or", false], [50851, 0.107507, " actions", false], [38604, 0.037086, " goals", false], [45909, 0.030712, " events", false], [21643, 0.030053, " etc", false], [61661, 0.027035, " categories", false], [47184, 0.026817, " scenes", false], [46606, 0.023694, " motion", false], [45124, 0.020128, " agents", false]]], "qwen": [5248, 1010, 2.091510032187216e-05, [[476, 0.146282, " or", false], [323, 0.125577, " and", false], [882, 0.073682, " time", false], [4992, 0.044693, " etc", false], [4244, 0.041437, " words", false], [4357, 0.028706, " events", false], [4128, 0.028093, " language", false], [6168, 0.020604, " actions", false], [11379, 0.01876, " motion", false], [279, 0.016326, " the", false]]]}, "raw_delta": -0.002782079908582924, "tuned_delta": 0.004030197898515023}, {"byte_start": 6262, "byte_end": 6269, "display": {"text": " agents", "kind": "normal"}, "is_word": true, "word_id": 1051, "word_key": " agents", "bytes_hex": "20 61 67 65 6e 74 73", "compression": {"rwkv": "9.38% 9.38% 9.38% 9.38% 9.38% 9.38% 9.38%", "qwen": "3.37% 3.37% 3.37% 3.37% 3.37% 3.37% 3.37%"}, "model_tokens": {"rwkv": [[45124, " agents", "normal", 0.026028016582131386]], "qwen": [[13009, " agents", "normal", 0.27024340629577637]]}, "loss": {"rwkv": 9.37912791649354, "qwen": 3.3708369235203084}, "topk": {"rwkv": [45124, 3, 0.026028016582131386, [[52342, 0.680083, " objects", false], [46691, 0.033219, " object", false], [45124, 0.026028, " agents", false], [47539, 0.018412, " things", false], [56606, 0.011576, " meanings", false], [46, 0.01145, "-", false], [38604, 0.009663, " goals", false], [55816, 0.009575, " concepts", false], [65275, 0.009417, " representations", false], [61867, 0.007649, " dimensions", false]]], "qwen": [13009, 1, 0.27024340629577637, [[13009, 0.270243, " agents", false], [6171, 0.051458, " objects", false], [43613, 0.049531, " representations", false], [15336, 0.044358, " dimensions", false], [38455, 0.029288, " perspectives", false], [20062, 0.022272, " minds", false], [1251, 0.020611, " people", false], [2513, 0.018062, " things", false], [37107, 0.016936, " senses", false], [6194, 0.015997, " views", false]]]}, "raw_delta": 0.33317039694104883, "tuned_delta": 0.33998267474814675}, {"byte_start": 6269, "byte_end": 6270, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "2.59%", "qwen": "2.10%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.8661974668502808]], "qwen": [[11, ",", "normal", 0.8899271488189697]]}, "loss": {"rwkv": 2.5888204469076856, "qwen": 2.103010975907061}, "topk": {"rwkv": [45, 1, 0.8661974668502808, [[45, 0.866197, ",", false], [21265, 0.026299, " and", false], [63662, 0.021322, " interacting", false], [4596, 0.016147, " in", false], [47, 0.011672, ".", false], [4715, 0.009252, " or", false], [45094, 0.008106, " acting", false], [275, 0.003818, " (", false], [45580, 0.003607, " cooper", false], [21643, 0.003414, " etc", false]]], "qwen": [11, 1, 0.8899271488189697, [[11, 0.889927, ",", false], [323, 0.024245, " and", false], [13, 0.015877, ".", false], [44730, 0.011038, " interacting", false], [304, 0.00927, " in", false], [476, 0.009064, " or", false], [6, 0.005501, "'", false], [448, 0.005398, " with", false], [4992, 0.005097, " etc", false], [320, 0.003637, " (", false]]]}, "raw_delta": 0.026938997209072113, "tuned_delta": 0.03375127501617006}, {"byte_start": 6270, "byte_end": 6273, "display": {"text": " or", "kind": "normal"}, "is_word": true, "word_id": 1052, "word_key": " or", "bytes_hex": "20 6f 72", "compression": {"rwkv": "12.96% 12.96% 12.96%", "qwen": "16.14% 16.14% 16.14%"}, "model_tokens": {"rwkv": [[4715, " or", "normal", 0.11760280281305313]], "qwen": [[476, " or", "normal", 0.06827627867460251]]}, "loss": {"rwkv": 12.96171325798678, "qwen": 16.135299082036887}, "topk": {"rwkv": [4715, 3, 0.11760280281305313, [[21643, 0.167384, " etc", false], [21265, 0.138596, " and", false], [4715, 0.117603, " or", false], [38604, 0.042988, " goals", false], [50851, 0.037687, " actions", false], [45432, 0.018823, " causal", false], [56529, 0.01749, " language", false], [22590, 0.012102, " the", false], [32251, 0.011832, " time", false], [45095, 0.011785, " action", false]]], "qwen": [476, 3, 0.06827627867460251, [[4992, 0.362629, " etc", false], [323, 0.112262, " and", false], [476, 0.068276, " or", false], [882, 0.028907, " time", false], [5248, 0.022951, " multiple", false], [4128, 0.018681, " language", false], [279, 0.014417, " the", false], [6540, 0.013399, " knowledge", false], [8845, 0.012834, " goals", false], [3738, 0.009357, " human", false]]]}, "raw_delta": -0.17598096529642737, "tuned_delta": -0.16916868748932942}, {"byte_start": 6273, "byte_end": 6280, "display": {"text": " symmet", "kind": "normal"}, "is_word": true, "word_id": 1053, "word_key": " symmet", "bytes_hex": "20 73 79 6d 6d 65 74", "compression": {"rwkv": "25.60% 25.60% 25.60% 25.60% 25.60% 25.60% 25.60%", "qwen": "39.61% 39.61% 39.61% 39.61% 0.16% 0.16% 0.16%"}, "model_tokens": {"rwkv": [[47484, " symmet", "normal", 4.764854384120554e-05]], "qwen": [[7886, " sym", "normal", 0.00015302766405511647], [4059, "met", "normal", 0.9731724262237549]]}, "loss": {"rwkv": 25.601396372917993, "qwen": 22.702058773788}, "topk": {"rwkv": [47484, 1007, 4.764854384120554e-05, [[30788, 0.075281, " even", false], [22590, 0.073235, " the", false], [45432, 0.036255, " causal", false], [47284, 0.030252, " simple", false], [39193, 0.028176, " other", false], [38604, 0.025625, " goals", false], [50851, 0.024608, " actions", false], [56529, 0.019898, " language", false], [38720, 0.018151, " human", false], [55816, 0.014724, " concepts", false]]], "qwen": [7886, 472, 0.00015302766405511647, [[279, 0.078277, " the", false], [1496, 0.069353, " even", false], [3738, 0.034636, " human", false], [1008, 0.032857, " other", false], [4128, 0.032166, " language", false], [5248, 0.025747, " multiple", false], [882, 0.020751, " time", false], [6540, 0.018177, " knowledge", false], [894, 0.017684, " any", false], [4113, 0.015942, " anything", false]]]}, "raw_delta": 0.16077341458627165, "tuned_delta": 0.1675856923933696}, {"byte_start": 6280, "byte_end": 6284, "display": {"text": "ries", "kind": "normal"}, "is_word": true, "word_id": 1054, "word_key": "ries", "bytes_hex": "72 69 65 73", "compression": {"rwkv": "0.01% 0.01% 0.01% 0.01%", "qwen": "0.00% 0.00% 0.00% 0.00%"}, "model_tokens": {"rwkv": [[26892, "ries", "normal", 0.9987442493438721]], "qwen": [[4019, "ries", "normal", 0.9997239708900452]]}, "loss": {"rwkv": 0.0056754274784726845, "qwen": 0.0012445526786539558}, "topk": {"rwkv": [26892, 1, 0.9987442493438721, [[26892, 0.998744, "ries", false], [8623, 0.000467, "riz", false], [7789, 0.000344, "ies", false], [122, 8e-05, "y", false], [1939, 7.3e-05, "ic", false], [26910, 2.7e-05, "rise", false], [8608, 2.7e-05, "rie", false], [8619, 2.5e-05, "ris", false], [8562, 1.6e-05, "ral", false], [2159, 1.2e-05, "ri", false]]], "qwen": [4019, 1, 0.9997239708900452, [[4019, 0.999724, "ries", false], [81, 8.5e-05, "r", false], [7231, 2.8e-05, "rie", false], [4543, 2.7e-05, "tries", false], [550, 1.7e-05, "ies", false], [5963, 1.5e-05, "ris", false], [461, 1.3e-05, "ri", false], [1539, 7e-06, "try", false], [376, 6e-06, "tr", false], [25610, 5e-06, "rons", false]]]}, "raw_delta": 0.0002456998699926771, "tuned_delta": 0.007057977677090624}, {"byte_start": 6284, "byte_end": 6285, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "9.09%", "qwen": "12.28%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.6003479957580566]], "qwen": [[13, ".", "normal", 0.5062693953514099]]}, "loss": {"rwkv": 9.087288099349427, "qwen": 12.275286427839026}, "topk": {"rwkv": [47, 1, 0.6003479957580566, [[47, 0.600348, ".", false], [45, 0.269091, ",", false], [4596, 0.026874, " in", false], [4706, 0.025156, " of", false], [60, 0.016195, ";", false], [21265, 0.013893, " and", false], [275, 0.012099, " (", false], [4715, 0.011059, " or", false], [5346, 0.00711, "---", false], [32227, 0.003477, " that", false]]], "qwen": [13, 1, 0.5062693953514099, [[13, 0.506269, ".", false], [11, 0.235655, ",", false], [382, 0.050041, ".\n\n", false], [323, 0.049627, " and", false], [476, 0.036576, " or", false], [304, 0.02841, " in", false], [315, 0.025678, " of", false], [4421, 0.014913, "---", false], [26, 0.014688, ";", false], [320, 0.012269, " (", false]]]}, "raw_delta": -0.17678016424179077, "tuned_delta": -0.16996788643469282}, {"byte_start": 6285, "byte_end": 6289, "display": {"text": " All", "kind": "normal"}, "is_word": true, "word_id": 1055, "word_key": " all", "bytes_hex": "20 41 6c 6c", "compression": {"rwkv": "20.85% 20.85% 20.85% 20.85%", "qwen": "19.97% 19.97% 19.97% 19.97%"}, "model_tokens": {"rwkv": [[19407, " All", "normal", 0.00976792722940445]], "qwen": [[2009, " All", "normal", 0.011931069195270538]]}, "loss": {"rwkv": 20.851451762848296, "qwen": 19.966039930760708}, "topk": {"rwkv": [19407, 15, 0.00976792722940445, [[20996, 0.164115, " The", false], [4331, 0.096452, " We", false], [37453, 0.056346, " These", false], [29894, 0.05034, " This", false], [50342, 0.045342, " Instead", false], [261, 0.044358, "\n\n", false], [3918, 0.032952, " It", false], [37451, 0.032044, " There", false], [3913, 0.030901, " In", false], [29834, 0.02124, " Such", false]]], "qwen": [2009, 15, 0.011931069195270538, [[576, 0.137482, " The", false], [1205, 0.108703, " We", false], [12090, 0.078001, " Instead", false], [1096, 0.065582, " This", false], [4220, 0.051513, " These", false], [1084, 0.039099, " It", false], [758, 0.025056, " In", false], [2619, 0.024796, " There", false], [15132, 0.024106, " Such", false], [1416, 0.021449, " If", false]]]}, "raw_delta": 0.049097657203674316, "tuned_delta": 0.055909935010772266}, {"byte_start": 6289, "byte_end": 6295, "display": {"text": " these", "kind": "normal"}, "is_word": true, "word_id": 1056, "word_key": " these", "bytes_hex": "20 74 68 65 73 65", "compression": {"rwkv": "4.16% 4.16% 4.16% 4.16% 4.16% 4.16%", "qwen": "4.02% 4.02% 4.02% 4.02% 4.02% 4.02%"}, "model_tokens": {"rwkv": [[39936, " these", "normal", 0.2488696575164795]], "qwen": [[1493, " these", "normal", 0.26273828744888306]]}, "loss": {"rwkv": 4.156201533810978, "qwen": 4.0172950879781695}, "topk": {"rwkv": [39936, 2, 0.2488696575164795, [[4706, 0.324569, " of", false], [39936, 0.24887, " these", false], [32139, 0.114467, " such", false], [22590, 0.071128, " the", false], [32234, 0.043603, " this", false], [39944, 0.033239, " those", false], [32227, 0.018349, " that", false], [22248, 0.016228, " our", false], [4858, 0.011014, " we", false], [38720, 0.009266, " human", false]]], "qwen": [1493, 2, 0.26273828744888306, [[315, 0.365524, " of", false], [1493, 0.262738, " these", false], [1741, 0.059072, " such", false], [279, 0.050706, " the", false], [419, 0.038164, " this", false], [429, 0.035941, " that", false], [582, 0.032031, " we", false], [1846, 0.029898, " those", false], [1039, 0.023221, " our", false], [13553, 0.009483, " attempts", false]]]}, "raw_delta": 0.007702608903249114, "tuned_delta": 0.01451488671034706}, {"byte_start": 6295, "byte_end": 6299, "display": {"text": " are", "kind": "normal"}, "is_word": true, "word_id": 1057, "word_key": " are", "bytes_hex": "20 61 72 65", "compression": {"rwkv": "6.97% 6.97% 6.97% 6.97%", "qwen": "7.74% 7.74% 7.74% 7.74%"}, "model_tokens": {"rwkv": [[21286, " are", "normal", 0.21246960759162903]], "qwen": [[525, " are", "normal", 0.17949646711349487]]}, "loss": {"rwkv": 6.9739652855472345, "qwen": 7.743664502905407}, "topk": {"rwkv": [21286, 1, 0.21246960759162903, [[21286, 0.21247, " are", false], [47539, 0.139286, " things", false], [47284, 0.081818, " simple", false], [38735, 0.032935, " ideas", false], [32448, 0.032693, " ways", false], [52326, 0.028891, " notions", false], [51566, 0.028861, " efforts", false], [55572, 0.028577, " attempts", false], [61590, 0.028146, " approaches", false], [55816, 0.025517, " concepts", false]]], "qwen": [525, 1, 0.17949646711349487, [[525, 0.179496, " are", false], [2513, 0.14278, " things", false], [4285, 0.083813, " simple", false], [614, 0.033614, " have", false], [18940, 0.026301, " concepts", false], [6708, 0.024537, " ideas", false], [58582, 0.022189, " notions", false], [5510, 0.021111, " ways", false], [2803, 0.020764, " seem", false], [13553, 0.019804, " attempts", false]]]}, "raw_delta": -0.04268118739128113, "tuned_delta": -0.03586890958418318}, {"byte_start": 6299, "byte_end": 6304, "display": {"text": " part", "kind": "normal"}, "is_word": true, "word_id": 1058, "word_key": " part", "bytes_hex": "20 70 61 72 74", "compression": {"rwkv": "21.08% 21.08% 21.08% 21.08% 21.08%", "qwen": "17.79% 17.79% 17.79% 17.79% 17.79%"}, "model_tokens": {"rwkv": [[31633, " part", "normal", 0.0029317159205675125]], "qwen": [[949, " part", "normal", 0.00720400782302022]]}, "loss": {"rwkv": 21.076872862987198, "qwen": 17.79246170535885}, "topk": {"rwkv": [31633, 59, 0.0029317159205675125, [[32386, 0.060224, " very", false], [51258, 0.043328, " complex", false], [47284, 0.035845, " simple", false], [22614, 0.034115, " too", false], [59829, 0.029005, " important", false], [47687, 0.021887, " useful", false], [32448, 0.021392, " ways", false], [59699, 0.019254, " extremely", false], [30992, 0.016417, " good", false], [63366, 0.014097, " complicated", false]]], "qwen": [949, 26, 0.00720400782302022, [[5390, 0.053922, " useful", false], [4285, 0.028505, " simple", false], [6351, 0.027971, " complex", false], [1602, 0.026334, " very", false], [2238, 0.025342, " too", false], [2989, 0.023064, " important", false], [1101, 0.019092, " just", false], [2244, 0.016302, " great", false], [9016, 0.016134, " extremely", false], [1661, 0.015528, " good", false]]]}, "raw_delta": 0.18212642669677725, "tuned_delta": 0.1889387045038752}, {"byte_start": 6304, "byte_end": 6307, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 1059, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "0.07% 0.07% 0.07%", "qwen": "0.11% 0.11% 0.11%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.9877299666404724]], "qwen": [[315, " of", "normal", 0.9824559688568115]]}, "loss": {"rwkv": 0.0748468496554943, "qwen": 0.10639722371129687}, "topk": {"rwkv": [4706, 1, 0.9877299666404724, [[4706, 0.98773, " of", false], [21265, 0.008791, " and", false], [46, 0.001025, "-", false], [45, 0.000786, ",", false], [22590, 0.000313, " the", false], [275, 0.000108, " (", false], [4596, 8.6e-05, " in", false], [38720, 6.8e-05, " human", false], [4715, 6e-05, " or", false], [32464, 5.2e-05, " what", false]]], "qwen": [315, 1, 0.9824559688568115, [[315, 0.982456, " of", false], [323, 0.012155, " and", false], [11, 0.002275, ",", false], [9777, 0.000429, "-and", false], [4421, 0.000221, "---", false], [6351, 0.000212, " complex", false], [320, 0.000203, " (", false], [714, 0.000132, " but", false], [279, 0.000132, " the", false], [476, 0.000102, " or", false]]]}, "raw_delta": -0.001749524225791295, "tuned_delta": 0.005062753581306652}, {"byte_start": 6307, "byte_end": 6311, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 1060, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "2.59% 2.59% 2.59% 2.59%", "qwen": "2.77% 2.77% 2.77% 2.77%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.5592520833015442]], "qwen": [[279, " the", "normal", 0.5408031344413757]]}, "loss": {"rwkv": 2.5888204469076856, "qwen": 2.7713270923888382}, "topk": {"rwkv": [22590, 1, 0.5592520833015442, [[22590, 0.559252, " the", false], [32464, 0.076464, " what", false], [22248, 0.049788, " our", false], [38720, 0.044117, " human", false], [332, 0.036865, " a", false], [21835, 0.032356, " how", false], [39026, 0.026174, " minds", false], [52652, 0.02196, " reality", false], [51258, 0.015578, " complex", false], [57419, 0.01327, " thinking", false]]], "qwen": [279, 1, 0.5408031344413757, [[279, 0.540803, " the", false], [1039, 0.075508, " our", false], [1128, 0.062604, " what", false], [3738, 0.043597, " human", false], [20062, 0.042312, " minds", false], [264, 0.041211, " a", false], [3971, 0.020199, " mind", false], [6351, 0.016703, " complex", false], [1246, 0.009529, " how", false], [4586, 0.008416, " general", false]]]}, "raw_delta": -0.010120317339897156, "tuned_delta": -0.003308039532799209}, {"byte_start": 6311, "byte_end": 6321, "display": {"text": " arbitrary", "kind": "normal"}, "is_word": true, "word_id": 1061, "word_key": " arbitrary", "bytes_hex": "20 61 72 62 69 74 72 61 72 79", "compression": {"rwkv": "18.60% 18.60% 18.60% 18.60% 18.60% 18.60% 18.60% 18.60% 18.60% 18.60%", "qwen": "18.48% 18.48% 18.48% 18.48% 18.48% 18.48% 18.48% 18.48% 18.48% 18.48%"}, "model_tokens": {"rwkv": [[59163, " arbitrary", "normal", 3.251288944738917e-05]], "qwen": [[24168, " arbitrary", "normal", 3.55418051185552e-05]]}, "loss": {"rwkv": 18.597240761459293, "qwen": 18.475153717264796}, "topk": {"rwkv": [59163, 1032, 3.251288944738917e-05, [[61720, 0.209146, " complexity", false], [55847, 0.099577, " contents", false], [31427, 0.062127, " mind", false], [38720, 0.061934, " human", false], [52569, 0.037672, " problem", false], [51258, 0.034641, " complex", false], [31835, 0.029986, " real", false], [45098, 0.028603, " actual", false], [51308, 0.021607, " content", false], [22752, 0.0209, " way", false]]], "qwen": [24168, 1218, 3.55418051185552e-05, [[23094, 0.230235, " complexity", false], [3971, 0.082195, " mind", false], [6351, 0.044407, " complex", false], [3738, 0.025924, " human", false], [8794, 0.024136, " contents", false], [5042, 0.021258, " actual", false], [3491, 0.020376, " problem", false], [20062, 0.020193, " minds", false], [88930, 0.0185, " richness", false], [2213, 0.016962, " content", false]]]}, "raw_delta": 0.006769943237304732, "tuned_delta": 0.013582221044402678}, {"byte_start": 6321, "byte_end": 6322, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "45.65%", "qwen": "36.15%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.07996922731399536]], "qwen": [[11, ",", "normal", 0.13471338152885437]]}, "loss": {"rwkv": 45.647772778127354, "qwen": 36.15043504345827}, "topk": {"rwkv": [45, 2, 0.07996922731399536, [[61720, 0.60989, " complexity", false], [45, 0.079969, ",", false], [60572, 0.027696, " structure", false], [21265, 0.025322, " and", false], [64294, 0.021552, " complexities", false], [55847, 0.014665, " contents", false], [51308, 0.011666, " content", false], [46642, 0.009715, " nature", false], [38720, 0.007492, " human", false], [64295, 0.007484, " complication", false]]], "qwen": [11, 2, 0.13471338152885437, [[23094, 0.148095, " complexity", false], [11, 0.134713, ",", false], [323, 0.055262, " and", false], [5944, 0.043879, " structure", false], [3738, 0.041658, " human", false], [15491, 0.030826, " simpl", false], [3565, 0.021551, " details", false], [10502, 0.014835, " mental", false], [2213, 0.014607, " content", false], [6993, 0.014223, " nature", false]]]}, "raw_delta": 0.526644229888916, "tuned_delta": 0.5334565076960139}, {"byte_start": 6322, "byte_end": 6336, "display": {"text": " intrinsically", "kind": "normal"}, "is_word": true, "word_id": 1062, "word_key": " intrinsically", "bytes_hex": "20 69 6e 74 72 69 6e 73 69 63 61 6c 6c 79", "compression": {"rwkv": "10.93% 10.93% 10.93% 10.93% 10.93% 10.93% 10.93% 10.93% 10.93% 10.93% 6.48% 6.48% 6.48% 6.48%", "qwen": "30.80% 30.80% 30.80% 30.80% 30.80% 0.10% 0.10% 0.10% 0.00% 0.00% 0.00% 0.00% 0.00% 0.00%"}, "model_tokens": {"rwkv": [[59914, " intrinsic", "normal", 0.0023238679859787226], [24525, "ally", "normal", 0.24050983786582947]], "qwen": [[10582, " intr", "normal", 0.00019538900232873857], [1330, "ins", "normal", 0.9828972220420837], [2673, "ically", "normal", 0.9994437098503113]]}, "loss": {"rwkv": 9.660904291667167, "qwen": 11.024154460112934}, "topk": {"rwkv": [59914, 44, 0.0023238679859787226, [[51258, 0.16301, " complex", false], [38720, 0.1183, " human", false], [39011, 0.03866, " messy", false], [63366, 0.038407, " complicated", false], [21265, 0.02307, " and", false], [62590, 0.015551, " subjective", false], [31170, 0.013421, " irre", false], [22184, 0.013199, " non", false], [46199, 0.010353, " highly", false], [21861, 0.009479, " idi", false]]], "qwen": [10582, 561, 0.00019538900232873857, [[24870, 0.118122, " irre", false], [6351, 0.08494, " complex", false], [3738, 0.072046, " human", false], [323, 0.033334, " and", false], [714, 0.015954, " but", false], [650, 0.015624, " un", false], [16965, 0.01198, " complicated", false], [877, 0.011912, " id", false], [45846, 0.010069, " messy", false], [24168, 0.009484, " arbitrary", false]]]}, "raw_delta": -0.07559464085248438, "tuned_delta": -0.06878236304538643}, {"byte_start": 6336, "byte_end": 6344, "display": {"text": "-complex", "kind": "normal"}, "is_word": true, "word_id": 1063, "word_key": "-complex", "bytes_hex": "2d 63 6f 6d 70 6c 65 78", "compression": {"rwkv": "76.64% 2.17% 2.17% 2.17% 2.17% 2.17% 2.17% 2.17%", "qwen": "21.28% 21.28% 21.28% 21.28% 0.08% 0.08% 0.08% 0.08%"}, "model_tokens": {"rwkv": [[46, "-", "normal", 0.014391020871698856], [48997, "complex", "normal", 0.43170493841171265]], "qwen": [[11476, "-com", "normal", 0.008921952918171883], [9111, "plex", "normal", 0.9829851984977722]]}, "loss": {"rwkv": 11.482387288325247, "qwen": 10.676848137768228}, "topk": {"rwkv": [46, 9, 0.014391020871698856, [[51258, 0.369968, " complex", false], [63366, 0.077067, " complicated", false], [39011, 0.065365, " messy", false], [59516, 0.035701, " difficult", false], [38720, 0.03556, " human", false], [31048, 0.023417, " hard", false], [38797, 0.019034, " intra", false], [63667, 0.015828, " interesting", false], [46, 0.014391, "-", false], [47284, 0.012203, " simple", false]]], "qwen": [11476, 9, 0.008921952918171883, [[6351, 0.474555, " complex", false], [16965, 0.050957, " complicated", false], [5000, 0.04705, " difficult", false], [83544, 0.027861, " unknow", false], [650, 0.021079, " un", false], [2588, 0.018002, " hard", false], [24870, 0.01069, " irre", false], [3738, 0.009019, " human", false], [11476, 0.008922, "-com", false], [55926, 0.007587, " meaningless", false]]]}, "raw_delta": 0.04466857528313994, "tuned_delta": 0.05148085309023789}, {"byte_start": 6344, "byte_end": 6345, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "44.24%", "qwen": "37.66%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.08649198710918427]], "qwen": [[11, ",", "normal", 0.12389146536588669]]}, "loss": {"rwkv": 44.23889090225922, "qwen": 37.66064049808222}, "topk": {"rwkv": [45, 4, 0.08649198710918427, [[55847, 0.310736, " contents", false], [46642, 0.155047, " nature", false], [60572, 0.118126, " structure", false], [45, 0.086492, ",", false], [51308, 0.058063, " content", false], [61720, 0.0153, " complexity", false], [38720, 0.013654, " human", false], [56480, 0.013143, " internal", false], [52652, 0.010186, " reality", false], [46, 0.008467, "-", false]]], "qwen": [11, 1, 0.12389146536588669, [[11, 0.123891, ",", false], [8794, 0.092671, " contents", false], [6993, 0.071234, " nature", false], [5944, 0.060559, " structure", false], [1879, 0.058331, " world", false], [2213, 0.033085, " content", false], [3971, 0.03014, " mind", false], [10502, 0.023869, " mental", false], [323, 0.022605, " and", false], [20062, 0.01616, " minds", false]]]}, "raw_delta": 0.3647756576538086, "tuned_delta": 0.3715879354609065}, {"byte_start": 6345, "byte_end": 6353, "display": {"text": " outside", "kind": "normal"}, "is_word": true, "word_id": 1064, "word_key": " outside", "bytes_hex": "20 6f 75 74 73 69 64 65", "compression": {"rwkv": "24.37% 24.37% 24.37% 24.37% 24.37% 24.37% 24.37% 24.37%", "qwen": "21.42% 21.42% 21.42% 21.42% 21.42% 21.42% 21.42% 21.42%"}, "model_tokens": {"rwkv": [[52391, " outside", "normal", 2.0112433048780076e-05]], "qwen": [[4889, " outside", "normal", 7.482973160222173e-05]]}, "loss": {"rwkv": 24.373656452518617, "qwen": 21.41567094596764}, "topk": {"rwkv": [52391, 1922, 2.0112433048780076e-05, [[55847, 0.088434, " contents", false], [21265, 0.063021, " and", false], [38720, 0.057094, " human", false], [60572, 0.038505, " structure", false], [39011, 0.034131, " messy", false], [46642, 0.03031, " nature", false], [51308, 0.025385, " content", false], [56480, 0.022454, " internal", false], [31835, 0.01853, " real", false], [63682, 0.017868, " irreducible", false]]], "qwen": [4889, 960, 7.482973160222173e-05, [[24870, 0.181912, " irre", false], [323, 0.08592, " and", false], [3971, 0.045985, " mind", false], [3738, 0.029883, " human", false], [20062, 0.022767, " minds", false], [8794, 0.020036, " contents", false], [1931, 0.011558, " real", false], [2213, 0.010374, " content", false], [10502, 0.008828, " mental", false], [7548, 0.008385, " highly", false]]]}, "raw_delta": 0.16402554512023926, "tuned_delta": 0.1708378229273372}, {"byte_start": 6353, "byte_end": 6359, "display": {"text": " world", "kind": "normal"}, "is_word": true, "word_id": 1065, "word_key": " world", "bytes_hex": "20 77 6f 72 6c 64", "compression": {"rwkv": "7.37% 7.37% 7.37% 7.37% 7.37% 7.37%", "qwen": "3.07% 3.07% 3.07% 3.07% 3.07% 3.07%"}, "model_tokens": {"rwkv": [[40213, " world", "normal", 0.08354373276233673]], "qwen": [[1879, " world", "normal", 0.3606451451778412]]}, "loss": {"rwkv": 7.373148483709871, "qwen": 3.065308771741586}, "topk": {"rwkv": [40213, 2, 0.08354373276233673, [[46, 0.726626, "-", false], [40213, 0.083544, " world", false], [22590, 0.020179, " the", false], [4706, 0.016611, " of", false], [52652, 0.013589, " reality", false], [46642, 0.01286, " nature", false], [63536, 0.007868, " environment", false], [63637, 0.005378, " information", false], [60572, 0.005312, " structure", false], [32398, 0.004888, " view", false]]], "qwen": [1879, 1, 0.3606451451778412, [[1879, 0.360645, " world", false], [10603, 0.193052, "-the", false], [315, 0.051654, " of", false], [30084, 0.041532, "-world", false], [279, 0.03997, " the", false], [8729, 0.039052, " reality", false], [11, 0.023874, ",", false], [8668, 0.017669, "-of", false], [7947, 0.014426, " domain", false], [12, 0.006347, "-", false]]]}, "raw_delta": 0.2388773560523987, "tuned_delta": 0.24568963385949666}, {"byte_start": 6359, "byte_end": 6360, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "18.46%", "qwen": "32.75%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.3592549264431]], "qwen": [[13, ".", "normal", 0.16265623271465302]]}, "loss": {"rwkv": 18.45635257387248, "qwen": 32.751273191564614}, "topk": {"rwkv": [47, 1, 0.3592549264431, [[47, 0.359255, ".", false], [45, 0.249524, ",", false], [32227, 0.096903, " that", false], [4706, 0.057149, " of", false], [4858, 0.04312, " we", false], [60, 0.039484, ";", false], [5346, 0.034169, "---", false], [21265, 0.029423, " and", false], [4596, 0.016256, " in", false], [4811, 0.007289, " to", false]]], "qwen": [13, 3, 0.16265623271465302, [[11, 0.304169, ",", false], [429, 0.212047, " that", false], [13, 0.162656, ".", false], [315, 0.073421, " of", false], [582, 0.04008, " we", false], [323, 0.037262, " and", false], [304, 0.03095, " in", false], [26, 0.019891, ";", false], [382, 0.013724, ".\n\n", false], [4421, 0.011087, "---", false]]]}, "raw_delta": -0.792678713798523, "tuned_delta": -0.785866435991425}, {"byte_start": 6360, "byte_end": 6365, "display": {"text": " They", "kind": "normal"}, "is_word": true, "word_id": 1066, "word_key": " they", "bytes_hex": "20 54 68 65 79", "compression": {"rwkv": "10.26% 10.26% 10.26% 10.26% 10.26%", "qwen": "11.05% 11.05% 11.05% 11.05% 11.05%"}, "model_tokens": {"rwkv": [[29893, " They", "normal", 0.05802981182932854]], "qwen": [[2379, " They", "normal", 0.046690043061971664]]}, "loss": {"rwkv": 10.256660056319973, "qwen": 11.051852799461324}, "topk": {"rwkv": [29893, 3, 0.05802981182932854, [[20996, 0.158863, " The", false], [4331, 0.114291, " We", false], [29893, 0.05803, " They", false], [261, 0.037497, "\n\n", false], [19555, 0.034397, " But", false], [50342, 0.032404, " Instead", false], [30031, 0.032371, " What", false], [3918, 0.032007, " It", false], [37451, 0.030079, " There", false], [20571, 0.025993, " Our", false]]], "qwen": [2379, 3, 0.046690043061971664, [[576, 0.16355, " The", false], [1205, 0.103303, " We", false], [2379, 0.04669, " They", false], [1084, 0.039729, " It", false], [12090, 0.027401, " Instead", false], [2619, 0.024403, " There", false], [2014, 0.023697, " To", false], [758, 0.022879, " In", false], [1416, 0.022751, " If", false], [1597, 0.022629, " And", false]]]}, "raw_delta": -0.044094848632812544, "tuned_delta": -0.037282570825714595}, {"byte_start": 6365, "byte_end": 6369, "display": {"text": " are", "kind": "normal"}, "is_word": true, "word_id": 1067, "word_key": " are", "bytes_hex": "20 61 72 65", "compression": {"rwkv": "2.98% 2.98% 2.98% 2.98%", "qwen": "2.57% 2.57% 2.57% 2.57%"}, "model_tokens": {"rwkv": [[21286, " are", "normal", 0.5182651877403259]], "qwen": [[525, " are", "normal", 0.5650731921195984]]}, "loss": {"rwkv": 2.976262962771421, "qwen": 2.5734070392698905}, "topk": {"rwkv": [21286, 1, 0.5182651877403259, [[21286, 0.518265, " are", false], [4491, 0.077323, " do", false], [31059, 0.052588, " have", false], [47266, 0.049023, " should", false], [45409, 0.037015, " cannot", false], [21413, 0.035902, " can", false], [22074, 0.01837, " may", false], [32475, 0.015427, " will", false], [21256, 0.014745, " all", false], [31506, 0.010566, " need", false]]], "qwen": [525, 1, 0.5650731921195984, [[525, 0.565073, " are", false], [653, 0.050742, " do", false], [614, 0.046284, " have", false], [646, 0.043862, " can", false], [1265, 0.041158, " should", false], [1231, 0.027971, " may", false], [4157, 0.024155, " cannot", false], [3000, 0.012619, " exist", false], [1969, 0.011286, " must", false], [1184, 0.011214, " need", false]]]}, "raw_delta": 0.022339075803756714, "tuned_delta": 0.02915135361085466}, {"byte_start": 6369, "byte_end": 6373, "display": {"text": " not", "kind": "normal"}, "is_word": true, "word_id": 1068, "word_key": " not", "bytes_hex": "20 6e 6f 74", "compression": {"rwkv": "5.46% 5.46% 5.46% 5.46%", "qwen": "5.43% 5.43% 5.43% 5.43%"}, "model_tokens": {"rwkv": [[22187, " not", "normal", 0.29779180884361267]], "qwen": [[537, " not", "normal", 0.29971134662628174]]}, "loss": {"rwkv": 5.459417268988997, "qwen": 5.4323574112130855}, "topk": {"rwkv": [22187, 1, 0.29779180884361267, [[22187, 0.297792, " not", false], [31633, 0.049339, " part", false], [21256, 0.04504, " all", false], [22590, 0.043235, " the", false], [332, 0.015269, " a", false], [31198, 0.013421, " just", false], [45, 0.013263, ",", false], [31296, 0.012113, " like", false], [32464, 0.011407, " what", false], [47687, 0.010699, " useful", false]]], "qwen": [537, 1, 0.29971134662628174, [[537, 0.299711, " not", false], [949, 0.055794, " part", false], [279, 0.04706, " the", false], [678, 0.025093, " all", false], [1101, 0.018226, " just", false], [1128, 0.015271, " what", false], [1172, 0.014496, " only", false], [5390, 0.012231, " useful", false], [11, 0.010814, ",", false], [2513, 0.010723, " things", false]]]}, "raw_delta": 0.0015005171298980713, "tuned_delta": 0.008312794936996017}, {"byte_start": 6373, "byte_end": 6378, "display": {"text": " what", "kind": "normal"}, "is_word": true, "word_id": 1069, "word_key": " what", "bytes_hex": "20 77 68 61 74", "compression": {"rwkv": "17.02% 17.02% 17.02% 17.02% 17.02%", "qwen": "13.71% 13.71% 13.71% 13.71% 13.71%"}, "model_tokens": {"rwkv": [[32464, " what", "normal", 0.008835834451019764]], "qwen": [[1128, " what", "normal", 0.022369293496012688]]}, "loss": {"rwkv": 17.019293060486987, "qwen": 13.705840912433946}, "topk": {"rwkv": [32464, 14, 0.008835834451019764, [[31633, 0.132581, " part", false], [59914, 0.109699, " intrinsic", false], [22590, 0.097943, " the", false], [47284, 0.044788, " simple", false], [45, 0.026451, ",", false], [4596, 0.020336, " in", false], [47539, 0.015664, " things", false], [63591, 0.015204, " fundamental", false], [332, 0.013385, " a", false], [4811, 0.010918, " to", false]]], "qwen": [1128, 5, 0.022369293496012688, [[949, 0.257528, " part", false], [279, 0.149537, " the", false], [304, 0.03459, " in", false], [4766, 0.029046, " inside", false], [1128, 0.022369, " what", false], [46601, 0.018088, " intrinsic", false], [11, 0.013909, ",", false], [4285, 0.012322, " simple", false], [264, 0.011966, " a", false], [9902, 0.011239, " ``", false]]]}, "raw_delta": 0.18373680114746094, "tuned_delta": 0.1905490789545589}, {"byte_start": 6378, "byte_end": 6385, "display": {"text": " should", "kind": "normal"}, "is_word": true, "word_id": 1070, "word_key": " should", "bytes_hex": "20 73 68 6f 75 6c 64", "compression": {"rwkv": "11.75% 11.75% 11.75% 11.75% 11.75% 11.75% 11.75%", "qwen": "16.70% 16.70% 16.70% 16.70% 16.70% 16.70% 16.70%"}, "model_tokens": {"rwkv": [[47266, " should", "normal", 0.010496150702238083]], "qwen": [[1265, " should", "normal", 0.0015293064061552286]]}, "loss": {"rwkv": 11.754100221528384, "qwen": 16.701618500909266}, "topk": {"rwkv": [47266, 14, 0.010496150702238083, [[4858, 0.239333, " we", false], [4600, 0.146498, " is", false], [39026, 0.110875, " minds", false], [22590, 0.097792, " the", false], [3609, 0.036346, " AI", false], [38964, 0.023378, " makes", false], [52201, 0.015711, " matters", false], [22248, 0.013402, " our", false], [21286, 0.01309, " are", false], [460, 0.01162, "'s", false]]], "qwen": [1265, 39, 0.0015293064061552286, [[279, 0.238696, " the", false], [582, 0.149782, " we", false], [374, 0.120309, " is", false], [20062, 0.100219, " minds", false], [1039, 0.050444, " our", false], [3643, 0.0339, " makes", false], [432, 0.024385, " it", false], [5780, 0.018558, " goes", false], [12677, 0.015993, " humans", false], [264, 0.011859, " a", false]]]}, "raw_delta": -0.27434866768973215, "tuned_delta": -0.26753638988263423}, {"byte_start": 6385, "byte_end": 6388, "display": {"text": " be", "kind": "normal"}, "is_word": true, "word_id": 1071, "word_key": " be", "bytes_hex": "20 62 65", "compression": {"rwkv": "0.90% 0.90% 0.90%", "qwen": "1.14% 1.14% 1.14%"}, "model_tokens": {"rwkv": [[4435, " be", "normal", 0.8582890033721924]], "qwen": [[387, " be", "normal", 0.8268448710441589]]}, "loss": {"rwkv": 0.9040325370153823, "qwen": 1.1429644508871892}, "topk": {"rwkv": [4435, 1, 0.8582890033721924, [[4435, 0.858289, " be", false], [46530, 0.0156, " matter", false], [38306, 0.014109, " drive", false], [38649, 0.012524, " guide", false], [51273, 0.008246, " concern", false], [4715, 0.005936, " or", false], [46286, 0.005113, " inform", false], [38377, 0.004396, " enter", false], [56675, 0.003826, " motivate", false], [4559, 0.003541, " go", false]]], "qwen": [387, 1, 0.8268448710441589, [[387, 0.826845, " be", false], [8474, 0.029989, " guide", false], [6541, 0.017479, " drive", false], [6051, 0.009878, " inform", false], [728, 0.00861, " go", false], [4925, 0.007859, " matter", false], [8253, 0.007208, " determine", false], [61325, 0.005009, " motivate", false], [6979, 0.004122, " define", false], [1281, 0.003884, " make", false]]]}, "raw_delta": -0.013249198595682778, "tuned_delta": -0.006436920788584831}, {"byte_start": 6388, "byte_end": 6394, "display": {"text": " built", "kind": "normal"}, "is_word": true, "word_id": 1072, "word_key": " built", "bytes_hex": "20 62 75 69 6c 74", "compression": {"rwkv": "11.41% 11.41% 11.41% 11.41% 11.41% 11.41%", "qwen": "11.21% 11.21% 11.21% 11.21% 11.21% 11.21%"}, "model_tokens": {"rwkv": [[37924, " built", "normal", 0.022524278610944748]], "qwen": [[5798, " built", "normal", 0.023984147235751152]]}, "loss": {"rwkv": 11.411943194531839, "qwen": 11.212031277763288}, "topk": {"rwkv": [37924, 11, 0.022524278610944748, [[22339, 0.098149, " put", false], [22590, 0.083763, " the", false], [53137, 0.064752, " thought", false], [53035, 0.057938, " studied", false], [4596, 0.041059, " in", false], [52249, 0.03806, " modeled", false], [32354, 0.027314, " used", false], [52112, 0.026837, " learned", false], [61755, 0.024986, " considered", false], [62684, 0.023301, " understood", false]]], "qwen": [5798, 9, 0.023984147235751152, [[3381, 0.102225, " thought", false], [279, 0.082371, " the", false], [61553, 0.073139, " modeled", false], [304, 0.057516, " in", false], [4766, 0.056733, " inside", false], [15251, 0.036094, " represented", false], [9498, 0.034182, " learned", false], [518, 0.025864, " at", false], [5798, 0.023984, " built", false], [19476, 0.023806, " studied", false]]]}, "raw_delta": 0.011085470517476437, "tuned_delta": 0.017897748324574383}, {"byte_start": 6394, "byte_end": 6397, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 1073, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "17.19% 17.19% 17.19%", "qwen": "10.69% 10.69% 10.69%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.058468643575906754]], "qwen": [[304, " in", "normal", 0.16885791718959808]]}, "loss": {"rwkv": 17.188358885591164, "qwen": 10.692159254357676}, "topk": {"rwkv": [4596, 2, 0.058468643575906754, [[31162, 0.886921, " into", false], [4596, 0.058469, " in", false], [46301, 0.007842, " inside", false], [46, 0.006387, "-", false], [4450, 0.005892, " by", false], [47, 0.004708, ".", false], [45, 0.003895, ",", false], [4423, 0.002401, " as", false], [4712, 0.002254, " on", false], [21265, 0.002168, " and", false]]], "qwen": [304, 2, 0.16885791718959808, [[1119, 0.712143, " into", false], [304, 0.168858, " in", false], [4766, 0.053773, " inside", false], [11, 0.00777, ",", false], [2878, 0.006168, " within", false], [311, 0.005287, " to", false], [323, 0.004373, " and", false], [13, 0.004349, ".", false], [553, 0.004262, " by", false], [369, 0.003311, " for", false]]]}, "raw_delta": 0.3602257966995239, "tuned_delta": 0.36703807450662185}, {"byte_start": 6397, "byte_end": 6398, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "40.86%", "qwen": "48.25%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.10554150491952896]], "qwen": [[11, ",", "normal", 0.0688665434718132]]}, "loss": {"rwkv": 40.857574400175714, "qwen": 48.25066140587562}, "topk": {"rwkv": [45, 3, 0.10554150491952896, [[4811, 0.438015, " to", false], [47, 0.224683, ".", false], [45, 0.105542, ",", false], [4423, 0.045631, " as", false], [4450, 0.021476, " by", false], [22590, 0.016918, " the", false], [60, 0.015396, ";", false], [21265, 0.01444, " and", false], [4715, 0.012439, " or", false], [5346, 0.009578, "---", false]]], "qwen": [11, 3, 0.0688665434718132, [[311, 0.609426, " to", false], [13, 0.07712, ".", false], [11, 0.068867, ",", false], [279, 0.042724, " the", false], [1039, 0.025157, " our", false], [264, 0.023088, " a", false], [382, 0.016726, ".\n\n", false], [476, 0.014431, " or", false], [458, 0.013104, " an", false], [20062, 0.009841, " minds", false]]]}, "raw_delta": -0.4099597930908203, "tuned_delta": -0.4031475152837224}, {"byte_start": 6398, "byte_end": 6401, "display": {"text": " as", "kind": "normal"}, "is_word": true, "word_id": 1074, "word_key": " as", "bytes_hex": "20 61 73", "compression": {"rwkv": "16.16% 16.16% 16.16%", "qwen": "20.21% 20.21% 20.21%"}, "model_tokens": {"rwkv": [[4423, " as", "normal", 0.0682545155286789]], "qwen": [[438, " as", "normal", 0.03467898070812225]]}, "loss": {"rwkv": 16.15517884328787, "qwen": 20.20747849176884}, "topk": {"rwkv": [4423, 5, 0.0682545155286789, [[21400, 0.198762, " but", false], [21265, 0.182804, " and", false], [4715, 0.089792, " or", false], [32232, 0.074682, " they", false], [4423, 0.068255, " as", false], [4596, 0.035796, " in", false], [51018, 0.032632, " because", false], [22185, 0.031748, " nor", false], [4811, 0.016983, " to", false], [22187, 0.014888, " not", false]]], "qwen": [438, 7, 0.03467898070812225, [[323, 0.207156, " and", false], [476, 0.162336, " or", false], [6329, 0.139448, " nor", false], [714, 0.08335, " but", false], [1576, 0.046677, " because", false], [807, 0.039988, " they", false], [438, 0.034679, " as", false], [1496, 0.025316, " even", false], [311, 0.022693, " to", false], [304, 0.021659, " in", false]]]}, "raw_delta": -0.22470720609029138, "tuned_delta": -0.21789492828319343}, {"byte_start": 6401, "byte_end": 6407, "display": {"text": " their", "kind": "normal"}, "is_word": true, "word_id": 1075, "word_key": " their", "bytes_hex": "20 74 68 65 69 72", "compression": {"rwkv": "16.06% 16.06% 16.06% 16.06% 16.06% 16.06%", "qwen": "15.12% 15.12% 15.12% 15.12% 15.12% 15.12%"}, "model_tokens": {"rwkv": [[39931, " their", "normal", 0.00471049640327692]], "qwen": [[862, " their", "normal", 0.006524569820612669]]}, "loss": {"rwkv": 16.061253384896663, "qwen": 15.124794952249854}, "topk": {"rwkv": [39931, 33, 0.00471049640327692, [[32232, 0.149743, " they", false], [332, 0.0685, " a", false], [22590, 0.067718, " the", false], [31633, 0.061484, " part", false], [4858, 0.036923, " we", false], [4601, 0.031899, " it", false], [55666, 0.027753, " building", false], [4588, 0.024363, " if", false], [52369, 0.020567, " opposed", false], [38720, 0.017584, " human", false]]], "qwen": [862, 25, 0.006524569820612669, [[807, 0.175156, " they", false], [279, 0.082138, " the", false], [264, 0.064957, " a", false], [582, 0.056716, " we", false], [421, 0.045218, " if", false], [419, 0.044418, " this", false], [429, 0.036722, " that", false], [949, 0.031809, " part", false], [432, 0.02626, " it", false], [1493, 0.02526, " these", false]]]}, "raw_delta": 0.05192828178405762, "tuned_delta": 0.05874055959115557}, {"byte_start": 6407, "byte_end": 6418, "display": {"text": " complexity", "kind": "normal"}, "is_word": true, "word_id": 1076, "word_key": " complexity", "bytes_hex": "20 63 6f 6d 70 6c 65 78 69 74 79", "compression": {"rwkv": "3.43% 3.43% 3.43% 3.43% 3.43% 3.43% 3.43% 3.43% 3.43% 3.43% 3.43%", "qwen": "4.88% 4.88% 4.88% 4.88% 4.88% 4.88% 4.88% 4.88% 4.88% 4.88% 4.88%"}, "model_tokens": {"rwkv": [[61720, " complexity", "normal", 0.12427899986505508]], "qwen": [[23094, " complexity", "normal", 0.050824154168367386]]}, "loss": {"rwkv": 3.432548570296895, "qwen": 4.884479658024287}, "topk": {"rwkv": [61720, 1, 0.12427899986505508, [[61720, 0.124279, " complexity", false], [55847, 0.078675, " contents", false], [56916, 0.052122, " presence", false], [22681, 0.037397, " use", false], [32386, 0.027891, " very", false], [59914, 0.019053, " intrinsic", false], [59677, 0.016927, " existence", false], [45098, 0.014413, " actual", false], [51308, 0.014037, " content", false], [31894, 0.013026, " role", false]]], "qwen": [23094, 2, 0.050824154168367386, [[8794, 0.118183, " contents", false], [23094, 0.050824, " complexity", false], [13885, 0.036968, " existence", false], [9362, 0.031106, " presence", false], [2213, 0.029506, " content", false], [4752, 0.025276, " building", false], [13042, 0.022211, " representation", false], [6993, 0.015222, " nature", false], [990, 0.011962, " use", false], [54480, 0.011863, " computational", false]]]}, "raw_delta": -0.08051215518604625, "tuned_delta": -0.0736998773789483}, {"byte_start": 6418, "byte_end": 6421, "display": {"text": " is", "kind": "normal"}, "is_word": true, "word_id": 1077, "word_key": " is", "bytes_hex": "20 69 73", "compression": {"rwkv": "6.90% 6.90% 6.90%", "qwen": "8.06% 8.06% 8.06%"}, "model_tokens": {"rwkv": [[4600, " is", "normal", 0.31668969988822937]], "qwen": [[374, " is", "normal", 0.2616298794746399]]}, "loss": {"rwkv": 6.903521191753828, "qwen": 8.060003478998834}, "topk": {"rwkv": [4600, 1, 0.31668969988822937, [[4600, 0.31669, " is", false], [38964, 0.067132, " makes", false], [40219, 0.044134, " would", false], [32475, 0.039626, " will", false], [21265, 0.039301, " and", false], [45409, 0.032078, " cannot", false], [21413, 0.027123, " can", false], [30659, 0.025806, " does", false], [47266, 0.017596, " should", false], [21800, 0.016233, " has", false]]], "qwen": [374, 1, 0.2616298794746399, [[374, 0.26163, " is", false], [3643, 0.093887, " makes", false], [323, 0.05325, " and", false], [686, 0.04864, " will", false], [1035, 0.031732, " would", false], [4157, 0.02455, " cannot", false], [646, 0.0233, " can", false], [3363, 0.018559, " means", false], [27715, 0.017811, " grows", false], [27934, 0.016117, " prevents", false]]]}, "raw_delta": -0.06412899494171143, "tuned_delta": -0.057316717134613476}, {"byte_start": 6421, "byte_end": 6429, "display": {"text": " endless", "kind": "normal"}, "is_word": true, "word_id": 1078, "word_key": " endless", "bytes_hex": "20 65 6e 64 6c 65 73 73", "compression": {"rwkv": "17.96% 17.96% 17.96% 17.96% 17.96% 17.96% 17.96% 17.96%", "qwen": "18.18% 18.18% 18.18% 18.18% 18.18% 18.18% 18.18% 18.18%"}, "model_tokens": {"rwkv": [[51607, " endless", "normal", 0.0003490437811706215]], "qwen": [[25678, " endless", "normal", 0.00031490589026361704]]}, "loss": {"rwkv": 17.963243917318636, "qwen": 18.17623583127968}, "topk": {"rwkv": [51607, 236, 0.0003490437811706215, [[22187, 0.181749, " not", false], [22614, 0.066922, " too", false], [332, 0.064687, " a", false], [4419, 0.042394, " an", false], [45302, 0.030517, " beyond", false], [31581, 0.023318, " only", false], [62161, 0.020157, " irrelevant", false], [47285, 0.019035, " simply", false], [22590, 0.017247, " the", false], [31633, 0.017171, " part", false]]], "qwen": [25678, 295, 0.00031490589026361704, [[537, 0.092246, " not", false], [264, 0.06122, " a", false], [7797, 0.059096, " beyond", false], [773, 0.041949, " so", false], [2238, 0.037008, " too", false], [24870, 0.025747, " irre", false], [458, 0.02232, " an", false], [279, 0.021553, " the", false], [39715, 0.019333, " irrelevant", false], [3041, 0.018743, " far", false]]]}, "raw_delta": -0.011810779571533203, "tuned_delta": -0.004998501764435256}, {"byte_start": 6429, "byte_end": 6430, "display": {"text": ";", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "3b", "compression": {"rwkv": "81.15%", "qwen": "71.32%"}, "model_tokens": {"rwkv": [[60, ";", "normal", 0.01119476743042469]], "qwen": [[26, ";", "normal", 0.0191591028124094]]}, "loss": {"rwkv": 81.15159605000419, "qwen": 71.32282624929111}, "topk": {"rwkv": [60, 5, 0.01119476743042469, [[2030, 0.527495, "ly", false], [47, 0.185128, ".", false], [21265, 0.129736, " and", false], [45, 0.115986, ",", false], [60, 0.011195, ";", false], [4596, 0.005957, " in", false], [5346, 0.003675, "---", false], [275, 0.002929, " (", false], [55794, 0.001738, " compared", false], [4811, 0.001443, " to", false]]], "qwen": [26, 5, 0.0191591028124094, [[13, 0.294122, ".", false], [11, 0.279669, ",", false], [323, 0.27395, " and", false], [382, 0.055618, ".\n\n", false], [26, 0.019159, ";", false], [304, 0.016172, " in", false], [320, 0.012282, " (", false], [4421, 0.005053, "---", false], [311, 0.003033, " to", false], [1576, 0.002492, " because", false]]]}, "raw_delta": 0.54502272605896, "tuned_delta": 0.5518350038660579}, {"byte_start": 6430, "byte_end": 6438, "display": {"text": " instead", "kind": "normal"}, "is_word": true, "word_id": 1079, "word_key": " instead", "bytes_hex": "20 69 6e 73 74 65 61 64", "compression": {"rwkv": "5.71% 5.71% 5.71% 5.71% 5.71% 5.71% 5.71% 5.71%", "qwen": "6.45% 6.45% 6.45% 6.45% 6.45% 6.45% 6.45% 6.45%"}, "model_tokens": {"rwkv": [[52028, " instead", "normal", 0.08055522292852402]], "qwen": [[4518, " instead", "normal", 0.05730580538511276]]}, "loss": {"rwkv": 5.705971597265919, "qwen": 6.445586211976131}, "topk": {"rwkv": [52028, 3, 0.08055522292852402, [[32232, 0.293988, " they", false], [4858, 0.109719, " we", false], [52028, 0.080555, " instead", false], [22590, 0.076711, " the", false], [32464, 0.053723, " what", false], [4601, 0.04203, " it", false], [47001, 0.034116, " rather", false], [21265, 0.027289, " and", false], [39931, 0.024126, " their", false], [39934, 0.018999, " there", false]]], "qwen": [4518, 4, 0.05730580538511276, [[807, 0.1876, " they", false], [432, 0.067963, " it", false], [582, 0.060777, " we", false], [4518, 0.057306, " instead", false], [323, 0.056879, " and", false], [279, 0.05503, " the", false], [4751, 0.035705, " rather", false], [1052, 0.030189, " there", false], [862, 0.030058, " their", false], [304, 0.020754, " in", false]]]}, "raw_delta": -0.04101294279098511, "tuned_delta": -0.03420066498388716}, {"byte_start": 6438, "byte_end": 6441, "display": {"text": " we", "kind": "normal"}, "is_word": true, "word_id": 1080, "word_key": " we", "bytes_hex": "20 77 65", "compression": {"rwkv": "9.96% 9.96% 9.96%", "qwen": "14.87% 14.87% 14.87%"}, "model_tokens": {"rwkv": [[4858, " we", "normal", 0.19121627509593964]], "qwen": [[582, " we", "normal", 0.0842391699552536]]}, "loss": {"rwkv": 9.956098589468107, "qwen": 14.872354517747151}, "topk": {"rwkv": [4858, 2, 0.19121627509593964, [[45, 0.626366, ",", false], [4858, 0.191216, " we", false], [32232, 0.07738, " they", false], [22590, 0.025442, " the", false], [32464, 0.016413, " what", false], [4706, 0.012252, " of", false], [22226, 0.005238, " one", false], [4601, 0.00494, " it", false], [39936, 0.003775, " these", false], [21256, 0.003251, " all", false]]], "qwen": [582, 3, 0.0842391699552536, [[11, 0.677031, ",", false], [807, 0.117721, " they", false], [582, 0.084239, " we", false], [279, 0.028229, " the", false], [1128, 0.014383, " what", false], [432, 0.01135, " it", false], [315, 0.010613, " of", false], [825, 0.005054, " one", false], [862, 0.004203, " their", false], [1052, 0.003506, " there", false]]]}, "raw_delta": -0.272615114847819, "tuned_delta": -0.26580283704072105}, {"byte_start": 6441, "byte_end": 6448, "display": {"text": " should", "kind": "normal"}, "is_word": true, "word_id": 1081, "word_key": " should", "bytes_hex": "20 73 68 6f 75 6c 64", "compression": {"rwkv": "0.26% 0.26% 0.26% 0.26% 0.26% 0.26% 0.26%", "qwen": "0.41% 0.41% 0.41% 0.41% 0.41% 0.41% 0.41%"}, "model_tokens": {"rwkv": [[47266, " should", "normal", 0.9054984450340271]], "qwen": [[1265, " should", "normal", 0.8530765771865845]]}, "loss": {"rwkv": 0.25661777024740906, "qwen": 0.4093801314287926}, "topk": {"rwkv": [47266, 1, 0.9054984450340271, [[47266, 0.905498, " should", false], [31475, 0.028299, " must", false], [31506, 0.020561, " need", false], [31059, 0.011632, " have", false], [21286, 0.006522, " are", false], [39196, 0.004645, " ought", false], [21413, 0.003613, " can", false], [37923, 0.001662, " build", false], [32435, 0.001512, " want", false], [22626, 0.000855, " try", false]]], "qwen": [1265, 1, 0.8530765771865845, [[1265, 0.853077, " should", false], [1184, 0.034088, " need", false], [646, 0.024345, " can", false], [1969, 0.016667, " must", false], [614, 0.015318, " have", false], [1936, 0.009191, " build", false], [21776, 0.008415, " ought", false], [525, 0.006014, " are", false], [5931, 0.002937, " seek", false], [1366, 0.002463, " want", false]]]}, "raw_delta": -0.008470943995884486, "tuned_delta": -0.001658666188786539}, {"byte_start": 6448, "byte_end": 6454, "display": {"text": " build", "kind": "normal"}, "is_word": true, "word_id": 1082, "word_key": " build", "bytes_hex": "20 62 75 69 6c 64", "compression": {"rwkv": "5.40% 5.40% 5.40% 5.40% 5.40% 5.40%", "qwen": "4.60% 4.60% 4.60% 4.60% 4.60% 4.60%"}, "model_tokens": {"rwkv": [[37923, " build", "normal", 0.1650061011314392]], "qwen": [[1936, " build", "normal", 0.21648700535297394]]}, "loss": {"rwkv": 5.400713857494492, "qwen": 4.59926610534126}, "topk": {"rwkv": [37923, 1, 0.1650061011314392, [[37923, 0.165006, " build", false], [38530, 0.102909, " focus", false], [4435, 0.10049, " be", false], [22626, 0.053455, " try", false], [38877, 0.046321, " learn", false], [31966, 0.034007, " seek", false], [63373, 0.026584, " concentrate", false], [22681, 0.020893, " use", false], [32122, 0.020816, " stop", false], [39942, 0.020529, " think", false]]], "qwen": [1936, 1, 0.21648700535297394, [[1936, 0.216487, " build", false], [5244, 0.116851, " focus", false], [1430, 0.068962, " try", false], [5931, 0.06029, " seek", false], [387, 0.056968, " be", false], [1401, 0.031789, " look", false], [1744, 0.031542, " think", false], [36355, 0.024805, " concentrate", false], [990, 0.017762, " use", false], [1477, 0.016482, " find", false]]]}, "raw_delta": 0.04444169998168945, "tuned_delta": 0.0512539777887874}, {"byte_start": 6454, "byte_end": 6457, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 1083, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "8.74% 8.74% 8.74%", "qwen": "4.42% 4.42% 4.42%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.23599961400032043]], "qwen": [[304, " in", "normal", 0.479447603225708]]}, "loss": {"rwkv": 8.735067630382394, "qwen": 4.418978842224913}, "topk": {"rwkv": [4596, 1, 0.23599961400032043, [[4596, 0.236, " in", false], [52224, 0.098691, " methods", false], [53087, 0.077679, " systems", false], [22590, 0.040337, " the", false], [45124, 0.037965, " agents", false], [332, 0.027632, " a", false], [22248, 0.025495, " our", false], [56567, 0.02345, " machines", false], [51258, 0.019402, " complex", false], [3609, 0.016296, " AI", false]]], "qwen": [304, 1, 0.479447603225708, [[304, 0.479448, " in", false], [5413, 0.091186, " methods", false], [279, 0.037211, " the", false], [4586, 0.029043, " general", false], [34447, 0.024152, " computation", false], [389, 0.019459, " on", false], [1039, 0.019375, " our", false], [5942, 0.016499, " systems", false], [2513, 0.014034, " things", false], [25185, 0.011642, " algorithms", false]]]}, "raw_delta": 0.23933478196461996, "tuned_delta": 0.2461470597717179}, {"byte_start": 6457, "byte_end": 6462, "display": {"text": " only", "kind": "normal"}, "is_word": true, "word_id": 1084, "word_key": " only", "bytes_hex": "20 6f 6e 6c 79", "compression": {"rwkv": "13.30% 13.30% 13.30% 13.30% 13.30%", "qwen": "12.35% 12.35% 12.35% 12.35% 12.35%"}, "model_tokens": {"rwkv": [[31581, " only", "normal", 0.025298792868852615]], "qwen": [[1172, " only", "normal", 0.03259682282805443]]}, "loss": {"rwkv": 13.299844908195132, "qwen": 12.347811726686185}, "topk": {"rwkv": [31581, 7, 0.025298792868852615, [[22590, 0.168525, " the", false], [52224, 0.071672, " methods", false], [332, 0.046047, " a", false], [32464, 0.042827, " what", false], [63370, 0.0371, " computation", false], [51832, 0.028311, " general", false], [31581, 0.025299, " only", false], [32448, 0.021212, " ways", false], [47284, 0.020266, " simple", false], [61720, 0.020215, " complexity", false]]], "qwen": [1172, 8, 0.03259682282805443, [[279, 0.193697, " the", false], [5413, 0.111508, " methods", false], [4586, 0.074875, " general", false], [34447, 0.058896, " computation", false], [1246, 0.040794, " how", false], [1128, 0.035663, " what", false], [5510, 0.033375, " ways", false], [1172, 0.032597, " only", false], [264, 0.025612, " a", false], [4285, 0.015885, " simple", false]]]}, "raw_delta": 0.052791929244995206, "tuned_delta": 0.059604207052093156}, {"byte_start": 6462, "byte_end": 6466, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 1085, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "4.83% 4.83% 4.83% 4.83%", "qwen": "4.33% 4.33% 4.33% 4.33%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.3426506221294403]], "qwen": [[279, " the", "normal", 0.3827328383922577]]}, "loss": {"rwkv": 4.825420424848339, "qwen": 4.32997011701384}, "topk": {"rwkv": [22590, 1, 0.3426506221294403, [[22590, 0.342651, " the", false], [32464, 0.262794, " what", false], [332, 0.043731, " a", false], [47284, 0.040694, " simple", false], [39944, 0.033018, " those", false], [4423, 0.032531, " as", false], [32227, 0.024716, " that", false], [39931, 0.012004, " their", false], [45865, 0.011757, " enough", false], [21835, 0.010474, " how", false]]], "qwen": [279, 1, 0.3827328383922577, [[279, 0.382733, " the", false], [1128, 0.12453, " what", false], [4586, 0.05139, " general", false], [1846, 0.03903, " those", false], [264, 0.038345, " a", false], [5413, 0.026603, " methods", false], [34447, 0.024977, " computation", false], [4285, 0.024853, " simple", false], [1602, 0.019209, " very", false], [2513, 0.015342, " things", false]]]}, "raw_delta": 0.02747359871864319, "tuned_delta": 0.03428587652574114}, {"byte_start": 6466, "byte_end": 6471, "display": {"text": " meta", "kind": "normal"}, "is_word": true, "word_id": 1086, "word_key": " meta", "bytes_hex": "20 6d 65 74 61", "compression": {"rwkv": "36.74% 36.74% 36.74% 36.74% 36.74%", "qwen": "31.24% 31.24% 31.24% 31.24% 31.24%"}, "model_tokens": {"rwkv": [[31416, " meta", "normal", 3.715497950906865e-05]], "qwen": [[8823, " meta", "normal", 0.00017295297584496439]]}, "loss": {"rwkv": 36.74363932264078, "qwen": 31.243331458582645}, "topk": {"rwkv": [31416, 1068, 3.715497950906865e-05, [[57234, 0.069678, " simplest", false], [47284, 0.062673, " simple", false], [52236, 0.052718, " minimal", false], [32386, 0.042514, " very", false], [47539, 0.040097, " things", false], [61720, 0.03986, " complexity", false], [60050, 0.029699, " necessary", false], [59644, 0.025993, " essential", false], [52237, 0.025577, " minimum", false], [64862, 0.021544, " computational", false]]], "qwen": [8823, 457, 0.00017295297584496439, [[4586, 0.075737, " general", false], [1429, 0.057345, " most", false], [4285, 0.04441, " simple", false], [44548, 0.040875, " simplest", false], [5413, 0.030342, " methods", false], [1602, 0.022685, " very", false], [54480, 0.020146, " computational", false], [6770, 0.018722, " basic", false], [12829, 0.018643, " kinds", false], [5871, 0.017594, " necessary", false]]]}, "raw_delta": 0.3050018310546876, "tuned_delta": 0.3118141088617855}, {"byte_start": 6471, "byte_end": 6479, "display": {"text": "-methods", "kind": "normal"}, "is_word": true, "word_id": 1087, "word_key": "-methods", "bytes_hex": "2d 6d 65 74 68 6f 64 73", "compression": {"rwkv": "4.17% 15.38% 15.38% 15.38% 15.38% 15.38% 15.38% 15.38%", "qwen": "12.34% 12.34% 12.34% 12.34% 12.34% 12.34% 12.34% 1.24%"}, "model_tokens": {"rwkv": [[46, "-", "normal", 0.7936562895774841], [49411, "methods", "normal", 0.0025811318773776293]], "qwen": [[50297, "-method", "normal", 0.008322557434439659], [82, "s", "normal", 0.9337674379348755]]}, "loss": {"rwkv": 13.97654848419804, "qwen": 10.949410231711036}, "topk": {"rwkv": [46, 1, 0.7936562895774841, [[46, 0.793656, "-", false], [1798, 0.023814, "co", false], [58313, 0.019134, "knowledge", false], [58449, 0.010014, "structure", false], [63039, 0.00981, "computation", false], [59943, 0.009321, " knowledge", false], [38887, 0.006958, " level", false], [45, 0.0067, ",", false], [65062, 0.004495, "representation", false], [49000, 0.003877, "concept", false]]], "qwen": [50297, 18, 0.008322557434439659, [[11591, 0.193179, "-level", false], [12, 0.164031, "-", false], [12646, 0.135322, "-k", false], [46094, 0.033313, "structures", false], [80739, 0.026792, "-information", false], [7837, 0.024583, "structure", false], [1448, 0.024123, "-m", false], [6540, 0.019148, " knowledge", false], [14389, 0.014137, " structures", false], [5504, 0.011423, "-re", false]]]}, "raw_delta": 0.16786018759012217, "tuned_delta": 0.17467246539722012}, {"byte_start": 6479, "byte_end": 6484, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 1088, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"rwkv": "2.72% 2.72% 2.72% 2.72% 2.72%", "qwen": "3.78% 3.78% 3.78% 3.78% 3.78%"}, "model_tokens": {"rwkv": [[32227, " that", "normal", 0.4700643718242645]], "qwen": [[429, " that", "normal", 0.3503324091434479]]}, "loss": {"rwkv": 2.7191420204254877, "qwen": 3.7830090704411083}, "topk": {"rwkv": [32227, 1, 0.4700643718242645, [[32227, 0.470064, " that", false], [45, 0.158533, ",", false], [21700, 0.071821, " for", false], [4706, 0.050751, " of", false], [21265, 0.039789, " and", false], [4811, 0.03269, " to", false], [46650, 0.029984, " needed", false], [5346, 0.029645, "---", false], [47, 0.015222, ".", false], [275, 0.013626, " (", false]]], "qwen": [429, 1, 0.3503324091434479, [[429, 0.350332, " that", false], [11, 0.172676, ",", false], [315, 0.140634, " of", false], [369, 0.101778, " for", false], [323, 0.035062, " and", false], [4421, 0.030228, "---", false], [311, 0.02602, " to", false], [320, 0.01569, " (", false], [13, 0.015441, ".", false], [25, 0.014572, ":", false]]]}, "raw_delta": -0.05899331569671631, "tuned_delta": -0.05218103788961836}, {"byte_start": 6484, "byte_end": 6488, "display": {"text": " can", "kind": "normal"}, "is_word": true, "word_id": 1089, "word_key": " can", "bytes_hex": "20 63 61 6e", "compression": {"rwkv": "10.99% 10.99% 10.99% 10.99%", "qwen": "8.84% 8.84% 8.84% 8.84%"}, "model_tokens": {"rwkv": [[21413, " can", "normal", 0.08658616244792938]], "qwen": [[646, " can", "normal", 0.14080820977687836]]}, "loss": {"rwkv": 10.9892786317714, "qwen": 8.83811426032155}, "topk": {"rwkv": [21413, 3, 0.08658616244792938, [[21286, 0.141393, " are", false], [45851, 0.136255, " enable", false], [21413, 0.086586, " can", false], [39590, 0.074613, " scale", false], [37675, 0.065473, " allow", false], [56540, 0.039562, " leverage", false], [31358, 0.037836, " make", false], [4858, 0.029373, " we", false], [32475, 0.020847, " will", false], [31073, 0.01534, " help", false]]], "qwen": [646, 1, 0.14080820977687836, [[646, 0.140808, " can", false], [525, 0.112271, " are", false], [7283, 0.094056, " enable", false], [2138, 0.087731, " allow", false], [5452, 0.065495, " scale", false], [1281, 0.041473, " make", false], [686, 0.038862, " will", false], [582, 0.032966, " we", false], [32064, 0.025115, " leverage", false], [1077, 0.013032, " let", false]]]}, "raw_delta": 0.11928588151931763, "tuned_delta": 0.12609815932641558}, {"byte_start": 6488, "byte_end": 6493, "display": {"text": " find", "kind": "normal"}, "is_word": true, "word_id": 1090, "word_key": " find", "bytes_hex": "20 66 69 6e 64", "compression": {"rwkv": "19.16% 19.16% 19.16% 19.16% 19.16%", "qwen": "18.87% 18.87% 18.87% 18.87% 18.87%"}, "model_tokens": {"rwkv": [[30858, " find", "normal", 0.004959655925631523]], "qwen": [[1477, " find", "normal", 0.0053453813306987286]]}, "loss": {"rwkv": 19.160793511806542, "qwen": 18.868729134458306}, "topk": {"rwkv": [30858, 26, 0.004959655925631523, [[39590, 0.180109, " scale", false], [4435, 0.142371, " be", false], [56540, 0.067162, " leverage", false], [32187, 0.041491, " take", false], [38877, 0.028847, " learn", false], [31358, 0.02849, " make", false], [46158, 0.028318, " handle", false], [30587, 0.021674, " deal", false], [22681, 0.020792, " use", false], [31073, 0.01653, " help", false]]], "qwen": [1477, 23, 0.0053453813306987286, [[387, 0.225458, " be", false], [5452, 0.197008, " scale", false], [32064, 0.081598, " leverage", false], [1896, 0.052988, " take", false], [3705, 0.027218, " handle", false], [32194, 0.023882, " exploit", false], [1281, 0.020005, " make", false], [1492, 0.016496, " help", false], [3060, 0.0129, " continue", false], [13444, 0.012311, " effectively", false]]]}, "raw_delta": 0.016195487976074174, "tuned_delta": 0.02300776578317212}, {"byte_start": 6493, "byte_end": 6497, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 1091, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"rwkv": "10.71% 10.71% 10.71% 10.71%", "qwen": "11.80% 11.80% 11.80% 11.80%"}, "model_tokens": {"rwkv": [[21265, " and", "normal", 0.09246046841144562]], "qwen": [[323, " and", "normal", 0.0730060413479805]]}, "loss": {"rwkv": 10.707502256597774, "qwen": 11.799500723793338}, "topk": {"rwkv": [21265, 2, 0.09246046841144562, [[22590, 0.154828, " the", false], [21265, 0.09246, " and", false], [60521, 0.059874, " solutions", false], [32448, 0.054386, " ways", false], [332, 0.05356, " a", false], [39931, 0.051296, " their", false], [47284, 0.038362, " simple", false], [51832, 0.028066, " general", false], [45, 0.019613, ",", false], [56832, 0.019021, " patterns", false]]], "qwen": [323, 2, 0.0730060413479805, [[279, 0.141221, " the", false], [323, 0.073006, " and", false], [1661, 0.060295, " good", false], [264, 0.054906, " a", false], [5510, 0.054743, " ways", false], [9904, 0.046261, " solutions", false], [1493, 0.041047, " these", false], [4285, 0.038317, " simple", false], [862, 0.029244, " their", false], [1105, 0.02607, " them", false]]]}, "raw_delta": -0.06055325269699097, "tuned_delta": -0.05374097488989302}, {"byte_start": 6497, "byte_end": 6505, "display": {"text": " capture", "kind": "normal"}, "is_word": true, "word_id": 1092, "word_key": " capture", "bytes_hex": "20 63 61 70 74 75 72 65", "compression": {"rwkv": "13.31% 13.31% 13.31% 13.31% 13.31% 13.31% 13.31% 13.31%", "qwen": "16.17% 16.17% 16.17% 16.17% 16.17% 16.17% 16.17% 16.17%"}, "model_tokens": {"rwkv": [[51133, " capture", "normal", 0.0026906896382570267]], "qwen": [[12322, " capture", "normal", 0.0007653105421923101]]}, "loss": {"rwkv": 13.313933726953811, "qwen": 16.17448031287533}, "topk": {"rwkv": [51133, 38, 0.0026906896382570267, [[51690, 0.235145, " exploit", false], [22681, 0.147133, " use", false], [38877, 0.063285, " learn", false], [56540, 0.038891, " leverage", false], [53251, 0.038502, " utilize", false], [32187, 0.033003, " take", false], [39590, 0.026282, " scale", false], [31358, 0.02551, " make", false], [37923, 0.017471, " build", false], [30587, 0.01658, " deal", false]]], "qwen": [12322, 91, 0.0007653105421923101, [[990, 0.19459, " use", false], [32194, 0.186764, " exploit", false], [32064, 0.077788, " leverage", false], [28066, 0.064644, " utilize", false], [3796, 0.036191, " apply", false], [1896, 0.028938, " take", false], [5452, 0.027852, " scale", false], [1281, 0.018812, " make", false], [3960, 0.017616, " learn", false], [10515, 0.012242, " adapt", false]]]}, "raw_delta": -0.1586223840713501, "tuned_delta": -0.15181010626425215}, {"byte_start": 6505, "byte_end": 6510, "display": {"text": " this", "kind": "normal"}, "is_word": true, "word_id": 1093, "word_key": " this", "bytes_hex": "20 74 68 69 73", "compression": {"rwkv": "15.33% 15.33% 15.33% 15.33% 15.33%", "qwen": "14.58% 14.58% 14.58% 14.58% 14.58%"}, "model_tokens": {"rwkv": [[32234, " this", "normal", 0.01398326363414526]], "qwen": [[419, " this", "normal", 0.0175336766988039]]}, "loss": {"rwkv": 15.328634809445234, "qwen": 14.584319693908627}, "topk": {"rwkv": [32234, 13, 0.01398326363414526, [[22590, 0.405294, " the", false], [39936, 0.060815, " these", false], [39931, 0.04857, " their", false], [51832, 0.036042, " general", false], [56832, 0.022183, " patterns", false], [32464, 0.022172, " what", false], [21256, 0.021537, " all", false], [32229, 0.019117, " them", false], [21273, 0.018585, " any", false], [32139, 0.017762, " such", false]]], "qwen": [419, 8, 0.0175336766988039, [[279, 0.280644, " the", false], [1493, 0.057801, " these", false], [4586, 0.045954, " general", false], [1128, 0.045642, " what", false], [5390, 0.039438, " useful", false], [12624, 0.029172, " patterns", false], [1846, 0.024341, " those", false], [419, 0.017534, " this", false], [6540, 0.017077, " knowledge", false], [5944, 0.015977, " structure", false]]]}, "raw_delta": 0.04127359390258789, "tuned_delta": 0.04808587170968584}, {"byte_start": 6510, "byte_end": 6520, "display": {"text": " arbitrary", "kind": "normal"}, "is_word": true, "word_id": 1094, "word_key": " arbitrary", "bytes_hex": "20 61 72 62 69 74 72 61 72 79", "compression": {"rwkv": "7.38% 7.38% 7.38% 7.38% 7.38% 7.38% 7.38% 7.38% 7.38% 7.38%", "qwen": "7.74% 7.74% 7.74% 7.74% 7.74% 7.74% 7.74% 7.74% 7.74% 7.74%"}, "model_tokens": {"rwkv": [[59163, " arbitrary", "normal", 0.016764571890234947]], "qwen": [[24168, " arbitrary", "normal", 0.013689912855625153]]}, "loss": {"rwkv": 7.382541029548991, "qwen": 7.738428168632419}, "topk": {"rwkv": [59163, 5, 0.016764571890234947, [[61720, 0.599701, " complexity", false], [51607, 0.085932, " endless", false], [51258, 0.039041, " complex", false], [59914, 0.036952, " intrinsic", false], [59163, 0.016765, " arbitrary", false], [56454, 0.011733, " inherent", false], [62680, 0.009753, " underlying", false], [51970, 0.008571, " immense", false], [51832, 0.007125, " general", false], [56125, 0.006177, " enormous", false]]], "qwen": [24168, 6, 0.013689912855625153, [[23094, 0.542489, " complexity", false], [6351, 0.061806, " complex", false], [1995, 0.052409, " information", false], [4889, 0.019668, " outside", false], [6540, 0.019221, " knowledge", false], [24168, 0.01369, " arbitrary", false], [5944, 0.013563, " structure", false], [2213, 0.012819, " content", false], [1879, 0.010544, " world", false], [3093, 0.009757, " kind", false]]]}, "raw_delta": -0.019734573364257824, "tuned_delta": -0.012922295557159878}, {"byte_start": 6520, "byte_end": 6531, "display": {"text": " complexity", "kind": "normal"}, "is_word": true, "word_id": 1095, "word_key": " complexity", "bytes_hex": "20 63 6f 6d 70 6c 65 78 69 74 79", "compression": {"rwkv": "0.45% 0.45% 0.45% 0.45% 0.45% 0.45% 0.45% 0.45% 0.45% 0.45% 0.45%", "qwen": "0.83% 0.83% 0.83% 0.83% 0.83% 0.83% 0.83% 0.83% 0.83% 0.83% 0.83%"}, "model_tokens": {"rwkv": [[61720, " complexity", "normal", 0.7582730054855347]], "qwen": [[23094, " complexity", "normal", 0.6040256023406982]]}, "loss": {"rwkv": 0.45148260113046823, "qwen": 0.8264981978603826}, "topk": {"rwkv": [61720, 1, 0.7582730054855347, [[61720, 0.758273, " complexity", false], [45, 0.171328, ",", false], [21265, 0.01007, " and", false], [51258, 0.00537, " complex", false], [59914, 0.005313, " intrinsic", false], [52391, 0.004314, " outside", false], [51308, 0.004219, " content", false], [56191, 0.002132, " external", false], [60572, 0.001947, " structure", false], [57141, 0.001755, " richness", false]]], "qwen": [23094, 1, 0.6040256023406982, [[23094, 0.604026, " complexity", false], [11, 0.203697, ",", false], [1879, 0.040507, " world", false], [4889, 0.020384, " outside", false], [323, 0.017252, " and", false], [6351, 0.016169, " complex", false], [5944, 0.016046, " structure", false], [1995, 0.009967, " information", false], [2213, 0.006884, " content", false], [714, 0.004294, " but", false]]]}, "raw_delta": -0.02079528028314764, "tuned_delta": -0.013983002476049694}, {"byte_start": 6531, "byte_end": 6532, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "13.88%", "qwen": "26.58%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.46283406019210815]], "qwen": [[13, ".", "normal", 0.22900354862213135]]}, "loss": {"rwkv": 13.877486477301062, "qwen": 26.581978183091152}, "topk": {"rwkv": [47, 1, 0.46283406019210815, [[47, 0.462834, ".", false], [45, 0.256148, ",", false], [4596, 0.048513, " in", false], [21265, 0.046874, " and", false], [5346, 0.02948, "---", false], [4423, 0.015295, " as", false], [4450, 0.009411, " by", false], [275, 0.009287, " (", false], [53356, 0.008483, " without", false], [4706, 0.00797, " of", false]]], "qwen": [13, 2, 0.22900354862213135, [[11, 0.242662, ",", false], [13, 0.229004, ".", false], [304, 0.118386, " in", false], [382, 0.102984, ".\n\n", false], [323, 0.03766, " and", false], [4421, 0.033871, "---", false], [438, 0.019708, " as", false], [448, 0.014766, " with", false], [320, 0.011584, " (", false], [389, 0.011583, " on", false]]]}, "raw_delta": -0.704486608505249, "tuned_delta": -0.6976743306981511}, {"byte_start": 6532, "byte_end": 6542, "display": {"text": " Essential", "kind": "normal"}, "is_word": true, "word_id": 1096, "word_key": " essential", "bytes_hex": "20 45 73 73 65 6e 74 69 61 6c", "compression": {"rwkv": "53.26% 53.26% 53.26% 53.26% 0.10% 0.10% 0.10% 0.10% 0.10% 0.10%", "qwen": "20.26% 20.26% 20.26% 20.26% 20.26% 20.26% 20.26% 20.26% 20.26% 20.26%"}, "model_tokens": {"rwkv": [[19840, " Ess", "normal", 7.661335075681563e-06], [41342, "ential", "normal", 0.9689548015594482]], "qwen": [[47733, " Essential", "normal", 1.3228118405095302e-05]]}, "loss": {"rwkv": 21.359529789333234, "qwen": 20.25754063497075}, "topk": {"rwkv": [19840, 1222, 7.661335075681563e-06, [[261, 0.277558, "\n\n", false], [20996, 0.109491, " The", false], [29894, 0.061344, " This", false], [37453, 0.051268, " These", false], [3913, 0.044756, " In", false], [4331, 0.039625, " We", false], [29889, 0.021756, " That", false], [19417, 0.019774, " And", false], [44844, 0.017566, " Search", false], [3918, 0.017441, " It", false]]], "qwen": [47733, 1181, 1.3228118405095302e-05, [[576, 0.129797, " The", false], [1096, 0.08778, " This", false], [1205, 0.079979, " We", false], [4220, 0.061063, " These", false], [758, 0.048117, " In", false], [1752, 0.039487, " For", false], [1597, 0.029719, " And", false], [2938, 0.027698, " That", false], [1084, 0.023024, " It", false], [220, 0.01766, " ", false]]]}, "raw_delta": 0.06110725402832031, "tuned_delta": 0.06791953183541825}, {"byte_start": 6542, "byte_end": 6545, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 1097, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "3.55% 3.55% 3.55%", "qwen": "6.58% 6.58% 6.58%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.5516167283058167]], "qwen": [[311, " to", "normal", 0.33457592129707336]]}, "loss": {"rwkv": 3.5456860542681228, "qwen": 6.581643478559646}, "topk": {"rwkv": [4811, 1, 0.5516167283058167, [[4811, 0.551617, " to", false], [37694, 0.059026, " among", false], [39239, 0.044549, " parts", false], [56089, 0.024674, " elements", false], [52224, 0.022931, " methods", false], [4600, 0.021665, " is", false], [31077, 0.020893, " here", false], [31416, 0.020517, " meta", false], [21700, 0.020121, " for", false], [4596, 0.017008, " in", false]]], "qwen": [311, 1, 0.33457592129707336, [[311, 0.334576, " to", false], [8823, 0.173613, " meta", false], [369, 0.105095, " for", false], [374, 0.036002, " is", false], [5413, 0.0318, " methods", false], [304, 0.027267, " in", false], [4221, 0.02533, " among", false], [11, 0.014456, ",", false], [1588, 0.012913, " here", false], [5479, 0.012706, " parts", false]]]}, "raw_delta": -0.16834922631581625, "tuned_delta": -0.1615369485087183}, {"byte_start": 6545, "byte_end": 6551, "display": {"text": " these", "kind": "normal"}, "is_word": true, "word_id": 1098, "word_key": " these", "bytes_hex": "20 74 68 65 73 65", "compression": {"rwkv": "7.89% 7.89% 7.89% 7.89% 7.89% 7.89%", "qwen": "6.54% 6.54% 6.54% 6.54% 6.54% 6.54%"}, "model_tokens": {"rwkv": [[39936, " these", "normal", 0.0716499537229538]], "qwen": [[1493, " these", "normal", 0.1133388951420784]]}, "loss": {"rwkv": 7.889738504861517, "qwen": 6.544344024559395}, "topk": {"rwkv": [39936, 3, 0.0716499537229538, [[32234, 0.522117, " this", false], [22590, 0.11478, " the", false], [39936, 0.07165, " these", false], [32227, 0.046349, " that", false], [55666, 0.028836, " building", false], [32139, 0.025892, " such", false], [21256, 0.015796, " all", false], [38279, 0.014214, " doing", false], [21273, 0.010897, " any", false], [22248, 0.008773, " our", false]]], "qwen": [1493, 2, 0.1133388951420784, [[419, 0.486482, " this", false], [1493, 0.113339, " these", false], [279, 0.090156, " the", false], [678, 0.039767, " all", false], [429, 0.034608, " that", false], [4752, 0.018017, " building", false], [1741, 0.016435, " such", false], [3730, 0.015154, " doing", false], [6832, 0.013901, " learning", false], [894, 0.009253, " any", false]]]}, "raw_delta": 0.07460451126098633, "tuned_delta": 0.08141678906808428}, {"byte_start": 6551, "byte_end": 6559, "display": {"text": " methods", "kind": "normal"}, "is_word": true, "word_id": 1099, "word_key": " methods", "bytes_hex": "20 6d 65 74 68 6f 64 73", "compression": {"rwkv": "2.43% 2.43% 2.43% 2.43% 2.43% 2.43% 2.43% 2.43%", "qwen": "4.78% 4.78% 4.78% 4.78% 4.78% 4.78% 4.78% 4.78%"}, "model_tokens": {"rwkv": [[52224, " methods", "normal", 0.3426448404788971]], "qwen": [[5413, " methods", "normal", 0.11975329369306564]]}, "loss": {"rwkv": 2.4303212358725212, "qwen": 4.784160712014783}, "topk": {"rwkv": [52224, 2, 0.3426448404788971, [[31416, 0.381455, " meta", false], [52224, 0.342645, " methods", false], [21286, 0.131986, " are", false], [51832, 0.042199, " general", false], [4600, 0.015514, " is", false], [22638, 0.011992, " two", false], [51258, 0.007035, " complex", false], [61590, 0.003605, " approaches", false], [59163, 0.003398, " arbitrary", false], [45, 0.002719, ",", false]]], "qwen": [5413, 2, 0.11975329369306564, [[8823, 0.671973, " meta", false], [5413, 0.119753, " methods", false], [374, 0.077473, " is", false], [525, 0.054646, " are", false], [4586, 0.01824, " general", false], [19827, 0.003394, " approaches", false], [1378, 0.00277, " two", false], [11, 0.002668, ",", false], [12538, 0.002589, " techniques", false], [1714, 0.001728, " method", false]]]}, "raw_delta": -0.13052457571029663, "tuned_delta": -0.12371229790319868}, {"byte_start": 6559, "byte_end": 6562, "display": {"text": " is", "kind": "normal"}, "is_word": true, "word_id": 1100, "word_key": " is", "bytes_hex": "20 69 73", "compression": {"rwkv": "4.79% 4.79% 4.79%", "qwen": "2.68% 2.68% 2.68%"}, "model_tokens": {"rwkv": [[4600, " is", "normal", 0.44986408948898315]], "qwen": [[374, " is", "normal", 0.6401692628860474]]}, "loss": {"rwkv": 4.7901983779516355, "qwen": 2.6811448543085183}, "topk": {"rwkv": [4600, 2, 0.44986408948898315, [[21286, 0.458542, " are", false], [4600, 0.449864, " is", false], [45, 0.036068, ",", false], [32475, 0.013987, " will", false], [4706, 0.010297, " of", false], [21700, 0.004263, " for", false], [40219, 0.00356, " would", false], [4596, 0.002935, " in", false], [275, 0.00258, " (", false], [47266, 0.002438, " should", false]]], "qwen": [374, 1, 0.6401692628860474, [[374, 0.640169, " is", false], [525, 0.278169, " are", false], [11, 0.031505, ",", false], [686, 0.009927, " will", false], [1265, 0.007983, " should", false], [369, 0.004219, " for", false], [1969, 0.003339, " must", false], [304, 0.003269, " in", false], [315, 0.003194, " of", false], [320, 0.003101, " (", false]]]}, "raw_delta": 0.11695076028505962, "tuned_delta": 0.12376303809215757}, {"byte_start": 6562, "byte_end": 6567, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 1101, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"rwkv": "9.35% 9.35% 9.35% 9.35% 9.35%", "qwen": "12.61% 12.61% 12.61% 12.61% 12.61%"}, "model_tokens": {"rwkv": [[32227, " that", "normal", 0.07407549768686295]], "qwen": [[429, " that", "normal", 0.03027326427400112]]}, "loss": {"rwkv": 9.354975655764372, "qwen": 12.61453016086352}, "topk": {"rwkv": [32227, 3, 0.07407549768686295, [[22590, 0.303834, " the", false], [56537, 0.129732, " learning", false], [32227, 0.074075, " that", false], [332, 0.053894, " a", false], [52195, 0.026167, " massive", false], [63370, 0.019947, " computation", false], [4811, 0.019108, " to", false], [39931, 0.013611, " their", false], [4419, 0.013459, " an", false], [51832, 0.013304, " general", false]]], "qwen": [429, 6, 0.03027326427400112, [[279, 0.385126, " the", false], [26943, 0.090273, " scaling", false], [264, 0.049859, " a", false], [34447, 0.0463, " computation", false], [6832, 0.037336, " learning", false], [429, 0.030273, " that", false], [2711, 0.029554, " search", false], [311, 0.018949, " to", false], [458, 0.013936, " an", false], [5452, 0.011061, " scale", false]]]}, "raw_delta": -0.18074808120727537, "tuned_delta": -0.17393580340017742}, {"byte_start": 6567, "byte_end": 6572, "display": {"text": " they", "kind": "normal"}, "is_word": true, "word_id": 1102, "word_key": " they", "bytes_hex": "20 74 68 65 79", "compression": {"rwkv": "0.86% 0.86% 0.86% 0.86% 0.86%", "qwen": "1.10% 1.10% 1.10% 1.10% 1.10%"}, "model_tokens": {"rwkv": [[32232, " they", "normal", 0.790442943572998]], "qwen": [[807, " they", "normal", 0.7365784645080566]]}, "loss": {"rwkv": 0.8558957395898878, "qwen": 1.1027221229226438}, "topk": {"rwkv": [32232, 1, 0.790442943572998, [[32232, 0.790443, " they", false], [4858, 0.04632, " we", false], [22590, 0.034946, " the", false], [39931, 0.01834, " their", false], [45, 0.015256, ",", false], [39934, 0.012725, " there", false], [4706, 0.00514, " of", false], [21256, 0.004165, " all", false], [63370, 0.003397, " computation", false], [22226, 0.003251, " one", false]]], "qwen": [807, 1, 0.7365784645080566, [[807, 0.736578, " they", false], [582, 0.065723, " we", false], [279, 0.056088, " the", false], [11, 0.016532, ",", false], [34447, 0.012233, " computation", false], [1052, 0.010324, " there", false], [862, 0.010036, " their", false], [315, 0.005888, " of", false], [432, 0.004903, " it", false], [264, 0.004412, " a", false]]]}, "raw_delta": -0.013686960935592652, "tuned_delta": -0.006874683128494705}, {"byte_start": 6572, "byte_end": 6576, "display": {"text": " can", "kind": "normal"}, "is_word": true, "word_id": 1103, "word_key": " can", "bytes_hex": "20 63 61 6e", "compression": {"rwkv": "11.27% 11.27% 11.27% 11.27%", "qwen": "11.62% 11.62% 11.62% 11.62%"}, "model_tokens": {"rwkv": [[21413, " can", "normal", 0.08134783804416656]], "qwen": [[646, " can", "normal", 0.07595773786306381]]}, "loss": {"rwkv": 11.271055006945026, "qwen": 11.62081074954688}, "topk": {"rwkv": [21413, 4, 0.08134783804416656, [[21286, 0.131597, " are", false], [39590, 0.131097, " scale", false], [4435, 0.122779, " be", false], [21413, 0.081348, " can", false], [22681, 0.028259, " use", false], [31059, 0.02739, " have", false], [47266, 0.026974, " should", false], [4491, 0.022848, " do", false], [56540, 0.020087, " leverage", false], [31475, 0.018604, " must", false]]], "qwen": [646, 4, 0.07595773786306381, [[387, 0.126536, " be", false], [525, 0.094305, " are", false], [5452, 0.082216, " scale", false], [646, 0.075958, " can", false], [1265, 0.054224, " should", false], [1969, 0.0487, " must", false], [32064, 0.036971, " leverage", false], [614, 0.023595, " have", false], [1896, 0.021734, " take", false], [990, 0.019605, " use", false]]]}, "raw_delta": -0.01939457654953003, "tuned_delta": -0.012582298742432083}, {"byte_start": 6576, "byte_end": 6581, "display": {"text": " find", "kind": "normal"}, "is_word": true, "word_id": 1104, "word_key": " find", "bytes_hex": "20 66 69 6e 64", "compression": {"rwkv": "11.95% 11.95% 11.95% 11.95% 11.95%", "qwen": "10.19% 10.19% 10.19% 10.19% 10.19%"}, "model_tokens": {"rwkv": [[30858, " find", "normal", 0.03663661330938339]], "qwen": [[1477, " find", "normal", 0.059287264943122864]]}, "loss": {"rwkv": 11.947318307361726, "qwen": 10.190334947014732}, "topk": {"rwkv": [30858, 5, 0.03663661330938339, [[39590, 0.232759, " scale", false], [4435, 0.140328, " be", false], [38877, 0.082999, " learn", false], [56540, 0.041553, " leverage", false], [30858, 0.036637, " find", false], [51133, 0.024952, " capture", false], [32187, 0.020199, " take", false], [22681, 0.019543, " use", false], [46158, 0.018221, " handle", false], [31358, 0.014143, " make", false]]], "qwen": [1477, 4, 0.059287264943122864, [[5452, 0.217553, " scale", false], [387, 0.111124, " be", false], [32064, 0.070474, " leverage", false], [1477, 0.059287, " find", false], [1896, 0.033056, " take", false], [3960, 0.031697, " learn", false], [32194, 0.022243, " exploit", false], [12322, 0.019151, " capture", false], [3705, 0.016545, " handle", false], [990, 0.016301, " use", false]]]}, "raw_delta": 0.0974278450012207, "tuned_delta": 0.10424012280831865}, {"byte_start": 6581, "byte_end": 6586, "display": {"text": " good", "kind": "normal"}, "is_word": true, "word_id": 1105, "word_key": " good", "bytes_hex": "20 67 6f 6f 64", "compression": {"rwkv": "22.32% 22.32% 22.32% 22.32% 22.32%", "qwen": "20.73% 20.73% 20.73% 20.73% 20.73%"}, "model_tokens": {"rwkv": [[30992, " good", "normal", 0.002037836005911231]], "qwen": [[1661, " good", "normal", 0.003192703705281019]]}, "loss": {"rwkv": 22.31668891375115, "qwen": 20.727514185330524}, "topk": {"rwkv": [30992, 48, 0.002037836005911231, [[21265, 0.329194, " and", false], [22590, 0.079658, " the", false], [59163, 0.06929, " arbitrary", false], [45, 0.035953, ",", false], [63293, 0.033334, " arbitrarily", false], [60572, 0.019215, " structure", false], [332, 0.017704, " a", false], [32448, 0.016601, " ways", false], [56832, 0.014906, " patterns", false], [22168, 0.014729, " new", false]]], "qwen": [1661, 35, 0.003192703705281019, [[323, 0.373493, " and", false], [279, 0.122858, " the", false], [11, 0.049253, ",", false], [264, 0.021193, " a", false], [419, 0.019855, " this", false], [1128, 0.018387, " what", false], [12624, 0.01774, " patterns", false], [24168, 0.017142, " arbitrary", false], [23094, 0.014599, " complexity", false], [862, 0.014111, " their", false]]]}, "raw_delta": 0.08812255859374996, "tuned_delta": 0.0949348364008479}, {"byte_start": 6586, "byte_end": 6601, "display": {"text": " approximations", "kind": "normal"}, "is_word": true, "word_id": 1106, "word_key": " approximations", "bytes_hex": "20 61 70 70 72 6f 78 69 6d 61 74 69 6f 6e 73", "compression": {"rwkv": "2.50% 2.50% 2.50% 2.50% 2.50% 2.50% 2.50% 2.50% 2.50% 2.50% 2.50% 2.50% 2.50% 2.50% 0.14%", "qwen": "6.57% 6.57% 6.57% 6.57% 6.57% 6.57% 6.57% 0.01% 0.01% 0.01% 0.01% 0.01% 0.01% 0.01% 0.01%"}, "model_tokens": {"rwkv": [[64831, " approximation", "normal", 0.14530563354492188], [116, "s", "normal", 0.9920324087142944]], "qwen": [[9848, " approx", "normal", 0.07817225903272629], [96376, "imations", "normal", 0.9960803389549255]]}, "loss": {"rwkv": 2.3388906724698297, "qwen": 3.06905465744766}, "topk": {"rwkv": [64831, 1, 0.14530563354492188, [[64831, 0.145306, " approximation", false], [32448, 0.110363, " ways", false], [65275, 0.086664, " representations", false], [60521, 0.079109, " solutions", false], [45, 0.062711, ",", false], [63245, 0.048898, " abstraction", false], [45865, 0.025491, " enough", false], [65135, 0.02311, " generalization", false], [63292, 0.020798, " approximate", false], [51832, 0.011734, " general", false]]], "qwen": [9848, 2, 0.07817225903272629, [[43613, 0.137482, " representations", false], [9848, 0.078172, " approx", false], [9904, 0.074397, " solutions", false], [5510, 0.067546, " ways", false], [11, 0.048612, ",", false], [44868, 0.030861, " approximate", false], [4586, 0.027049, " general", false], [2750, 0.026102, " values", false], [3322, 0.019664, " enough", false], [4119, 0.017806, " models", false]]]}, "raw_delta": -0.04048888860270375, "tuned_delta": -0.0336766107956058}, {"byte_start": 6601, "byte_end": 6602, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "43.96%", "qwen": "43.14%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.08705120533704758]], "qwen": [[11, ",", "normal", 0.09145106375217438]]}, "loss": {"rwkv": 43.9571145270856, "qwen": 43.13570388873347}, "topk": {"rwkv": [45, 3, 0.08705120533704758, [[4811, 0.583775, " to", false], [4706, 0.108272, " of", false], [45, 0.087051, ",", false], [32227, 0.026655, " that", false], [4596, 0.024489, " in", false], [21700, 0.020807, " for", false], [47, 0.018513, ".", false], [21265, 0.016905, " and", false], [5346, 0.013333, "---", false], [275, 0.012706, " (", false]]], "qwen": [11, 3, 0.09145106375217438, [[311, 0.526465, " to", false], [315, 0.162268, " of", false], [11, 0.091451, ",", false], [369, 0.029232, " for", false], [304, 0.021169, " in", false], [13, 0.020419, ".", false], [429, 0.019746, " that", false], [323, 0.018833, " and", false], [4421, 0.011141, "---", false], [448, 0.008905, " with", false]]]}, "raw_delta": 0.04554867744445801, "tuned_delta": 0.05236095525155596}, {"byte_start": 6602, "byte_end": 6606, "display": {"text": " but", "kind": "normal"}, "is_word": true, "word_id": 1107, "word_key": " but", "bytes_hex": "20 62 75 74", "compression": {"rwkv": "20.57% 20.57% 20.57% 20.57%", "qwen": "18.68% 18.68% 18.68% 18.68%"}, "model_tokens": {"rwkv": [[21400, " but", "normal", 0.010533981956541538]], "qwen": [[714, " but", "normal", 0.01588658057153225]]}, "loss": {"rwkv": 20.56967538767467, "qwen": 18.675148902300144}, "topk": {"rwkv": [21400, 20, 0.010533981956541538, [[21265, 0.170614, " and", false], [4715, 0.088954, " or", false], [4596, 0.061116, " in", false], [30788, 0.050346, " even", false], [22187, 0.049908, " not", false], [32227, 0.04338, " that", false], [4788, 0.030586, " so", false], [32487, 0.025904, " with", false], [4423, 0.020406, " as", false], [47001, 0.018734, " rather", false]]], "qwen": [714, 10, 0.01588658057153225, [[323, 0.225587, " and", false], [1496, 0.073592, " even", false], [476, 0.052948, " or", false], [892, 0.049974, " which", false], [304, 0.047493, " in", false], [537, 0.041677, " not", false], [448, 0.031349, " with", false], [438, 0.027299, " as", false], [429, 0.023634, " that", false], [714, 0.015887, " but", false]]]}, "raw_delta": 0.10505485534667969, "tuned_delta": 0.11186713315377764}, {"byte_start": 6606, "byte_end": 6610, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 1108, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "17.05% 17.05% 17.05% 17.05%", "qwen": "14.26% 14.26% 14.26% 14.26%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.02280323952436447]], "qwen": [[279, " the", "normal", 0.042297009378671646]]}, "loss": {"rwkv": 17.04747069800435, "qwen": 14.260313408772268}, "topk": {"rwkv": [22590, 9, 0.02280323952436447, [[22187, 0.220271, " not", false], [32232, 0.172754, " they", false], [32227, 0.062025, " that", false], [39115, 0.055956, " never", false], [4692, 0.042486, " no", false], [45409, 0.042035, " cannot", false], [21413, 0.032571, " can", false], [30135, 0.023987, " also", false], [22590, 0.022803, " the", false], [21286, 0.021908, " are", false]]], "qwen": [279, 5, 0.042297009378671646, [[537, 0.165363, " not", false], [807, 0.163116, " they", false], [429, 0.05804, " that", false], [2581, 0.044574, " never", false], [279, 0.042297, " the", false], [653, 0.026959, " do", false], [419, 0.025683, " this", false], [1172, 0.023613, " only", false], [646, 0.023518, " can", false], [304, 0.021847, " in", false]]]}, "raw_delta": 0.15455281734466553, "tuned_delta": 0.16136509515176348}, {"byte_start": 6610, "byte_end": 6617, "display": {"text": " search", "kind": "normal"}, "is_word": true, "word_id": 1109, "word_key": " search", "bytes_hex": "20 73 65 61 72 63 68", "compression": {"rwkv": "12.24% 12.24% 12.24% 12.24% 12.24% 12.24% 12.24%", "qwen": "10.83% 10.83% 10.83% 10.83% 10.83% 10.83% 10.83%"}, "model_tokens": {"rwkv": [[47202, " search", "normal", 0.008756576105952263]], "qwen": [[2711, " search", "normal", 0.014953196048736572]]}, "loss": {"rwkv": 12.237145436111744, "qwen": 10.827504379684806}, "topk": {"rwkv": [47202, 11, 0.008756576105952263, [[64831, 0.407183, " approximation", false], [52224, 0.059049, " methods", false], [30992, 0.036793, " good", false], [30273, 0.02898, " best", false], [31458, 0.021425, " more", false], [21952, 0.015097, " key", false], [31581, 0.012142, " only", false], [61720, 0.011572, " complexity", false], [45098, 0.010112, " actual", false], [31461, 0.00998, " most", false]]], "qwen": [2711, 11, 0.014953196048736572, [[9848, 0.096294, " approx", false], [23094, 0.055132, " complexity", false], [3565, 0.054822, " details", false], [5042, 0.035948, " actual", false], [56204, 0.035316, " approximation", false], [5413, 0.02631, " methods", false], [1850, 0.022449, " best", false], [4271, 0.016598, " quality", false], [44868, 0.015384, " approximate", false], [4734, 0.014968, " exact", false]]]}, "raw_delta": 0.07816709790910992, "tuned_delta": 0.08497937571620787}, {"byte_start": 6617, "byte_end": 6621, "display": {"text": " for", "kind": "normal"}, "is_word": true, "word_id": 1110, "word_key": " for", "bytes_hex": "20 66 6f 72", "compression": {"rwkv": "8.70% 8.70% 8.70% 8.70%", "qwen": "7.36% 7.36% 7.36% 7.36%"}, "model_tokens": {"rwkv": [[21700, " for", "normal", 0.14547452330589294]], "qwen": [[369, " for", "normal", 0.19535474479198456]]}, "loss": {"rwkv": 8.699845583485692, "qwen": 7.361974269267249}, "topk": {"rwkv": [21700, 2, 0.14547452330589294, [[21265, 0.153076, " and", false], [21700, 0.145475, " for", false], [4600, 0.093256, " is", false], [31475, 0.058395, " must", false], [52224, 0.055212, " methods", false], [39750, 0.047688, " space", false], [4715, 0.034771, " or", false], [47266, 0.030606, " should", false], [46, 0.029081, "-", false], [21413, 0.026364, " can", false]]], "qwen": [369, 2, 0.19535474479198456, [[323, 0.248778, " and", false], [369, 0.195355, " for", false], [3550, 0.060089, " space", false], [374, 0.051573, " is", false], [476, 0.047005, " or", false], [5413, 0.034343, " methods", false], [646, 0.031523, " can", false], [1969, 0.021933, " must", false], [1184, 0.019861, " need", false], [9777, 0.016862, "-and", false]]]}, "raw_delta": 0.07418733835220337, "tuned_delta": 0.08099961615930132}, {"byte_start": 6621, "byte_end": 6626, "display": {"text": " them", "kind": "normal"}, "is_word": true, "word_id": 1111, "word_key": " them", "bytes_hex": "20 74 68 65 6d", "compression": {"rwkv": "11.89% 11.89% 11.89% 11.89% 11.89%", "qwen": "22.09% 22.09% 22.09% 22.09% 22.09%"}, "model_tokens": {"rwkv": [[32229, " them", "normal", 0.03663533553481102]], "qwen": [[1105, " them", "normal", 0.002185772405937314]]}, "loss": {"rwkv": 11.890963032327003, "qwen": 22.094102087698467}, "topk": {"rwkv": [32229, 6, 0.03663533553481102, [[30992, 0.342232, " good", false], [64831, 0.123366, " approximation", false], [39936, 0.109853, " these", false], [32139, 0.081257, " such", false], [22590, 0.070136, " the", false], [32229, 0.036635, " them", false], [45301, 0.029394, " better", false], [39944, 0.027281, " those", false], [332, 0.025397, " a", false], [63292, 0.018031, " approximate", false]]], "qwen": [1105, 47, 0.002185772405937314, [[1661, 0.158216, " good", false], [279, 0.120957, " the", false], [264, 0.08415, " a", false], [4734, 0.061812, " exact", false], [1493, 0.041712, " these", false], [458, 0.038725, " an", false], [9848, 0.032758, " approx", false], [1741, 0.028929, " such", false], [4285, 0.027181, " simple", false], [4727, 0.019721, " perfect", false]]]}, "raw_delta": -0.5657821655273436, "tuned_delta": -0.5589698877202457}, {"byte_start": 6626, "byte_end": 6633, "display": {"text": " should", "kind": "normal"}, "is_word": true, "word_id": 1112, "word_key": " should", "bytes_hex": "20 73 68 6f 75 6c 64", "compression": {"rwkv": "5.96% 5.96% 5.96% 5.96% 5.96% 5.96% 5.96%", "qwen": "5.68% 5.68% 5.68% 5.68% 5.68% 5.68% 5.68%"}, "model_tokens": {"rwkv": [[47266, " should", "normal", 0.098131462931633]], "qwen": [[1265, " should", "normal", 0.11030002683401108]]}, "loss": {"rwkv": 5.957557646528085, "qwen": 5.679455557845392}, "topk": {"rwkv": [47266, 3, 0.098131462931633, [[4600, 0.306823, " is", false], [31475, 0.192024, " must", false], [47266, 0.098131, " should", false], [21800, 0.056036, " has", false], [21413, 0.046779, " can", false], [45409, 0.03502, " cannot", false], [32475, 0.03434, " will", false], [30659, 0.023566, " does", false], [45, 0.022837, ",", false], [39105, 0.021534, " needs", false]]], "qwen": [1265, 2, 0.11030002683401108, [[374, 0.354648, " is", false], [1265, 0.1103, " should", false], [1969, 0.082882, " must", false], [646, 0.063995, " can", false], [1558, 0.034168, " does", false], [4157, 0.033618, " cannot", false], [702, 0.031089, " has", false], [686, 0.029944, " will", false], [11, 0.025467, ",", false], [1231, 0.025081, " may", false]]]}, "raw_delta": 0.015421254294259223, "tuned_delta": 0.02223353210135717}, {"byte_start": 6633, "byte_end": 6636, "display": {"text": " be", "kind": "normal"}, "is_word": true, "word_id": 1113, "word_key": " be", "bytes_hex": "20 62 65", "compression": {"rwkv": "6.11% 6.11% 6.11%", "qwen": "5.80% 5.80% 5.80%"}, "model_tokens": {"rwkv": [[4435, " be", "normal", 0.3595508635044098]], "qwen": [[387, " be", "normal", 0.38093888759613037]]}, "loss": {"rwkv": 6.105154795428556, "qwen": 5.801535190406596}, "topk": {"rwkv": [4435, 1, 0.3595508635044098, [[4435, 0.359551, " be", false], [22187, 0.342518, " not", false], [39115, 0.067216, " never", false], [45150, 0.029187, " always", false], [32122, 0.014185, " stop", false], [55851, 0.012674, " continue", false], [31581, 0.012515, " only", false], [52570, 0.012489, " proceed", false], [52051, 0.008953, " involve", false], [31059, 0.008781, " have", false]]], "qwen": [387, 2, 0.38093888759613037, [[537, 0.406596, " not", false], [387, 0.380939, " be", false], [2581, 0.03639, " never", false], [2936, 0.018259, " stop", false], [2677, 0.017082, " always", false], [7146, 0.012229, " remain", false], [3060, 0.009484, " continue", false], [10354, 0.009378, " proceed", false], [1172, 0.006784, " only", false], [835, 0.00434, " end", false]]]}, "raw_delta": 0.016836245854695675, "tuned_delta": 0.02364852366179362}, {"byte_start": 6636, "byte_end": 6639, "display": {"text": " by", "kind": "normal"}, "is_word": true, "word_id": 1114, "word_key": " by", "bytes_hex": "20 62 79", "compression": {"rwkv": "30.43% 30.43% 30.43%", "qwen": "32.12% 32.12% 32.12%"}, "model_tokens": {"rwkv": [[4450, " by", "normal", 0.006302002817392349]], "qwen": [[553, " by", "normal", 0.004782747942954302]]}, "loss": {"rwkv": 30.43184851875157, "qwen": 32.11643578221786}, "topk": {"rwkv": [4450, 25, 0.006302002817392349, [[37810, 0.079244, " based", false], [46141, 0.068436, " guided", false], [30666, 0.047774, " done", false], [37862, 0.027942, " blind", false], [332, 0.02384, " a", false], [45796, 0.019215, " driven", false], [31269, 0.018218, " left", false], [4423, 0.014826, " as", false], [4596, 0.011679, " in", false], [64862, 0.01144, " computational", false]]], "qwen": [553, 33, 0.004782747942954302, [[2814, 0.098134, " done", false], [2115, 0.091625, " left", false], [3118, 0.038297, " based", false], [32587, 0.033109, " guided", false], [264, 0.02995, " a", false], [27498, 0.019021, " automated", false], [7199, 0.018033, " limited", false], [22978, 0.012739, " abandoned", false], [16227, 0.011882, " driven", false], [13075, 0.010533, " conducted", false]]]}, "raw_delta": -0.0934133529663086, "tuned_delta": -0.08660107515921064}, {"byte_start": 6639, "byte_end": 6643, "display": {"text": " our", "kind": "normal"}, "is_word": true, "word_id": 1115, "word_key": " our", "bytes_hex": "20 6f 75 72", "compression": {"rwkv": "38.32% 38.32% 38.32% 38.32%", "qwen": "34.49% 34.49% 34.49% 34.49%"}, "model_tokens": {"rwkv": [[22248, " our", "normal", 0.00020482149557210505]], "qwen": [[1039, " our", "normal", 0.0004757429996971041]]}, "loss": {"rwkv": 38.321587023613084, "qwen": 34.49228151342959}, "topk": {"rwkv": [22248, 355, 0.00020482149557210505, [[37920, 0.116971, " brute", false], [38989, 0.06882, " means", false], [332, 0.046291, " a", false], [56537, 0.045276, " learning", false], [22590, 0.03962, " the", false], [52224, 0.037138, " methods", false], [52195, 0.025042, " massive", false], [47202, 0.022246, " search", false], [63370, 0.020554, " computation", false], [31978, 0.020482, " self", false]]], "qwen": [1039, 235, 0.0004757429996971041, [[264, 0.064584, " a", false], [26943, 0.05475, " scaling", false], [4586, 0.048367, " general", false], [5413, 0.040268, " methods", false], [279, 0.036895, " the", false], [34447, 0.029067, " computation", false], [458, 0.028545, " an", false], [64098, 0.026486, " brute", false], [2711, 0.018504, " search", false], [8823, 0.01828, " meta", false]]]}, "raw_delta": 0.2123417854309082, "tuned_delta": 0.21915406323800615}, {"byte_start": 6643, "byte_end": 6651, "display": {"text": " methods", "kind": "normal"}, "is_word": true, "word_id": 1116, "word_key": " methods", "bytes_hex": "20 6d 65 74 68 6f 64 73", "compression": {"rwkv": "7.54% 7.54% 7.54% 7.54% 7.54% 7.54% 7.54% 7.54%", "qwen": "7.91% 7.91% 7.91% 7.91% 7.91% 7.91% 7.91% 7.91%"}, "model_tokens": {"rwkv": [[52224, " methods", "normal", 0.03533893823623657]], "qwen": [[5413, " methods", "normal", 0.029909150674939156]]}, "loss": {"rwkv": 7.537518035894486, "qwen": 7.9113583364123246}, "topk": {"rwkv": [52224, 5, 0.03533893823623657, [[22251, 0.204374, " own", false], [30273, 0.099702, " best", false], [39026, 0.068424, " minds", false], [31461, 0.052052, " most", false], [52224, 0.035339, " methods", false], [45124, 0.029195, " agents", false], [56567, 0.019329, " machines", false], [51832, 0.00936, " general", false], [38989, 0.009049, " means", false], [60227, 0.008356, " preferred", false]]], "qwen": [5413, 6, 0.029909150674939156, [[1828, 0.28534, " own", false], [54480, 0.03619, " computational", false], [3738, 0.03306, " human", false], [4586, 0.032884, " general", false], [20062, 0.03041, " minds", false], [5413, 0.029909, " methods", false], [8823, 0.01548, " meta", false], [1850, 0.013422, " best", false], [13009, 0.012272, " agents", false], [34447, 0.011803, " computation", false]]]}, "raw_delta": -0.02073010802268982, "tuned_delta": -0.013917830215591873}, {"byte_start": 6651, "byte_end": 6652, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "13.03%", "qwen": "10.56%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.4832322895526886]], "qwen": [[11, ",", "normal", 0.5567399263381958]]}, "loss": {"rwkv": 13.032157351780185, "qwen": 10.561556704184026}, "topk": {"rwkv": [45, 1, 0.4832322895526886, [[45, 0.483232, ",", false], [4706, 0.099792, " of", false], [21265, 0.043582, " and", false], [40, 0.037604, "'", false], [47001, 0.03656, " rather", false], [47, 0.035761, ".", false], [32227, 0.026477, " that", false], [22187, 0.025361, " not", false], [5346, 0.024484, "---", false], [21700, 0.018855, " for", false]]], "qwen": [11, 1, 0.5567399263381958, [[11, 0.55674, ",", false], [323, 0.076192, " and", false], [315, 0.048468, " of", false], [4751, 0.040143, " rather", false], [13, 0.03996, ".", false], [4421, 0.037418, "---", false], [429, 0.032771, " that", false], [369, 0.02546, " for", false], [320, 0.018558, " (", false], [382, 0.016291, ".\n\n", false]]]}, "raw_delta": 0.1369991898536682, "tuned_delta": 0.14381146766076616}, {"byte_start": 6652, "byte_end": 6656, "display": {"text": " not", "kind": "normal"}, "is_word": true, "word_id": 1117, "word_key": " not", "bytes_hex": "20 6e 6f 74", "compression": {"rwkv": "1.81% 1.81% 1.81% 1.81%", "qwen": "2.91% 2.91% 2.91% 2.91%"}, "model_tokens": {"rwkv": [[22187, " not", "normal", 0.6672734618186951]], "qwen": [[537, " not", "normal", 0.5248613357543945]]}, "loss": {"rwkv": 1.813935415180215, "qwen": 2.906224371822002}, "topk": {"rwkv": [22187, 1, 0.6672734618186951, [[22187, 0.667273, " not", false], [21265, 0.109822, " and", false], [47001, 0.031644, " rather", false], [4450, 0.02152, " by", false], [40186, 0.021009, " which", false], [4423, 0.009597, " as", false], [4596, 0.007196, " in", false], [40085, 0.00662, " using", false], [32487, 0.006234, " with", false], [53140, 0.005706, " through", false]]], "qwen": [537, 1, 0.5248613357543945, [[537, 0.524861, " not", false], [323, 0.174363, " and", false], [892, 0.037924, " which", false], [4751, 0.031897, " rather", false], [553, 0.022549, " by", false], [438, 0.017158, " as", false], [773, 0.01376, " so", false], [1667, 0.012388, " using", false], [429, 0.010594, " that", false], [448, 0.009621, " with", false]]]}, "raw_delta": -0.060569360852241516, "tuned_delta": -0.05375708304514357}, {"byte_start": 6656, "byte_end": 6659, "display": {"text": " by", "kind": "normal"}, "is_word": true, "word_id": 1118, "word_key": " by", "bytes_hex": "20 62 79", "compression": {"rwkv": "2.15% 2.15% 2.15%", "qwen": "1.98% 1.98% 1.98%"}, "model_tokens": {"rwkv": [[4450, " by", "normal", 0.6967791318893433]], "qwen": [[553, " by", "normal", 0.7199219465255737]]}, "loss": {"rwkv": 2.1485448606988955, "qwen": 1.9753651389266438}, "topk": {"rwkv": [4450, 1, 0.6967791318893433, [[4450, 0.696779, " by", false], [22590, 0.094841, " the", false], [22248, 0.044669, " our", false], [31597, 0.01722, " ours", false], [4596, 0.013517, " in", false], [38720, 0.00915, " human", false], [39944, 0.008726, " those", false], [53140, 0.007585, " through", false], [37924, 0.005536, " built", false], [39931, 0.004408, " their", false]]], "qwen": [553, 1, 0.7199219465255737, [[553, 0.719922, " by", false], [1039, 0.078851, " our", false], [279, 0.035263, " the", false], [11350, 0.023112, " ours", false], [304, 0.01811, " in", false], [3738, 0.007074, " human", false], [504, 0.00552, " from", false], [1128, 0.005099, " what", false], [1846, 0.00484, " those", false], [264, 0.004775, " a", false]]]}, "raw_delta": 0.009603122870127365, "tuned_delta": 0.01641540067722531}, {"byte_start": 6659, "byte_end": 6662, "display": {"text": " us", "kind": "normal"}, "is_word": true, "word_id": 1119, "word_key": " us", "bytes_hex": "20 75 73", "compression": {"rwkv": "33.44% 33.44% 33.44%", "qwen": "28.03% 28.03% 28.03%"}, "model_tokens": {"rwkv": [[4835, " us", "normal", 0.003851891029626131]], "qwen": [[601, " us", "normal", 0.009435177780687809]]}, "loss": {"rwkv": 33.43746318727025, "qwen": 28.032226186058057}, "topk": {"rwkv": [4835, 22, 0.003851891029626131, [[22590, 0.301501, " the", false], [22248, 0.13459, " our", false], [38720, 0.102688, " human", false], [31597, 0.031135, " ours", false], [52224, 0.028738, " methods", false], [21273, 0.022548, " any", false], [47629, 0.020241, " trying", false], [39944, 0.017127, " those", false], [32464, 0.016676, " what", false], [55666, 0.0149, " building", false]]], "qwen": [601, 16, 0.009435177780687809, [[1039, 0.258688, " our", false], [279, 0.135349, " the", false], [3738, 0.051711, " human", false], [1128, 0.040592, " what", false], [1246, 0.030586, " how", false], [894, 0.029897, " any", false], [11350, 0.029029, " ours", false], [1045, 0.022115, " some", false], [4460, 0.01838, " trying", false], [264, 0.016735, " a", false]]]}, "raw_delta": 0.2997299830118816, "tuned_delta": 0.3065422608189795}, {"byte_start": 6662, "byte_end": 6663, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "12.40%", "qwen": "17.46%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.5049437880516052]], "qwen": [[13, ".", "normal", 0.3797611594200134]]}, "loss": {"rwkv": 12.398160507639528, "qwen": 17.460447263063372}, "topk": {"rwkv": [47, 1, 0.5049437880516052, [[47, 0.504944, ".", false], [45, 0.156282, ",", false], [47629, 0.037812, " trying", false], [60, 0.020034, ";", false], [57419, 0.01667, " thinking", false], [55666, 0.014702, " building", false], [5346, 0.014101, "---", false], [46227, 0.0101, " humans", false], [52157, 0.009907, " looking", false], [275, 0.009199, " (", false]]], "qwen": [13, 1, 0.3797611594200134, [[13, 0.379761, ".", false], [382, 0.197382, ".\n\n", false], [11, 0.133295, ",", false], [4460, 0.027582, " trying", false], [4421, 0.02084, "---", false], [13217, 0.019914, " ourselves", false], [26, 0.01801, ";", false], [4752, 0.015604, " building", false], [304, 0.013535, " in", false], [624, 0.012272, ".\n", false]]]}, "raw_delta": -0.2807127833366394, "tuned_delta": -0.2739005055295415}, {"byte_start": 6663, "byte_end": 6666, "display": {"text": " We", "kind": "normal"}, "is_word": true, "word_id": 1120, "word_key": " we", "bytes_hex": "20 57 65", "compression": {"rwkv": "16.34% 16.34% 16.34%", "qwen": "12.74% 12.74% 12.74%"}, "model_tokens": {"rwkv": [[4331, " We", "normal", 0.06532043218612671]], "qwen": [[1205, " We", "normal", 0.12015379965305328]]}, "loss": {"rwkv": 16.343029760070287, "qwen": 12.7376915233504}, "topk": {"rwkv": [4331, 3, 0.06532043218612671, [[261, 0.334905, "\n\n", false], [20996, 0.098252, " The", false], [4331, 0.06532, " We", false], [29894, 0.061993, " This", false], [3913, 0.032028, " In", false], [37453, 0.022951, " These", false], [20571, 0.022897, " Our", false], [3918, 0.018735, " It", false], [19417, 0.014624, " And", false], [3908, 0.013421, " If", false]]], "qwen": [1205, 2, 0.12015379965305328, [[576, 0.124349, " The", false], [1205, 0.120154, " We", false], [1096, 0.100161, " This", false], [758, 0.045278, " In", false], [1084, 0.03561, " It", false], [4220, 0.029118, " These", false], [1597, 0.026011, " And", false], [2938, 0.025488, " That", false], [2379, 0.023709, " They", false], [1416, 0.022571, " If", false]]]}, "raw_delta": 0.19992240269978845, "tuned_delta": 0.2067346805068864}, {"byte_start": 6666, "byte_end": 6671, "display": {"text": " want", "kind": "normal"}, "is_word": true, "word_id": 1121, "word_key": " want", "bytes_hex": "20 77 61 6e 74", "compression": {"rwkv": "16.91% 16.91% 16.91% 16.91% 16.91%", "qwen": "16.53% 16.53% 16.53% 16.53% 16.53%"}, "model_tokens": {"rwkv": [[32435, " want", "normal", 0.009266255423426628]], "qwen": [[1366, " want", "normal", 0.01023530401289463]]}, "loss": {"rwkv": 16.90658251041754, "qwen": 16.525756167132496}, "topk": {"rwkv": [32435, 10, 0.009266255423426628, [[47266, 0.552161, " should", false], [21286, 0.061105, " are", false], [21413, 0.055396, " can", false], [31059, 0.051735, " have", false], [31475, 0.03549, " must", false], [4491, 0.032531, " do", false], [31506, 0.030899, " need", false], [45409, 0.025555, " cannot", false], [32475, 0.019754, " will", false], [32435, 0.009266, " want", false]]], "qwen": [1366, 11, 0.01023530401289463, [[1265, 0.475429, " should", false], [646, 0.080123, " can", false], [525, 0.070954, " are", false], [653, 0.048946, " do", false], [614, 0.043774, " have", false], [1184, 0.03069, " need", false], [4157, 0.023288, " cannot", false], [1969, 0.021519, " must", false], [686, 0.020723, " will", false], [1936, 0.014334, " build", false]]]}, "raw_delta": 0.02111749649047856, "tuned_delta": 0.027929774297576506}, {"byte_start": 6671, "byte_end": 6674, "display": {"text": " AI", "kind": "normal"}, "is_word": true, "word_id": 1122, "word_key": " ai", "bytes_hex": "20 41 49", "compression": {"rwkv": "32.69% 32.69% 32.69%", "qwen": "33.82% 33.82% 33.82%"}, "model_tokens": {"rwkv": [[3609, " AI", "normal", 0.004324214532971382]], "qwen": [[15235, " AI", "normal", 0.003602352924644947]]}, "loss": {"rwkv": 32.686059520140574, "qwen": 33.82018764574531}, "topk": {"rwkv": [3609, 18, 0.004324214532971382, [[4811, 0.389801, " to", false], [22248, 0.164249, " our", false], [52224, 0.091651, " methods", false], [22590, 0.068976, " the", false], [332, 0.040375, " a", false], [30992, 0.021742, " good", false], [39936, 0.017314, " these", false], [32229, 0.014519, " them", false], [47202, 0.011843, " search", false], [4419, 0.008615, " an", false]]], "qwen": [15235, 19, 0.003602352924644947, [[311, 0.431843, " to", false], [1039, 0.151343, " our", false], [279, 0.06933, " the", false], [5413, 0.062271, " methods", false], [1105, 0.055695, " them", false], [264, 0.020451, " a", false], [1493, 0.020378, " these", false], [13009, 0.007229, " agents", false], [458, 0.006334, " an", false], [18495, 0.00584, " computers", false]]]}, "raw_delta": -0.06288941701253248, "tuned_delta": -0.05607713920543453}, {"byte_start": 6674, "byte_end": 6681, "display": {"text": " agents", "kind": "normal"}, "is_word": true, "word_id": 1123, "word_key": " agents", "bytes_hex": "20 61 67 65 6e 74 73", "compression": {"rwkv": "5.01% 5.01% 5.01% 5.01% 5.01% 5.01% 5.01%", "qwen": "4.27% 4.27% 4.27% 4.27% 4.27% 4.27% 4.27%"}, "model_tokens": {"rwkv": [[45124, " agents", "normal", 0.14229430258274078]], "qwen": [[13009, " agents", "normal", 0.19034291803836823]]}, "loss": {"rwkv": 5.01159410130234, "qwen": 4.273798663792818}, "topk": {"rwkv": [45124, 4, 0.14229430258274078, [[53087, 0.246925, " systems", false], [4811, 0.204055, " to", false], [52224, 0.173339, " methods", false], [45124, 0.142294, " agents", false], [63843, 0.052572, " researchers", false], [57103, 0.045597, " research", false], [32227, 0.026143, " that", false], [56949, 0.017372, " programs", false], [116, 0.014678, "s", false], [45, 0.010725, ",", false]]], "qwen": [13009, 3, 0.19034291803836823, [[5942, 0.341456, " systems", false], [311, 0.200749, " to", false], [13009, 0.190343, " agents", false], [5413, 0.066325, " methods", false], [429, 0.04606, " that", false], [11811, 0.04474, " researchers", false], [3412, 0.025602, " research", false], [7468, 0.008014, " programs", false], [11, 0.006924, ",", false], [537, 0.003817, " not", false]]]}, "raw_delta": 0.04091206618717739, "tuned_delta": 0.04772434399427534}, {"byte_start": 6681, "byte_end": 6686, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 1124, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"rwkv": "3.72% 3.72% 3.72% 3.72% 3.72%", "qwen": "3.77% 3.77% 3.77% 3.77% 3.77%"}, "model_tokens": {"rwkv": [[32227, " that", "normal", 0.3567509949207306]], "qwen": [[429, " that", "normal", 0.35199281573295593]]}, "loss": {"rwkv": 3.719448152291858, "qwen": 3.7659552707815522}, "topk": {"rwkv": [32227, 2, 0.3567509949207306, [[4811, 0.50093, " to", false], [32227, 0.356751, " that", false], [45, 0.029995, ",", false], [22762, 0.02981, " who", false], [32487, 0.016772, " with", false], [40191, 0.009517, " whose", false], [51127, 0.005733, " capable", false], [21265, 0.004544, " and", false], [4596, 0.003805, " in", false], [275, 0.00374, " (", false]]], "qwen": [429, 2, 0.35199281573295593, [[311, 0.565987, " to", false], [429, 0.351993, " that", false], [448, 0.011837, " with", false], [11, 0.010759, ",", false], [6693, 0.005431, " whose", false], [879, 0.005186, " who", false], [2952, 0.004026, " able", false], [537, 0.003776, " not", false], [12875, 0.003059, " capable", false], [5798, 0.002581, " built", false]]]}, "raw_delta": -0.0025789022445678877, "tuned_delta": 0.004233375562530059}, {"byte_start": 6686, "byte_end": 6690, "display": {"text": " can", "kind": "normal"}, "is_word": true, "word_id": 1125, "word_key": " can", "bytes_hex": "20 63 61 6e", "compression": {"rwkv": "4.68% 4.68% 4.68% 4.68%", "qwen": "4.18% 4.18% 4.18% 4.18%"}, "model_tokens": {"rwkv": [[21413, " can", "normal", 0.3548550009727478]], "qwen": [[646, " can", "normal", 0.3953403830528259]]}, "loss": {"rwkv": 4.684532237261526, "qwen": 4.18385258194923}, "topk": {"rwkv": [21413, 1, 0.3548550009727478, [[21413, 0.354855, " can", false], [21286, 0.160759, " are", false], [30858, 0.053461, " find", false], [4491, 0.038552, " do", false], [31059, 0.036208, " have", false], [38877, 0.026188, " learn", false], [32475, 0.018769, " will", false], [47202, 0.018631, " search", false], [22681, 0.018268, " use", false], [39942, 0.01753, " think", false]]], "qwen": [646, 1, 0.3953403830528259, [[646, 0.39534, " can", false], [525, 0.170227, " are", false], [3960, 0.036257, " learn", false], [614, 0.029221, " have", false], [653, 0.026931, " do", false], [686, 0.022574, " will", false], [1477, 0.018476, " find", false], [975, 0.015161, " work", false], [1744, 0.014971, " think", false], [11, 0.010416, ",", false]]]}, "raw_delta": 0.027763575315475464, "tuned_delta": 0.03457585312257341}, {"byte_start": 6690, "byte_end": 6699, "display": {"text": " discover", "kind": "normal"}, "is_word": true, "word_id": 1126, "word_key": " discover", "bytes_hex": "20 64 69 73 63 6f 76 65 72", "compression": {"rwkv": "8.01% 8.01% 8.01% 8.01% 8.01% 8.01% 8.01% 8.01% 8.01%", "qwen": "8.66% 8.66% 8.66% 8.66% 8.66% 8.66% 8.66% 8.66% 8.66%"}, "model_tokens": {"rwkv": [[56010, " discover", "normal", 0.01816163957118988]], "qwen": [[6997, " discover", "normal", 0.013267488218843937]]}, "loss": {"rwkv": 8.01497244938313, "qwen": 8.661056807501929}, "topk": {"rwkv": [56010, 9, 0.01816163957118988, [[30858, 0.278909, " find", false], [38877, 0.081206, " learn", false], [4491, 0.046088, " do", false], [47202, 0.039445, " search", false], [39942, 0.034342, " think", false], [4435, 0.028888, " be", false], [63292, 0.018242, " approximate", false], [22681, 0.018181, " use", false], [56010, 0.018162, " discover", false], [37923, 0.017444, " build", false]]], "qwen": [6997, 13, 0.013267488218843937, [[1477, 0.163343, " find", false], [3960, 0.0668, " learn", false], [653, 0.063917, " do", false], [1744, 0.040563, " think", false], [11625, 0.026984, " solve", false], [2711, 0.02423, " search", false], [387, 0.022677, " be", false], [1936, 0.019734, " build", false], [1281, 0.018899, " make", false], [2874, 0.017637, " reason", false]]]}, "raw_delta": -0.03582652409871423, "tuned_delta": -0.029014246291616284}, {"byte_start": 6699, "byte_end": 6704, "display": {"text": " like", "kind": "normal"}, "is_word": true, "word_id": 1127, "word_key": " like", "bytes_hex": "20 6c 69 6b 65", "compression": {"rwkv": "36.74% 36.74% 36.74% 36.74% 36.74%", "qwen": "32.17% 32.17% 32.17% 32.17% 32.17%"}, "model_tokens": {"rwkv": [[31296, " like", "normal", 3.846095205517486e-05]], "qwen": [[1075, " like", "normal", 0.00013390577805694193]]}, "loss": {"rwkv": 36.74363932264078, "qwen": 32.1662350786017}, "topk": {"rwkv": [31296, 547, 3.846095205517486e-05, [[22590, 0.146207, " the", false], [21265, 0.093467, " and", false], [30992, 0.06086, " good", false], [45, 0.06026, ",", false], [39931, 0.056277, " their", false], [39936, 0.054229, " these", false], [22168, 0.050029, " new", false], [52224, 0.034468, " methods", false], [21835, 0.033791, " how", false], [32464, 0.030655, " what", false]]], "qwen": [1075, 249, 0.00013390577805694193, [[279, 0.162703, " the", false], [323, 0.109268, " and", false], [369, 0.064706, " for", false], [862, 0.062624, " their", false], [1128, 0.058175, " what", false], [1661, 0.057383, " good", false], [11, 0.041455, ",", false], [1493, 0.039444, " these", false], [1246, 0.029323, " how", false], [2513, 0.02278, " things", false]]]}, "raw_delta": 0.25382518768310547, "tuned_delta": 0.2606374654902034}, {"byte_start": 6704, "byte_end": 6707, "display": {"text": " we", "kind": "normal"}, "is_word": true, "word_id": 1128, "word_key": " we", "bytes_hex": "20 77 65", "compression": {"rwkv": "12.96% 12.96% 12.96%", "qwen": "11.68% 11.68% 11.68%"}, "model_tokens": {"rwkv": [[4858, " we", "normal", 0.1137642115354538]], "qwen": [[582, " we", "normal", 0.14333263039588928]]}, "loss": {"rwkv": 12.96171325798678, "qwen": 11.677338222210782}, "topk": {"rwkv": [4858, 2, 0.1137642115354538, [[4835, 0.390881, " us", false], [4858, 0.113764, " we", false], [46227, 0.066987, " humans", false], [52224, 0.055756, " methods", false], [32234, 0.044551, " this", false], [46, 0.03846, "-", false], [38720, 0.025766, " human", false], [22590, 0.025694, " the", false], [26307, 0.021948, "ness", false], [22248, 0.01979, " our", false]]], "qwen": [582, 3, 0.14333263039588928, [[601, 0.288519, " us", false], [33323, 0.180082, "-minded", false], [582, 0.143333, " we", false], [12677, 0.092214, " humans", false], [13217, 0.027994, " ourselves", false], [3738, 0.027534, " human", false], [264, 0.024417, " a", false], [5577, 0.018602, " themselves", false], [279, 0.018061, " the", false], [20062, 0.014807, " minds", false]]]}, "raw_delta": 0.07122087478637695, "tuned_delta": 0.0780331525934749}, {"byte_start": 6707, "byte_end": 6711, "display": {"text": " can", "kind": "normal"}, "is_word": true, "word_id": 1129, "word_key": " can", "bytes_hex": "20 63 61 6e", "compression": {"rwkv": "17.12% 17.12% 17.12% 17.12%", "qwen": "8.59% 8.59% 8.59% 8.59%"}, "model_tokens": {"rwkv": [[21413, " can", "normal", 0.022478684782981873]], "qwen": [[646, " can", "normal", 0.14863568544387817]]}, "loss": {"rwkv": 17.11791479179776, "qwen": 8.594211152096834}, "topk": {"rwkv": [21413, 3, 0.022478684782981873, [[4491, 0.868829, " do", false], [56010, 0.047736, " discover", false], [21413, 0.022479, " can", false], [31059, 0.010798, " have", false], [21532, 0.01027, " did", false], [40219, 0.007136, " would", false], [46227, 0.006915, " humans", false], [60112, 0.003189, " ourselves", false], [39021, 0.002958, " might", false], [61885, 0.002566, " discovered", false]]], "qwen": [646, 3, 0.14863568544387817, [[653, 0.568086, " do", false], [6997, 0.174734, " discover", false], [646, 0.148636, " can", false], [1521, 0.021359, " did", false], [11105, 0.010338, " discovered", false], [1410, 0.007818, " could", false], [1035, 0.007264, " would", false], [1477, 0.007214, " find", false], [11, 0.006526, ",", false], [1744, 0.006406, " think", false]]]}, "raw_delta": 0.4726544916629791, "tuned_delta": 0.47946676947007705}, {"byte_start": 6711, "byte_end": 6712, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "11.13%", "qwen": "13.22%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.5331584811210632]], "qwen": [[11, ",", "normal", 0.48036783933639526]]}, "loss": {"rwkv": 11.130166819358212, "qwen": 13.222356190044069}, "topk": {"rwkv": [45, 1, 0.5331584811210632, [[45, 0.533158, ",", false], [47, 0.184687, ".", false], [5346, 0.065643, "---", false], [56010, 0.055456, " discover", false], [60, 0.035613, ";", false], [21265, 0.022827, " and", false], [4596, 0.013908, " in", false], [59, 0.013061, ":", false], [275, 0.010391, " (", false], [21400, 0.004388, " but", false]]], "qwen": [11, 1, 0.48036783933639526, [[11, 0.480368, ",", false], [6997, 0.207943, " discover", false], [13, 0.099656, ".", false], [4421, 0.064796, "---", false], [382, 0.043028, ".\n\n", false], [26, 0.024823, ";", false], [320, 0.007874, " (", false], [323, 0.007799, " and", false], [25, 0.007231, ":", false], [1477, 0.004184, " find", false]]]}, "raw_delta": -0.11601561307907104, "tuned_delta": -0.1092033352719731}, {"byte_start": 6712, "byte_end": 6716, "display": {"text": " not", "kind": "normal"}, "is_word": true, "word_id": 1130, "word_key": " not", "bytes_hex": "20 6e 6f 74", "compression": {"rwkv": "7.54% 7.54% 7.54% 7.54%", "qwen": "7.45% 7.45% 7.45% 7.45%"}, "model_tokens": {"rwkv": [[22187, " not", "normal", 0.18961742520332336]], "qwen": [[537, " not", "normal", 0.19144868850708008]]}, "loss": {"rwkv": 7.537518035894486, "qwen": 7.453032633549699}, "topk": {"rwkv": [22187, 2, 0.18961742520332336, [[21265, 0.194162, " and", false], [22187, 0.189617, " not", false], [21400, 0.133369, " but", false], [47001, 0.048698, " rather", false], [32227, 0.043113, " that", false], [4450, 0.033771, " by", false], [4596, 0.02907, " in", false], [4715, 0.02406, " or", false], [4788, 0.023503, " so", false], [4811, 0.016616, " to", false]]], "qwen": [537, 2, 0.19144868850708008, [[323, 0.224467, " and", false], [537, 0.191449, " not", false], [714, 0.158138, " but", false], [553, 0.039503, " by", false], [429, 0.02697, " that", false], [2041, 0.026324, " without", false], [476, 0.023965, " or", false], [4751, 0.023311, " rather", false], [448, 0.023124, " with", false], [773, 0.020411, " so", false]]]}, "raw_delta": 0.004684865474700928, "tuned_delta": 0.011497143281798874}, {"byte_start": 6716, "byte_end": 6722, "display": {"text": " which", "kind": "normal"}, "is_word": true, "word_id": 1131, "word_key": " which", "bytes_hex": "20 77 68 69 63 68", "compression": {"rwkv": "21.98% 21.98% 21.98% 21.98% 21.98% 21.98%", "qwen": "26.25% 26.25% 26.25% 26.25% 26.25% 26.25%"}, "model_tokens": {"rwkv": [[40186, " which", "normal", 0.0006611832068301737]], "qwen": [[892, " which", "normal", 0.0001608761231182143]]}, "loss": {"rwkv": 21.9785572635428, "qwen": 26.25367046853784}, "topk": {"rwkv": [40186, 67, 0.0006611832068301737, [[31296, 0.333391, " like", false], [32227, 0.174015, " that", false], [31580, 0.073641, " ones", false], [31198, 0.056227, " just", false], [3609, 0.03415, " AI", false], [56010, 0.033824, " discover", false], [45124, 0.030258, " agents", false], [22590, 0.018559, " the", false], [39944, 0.016677, " those", false], [4450, 0.016466, " by", false]]], "qwen": [892, 153, 0.0001608761231182143, [[1075, 0.258698, " like", false], [429, 0.23203, " that", false], [6997, 0.062718, " discover", false], [1101, 0.053694, " just", false], [6174, 0.038152, " ones", false], [279, 0.03279, " the", false], [825, 0.025358, " one", false], [13009, 0.025107, " agents", false], [15235, 0.02273, " AI", false], [553, 0.022475, " by", false]]]}, "raw_delta": -0.2370626131693523, "tuned_delta": -0.23025033536225434}, {"byte_start": 6722, "byte_end": 6730, "display": {"text": " contain", "kind": "normal"}, "is_word": true, "word_id": 1132, "word_key": " contain", "bytes_hex": "20 63 6f 6e 74 61 69 6e", "compression": {"rwkv": "18.88% 18.88% 18.88% 18.88% 18.88% 18.88% 18.88% 18.88%", "qwen": "19.92% 19.92% 19.92% 19.92% 19.92% 19.92% 19.92% 19.92%"}, "model_tokens": {"rwkv": [[51306, " contain", "normal", 0.00022505783999804407]], "qwen": [[6644, " contain", "normal", 0.00014512930647470057]]}, "loss": {"rwkv": 18.879017136632918, "qwen": 19.922457377248936}, "topk": {"rwkv": [51306, 171, 0.00022505783999804407, [[4858, 0.303025, " we", false], [21413, 0.25477, " can", false], [4706, 0.03009, " of", false], [21286, 0.026887, " are", false], [31296, 0.02576, " like", false], [22752, 0.022115, " way", false], [31580, 0.018721, " ones", false], [31059, 0.013686, " have", false], [39239, 0.012902, " parts", false], [56010, 0.012546, " discover", false]]], "qwen": [6644, 286, 0.00014512930647470057, [[582, 0.509987, " we", false], [315, 0.054849, " of", false], [646, 0.046551, " can", false], [374, 0.044929, " is", false], [525, 0.02955, " are", false], [1075, 0.015272, " like", false], [1616, 0.011093, " way", false], [5510, 0.009118, " ways", false], [5413, 0.008642, " methods", false], [11, 0.008383, ",", false]]]}, "raw_delta": -0.057860612869262695, "tuned_delta": -0.051048335062164746}, {"byte_start": 6730, "byte_end": 6735, "display": {"text": " what", "kind": "normal"}, "is_word": true, "word_id": 1133, "word_key": " what", "bytes_hex": "20 77 68 61 74", "compression": {"rwkv": "9.41% 9.41% 9.41% 9.41% 9.41%", "qwen": "11.11% 11.11% 11.11% 11.11% 11.11%"}, "model_tokens": {"rwkv": [[32464, " what", "normal", 0.07278504222631454]], "qwen": [[1128, " what", "normal", 0.045924846082925797]]}, "loss": {"rwkv": 9.411330930799096, "qwen": 11.11145338711783}, "topk": {"rwkv": [32464, 4, 0.07278504222631454, [[31296, 0.341937, " like", false], [22248, 0.126189, " our", false], [22590, 0.086415, " the", false], [32464, 0.072785, " what", false], [59943, 0.066871, " knowledge", false], [38720, 0.024047, " human", false], [4835, 0.021256, " us", false], [4596, 0.020862, " in", false], [32227, 0.019373, " that", false], [332, 0.016806, " a", false]]], "qwen": [1128, 4, 0.045924846082925797, [[1039, 0.192355, " our", false], [601, 0.074176, " us", false], [279, 0.071885, " the", false], [1128, 0.045925, " what", false], [678, 0.043658, " all", false], [304, 0.040075, " in", false], [264, 0.038176, " a", false], [1075, 0.030652, " like", false], [2878, 0.026761, " within", false], [43613, 0.026124, " representations", false]]]}, "raw_delta": -0.0942748069763184, "tuned_delta": -0.08746252916922045}, {"byte_start": 6735, "byte_end": 6738, "display": {"text": " we", "kind": "normal"}, "is_word": true, "word_id": 1134, "word_key": " we", "bytes_hex": "20 77 65", "compression": {"rwkv": "0.77% 0.77% 0.77%", "qwen": "0.56% 0.56% 0.56%"}, "model_tokens": {"rwkv": [[4858, " we", "normal", 0.8796457648277283]], "qwen": [[582, " we", "normal", 0.9115656614303589]]}, "loss": {"rwkv": 0.76901469057802, "qwen": 0.5565898267061866}, "topk": {"rwkv": [4858, 1, 0.8796457648277283, [[4858, 0.879646, " we", false], [31296, 0.022075, " like", false], [4600, 0.008903, " is", false], [22248, 0.007913, " our", false], [21413, 0.007562, " can", false], [32232, 0.00623, " they", false], [46227, 0.004702, " humans", false], [22590, 0.003956, " the", false], [47, 0.003563, ".", false], [332, 0.003481, " a", false]]], "qwen": [582, 1, 0.9115656614303589, [[582, 0.911566, " we", false], [374, 0.010946, " is", false], [1039, 0.007368, " our", false], [7952, 0.003925, " appears", false], [304, 0.002683, " in", false], [5868, 0.002403, " looks", false], [807, 0.002394, " they", false], [4977, 0.002156, " seems", false], [3643, 0.002092, " makes", false], [12677, 0.002075, " humans", false]]]}, "raw_delta": 0.01177933563788732, "tuned_delta": 0.018591613444985267}, {"byte_start": 6738, "byte_end": 6743, "display": {"text": " have", "kind": "normal"}, "is_word": true, "word_id": 1135, "word_key": " have", "bytes_hex": "20 68 61 76 65", "compression": {"rwkv": "10.93% 10.93% 10.93% 10.93% 10.93%", "qwen": "15.79% 15.79% 15.79% 15.79% 15.79%"}, "model_tokens": {"rwkv": [[31059, " have", "normal", 0.0487077496945858]], "qwen": [[614, " have", "normal", 0.012539910152554512]]}, "loss": {"rwkv": 10.932923356736675, "qwen": 15.793323332944}, "topk": {"rwkv": [31059, 5, 0.0487077496945858, [[21413, 0.279296, " can", false], [39942, 0.15003, " think", false], [31223, 0.131683, " know", false], [4491, 0.094535, " do", false], [31059, 0.048708, " have", false], [31296, 0.042598, " like", false], [32435, 0.023721, " want", false], [39021, 0.018103, " might", false], [51025, 0.015389, " believe", false], [50888, 0.01375, " already", false]]], "qwen": [614, 9, 0.012539910152554512, [[1744, 0.472448, " think", false], [1414, 0.110558, " know", false], [1366, 0.071092, " want", false], [646, 0.048242, " can", false], [4411, 0.046941, " believe", false], [2669, 0.041109, " already", false], [653, 0.021499, " do", false], [1035, 0.015672, " would", false], [614, 0.01254, " have", false], [1477, 0.010907, " find", false]]]}, "raw_delta": -0.2695178031921387, "tuned_delta": -0.2627055253850408}, {"byte_start": 6743, "byte_end": 6754, "display": {"text": " discovered", "kind": "normal"}, "is_word": true, "word_id": 1136, "word_key": " discovered", "bytes_hex": "20 64 69 73 63 6f 76 65 72 65 64", "compression": {"rwkv": "2.63% 2.63% 2.63% 2.63% 2.63% 2.63% 2.63% 2.63% 2.63% 2.63% 2.63%", "qwen": "3.06% 3.06% 3.06% 3.06% 3.06% 3.06% 3.06% 3.06% 3.06% 3.06% 3.06%"}, "model_tokens": {"rwkv": [[61885, " discovered", "normal", 0.20263995230197906]], "qwen": [[11105, " discovered", "normal", 0.15453387796878815]]}, "loss": {"rwkv": 2.625643495936057, "qwen": 3.061369163855374}, "topk": {"rwkv": [61885, 1, 0.20263995230197906, [[61885, 0.20264, " discovered", false], [47, 0.13319, ".", false], [52112, 0.094932, " learned", false], [4596, 0.075077, " in", false], [50888, 0.066607, " already", false], [4811, 0.043866, " to", false], [53137, 0.038036, " thought", false], [38547, 0.031684, " found", false], [22339, 0.02405, " put", false], [38848, 0.020034, " known", false]]], "qwen": [11105, 2, 0.15453387796878815, [[304, 0.207364, " in", false], [11105, 0.154534, " discovered", false], [4766, 0.066517, " inside", false], [2669, 0.053761, " already", false], [1730, 0.043844, " found", false], [5798, 0.040682, " built", false], [9498, 0.036944, " learned", false], [3381, 0.029962, " thought", false], [13, 0.023349, ".", false], [382, 0.016495, ".\n\n", false]]]}, "raw_delta": -0.024161761457269837, "tuned_delta": -0.01734948365017189}, {"byte_start": 6754, "byte_end": 6755, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "4.61%", "qwen": "17.17%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.7769263386726379]], "qwen": [[13, ".", "normal", 0.38600796461105347]]}, "loss": {"rwkv": 4.61408814346812, "qwen": 17.166218269075713}, "topk": {"rwkv": [47, 1, 0.7769263386726379, [[47, 0.776926, ".", false], [45, 0.064455, ",", false], [4596, 0.018542, " in", false], [31296, 0.01623, " like", false], [21700, 0.013032, " for", false], [21265, 0.012778, " and", false], [50888, 0.011746, " already", false], [60, 0.010426, ";", false], [5346, 0.010292, "---", false], [60112, 0.009627, " ourselves", false]]], "qwen": [13, 1, 0.38600796461105347, [[13, 0.386008, ".", false], [382, 0.231522, ".\n\n", false], [304, 0.072136, " in", false], [11, 0.053785, ",", false], [911, 0.05076, " about", false], [323, 0.018208, " and", false], [13217, 0.017798, " ourselves", false], [2669, 0.015759, " already", false], [4766, 0.013275, " inside", false], [624, 0.012202, ".\n", false]]]}, "raw_delta": -0.6960378885269165, "tuned_delta": -0.6892256107198186}, {"byte_start": 6755, "byte_end": 6764, "display": {"text": " Building", "kind": "normal"}, "is_word": true, "word_id": 1137, "word_key": " building", "bytes_hex": "20 42 75 69 6c 64 69 6e 67", "compression": {"rwkv": "13.21% 13.21% 13.21% 13.21% 13.21% 13.21% 13.21% 13.21% 13.21%", "qwen": "12.49% 12.49% 12.49% 12.49% 12.49% 12.49% 12.49% 12.49% 12.49%"}, "model_tokens": {"rwkv": [[54879, " Building", "normal", 0.0013537760823965073]], "qwen": [[16858, " Building", "normal", 0.0019598412327468395]]}, "loss": {"rwkv": 13.212181147030002, "qwen": 12.493121683772598}, "topk": {"rwkv": [54879, 42, 0.0013537760823965073, [[261, 0.491337, "\n\n", false], [20996, 0.062685, " The", false], [4331, 0.056755, " We", false], [29894, 0.053911, " This", false], [0, 0.021293, "[0]", false], [3913, 0.018078, " In", false], [19417, 0.017814, " And", false], [37453, 0.014228, " These", false], [3918, 0.012922, " It", false], [20571, 0.012835, " Our", false]]], "qwen": [16858, 56, 0.0019598412327468395, [[1205, 0.156684, " We", false], [576, 0.135697, " The", false], [1096, 0.0787, " This", false], [758, 0.036291, " In", false], [220, 0.035951, " ", false], [1084, 0.029062, " It", false], [1597, 0.029, " And", false], [4220, 0.020506, " These", false], [1416, 0.019435, " If", false], [2014, 0.017807, " To", false]]]}, "raw_delta": 0.03987312316894531, "tuned_delta": 0.04668540097604326}, {"byte_start": 6764, "byte_end": 6767, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 1138, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "4.25% 4.25% 4.25%", "qwen": "3.09% 3.09% 3.09%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.49602892994880676]], "qwen": [[304, " in", "normal", 0.5984180569648743]]}, "loss": {"rwkv": 4.250126992202187, "qwen": 3.086560094633201}, "topk": {"rwkv": [4596, 1, 0.49602892994880676, [[4596, 0.496029, " in", false], [52224, 0.060938, " methods", false], [3609, 0.060401, " AI", false], [32139, 0.034953, " such", false], [39936, 0.034372, " these", false], [32234, 0.02739, " this", false], [22248, 0.020615, " our", false], [332, 0.017814, " a", false], [45124, 0.013989, " agents", false], [22590, 0.013847, " the", false]]], "qwen": [304, 1, 0.5984180569648743, [[304, 0.598418, " in", false], [6540, 0.031385, " knowledge", false], [5413, 0.03018, " methods", false], [279, 0.027624, " the", false], [264, 0.025223, " a", false], [1039, 0.02026, " our", false], [389, 0.017346, " on", false], [1493, 0.014468, " these", false], [1741, 0.013214, " such", false], [419, 0.011646, " this", false]]]}, "raw_delta": 0.06452184915542603, "tuned_delta": 0.07133412696252397}, {"byte_start": 6767, "byte_end": 6771, "display": {"text": " our", "kind": "normal"}, "is_word": true, "word_id": 1139, "word_key": " our", "bytes_hex": "20 6f 75 72", "compression": {"rwkv": "7.89% 7.89% 7.89% 7.89%", "qwen": "8.73% 8.73% 8.73% 8.73%"}, "model_tokens": {"rwkv": [[22248, " our", "normal", 0.17137473821640015]], "qwen": [[1039, " our", "normal", 0.14410899579524994]]}, "loss": {"rwkv": 7.889738504861517, "qwen": 8.733648773512776}, "topk": {"rwkv": [22248, 1, 0.17137473821640015, [[22248, 0.171375, " our", false], [38720, 0.136532, " human", false], [32464, 0.116863, " what", false], [22590, 0.098383, " the", false], [59943, 0.078696, " knowledge", false], [21835, 0.065564, " how", false], [332, 0.033664, " a", false], [32234, 0.020113, " this", false], [39936, 0.015929, " these", false], [32139, 0.013032, " such", false]]], "qwen": [1039, 2, 0.14410899579524994, [[1128, 0.150954, " what", false], [1039, 0.144109, " our", false], [279, 0.11937, " the", false], [1246, 0.075014, " how", false], [3738, 0.067958, " human", false], [6540, 0.057701, " knowledge", false], [264, 0.026214, " a", false], [1741, 0.020343, " such", false], [894, 0.016577, " any", false], [419, 0.014827, " this", false]]]}, "raw_delta": -0.046796321868896484, "tuned_delta": -0.039984044061798535}, {"byte_start": 6771, "byte_end": 6783, "display": {"text": " discoveries", "kind": "normal"}, "is_word": true, "word_id": 1140, "word_key": " discoveries", "bytes_hex": "20 64 69 73 63 6f 76 65 72 69 65 73", "compression": {"rwkv": "8.45% 8.45% 8.45% 8.45% 8.45% 8.45% 8.45% 8.45% 8.45% 8.45% 8.45% 8.45%", "qwen": "9.32% 9.32% 9.32% 9.32% 9.32% 9.32% 9.32% 9.32% 9.32% 9.32% 9.32% 9.32%"}, "model_tokens": {"rwkv": [[63484, " discoveries", "normal", 0.0036255193408578634]], "qwen": [[52998, " discoveries", "normal", 0.002021820517256856]]}, "loss": {"rwkv": 8.45329125520877, "qwen": 9.323051232879088}, "topk": {"rwkv": [63484, 28, 0.0036255193408578634, [[59943, 0.226622, " knowledge", false], [22251, 0.163593, " own", false], [65034, 0.057329, " understanding", false], [38720, 0.054377, " human", false], [52224, 0.047178, " methods", false], [39026, 0.033155, " minds", false], [38735, 0.029431, " ideas", false], [32448, 0.023456, " ways", false], [57419, 0.016576, " thinking", false], [57422, 0.016078, " thoughts", false]]], "qwen": [52998, 43, 0.002021820517256856, [[1828, 0.254991, " own", false], [6540, 0.135437, " knowledge", false], [6708, 0.045557, " ideas", false], [8660, 0.039746, " understanding", false], [3738, 0.035428, " human", false], [5510, 0.035331, " ways", false], [11303, 0.032556, " thoughts", false], [1616, 0.026011, " way", false], [10502, 0.023597, " mental", false], [20062, 0.022822, " minds", false]]]}, "raw_delta": -0.04822973410288489, "tuned_delta": -0.04141745629578694}, {"byte_start": 6783, "byte_end": 6788, "display": {"text": " only", "kind": "normal"}, "is_word": true, "word_id": 1141, "word_key": " only", "bytes_hex": "20 6f 6e 6c 79", "compression": {"rwkv": "18.60% 18.60% 18.60% 18.60% 18.60%", "qwen": "16.08% 16.08% 16.08% 16.08% 16.08%"}, "model_tokens": {"rwkv": [[31581, " only", "normal", 0.005843843333423138]], "qwen": [[1172, " only", "normal", 0.01158465538173914]]}, "loss": {"rwkv": 18.597240761459293, "qwen": 16.079101744403204}, "topk": {"rwkv": [31581, 22, 0.005843843333423138, [[4600, 0.25945, " is", false], [4706, 0.117571, " of", false], [45, 0.075798, ",", false], [37598, 0.056051, " about", false], [32475, 0.039703, " will", false], [30659, 0.039411, " does", false], [4811, 0.031415, " to", false], [21265, 0.031353, " and", false], [38964, 0.019165, " makes", false], [4596, 0.016512, " in", false]]], "qwen": [1172, 16, 0.01158465538173914, [[374, 0.245717, " is", false], [11, 0.078962, ",", false], [686, 0.051181, " will", false], [1558, 0.046048, " does", false], [323, 0.039916, " and", false], [315, 0.031096, " of", false], [1035, 0.030783, " would", false], [911, 0.028587, " about", false], [3643, 0.028279, " makes", false], [311, 0.022778, " to", false]]]}, "raw_delta": 0.13963527679443355, "tuned_delta": 0.1464475546015315}, {"byte_start": 6788, "byte_end": 6794, "display": {"text": " makes", "kind": "normal"}, "is_word": true, "word_id": 1142, "word_key": " makes", "bytes_hex": "20 6d 61 6b 65 73", "compression": {"rwkv": "5.73% 5.73% 5.73% 5.73% 5.73% 5.73%", "qwen": "6.56% 6.56% 6.56% 6.56% 6.56% 6.56%"}, "model_tokens": {"rwkv": [[38964, " makes", "normal", 0.1486552357673645]], "qwen": [[3643, " makes", "normal", 0.11284811794757843]]}, "loss": {"rwkv": 5.729452961863721, "qwen": 6.557386758844204}, "topk": {"rwkv": [38964, 1, 0.1486552357673645, [[38964, 0.148655, " makes", false], [38875, 0.106267, " leads", false], [40212, 0.038806, " works", false], [39719, 0.028856, " slows", false], [45691, 0.025688, " delays", false], [30109, 0.023434, " adds", false], [30965, 0.022379, " gets", false], [46441, 0.019735, " limits", false], [38989, 0.01933, " means", false], [47237, 0.018796, " serves", false]]], "qwen": [3643, 1, 0.11284811794757843, [[3643, 0.112848, " makes", false], [69170, 0.060295, " slows", false], [11508, 0.059239, " leads", false], [81220, 0.028288, " wastes", false], [17045, 0.026327, " serves", false], [27236, 0.024041, " tends", false], [13388, 0.023396, " limits", false], [31074, 0.022752, " delays", false], [9044, 0.020737, " becomes", false], [305, 0.02037, " h", false]]]}, "raw_delta": -0.04591039816538495, "tuned_delta": -0.039098120358287}, {"byte_start": 6794, "byte_end": 6797, "display": {"text": " it", "kind": "normal"}, "is_word": true, "word_id": 1143, "word_key": " it", "bytes_hex": "20 69 74", "compression": {"rwkv": "10.99% 10.99% 10.99%", "qwen": "15.04% 15.04% 15.04%"}, "model_tokens": {"rwkv": [[4601, " it", "normal", 0.16222283244132996]], "qwen": [[432, " it", "normal", 0.0819397121667862]]}, "loss": {"rwkv": 10.9892786317714, "qwen": 15.03872193505929}, "topk": {"rwkv": [4601, 2, 0.16222283244132996, [[22590, 0.197497, " the", false], [4601, 0.162223, " it", false], [32229, 0.125896, " them", false], [47539, 0.111224, " things", false], [4835, 0.08174, " us", false], [22248, 0.062432, " our", false], [21700, 0.041636, " for", false], [32234, 0.023982, " this", false], [39936, 0.015109, " these", false], [39931, 0.014693, " their", false]]], "qwen": [432, 4, 0.0819397121667862, [[279, 0.208293, " the", false], [1105, 0.119184, " them", false], [601, 0.115135, " us", false], [432, 0.08194, " it", false], [1039, 0.061006, " our", false], [2513, 0.045762, " things", false], [5530, 0.041568, " sense", false], [369, 0.036062, " for", false], [1493, 0.033041, " these", false], [15235, 0.028617, " AI", false]]]}, "raw_delta": -0.2245488166809082, "tuned_delta": -0.21773653887381025}, {"byte_start": 6797, "byte_end": 6804, "display": {"text": " harder", "kind": "normal"}, "is_word": true, "word_id": 1144, "word_key": " harder", "bytes_hex": "20 68 61 72 64 65 72", "compression": {"rwkv": "1.65% 1.65% 1.65% 1.65% 1.65% 1.65% 1.65%", "qwen": "1.70% 1.70% 1.70% 1.70% 1.70% 1.70% 1.70%"}, "model_tokens": {"rwkv": [[46162, " harder", "normal", 0.5285402536392212]], "qwen": [[15750, " harder", "normal", 0.5171852707862854]]}, "loss": {"rwkv": 1.650404483159807, "qwen": 1.6986549836390592}, "topk": {"rwkv": [46162, 1, 0.5285402536392212, [[46162, 0.52854, " harder", false], [31458, 0.13274, " more", false], [31048, 0.050174, " hard", false], [45819, 0.048646, " easier", false], [62082, 0.033123, " impossible", false], [59516, 0.03086, " difficult", false], [56895, 0.018945, " possible", false], [31277, 0.013756, " less", false], [31466, 0.012884, " much", false], [30788, 0.012339, " even", false]]], "qwen": [15750, 1, 0.5171852707862854, [[15750, 0.517185, " harder", false], [803, 0.171217, " more", false], [5000, 0.047931, " difficult", false], [2588, 0.045289, " hard", false], [8661, 0.030418, " easier", false], [11997, 0.028264, " impossible", false], [1753, 0.02736, " much", false], [2686, 0.022846, " less", false], [10960, 0.009127, " worse", false], [1602, 0.008539, " very", false]]]}, "raw_delta": -0.0026755758694240045, "tuned_delta": 0.004136701937673942}, {"byte_start": 6804, "byte_end": 6807, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 1145, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "3.50% 3.50% 3.50%", "qwen": "4.58% 4.58% 4.58%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.556350827217102]], "qwen": [[311, " to", "normal", 0.46676692366600037]]}, "loss": {"rwkv": 3.4987233250725183, "qwen": 4.5801072380351435}, "topk": {"rwkv": [4811, 1, 0.556350827217102, [[4811, 0.556351, " to", false], [21700, 0.363499, " for", false], [21265, 0.024827, " and", false], [45, 0.023392, ",", false], [47, 0.009191, ".", false], [38869, 0.005844, " later", false], [4596, 0.004573, " in", false], [22187, 0.001197, " not", false], [275, 0.000971, " (", false], [5346, 0.00097, "---", false]]], "qwen": [311, 2, 0.46676692366600037, [[369, 0.474168, " for", false], [311, 0.466767, " to", false], [11, 0.020797, ",", false], [323, 0.014098, " and", false], [304, 0.003788, " in", false], [382, 0.002963, ".\n\n", false], [13, 0.00262, ".", false], [2937, 0.002214, " later", false], [320, 0.001455, " (", false], [1091, 0.000865, " than", false]]]}, "raw_delta": -0.05996465682983401, "tuned_delta": -0.05315237902273606}, {"byte_start": 6807, "byte_end": 6811, "display": {"text": " see", "kind": "normal"}, "is_word": true, "word_id": 1146, "word_key": " see", "bytes_hex": "20 73 65 65", "compression": {"rwkv": "20.43% 20.43% 20.43% 20.43%", "qwen": "23.37% 23.37% 23.37% 23.37%"}, "model_tokens": {"rwkv": [[22449, " see", "normal", 0.010801587253808975]], "qwen": [[1490, " see", "normal", 0.005611109547317028]]}, "loss": {"rwkv": 20.428787200087857, "qwen": 23.367181732922425}, "topk": {"rwkv": [22449, 8, 0.010801587253808975, [[56010, 0.343612, " discover", false], [30858, 0.30686, " find", false], [31358, 0.053545, " make", false], [37923, 0.03392, " build", false], [4491, 0.024791, " do", false], [38877, 0.022269, " learn", false], [21751, 0.015845, " get", false], [22449, 0.010802, " see", false], [55851, 0.009587, " continue", false], [31205, 0.009299, " keep", false]]], "qwen": [1490, 20, 0.005611109547317028, [[6997, 0.197757, " discover", false], [1477, 0.197086, " find", false], [1936, 0.079119, " build", false], [1281, 0.06395, " make", false], [653, 0.033076, " do", false], [5452, 0.029453, " scale", false], [633, 0.026675, " get", false], [7269, 0.024902, " improve", false], [3960, 0.022128, " learn", false], [11075, 0.018933, " achieve", false]]]}, "raw_delta": -0.162939190864563, "tuned_delta": -0.15612691305746504}, {"byte_start": 6811, "byte_end": 6815, "display": {"text": " how", "kind": "normal"}, "is_word": true, "word_id": 1147, "word_key": " how", "bytes_hex": "20 68 6f 77", "compression": {"rwkv": "10.92% 10.92% 10.92% 10.92%", "qwen": "7.47% 7.47% 7.47% 7.47%"}, "model_tokens": {"rwkv": [[21835, " how", "normal", 0.08877964317798615]], "qwen": [[1246, " how", "normal", 0.19070583581924438]]}, "loss": {"rwkv": 10.918834537977993, "qwen": 7.470559278009971}, "topk": {"rwkv": [21835, 4, 0.08877964317798615, [[22590, 0.205309, " the", false], [32464, 0.194181, " what", false], [32229, 0.110058, " them", false], [21835, 0.08878, " how", false], [22168, 0.053599, " new", false], [32227, 0.026834, " that", false], [21265, 0.024972, " and", false], [22248, 0.018654, " our", false], [32465, 0.017508, " when", false], [40185, 0.016631, " where", false]]], "qwen": [1246, 3, 0.19070583581924438, [[1128, 0.219279, " what", false], [279, 0.196197, " the", false], [1246, 0.190706, " how", false], [429, 0.055472, " that", false], [1380, 0.043963, " where", false], [1039, 0.03091, " our", false], [1105, 0.026745, " them", false], [501, 0.020996, " new", false], [323, 0.014204, " and", false], [979, 0.012656, " when", false]]]}, "raw_delta": 0.1912129819393158, "tuned_delta": 0.19802525974641375}, {"byte_start": 6815, "byte_end": 6819, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 1148, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "11.41% 11.41% 11.41% 11.41%", "qwen": "10.42% 10.42% 10.42% 10.42%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.07960384339094162]], "qwen": [[279, " the", "normal", 0.0990520566701889]]}, "loss": {"rwkv": 11.411943194531839, "qwen": 10.423967358819077}, "topk": {"rwkv": [22590, 3, 0.07960384339094162, [[4811, 0.469759, " to", false], [32232, 0.086089, " they", false], [22590, 0.079604, " the", false], [4858, 0.062246, " we", false], [22248, 0.049591, " our", false], [31466, 0.044522, " much", false], [3609, 0.019996, " AI", false], [39936, 0.019457, " these", false], [39944, 0.013985, " those", false], [21660, 0.007521, " far", false]]], "qwen": [279, 3, 0.0990520566701889, [[311, 0.27446, " to", false], [582, 0.129452, " we", false], [279, 0.099052, " the", false], [807, 0.088681, " they", false], [1039, 0.063842, " our", false], [1753, 0.028114, " much", false], [1493, 0.026621, " these", false], [15235, 0.02435, " AI", false], [3041, 0.021774, " far", false], [2513, 0.01097, " things", false]]]}, "raw_delta": 0.05478501319885254, "tuned_delta": 0.06159729100595049}, {"byte_start": 6819, "byte_end": 6831, "display": {"text": " discovering", "kind": "normal"}, "is_word": true, "word_id": 1149, "word_key": " discovering", "bytes_hex": "20 64 69 73 63 6f 76 65 72 69 6e 67", "compression": {"rwkv": "11.32% 11.32% 11.32% 11.32% 11.32% 11.32% 11.32% 11.32% 11.32% 11.32% 11.32% 11.32%", "qwen": "11.51% 11.51% 11.51% 11.51% 11.51% 11.51% 11.51% 11.51% 11.51% 11.51% 11.51% 11.51%"}, "model_tokens": {"rwkv": [[63485, " discovering", "normal", 0.0005360121140256524]], "qwen": [[41587, " discovering", "normal", 0.00047218933468684554]]}, "loss": {"rwkv": 11.31801773614063, "qwen": 11.508694901152227}, "topk": {"rwkv": [63485, 120, 0.0005360121140256524, [[37636, 0.152865, " agent", false], [40213, 0.117816, " world", false], [45124, 0.060229, " agents", false], [3609, 0.051291, " AI", false], [31427, 0.042816, " mind", false], [52224, 0.041297, " methods", false], [63484, 0.036313, " discoveries", false], [52391, 0.03625, " outside", false], [59544, 0.033119, " discovery", false], [31835, 0.025668, " real", false]]], "qwen": [41587, 131, 0.00047218933468684554, [[1879, 0.122462, " world", false], [8315, 0.114564, " agent", false], [15235, 0.097821, " AI", false], [13009, 0.080342, " agents", false], [52998, 0.069388, " discoveries", false], [18335, 0.04886, " discovery", false], [5413, 0.035019, " methods", false], [1849, 0.023291, " system", false], [11105, 0.023193, " discovered", false], [1931, 0.017734, " real", false]]]}, "raw_delta": -0.010573387145996094, "tuned_delta": -0.003761109338898147}, {"byte_start": 6831, "byte_end": 6839, "display": {"text": " process", "kind": "normal"}, "is_word": true, "word_id": 1150, "word_key": " process", "bytes_hex": "20 70 72 6f 63 65 73 73", "compression": {"rwkv": "7.19% 7.19% 7.19% 7.19% 7.19% 7.19% 7.19% 7.19%", "qwen": "6.32% 6.32% 6.32% 6.32% 6.32% 6.32% 6.32% 6.32%"}, "model_tokens": {"rwkv": [[52571, " process", "normal", 0.04078624024987221]], "qwen": [[1882, " process", "normal", 0.06064356863498688]]}, "loss": {"rwkv": 7.185297566927454, "qwen": 6.317970785469655}, "topk": {"rwkv": [52571, 5, 0.04078624024987221, [[4600, 0.140924, " is", false], [21413, 0.119601, " can", false], [37636, 0.104803, " agent", false], [51896, 0.053603, " happens", false], [52571, 0.040786, " process", false], [22748, 0.037056, " was", false], [40212, 0.032853, " works", false], [38128, 0.030856, " could", false], [30988, 0.028576, " goes", false], [39021, 0.023173, " might", false]]], "qwen": [1882, 7, 0.06064356863498688, [[646, 0.159018, " can", false], [1410, 0.095712, " could", false], [8315, 0.08047, " agent", false], [4278, 0.076773, " works", false], [374, 0.075503, " is", false], [1265, 0.065869, " should", false], [1882, 0.060644, " process", false], [3520, 0.036977, " actually", false], [5413, 0.026838, " methods", false], [572, 0.026468, " was", false]]]}, "raw_delta": 0.04809480905532837, "tuned_delta": 0.05490708686242632}, {"byte_start": 6839, "byte_end": 6843, "display": {"text": " can", "kind": "normal"}, "is_word": true, "word_id": 1151, "word_key": " can", "bytes_hex": "20 63 61 6e", "compression": {"rwkv": "8.52% 8.52% 8.52% 8.52%", "qwen": "9.65% 9.65% 9.65% 9.65%"}, "model_tokens": {"rwkv": [[21413, " can", "normal", 0.15115316212177277]], "qwen": [[646, " can", "normal", 0.11752419918775558]]}, "loss": {"rwkv": 8.523735349002175, "qwen": 9.653031478712043}, "topk": {"rwkv": [21413, 2, 0.15115316212177277, [[40212, 0.277205, " works", false], [21413, 0.151153, " can", false], [46342, 0.105044, " itself", false], [38128, 0.075269, " could", false], [39021, 0.072207, " might", false], [4600, 0.044659, " is", false], [47266, 0.023745, " should", false], [55448, 0.02325, " actually", false], [30988, 0.018111, " goes", false], [56940, 0.015899, " proceeds", false]]], "qwen": [646, 2, 0.11752419918775558, [[4278, 0.37059, " works", false], [646, 0.117524, " can", false], [5086, 0.064597, " itself", false], [1410, 0.063524, " could", false], [1265, 0.060406, " should", false], [3520, 0.059734, " actually", false], [2578, 0.044, " might", false], [374, 0.037924, " is", false], [2167, 0.033396, " really", false], [1035, 0.018969, " would", false]]]}, "raw_delta": -0.06262147426605225, "tuned_delta": -0.0558091964589543}, {"byte_start": 6843, "byte_end": 6846, "display": {"text": " be", "kind": "normal"}, "is_word": true, "word_id": 1152, "word_key": " be", "bytes_hex": "20 62 65", "compression": {"rwkv": "5.05% 5.05% 5.05%", "qwen": "5.28% 5.28% 5.28%"}, "model_tokens": {"rwkv": [[4435, " be", "normal", 0.4289212226867676]], "qwen": [[387, " be", "normal", 0.4152001440525055]]}, "loss": {"rwkv": 5.04849338852746, "qwen": 5.283838389237209}, "topk": {"rwkv": [4435, 1, 0.4289212226867676, [[4435, 0.428921, " be", false], [32499, 0.130115, " work", false], [52570, 0.070749, " proceed", false], [55851, 0.06122, " continue", false], [4559, 0.048275, " go", false], [39590, 0.0309, " scale", false], [46159, 0.015215, " happen", false], [46342, 0.015127, " itself", false], [39166, 0.011769, " occur", false], [30858, 0.009119, " find", false]]], "qwen": [387, 1, 0.4152001440525055, [[387, 0.4152, " be", false], [975, 0.147852, " work", false], [10354, 0.076191, " proceed", false], [3060, 0.061021, " continue", false], [5452, 0.036785, " scale", false], [728, 0.034755, " go", false], [5086, 0.013146, " itself", false], [11996, 0.013124, " succeed", false], [1477, 0.012888, " find", false], [3537, 0.01178, " happen", false]]]}, "raw_delta": -0.013050297896067264, "tuned_delta": -0.0062380200889693175}, {"byte_start": 6846, "byte_end": 6851, "display": {"text": " done", "kind": "normal"}, "is_word": true, "word_id": 1153, "word_key": " done", "bytes_hex": "20 64 6f 6e 65", "compression": {"rwkv": "10.71% 10.71% 10.71% 10.71% 10.71%", "qwen": "11.39% 11.39% 11.39% 11.39% 11.39%"}, "model_tokens": {"rwkv": [[30666, " done", "normal", 0.05191881209611893]], "qwen": [[2814, " done", "normal", 0.04250689595937729]]}, "loss": {"rwkv": 10.707502256597774, "qwen": 11.390398067945}, "topk": {"rwkv": [30666, 4, 0.05191881209611893, [[59203, 0.213639, " automated", false], [31351, 0.106143, " made", false], [56418, 0.069887, " improved", false], [30666, 0.051919, " done", false], [56189, 0.037183, " extended", false], [63594, 0.034271, " generalized", false], [55689, 0.021576, " captured", false], [38547, 0.01936, " found", false], [50937, 0.018573, " applied", false], [63246, 0.018458, " accelerated", false]]], "qwen": [2814, 5, 0.04250689595937729, [[27498, 0.193687, " automated", false], [1865, 0.114809, " made", false], [12944, 0.06158, " improved", false], [30690, 0.057649, " scaled", false], [2814, 0.042507, " done", false], [66117, 0.037587, " generalized", false], [11577, 0.030584, " extended", false], [8570, 0.022971, " continued", false], [85610, 0.02253, " sped", false], [11691, 0.020541, " carried", false]]]}, "raw_delta": -0.03786778450012207, "tuned_delta": -0.031055506693024124}, {"byte_start": 6851, "byte_end": 6853, "display": {"text": ".\n", "kind": "control"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e 0a", "compression": {"rwkv": "27.33% 94.11%", "qwen": "45.90% 45.90%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.22040106356143951], [11, "\n", "control", 0.005381555296480656]], "qwen": [[624, ".\n", "control", 0.006153350230306387]]}, "loss": {"rwkv": 60.722808849916326, "qwen": 45.90257367451315}, "topk": {"rwkv": [47, 1, 0.22040106356143951, [[47, 0.220401, ".", false], [4450, 0.160728, " by", false], [45, 0.09942, ",", false], [4596, 0.091714, " in", false], [45301, 0.069223, " better", false], [4424, 0.03349, " at", false], [31458, 0.030762, " more", false], [64839, 0.021353, " automatically", false], [32458, 0.020775, " well", false], [4712, 0.016858, " on", false]]], "qwen": [624, 20, 0.006153350230306387, [[553, 0.132295, " by", false], [13, 0.127566, ".", false], [304, 0.122575, " in", false], [382, 0.113753, ".\n\n", false], [11, 0.091856, ",", false], [2664, 0.084548, " better", false], [803, 0.043739, " more", false], [9463, 0.017869, " automatically", false], [29720, 0.016849, " efficiently", false], [1632, 0.016194, " well", false]]]}, "raw_delta": 0.8218083381652832, "tuned_delta": 0.8286206159723811}], "meta": {"model_a": "RWKV7-G1C-1.5B", "model_b": "Qwen3-1.7B-Base", "avg_compression": {"rwkv": 9.34723569263109, "qwen": 9.47008618524935}, "avg_delta": -0.006812277807097947, "avg_delta_compression": -0.12285049261822686}}</script>
+    <script id="render-model" type="application/json">{"text": "The Bitter Lesson\nRich Sutton\nMarch 13, 2019\nThe biggest lesson that can be read from 70 years of AI research is that general methods that leverage computation are ultimately the most effective, and by a large margin. The ultimate reason for this is Moore's law, or rather its generalization of continued exponentially falling cost per unit of computation. Most AI research has been conducted as if the computation available to the agent were constant (in which case leveraging human knowledge would be one of the only ways to improve performance) but, over a slightly longer time than a typical research project, massively more computation inevitably becomes available. Seeking an improvement that makes a difference in the shorter term, researchers seek to leverage their human knowledge of the domain, but the only thing that matters in the long run is the leveraging of computation. These two need not run counter to each other, but in practice they tend to. Time spent on one is time not spent on the other. There are psychological commitments to investment in one approach or the other. And the human-knowledge approach tends to complicate methods in ways that make them less suited to taking advantage of general methods leveraging computation.  There were many examples of AI researchers' belated learning of this bitter lesson, and it is instructive to review some of the most prominent.\n\nIn computer chess, the methods that defeated the world champion, Kasparov, in 1997, were based on massive, deep search. At the time, this was looked upon with dismay by the majority of computer-chess researchers who had pursued methods that leveraged human understanding of the special structure of chess. When a simpler, search-based approach with special hardware and software proved vastly more effective, these human-knowledge-based chess researchers were not good losers. They said that ``brute force\" search may have won this time, but it was not a general strategy, and anyway it was not how people played chess. These researchers wanted methods based on human input to win and were disappointed when they did not.\n\nA similar pattern of research progress was seen in computer Go, only delayed by a further 20 years. Enormous initial efforts went into avoiding search by taking advantage of human knowledge, or of the special features of the game, but all those efforts proved irrelevant, or worse, once search was applied effectively at scale. Also important was the use of learning by self play to learn a value function (as it was in many other games and even in chess, although learning did not play a big role in the 1997 program that first beat a world champion). Learning by self play, and learning in general, is like search in that it enables massive computation to be brought to bear. Search and learning are the two most important classes of techniques for utilizing massive amounts of computation in AI research. In computer Go, as in computer chess, researchers' initial effort was directed towards utilizing human understanding (so that less search was needed) and only much later was much greater success had by embracing search and learning.\n\nIn speech recognition, there was an early competition, sponsored by DARPA, in the 1970s. Entrants included a host of special methods that took advantage of human knowledge---knowledge of words, of phonemes, of the human vocal tract, etc. On the other side were newer methods that were more statistical in nature and did much more computation, based on hidden Markov models (HMMs). Again, the statistical methods won out over the human-knowledge-based methods. This led to a major change in all of natural language processing, gradually over decades, where statistics and computation came to dominate the field. The recent rise of deep learning in speech recognition is the most recent step in this consistent direction. Deep learning methods rely even less on human knowledge, and use even more computation, together with learning on huge training sets, to produce dramatically better speech recognition systems. As in the games, researchers always tried to make systems that worked the way the researchers thought their own minds worked---they tried to put that knowledge in their systems---but it proved ultimately counterproductive, and a colossal waste of researcher's time, when, through Moore's law, massive computation became available and a means was found to put it to good use.\n\nIn computer vision, there has been a similar pattern. Early methods conceived of vision as searching for edges, or generalized cylinders, or in terms of SIFT features. But today all this is discarded. Modern deep-learning neural networks use only the notions of convolution and certain kinds of invariances, and perform much better.\n\nThis is a big lesson. As a field, we still have not thoroughly learned it, as we are continuing to make the same kind of mistakes. To see this, and to effectively resist it, we have to understand the appeal of these mistakes. We have to learn the bitter lesson that building in how we think we think does not work in the long run. The bitter lesson is based on the historical observations that 1) AI researchers have often tried to build knowledge into their agents, 2) this always helps in the short term, and is personally satisfying to the researcher, but 3) in the long run it plateaus and even inhibits further progress, and 4) breakthrough progress eventually arrives by an opposing approach based on scaling computation by search and learning. The eventual success is tinged with bitterness, and often incompletely digested, because it is success over a favored, human-centric approach.\n\nOne thing that should be learned from the bitter lesson is the great power of general purpose methods, of methods that continue to scale with increased computation even as the available computation becomes very great. The two methods that seem to scale arbitrarily in this way are search and learning.\n\nThe second general point to be learned from the bitter lesson is that the actual contents of minds are tremendously, irredeemably complex; we should stop trying to find simple ways to think about the contents of minds, such as simple ways to think about space, objects, multiple agents, or symmetries. All these are part of the arbitrary, intrinsically-complex, outside world. They are not what should be built in, as their complexity is endless; instead we should build in only the meta-methods that can find and capture this arbitrary complexity. Essential to these methods is that they can find good approximations, but the search for them should be by our methods, not by us. We want AI agents that can discover like we can, not which contain what we have discovered. Building in our discoveries only makes it harder to see how the discovering process can be done.\n", "tokens": [{"byte_start": 0, "byte_end": 3, "display": {"text": "The", "kind": "normal"}, "is_word": true, "word_id": 0, "word_key": "the", "bytes_hex": "54 68 65", "compression": {"rwkv": "19.16% 19.16% 19.16%", "qwen": "33.67% 33.67% 33.67%"}, "model_tokens": {"rwkv": [[6699, "The", "normal", 0.04121053218841553]], "qwen": [[785, "The", "normal", 0.003693073522299528]]}, "loss": {"rwkv": 19.160793511806542, "qwen": 33.67067739459524}, "topk": {"rwkv": [6699, 1, 0.04121053218841553, [[6699, 0.041211, "The", false], [24281, 0.037395, "User", false], [36, 0.035577, "#", false], [34579, 0.031296, "https", false], [1136, 0.024314, "In", false], [82, 0.022212, "Q", false], [520, 0.020419, "**", false], [6833, 0.017958, "You", false], [640, 0.014308, "20", false], [41, 0.013511, "(", false]]], "qwen": [785, 30, 0.003693073522299528, [[262, 0.036306, "   ", false], [286, 0.025112, "       ", false], [198, 0.021214, "\n", false], [310, 0.014187, "           ", false], [220, 0.012878, " ", false], [197, 0.01252, "\t", false], [16, 0.011983, "1", false], [2, 0.009983, "#", false], [256, 0.008925, "  ", false], [17, 0.008681, "2", false]]]}, "raw_delta": -0.8045988082885742, "tuned_delta": -0.7972616697748715}, {"byte_start": 3, "byte_end": 10, "display": {"text": " Bitter", "kind": "normal"}, "is_word": true, "word_id": 1, "word_key": " bitter", "bytes_hex": "20 42 69 74 74 65 72", "compression": {"rwkv": "41.42% 41.42% 41.42% 41.42% 7.47% 7.47% 7.47%", "qwen": "62.88% 62.88% 17.53% 17.53% 17.53% 17.53% 17.53%"}, "model_tokens": {"rwkv": [[19523, " Bit", "normal", 0.00010360294254496694], [8795, "ter", "normal", 0.28614088892936707]], "qwen": [[425, " B", "normal", 0.00093627575552091], [3248, "itter", "normal", 0.007752551697194576]]}, "loss": {"rwkv": 26.869390061199304, "qwen": 30.485520618743337}, "topk": {"rwkv": [19523, 1622, 0.00010360294254496694, [[52569, 0.012556, " problem", false], [32355, 0.011763, " user", false], [45242, 0.008805, " author", false], [331, 0.008116, " `", false], [45010, 0.007984, " United", false], [269, 0.006239, " \"", false], [38499, 0.006146, " first", false], [57009, 0.006012, " question", false], [31894, 0.005713, " role", false], [51272, 0.005701, " concept", false]]], "qwen": [425, 134, 0.00093627575552091, [[2701, 0.032689, " following", false], [4226, 0.024054, " answer", false], [1156, 0.015003, " first", false], [4396, 0.011983, " correct", false], [1565, 0.011463, " `", false], [729, 0.010951, " function", false], [1887, 0.009331, " main", false], [2790, 0.008723, " total", false], [1372, 0.008478, " number", false], [3491, 0.00806, " problem", false]]]}, "raw_delta": -0.20052085603986466, "tuned_delta": -0.19318371752616192}, {"byte_start": 10, "byte_end": 17, "display": {"text": " Lesson", "kind": "normal"}, "is_word": true, "word_id": 2, "word_key": " lesson", "bytes_hex": "20 4c 65 73 73 6f 6e", "compression": {"rwkv": "20.74% 20.74% 20.74% 20.74% 20.74% 1.02% 1.02%", "qwen": "16.49% 16.49% 16.49% 16.49% 16.49% 16.49% 16.49%"}, "model_tokens": {"rwkv": [[29273, " Less", "normal", 0.0032149008475244045], [2098, "on", "normal", 0.8933794498443604]], "qwen": [[48915, " Lesson", "normal", 0.0016589945880696177]]}, "loss": {"rwkv": 15.10522639770043, "qwen": 16.491920054712242}, "topk": {"rwkv": [29273, 29, 0.0032149008475244045, [[37496, 0.246803, " Truth", false], [29584, 0.100386, " Pill", false], [26939, 0.052462, "root", false], [19826, 0.030137, " End", false], [29694, 0.025204, " Root", false], [44502, 0.021864, " Legacy", false], [20979, 0.020562, " Tas", false], [44014, 0.017332, " Battle", false], [21265, 0.011802, " and", false], [37421, 0.011155, " Sweet", false]]], "qwen": [48915, 78, 0.0016589945880696177, [[3972, 0.086547, " End", false], [18854, 0.033914, " Root", false], [2090, 0.0327, "ness", false], [2888, 0.032286, "root", false], [29098, 0.030777, " Truth", false], [34136, 0.021435, " Pill", false], [57981, 0.019807, " Taste", false], [323, 0.016665, " and", false], [26589, 0.016409, " Sweet", false], [55835, 0.013012, " Harvest", false]]]}, "raw_delta": -0.07689462389264791, "tuned_delta": -0.06955748537894517}, {"byte_start": 17, "byte_end": 18, "display": {"text": "\n", "kind": "control"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "0a", "compression": {"rwkv": "31.84%", "qwen": "26.29%"}, "model_tokens": {"rwkv": [[11, "\n", "control", 0.16939213871955872]], "qwen": [[198, "\n", "control", 0.2327895313501358]]}, "loss": {"rwkv": 31.840730394619698, "qwen": 26.286273362980776}, "topk": {"rwkv": [11, 3, 0.16939213871955872, [[59, 0.312257, ":", false], [4706, 0.233828, " of", false], [11, 0.169392, "\n", false], [261, 0.050367, "\n\n", false], [4596, 0.019932, " in", false], [30917, 0.014304, " from", false], [275, 0.012285, " (", false], [21700, 0.011542, " for", false], [22897, 0.010455, " –", false], [280, 0.009315, " -", false]]], "qwen": [198, 2, 0.2327895313501358, [[315, 0.281083, " of", false], [198, 0.23279, "\n", false], [25, 0.055722, ":", false], [271, 0.051887, "\n\n", false], [320, 0.027106, " (", false], [374, 0.02522, " is", false], [304, 0.019353, " in", false], [553, 0.013985, " by", false], [504, 0.013709, " from", false], [11, 0.013458, ",", false]]]}, "raw_delta": 0.3080044984817505, "tuned_delta": 0.3153416369954532}, {"byte_start": 18, "byte_end": 22, "display": {"text": "Rich", "kind": "normal"}, "is_word": true, "word_id": 3, "word_key": "rich", "bytes_hex": "52 69 63 68", "compression": {"rwkv": "43.96% 43.96% 43.96% 43.96%", "qwen": "39.68% 39.68% 39.68% 39.68%"}, "model_tokens": {"rwkv": [[24100, "Rich", "normal", 5.900553514948115e-05]], "qwen": [[27177, "Rich", "normal", 0.00015063985483720899]]}, "loss": {"rwkv": 43.9571145270856, "qwen": 39.67690060330372}, "topk": {"rwkv": [24100, 1621, 5.900553514948115e-05, [[6699, 0.12258, "The", false], [1136, 0.043154, "In", false], [894, 0.040422, "By", false], [66, 0.034144, "A", false], [1782, 0.030002, "by", false], [24242, 0.019565, "This", false], [35, 0.014518, "\"", false], [24327, 0.013673, "When", false], [74, 0.012853, "I", false], [1141, 0.01171, "It", false]]], "qwen": [27177, 744, 0.00015063985483720899, [[785, 0.164658, "The", false], [32, 0.037296, "A", false], [1359, 0.026936, "By", false], [1694, 0.024776, "by", false], [16, 0.017683, "1", false], [641, 0.01757, "In", false], [33, 0.01526, "B", false], [40, 0.012698, "I", false], [4498, 0.009365, "When", false], [25020, 0.00897, "Chapter", false]]]}, "raw_delta": 0.23734545707702637, "tuned_delta": 0.2446825955907291}, {"byte_start": 22, "byte_end": 29, "display": {"text": " Sutton", "kind": "normal"}, "is_word": true, "word_id": 4, "word_key": " sutton", "bytes_hex": "20 53 75 74 74 6f 6e", "compression": {"rwkv": "26.73% 26.73% 26.73% 26.73% 26.73% 26.73% 26.73%", "qwen": "23.54% 23.54% 23.54% 23.54% 23.54% 23.54% 23.54%"}, "model_tokens": {"rwkv": [[44940, " Sutton", "normal", 3.066686986130662e-05]], "qwen": [[73013, " Sutton", "normal", 0.00010748509521363303]]}, "loss": {"rwkv": 26.728501873612494, "qwen": 23.54210068043684}, "topk": {"rwkv": [44940, 2572, 3.066686986130662e-05, [[26269, 0.096985, "mond", false], [4596, 0.063092, " in", false], [21265, 0.059195, " and", false], [1941, 0.044189, "ie", false], [45, 0.032253, ",", false], [46787, 0.031165, " people", false], [19712, 0.029253, " Dad", false], [2030, 0.017598, "ly", false], [1858, 0.016853, "es", false], [8795, 0.015833, "ter", false]]], "qwen": [73013, 761, 0.00010748509521363303, [[6712, 0.07193, "elle", false], [323, 0.065119, " and", false], [645, 0.064316, "ie", false], [12388, 0.06407, "mond", false], [288, 0.034253, "es", false], [32521, 0.028727, " Dad", false], [304, 0.027695, " in", false], [11, 0.024138, ",", false], [1933, 0.020337, "land", false], [2347, 0.01703, "ards", false]]]}, "raw_delta": 0.17669160025460395, "tuned_delta": 0.1840287387683067}, {"byte_start": 29, "byte_end": 30, "display": {"text": "\n", "kind": "control"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "0a", "compression": {"rwkv": "50.16%", "qwen": "18.95%"}, "model_tokens": {"rwkv": [[11, "\n", "control", 0.06104319170117378]], "qwen": [[198, "\n", "control", 0.349587619304657]]}, "loss": {"rwkv": 50.156194780905366, "qwen": 18.95342543052871}, "topk": {"rwkv": [11, 4, 0.06104319170117378, [[45, 0.226113, ",", false], [4600, 0.107195, " is", false], [460, 0.062042, "'s", false], [11, 0.061043, "\n", false], [21265, 0.05983, " and", false], [28309, 0.051197, "’s", false], [21800, 0.032388, " has", false], [22748, 0.026898, " was", false], [59, 0.02509, ":", false], [4706, 0.013552, " of", false]]], "qwen": [198, 1, 0.349587619304657, [[198, 0.349588, "\n", false], [11, 0.156176, ",", false], [323, 0.072967, " and", false], [594, 0.045174, "'s", false], [271, 0.036277, "\n\n", false], [320, 0.024252, " (", false], [374, 0.018142, " is", false], [748, 0.015414, "’s", false], [25, 0.013219, ":", false], [702, 0.013153, " has", false]]]}, "raw_delta": 1.7302489280700684, "tuned_delta": 1.737586066583771}, {"byte_start": 30, "byte_end": 35, "display": {"text": "March", "kind": "normal"}, "is_word": true, "word_id": 5, "word_key": "march", "bytes_hex": "4d 61 72 63 68", "compression": {"rwkv": "18.15% 18.15% 18.15% 18.15% 18.15%", "qwen": "30.01% 30.01% 30.01% 30.01% 30.01%"}, "model_tokens": {"rwkv": [[33258, "March", "normal", 0.006613485980778933]], "qwen": [[27523, "March", "normal", 0.00024377863155677915]]}, "loss": {"rwkv": 18.146398561181492, "qwen": 30.005352182529908}, "topk": {"rwkv": [33258, 21, 0.006613485980778933, [[6699, 0.071124, "The", false], [66, 0.026327, "A", false], [1136, 0.02585, "In", false], [58067, 0.020608, "Published", false], [640, 0.018784, "20", false], [41, 0.015667, "(", false], [24242, 0.014126, "This", false], [35, 0.010582, "\"", false], [125, 0.010216, "|", false], [639, 0.00977, "19", false]]], "qwen": [27523, 510, 0.00024377863155677915, [[785, 0.081713, "The", false], [16, 0.039271, "1", false], [32, 0.029568, "A", false], [1986, 0.018435, "This", false], [25020, 0.017801, "Chapter", false], [17, 0.015555, "2", false], [33, 0.014165, "B", false], [15, 0.011578, "0", false], [50, 0.010767, "S", false], [2082, 0.009907, "An", false]]]}, "raw_delta": -0.6576000213623046, "tuned_delta": -0.6502628828486018}, {"byte_start": 35, "byte_end": 38, "display": {"text": " 13", "kind": "normal"}, "is_word": true, "word_id": 6, "word_key": " 13", "bytes_hex": "20 31 33", "compression": {"rwkv": "22.35% 22.35% 22.35%", "qwen": "0.97% 20.04% 48.62%"}, "model_tokens": {"rwkv": [[3486, " 13", "normal", 0.02427285723388195]], "qwen": [[220, " ", "normal", 0.947685718536377], [16, "1", "normal", 0.32922863960266113], [18, "3", "normal", 0.0674586296081543]]}, "loss": {"rwkv": 22.354259097107633, "qwen": 23.209212465823803}, "topk": {"rwkv": [3486, 18, 0.02427285723388195, [[3493, 0.141099, " 20", false], [3492, 0.051897, " 19", false], [284, 0.047504, " 1", false], [3504, 0.029647, " 31", false], [3488, 0.027927, " 15", false], [3503, 0.027418, " 30", false], [3501, 0.027317, " 28", false], [3485, 0.026356, " 12", false], [286, 0.026137, " 3", false], [3487, 0.02606, " 14", false]]], "qwen": [220, 1, 0.947685718536377, [[220, 0.947686, " ", false], [11, 0.008321, ",", false], [315, 0.005407, " of", false], [287, 0.003772, "ing", false], [198, 0.003389, "\n", false], [374, 0.001193, " is", false], [4102, 0.001136, " ", false], [68, 0.000797, "e", false], [64, 0.000787, "a", false], [278, 0.000753, "al", false]]]}, "raw_delta": -0.04740868136286743, "tuned_delta": -0.0400715428491647}, {"byte_start": 38, "byte_end": 39, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "1.38%", "qwen": "1.07%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.9261689782142639]], "qwen": [[11, ",", "normal", 0.9425589442253113]]}, "loss": {"rwkv": 1.3824653406956007, "qwen": 1.0668151685550242}, "topk": {"rwkv": [45, 1, 0.9261689782142639, [[45, 0.926169, ",", false], [2209, 0.037057, "th", false], [3493, 0.009484, " 20", false], [11, 0.007212, "\n", false], [9815, 0.003922, "–", false], [46, 0.002842, "-", false], [22897, 0.001676, " –", false], [261, 0.001573, "\n\n", false], [280, 0.001572, " -", false], [273, 0.0007, " \u0026", false]]], "qwen": [11, 1, 0.9425589442253113, [[11, 0.942559, ",", false], [339, 0.020566, "th", false], [220, 0.012831, " ", false], [198, 0.006914, "\n", false], [12, 0.00258, "-", false], [481, 0.002276, " -", false], [345, 0.001089, ",\n", false], [271, 0.001017, "\n\n", false], [13, 0.000906, ".", false], [15, 0.000865, "0", false]]]}, "raw_delta": 0.017503362149000168, "tuned_delta": 0.024840500662702904}, {"byte_start": 39, "byte_end": 42, "display": {"text": " 20", "kind": "normal"}, "is_word": true, "word_id": 7, "word_key": " 20", "bytes_hex": "20 32 30", "compression": {"rwkv": "0.83% 0.83% 0.83%", "qwen": "0.09% 1.65% 0.01%"}, "model_tokens": {"rwkv": [[3493, " 20", "normal", 0.8704513907432556]], "qwen": [[220, " ", "normal", 0.9952646493911743], [17, "2", "normal", 0.9127693772315979], [15, "0", "normal", 0.9992802739143372]]}, "loss": {"rwkv": 0.8335884432219759, "qwen": 0.5815180772308782}, "topk": {"rwkv": [3493, 1, 0.8704513907432556, [[3493, 0.870451, " 20", false], [3492, 0.119114, " 19", false], [3491, 0.005465, " 18", false], [3490, 0.000784, " 17", false], [11, 0.000624, "\n", false], [640, 0.000461, "20", false], [639, 0.000147, "19", false], [3489, 0.000144, " 16", false], [3485, 0.000121, " 12", false], [3488, 0.00012, " 15", false]]], "qwen": [220, 1, 0.9952646493911743, [[220, 0.995265, " ", false], [17, 0.001133, "2", false], [4102, 0.000583, " ", false], [16, 0.000191, "1", false], [198, 7.9e-05, "\n", false], [715, 7e-05, " \n", false], [279, 5.3e-05, " the", false], [378, 5.2e-05, "\\xe2\\x80", true], [15585, 4.5e-05, " Chapter", false], [576, 3.2e-05, " The", false]]]}, "raw_delta": 0.013977749079155428, "tuned_delta": 0.021314887592858163}, {"byte_start": 42, "byte_end": 44, "display": {"text": "19", "kind": "normal"}, "is_word": true, "word_id": 8, "word_key": "19", "bytes_hex": "31 39", "compression": {"rwkv": "25.78% 25.78%", "qwen": "10.29% 37.86%"}, "model_tokens": {"rwkv": [[639, "19", "normal", 0.05752173811197281]], "qwen": [[16, "1", "normal", 0.5653393268585205], [24, "9", "normal", 0.12255670875310898]]}, "loss": {"rwkv": 25.782538328386746, "qwen": 24.070560140541627}, "topk": {"rwkv": [639, 4, 0.05752173811197281, [[640, 0.06631, "20", false], [638, 0.057777, "18", false], [634, 0.057629, "14", false], [639, 0.057522, "19", false], [637, 0.056935, "17", false], [636, 0.056339, "16", false], [633, 0.055022, "13", false], [632, 0.054071, "12", false], [641, 0.052084, "21", false], [635, 0.051313, "15", false]]], "qwen": [16, 1, 0.5653393268585205, [[16, 0.565339, "1", false], [15, 0.273209, "0", false], [17, 0.160743, "2", false], [18, 0.000155, "3", false], [19, 7.8e-05, "4", false], [20, 7.4e-05, "5", false], [24, 5.4e-05, "9", false], [220, 5e-05, " ", false], [21, 5e-05, "6", false], [198, 4.7e-05, "\n", false]]]}, "raw_delta": 0.09493222832679749, "tuned_delta": 0.10226936684050023}, {"byte_start": 44, "byte_end": 45, "display": {"text": "\n", "kind": "control"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "0a", "compression": {"rwkv": "10.07%", "qwen": "5.68%"}, "model_tokens": {"rwkv": [[11, "\n", "control", 0.571814239025116]], "qwen": [[198, "\n", "control", 0.7300056219100952]]}, "loss": {"rwkv": 10.073505412457116, "qwen": 5.675256033267606}, "topk": {"rwkv": [11, 1, 0.571814239025116, [[11, 0.571814, "\n", false], [261, 0.269049, "\n\n", false], [45, 0.022059, ",", false], [359, 0.012099, " |", false], [280, 0.011396, " -", false], [4424, 0.010551, " at", false], [22907, 0.009347, " •", false], [4932, 0.0053, " ·", false], [22898, 0.00365, " —", false], [275, 0.003455, " (", false]]], "qwen": [198, 1, 0.7300056219100952, [[198, 0.730006, "\n", false], [271, 0.076219, "\n\n", false], [220, 0.029873, " ", false], [11, 0.020279, ",", false], [481, 0.015444, " -", false], [760, 0.012802, " |", false], [7288, 0.010354, " •", false], [151643, 0.009148, "\u003c|endoftext|\u003e", false], [9592, 0.007784, " ·", false], [553, 0.007227, " by", false]]]}, "raw_delta": 0.24389073252677917, "tuned_delta": 0.2512278710404819}, {"byte_start": 45, "byte_end": 48, "display": {"text": "The", "kind": "normal"}, "is_word": true, "word_id": 9, "word_key": "the", "bytes_hex": "54 68 65", "compression": {"rwkv": "14.46% 14.46% 14.46%", "qwen": "15.35% 15.35% 15.35%"}, "model_tokens": {"rwkv": [[6699, "The", "normal", 0.09010478109121323]], "qwen": [[785, "The", "normal", 0.07778266817331314]]}, "loss": {"rwkv": 14.464520592246117, "qwen": 15.351697396288186}, "topk": {"rwkv": [6699, 1, 0.09010478109121323, [[6699, 0.090105, "The", false], [1136, 0.039257, "In", false], [66, 0.025966, "A", false], [74, 0.025273, "I", false], [24242, 0.017964, "This", false], [1141, 0.017594, "It", false], [35, 0.015829, "\"", false], [24327, 0.015664, "When", false], [33427, 0.014175, "Share", false], [853, 0.01296, "As", false]]], "qwen": [785, 1, 0.07778266817331314, [[785, 0.077783, "The", false], [16, 0.045669, "1", false], [1986, 0.029479, "This", false], [641, 0.02658, "In", false], [17, 0.021241, "2", false], [15949, 0.019793, "Abstract", false], [32, 0.017704, "A", false], [37155, 0.013513, "Introduction", false], [18, 0.013196, "3", false], [25020, 0.011838, "Chapter", false]]]}, "raw_delta": -0.04919552803039551, "tuned_delta": -0.04185838951669277}, {"byte_start": 48, "byte_end": 56, "display": {"text": " biggest", "kind": "normal"}, "is_word": true, "word_id": 10, "word_key": " biggest", "bytes_hex": "20 62 69 67 67 65 73 74", "compression": {"rwkv": "15.22% 15.22% 15.22% 15.22% 15.22% 15.22% 15.22% 15.22%", "qwen": "17.46% 17.46% 17.46% 17.46% 17.46% 17.46% 17.46% 17.46%"}, "model_tokens": {"rwkv": [[51039, " biggest", "normal", 0.001161403488367796]], "qwen": [[8538, " biggest", "normal", 0.00043262317194603384]]}, "loss": {"rwkv": 15.215924259375784, "qwen": 17.460315051400524}, "topk": {"rwkv": [51039, 93, 0.001161403488367796, [[19523, 0.102103, " Bit", false], [45315, 0.021365, " bitter", false], [39831, 0.013227, " story", false], [46430, 0.011284, " lesson", false], [31461, 0.011049, " most", false], [59725, 0.01025, " following", false], [47014, 0.007033, " recent", false], [40213, 0.006819, " world", false], [38499, 0.00663, " first", false], [320, 0.006065, " U", false]]], "qwen": [8538, 212, 0.00043262317194603384, [[425, 0.396047, " B", false], [2701, 0.017174, " following", false], [1156, 0.01285, " first", false], [5795, 0.009658, " goal", false], [3491, 0.009548, " problem", false], [2311, 0.009273, " book", false], [17755, 0.005431, " lesson", false], [22079, 0.00476, " Problem", false], [220, 0.004692, " ", false], [1429, 0.004305, " most", false]]]}, "raw_delta": -0.12445545196533203, "tuned_delta": -0.11711831345162929}, {"byte_start": 56, "byte_end": 63, "display": {"text": " lesson", "kind": "normal"}, "is_word": true, "word_id": 11, "word_key": " lesson", "bytes_hex": "20 6c 65 73 73 6f 6e", "compression": {"rwkv": "2.96% 2.96% 2.96% 2.96% 2.96% 2.96% 2.96%", "qwen": "4.68% 4.68% 4.68% 4.68% 4.68% 4.68% 4.68%"}, "model_tokens": {"rwkv": [[46430, " lesson", "normal", 0.3188975751399994]], "qwen": [[17755, " lesson", "normal", 0.16280625760555267]]}, "loss": {"rwkv": 2.9586519393230692, "qwen": 4.676378416939369}, "topk": {"rwkv": [46430, 1, 0.3188975751399994, [[46430, 0.318898, " lesson", false], [52569, 0.056575, " problem", false], [59281, 0.038406, " challenge", false], [52245, 0.031298, " mistake", false], [47009, 0.025335, " reason", false], [56739, 0.015289, " obstacle", false], [39941, 0.014743, " thing", false], [52127, 0.01308, " lessons", false], [31887, 0.012984, " risk", false], [47546, 0.010046, " threat", false]]], "qwen": [17755, 1, 0.16280625760555267, [[17755, 0.162806, " lesson", false], [3491, 0.111456, " problem", false], [8645, 0.099703, " challenge", false], [16523, 0.061177, " mistake", false], [88374, 0.031043, " takeaway", false], [3166, 0.025807, " thing", false], [6672, 0.023547, " difference", false], [4265, 0.012921, " issue", false], [12761, 0.011748, " surprise", false], [323, 0.009962, " and", false]]]}, "raw_delta": -0.09525098119463238, "tuned_delta": -0.08791384268092964}, {"byte_start": 63, "byte_end": 68, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 12, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"rwkv": "9.13% 9.13% 9.13% 9.13% 9.13%", "qwen": "9.58% 9.58% 9.58% 9.58% 9.58%"}, "model_tokens": {"rwkv": [[32227, " that", "normal", 0.07993438839912415]], "qwen": [[429, " that", "normal", 0.0701269581913948]]}, "loss": {"rwkv": 9.12955455562547, "qwen": 9.584716960092944}, "topk": {"rwkv": [32227, 3, 0.07993438839912415, [[308, 0.337119, " I", false], [4706, 0.098685, " of", false], [32227, 0.079934, " that", false], [4858, 0.075109, " we", false], [30917, 0.058424, " from", false], [4811, 0.044791, " to", false], [4596, 0.040651, " in", false], [22799, 0.02782, " you", false], [52112, 0.02661, " learned", false], [21700, 0.019094, " for", false]]], "qwen": [429, 5, 0.0701269581913948, [[358, 0.284519, " I", false], [315, 0.126414, " of", false], [304, 0.088273, " in", false], [582, 0.079642, " we", false], [429, 0.070127, " that", false], [504, 0.051129, " from", false], [374, 0.033558, " is", false], [498, 0.0333, " you", false], [311, 0.024325, " to", false], [9498, 0.018782, " learned", false]]]}, "raw_delta": -0.025239562988281228, "tuned_delta": -0.01790242447457849}, {"byte_start": 68, "byte_end": 72, "display": {"text": " can", "kind": "normal"}, "is_word": true, "word_id": 13, "word_key": " can", "bytes_hex": "20 63 61 6e", "compression": {"rwkv": "13.31% 13.31% 13.31% 13.31%", "qwen": "15.66% 15.66% 15.66% 15.66%"}, "model_tokens": {"rwkv": [[21413, " can", "normal", 0.05263060703873634]], "qwen": [[646, " can", "normal", 0.031018095090985298]]}, "loss": {"rwkv": 13.313933726953811, "qwen": 15.658581805299024}, "topk": {"rwkv": [21413, 4, 0.05263060703873634, [[308, 0.291346, " I", false], [22590, 0.074025, " the", false], [4858, 0.052769, " we", false], [21413, 0.052631, " can", false], [22799, 0.017396, " you", false], [332, 0.016364, " a", false], [21273, 0.014957, " any", false], [21800, 0.012189, " has", false], [4677, 0.012035, " my", false], [46787, 0.010691, " people", false]]], "qwen": [646, 4, 0.031018095090985298, [[358, 0.439486, " I", false], [582, 0.078553, " we", false], [498, 0.037389, " you", false], [646, 0.031018, " can", false], [264, 0.028214, " a", false], [279, 0.026695, " the", false], [5662, 0.014207, " machine", false], [12677, 0.013768, " humans", false], [46069, 0.012944, " Rein", false], [4041, 0.011765, " comes", false]]]}, "raw_delta": -0.13001489639282227, "tuned_delta": -0.12267775787911953}, {"byte_start": 72, "byte_end": 75, "display": {"text": " be", "kind": "normal"}, "is_word": true, "word_id": 14, "word_key": " be", "bytes_hex": "20 62 65", "compression": {"rwkv": "0.75% 0.75% 0.75%", "qwen": "0.73% 0.73% 0.73%"}, "model_tokens": {"rwkv": [[4435, " be", "normal", 0.8826338052749634]], "qwen": [[387, " be", "normal", 0.8855698108673096]]}, "loss": {"rwkv": 0.7514036671296683, "qwen": 0.7305084468570671}, "topk": {"rwkv": [4435, 1, 0.8826338052749634, [[4435, 0.882634, " be", false], [30482, 0.055028, " come", false], [30789, 0.008289, " ever", false], [39903, 0.007478, " teach", false], [31073, 0.006056, " help", false], [56896, 0.004466, " possibly", false], [28310, 0.002614, "’t", false], [461, 0.002549, "'t", false], [21265, 0.001868, " and", false], [45846, 0.001267, " emerge", false]]], "qwen": [387, 1, 0.8855698108673096, [[387, 0.88557, " be", false], [2525, 0.048234, " come", false], [1492, 0.009508, " help", false], [3512, 0.005803, " ever", false], [4538, 0.003257, " teach", false], [10767, 0.002551, " possibly", false], [2297, 0.002033, " change", false], [32944, 0.001749, " emerge", false], [1281, 0.001438, " make", false], [944, 0.001403, "'t", false]]]}, "raw_delta": 0.0011586770415306091, "tuned_delta": 0.008495815555233346}, {"byte_start": 75, "byte_end": 80, "display": {"text": " read", "kind": "normal"}, "is_word": true, "word_id": 15, "word_key": " read", "bytes_hex": "20 72 65 61 64", "compression": {"rwkv": "27.73% 27.73% 27.73% 27.73% 27.73%", "qwen": "32.52% 32.52% 32.52% 32.52% 32.52%"}, "model_tokens": {"rwkv": [[31834, " read", "normal", 0.0004577813087962568]], "qwen": [[1349, " read", "normal", 0.00012139618047513068]]}, "loss": {"rwkv": 27.726795317084765, "qwen": 32.519972434549345}, "topk": {"rwkv": [31834, 19, 0.0004577813087962568, [[52112, 0.729077, " learned", false], [38297, 0.091694, " drawn", false], [39887, 0.050446, " taken", false], [47512, 0.028853, " taught", false], [21762, 0.023683, " gle", false], [46418, 0.018075, " learnt", false], [51438, 0.0136, " derived", false], [59697, 0.010598, " extracted", false], [46071, 0.004611, " gained", false], [50937, 0.001465, " applied", false]]], "qwen": [1349, 49, 0.00012139618047513068, [[9498, 0.829011, " learned", false], [49250, 0.066563, " learnt", false], [14764, 0.019995, " drawn", false], [15599, 0.019093, " taught", false], [4429, 0.013984, " taken", false], [14257, 0.008978, " derived", false], [18163, 0.006738, " gained", false], [94016, 0.005617, " glean", false], [27432, 0.004285, " extracted", false], [9251, 0.001362, " applied", false]]]}, "raw_delta": -0.2657901763916015, "tuned_delta": -0.2584530378778988}, {"byte_start": 80, "byte_end": 85, "display": {"text": " from", "kind": "normal"}, "is_word": true, "word_id": 16, "word_key": " from", "bytes_hex": "20 66 72 6f 6d", "compression": {"rwkv": "2.94% 2.94% 2.94% 2.94% 2.94%", "qwen": "1.74% 1.74% 1.74% 1.74% 1.74%"}, "model_tokens": {"rwkv": [[30917, " from", "normal", 0.4441596567630768]], "qwen": [[504, " from", "normal", 0.6165587902069092]]}, "loss": {"rwkv": 2.944563120564388, "qwen": 1.7442240749686408}, "topk": {"rwkv": [30917, 1, 0.4441596567630768, [[30917, 0.44416, " from", false], [31162, 0.387544, " into", false], [4596, 0.065291, " in", false], [51035, 0.039881, " between", false], [22249, 0.022987, " out", false], [4450, 0.004321, " by", false], [22218, 0.004134, " off", false], [4712, 0.002872, " on", false], [37598, 0.002398, " about", false], [4424, 0.00168, " at", false]]], "qwen": [504, 1, 0.6165587902069092, [[504, 0.616559, " from", false], [304, 0.120954, " in", false], [1119, 0.042574, " into", false], [700, 0.032714, " out", false], [911, 0.024167, " about", false], [1588, 0.015949, " here", false], [374, 0.013519, " is", false], [1007, 0.01317, " off", false], [389, 0.011411, " on", false], [1948, 0.010526, " between", false]]]}, "raw_delta": 0.06656093001365661, "tuned_delta": 0.07389806852735935}, {"byte_start": 85, "byte_end": 88, "display": {"text": " 70", "kind": "normal"}, "is_word": true, "word_id": 17, "word_key": " 70", "bytes_hex": "20 37 30", "compression": {"rwkv": "62.74% 62.74% 62.74%", "qwen": "94.00% 66.29% 22.98%"}, "model_tokens": {"rwkv": [[3543, " 70", "normal", 2.8311646019574255e-05]], "qwen": [[220, " ", "normal", 0.005448168609291315], [22, "7", "normal", 0.025329088792204857], [15, "0", "normal", 0.2796103358268738]]}, "loss": {"rwkv": 62.74220620532731, "qwen": 61.08993448195813}, "topk": {"rwkv": [3543, 1621, 2.8311646019574255e-05, [[22590, 0.495919, " the", false], [32234, 0.097747, " this", false], [332, 0.020217, " a", false], [51929, 0.008586, " history", false], [22248, 0.007422, " our", false], [39936, 0.006898, " these", false], [50018, 0.006786, " Bitcoin", false], [21256, 0.005979, " all", false], [28826, 0.005976, " Elon", false], [4677, 0.005804, " my", false]]], "qwen": [220, 15, 0.005448168609291315, [[279, 0.268288, " the", false], [419, 0.195308, " this", false], [73013, 0.057031, " Sutton", false], [1493, 0.041197, " these", false], [678, 0.032129, " all", false], [576, 0.020956, " The", false], [264, 0.020694, " a", false], [894, 0.015734, " any", false], [847, 0.015447, " my", false], [1039, 0.013623, " our", false]]]}, "raw_delta": 0.0916213989257811, "tuned_delta": 0.09895853743948384}, {"byte_start": 88, "byte_end": 94, "display": {"text": " years", "kind": "normal"}, "is_word": true, "word_id": 18, "word_key": " years", "bytes_hex": "20 79 65 61 72 73", "compression": {"rwkv": "0.92% 0.92% 0.92% 0.92% 0.92% 0.92%", "qwen": "2.10% 2.10% 2.10% 2.10% 2.10% 2.10%"}, "model_tokens": {"rwkv": [[40237, " years", "normal", 0.737188458442688]], "qwen": [[1635, " years", "normal", 0.49800431728363037]]}, "loss": {"rwkv": 0.9216435604637339, "qwen": 2.0953538514617325}, "topk": {"rwkv": [40237, 1, 0.737188458442688, [[40237, 0.737188, " years", false], [49, 0.086995, "0", false], [46, 0.030434, "-", false], [44, 0.017851, "+", false], [38, 0.016737, "%", false], [45, 0.012636, ",", false], [620, 0.007046, "00", false], [116, 0.006838, "s", false], [37583, 0.006328, " Years", false], [52232, 0.006267, " million", false]]], "qwen": [1635, 1, 0.49800431728363037, [[1635, 0.498004, " years", false], [15, 0.166918, "0", false], [11, 0.063044, ",", false], [10, 0.057261, "+", false], [82, 0.035846, "s", false], [4, 0.020973, "%", false], [594, 0.014383, "'s", false], [748, 0.011282, "’s", false], [3526, 0.011117, " million", false], [4666, 0.00788, "-year", false]]]}, "raw_delta": -0.06508431831995644, "tuned_delta": -0.0577471798062537}, {"byte_start": 94, "byte_end": 97, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 19, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "0.38% 0.38% 0.38%", "qwen": "0.21% 0.21% 0.21%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.9375355839729309]], "qwen": [[315, " of", "normal", 0.9662426114082336]]}, "loss": {"rwkv": 0.38450734528901, "qwen": 0.20642770791094583}, "topk": {"rwkv": [4706, 1, 0.9375355839729309, [[4706, 0.937536, " of", false], [4596, 0.017684, " in", false], [21240, 0.01036, " ago", false], [39690, 0.002713, " since", false], [37634, 0.00254, " after", false], [9820, 0.002452, "’", false], [40218, 0.002421, " worth", false], [40, 0.001955, "'", false], [4712, 0.001774, " on", false], [21265, 0.00175, " and", false]]], "qwen": [315, 1, 0.9662426114082336, [[315, 0.966243, " of", false], [304, 0.005526, " in", false], [5802, 0.004527, " worth", false], [198, 0.002633, "\n", false], [4134, 0.002496, " ago", false], [527, 0.00184, "’", false], [323, 0.001746, " and", false], [6, 0.001554, "'", false], [320, 0.001478, " (", false], [374, 0.000932, " is", false]]]}, "raw_delta": 0.00987483188509941, "tuned_delta": 0.017211970398802144}, {"byte_start": 97, "byte_end": 100, "display": {"text": " AI", "kind": "normal"}, "is_word": true, "word_id": 20, "word_key": " ai", "bytes_hex": "20 41 49", "compression": {"rwkv": "26.11% 26.11% 26.11%", "qwen": "18.81% 18.81% 18.81%"}, "model_tokens": {"rwkv": [[3609, " AI", "normal", 0.013134406879544258]], "qwen": [[15235, " AI", "normal", 0.04373104125261307]]}, "loss": {"rwkv": 26.111277432755976, "qwen": 18.813326929947113}, "topk": {"rwkv": [3609, 10, 0.013134406879544258, [[51929, 0.077017, " history", false], [22590, 0.054169, " the", false], [54830, 0.038788, " American", false], [320, 0.027472, " U", false], [4273, 0.022142, " US", false], [22747, 0.017623, " war", false], [57103, 0.016225, " research", false], [56077, 0.01568, " economic", false], [39750, 0.013301, " space", false], [3609, 0.013134, " AI", false]]], "qwen": [15235, 3, 0.04373104125261307, [[3412, 0.184863, " research", false], [71278, 0.146839, " reinforcement", false], [15235, 0.043731, " AI", false], [5662, 0.039956, " machine", false], [3139, 0.035446, " experience", false], [975, 0.034034, " work", false], [6366, 0.015723, " computer", false], [3738, 0.015547, " human", false], [279, 0.013831, " the", false], [20443, 0.012459, " artificial", false]]]}, "raw_delta": 0.40468430519104004, "tuned_delta": 0.41202144370474275}, {"byte_start": 100, "byte_end": 109, "display": {"text": " research", "kind": "normal"}, "is_word": true, "word_id": 21, "word_key": " research", "bytes_hex": "20 72 65 73 65 61 72 63 68", "compression": {"rwkv": "1.89% 1.89% 1.89% 1.89% 1.89% 1.89% 1.89% 1.89% 1.89%", "qwen": "0.93% 0.93% 0.93% 0.93% 0.93% 0.93% 0.93% 0.93% 0.93%"}, "model_tokens": {"rwkv": [[57103, " research", "normal", 0.3874472379684448]], "qwen": [[3412, " research", "normal", 0.6299545168876648]]}, "loss": {"rwkv": 1.8941634108893723, "qwen": 0.925945037653647}, "topk": {"rwkv": [57103, 1, 0.3874472379684448, [[57103, 0.387447, " research", false], [4600, 0.244654, " is", false], [63469, 0.083007, " development", false], [51929, 0.055617, " history", false], [56950, 0.048832, " progress", false], [21265, 0.010842, " and", false], [45, 0.010626, ",", false], [32499, 0.008372, " work", false], [47160, 0.005417, " safety", false], [4596, 0.004778, " in", false]]], "qwen": [3412, 1, 0.6299545168876648, [[3412, 0.629955, " research", false], [374, 0.16431, " is", false], [3840, 0.03876, " history", false], [3139, 0.016074, " experience", false], [323, 0.013818, " and", false], [4401, 0.013259, " development", false], [198, 0.012023, "\n", false], [5098, 0.008429, " progress", false], [11, 0.00837, ",", false], [975, 0.006823, " work", false]]]}, "raw_delta": 0.05368942684597439, "tuned_delta": 0.061026565359677126}, {"byte_start": 109, "byte_end": 112, "display": {"text": " is", "kind": "normal"}, "is_word": true, "word_id": 22, "word_key": " is", "bytes_hex": "20 69 73", "compression": {"rwkv": "1.31% 1.31% 1.31%", "qwen": "1.30% 1.30% 1.30%"}, "model_tokens": {"rwkv": [[4600, " is", "normal", 0.8063996434211731]], "qwen": [[374, " is", "normal", 0.8059275150299072]]}, "loss": {"rwkv": 1.309086076327469, "qwen": 1.2969914859798395}, "topk": {"rwkv": [4600, 1, 0.8063996434211731, [[4600, 0.8064, " is", false], [45, 0.048329, ",", false], [21265, 0.023863, " and", false], [59, 0.012272, ":", false], [4596, 0.007698, " in", false], [64, 0.006744, "?", false], [275, 0.006509, " (", false], [11, 0.005695, "\n", false], [22074, 0.005339, " may", false], [43273, 0.004042, "—and", false]]], "qwen": [374, 1, 0.8059275150299072, [[374, 0.805928, " is", false], [323, 0.036311, " and", false], [11, 0.033098, ",", false], [198, 0.017596, "\n", false], [304, 0.013902, " in", false], [25, 0.01129, ":", false], [320, 0.008696, " (", false], [389, 0.0061, " on", false], [13, 0.003515, ".", false], [429, 0.002065, " that", false]]]}, "raw_delta": 0.0006706664959589548, "tuned_delta": 0.008007805009661691}, {"byte_start": 112, "byte_end": 117, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 23, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"rwkv": "1.80% 1.80% 1.80% 1.80% 1.80%", "qwen": "2.50% 2.50% 2.50% 2.50% 2.50%"}, "model_tokens": {"rwkv": [[32227, " that", "normal", 0.6123745441436768]], "qwen": [[429, " that", "normal", 0.500173807144165]]}, "loss": {"rwkv": 1.7963243917318634, "qwen": 2.4987466833014254}, "topk": {"rwkv": [32227, 1, 0.6123745441436768, [[32227, 0.612375, " that", false], [32234, 0.134196, " this", false], [22187, 0.043185, " not", false], [22590, 0.037584, " the", false], [59, 0.034723, ":", false], [332, 0.011083, " a", false], [4811, 0.010767, " to", false], [21835, 0.009836, " how", false], [45, 0.006818, ",", false], [22226, 0.006771, " one", false]]], "qwen": [429, 1, 0.500173807144165, [[429, 0.500174, " that", false], [279, 0.096222, " the", false], [419, 0.095586, " this", false], [25, 0.052095, ":", false], [537, 0.02853, " not", false], [1246, 0.021607, " how", false], [311, 0.019934, " to", false], [825, 0.013768, " one", false], [11, 0.011314, ",", false], [4658, 0.010545, " probably", false]]]}, "raw_delta": -0.038950562477111816, "tuned_delta": -0.031613423963409076}, {"byte_start": 117, "byte_end": 125, "display": {"text": " general", "kind": "normal"}, "is_word": true, "word_id": 24, "word_key": " general", "bytes_hex": "20 67 65 6e 65 72 61 6c", "compression": {"rwkv": "15.08% 15.08% 15.08% 15.08% 15.08% 15.08% 15.08% 15.08%", "qwen": "13.08% 13.08% 13.08% 13.08% 13.08% 13.08% 13.08% 13.08%"}, "model_tokens": {"rwkv": [[51832, " general", "normal", 0.0012306030839681625]], "qwen": [[4586, " general", "normal", 0.0030250304844230413]]}, "loss": {"rwkv": 15.075036071788972, "qwen": 13.076304223365101}, "topk": {"rwkv": [51832, 89, 0.0012306030839681625, [[22590, 0.109695, " the", false], [4601, 0.090823, " it", false], [4858, 0.062206, " we", false], [3609, 0.04318, " AI", false], [39934, 0.039635, " there", false], [45, 0.028941, ",", false], [22799, 0.026261, " you", false], [4588, 0.019662, " if", false], [64452, 0.018409, " intelligence", false], [52167, 0.016605, " machine", false]]], "qwen": [4586, 48, 0.0030250304844230413, [[279, 0.099251, " the", false], [432, 0.067776, " it", false], [1052, 0.061612, " there", false], [582, 0.054925, " we", false], [498, 0.053064, " you", false], [264, 0.028246, " a", false], [12677, 0.0213, " humans", false], [6832, 0.019795, " learning", false], [421, 0.018688, " if", false], [902, 0.017065, " no", false]]]}, "raw_delta": 0.11083322763442993, "tuned_delta": 0.11817036614813267}, {"byte_start": 125, "byte_end": 133, "display": {"text": " methods", "kind": "normal"}, "is_word": true, "word_id": 25, "word_key": " methods", "bytes_hex": "20 6d 65 74 68 6f 64 73", "compression": {"rwkv": "13.60% 13.60% 13.60% 13.60% 13.60% 13.60% 13.60% 13.60%", "qwen": "9.43% 9.43% 9.43% 9.43% 9.43% 9.43% 9.43% 9.43%"}, "model_tokens": {"rwkv": [[52224, " methods", "normal", 0.002398804761469364]], "qwen": [[5413, " methods", "normal", 0.015259837731719017]]}, "loss": {"rwkv": 13.595710102127438, "qwen": 9.42830712328745}, "topk": {"rwkv": [52224, 21, 0.002398804761469364, [[64452, 0.373298, " intelligence", false], [3609, 0.207784, " AI", false], [46, 0.10153, "-", false], [61594, 0.088554, " artificial", false], [52610, 0.037533, " purpose", false], [45, 0.025662, ",", false], [7919, 0.015649, "ist", false], [7933, 0.012159, "ity", false], [63659, 0.011632, " intelligent", false], [52569, 0.011178, " problem", false]]], "qwen": [5413, 11, 0.015259837731719017, [[2022, 0.265766, "ization", false], [11229, 0.17726, " intelligence", false], [58238, 0.089942, "-purpose", false], [3491, 0.04714, " problem", false], [15235, 0.046259, " AI", false], [4849, 0.044556, "izing", false], [7428, 0.026199, " purpose", false], [6832, 0.025554, " learning", false], [7923, 0.019115, "isation", false], [6540, 0.018468, " knowledge", false]]]}, "raw_delta": 0.23108989000320435, "tuned_delta": 0.23842702851690709}, {"byte_start": 133, "byte_end": 138, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 26, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"rwkv": "11.78% 11.78% 11.78% 11.78% 11.78%", "qwen": "10.81% 10.81% 10.81% 10.81% 10.81%"}, "model_tokens": {"rwkv": [[32227, " that", "normal", 0.037954624742269516]], "qwen": [[429, " that", "normal", 0.049904197454452515]]}, "loss": {"rwkv": 11.778252482257551, "qwen": 10.811737501632706}, "topk": {"rwkv": [32227, 7, 0.037954624742269516, [[21286, 0.16466, " are", false], [21700, 0.095833, " for", false], [4706, 0.068984, " of", false], [21265, 0.062194, " and", false], [21556, 0.048598, " don", false], [21413, 0.047104, " can", false], [32227, 0.037955, " that", false], [4491, 0.037125, " do", false], [32475, 0.034783, " will", false], [45, 0.03333, ",", false]]], "qwen": [429, 4, 0.049904197454452515, [[525, 0.289964, " are", false], [369, 0.190641, " for", false], [315, 0.055679, " of", false], [429, 0.049904, " that", false], [653, 0.046371, " do", false], [323, 0.030326, " and", false], [11, 0.025965, ",", false], [311, 0.023332, " to", false], [1513, 0.022734, " don", false], [614, 0.017888, " have", false]]]}, "raw_delta": 0.05359497070312491, "tuned_delta": 0.06093210921682765}, {"byte_start": 138, "byte_end": 147, "display": {"text": " leverage", "kind": "normal"}, "is_word": true, "word_id": 27, "word_key": " leverage", "bytes_hex": "20 6c 65 76 65 72 61 67 65", "compression": {"rwkv": "14.40% 14.40% 14.40% 14.40% 14.40% 14.40% 14.40% 14.40% 14.40%", "qwen": "14.46% 14.46% 14.46% 14.46% 14.46% 14.46% 14.46% 14.46% 14.46%"}, "model_tokens": {"rwkv": [[56540, " leverage", "normal", 0.0007558115175925195]], "qwen": [[32064, " leverage", "normal", 0.0007328909123316407]]}, "loss": {"rwkv": 14.401903619985312, "qwen": 14.464046684497074}, "topk": {"rwkv": [56540, 82, 0.0007558115175925195, [[32499, 0.436449, " work", false], [21286, 0.068103, " are", false], [31967, 0.041057, " seem", false], [31059, 0.026516, " have", false], [21413, 0.026309, " can", false], [31324, 0.023611, " look", false], [45185, 0.02278, " appear", false], [39740, 0.014965, " solve", false], [37730, 0.013661, " apply", false], [53051, 0.013076, " succeed", false]]], "qwen": [32064, 95, 0.0007328909123316407, [[975, 0.316427, " work", false], [646, 0.150735, " can", false], [525, 0.097766, " are", false], [3796, 0.039363, " apply", false], [614, 0.021262, " have", false], [11625, 0.01701, " solve", false], [5452, 0.016156, " scale", false], [653, 0.015514, " do", false], [686, 0.013696, " will", false], [2138, 0.012736, " allow", false]]]}, "raw_delta": -0.0034459431966145093, "tuned_delta": 0.0038911953170882273}, {"byte_start": 147, "byte_end": 159, "display": {"text": " computation", "kind": "normal"}, "is_word": true, "word_id": 28, "word_key": " computation", "bytes_hex": "20 63 6f 6d 70 75 74 61 74 69 6f 6e", "compression": {"rwkv": "8.83% 8.83% 8.83% 8.83% 8.83% 8.83% 8.83% 8.83% 8.83% 8.83% 8.83% 8.83%", "qwen": "11.05% 11.05% 11.05% 11.05% 11.05% 11.05% 11.05% 11.05% 11.05% 11.05% 11.05% 11.05%"}, "model_tokens": {"rwkv": [[63370, " computation", "normal", 0.0028083007782697678]], "qwen": [[34447, " computation", "normal", 0.0006424598395824432]]}, "loss": {"rwkv": 8.828993088773602, "qwen": 11.04594404885318}, "topk": {"rwkv": [63370, 59, 0.0028083007782697678, [[22590, 0.121059, " the", false], [30597, 0.049527, " deep", false], [63885, 0.035487, " statistical", false], [332, 0.033624, " a", false], [30579, 0.031524, " data", false], [52167, 0.027581, " machine", false], [38720, 0.02553, " human", false], [38864, 0.022884, " large", false], [52195, 0.018887, " massive", false], [55465, 0.018348, " advances", false]]], "qwen": [34447, 201, 0.0006424598395824432, [[279, 0.123796, " the", false], [3738, 0.062438, " human", false], [264, 0.041242, " a", false], [821, 0.029322, " data", false], [4867, 0.02503, " prior", false], [7947, 0.023999, " domain", false], [28464, 0.021281, " statistical", false], [3460, 0.021071, " large", false], [6540, 0.018823, " knowledge", false], [3139, 0.015167, " experience", false]]]}, "raw_delta": -0.12293386459350587, "tuned_delta": -0.11559672607980313}, {"byte_start": 159, "byte_end": 163, "display": {"text": " are", "kind": "normal"}, "is_word": true, "word_id": 29, "word_key": " are", "bytes_hex": "20 61 72 65", "compression": {"rwkv": "10.00% 10.00% 10.00% 10.00%", "qwen": "5.74% 5.74% 5.74% 5.74%"}, "model_tokens": {"rwkv": [[21286, " are", "normal", 0.10807795077562332]], "qwen": [[525, " are", "normal", 0.2796705365180969]]}, "loss": {"rwkv": 10.00306131866371, "qwen": 5.744374248312017}, "topk": {"rwkv": [21286, 3, 0.10807795077562332, [[21265, 0.157537, " and", false], [4811, 0.1322, " to", false], [21286, 0.108078, " are", false], [39339, 0.062954, " power", false], [45, 0.047468, ",", false], [4596, 0.039597, " in", false], [21413, 0.03843, " can", false], [32475, 0.033489, " will", false], [31059, 0.025633, " have", false], [4491, 0.01757, " do", false]]], "qwen": [525, 1, 0.2796705365180969, [[525, 0.279671, " are", false], [323, 0.119331, " and", false], [311, 0.113936, " to", false], [2355, 0.060554, " power", false], [11, 0.03411, ",", false], [614, 0.030285, " have", false], [653, 0.027643, " do", false], [646, 0.026449, " can", false], [304, 0.024634, " in", false], [369, 0.016129, " for", false]]]}, "raw_delta": 0.23615175485610962, "tuned_delta": 0.24348889336981236}, {"byte_start": 163, "byte_end": 174, "display": {"text": " ultimately", "kind": "normal"}, "is_word": true, "word_id": 30, "word_key": " ultimately", "bytes_hex": "20 75 6c 74 69 6d 61 74 65 6c 79", "compression": {"rwkv": "8.97% 8.97% 8.97% 8.97% 8.97% 8.97% 8.97% 8.97% 8.97% 8.97% 8.97%", "qwen": "11.04% 11.04% 11.04% 11.04% 11.04% 11.04% 11.04% 11.04% 11.04% 11.04% 11.04%"}, "model_tokens": {"rwkv": [[62676, " ultimately", "normal", 0.004225963726639748]], "qwen": [[13653, " ultimately", "normal", 0.0011913263006135821]]}, "loss": {"rwkv": 8.965611937342633, "qwen": 11.037744906263184}, "topk": {"rwkv": [62676, 45, 0.004225963726639748, [[22187, 0.103783, " not", false], [22590, 0.089257, " the", false], [31458, 0.04812, " more", false], [57492, 0.042825, " unlikely", false], [46439, 0.03466, " likely", false], [21660, 0.02919, " far", false], [31466, 0.028325, " much", false], [39171, 0.022499, " often", false], [45301, 0.02206, " better", false], [332, 0.021258, " a", false]]], "qwen": [13653, 98, 0.0011913263006135821, [[537, 0.088327, " not", false], [803, 0.087442, " more", false], [279, 0.065257, " the", false], [1753, 0.050196, " much", false], [3041, 0.048153, " far", false], [2664, 0.031781, " better", false], [7565, 0.028479, " essential", false], [16353, 0.026478, " superior", false], [3545, 0.024984, " often", false], [1602, 0.021899, " very", false]]]}, "raw_delta": -0.11490345001220705, "tuned_delta": -0.1075663114985043}, {"byte_start": 174, "byte_end": 178, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 31, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "10.43% 10.43% 10.43% 10.43%", "qwen": "14.63% 14.63% 14.63% 14.63%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.09978649020195007]], "qwen": [[279, " the", "normal", 0.03898989409208298]]}, "loss": {"rwkv": 10.425725881424148, "qwen": 14.627363081809944}, "topk": {"rwkv": [22590, 2, 0.09978649020195007, [[31458, 0.134943, " more", false], [22590, 0.099786, " the", false], [45781, 0.072104, " doomed", false], [45301, 0.052523, " better", false], [52140, 0.049737, " limited", false], [38606, 0.04429, " going", false], [31277, 0.041161, " less", false], [22187, 0.035865, " not", false], [31466, 0.026887, " much", false], [57350, 0.022708, " superior", false]]], "qwen": [279, 7, 0.03898989409208298, [[803, 0.130619, " more", false], [7199, 0.071714, " limited", false], [16353, 0.06177, " superior", false], [2664, 0.047314, " better", false], [57637, 0.042213, " doomed", false], [537, 0.039317, " not", false], [279, 0.03899, " the", false], [1753, 0.037011, " much", false], [2686, 0.036432, " less", false], [37179, 0.020377, " inferior", false]]]}, "raw_delta": -0.23298823833465576, "tuned_delta": -0.22565109982095302}, {"byte_start": 178, "byte_end": 183, "display": {"text": " most", "kind": "normal"}, "is_word": true, "word_id": 32, "word_key": " most", "bytes_hex": "20 6d 6f 73 74", "compression": {"rwkv": "3.25% 3.25% 3.25% 3.25% 3.25%", "qwen": "4.69% 4.69% 4.69% 4.69% 4.69%"}, "model_tokens": {"rwkv": [[31461, " most", "normal", 0.4079984426498413]], "qwen": [[1429, " most", "normal", 0.272220253944397]]}, "loss": {"rwkv": 3.2545171332553764, "qwen": 4.692884144744052}, "topk": {"rwkv": [31461, 1, 0.4079984426498413, [[31461, 0.407998, " most", false], [30273, 0.142053, " best", false], [31581, 0.09945, " only", false], [22752, 0.075336, " way", false], [21952, 0.046729, " key", false], [31580, 0.029141, " ones", false], [31637, 0.021997, " path", false], [39523, 0.012034, " right", false], [38879, 0.009627, " least", false], [31209, 0.00684, " keys", false]]], "qwen": [1429, 1, 0.272220253944397, [[1429, 0.27222, " most", false], [1172, 0.173044, " only", false], [1850, 0.172389, " best", false], [1376, 0.117854, " key", false], [1616, 0.056885, " way", false], [6894, 0.021108, " keys", false], [6174, 0.015336, " ones", false], [1815, 0.009391, " path", false], [25648, 0.007474, " fastest", false], [2530, 0.006102, " source", false]]]}, "raw_delta": -0.07976000308990477, "tuned_delta": -0.07242286457620203}, {"byte_start": 183, "byte_end": 193, "display": {"text": " effective", "kind": "normal"}, "is_word": true, "word_id": 33, "word_key": " effective", "bytes_hex": "20 65 66 66 65 63 74 69 76 65", "compression": {"rwkv": "3.75% 3.75% 3.75% 3.75% 3.75% 3.75% 3.75% 3.75% 3.75% 3.75%", "qwen": "2.96% 2.96% 2.96% 2.96% 2.96% 2.96% 2.96% 2.96% 2.96% 2.96%"}, "model_tokens": {"rwkv": [[59593, " effective", "normal", 0.12430167943239212]], "qwen": [[7373, " effective", "normal", 0.19383913278579712]]}, "loss": {"rwkv": 3.7476257898092213, "qwen": 2.9588353158245524}, "topk": {"rwkv": [59593, 2, 0.12430167943239212, [[56900, 0.413213, " powerful", false], [59593, 0.124302, " effective", false], [59829, 0.098518, " important", false], [60274, 0.089289, " promising", false], [47687, 0.055439, " useful", false], [62603, 0.0374, " successful", false], [57516, 0.025429, " valuable", false], [56290, 0.020602, " fruitful", false], [59594, 0.013327, " efficient", false], [47129, 0.010969, " robust", false]]], "qwen": [7373, 2, 0.19383913278579712, [[7988, 0.240876, " powerful", false], [7373, 0.193839, " effective", false], [6849, 0.174028, " successful", false], [2989, 0.117221, " important", false], [5390, 0.059075, " useful", false], [15172, 0.055521, " valuable", false], [25383, 0.031705, " promising", false], [11050, 0.013268, " efficient", false], [88584, 0.011966, " fruitful", false], [21765, 0.011342, " robust", false]]]}, "raw_delta": 0.04373983144760132, "tuned_delta": 0.05107696996130405}, {"byte_start": 193, "byte_end": 194, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "49.87%", "qwen": "51.54%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.06158022582530975]], "qwen": [[11, ",", "normal", 0.057391125708818436]]}, "loss": {"rwkv": 49.87441840573174, "qwen": 51.53785610270818}, "topk": {"rwkv": [45, 3, 0.06158022582530975, [[47, 0.351684, ".", false], [22752, 0.205939, " way", false], [45, 0.06158, ",", false], [21700, 0.0384, " for", false], [21265, 0.036802, " and", false], [55532, 0.034852, " approach", false], [31580, 0.028603, " ones", false], [4424, 0.027025, " at", false], [32448, 0.024331, " ways", false], [38989, 0.019759, " means", false]]], "qwen": [11, 5, 0.057391125708818436, [[13, 0.32337, ".", false], [1616, 0.101312, " way", false], [624, 0.098027, ".\n", false], [6174, 0.05969, " ones", false], [11, 0.057391, ",", false], [369, 0.041388, " for", false], [323, 0.03413, " and", false], [5413, 0.033294, " methods", false], [5486, 0.026549, " approach", false], [19827, 0.023389, " approaches", false]]]}, "raw_delta": -0.09224057197570801, "tuned_delta": -0.08490343346200527}, {"byte_start": 194, "byte_end": 198, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 34, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"rwkv": "5.49% 5.49% 5.49% 5.49%", "qwen": "4.75% 4.75% 4.75% 4.75%"}, "model_tokens": {"rwkv": [[21265, " and", "normal", 0.29447421431541443]], "qwen": [[323, " and", "normal", 0.3485313057899475]]}, "loss": {"rwkv": 5.4946393158857, "qwen": 4.751999956303438}, "topk": {"rwkv": [21265, 1, 0.29447421431541443, [[21265, 0.294474, " and", false], [21400, 0.134004, " but", false], [40187, 0.098236, " while", false], [30788, 0.069891, " even", false], [22187, 0.028177, " not", false], [53339, 0.023985, " whereas", false], [4423, 0.016691, " as", false], [62461, 0.015659, " regardless", false], [51018, 0.014714, " because", false], [61953, 0.014549, " especially", false]]], "qwen": [323, 1, 0.3485313057899475, [[323, 0.348531, " and", false], [714, 0.111823, " but", false], [1393, 0.062869, " while", false], [1496, 0.038513, " even", false], [537, 0.027169, " not", false], [1576, 0.026478, " because", false], [15484, 0.023397, " regardless", false], [518, 0.020713, " at", false], [438, 0.019853, " as", false], [5310, 0.019235, " especially", false]]]}, "raw_delta": 0.04118067026138306, "tuned_delta": 0.0485178087750858}, {"byte_start": 198, "byte_end": 201, "display": {"text": " by", "kind": "normal"}, "is_word": true, "word_id": 35, "word_key": " by", "bytes_hex": "20 62 79", "compression": {"rwkv": "38.89% 38.89% 38.89%", "qwen": "40.06% 40.06% 40.06%"}, "model_tokens": {"rwkv": [[4450, " by", "normal", 0.001551977009512484]], "qwen": [[553, " by", "normal", 0.0012753555784001946]]}, "loss": {"rwkv": 38.88513977396034, "qwen": 40.06201992019205}, "topk": {"rwkv": [4450, 61, 0.001551977009512484, [[32227, 0.405854, " that", false], [22590, 0.074233, " the", false], [32232, 0.026007, " they", false], [4858, 0.016401, " we", false], [4601, 0.01391, " it", false], [4788, 0.010756, " so", false], [31461, 0.010344, " most", false], [39944, 0.009956, " those", false], [4596, 0.009781, " in", false], [32239, 0.009053, " thus", false]]], "qwen": [553, 73, 0.0012753555784001946, [[429, 0.410987, " that", false], [279, 0.063035, " the", false], [4586, 0.027629, " general", false], [419, 0.023899, " this", false], [304, 0.018764, " in", false], [807, 0.014569, " they", false], [5413, 0.0122, " methods", false], [525, 0.009973, " are", false], [264, 0.009383, " a", false], [1846, 0.008567, " those", false]]]}, "raw_delta": -0.06526009241739894, "tuned_delta": -0.0579229539036962}, {"byte_start": 201, "byte_end": 203, "display": {"text": " a", "kind": "normal"}, "is_word": true, "word_id": 36, "word_key": " a", "bytes_hex": "20 61", "compression": {"rwkv": "24.09% 24.09%", "qwen": "34.47% 34.47%"}, "model_tokens": {"rwkv": [[332, " a", "normal", 0.06823011487722397]], "qwen": [[264, " a", "normal", 0.021862488240003586]]}, "loss": {"rwkv": 24.091880077344992, "qwen": 34.47124158587966}, "topk": {"rwkv": [332, 3, 0.06823011487722397, [[21660, 0.359787, " far", false], [59695, 0.084325, " extension", false], [332, 0.06823, " a", false], [55856, 0.028352, " contrast", false], [22590, 0.026242, " the", false], [21265, 0.024358, " and", false], [63617, 0.024227, " implication", false], [51832, 0.022478, " general", false], [32227, 0.02069, " that", false], [22190, 0.019128, " now", false]]], "qwen": [264, 10, 0.021862488240003586, [[3041, 0.264678, " far", false], [8894, 0.082611, " extension", false], [429, 0.061582, " that", false], [4586, 0.046859, " general", false], [76482, 0.036838, " leveraging", false], [419, 0.034214, " this", false], [44378, 0.027155, " inference", false], [12872, 0.023993, " contrast", false], [323, 0.022239, " and", false], [264, 0.021862, " a", false]]]}, "raw_delta": -0.5755540132522583, "tuned_delta": -0.5682168747385555}, {"byte_start": 203, "byte_end": 209, "display": {"text": " large", "kind": "normal"}, "is_word": true, "word_id": 37, "word_key": " large", "bytes_hex": "20 6c 61 72 67 65", "compression": {"rwkv": "5.05% 5.05% 5.05% 5.05% 5.05% 5.05%", "qwen": "5.14% 5.14% 5.14% 5.14% 5.14% 5.14%"}, "model_tokens": {"rwkv": [[38864, " large", "normal", 0.1883333921432495]], "qwen": [[3460, " large", "normal", 0.18076620995998383]]}, "loss": {"rwkv": 5.04849338852746, "qwen": 5.141256172539397}, "topk": {"rwkv": [38864, 2, 0.1883333921432495, [[32470, 0.381072, " wide", false], [38864, 0.188333, " large", false], [31323, 0.090698, " long", false], [31118, 0.058908, " huge", false], [32386, 0.042384, " very", false], [63870, 0.038671, " significant", false], [22031, 0.025684, " lot", false], [64313, 0.021783, " considerable", false], [63893, 0.019983, " substantial", false], [21357, 0.017218, " big", false]]], "qwen": [3460, 2, 0.18076620995998383, [[6884, 0.310814, " wide", false], [3460, 0.180766, " large", false], [1293, 0.126867, " long", false], [1602, 0.068904, " very", false], [6765, 0.045274, " huge", false], [8168, 0.035746, " factor", false], [5089, 0.029993, " significant", false], [11924, 0.013267, " substantial", false], [4745, 0.012768, " margin", false], [23839, 0.012653, " considerable", false]]]}, "raw_delta": -0.005143860975901249, "tuned_delta": 0.002193277537801488}, {"byte_start": 209, "byte_end": 216, "display": {"text": " margin", "kind": "normal"}, "is_word": true, "word_id": 38, "word_key": " margin", "bytes_hex": "20 6d 61 72 67 69 6e", "compression": {"rwkv": "0.18% 0.18% 0.18% 0.18% 0.18% 0.18% 0.18%", "qwen": "0.44% 0.44% 0.44% 0.44% 0.44% 0.44% 0.44%"}, "model_tokens": {"rwkv": [[46513, " margin", "normal", 0.9319722652435303]], "qwen": [[4745, " margin", "normal", 0.8445775508880615]]}, "loss": {"rwkv": 0.18114195546875936, "qwen": 0.43517526410812457}, "topk": {"rwkv": [46513, 1, 0.9319722652435303, [[46513, 0.931972, " margin", false], [45950, 0.014984, " factor", false], [39189, 0.011322, " order", false], [45157, 0.01066, " amount", false], [45690, 0.005419, " degree", false], [56024, 0.003767, " distance", false], [45865, 0.002853, " enough", false], [61863, 0.002431, " difference", false], [21732, 0.001644, " gap", false], [59977, 0.001481, " magnitude", false]]], "qwen": [4745, 1, 0.8445775508880615, [[4745, 0.844578, " margin", false], [8168, 0.082189, " factor", false], [8381, 0.016987, " degree", false], [3311, 0.01442, " amount", false], [12818, 0.003955, " extent", false], [14501, 0.003616, " stretch", false], [6629, 0.002516, " measure", false], [2990, 0.00228, " lead", false], [198, 0.001796, "\n", false], [323, 0.001686, " and", false]]]}, "raw_delta": -0.01408659773213523, "tuned_delta": -0.006749459218432494}, {"byte_start": 216, "byte_end": 217, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "2.68%", "qwen": "8.42%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.8622329235076904]], "qwen": [[13, ".", "normal", 0.6270043849945068]]}, "loss": {"rwkv": 2.6768755641494435, "qwen": 8.418156274529066}, "topk": {"rwkv": [47, 1, 0.8622329235076904, [[47, 0.862233, ".", false], [45, 0.068679, ",", false], [59, 0.010867, ":", false], [22590, 0.006439, " the", false], [11, 0.006392, "\n", false], [275, 0.005129, " (", false], [60, 0.00486, ";", false], [261, 0.002899, "\n\n", false], [9816, 0.002847, "—", false], [31601, 0.002392, " over", false]]], "qwen": [13, 1, 0.6270043849945068, [[13, 0.627004, ".", false], [624, 0.202733, ".\n", false], [11, 0.082328, ",", false], [320, 0.014542, " (", false], [382, 0.012179, ".\n\n", false], [198, 0.007495, "\n", false], [916, 0.006018, " over", false], [279, 0.004519, " the", false], [25, 0.003771, ":", false], [304, 0.002041, " in", false]]]}, "raw_delta": -0.3183642029762268, "tuned_delta": -0.3110270644625241}, {"byte_start": 217, "byte_end": 221, "display": {"text": " The", "kind": "normal"}, "is_word": true, "word_id": 39, "word_key": " the", "bytes_hex": "20 54 68 65", "compression": {"rwkv": "11.55% 11.55% 11.55% 11.55%", "qwen": "10.77% 10.77% 10.77% 10.77%"}, "model_tokens": {"rwkv": [[20996, " The", "normal", 0.07724101096391678]], "qwen": [[576, " The", "normal", 0.09180492162704468]]}, "loss": {"rwkv": 11.55283138211865, "qwen": 10.766514878566642}, "topk": {"rwkv": [20996, 2, 0.07724101096391678, [[11, 0.245774, "\n", false], [20996, 0.077241, " The", false], [261, 0.076942, "\n\n", false], [29894, 0.057662, " This", false], [3913, 0.031484, " In", false], [19555, 0.02612, " But", false], [29889, 0.025226, " That", false], [3918, 0.019655, " It", false], [37451, 0.014028, " There", false], [3908, 0.011549, " If", false]]], "qwen": [576, 2, 0.09180492162704468, [[1096, 0.102863, " This", false], [576, 0.091805, " The", false], [758, 0.053598, " In", false], [1084, 0.031458, " It", false], [358, 0.028216, " I", false], [2619, 0.027395, " There", false], [1205, 0.024915, " We", false], [1988, 0.020156, " But", false], [2938, 0.018816, " That", false], [1752, 0.018054, " For", false]]]}, "raw_delta": 0.04360264539718628, "tuned_delta": 0.05093978391088902}, {"byte_start": 221, "byte_end": 230, "display": {"text": " ultimate", "kind": "normal"}, "is_word": true, "word_id": 40, "word_key": " ultimate", "bytes_hex": "20 75 6c 74 69 6d 61 74 65", "compression": {"rwkv": "14.21% 14.21% 14.21% 14.21% 14.21% 14.21% 14.21% 14.21% 14.21%", "qwen": "12.07% 12.07% 12.07% 12.07% 12.07% 12.07% 12.07% 12.07% 12.07%"}, "model_tokens": {"rwkv": [[57481, " ultimate", "normal", 0.000839363900013268]], "qwen": [[16724, " ultimate", "normal", 0.0024230415001511574]]}, "loss": {"rwkv": 14.214052703202896, "qwen": 12.068007323696538}, "topk": {"rwkv": [57481, 209, 0.000839363900013268, [[31461, 0.037045, " most", false], [39193, 0.029536, " other", false], [47205, 0.021271, " second", false], [3609, 0.019594, " AI", false], [31581, 0.015879, " only", false], [30273, 0.015863, " best", false], [47009, 0.014167, " reason", false], [38478, 0.011744, " field", false], [51039, 0.011219, " biggest", false], [51929, 0.011215, " history", false]]], "qwen": [16724, 62, 0.0024230415001511574, [[1429, 0.049734, " most", false], [1850, 0.027735, " best", false], [17755, 0.025101, " lesson", false], [2874, 0.023272, " reason", false], [2070, 0.020655, " field", false], [2086, 0.019784, " second", false], [8538, 0.014146, " biggest", false], [1008, 0.013724, " other", false], [18366, 0.012607, " lessons", false], [1172, 0.012375, " only", false]]]}, "raw_delta": 0.11900202433268224, "tuned_delta": 0.12633916284638497}, {"byte_start": 230, "byte_end": 237, "display": {"text": " reason", "kind": "normal"}, "is_word": true, "word_id": 41, "word_key": " reason", "bytes_hex": "20 72 65 61 73 6f 6e", "compression": {"rwkv": "9.98% 9.98% 9.98% 9.98% 9.98% 9.98% 9.98%", "qwen": "10.78% 10.78% 10.78% 10.78% 10.78% 10.78% 10.78%"}, "model_tokens": {"rwkv": [[47009, " reason", "normal", 0.020904244855046272]], "qwen": [[2874, " reason", "normal", 0.015219236724078655]]}, "loss": {"rwkv": 9.98293443472274, "qwen": 10.782071477116876}, "topk": {"rwkv": [47009, 5, 0.020904244855046272, [[46430, 0.160292, " lesson", false], [30985, 0.082412, " goal", false], [32223, 0.032678, " test", false], [53052, 0.028102, " success", false], [47009, 0.020904, " reason", false], [39365, 0.020396, " proof", false], [57009, 0.019322, " question", false], [51668, 0.015807, " example", false], [51708, 0.012401, " failure", false], [3609, 0.012401, " AI", false]]], "qwen": [2874, 8, 0.015219236724078655, [[5795, 0.197554, " goal", false], [17755, 0.12357, " lesson", false], [4586, 0.046748, " general", false], [2393, 0.02311, " success", false], [9213, 0.020597, " aim", false], [3110, 0.016128, " example", false], [11064, 0.015232, " proof", false], [2874, 0.015219, " reason", false], [1273, 0.013686, " test", false], [1714, 0.013036, " method", false]]]}, "raw_delta": -0.044313567025320855, "tuned_delta": -0.036976428511618115}, {"byte_start": 237, "byte_end": 241, "display": {"text": " for", "kind": "normal"}, "is_word": true, "word_id": 42, "word_key": " for", "bytes_hex": "20 66 6f 72", "compression": {"rwkv": "5.74% 5.74% 5.74% 5.74%", "qwen": "3.90% 3.90% 3.90% 3.90%"}, "model_tokens": {"rwkv": [[21700, " for", "normal", 0.28307074308395386]], "qwen": [[369, " for", "normal", 0.4208017885684967]]}, "loss": {"rwkv": 5.741193644162623, "qwen": 3.902460211788234}, "topk": {"rwkv": [21700, 1, 0.28307074308395386, [[21700, 0.283071, " for", false], [32227, 0.246567, " that", false], [22763, 0.126859, " why", false], [4600, 0.066469, " is", false], [4858, 0.051601, " we", false], [4811, 0.039463, " to", false], [3609, 0.032758, " AI", false], [22590, 0.018896, " the", false], [32234, 0.013857, " this", false], [45290, 0.011895, " behind", false]]], "qwen": [369, 1, 0.4208017885684967, [[369, 0.420802, " for", false], [374, 0.30178, " is", false], [429, 0.070091, " that", false], [3170, 0.062996, " why", false], [4815, 0.032831, " behind", false], [419, 0.018419, " this", false], [582, 0.010519, " we", false], [11, 0.010184, ",", false], [1660, 0.004257, " being", false], [30, 0.004198, "?", false]]]}, "raw_delta": 0.10196103155612946, "tuned_delta": 0.1092981700698322}, {"byte_start": 241, "byte_end": 246, "display": {"text": " this", "kind": "normal"}, "is_word": true, "word_id": 43, "word_key": " this", "bytes_hex": "20 74 68 69 73", "compression": {"rwkv": "3.21% 3.21% 3.21% 3.21% 3.21%", "qwen": "0.38% 0.38% 0.38% 0.38% 0.38%"}, "model_tokens": {"rwkv": [[32234, " this", "normal", 0.40920206904411316]], "qwen": [[419, " this", "normal", 0.8994473218917847]]}, "loss": {"rwkv": 3.212250676979332, "qwen": 0.3822233529835437}, "topk": {"rwkv": [32234, 1, 0.40920206904411316, [[32234, 0.409202, " this", false], [22590, 0.27502, " the", false], [32227, 0.073391, " that", false], [3609, 0.039339, " AI", false], [53052, 0.018757, " success", false], [22248, 0.010515, " our", false], [21256, 0.006393, " all", false], [56950, 0.005797, " progress", false], [56768, 0.005666, " optimism", false], [51708, 0.005342, " failure", false]]], "qwen": [419, 1, 0.8994473218917847, [[419, 0.899447, " this", false], [429, 0.043323, " that", false], [279, 0.018447, " the", false], [3170, 0.004849, " why", false], [4586, 0.002428, " general", false], [1039, 0.00165, " our", false], [2393, 0.001436, " success", false], [862, 0.000959, " their", false], [678, 0.000934, " all", false], [1667, 0.000867, " using", false]]]}, "raw_delta": 0.15693003684282303, "tuned_delta": 0.16426717535652577}, {"byte_start": 246, "byte_end": 249, "display": {"text": " is", "kind": "normal"}, "is_word": true, "word_id": 44, "word_key": " is", "bytes_hex": "20 69 73", "compression": {"rwkv": "1.76% 1.76% 1.76%", "qwen": "1.48% 1.48% 1.48%"}, "model_tokens": {"rwkv": [[4600, " is", "normal", 0.7477954626083374]], "qwen": [[374, " is", "normal", 0.7817800045013428]]}, "loss": {"rwkv": 1.7611023448351601, "qwen": 1.4798559807788028}, "topk": {"rwkv": [4600, 1, 0.7477954626083374, [[4600, 0.747795, " is", false], [45, 0.028138, ",", false], [53052, 0.018775, " success", false], [31291, 0.012977, " lies", false], [46430, 0.011119, " lesson", false], [21800, 0.011027, " has", false], [61735, 0.008632, " conclusion", false], [22748, 0.008324, " was", false], [47092, 0.007668, " result", false], [30808, 0.006683, " fact", false]]], "qwen": [374, 1, 0.7817800045013428, [[374, 0.78178, " is", false], [11, 0.022543, ",", false], [15448, 0.01882, " lies", false], [16688, 0.012301, " conclusion", false], [646, 0.009791, " can", false], [702, 0.009129, " has", false], [4977, 0.009058, " seems", false], [21930, 0.008822, " observation", false], [17755, 0.00673, " lesson", false], [1102, 0.006493, " result", false]]]}, "raw_delta": 0.015595609943072006, "tuned_delta": 0.022932748456774742}, {"byte_start": 249, "byte_end": 255, "display": {"text": " Moore", "kind": "normal"}, "is_word": true, "word_id": 45, "word_key": " moore", "bytes_hex": "20 4d 6f 6f 72 65", "compression": {"rwkv": "20.29% 20.29% 20.29% 20.29% 20.29% 20.29%", "qwen": "21.22% 21.22% 21.22% 21.22% 21.22% 21.22%"}, "model_tokens": {"rwkv": [[37045, " Moore", "normal", 0.0011644504265859723]], "qwen": [[20219, " Moore", "normal", 0.0008584775496274233]]}, "loss": {"rwkv": 20.287899012501047, "qwen": 21.22069134830696}, "topk": {"rwkv": [37045, 35, 0.0011644504265859723, [[32227, 0.626016, " that", false], [22590, 0.073757, " the", false], [51018, 0.038919, " because", false], [47284, 0.03383, " simple", false], [22187, 0.017466, " not", false], [47285, 0.015647, " simply", false], [332, 0.015521, " a", false], [45, 0.00764, ",", false], [4706, 0.006208, " of", false], [56937, 0.004935, " probably", false]]], "qwen": [20219, 42, 0.0008584775496274233, [[429, 0.652205, " that", false], [279, 0.065473, " the", false], [1576, 0.041846, " because", false], [4285, 0.032524, " simple", false], [537, 0.023759, " not", false], [4936, 0.023078, " simply", false], [264, 0.008186, " a", false], [54480, 0.007306, " computational", false], [11, 0.004318, ",", false], [4658, 0.003951, " probably", false]]]}, "raw_delta": -0.05172499020894361, "tuned_delta": -0.04438785169524087}, {"byte_start": 255, "byte_end": 257, "display": {"text": "'s", "kind": "normal"}, "is_word": true, "word_id": 46, "word_key": "'s", "bytes_hex": "27 73", "compression": {"rwkv": "7.64% 7.64%", "qwen": "8.29% 8.29%"}, "model_tokens": {"rwkv": [[460, "'s", "normal", 0.4291766285896301]], "qwen": [[594, "'s", "normal", 0.3989563584327698]]}, "loss": {"rwkv": 7.643184176584596, "qwen": 8.285607095725963}, "topk": {"rwkv": [460, 2, 0.4291766285896301, [[28309, 0.560065, "’s", false], [460, 0.429177, "'s", false], [116, 0.006335, "s", false], [45, 0.000687, ",", false], [21265, 0.000549, " and", false], [9819, 0.000341, "‘", false], [47, 0.000247, ".", false], [46, 0.000225, "-", false], [2496, 0.000148, "â", false], [9222, 0.000132, "´s", false]]], "qwen": [594, 2, 0.3989563584327698, [[748, 0.59176, "’s", false], [594, 0.398956, "'s", false], [527, 0.000957, "’", false], [17744, 0.000841, " ’", false], [42641, 0.000839, "‘s", false], [8835, 0.000813, "â", false], [75151, 0.000435, "’", false], [6, 0.000403, "'", false], [7506, 0.000396, " Law", false], [45149, 0.000378, "\u0026apos", false]]]}, "raw_delta": -0.03562349081039429, "tuned_delta": -0.02828635229669155}, {"byte_start": 257, "byte_end": 261, "display": {"text": " law", "kind": "normal"}, "is_word": true, "word_id": 47, "word_key": " law", "bytes_hex": "20 6c 61 77", "compression": {"rwkv": "4.79% 4.79% 4.79% 4.79%", "qwen": "3.23% 3.23% 3.23% 3.23%"}, "model_tokens": {"rwkv": [[21988, " law", "normal", 0.34627750515937805]], "qwen": [[2329, " law", "normal", 0.4886452555656433]]}, "loss": {"rwkv": 4.7901983779516355, "qwen": 3.228564198816081}, "topk": {"rwkv": [21988, 2, 0.34627750515937805, [[20267, 0.6498, " Law", false], [21988, 0.346278, " law", false], [29262, 0.000347, " Laws", false], [21265, 0.000294, " and", false], [275, 0.000252, " (", false], [31259, 0.000249, " laws", false], [45958, 0.000248, " famous", false], [31907, 0.000135, " rule", false], [53127, 0.000131, " theorem", false], [47205, 0.000112, " second", false]]], "qwen": [2329, 2, 0.4886452555656433, [[7506, 0.505915, " Law", false], [2329, 0.488645, " law", false], [40989, 0.000736, " Laws", false], [198, 0.000675, "\n", false], [220, 0.000285, " ", false], [6872, 0.000245, " laws", false], [576, 0.000243, " The", false], [19915, 0.000168, "law", false], [323, 0.000159, " and", false], [57817, 0.000148, " theorem", false]]]}, "raw_delta": 0.08659538626670837, "tuned_delta": 0.09393252478041111}, {"byte_start": 261, "byte_end": 262, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "13.95%", "qwen": "17.39%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.4582744836807251]], "qwen": [[11, ",", "normal", 0.3811791241168976]]}, "loss": {"rwkv": 13.947930571094469, "qwen": 17.393237517997758}, "topk": {"rwkv": [45, 1, 0.4582744836807251, [[45, 0.458274, ",", false], [59, 0.193715, ":", false], [47, 0.150074, ".", false], [21265, 0.033727, " and", false], [275, 0.02117, " (", false], [9816, 0.019646, "—", false], [60, 0.01641, ";", false], [280, 0.015889, " -", false], [22898, 0.010803, " —", false], [43274, 0.010374, "—the", false]]], "qwen": [11, 1, 0.3811791241168976, [[11, 0.381179, ",", false], [25, 0.18403, ":", false], [13, 0.177942, ".", false], [323, 0.043685, " and", false], [624, 0.030055, ".\n", false], [26, 0.021415, ";", false], [481, 0.018391, " -", false], [1959, 0.016107, " —", false], [320, 0.014172, " (", false], [1177, 0.012551, " --", false]]]}, "raw_delta": -0.19104838371276855, "tuned_delta": -0.18371124519906581}, {"byte_start": 262, "byte_end": 265, "display": {"text": " or", "kind": "normal"}, "is_word": true, "word_id": 48, "word_key": " or", "bytes_hex": "20 6f 72", "compression": {"rwkv": "28.37% 28.37% 28.37%", "qwen": "26.33% 26.33% 26.33%"}, "model_tokens": {"rwkv": [[4715, " or", "normal", 0.009043858386576176]], "qwen": [[476, " or", "normal", 0.012534013018012047]]}, "loss": {"rwkv": 28.365488434144982, "qwen": 26.325031803135847}, "topk": {"rwkv": [4715, 7, 0.009043858386576176, [[40186, 0.607009, " which", false], [21400, 0.103849, " but", false], [21265, 0.070827, " and", false], [22590, 0.061795, " the", false], [332, 0.017519, " a", false], [32227, 0.01241, " that", false], [4715, 0.009044, " or", false], [4596, 0.008774, " in", false], [340, 0.007927, " i", false], [40185, 0.007017, " where", false]]], "qwen": [476, 8, 0.012534013018012047, [[892, 0.639171, " which", false], [279, 0.084171, " the", false], [323, 0.051258, " and", false], [714, 0.029083, " but", false], [429, 0.024328, " that", false], [264, 0.018037, " a", false], [438, 0.014398, " as", false], [476, 0.012534, " or", false], [304, 0.011276, " in", false], [600, 0.007726, " i", false]]]}, "raw_delta": 0.1131469408671062, "tuned_delta": 0.12048407938080893}, {"byte_start": 265, "byte_end": 272, "display": {"text": " rather", "kind": "normal"}, "is_word": true, "word_id": 49, "word_key": " rather", "bytes_hex": "20 72 61 74 68 65 72", "compression": {"rwkv": "5.72% 5.72% 5.72% 5.72% 5.72% 5.72% 5.72%", "qwen": "5.90% 5.90% 5.90% 5.90% 5.90% 5.90% 5.90%"}, "model_tokens": {"rwkv": [[47001, " rather", "normal", 0.10823953151702881]], "qwen": [[4751, " rather", "normal", 0.10114416480064392]]}, "loss": {"rwkv": 5.716035039236404, "qwen": 5.902705008482897}, "topk": {"rwkv": [47001, 4, 0.10823953151702881, [[22590, 0.226861, " the", false], [31458, 0.1827, " more", false], [4424, 0.113157, " at", false], [47001, 0.10824, " rather", false], [45, 0.042783, ",", false], [4596, 0.029902, " in", false], [332, 0.015563, " a", false], [52448, 0.015363, " perhaps", false], [32074, 0.01319, " some", false], [32227, 0.012687, " that", false]]], "qwen": [4751, 3, 0.10114416480064392, [[279, 0.211004, " the", false], [803, 0.133768, " more", false], [4751, 0.101144, " rather", false], [518, 0.099381, " at", false], [304, 0.062929, " in", false], [11, 0.049104, ",", false], [438, 0.029579, " as", false], [894, 0.023234, " any", false], [4936, 0.020661, " simply", false], [311, 0.016255, " to", false]]]}, "raw_delta": -0.010351181030273438, "tuned_delta": -0.003014042516570701}, {"byte_start": 272, "byte_end": 276, "display": {"text": " its", "kind": "normal"}, "is_word": true, "word_id": 50, "word_key": " its", "bytes_hex": "20 69 74 73", "compression": {"rwkv": "10.00% 10.00% 10.00% 10.00%", "qwen": "14.29% 14.29% 14.29% 14.29%"}, "model_tokens": {"rwkv": [[21902, " its", "normal", 0.10679490864276886]], "qwen": [[1181, " its", "normal", 0.041973281651735306]]}, "loss": {"rwkv": 10.00306131866371, "qwen": 14.294952864439173}, "topk": {"rwkv": [21902, 3, 0.10679490864276886, [[22590, 0.329043, " the", false], [45, 0.287878, ",", false], [21902, 0.106795, " its", false], [332, 0.046495, " a", false], [32227, 0.04548, " that", false], [37045, 0.02159, " Moore", false], [21835, 0.013469, " how", false], [31458, 0.010141, " more", false], [32464, 0.008609, " what", false], [4419, 0.007035, " an", false]]], "qwen": [1181, 3, 0.041973281651735306, [[11, 0.411784, ",", false], [279, 0.324031, " the", false], [1181, 0.041973, " its", false], [264, 0.025174, " a", false], [429, 0.020966, " that", false], [20219, 0.015413, " Moore", false], [458, 0.008091, " an", false], [25, 0.007787, ":", false], [1128, 0.007512, " what", false], [1039, 0.007394, " our", false]]]}, "raw_delta": -0.2379930019378662, "tuned_delta": -0.23065586342416347}, {"byte_start": 276, "byte_end": 291, "display": {"text": " generalization", "kind": "normal"}, "is_word": true, "word_id": 51, "word_key": " generalization", "bytes_hex": "20 67 65 6e 65 72 61 6c 69 7a 61 74 69 6f 6e", "compression": {"rwkv": "6.99% 6.99% 6.99% 6.99% 6.99% 6.99% 6.99% 6.99% 6.99% 6.99% 6.99% 6.99% 6.99% 6.99% 6.99%", "qwen": "10.66% 10.66% 10.66% 10.66% 10.66% 10.66% 10.66% 10.66% 0.43% 0.43% 0.43% 0.43% 0.43% 0.43% 0.43%"}, "model_tokens": {"rwkv": [[65135, " generalization", "normal", 0.0029486077837646008]], "qwen": [[4586, " general", "normal", 0.008826144970953465], [2022, "ization", "normal", 0.8470881581306458]]}, "loss": {"rwkv": 6.988054104305918, "qwen": 5.886180447042385}, "topk": {"rwkv": [65135, 57, 0.0029486077837646008, [[21458, 0.051642, " cor", false], [52046, 0.038359, " inverse", false], [60588, 0.034426, " successor", false], [45606, 0.028142, " cousin", false], [45828, 0.025015, " effect", false], [63774, 0.019086, " predecessor", false], [63563, 0.018661, " exponential", false], [61841, 0.014703, " derivative", false], [31458, 0.014301, " more", false], [63454, 0.012307, " derivatives", false]]], "qwen": [4586, 20, 0.008826144970953465, [[1829, 0.076741, " cor", false], [9931, 0.057388, " reverse", false], [27949, 0.054086, " inverse", false], [33565, 0.046774, " successor", false], [14002, 0.029152, " opposite", false], [13578, 0.021762, " equivalent", false], [94240, 0.0146, " converse", false], [31805, 0.014345, " derivative", false], [3265, 0.014272, " close", false], [27397, 0.013097, " twin", false]]]}, "raw_delta": 0.061100849509239184, "tuned_delta": 0.06843798802294192}, {"byte_start": 291, "byte_end": 294, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 52, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "31.37% 31.37% 31.37%", "qwen": "37.00% 37.00% 37.00%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.005440823268145323]], "qwen": [[315, " of", "normal", 0.0021232785657048225]]}, "loss": {"rwkv": 31.371103102663653, "qwen": 36.99787668920725}, "topk": {"rwkv": [4706, 18, 0.005440823268145323, [[45, 0.225717, ",", false], [4811, 0.188418, " to", false], [116, 0.142579, "s", false], [59, 0.102158, ":", false], [47, 0.076374, ".", false], [32227, 0.066178, " that", false], [37045, 0.014779, " Moore", false], [4596, 0.012062, " in", false], [30917, 0.010933, " from", false], [31162, 0.010568, " into", false]]], "qwen": [315, 30, 0.0021232785657048225, [[11, 0.267544, ",", false], [25, 0.208771, ":", false], [311, 0.197383, " to", false], [13, 0.064783, ".", false], [429, 0.057587, " that", false], [481, 0.015406, " -", false], [892, 0.011045, " which", false], [624, 0.010519, ".\n", false], [320, 0.009481, " (", false], [369, 0.009388, " for", false]]]}, "raw_delta": -0.31201457977294944, "tuned_delta": -0.30467744125924673}, {"byte_start": 294, "byte_end": 304, "display": {"text": " continued", "kind": "normal"}, "is_word": true, "word_id": 53, "word_key": " continued", "bytes_hex": "20 63 6f 6e 74 69 6e 75 65 64", "compression": {"rwkv": "11.83% 11.83% 11.83% 11.83% 11.83% 11.83% 11.83% 11.83% 11.83% 11.83%", "qwen": "12.88% 12.88% 12.88% 12.88% 12.88% 12.88% 12.88% 12.88% 12.88% 12.88%"}, "model_tokens": {"rwkv": [[59392, " continued", "normal", 0.0013883133651688695]], "qwen": [[8570, " continued", "normal", 0.0007931358413770795]]}, "loss": {"rwkv": 11.834607757292277, "qwen": 12.875180187205157}, "topk": {"rwkv": [59392, 68, 0.0013883133651688695, [[22590, 0.203434, " the", false], [37045, 0.118493, " Moore", false], [269, 0.041593, " \"", false], [63563, 0.040099, " exponential", false], [332, 0.029872, " a", false], [32227, 0.029791, " that", false], [32234, 0.021437, " this", false], [52805, 0.013601, " scaling", false], [4601, 0.010948, " it", false], [62092, 0.01008, " increasing", false]]], "qwen": [8570, 110, 0.0007931358413770795, [[279, 0.276562, " the", false], [330, 0.038808, " \"", false], [20219, 0.037563, " Moore", false], [1036, 0.017845, " “", false], [429, 0.017202, " that", false], [71161, 0.014851, " Denn", false], [1128, 0.014283, " what", false], [58755, 0.013923, " exponential", false], [1246, 0.011885, " how", false], [24231, 0.011763, " computing", false]]]}, "raw_delta": -0.05770158767700195, "tuned_delta": -0.05036444916329921}, {"byte_start": 304, "byte_end": 318, "display": {"text": " exponentially", "kind": "normal"}, "is_word": true, "word_id": 54, "word_key": " exponentially", "bytes_hex": "20 65 78 70 6f 6e 65 6e 74 69 61 6c 6c 79", "compression": {"rwkv": "8.53% 8.53% 8.53% 8.53% 8.53% 8.53% 8.53% 8.53% 8.53% 8.53% 8.53% 8.53% 8.53% 8.53%", "qwen": "7.29% 7.29% 7.29% 7.29% 7.29% 7.29% 7.29% 7.29% 7.29% 7.29% 7.29% 7.29% 7.29% 7.29%"}, "model_tokens": {"rwkv": [[64911, " exponentially", "normal", 0.00134140660520643]], "qwen": [[74151, " exponentially", "normal", 0.003478133585304022]]}, "loss": {"rwkv": 8.53379879097266, "qwen": 7.292385021382192}, "topk": {"rwkv": [64911, 41, 0.00134140660520643, [[63563, 0.533892, " exponential", false], [64423, 0.053977, " improvements", false], [46132, 0.049292, " growth", false], [63621, 0.041512, " improvement", false], [56950, 0.025725, " progress", false], [59847, 0.019737, " increases", false], [56045, 0.015297, " doubling", false], [52805, 0.014461, " scaling", false], [45, 0.012211, ",", false], [62329, 0.011885, " polynomial", false]]], "qwen": [74151, 35, 0.003478133585304022, [[58755, 0.241755, " exponential", false], [29016, 0.077583, " technological", false], [15673, 0.073068, " improvement", false], [5098, 0.061303, " progress", false], [18142, 0.050694, " improvements", false], [12703, 0.032734, " increases", false], [26943, 0.02385, " scaling", false], [6513, 0.023342, " growth", false], [5263, 0.022613, " increase", false], [54480, 0.017393, " computational", false]]]}, "raw_delta": 0.06883859634399414, "tuned_delta": 0.07617573485769688}, {"byte_start": 318, "byte_end": 326, "display": {"text": " falling", "kind": "normal"}, "is_word": true, "word_id": 55, "word_key": " falling", "bytes_hex": "20 66 61 6c 6c 69 6e 67", "compression": {"rwkv": "11.83% 11.83% 11.83% 11.83% 11.83% 11.83% 11.83% 11.83%", "qwen": "16.79% 16.79% 16.79% 16.79% 16.79% 16.79% 16.79% 16.79%"}, "model_tokens": {"rwkv": [[51709, " falling", "normal", 0.00530181173235178]], "qwen": [[15679, " falling", "normal", 0.0005811915034428239]]}, "loss": {"rwkv": 11.834607757292277, "qwen": 16.79484215747727}, "topk": {"rwkv": [51709, 18, 0.00530181173235178, [[62092, 0.382384, " increasing", false], [46, 0.11616, "-", false], [51876, 0.09648, " growing", false], [61816, 0.07686, " decreasing", false], [45961, 0.035576, " faster", false], [64230, 0.02689, " accelerating", false], [59832, 0.025235, " improving", false], [47122, 0.022956, " rising", false], [46132, 0.020613, " growth", false], [52805, 0.016428, " scaling", false]]], "qwen": [15679, 81, 0.0005811915034428239, [[7703, 0.346143, " increasing", false], [18392, 0.14817, " improving", false], [68641, 0.054102, " accelerating", false], [7826, 0.047504, " growing", false], [10596, 0.044581, " faster", false], [43549, 0.021275, " decreasing", false], [4937, 0.01972, " fast", false], [2664, 0.016937, " better", false], [16062, 0.016582, " rising", false], [11048, 0.015995, " rapid", false]]]}, "raw_delta": -0.27505379915237427, "tuned_delta": -0.26771666063867156}, {"byte_start": 326, "byte_end": 331, "display": {"text": " cost", "kind": "normal"}, "is_word": true, "word_id": 56, "word_key": " cost", "bytes_hex": "20 63 6f 73 74", "compression": {"rwkv": "8.06% 8.06% 8.06% 8.06% 8.06%", "qwen": "8.69% 8.69% 8.69% 8.69% 8.69%"}, "model_tokens": {"rwkv": [[30510, " cost", "normal", 0.10696844011545181]], "qwen": [[2783, " cost", "normal", 0.08987583220005035]]}, "loss": {"rwkv": 8.058804329965694, "qwen": 8.689806956154829}, "topk": {"rwkv": [30510, 2, 0.10696844011545181, [[38124, 0.47967, " costs", false], [30510, 0.106968, " cost", false], [45860, 0.039326, " energy", false], [56353, 0.033381, " hardware", false], [46900, 0.029881, " prices", false], [62659, 0.019805, " transistor", false], [39339, 0.018366, " power", false], [22278, 0.016944, " per", false], [32343, 0.015495, " unit", false], [30442, 0.015334, " chip", false]]], "qwen": [2783, 3, 0.08987583220005035, [[7049, 0.392977, " costs", false], [7576, 0.101625, " prices", false], [2783, 0.089876, " cost", false], [817, 0.047729, " per", false], [54480, 0.031836, " computational", false], [11773, 0.027092, " hardware", false], [34447, 0.025031, " computation", false], [24231, 0.023069, " computing", false], [304, 0.013094, " in", false], [4982, 0.012892, " unit", false]]]}, "raw_delta": -0.03499021530151364, "tuned_delta": -0.027653076787810902}, {"byte_start": 331, "byte_end": 335, "display": {"text": " per", "kind": "normal"}, "is_word": true, "word_id": 57, "word_key": " per", "bytes_hex": "20 70 65 72", "compression": {"rwkv": "3.65% 3.65% 3.65% 3.65%", "qwen": "9.24% 9.24% 9.24% 9.24%"}, "model_tokens": {"rwkv": [[22278, " per", "normal", 0.4464338421821594]], "qwen": [[817, " per", "normal", 0.12882518768310547]]}, "loss": {"rwkv": 3.6454818538087816, "qwen": 9.239104709507004}, "topk": {"rwkv": [22278, 1, 0.4464338421821594, [[22278, 0.446434, " per", false], [4706, 0.112915, " of", false], [47, 0.099172, ".", false], [45, 0.0543, ",", false], [21700, 0.048796, " for", false], [46, 0.025555, "-", false], [21265, 0.025132, " and", false], [45644, 0.024696, " curves", false], [4811, 0.020444, " to", false], [48, 0.018441, "/", false]]], "qwen": [817, 2, 0.12882518768310547, [[315, 0.442599, " of", false], [817, 0.128825, " per", false], [13, 0.073923, ".", false], [323, 0.053048, " and", false], [369, 0.040947, " for", false], [11, 0.03493, ",", false], [304, 0.031386, " in", false], [624, 0.021357, ".\n", false], [311, 0.016775, " to", false], [448, 0.014182, " with", false]]]}, "raw_delta": -0.3101763129234314, "tuned_delta": -0.3028391744097287}, {"byte_start": 335, "byte_end": 340, "display": {"text": " unit", "kind": "normal"}, "is_word": true, "word_id": 58, "word_key": " unit", "bytes_hex": "20 75 6e 69 74", "compression": {"rwkv": "4.20% 4.20% 4.20% 4.20% 4.20%", "qwen": "5.21% 5.21% 5.21% 5.21% 5.21%"}, "model_tokens": {"rwkv": [[32343, " unit", "normal", 0.3136623799800873]], "qwen": [[4982, " unit", "normal", 0.23570650815963745]]}, "loss": {"rwkv": 4.198467990087022, "qwen": 5.212341403323332}, "topk": {"rwkv": [32343, 1, 0.3136623799800873, [[32343, 0.313662, " unit", false], [62659, 0.095338, " transistor", false], [63370, 0.093032, " computation", false], [21365, 0.059525, " bit", false], [3806, 0.043206, " FL", false], [64862, 0.0369, " computational", false], [60096, 0.036174, " operation", false], [59346, 0.026212, " computing", false], [51266, 0.021544, " compute", false], [63750, 0.01747, " performance", false]]], "qwen": [4982, 1, 0.23570650815963745, [[4982, 0.235707, " unit", false], [2699, 0.213193, " bit", false], [34447, 0.047026, " computation", false], [97941, 0.026785, " transistor", false], [54480, 0.023907, " computational", false], [5068, 0.020639, " performance", false], [5666, 0.017223, " operation", false], [24231, 0.016224, " computing", false], [22302, 0.01419, " capability", false], [8692, 0.013948, " processing", false]]]}, "raw_delta": -0.05622107982635496, "tuned_delta": -0.048883941312652224}, {"byte_start": 340, "byte_end": 343, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 59, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "3.15% 3.15% 3.15%", "qwen": "1.60% 1.60% 1.60%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.590901792049408]], "qwen": [[315, " of", "normal", 0.766579270362854]]}, "loss": {"rwkv": 3.146502856105486, "qwen": 1.5978879427888404}, "topk": {"rwkv": [4706, 1, 0.590901792049408, [[4706, 0.590902, " of", false], [47, 0.089568, ".", false], [32251, 0.064605, " time", false], [45, 0.037328, ",", false], [63370, 0.031465, " computation", false], [59346, 0.01104, " computing", false], [63750, 0.009916, " performance", false], [275, 0.007623, " (", false], [55686, 0.007393, " capacity", false], [64862, 0.00677, " computational", false]]], "qwen": [315, 1, 0.766579270362854, [[315, 0.766579, " of", false], [13, 0.030388, ".", false], [34447, 0.024931, " computation", false], [11, 0.01643, ",", false], [8692, 0.010762, " processing", false], [304, 0.010713, " in", false], [624, 0.007539, ".\n", false], [5666, 0.007468, " operation", false], [5068, 0.005944, " performance", false], [24231, 0.00588, " computing", false]]]}, "raw_delta": 0.08587344487508138, "tuned_delta": 0.09321058338878412}, {"byte_start": 343, "byte_end": 355, "display": {"text": " computation", "kind": "normal"}, "is_word": true, "word_id": 60, "word_key": " computation", "bytes_hex": "20 63 6f 6d 70 75 74 61 74 69 6f 6e", "compression": {"rwkv": "1.63% 1.63% 1.63% 1.63% 1.63% 1.63% 1.63% 1.63% 1.63% 1.63% 1.63% 1.63%", "qwen": "1.75% 1.75% 1.75% 1.75% 1.75% 1.75% 1.75% 1.75% 1.75% 1.75% 1.75% 1.75%"}, "model_tokens": {"rwkv": [[63370, " computation", "normal", 0.3352624475955963]], "qwen": [[34447, " computation", "normal", 0.31194689869880676]]}, "loss": {"rwkv": 1.631954839547248, "qwen": 1.750653682200866}, "topk": {"rwkv": [63370, 1, 0.3352624475955963, [[63370, 0.335262, " computation", false], [59346, 0.173968, " computing", false], [51266, 0.081661, " compute", false], [64862, 0.0574, " computational", false], [63750, 0.043529, " performance", false], [62378, 0.035916, " processing", false], [39339, 0.019597, " power", false], [63637, 0.017141, " information", false], [55686, 0.015188, " capacity", false], [61654, 0.013926, " capability", false]]], "qwen": [34447, 1, 0.31194689869880676, [[34447, 0.311947, " computation", false], [24231, 0.198532, " computing", false], [8692, 0.090849, " processing", false], [54480, 0.064271, " computational", false], [5068, 0.040201, " performance", false], [11773, 0.022831, " hardware", false], [6366, 0.01754, " computer", false], [882, 0.015558, " time", false], [12564, 0.013179, " compute", false], [1995, 0.011198, " information", false]]]}, "raw_delta": -0.006582061449686677, "tuned_delta": 0.0007550770640160596}, {"byte_start": 355, "byte_end": 356, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "9.51%", "qwen": "12.53%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.5903587937355042]], "qwen": [[13, ".", "normal", 0.4991952180862427]]}, "loss": {"rwkv": 9.509952662109866, "qwen": 12.529050053861804}, "topk": {"rwkv": [47, 1, 0.5903587937355042, [[47, 0.590359, ".", false], [45, 0.158084, ",", false], [275, 0.035531, " (", false], [31601, 0.029962, " over", false], [21265, 0.021302, " and", false], [59, 0.019519, ":", false], [39339, 0.013583, " power", false], [4811, 0.011429, " to", false], [4423, 0.008042, " as", false], [60, 0.007502, ";", false]]], "qwen": [13, 1, 0.4991952180862427, [[13, 0.499195, ".", false], [624, 0.12854, ".\n", false], [11, 0.104222, ",", false], [320, 0.03919, " (", false], [25, 0.023488, ":", false], [323, 0.020868, " and", false], [2355, 0.01891, " power", false], [311, 0.014753, " to", false], [429, 0.010954, " that", false], [304, 0.008801, " in", false]]]}, "raw_delta": -0.16741430759429932, "tuned_delta": -0.16007716908059658}, {"byte_start": 356, "byte_end": 361, "display": {"text": " Most", "kind": "normal"}, "is_word": true, "word_id": 61, "word_key": " most", "bytes_hex": "20 4d 6f 73 74", "compression": {"rwkv": "21.75% 21.75% 21.75% 21.75% 21.75%", "qwen": "19.99% 19.99% 19.99% 19.99% 19.99%"}, "model_tokens": {"rwkv": [[29425, " Most", "normal", 0.002402838319540024]], "qwen": [[7496, " Most", "normal", 0.003920088987797499]]}, "loss": {"rwkv": 21.7531361634039, "qwen": 19.98724410174221}, "topk": {"rwkv": [29425, 50, 0.002402838319540024, [[11, 0.156923, "\n", false], [20996, 0.102468, " The", false], [29894, 0.092229, " This", false], [261, 0.051479, "\n\n", false], [19555, 0.037603, " But", false], [3913, 0.034827, " In", false], [37045, 0.03449, " Moore", false], [3918, 0.026954, " It", false], [3641, 0.025934, " As", false], [3908, 0.023031, " If", false]]], "qwen": [7496, 44, 0.003920088987797499, [[1096, 0.116306, " This", false], [576, 0.11264, " The", false], [758, 0.047365, " In", false], [1084, 0.041821, " It", false], [1634, 0.034852, " As", false], [1416, 0.023749, " If", false], [1752, 0.019009, " For", false], [1205, 0.018853, " We", false], [2619, 0.018818, " There", false], [1988, 0.016239, " But", false]]]}, "raw_delta": 0.09792184829711914, "tuned_delta": 0.10525898681082188}, {"byte_start": 361, "byte_end": 364, "display": {"text": " AI", "kind": "normal"}, "is_word": true, "word_id": 62, "word_key": " ai", "bytes_hex": "20 41 49", "compression": {"rwkv": "13.06% 13.06% 13.06%", "qwen": "13.88% 13.88% 13.88%"}, "model_tokens": {"rwkv": [[3609, " AI", "normal", 0.11309946328401566]], "qwen": [[15235, " AI", "normal", 0.0993504747748375]]}, "loss": {"rwkv": 13.055638716377988, "qwen": 13.880539169353877}, "topk": {"rwkv": [3609, 2, 0.11309946328401566, [[4706, 0.300896, " of", false], [3609, 0.113099, " AI", false], [46787, 0.065684, " people", false], [39193, 0.040574, " other", false], [52224, 0.027826, " methods", false], [57103, 0.022186, " research", false], [63843, 0.010703, " researchers", false], [52167, 0.010206, " machine", false], [63619, 0.008297, " importantly", false], [46588, 0.008013, " modern", false]]], "qwen": [15235, 2, 0.0993504747748375, [[315, 0.255866, " of", false], [15235, 0.09935, " AI", false], [5413, 0.047656, " methods", false], [1008, 0.034763, " other", false], [25185, 0.032398, " algorithms", false], [5662, 0.026303, " machine", false], [4586, 0.025553, " general", false], [3412, 0.024496, " research", false], [1251, 0.021594, " people", false], [5322, 0.020916, " problems", false]]]}, "raw_delta": -0.04574219385782874, "tuned_delta": -0.038405055344126}, {"byte_start": 364, "byte_end": 373, "display": {"text": " research", "kind": "normal"}, "is_word": true, "word_id": 63, "word_key": " research", "bytes_hex": "20 72 65 73 65 61 72 63 68", "compression": {"rwkv": "2.88% 2.88% 2.88% 2.88% 2.88% 2.88% 2.88% 2.88% 2.88%", "qwen": "3.05% 3.05% 3.05% 3.05% 3.05% 3.05% 3.05% 3.05% 3.05%"}, "model_tokens": {"rwkv": [[57103, " research", "normal", 0.23477506637573242]], "qwen": [[3412, " research", "normal", 0.21799854934215546]]}, "loss": {"rwkv": 2.880380723997062, "qwen": 3.0522353433308953}, "topk": {"rwkv": [57103, 1, 0.23477506637573242, [[57103, 0.234775, " research", false], [63843, 0.205854, " researchers", false], [52224, 0.076775, " methods", false], [53087, 0.062929, " systems", false], [62633, 0.028286, " techniques", false], [32499, 0.025006, " work", false], [56950, 0.020673, " progress", false], [64251, 0.018293, " applications", false], [61559, 0.014075, " algorithms", false], [4600, 0.014028, " is", false]]], "qwen": [3412, 1, 0.21799854934215546, [[3412, 0.217999, " research", false], [11811, 0.166973, " researchers", false], [5413, 0.156672, " methods", false], [25185, 0.064499, " algorithms", false], [12538, 0.055351, " techniques", false], [19827, 0.037726, " approaches", false], [5942, 0.036706, " systems", false], [5322, 0.027952, " problems", false], [8357, 0.013111, " applications", false], [374, 0.012034, " is", false]]]}, "raw_delta": -0.009529643588595926, "tuned_delta": -0.0021925050748931897}, {"byte_start": 373, "byte_end": 377, "display": {"text": " has", "kind": "normal"}, "is_word": true, "word_id": 64, "word_key": " has", "bytes_hex": "20 68 61 73", "compression": {"rwkv": "7.26% 7.26% 7.26% 7.26%", "qwen": "7.36% 7.36% 7.36% 7.36%"}, "model_tokens": {"rwkv": [[21800, " has", "normal", 0.19905588030815125]], "qwen": [[702, " has", "normal", 0.19522716104984283]]}, "loss": {"rwkv": 7.25574166072086, "qwen": 7.364920009609059}, "topk": {"rwkv": [21800, 1, 0.19905588030815125, [[21800, 0.199056, " has", false], [4600, 0.110434, " is", false], [45, 0.048918, ",", false], [4596, 0.04218, " in", false], [39971, 0.037385, " today", false], [31601, 0.02671, " over", false], [32227, 0.026028, " that", false], [56952, 0.024967, " projects", false], [51566, 0.020464, " efforts", false], [39690, 0.015216, " since", false]]], "qwen": [702, 1, 0.19522716104984283, [[702, 0.195227, " has", false], [374, 0.139316, " is", false], [3351, 0.06346, " today", false], [304, 0.046102, " in", false], [11, 0.03967, ",", false], [916, 0.022977, " over", false], [23497, 0.017717, " focuses", false], [429, 0.016171, " that", false], [15689, 0.014485, " papers", false], [323, 0.014132, " and", false]]]}, "raw_delta": -0.006054133176803589, "tuned_delta": 0.0012830053368991477}, {"byte_start": 377, "byte_end": 382, "display": {"text": " been", "kind": "normal"}, "is_word": true, "word_id": 65, "word_key": " been", "bytes_hex": "20 62 65 65 6e", "compression": {"rwkv": "4.03% 4.03% 4.03% 4.03% 4.03%", "qwen": "4.25% 4.25% 4.25% 4.25% 4.25%"}, "model_tokens": {"rwkv": [[30259, " been", "normal", 0.3273267447948456]], "qwen": [[1012, " been", "normal", 0.30757519602775574]]}, "loss": {"rwkv": 4.029402164982847, "qwen": 4.252472262284453}, "topk": {"rwkv": [30259, 1, 0.3273267447948456, [[30259, 0.327327, " been", false], [51770, 0.165536, " focused", false], [45953, 0.023937, " failed", false], [22187, 0.019842, " not", false], [40013, 0.018844, " tried", false], [39887, 0.017652, " taken", false], [56255, 0.014978, " followed", false], [64300, 0.012869, " concentrated", false], [51960, 0.010051, " ignored", false], [56500, 0.009962, " involved", false]]], "qwen": [1012, 1, 0.30757519602775574, [[1012, 0.307575, " been", false], [10735, 0.185736, " focused", false], [8110, 0.022109, " followed", false], [37526, 0.018622, " concentrated", false], [537, 0.016617, " not", false], [4429, 0.015635, " taken", false], [6679, 0.014515, " tried", false], [7391, 0.009086, " spent", false], [1030, 0.008749, " had", false], [264, 0.008633, " a", false]]]}, "raw_delta": -0.012369632720947266, "tuned_delta": -0.005032494207244529}, {"byte_start": 382, "byte_end": 392, "display": {"text": " conducted", "kind": "normal"}, "is_word": true, "word_id": 66, "word_key": " conducted", "bytes_hex": "20 63 6f 6e 64 75 63 74 65 64", "compression": {"rwkv": "6.93% 6.93% 6.93% 6.93% 6.93% 6.93% 6.93% 6.93% 6.93% 6.93%", "qwen": "7.16% 7.16% 7.16% 7.16% 7.16% 7.16% 7.16% 7.16% 7.16% 7.16%"}, "model_tokens": {"rwkv": [[59355, " conducted", "normal", 0.021404659375548363]], "qwen": [[13075, " conducted", "normal", 0.01887700892984867]]}, "loss": {"rwkv": 6.93169882927119, "qwen": 7.159032376487684}, "topk": {"rwkv": [59355, 10, 0.021404659375548363, [[51770, 0.113657, " focused", false], [30666, 0.059338, " done", false], [45796, 0.034895, " driven", false], [51459, 0.032573, " devoted", false], [4712, 0.032464, " on", false], [37810, 0.031082, " based", false], [37598, 0.028814, " about", false], [4596, 0.026769, " in", false], [332, 0.025411, " a", false], [59355, 0.021405, " conducted", false]]], "qwen": [13075, 9, 0.01887700892984867, [[10735, 0.150755, " focused", false], [28229, 0.042238, " devoted", false], [304, 0.040494, " in", false], [911, 0.038982, " about", false], [16227, 0.037951, " driven", false], [3118, 0.033625, " based", false], [2814, 0.030086, " done", false], [264, 0.019769, " a", false], [13075, 0.018877, " conducted", false], [389, 0.018383, " on", false]]]}, "raw_delta": -0.012606048583984342, "tuned_delta": -0.005268910070281605}, {"byte_start": 392, "byte_end": 395, "display": {"text": " as", "kind": "normal"}, "is_word": true, "word_id": 67, "word_key": " as", "bytes_hex": "20 61 73", "compression": {"rwkv": "32.12% 32.12% 32.12%", "qwen": "28.91% 28.91% 28.91%"}, "model_tokens": {"rwkv": [[4423, " as", "normal", 0.004767954349517822]], "qwen": [[438, " as", "normal", 0.008154122158885002]]}, "loss": {"rwkv": 32.122506769793326, "qwen": 28.909395033008668}, "topk": {"rwkv": [4423, 16, 0.004767954349517822, [[4712, 0.228413, " on", false], [4596, 0.221283, " in", false], [32487, 0.113329, " with", false], [40085, 0.09213, " using", false], [4450, 0.080245, " by", false], [47806, 0.044567, " within", false], [4424, 0.030896, " at", false], [40062, 0.030419, " under", false], [31601, 0.014079, " over", false], [4811, 0.010426, " to", false]]], "qwen": [438, 16, 0.008154122158885002, [[304, 0.233193, " in", false], [389, 0.124188, " on", false], [553, 0.121443, " by", false], [448, 0.089342, " with", false], [1212, 0.067534, " under", false], [2878, 0.056427, " within", false], [1667, 0.0494, " using", false], [518, 0.029888, " at", false], [916, 0.023816, " over", false], [2163, 0.015385, " around", false]]]}, "raw_delta": 0.17817274729410815, "tuned_delta": 0.1855098858078109}, {"byte_start": 395, "byte_end": 398, "display": {"text": " if", "kind": "normal"}, "is_word": true, "word_id": 68, "word_key": " if", "bytes_hex": "20 69 66", "compression": {"rwkv": "10.33% 10.33% 10.33%", "qwen": "11.76% 11.76% 11.76%"}, "model_tokens": {"rwkv": [[4588, " if", "normal", 0.1799420863389969]], "qwen": [[421, " if", "normal", 0.14144553244113922]]}, "loss": {"rwkv": 10.33180042303294, "qwen": 11.757006318845464}, "topk": {"rwkv": [4588, 2, 0.1799420863389969, [[332, 0.314913, " a", false], [4588, 0.179942, " if", false], [4419, 0.125067, " an", false], [31633, 0.060418, " part", false], [47544, 0.054061, " though", false], [22590, 0.018057, " the", false], [269, 0.012355, " \"", false], [50937, 0.00699, " applied", false], [63625, 0.006962, " incremental", false], [32074, 0.006714, " some", false]]], "qwen": [421, 2, 0.14144553244113922, [[264, 0.3322, " a", false], [421, 0.141446, " if", false], [458, 0.093673, " an", false], [949, 0.070602, " part", false], [3498, 0.029649, " though", false], [279, 0.018577, " the", false], [2987, 0.010033, " either", false], [330, 0.009308, " \"", false], [11017, 0.007624, " follows", false], [9251, 0.005406, " applied", false]]]}, "raw_delta": -0.079030195871989, "tuned_delta": -0.07169305735828627}, {"byte_start": 398, "byte_end": 402, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 69, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "7.89% 7.89% 7.89% 7.89%", "qwen": "8.42% 8.42% 8.42% 8.42%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.17593203485012054]], "qwen": [[279, " the", "normal", 0.1544894278049469]]}, "loss": {"rwkv": 7.889738504861517, "qwen": 8.420062594724723}, "topk": {"rwkv": [22590, 1, 0.17593203485012054, [[22590, 0.175932, " the", false], [32234, 0.094406, " this", false], [4858, 0.084822, " we", false], [4601, 0.083783, " it", false], [39934, 0.07107, " there", false], [37045, 0.052927, " Moore", false], [3609, 0.033823, " AI", false], [22226, 0.023733, " one", false], [63370, 0.022286, " computation", false], [51832, 0.016034, " general", false]]], "qwen": [279, 1, 0.1544894278049469, [[279, 0.154489, " the", false], [432, 0.100706, " it", false], [1052, 0.094937, " there", false], [419, 0.078101, " this", false], [582, 0.064453, " we", false], [34447, 0.05836, " computation", false], [20219, 0.025845, " Moore", false], [24231, 0.023952, " computing", false], [264, 0.020418, " a", false], [429, 0.016013, " that", false]]]}, "raw_delta": -0.029407411813735962, "tuned_delta": -0.022070273300033225}, {"byte_start": 402, "byte_end": 414, "display": {"text": " computation", "kind": "normal"}, "is_word": true, "word_id": 70, "word_key": " computation", "bytes_hex": "20 63 6f 6d 70 75 74 61 74 69 6f 6e", "compression": {"rwkv": "6.95% 6.95% 6.95% 6.95% 6.95% 6.95% 6.95% 6.95% 6.95% 6.95% 6.95% 6.95%", "qwen": "8.09% 8.09% 8.09% 8.09% 8.09% 8.09% 8.09% 8.09% 8.09% 8.09% 8.09% 8.09%"}, "model_tokens": {"rwkv": [[63370, " computation", "normal", 0.009839637205004692]], "qwen": [[34447, " computation", "normal", 0.004578007850795984]]}, "loss": {"rwkv": 6.9504839209494325, "qwen": 8.094858629573698}, "topk": {"rwkv": [63370, 15, 0.009839637205004692, [[30510, 0.172588, " cost", false], [31581, 0.049574, " only", false], [30985, 0.034634, " goal", false], [52569, 0.028658, " problem", false], [64862, 0.026054, " computational", false], [40213, 0.0241, " world", false], [57481, 0.015938, " ultimate", false], [56353, 0.014672, " hardware", false], [38124, 0.013456, " costs", false], [31356, 0.012289, " main", false]]], "qwen": [34447, 29, 0.004578007850795984, [[2783, 0.218788, " cost", false], [3853, 0.04936, " future", false], [3491, 0.035279, " problem", false], [16724, 0.026408, " ultimate", false], [1879, 0.024884, " world", false], [1172, 0.024796, " only", false], [7049, 0.019743, " costs", false], [54480, 0.016114, " computational", false], [11773, 0.013483, " hardware", false], [6366, 0.01246, " computer", false]]]}, "raw_delta": -0.06345760822296143, "tuned_delta": -0.056120469709258686}, {"byte_start": 414, "byte_end": 424, "display": {"text": " available", "kind": "normal"}, "is_word": true, "word_id": 71, "word_key": " available", "bytes_hex": "20 61 76 61 69 6c 61 62 6c 65", "compression": {"rwkv": "7.02% 7.02% 7.02% 7.02% 7.02% 7.02% 7.02% 7.02% 7.02% 7.02%", "qwen": "4.96% 4.96% 4.96% 4.96% 4.96% 4.96% 4.96% 4.96% 4.96% 4.96%"}, "model_tokens": {"rwkv": [[59206, " available", "normal", 0.020406221970915794]], "qwen": [[2500, " available", "normal", 0.06380987167358398]]}, "loss": {"rwkv": 7.016231741823279, "qwen": 4.962595936959651}, "topk": {"rwkv": [59206, 10, 0.020406221970915794, [[22748, 0.22568, " was", false], [4600, 0.103583, " is", false], [32462, 0.088636, " were", false], [30510, 0.065532, " cost", false], [40219, 0.047903, " would", false], [38128, 0.032357, " could", false], [46342, 0.031699, " itself", false], [4706, 0.021215, " of", false], [52569, 0.020689, " problem", false], [59206, 0.020406, " available", false]]], "qwen": [2500, 4, 0.06380987167358398, [[2783, 0.125413, " cost", false], [374, 0.093354, " is", false], [572, 0.089454, " was", false], [2500, 0.06381, " available", false], [7049, 0.047193, " costs", false], [8039, 0.035703, " budget", false], [1033, 0.034068, " were", false], [315, 0.025528, " of", false], [686, 0.024158, " will", false], [3491, 0.023169, " problem", false]]]}, "raw_delta": 0.1138777494430542, "tuned_delta": 0.12121488795675694}, {"byte_start": 424, "byte_end": 427, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 72, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "7.14% 7.14% 7.14%", "qwen": "4.65% 4.65% 4.65%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.30386364459991455]], "qwen": [[311, " to", "normal", 0.4611510634422302]]}, "loss": {"rwkv": 7.138334837731849, "qwen": 4.652869514643304}, "topk": {"rwkv": [4811, 1, 0.30386364459991455, [[4811, 0.303864, " to", false], [22748, 0.147861, " was", false], [32462, 0.121029, " were", false], [4600, 0.094718, " is", false], [21700, 0.090032, " for", false], [40219, 0.033777, " would", false], [4596, 0.03114, " in", false], [39971, 0.024681, " today", false], [4712, 0.02147, " on", false], [4424, 0.014831, " at", false]]], "qwen": [311, 1, 0.4611510634422302, [[311, 0.461151, " to", false], [572, 0.094041, " was", false], [3351, 0.084702, " today", false], [374, 0.061872, " is", false], [1033, 0.057448, " were", false], [304, 0.032404, " in", false], [1035, 0.02982, " would", false], [369, 0.024711, " for", false], [518, 0.024061, " at", false], [686, 0.020078, " will", false]]]}, "raw_delta": 0.1378234624862671, "tuned_delta": 0.14516060099996983}, {"byte_start": 427, "byte_end": 431, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 73, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "11.27% 11.27% 11.27% 11.27%", "qwen": "11.27% 11.27% 11.27% 11.27%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.0834406390786171]], "qwen": [[279, " the", "normal", 0.08203161507844925]]}, "loss": {"rwkv": 11.271055006945026, "qwen": 11.273987311142236}, "topk": {"rwkv": [22590, 4, 0.0834406390786171, [[63843, 0.189921, " researchers", false], [3609, 0.134564, " AI", false], [4835, 0.092733, " us", false], [22590, 0.083441, " the", false], [4601, 0.06669, " it", false], [39740, 0.050189, " solve", false], [332, 0.043008, " a", false], [46227, 0.031322, " humans", false], [4419, 0.023586, " an", false], [4491, 0.017823, " do", false]]], "qwen": [279, 3, 0.08203161507844925, [[601, 0.346554, " us", false], [432, 0.134368, " it", false], [279, 0.082032, " the", false], [264, 0.0735, " a", false], [11811, 0.03848, " researchers", false], [15235, 0.035806, " AI", false], [458, 0.03419, " an", false], [11625, 0.03216, " solve", false], [12677, 0.024675, " humans", false], [1105, 0.008507, " them", false]]]}, "raw_delta": -0.00016260147094726562, "tuned_delta": 0.007174537042755471}, {"byte_start": 431, "byte_end": 437, "display": {"text": " agent", "kind": "normal"}, "is_word": true, "word_id": 74, "word_key": " agent", "bytes_hex": "20 61 67 65 6e 74", "compression": {"rwkv": "14.75% 14.75% 14.75% 14.75% 14.75% 14.75%", "qwen": "15.32% 15.32% 15.32% 15.32% 15.32% 15.32%"}, "model_tokens": {"rwkv": [[37636, " agent", "normal", 0.007329931017011404]], "qwen": [[8315, " agent", "normal", 0.006113724783062935]]}, "loss": {"rwkv": 14.746296967419742, "qwen": 15.320276165975551}, "topk": {"rwkv": [37636, 15, 0.007329931017011404, [[3609, 0.237394, " AI", false], [62496, 0.201397, " researcher", false], [63843, 0.14845, " researchers", false], [57103, 0.039237, " research", false], [52569, 0.033937, " problem", false], [59113, 0.022737, " algorithm", false], [52581, 0.01908, " project", false], [47487, 0.017301, " system", false], [38478, 0.01629, " field", false], [40213, 0.012288, " world", false]]], "qwen": [8315, 19, 0.006113724783062935, [[31085, 0.271469, " researcher", false], [15235, 0.14507, " AI", false], [2070, 0.099388, " field", false], [11811, 0.054255, " researchers", false], [3738, 0.051663, " human", false], [3412, 0.025836, " research", false], [5662, 0.024803, " machine", false], [1879, 0.024768, " world", false], [1849, 0.021812, " system", false], [12111, 0.016211, " algorithm", false]]]}, "raw_delta": -0.03182816505432129, "tuned_delta": -0.024491026540618552}, {"byte_start": 437, "byte_end": 442, "display": {"text": " were", "kind": "normal"}, "is_word": true, "word_id": 75, "word_key": " were", "bytes_hex": "20 77 65 72 65", "compression": {"rwkv": "6.62% 6.62% 6.62% 6.62% 6.62%", "qwen": "6.27% 6.27% 6.27% 6.27% 6.27%"}, "model_tokens": {"rwkv": [[32462, " were", "normal", 0.15815630555152893]], "qwen": [[1033, " were", "normal", 0.17594511806964874]]}, "loss": {"rwkv": 6.621744816580202, "qwen": 6.2670065216045385}, "topk": {"rwkv": [32462, 3, 0.15815630555152893, [[22748, 0.264146, " was", false], [4600, 0.212517, " is", false], [32462, 0.158156, " were", false], [40219, 0.067744, " would", false], [38128, 0.037015, " could", false], [4596, 0.016802, " in", false], [32475, 0.014482, " will", false], [275, 0.014213, " (", false], [21265, 0.013976, " and", false], [45, 0.011533, ",", false]]], "qwen": [1033, 3, 0.17594511806964874, [[374, 0.26816, " is", false], [572, 0.215074, " was", false], [1033, 0.175945, " were", false], [1035, 0.044511, " would", false], [686, 0.039311, " will", false], [1410, 0.025966, " could", false], [518, 0.021568, " at", false], [304, 0.018258, " in", false], [702, 0.016137, " has", false], [320, 0.014433, " (", false]]]}, "raw_delta": 0.019670867919921897, "tuned_delta": 0.027008006433624634}, {"byte_start": 442, "byte_end": 451, "display": {"text": " constant", "kind": "normal"}, "is_word": true, "word_id": 76, "word_key": " constant", "bytes_hex": "20 63 6f 6e 73 74 61 6e 74", "compression": {"rwkv": "7.11% 7.11% 7.11% 7.11% 7.11% 7.11% 7.11% 7.11% 7.11%", "qwen": "8.21% 8.21% 8.21% 8.21% 8.21% 8.21% 8.21% 8.21% 8.21%"}, "model_tokens": {"rwkv": [[55836, " constant", "normal", 0.028594616800546646]], "qwen": [[6783, " constant", "normal", 0.01665637083351612]]}, "loss": {"rwkv": 7.107026351601448, "qwen": 8.205253098838568}, "topk": {"rwkv": [55836, 7, 0.028594616800546646, [[38501, 0.174632, " fixed", false], [56447, 0.121853, " infinite", false], [60706, 0.086399, " unlimited", false], [332, 0.049952, " a", false], [30911, 0.049789, " free", false], [22590, 0.035286, " the", false], [55836, 0.028595, " constant", false], [63507, 0.027384, " effectively", false], [52140, 0.022027, " limited", false], [22187, 0.018444, " not", false]]], "qwen": [6783, 8, 0.01665637083351612, [[23809, 0.144194, " infinite", false], [26764, 0.115091, " unlimited", false], [7199, 0.090128, " limited", false], [8356, 0.073454, " fixed", false], [264, 0.065811, " a", false], [1910, 0.037812, " free", false], [650, 0.032257, " un", false], [6783, 0.016656, " constant", false], [91559, 0.01608, " limitless", false], [537, 0.01543, " not", false]]]}, "raw_delta": -0.06089862187703454, "tuned_delta": -0.0535614833633318}, {"byte_start": 451, "byte_end": 453, "display": {"text": " (", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "20 28", "compression": {"rwkv": "30.71% 30.71%", "qwen": "29.14% 29.14%"}, "model_tokens": {"rwkv": [[275, " (", "normal", 0.033619675785303116]], "qwen": [[320, " (", "normal", 0.03947778046131134]]}, "loss": {"rwkv": 30.713624893925193, "qwen": 29.142595625040475}, "topk": {"rwkv": [275, 5, 0.033619675785303116, [[45, 0.500555, ",", false], [47, 0.230461, ".", false], [60, 0.042696, ";", false], [4715, 0.036823, " or", false], [275, 0.03362, " (", false], [21265, 0.033529, " and", false], [31601, 0.025912, " over", false], [4596, 0.013984, " in", false], [59, 0.007075, ":", false], [21700, 0.006553, " for", false]]], "qwen": [320, 5, 0.03947778046131134, [[11, 0.466767, ",", false], [13, 0.157859, ".", false], [476, 0.118998, " or", false], [323, 0.048784, " and", false], [320, 0.039478, " (", false], [624, 0.024425, ".\n", false], [304, 0.023464, " in", false], [26, 0.020988, ";", false], [916, 0.012563, " over", false], [25, 0.008847, ":", false]]]}, "raw_delta": 0.08711636066436768, "tuned_delta": 0.09445349917807042}, {"byte_start": 453, "byte_end": 455, "display": {"text": "in", "kind": "normal"}, "is_word": true, "word_id": 77, "word_key": "in", "bytes_hex": "69 6e", "compression": {"rwkv": "27.75% 27.75%", "qwen": "31.87% 31.87%"}, "model_tokens": {"rwkv": [[1950, "in", "normal", 0.04581916704773903]], "qwen": [[258, "in", "normal", 0.029175065457820892]]}, "loss": {"rwkv": 27.754972954602124, "qwen": 31.869503092109046}, "topk": {"rwkv": [1950, 4, 0.04581916704773903, [[2101, 0.252587, "or", false], [7005, 0.064822, "and", false], [106, 0.04752, "i", false], [1950, 0.045819, "in", false], [36003, 0.032701, "which", false], [98, 0.030352, "a", false], [102, 0.028799, "e", false], [1751, 0.027844, "as", false], [8801, 0.022938, "the", false], [1752, 0.018011, "at", false]]], "qwen": [258, 7, 0.029175065457820892, [[269, 0.199894, "or", false], [72, 0.072016, "i", false], [437, 0.065276, "and", false], [300, 0.051478, "as", false], [68, 0.049405, "e", false], [8206, 0.038289, "which", false], [258, 0.029175, "in", false], [4535, 0.027088, "though", false], [1782, 0.021445, "the", false], [1958, 0.018568, "for", false]]]}, "raw_delta": -0.22815799713134766, "tuned_delta": -0.22082085861764492}, {"byte_start": 455, "byte_end": 461, "display": {"text": " which", "kind": "normal"}, "is_word": true, "word_id": 78, "word_key": " which", "bytes_hex": "20 77 68 69 63 68", "compression": {"rwkv": "16.62% 16.62% 16.62% 16.62% 16.62% 16.62%", "qwen": "7.09% 7.09% 7.09% 7.09% 7.09% 7.09%"}, "model_tokens": {"rwkv": [[40186, " which", "normal", 0.003966955002397299]], "qwen": [[892, " which", "normal", 0.09437352418899536]]}, "loss": {"rwkv": 16.62480613524391, "qwen": 7.0947379523325065}, "topk": {"rwkv": [40186, 30, 0.003966955002397299, [[22590, 0.188415, " the", false], [39920, 0.088759, " terms", false], [30808, 0.062445, " fact", false], [62293, 0.056727, " particular", false], [32074, 0.050032, " some", false], [39193, 0.03897, " other", false], [332, 0.038454, " a", false], [32251, 0.036288, " time", false], [55856, 0.031495, " contrast", false], [56901, 0.02424, " practice", false]]], "qwen": [892, 3, 0.09437352418899536, [[279, 0.158246, " the", false], [2097, 0.094419, " fact", false], [892, 0.094374, " which", false], [3793, 0.060052, " terms", false], [6588, 0.042931, " practice", false], [264, 0.037449, " a", false], [37555, 0.036592, "dependent", false], [1045, 0.031777, " some", false], [1008, 0.031536, " other", false], [12872, 0.027771, " contrast", false]]]}, "raw_delta": 0.5284591913223267, "tuned_delta": 0.5357963298360294}, {"byte_start": 461, "byte_end": 466, "display": {"text": " case", "kind": "normal"}, "is_word": true, "word_id": 79, "word_key": " case", "bytes_hex": "20 63 61 73 65", "compression": {"rwkv": "0.20% 0.20% 0.20% 0.20% 0.20%", "qwen": "0.09% 0.09% 0.09% 0.09% 0.09%"}, "model_tokens": {"rwkv": [[30405, " case", "normal", 0.9465376734733582]], "qwen": [[1142, " case", "normal", 0.9761645793914795]]}, "loss": {"rwkv": 0.19812401379395553, "qwen": 0.08700916041125867}, "topk": {"rwkv": [30405, 1, 0.9465376734733582, [[30405, 0.946538, " case", false], [22590, 0.008833, " the", false], [4601, 0.006827, " it", false], [4858, 0.003043, " we", false], [37045, 0.001988, " Moore", false], [37970, 0.001368, " cases", false], [39631, 0.001339, " sense", false], [332, 0.001233, " a", false], [39934, 0.001163, " there", false], [45, 0.001, ",", false]]], "qwen": [1142, 1, 0.9761645793914795, [[1142, 0.976165, " case", false], [432, 0.004039, " it", false], [279, 0.00354, " the", false], [5048, 0.002521, " cases", false], [374, 0.000955, " is", false], [582, 0.000813, " we", false], [11, 0.000769, ",", false], [5530, 0.000749, " sense", false], [498, 0.000373, " you", false], [678, 0.000372, " all", false]]]}, "raw_delta": 0.006161515787243843, "tuned_delta": 0.013498654300946579}, {"byte_start": 466, "byte_end": 477, "display": {"text": " leveraging", "kind": "normal"}, "is_word": true, "word_id": 80, "word_key": " leveraging", "bytes_hex": "20 6c 65 76 65 72 61 67 69 6e 67", "compression": {"rwkv": "24.80% 24.80% 24.80% 24.80% 24.80% 24.80% 0.05% 0.05% 0.05% 0.05% 0.05%", "qwen": "13.60% 13.60% 13.60% 13.60% 13.60% 13.60% 13.60% 13.60% 13.60% 13.60% 13.60%"}, "model_tokens": {"rwkv": [[38888, " lever", "normal", 0.0002689224202185869], [33672, "aging", "normal", 0.9851014614105225]], "qwen": [[76482, " leveraging", "normal", 0.0002496717497706413]]}, "loss": {"rwkv": 13.549981478741657, "qwen": 13.59963599700304}, "topk": {"rwkv": [38888, 200, 0.0002689224202185869, [[22590, 0.240017, " the", false], [45, 0.132559, ",", false], [4601, 0.111652, " it", false], [4858, 0.041021, " we", false], [39934, 0.038155, " there", false], [22799, 0.019503, " you", false], [332, 0.018341, " a", false], [22226, 0.014805, " one", false], [21273, 0.013244, " any", false], [3609, 0.012739, " AI", false]]], "qwen": [76482, 226, 0.0002496717497706413, [[11, 0.249015, ",", false], [279, 0.172923, " the", false], [432, 0.080018, " it", false], [582, 0.052138, " we", false], [264, 0.025589, " a", false], [498, 0.025274, " you", false], [1052, 0.022696, " there", false], [825, 0.012884, " one", false], [1429, 0.012434, " most", false], [678, 0.010484, " all", false]]]}, "raw_delta": -0.0027534311467950793, "tuned_delta": 0.004583707366907657}, {"byte_start": 477, "byte_end": 483, "display": {"text": " human", "kind": "normal"}, "is_word": true, "word_id": 81, "word_key": " human", "bytes_hex": "20 68 75 6d 61 6e", "compression": {"rwkv": "16.53% 16.53% 16.53% 16.53% 16.53% 16.53%", "qwen": "20.96% 20.96% 20.96% 20.96% 20.96% 20.96%"}, "model_tokens": {"rwkv": [[38720, " human", "normal", 0.004078036639839411]], "qwen": [[3738, " human", "normal", 0.0009363950230181217]]}, "loss": {"rwkv": 16.530880676852703, "qwen": 20.959572955879473}, "topk": {"rwkv": [38720, 15, 0.004078036639839411, [[63370, 0.480906, " computation", false], [22590, 0.095968, " the", false], [4601, 0.039196, " it", false], [51832, 0.028084, " general", false], [31458, 0.026637, " more", false], [64862, 0.019428, " computational", false], [32227, 0.016298, " that", false], [32234, 0.010317, " this", false], [37045, 0.009936, " Moore", false], [3609, 0.009241, " AI", false]]], "qwen": [3738, 62, 0.0009363950230181217, [[34447, 0.467746, " computation", false], [432, 0.120113, " it", false], [279, 0.068171, " the", false], [803, 0.032484, " more", false], [264, 0.021402, " a", false], [54480, 0.01602, " computational", false], [429, 0.011881, " that", false], [24231, 0.01097, " computing", false], [4586, 0.008736, " general", false], [374, 0.008231, " is", false]]]}, "raw_delta": -0.2455788453420004, "tuned_delta": -0.23824170682829765}, {"byte_start": 483, "byte_end": 493, "display": {"text": " knowledge", "kind": "normal"}, "is_word": true, "word_id": 82, "word_key": " knowledge", "bytes_hex": "20 6b 6e 6f 77 6c 65 64 67 65", "compression": {"rwkv": "5.30% 5.30% 5.30% 5.30% 5.30% 5.30% 5.30% 5.30% 5.30% 5.30%", "qwen": "4.41% 4.41% 4.41% 4.41% 4.41% 4.41% 4.41% 4.41% 4.41% 4.41%"}, "model_tokens": {"rwkv": [[59943, " knowledge", "normal", 0.05250487104058266]], "qwen": [[6540, " knowledge", "normal", 0.08692403882741928]]}, "loss": {"rwkv": 5.297395853264163, "qwen": 4.405126212973418}, "topk": {"rwkv": [59943, 4, 0.05250487104058266, [[64452, 0.179815, " intelligence", false], [46, 0.111071, "-", false], [63370, 0.060205, " computation", false], [59943, 0.052505, " knowledge", false], [38853, 0.045172, " labor", false], [59683, 0.026737, " expertise", false], [59917, 0.025148, " intuition", false], [59304, 0.023541, " cognition", false], [4715, 0.022247, " or", false], [61979, 0.017686, " experience", false]]], "qwen": [6540, 3, 0.08692403882741928, [[11229, 0.127482, " intelligence", false], [18726, 0.106964, " expertise", false], [6540, 0.086924, " knowledge", false], [34447, 0.051886, " computation", false], [9327, 0.038036, " labor", false], [56251, 0.029934, " intuition", false], [20017, 0.020528, " insight", false], [27597, 0.01394, " creativity", false], [6203, 0.01205, " expert", false], [23389, 0.011551, " wisdom", false]]]}, "raw_delta": 0.04947793483734131, "tuned_delta": 0.05681507335104405}, {"byte_start": 493, "byte_end": 499, "display": {"text": " would", "kind": "normal"}, "is_word": true, "word_id": 83, "word_key": " would", "bytes_hex": "20 77 6f 75 6c 64", "compression": {"rwkv": "7.94% 7.94% 7.94% 7.94% 7.94% 7.94%", "qwen": "4.58% 4.58% 4.58% 4.58% 4.58% 4.58%"}, "model_tokens": {"rwkv": [[40219, " would", "normal", 0.071438729763031]], "qwen": [[1035, " would", "normal", 0.21791388094425201]]}, "loss": {"rwkv": 7.936701234057122, "qwen": 4.579520705536263}, "topk": {"rwkv": [40219, 3, 0.071438729763031, [[4600, 0.271447, " is", false], [21265, 0.135429, " and", false], [40219, 0.071439, " would", false], [4811, 0.05034, " to", false], [45, 0.03904, ",", false], [22748, 0.035162, " was", false], [4715, 0.030387, " or", false], [4706, 0.029274, " of", false], [4596, 0.025587, " in", false], [37598, 0.022679, " about", false]]], "qwen": [1035, 1, 0.21791388094425201, [[1035, 0.217914, " would", false], [374, 0.210744, " is", false], [323, 0.095186, " and", false], [311, 0.050285, " to", false], [11, 0.038354, ",", false], [476, 0.036735, " or", false], [572, 0.023529, " was", false], [304, 0.022526, " in", false], [4566, 0.020117, " via", false], [911, 0.017185, " about", false]]]}, "raw_delta": 0.1861616174379985, "tuned_delta": 0.19349875595170124}, {"byte_start": 499, "byte_end": 502, "display": {"text": " be", "kind": "normal"}, "is_word": true, "word_id": 84, "word_key": " be", "bytes_hex": "20 62 65", "compression": {"rwkv": "2.38% 2.38% 2.38%", "qwen": "2.55% 2.55% 2.55%"}, "model_tokens": {"rwkv": [[4435, " be", "normal", 0.6688634157180786]], "qwen": [[387, " be", "normal", 0.6547784805297852]]}, "loss": {"rwkv": 2.383358506676917, "qwen": 2.5455050039505354}, "topk": {"rwkv": [4435, 1, 0.6688634157180786, [[4435, 0.668863, " be", false], [31059, 0.079696, " have", false], [22187, 0.021012, " not", false], [39820, 0.014323, " still", false], [31358, 0.011701, " make", false], [45150, 0.009902, " always", false], [53056, 0.009712, " suffice", false], [31967, 0.00811, " seem", false], [31581, 0.007504, " only", false], [46439, 0.006341, " likely", false]]], "qwen": [387, 1, 0.6547784805297852, [[387, 0.654778, " be", false], [614, 0.071888, " have", false], [537, 0.016801, " not", false], [2058, 0.015372, " still", false], [76156, 0.012673, " suffice", false], [1281, 0.011296, " make", false], [2677, 0.010566, " always", false], [2803, 0.008881, " seem", false], [4658, 0.008868, " probably", false], [4363, 0.008818, " likely", false]]]}, "raw_delta": -0.008991310993830354, "tuned_delta": -0.0016541724801276171}, {"byte_start": 502, "byte_end": 506, "display": {"text": " one", "kind": "normal"}, "is_word": true, "word_id": 85, "word_key": " one", "bytes_hex": "20 6f 6e 65", "compression": {"rwkv": "27.19% 27.19% 27.19% 27.19%", "qwen": "30.48% 30.48% 30.48% 30.48%"}, "model_tokens": {"rwkv": [[22226, " one", "normal", 0.0023958298843353987]], "qwen": [[825, " one", "normal", 0.0011593190720304847]]}, "loss": {"rwkv": 27.191420204254875, "qwen": 30.476583356024122}, "topk": {"rwkv": [22226, 49, 0.0023958298843353987, [[22590, 0.303476, " the", false], [332, 0.088067, " a", false], [31458, 0.042659, " more", false], [62606, 0.032527, " sufficient", false], [31461, 0.028552, " most", false], [52371, 0.026684, " optimal", false], [4419, 0.019832, " an", false], [31466, 0.018192, " much", false], [4706, 0.01665, " of", false], [59829, 0.01661, " important", false]]], "qwen": [825, 67, 0.0011593190720304847, [[279, 0.387049, " the", false], [803, 0.096544, " more", false], [264, 0.065433, " a", false], [22823, 0.037437, " optimal", false], [1429, 0.022295, " most", false], [458, 0.016741, " an", false], [1753, 0.01659, " much", false], [14016, 0.016242, " sufficient", false], [3041, 0.015432, " far", false], [2664, 0.014423, " better", false]]]}, "raw_delta": -0.1821681261062622, "tuned_delta": -0.17483098759255947}, {"byte_start": 506, "byte_end": 509, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 86, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "4.09% 4.09% 4.09%", "qwen": "4.45% 4.45% 4.45%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.5052815079689026]], "qwen": [[315, " of", "normal", 0.4768576920032501]]}, "loss": {"rwkv": 4.085757440017572, "qwen": 4.451538741005137}, "topk": {"rwkv": [4706, 1, 0.5052815079689026, [[4706, 0.505282, " of", false], [22752, 0.091911, " way", false], [39941, 0.068209, " thing", false], [55532, 0.038928, " approach", false], [460, 0.031263, "'s", false], [46713, 0.02028, " option", false], [56895, 0.019485, " possible", false], [46561, 0.015649, " method", false], [57260, 0.015398, " solution", false], [59593, 0.00825, " effective", false]]], "qwen": [315, 1, 0.4768576920032501, [[315, 0.476858, " of", false], [1616, 0.127351, " way", false], [2999, 0.081661, " option", false], [5486, 0.029032, " approach", false], [6291, 0.027137, " solution", false], [3204, 0.023123, " possible", false], [594, 0.022702, "'s", false], [1714, 0.017687, " method", false], [7373, 0.012969, " effective", false], [8282, 0.008211, " strategy", false]]]}, "raw_delta": -0.020283222198486328, "tuned_delta": -0.012946083684783592}, {"byte_start": 509, "byte_end": 513, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 87, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "0.25% 0.25% 0.25% 0.25%", "qwen": "0.27% 0.27% 0.27% 0.27%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.9462407827377319]], "qwen": [[279, " the", "normal", 0.9428697228431702]]}, "loss": {"rwkv": 0.2487557062079664, "qwen": 0.26521777134132535}, "topk": {"rwkv": [22590, 1, 0.9462407827377319, [[22590, 0.946241, " the", false], [21902, 0.007788, " its", false], [52869, 0.006369, " several", false], [31370, 0.005837, " many", false], [21674, 0.004015, " few", false], [22638, 0.003584, " two", false], [332, 0.003583, " a", false], [31581, 0.002997, " only", false], [45, 0.002779, ",", false], [32386, 0.002485, " very", false]]], "qwen": [279, 1, 0.9428697228431702, [[279, 0.94287, " the", false], [1181, 0.008991, " its", false], [1172, 0.008451, " only", false], [1657, 0.007163, " many", false], [1039, 0.006467, " our", false], [3807, 0.004442, " several", false], [264, 0.00355, " a", false], [697, 0.003538, " your", false], [2421, 0.002282, " few", false], [1378, 0.00215, " two", false]]]}, "raw_delta": -0.0009128507226705551, "tuned_delta": 0.0064242877910321815}, {"byte_start": 513, "byte_end": 518, "display": {"text": " only", "kind": "normal"}, "is_word": true, "word_id": 88, "word_key": " only", "bytes_hex": "20 6f 6e 6c 79", "compression": {"rwkv": "12.85% 12.85% 12.85% 12.85% 12.85%", "qwen": "9.09% 9.09% 9.09% 9.09% 9.09%"}, "model_tokens": {"rwkv": [[31581, " only", "normal", 0.02849949151277542]], "qwen": [[1172, " only", "normal", 0.08046524226665497]]}, "loss": {"rwkv": 12.849002707917329, "qwen": 9.08872587431064}, "topk": {"rwkv": [31581, 6, 0.02849949151277542, [[31461, 0.469319, " most", false], [30273, 0.090291, " best", false], [21674, 0.060397, " few", false], [51039, 0.040166, " biggest", false], [31458, 0.036302, " more", false], [31581, 0.028499, " only", false], [31356, 0.024635, " main", false], [51718, 0.016832, " fastest", false], [38879, 0.013931, " least", false], [52555, 0.012394, " primary", false]]], "qwen": [1172, 4, 0.08046524226665497, [[1429, 0.287685, " most", false], [1850, 0.214394, " best", false], [2421, 0.089719, " few", false], [1172, 0.080465, " only", false], [1887, 0.038782, " main", false], [803, 0.03611, " more", false], [2664, 0.032344, " better", false], [6028, 0.021359, " primary", false], [1376, 0.015158, " key", false], [42049, 0.008197, " cheapest", false]]]}, "raw_delta": 0.20851402282714848, "tuned_delta": 0.21585116134085122}, {"byte_start": 518, "byte_end": 523, "display": {"text": " ways", "kind": "normal"}, "is_word": true, "word_id": 89, "word_key": " ways", "bytes_hex": "20 77 61 79 73", "compression": {"rwkv": "3.63% 3.63% 3.63% 3.63% 3.63%", "qwen": "6.60% 6.60% 6.60% 6.60% 6.60%"}, "model_tokens": {"rwkv": [[32448, " ways", "normal", 0.36133360862731934]], "qwen": [[5510, " ways", "normal", 0.16065028309822083]]}, "loss": {"rwkv": 3.634915239739771, "qwen": 6.59501140337346}, "topk": {"rwkv": [32448, 1, 0.36133360862731934, [[32448, 0.361334, " ways", false], [59593, 0.075305, " effective", false], [47539, 0.067385, " things", false], [52373, 0.06188, " options", false], [52224, 0.025765, " methods", false], [56895, 0.024011, " possible", false], [52957, 0.021215, " sources", false], [60376, 0.017387, " remaining", false], [47720, 0.017173, " viable", false], [56212, 0.01017, " feasible", false]]], "qwen": [5510, 2, 0.16065028309822083, [[2606, 0.185292, " options", false], [5510, 0.16065, " ways", false], [7373, 0.121537, " effective", false], [30428, 0.061611, " viable", false], [5413, 0.035611, " methods", false], [3363, 0.030889, " means", false], [19827, 0.029106, " approaches", false], [3204, 0.028069, " possible", false], [2513, 0.027952, " things", false], [4586, 0.015256, " general", false]]]}, "raw_delta": -0.16414258480072022, "tuned_delta": -0.15680544628701748}, {"byte_start": 523, "byte_end": 526, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 90, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "1.31% 1.31% 1.31%", "qwen": "1.50% 1.50% 1.50%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.8043993711471558]], "qwen": [[311, " to", "normal", 0.7796909809112549]]}, "loss": {"rwkv": 1.3149564174769197, "qwen": 1.4959401207549632}, "topk": {"rwkv": [4811, 1, 0.8043993711471558, [[4811, 0.804399, " to", false], [4706, 0.052756, " of", false], [21700, 0.049434, " for", false], [4596, 0.019183, " in", false], [32227, 0.013408, " that", false], [22590, 0.010879, " the", false], [51791, 0.006568, " forward", false], [22799, 0.004905, " you", false], [4601, 0.004623, " it", false], [22226, 0.003395, " one", false]]], "qwen": [311, 1, 0.7796909809112549, [[311, 0.779691, " to", false], [315, 0.058685, " of", false], [429, 0.026445, " that", false], [582, 0.012324, " we", false], [458, 0.011095, " an", false], [369, 0.010228, " for", false], [498, 0.009548, " you", false], [4637, 0.009054, " forward", false], [701, 0.008555, "),", false], [279, 0.007961, " the", false]]]}, "raw_delta": -0.01003586749235788, "tuned_delta": -0.002698728978655144}, {"byte_start": 526, "byte_end": 534, "display": {"text": " improve", "kind": "normal"}, "is_word": true, "word_id": 91, "word_key": " improve", "bytes_hex": "20 69 6d 70 72 6f 76 65", "compression": {"rwkv": "3.21% 3.21% 3.21% 3.21% 3.21% 3.21% 3.21% 3.21%", "qwen": "3.96% 3.96% 3.96% 3.96% 3.96% 3.96% 3.96% 3.96%"}, "model_tokens": {"rwkv": [[51982, " improve", "normal", 0.239995539188385]], "qwen": [[7269, " improve", "normal", 0.17285309731960297]]}, "loss": {"rwkv": 3.2052062675999915, "qwen": 3.9568462317260016}, "topk": {"rwkv": [51982, 1, 0.239995539188385, [[51982, 0.239996, " improve", false], [21751, 0.096764, " get", false], [31358, 0.077642, " make", false], [56433, 0.064536, " increase", false], [30938, 0.057972, " gain", false], [50848, 0.021004, " achieve", false], [37886, 0.019635, " boost", false], [39590, 0.018123, " scale", false], [46694, 0.013848, " obtain", false], [56950, 0.012106, " progress", false]]], "qwen": [7269, 1, 0.17285309731960297, [[7269, 0.172853, " improve", false], [1281, 0.086589, " make", false], [633, 0.077066, " get", false], [8722, 0.046208, " gain", false], [11075, 0.041978, " achieve", false], [32064, 0.035684, " leverage", false], [653, 0.034434, " do", false], [11625, 0.030462, " solve", false], [7949, 0.025845, " reduce", false], [11912, 0.017287, " advance", false]]]}, "raw_delta": -0.04167976975440979, "tuned_delta": -0.03434263124070705}, {"byte_start": 534, "byte_end": 546, "display": {"text": " performance", "kind": "normal"}, "is_word": true, "word_id": 92, "word_key": " performance", "bytes_hex": "20 70 65 72 66 6f 72 6d 61 6e 63 65", "compression": {"rwkv": "1.38% 1.38% 1.38% 1.38% 1.38% 1.38% 1.38% 1.38% 1.38% 1.38% 1.38% 1.38%", "qwen": "0.92% 0.92% 0.92% 0.92% 0.92% 0.92% 0.92% 0.92% 0.92% 0.92% 0.92% 0.92%"}, "model_tokens": {"rwkv": [[63750, " performance", "normal", 0.40172532200813293]], "qwen": [[5068, " performance", "normal", 0.5418747663497925]]}, "loss": {"rwkv": 1.3795301701208758, "qwen": 0.9208005767516142}, "topk": {"rwkv": [63750, 1, 0.40172532200813293, [[63750, 0.401725, " performance", false], [22590, 0.123543, " the", false], [499, 0.086506, ").", false], [497, 0.081763, "),", false], [37636, 0.030184, " agent", false], [21902, 0.025359, " its", false], [42, 0.02465, ")", false], [3609, 0.017918, " AI", false], [52738, 0.012741, " results", false], [4712, 0.01061, " on", false]]], "qwen": [5068, 1, 0.5418747663497925, [[5068, 0.541875, " performance", false], [279, 0.105896, " the", false], [458, 0.056244, " an", false], [6832, 0.034256, " learning", false], [264, 0.028226, " a", false], [701, 0.014869, "),", false], [8315, 0.01308, " agent", false], [3059, 0.012277, " results", false], [432, 0.011117, " it", false], [1181, 0.009955, " its", false]]]}, "raw_delta": 0.025437369942665097, "tuned_delta": 0.03277450845636783}, {"byte_start": 546, "byte_end": 547, "display": {"text": ")", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "29", "compression": {"rwkv": "52.13%", "qwen": "38.82%"}, "model_tokens": {"rwkv": [[42, ")", "normal", 0.05563868209719658]], "qwen": [[8, ")", "normal", 0.1161569133400917]]}, "loss": {"rwkv": 52.12862940712074, "qwen": 38.82316582572192}, "topk": {"rwkv": [42, 3, 0.05563868209719658, [[499, 0.436501, ").", false], [497, 0.346914, "),", false], [42, 0.055639, ")", false], [45, 0.035656, ",", false], [502, 0.023759, ");", false], [580, 0.012966, ".)", false], [31601, 0.00637, " over", false], [4712, 0.005548, " on", false], [45302, 0.003878, " beyond", false], [4706, 0.003696, " of", false]]], "qwen": [8, 3, 0.1161569133400917, [[701, 0.481042, "),", false], [568, 0.212925, ").", false], [8, 0.116157, ")", false], [11, 0.039897, ",", false], [4292, 0.036839, ").\n", false], [1215, 0.015695, ");", false], [11941, 0.009442, " significantly", false], [304, 0.008665, " in", false], [389, 0.006226, " on", false], [26, 0.005549, ";", false]]]}, "raw_delta": 0.7378115653991699, "tuned_delta": 0.7451487039128727}, {"byte_start": 547, "byte_end": 551, "display": {"text": " but", "kind": "normal"}, "is_word": true, "word_id": 93, "word_key": " but", "bytes_hex": "20 62 75 74", "compression": {"rwkv": "7.29% 7.29% 7.29% 7.29%", "qwen": "8.82% 8.82% 8.82% 8.82%"}, "model_tokens": {"rwkv": [[21400, " but", "normal", 0.19607014954090118]], "qwen": [[714, " but", "normal", 0.1414593905210495]]}, "loss": {"rwkv": 7.290963707617563, "qwen": 8.817312958699693}, "topk": {"rwkv": [21400, 3, 0.19607014954090118, [[4715, 0.280877, " or", false], [21265, 0.214771, " and", false], [21400, 0.19607, " but", false], [47001, 0.044338, " rather", false], [32465, 0.04011, " when", false], [40187, 0.028602, " while", false], [53339, 0.018469, " whereas", false], [4788, 0.015203, " so", false], [40186, 0.014444, " which", false], [280, 0.014012, " -", false]]], "qwen": [714, 3, 0.1414593905210495, [[476, 0.532945, " or", false], [323, 0.185605, " and", false], [714, 0.141459, " but", false], [4751, 0.02819, " rather", false], [1177, 0.011847, " --", false], [1959, 0.011388, " —", false], [481, 0.010769, " -", false], [1365, 0.006627, " –", false], [19853, 0.006069, " whereas", false], [448, 0.005423, " with", false]]]}, "raw_delta": -0.08463877439498901, "tuned_delta": -0.07730163588128627}, {"byte_start": 551, "byte_end": 552, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "72.70%", "qwen": "57.75%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.017884861677885056]], "qwen": [[11, ",", "normal", 0.04066253453493118]]}, "loss": {"rwkv": 72.69830479479542, "qwen": 57.75195044194827}, "topk": {"rwkv": [45, 9, 0.017884861677885056, [[4596, 0.15576, " in", false], [32234, 0.137253, " this", false], [22590, 0.133383, " the", false], [37045, 0.077004, " Moore", false], [32227, 0.063672, " that", false], [4601, 0.041985, " it", false], [4423, 0.034334, " as", false], [4858, 0.025061, " we", false], [45, 0.017885, ",", false], [39934, 0.011089, " there", false]]], "qwen": [11, 6, 0.04066253453493118, [[304, 0.159878, " in", false], [279, 0.15586, " the", false], [419, 0.107942, " this", false], [438, 0.055029, " as", false], [429, 0.041814, " that", false], [11, 0.040663, ",", false], [432, 0.035516, " it", false], [582, 0.022734, " we", false], [448, 0.02131, " with", false], [1052, 0.014629, " there", false]]]}, "raw_delta": 0.8288018703460693, "tuned_delta": 0.8361390088597721}, {"byte_start": 552, "byte_end": 557, "display": {"text": " over", "kind": "normal"}, "is_word": true, "word_id": 94, "word_key": " over", "bytes_hex": "20 6f 76 65 72", "compression": {"rwkv": "18.37% 18.37% 18.37% 18.37% 18.37%", "qwen": "16.27% 16.27% 16.27% 16.27% 16.27%"}, "model_tokens": {"rwkv": [[31601, " over", "normal", 0.006244035437703133]], "qwen": [[916, " over", "normal", 0.010989399626851082]]}, "loss": {"rwkv": 18.37181966132039, "qwen": 16.269359271746694}, "topk": {"rwkv": [31601, 20, 0.006244035437703133, [[4423, 0.299683, " as", false], [4596, 0.284434, " in", false], [4706, 0.038182, " of", false], [32487, 0.020703, " with", false], [47532, 0.01803, " thanks", false], [21700, 0.0175, " for", false], [4588, 0.01441, " if", false], [4450, 0.010614, " by", false], [31296, 0.009788, " like", false], [31458, 0.009522, " more", false]]], "qwen": [916, 16, 0.010989399626851082, [[438, 0.261753, " as", false], [304, 0.210697, " in", false], [448, 0.049432, " with", false], [2474, 0.032234, " since", false], [369, 0.026634, " for", false], [2661, 0.020306, " given", false], [315, 0.019959, " of", false], [4518, 0.019633, " instead", false], [553, 0.016233, " by", false], [9339, 0.015698, " thanks", false]]]}, "raw_delta": 0.11658515930175783, "tuned_delta": 0.12392229781546057}, {"byte_start": 557, "byte_end": 559, "display": {"text": " a", "kind": "normal"}, "is_word": true, "word_id": 95, "word_key": " a", "bytes_hex": "20 61", "compression": {"rwkv": "40.29% 40.29%", "qwen": "44.14% 44.14%"}, "model_tokens": {"rwkv": [[332, " a", "normal", 0.01135292649269104]], "qwen": [[264, " a", "normal", 0.007482042536139488]]}, "loss": {"rwkv": 40.294021649828466, "qwen": 44.1396999083741}, "topk": {"rwkv": [332, 5, 0.01135292649269104, [[22590, 0.622841, " the", false], [32251, 0.227246, " time", false], [3543, 0.029391, " 70", false], [51396, 0.014309, " decades", false], [332, 0.011353, " a", false], [32234, 0.010113, " this", false], [37045, 0.006754, " Moore", false], [21265, 0.006254, " and", false], [31370, 0.004884, " many", false], [21256, 0.004334, " all", false]]], "qwen": [264, 3, 0.007482042536139488, [[279, 0.658494, " the", false], [882, 0.28459, " time", false], [264, 0.007482, " a", false], [323, 0.004873, " and", false], [3213, 0.004735, " recent", false], [1657, 0.00455, " many", false], [220, 0.004311, " ", false], [10793, 0.00318, " decades", false], [1429, 0.002201, " most", false], [1293, 0.001318, " long", false]]]}, "raw_delta": -0.21324968338012695, "tuned_delta": -0.2059125448664242}, {"byte_start": 559, "byte_end": 568, "display": {"text": " slightly", "kind": "normal"}, "is_word": true, "word_id": 96, "word_key": " slightly", "bytes_hex": "20 73 6c 69 67 68 74 6c 79", "compression": {"rwkv": "17.28% 17.28% 17.28% 17.28% 17.28% 17.28% 17.28% 17.28% 17.28%", "qwen": "18.33% 18.33% 18.33% 18.33% 18.33% 18.33% 18.33% 18.33% 18.33%"}, "model_tokens": {"rwkv": [[57245, " slightly", "normal", 0.00018253736197948456]], "qwen": [[10078, " slightly", "normal", 0.00010625468712532893]]}, "loss": {"rwkv": 17.282284343982372, "qwen": 18.333591357686608}, "topk": {"rwkv": [57245, 200, 0.00018253736197948456, [[3543, 0.300862, " 70", false], [46790, 0.105546, " period", false], [31323, 0.09544, " long", false], [32386, 0.036812, " very", false], [51158, 0.026744, " century", false], [32251, 0.026189, " time", false], [45674, 0.021718, " decade", false], [38864, 0.018308, " large", false], [46470, 0.016697, " longer", false], [21674, 0.015896, " few", false]]], "qwen": [10078, 244, 0.00010625468712532893, [[4168, 0.154879, " period", false], [1293, 0.103377, " long", false], [9390, 0.074917, " span", false], [220, 0.070935, " ", false], [9294, 0.047748, " century", false], [3460, 0.046555, " large", false], [1602, 0.043272, " very", false], [2421, 0.028123, " few", false], [1753, 0.024449, " much", false], [6884, 0.024078, " wide", false]]]}, "raw_delta": -0.05829683939615882, "tuned_delta": -0.05095970088245608}, {"byte_start": 568, "byte_end": 575, "display": {"text": " longer", "kind": "normal"}, "is_word": true, "word_id": 97, "word_key": " longer", "bytes_hex": "20 6c 6f 6e 67 65 72", "compression": {"rwkv": "0.68% 0.68% 0.68% 0.68% 0.68% 0.68% 0.68%", "qwen": "1.14% 1.14% 1.14% 1.14% 1.14% 1.14% 1.14%"}, "model_tokens": {"rwkv": [[46470, " longer", "normal", 0.7653277516365051]], "qwen": [[5021, " longer", "normal", 0.6415794491767883]]}, "loss": {"rwkv": 0.6843140539930908, "qwen": 1.1433932558448097}, "topk": {"rwkv": [46470, 1, 0.7653277516365051, [[46470, 0.765328, " longer", false], [52888, 0.065395, " shorter", false], [46397, 0.043352, " larger", false], [31458, 0.028546, " more", false], [59513, 0.014313, " different", false], [40192, 0.01248, " wider", false], [31277, 0.011823, " less", false], [51093, 0.009529, " broader", false], [52932, 0.008377, " smaller", false], [56189, 0.006928, " extended", false]]], "qwen": [5021, 1, 0.6415794491767883, [[5021, 0.641579, " longer", false], [23327, 0.093429, " shorter", false], [803, 0.051857, " more", false], [2155, 0.041469, " different", false], [8131, 0.029925, " larger", false], [11577, 0.017777, " extended", false], [2686, 0.014145, " less", false], [9155, 0.013051, " smaller", false], [21864, 0.009469, " wider", false], [26829, 0.005714, " broader", false]]]}, "raw_delta": -0.0254567563533783, "tuned_delta": -0.018119617839675563}, {"byte_start": 575, "byte_end": 580, "display": {"text": " time", "kind": "normal"}, "is_word": true, "word_id": 98, "word_key": " time", "bytes_hex": "20 74 69 6d 65", "compression": {"rwkv": "3.11% 3.11% 3.11% 3.11% 3.11%", "qwen": "2.15% 2.15% 2.15% 2.15% 2.15%"}, "model_tokens": {"rwkv": [[32251, " time", "normal", 0.4206095039844513]], "qwen": [[882, " time", "normal", 0.551668107509613]]}, "loss": {"rwkv": 3.1136289456685633, "qwen": 2.145318681147023}, "topk": {"rwkv": [32251, 1, 0.4206095039844513, [[32251, 0.42061, " time", false], [46790, 0.290725, " period", false], [39962, 0.124843, " times", false], [51940, 0.055261, " horizon", false], [57431, 0.013918, " timeline", false], [51929, 0.009873, " history", false], [32219, 0.008862, " term", false], [32091, 0.006827, " span", false], [62061, 0.005058, " historical", false], [46, 0.004165, "-", false]]], "qwen": [882, 1, 0.551668107509613, [[882, 0.551668, " time", false], [3039, 0.204437, " times", false], [4168, 0.095723, " period", false], [4647, 0.016563, " term", false], [69953, 0.015943, " timeframe", false], [34074, 0.01331, " horizon", false], [9390, 0.011896, " span", false], [3840, 0.010853, " history", false], [13656, 0.010749, " historical", false], [1651, 0.009354, " view", false]]]}, "raw_delta": 0.053694522380828856, "tuned_delta": 0.06103166089453159}, {"byte_start": 580, "byte_end": 585, "display": {"text": " than", "kind": "normal"}, "is_word": true, "word_id": 99, "word_key": " than", "bytes_hex": "20 74 68 61 6e", "compression": {"rwkv": "17.70% 17.70% 17.70% 17.70% 17.70%", "qwen": "18.76% 18.76% 18.76% 18.76% 18.76%"}, "model_tokens": {"rwkv": [[32226, " than", "normal", 0.007359430659562349]], "qwen": [[1091, " than", "normal", 0.005510401912033558]]}, "loss": {"rwkv": 17.69555636090369, "qwen": 18.759066116962142}, "topk": {"rwkv": [32226, 9, 0.007359430659562349, [[51940, 0.27763, " horizon", false], [38549, 0.189149, " frame", false], [46790, 0.16146, " period", false], [39590, 0.115795, " scale", false], [34478, 0.092053, "frame", false], [32091, 0.054424, " span", false], [46, 0.053437, "-", false], [45, 0.01514, ",", false], [32226, 0.007359, " than", false], [56485, 0.006647, " interval", false]]], "qwen": [1091, 9, 0.005510401912033558, [[34074, 0.294978, " horizon", false], [5452, 0.278795, " scale", false], [4168, 0.118818, " period", false], [4034, 0.117693, " frame", false], [9390, 0.071881, " span", false], [11, 0.034453, ",", false], [12934, 0.018418, "-scale", false], [3241, 0.006431, " window", false], [1091, 0.00551, " than", false], [46767, 0.005317, "-frame", false]]]}, "raw_delta": -0.058973503112792924, "tuned_delta": -0.051636364599090184}, {"byte_start": 585, "byte_end": 587, "display": {"text": " a", "kind": "normal"}, "is_word": true, "word_id": 100, "word_key": " a", "bytes_hex": "20 61", "compression": {"rwkv": "35.08% 35.08%", "qwen": "33.10% 33.10%"}, "model_tokens": {"rwkv": [[332, " a", "normal", 0.02080506645143032]], "qwen": [[264, " a", "normal", 0.025462068617343903]]}, "loss": {"rwkv": 35.081158709116394, "qwen": 33.09691532413615}, "topk": {"rwkv": [332, 8, 0.02080506645143032, [[37045, 0.268005, " Moore", false], [22590, 0.204051, " the", false], [3543, 0.082391, " 70", false], [32227, 0.077544, " that", false], [4858, 0.038297, " we", false], [4601, 0.035759, " it", false], [32234, 0.023253, " this", false], [332, 0.020805, " a", false], [22799, 0.018278, " you", false], [22226, 0.015477, " one", false]]], "qwen": [264, 9, 0.025462068617343903, [[20219, 0.190439, " Moore", false], [279, 0.189425, " the", false], [429, 0.086501, " that", false], [220, 0.058331, " ", false], [1429, 0.044907, " most", false], [582, 0.042566, " we", false], [358, 0.041866, " I", false], [1128, 0.027468, " what", false], [264, 0.025462, " a", false], [374, 0.022678, " is", false]]]}, "raw_delta": 0.11002981662750244, "tuned_delta": 0.11736695514120518}, {"byte_start": 587, "byte_end": 595, "display": {"text": " typical", "kind": "normal"}, "is_word": true, "word_id": 101, "word_key": " typical", "bytes_hex": "20 74 79 70 69 63 61 6c", "compression": {"rwkv": "6.30% 6.30% 6.30% 6.30% 6.30% 6.30% 6.30% 6.30%", "qwen": "2.64% 2.64% 2.64% 2.64% 2.64% 2.64% 2.64% 2.64%"}, "model_tokens": {"rwkv": [[53216, " typical", "normal", 0.06208483874797821]], "qwen": [[14260, " typical", "normal", 0.30994606018066406]]}, "loss": {"rwkv": 6.304746394509873, "qwen": 2.640485647564225}, "topk": {"rwkv": [53216, 6, 0.06208483874797821, [[38720, 0.194608, " human", false], [45674, 0.142557, " decade", false], [51158, 0.088215, " century", false], [3543, 0.062799, " 70", false], [47289, 0.062467, " single", false], [53216, 0.062085, " typical", false], [32512, 0.042873, " year", false], [62035, 0.035198, " generation", false], [21674, 0.023645, " few", false], [46795, 0.019157, " person", false]]], "qwen": [14260, 1, 0.30994606018066406, [[14260, 0.309946, " typical", false], [3175, 0.145236, " single", false], [3738, 0.103433, " human", false], [13212, 0.090959, " decade", false], [9471, 0.052553, " generation", false], [2421, 0.034489, " few", false], [9294, 0.033726, " century", false], [8338, 0.02265, " quarter", false], [6931, 0.017734, " career", false], [19031, 0.015397, " lifetime", false]]]}, "raw_delta": 0.20318976044654846, "tuned_delta": 0.2105268989602512}, {"byte_start": 595, "byte_end": 604, "display": {"text": " research", "kind": "normal"}, "is_word": true, "word_id": 102, "word_key": " research", "bytes_hex": "20 72 65 73 65 61 72 63 68", "compression": {"rwkv": "4.60% 4.60% 4.60% 4.60% 4.60% 4.60% 4.60% 4.60% 4.60%", "qwen": "4.11% 4.11% 4.11% 4.11% 4.11% 4.11% 4.11% 4.11% 4.11%"}, "model_tokens": {"rwkv": [[57103, " research", "normal", 0.10014776140451431]], "qwen": [[3412, " research", "normal", 0.12872017920017242]]}, "loss": {"rwkv": 4.602347461169218, "qwen": 4.107902594964088}, "topk": {"rwkv": [57103, 3, 0.10014776140451431, [[38720, 0.2407, " human", false], [3609, 0.118002, " AI", false], [57103, 0.100148, " research", false], [45418, 0.050959, " career", false], [56546, 0.029501, " lifetime", false], [46795, 0.026311, " person", false], [55427, 0.024988, " academic", false], [31293, 0.023495, " life", false], [37636, 0.013832, " agent", false], [56545, 0.013468, " lifespan", false]]], "qwen": [3412, 1, 0.12872017920017242, [[3412, 0.12872, " research", false], [15235, 0.117699, " AI", false], [14250, 0.113605, " academic", false], [29561, 0.081167, " PhD", false], [3738, 0.06284, " human", false], [5567, 0.053965, " paper", false], [6931, 0.045386, " career", false], [220, 0.019262, " ", false], [31085, 0.01882, " researcher", false], [2390, 0.015059, " project", false]]]}, "raw_delta": 0.027417845196194113, "tuned_delta": 0.03475498370989685}, {"byte_start": 604, "byte_end": 612, "display": {"text": " project", "kind": "normal"}, "is_word": true, "word_id": 103, "word_key": " project", "bytes_hex": "20 70 72 6f 6a 65 63 74", "compression": {"rwkv": "6.73% 6.73% 6.73% 6.73% 6.73% 6.73% 6.73% 6.73%", "qwen": "2.24% 2.24% 2.24% 2.24% 2.24% 2.24% 2.24% 2.24%"}, "model_tokens": {"rwkv": [[52581, " project", "normal", 0.05062534660100937]], "qwen": [[2390, " project", "normal", 0.3694009780883789]]}, "loss": {"rwkv": 6.727410957270312, "qwen": 2.2449068743387732}, "topk": {"rwkv": [52581, 4, 0.05062534660100937, [[45418, 0.665753, " career", false], [38172, 0.057023, " cycle", false], [56546, 0.05467, " lifetime", false], [52581, 0.050625, " project", false], [46790, 0.024565, " period", false], [31293, 0.024176, " life", false], [39227, 0.018057, " paper", false], [52580, 0.009991, " program", false], [56545, 0.009035, " lifespan", false], [32251, 0.005437, " time", false]]], "qwen": [2390, 1, 0.3694009780883789, [[2390, 0.369401, " project", false], [5567, 0.149084, " paper", false], [6931, 0.101524, " career", false], [2025, 0.099172, " program", false], [10775, 0.03564, " cycle", false], [2083, 0.016677, " team", false], [5041, 0.015622, " effort", false], [4168, 0.014426, " period", false], [4549, 0.013782, " article", false], [18402, 0.012573, " agenda", false]]]}, "raw_delta": 0.24856280535459518, "tuned_delta": 0.2558999438682979}, {"byte_start": 612, "byte_end": 613, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "4.83%", "qwen": "3.30%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.766708254814148]], "qwen": [[11, ",", "normal", 0.832703709602356]]}, "loss": {"rwkv": 4.825420424848339, "qwen": 3.301560622637448}, "topk": {"rwkv": [45, 1, 0.766708254814148, [[45, 0.766708, ",", false], [38867, 0.034144, " lasts", false], [40219, 0.02692, " would", false], [275, 0.020627, " (", false], [39751, 0.018768, " spans", false], [460, 0.009373, "'s", false], [4600, 0.008784, " is", false], [21413, 0.008738, " can", false], [39021, 0.007061, " might", false], [32091, 0.005655, " span", false]]], "qwen": [11, 1, 0.832703709602356, [[11, 0.832704, ",", false], [320, 0.039765, " (", false], [1035, 0.012515, " would", false], [39658, 0.008696, " lasts", false], [476, 0.008524, " or", false], [304, 0.005829, " in", false], [60861, 0.005639, " lifespan", false], [323, 0.005504, " and", false], [594, 0.005473, "'s", false], [44295, 0.004554, " spans", false]]]}, "raw_delta": 0.08450073003768921, "tuned_delta": 0.09183786855139195}, {"byte_start": 613, "byte_end": 623, "display": {"text": " massively", "kind": "normal"}, "is_word": true, "word_id": 104, "word_key": " massively", "bytes_hex": "20 6d 61 73 73 69 76 65 6c 79", "compression": {"rwkv": "15.89% 15.89% 15.89% 15.89% 15.89% 15.89% 15.89% 15.89% 15.89% 15.89%", "qwen": "16.97% 16.97% 16.97% 16.97% 16.97% 16.97% 16.97% 16.97% 16.97% 16.97%"}, "model_tokens": {"rwkv": [[59988, " massively", "normal", 0.0001499016652815044]], "qwen": [[63707, " massively", "normal", 8.201191667467356e-05]]}, "loss": {"rwkv": 15.892187559792484, "qwen": 16.967257989641936}, "topk": {"rwkv": [59988, 243, 0.0001499016652815044, [[22590, 0.247101, " the", false], [63370, 0.117083, " computation", false], [37045, 0.090785, " Moore", false], [32234, 0.081544, " this", false], [4858, 0.065441, " we", false], [4601, 0.03113, " it", false], [32227, 0.029685, " that", false], [39934, 0.021945, " there", false], [59346, 0.02039, " computing", false], [3609, 0.010807, " AI", false]]], "qwen": [63707, 349, 8.201191667467356e-05, [[279, 0.314859, " the", false], [419, 0.094283, " this", false], [34447, 0.08315, " computation", false], [20219, 0.059401, " Moore", false], [582, 0.056349, " we", false], [432, 0.035309, " it", false], [429, 0.026882, " that", false], [264, 0.017638, " a", false], [1052, 0.016266, " there", false], [58755, 0.015347, " exponential", false]]]}, "raw_delta": -0.05961456298828127, "tuned_delta": -0.05227742447457853}, {"byte_start": 623, "byte_end": 628, "display": {"text": " more", "kind": "normal"}, "is_word": true, "word_id": 105, "word_key": " more", "bytes_hex": "20 6d 6f 72 65", "compression": {"rwkv": "5.27% 5.27% 5.27% 5.27% 5.27%", "qwen": "5.55% 5.55% 5.55% 5.55% 5.55%"}, "model_tokens": {"rwkv": [[31458, " more", "normal", 0.23026542365550995]], "qwen": [[803, " more", "normal", 0.21473440527915955]]}, "loss": {"rwkv": 5.2692182157467995, "qwen": 5.548436778945468}, "topk": {"rwkv": [31458, 2, 0.23026542365550995, [[56812, 0.239709, " parallel", false], [31458, 0.230265, " more", false], [62092, 0.094518, " increasing", false], [59846, 0.060232, " increased", false], [56418, 0.052938, " improved", false], [51178, 0.033869, " cheaper", false], [56900, 0.019873, " powerful", false], [45301, 0.018152, " better", false], [45961, 0.017265, " faster", false], [51709, 0.016974, " falling", false]]], "qwen": [803, 1, 0.21473440527915955, [[803, 0.214734, " more", false], [23048, 0.151313, " cheaper", false], [7703, 0.085892, " increasing", false], [7172, 0.07638, " increased", false], [15279, 0.059274, " parallel", false], [12944, 0.033619, " improved", false], [4722, 0.026703, " lower", false], [11046, 0.023342, " reduced", false], [17719, 0.021584, " reducing", false], [15679, 0.019332, " falling", false]]]}, "raw_delta": -0.015483164787292503, "tuned_delta": -0.008146026273589766}, {"byte_start": 628, "byte_end": 640, "display": {"text": " computation", "kind": "normal"}, "is_word": true, "word_id": 106, "word_key": " computation", "bytes_hex": "20 63 6f 6d 70 75 74 61 74 69 6f 6e", "compression": {"rwkv": "1.77% 1.77% 1.77% 1.77% 1.77% 1.77% 1.77% 1.77% 1.77% 1.77% 1.77% 1.77%", "qwen": "0.69% 0.69% 0.69% 0.69% 0.69% 0.69% 0.69% 0.69% 0.69% 0.69% 0.69% 0.69%"}, "model_tokens": {"rwkv": [[63370, " computation", "normal", 0.3055560886859894]], "qwen": [[34447, " computation", "normal", 0.6322945952415466]]}, "loss": {"rwkv": 1.7728430271340614, "qwen": 0.6888867195008749}, "topk": {"rwkv": [63370, 1, 0.3055560886859894, [[63370, 0.305556, " computation", false], [59346, 0.142826, " computing", false], [51266, 0.085277, " compute", false], [56900, 0.049415, " powerful", false], [64862, 0.046111, " computational", false], [60406, 0.032073, " resources", false], [21265, 0.018434, " and", false], [39339, 0.013736, " power", false], [59345, 0.013182, " computers", false], [59593, 0.011223, " effective", false]]], "qwen": [34447, 1, 0.6322945952415466, [[34447, 0.632295, " computation", false], [24231, 0.092921, " computing", false], [54480, 0.077247, " computational", false], [7988, 0.025779, " powerful", false], [2355, 0.017244, " power", false], [4963, 0.011984, " resources", false], [12564, 0.009854, " compute", false], [374, 0.006309, " is", false], [6366, 0.005893, " computer", false], [82599, 0.005062, " computations", false]]]}, "raw_delta": 0.060107300678888954, "tuned_delta": 0.06744443919259169}, {"byte_start": 640, "byte_end": 651, "display": {"text": " inevitably", "kind": "normal"}, "is_word": true, "word_id": 107, "word_key": " inevitably", "bytes_hex": "20 69 6e 65 76 69 74 61 62 6c 79", "compression": {"rwkv": "19.47% 19.47% 19.47% 19.47% 19.47% 19.47% 19.47% 19.47% 19.47% 19.47% 19.47%", "qwen": "18.37% 18.37% 18.37% 18.37% 18.37% 18.37% 18.37% 18.37% 18.37% 18.37% 18.37%"}, "model_tokens": {"rwkv": [[62110, " inevitably", "normal", 6.9300276663852856e-06]], "qwen": [[39505, " inevitably", "normal", 1.3586168279289268e-05]]}, "loss": {"rwkv": 19.468185921086867, "qwen": 18.37216081236056}, "topk": {"rwkv": [62110, 430, 6.9300276663852856e-06, [[21800, 0.431345, " has", false], [4600, 0.301842, " is", false], [45283, 0.049442, " became", false], [51019, 0.041637, " becomes", false], [21265, 0.028217, " and", false], [22748, 0.020679, " was", false], [32475, 0.016363, " will", false], [275, 0.012891, " (", false], [22278, 0.012822, " per", false], [21413, 0.011631, " can", false]]], "qwen": [39505, 250, 1.3586168279289268e-05, [[374, 0.368706, " is", false], [9044, 0.210179, " becomes", false], [702, 0.163419, " has", false], [686, 0.063317, " will", false], [6116, 0.05747, " became", false], [646, 0.030104, " can", false], [572, 0.019347, " was", false], [1091, 0.017925, " than", false], [1035, 0.013141, " would", false], [320, 0.007676, " (", false]]]}, "raw_delta": 0.06077653711492359, "tuned_delta": 0.06811367562862633}, {"byte_start": 651, "byte_end": 659, "display": {"text": " becomes", "kind": "normal"}, "is_word": true, "word_id": 108, "word_key": " becomes", "bytes_hex": "20 62 65 63 6f 6d 65 73", "compression": {"rwkv": "0.70% 0.70% 0.70% 0.70% 0.70% 0.70% 0.70% 0.70%", "qwen": "0.36% 0.36% 0.36% 0.36% 0.36% 0.36% 0.36% 0.36%"}, "model_tokens": {"rwkv": [[51019, " becomes", "normal", 0.7341703176498413]], "qwen": [[9044, " becomes", "normal", 0.8512977361679077]]}, "loss": {"rwkv": 0.7044409379340641, "qwen": 0.3629129528386432}, "topk": {"rwkv": [51019, 1, 0.7341703176498413, [[51019, 0.73417, " becomes", false], [45283, 0.078943, " became", false], [38087, 0.027746, " comes", false], [50956, 0.025538, " arrives", false], [21800, 0.011826, " has", false], [45199, 0.010087, " arises", false], [30965, 0.008402, " gets", false], [4600, 0.007217, " is", false], [50935, 0.006631, " appears", false], [51586, 0.006175, " emerges", false]]], "qwen": [9044, 1, 0.8512977361679077, [[9044, 0.851298, " becomes", false], [6116, 0.030535, " became", false], [29682, 0.015827, " arrives", false], [4041, 0.014727, " comes", false], [374, 0.00821, " is", false], [5221, 0.007622, " gets", false], [686, 0.007398, " will", false], [17066, 0.007118, " falls", false], [3635, 0.005005, " become", false], [3643, 0.00425, " makes", false]]]}, "raw_delta": 0.018938332796096802, "tuned_delta": 0.02627547130979954}, {"byte_start": 659, "byte_end": 669, "display": {"text": " available", "kind": "normal"}, "is_word": true, "word_id": 109, "word_key": " available", "bytes_hex": "20 61 76 61 69 6c 61 62 6c 65", "compression": {"rwkv": "0.12% 0.12% 0.12% 0.12% 0.12% 0.12% 0.12% 0.12% 0.12% 0.12%", "qwen": "0.05% 0.05% 0.05% 0.05% 0.05% 0.05% 0.05% 0.05% 0.05% 0.05%"}, "model_tokens": {"rwkv": [[59206, " available", "normal", 0.9360848069190979]], "qwen": [[2500, " available", "normal", 0.9704382419586182]]}, "loss": {"rwkv": 0.11887440827637331, "qwen": 0.054114593021693955}, "topk": {"rwkv": [59206, 1, 0.9360848069190979, [[59206, 0.936085, " available", false], [56895, 0.008095, " possible", false], [61551, 0.00751, " affordable", false], [38006, 0.007074, " cheap", false], [51178, 0.006446, " cheaper", false], [61519, 0.004771, " accessible", false], [56212, 0.00285, " feasible", false], [31458, 0.002673, " more", false], [30911, 0.00177, " free", false], [46042, 0.001525, " freely", false]]], "qwen": [2500, 1, 0.9704382419586182, [[2500, 0.970438, " available", false], [15614, 0.012816, " accessible", false], [3204, 0.003238, " possible", false], [42203, 0.000999, " feasible", false], [30268, 0.000741, " readily", false], [16637, 0.000601, " affordable", false], [264, 0.000533, " a", false], [13570, 0.000506, " widely", false], [25580, 0.000454, " freely", false], [518, 0.000437, " at", false]]]}, "raw_delta": 0.003591046668589115, "tuned_delta": 0.010928185182291852}, {"byte_start": 669, "byte_end": 670, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "9.44%", "qwen": "17.36%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.5892093777656555]], "qwen": [[13, ".", "normal", 0.3819284737110138]]}, "loss": {"rwkv": 9.439508568316459, "qwen": 17.357820915727263}, "topk": {"rwkv": [47, 1, 0.5892093777656555, [[47, 0.589209, ".", false], [45, 0.142907, ",", false], [4811, 0.068165, " to", false], [21265, 0.029715, " and", false], [275, 0.019829, " (", false], [4424, 0.017932, " at", false], [4423, 0.01607, " as", false], [21700, 0.012768, " for", false], [32226, 0.009827, " than", false], [4596, 0.006974, " in", false]]], "qwen": [13, 1, 0.3819284737110138, [[13, 0.381928, ".", false], [11, 0.185065, ",", false], [624, 0.141005, ".\n", false], [311, 0.064201, " to", false], [323, 0.06305, " and", false], [320, 0.031207, " (", false], [1091, 0.014719, " than", false], [369, 0.012568, " for", false], [518, 0.010692, " at", false], [1526, 0.007702, " through", false]]]}, "raw_delta": -0.4390844702720642, "tuned_delta": -0.4317473317583615}, {"byte_start": 670, "byte_end": 678, "display": {"text": " Seeking", "kind": "normal"}, "is_word": true, "word_id": 110, "word_key": " seeking", "bytes_hex": "20 53 65 65 6b 69 6e 67", "compression": {"rwkv": "38.77% 38.77% 38.77% 38.77% 38.77% 0.30% 0.30% 0.30%", "qwen": "25.58% 25.58% 25.58% 25.58% 25.58% 25.58% 25.58% 25.58%"}, "model_tokens": {"rwkv": [[29753, " Seek", "normal", 2.1366482542362064e-05], [7856, "ing", "normal", 0.9518613219261169]], "qwen": [[58705, " Seeking", "normal", 1.1795600585173815e-05]]}, "loss": {"rwkv": 24.343937850449528, "qwen": 25.580299629670897}, "topk": {"rwkv": [29753, 891, 2.1366482542362064e-05, [[11, 0.247866, "\n", false], [29894, 0.100981, " This", false], [261, 0.094195, "\n\n", false], [20996, 0.088735, " The", false], [3913, 0.02941, " In", false], [3918, 0.021004, " It", false], [3641, 0.020238, " As", false], [19417, 0.016542, " And", false], [19907, 0.016326, " For", false], [29898, 0.015029, " Thus", false]]], "qwen": [58705, 1520, 1.1795600585173815e-05, [[1096, 0.168432, " This", false], [576, 0.107964, " The", false], [1634, 0.050958, " As", false], [758, 0.048782, " In", false], [1084, 0.034836, " It", false], [1597, 0.029178, " And", false], [1752, 0.019607, " For", false], [14301, 0.016932, " Thus", false], [1416, 0.015635, " If", false], [1205, 0.013743, " We", false]]]}, "raw_delta": -0.06855845451354986, "tuned_delta": -0.06122131599984712}, {"byte_start": 678, "byte_end": 681, "display": {"text": " an", "kind": "normal"}, "is_word": true, "word_id": 111, "word_key": " an", "bytes_hex": "20 61 6e", "compression": {"rwkv": "27.43% 27.43% 27.43%", "qwen": "26.75% 26.75% 26.75%"}, "model_tokens": {"rwkv": [[4419, " an", "normal", 0.010524781420826912]], "qwen": [[458, " an", "normal", 0.011676748283207417]]}, "loss": {"rwkv": 27.426233850232894, "qwen": 26.750906708712392}, "topk": {"rwkv": [4419, 13, 0.010524781420826912, [[4811, 0.446342, " to", false], [22249, 0.057155, " out", false], [332, 0.046212, " a", false], [51832, 0.036204, " general", false], [22590, 0.034568, " the", false], [32448, 0.03139, " ways", false], [52224, 0.026279, " methods", false], [59943, 0.016851, " knowledge", false], [38720, 0.015143, " human", false], [31458, 0.014834, " more", false]]], "qwen": [458, 12, 0.011676748283207417, [[311, 0.346544, " to", false], [4586, 0.095296, " general", false], [264, 0.068085, " a", false], [279, 0.039555, " the", false], [5413, 0.029232, " methods", false], [501, 0.022304, " new", false], [5510, 0.022205, " ways", false], [2664, 0.02123, " better", false], [803, 0.018443, " more", false], [700, 0.015659, " out", false]]]}, "raw_delta": 0.03744808832804347, "tuned_delta": 0.04478522684174621}, {"byte_start": 681, "byte_end": 693, "display": {"text": " improvement", "kind": "normal"}, "is_word": true, "word_id": 112, "word_key": " improvement", "bytes_hex": "20 69 6d 70 72 6f 76 65 6d 65 6e 74", "compression": {"rwkv": "4.60% 4.60% 4.60% 4.60% 4.60% 4.60% 4.60% 4.60% 4.60% 4.60% 4.60% 4.60%", "qwen": "5.62% 5.62% 5.62% 5.62% 5.62% 5.62% 5.62% 5.62% 5.62% 5.62% 5.62% 5.62%"}, "model_tokens": {"rwkv": [[63621, " improvement", "normal", 0.04658503830432892]], "qwen": [[15673, " improvement", "normal", 0.023840148001909256]]}, "loss": {"rwkv": 4.602347461169219, "qwen": 5.61506586758611}, "topk": {"rwkv": [63621, 4, 0.04658503830432892, [[30729, 0.076863, " edge", false], [59093, 0.069208, " advantage", false], [63277, 0.048669, " alternative", false], [63621, 0.046585, " improvement", false], [3609, 0.04442, " AI", false], [52371, 0.032217, " optimal", false], [55532, 0.02862, " approach", false], [30789, 0.028553, " ever", false], [63560, 0.026882, " explanation", false], [40077, 0.025395, " upper", false]]], "qwen": [15673, 10, 0.023840148001909256, [[22823, 0.143534, " optimal", false], [10555, 0.058327, " alternative", false], [16148, 0.05473, " explanation", false], [7373, 0.047727, " effective", false], [8315, 0.041014, " agent", false], [12111, 0.034582, " algorithm", false], [4226, 0.030941, " answer", false], [5486, 0.029412, " approach", false], [11050, 0.024839, " efficient", false], [15673, 0.02384, " improvement", false]]]}, "raw_delta": -0.05615703264872237, "tuned_delta": -0.04881989413501964}, {"byte_start": 693, "byte_end": 698, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 113, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"rwkv": "13.13% 13.13% 13.13% 13.13% 13.13%", "qwen": "10.43% 10.43% 10.43% 10.43% 10.43%"}, "model_tokens": {"rwkv": [[32227, " that", "normal", 0.026305479928851128]], "qwen": [[429, " that", "normal", 0.05540107935667038]]}, "loss": {"rwkv": 13.130779083090955, "qwen": 10.4348555804452}, "topk": {"rwkv": [32227, 5, 0.026305479928851128, [[4596, 0.49114, " in", false], [4450, 0.12489, " by", false], [4706, 0.124764, " of", false], [31601, 0.030287, " over", false], [32227, 0.026305, " that", false], [4811, 0.0256, " to", false], [4712, 0.019347, " on", false], [30917, 0.016626, " from", false], [32487, 0.011996, " with", false], [53140, 0.011436, " through", false]]], "qwen": [429, 4, 0.05540107935667038, [[304, 0.462232, " in", false], [916, 0.084486, " over", false], [389, 0.059968, " on", false], [429, 0.055401, " that", false], [311, 0.045035, " to", false], [315, 0.032579, " of", false], [553, 0.02508, " by", false], [374, 0.018459, " is", false], [7797, 0.0181, " beyond", false], [504, 0.015775, " from", false]]]}, "raw_delta": 0.1494937419891358, "tuned_delta": 0.15683088050283853}, {"byte_start": 698, "byte_end": 704, "display": {"text": " makes", "kind": "normal"}, "is_word": true, "word_id": 114, "word_key": " makes", "bytes_hex": "20 6d 61 6b 65 73", "compression": {"rwkv": "15.22% 15.22% 15.22% 15.22% 15.22% 15.22%", "qwen": "16.07% 16.07% 16.07% 16.07% 16.07% 16.07%"}, "model_tokens": {"rwkv": [[38964, " makes", "normal", 0.0063440874218940735]], "qwen": [[3643, " makes", "normal", 0.004769652150571346]]}, "loss": {"rwkv": 15.215924259375784, "qwen": 16.066458726462773}, "topk": {"rwkv": [38964, 23, 0.0063440874218940735, [[4600, 0.235056, " is", false], [57102, 0.073091, " requires", false], [56540, 0.069132, " leverage", false], [21413, 0.058403, " can", false], [40219, 0.040163, " would", false], [31581, 0.023398, " only", false], [22748, 0.023257, " was", false], [38278, 0.022887, " doesn", false], [38087, 0.0211, " comes", false], [30659, 0.02105, " does", false]]], "qwen": [3643, 24, 0.004769652150571346, [[374, 0.189496, " is", false], [7460, 0.158147, " requires", false], [1558, 0.100576, " does", false], [646, 0.047346, " can", false], [3171, 0.046745, " doesn", false], [27505, 0.046031, " lever", false], [1035, 0.036799, " would", false], [33644, 0.034925, " relies", false], [4157, 0.025388, " cannot", false], [28405, 0.019711, " scales", false]]]}, "raw_delta": -0.047163645426432255, "tuned_delta": -0.039826506912729515}, {"byte_start": 704, "byte_end": 706, "display": {"text": " a", "kind": "normal"}, "is_word": true, "word_id": 115, "word_key": " a", "bytes_hex": "20 61", "compression": {"rwkv": "26.21% 26.21%", "qwen": "28.80% 28.80%"}, "model_tokens": {"rwkv": [[332, " a", "normal", 0.05422629788517952]], "qwen": [[264, " a", "normal", 0.041008658707141876]]}, "loss": {"rwkv": 26.205202891147184, "qwen": 28.799548280713836}, "topk": {"rwkv": [332, 4, 0.05422629788517952, [[22681, 0.273443, " use", false], [22590, 0.131792, " the", false], [4692, 0.064343, " no", false], [332, 0.054226, " a", false], [45301, 0.026396, " better", false], [39631, 0.025542, " sense", false], [4601, 0.023307, " it", false], [4833, 0.020211, " up", false], [30992, 0.01893, " good", false], [4419, 0.015025, " an", false]]], "qwen": [264, 4, 0.041008658707141876, [[990, 0.383282, " use", false], [902, 0.161169, " no", false], [279, 0.054144, " the", false], [264, 0.041009, " a", false], [2632, 0.038358, " little", false], [5530, 0.03482, " sense", false], [2664, 0.028742, " better", false], [1661, 0.016088, " good", false], [803, 0.015047, " more", false], [8811, 0.012346, " heavy", false]]]}, "raw_delta": -0.1438610553741455, "tuned_delta": -0.13652391686044277}, {"byte_start": 706, "byte_end": 717, "display": {"text": " difference", "kind": "normal"}, "is_word": true, "word_id": 116, "word_key": " difference", "bytes_hex": "20 64 69 66 66 65 72 65 6e 63 65", "compression": {"rwkv": "4.33% 4.33% 4.33% 4.33% 4.33% 4.33% 4.33% 4.33% 4.33% 4.33% 4.33%", "qwen": "4.66% 4.66% 4.66% 4.66% 4.66% 4.66% 4.66% 4.66% 4.66% 4.66% 4.66%"}, "model_tokens": {"rwkv": [[61863, " difference", "normal", 0.07142824679613113]], "qwen": [[6672, " difference", "normal", 0.05831332132220268]]}, "loss": {"rwkv": 4.329109764031157, "qwen": 4.659125709293158}, "topk": {"rwkv": [61863, 1, 0.07142824679613113, [[61863, 0.071428, " difference", false], [38594, 0.048289, " given", false], [3483, 0.045238, " 10", false], [39720, 0.032887, " small", false], [52232, 0.027232, " million", false], [56587, 0.022971, " marginal", false], [38864, 0.021362, " large", false], [21357, 0.020284, " big", false], [284, 0.019764, " 1", false], [63870, 0.019147, " significant", false]]], "qwen": [6672, 4, 0.05831332132220268, [[2613, 0.104232, " small", false], [3460, 0.064247, " large", false], [5089, 0.060479, " significant", false], [6672, 0.058313, " difference", false], [8131, 0.038904, " larger", false], [9155, 0.029102, " smaller", false], [3175, 0.028157, " single", false], [2409, 0.02704, " big", false], [11924, 0.025355, " substantial", false], [6765, 0.014296, " huge", false]]]}, "raw_delta": -0.01829996975985443, "tuned_delta": -0.010962831246151692}, {"byte_start": 717, "byte_end": 720, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 117, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "10.57% 10.57% 10.57%", "qwen": "9.94% 9.94% 9.94%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.17373314499855042]], "qwen": [[304, " in", "normal", 0.1915179193019867]]}, "loss": {"rwkv": 10.566614069010962, "qwen": 9.935203413982654}, "topk": {"rwkv": [4596, 1, 0.17373314499855042, [[4596, 0.173733, " in", false], [4811, 0.106199, " to", false], [4600, 0.077138, " is", false], [45, 0.064675, ",", false], [57102, 0.063702, " requires", false], [39971, 0.042596, " today", false], [4450, 0.039749, " by", false], [32475, 0.02406, " will", false], [31601, 0.022401, " over", false], [32487, 0.02149, " with", false]]], "qwen": [304, 1, 0.1915179193019867, [[304, 0.191518, " in", false], [374, 0.095014, " is", false], [311, 0.071833, " to", false], [916, 0.063177, " over", false], [389, 0.062715, " on", false], [7460, 0.046699, " requires", false], [979, 0.029425, " when", false], [11, 0.02619, ",", false], [518, 0.025189, " at", false], [369, 0.024353, " for", false]]]}, "raw_delta": 0.03501284122467041, "tuned_delta": 0.04234997973837315}, {"byte_start": 720, "byte_end": 724, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 118, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "4.79% 4.79% 4.79% 4.79%", "qwen": "6.17% 6.17% 6.17% 6.17%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.3486831486225128]], "qwen": [[279, " the", "normal", 0.2544078826904297]]}, "loss": {"rwkv": 4.7901983779516355, "qwen": 6.171202403560686}, "topk": {"rwkv": [22590, 1, 0.3486831486225128, [[22590, 0.348683, " the", false], [332, 0.136279, " a", false], [39920, 0.051654, " terms", false], [32234, 0.045685, " this", false], [31835, 0.035525, " real", false], [56901, 0.019877, " practice", false], [63750, 0.019826, " performance", false], [4419, 0.019328, " an", false], [38720, 0.016056, " human", false], [3483, 0.011287, " 10", false]]], "qwen": [279, 1, 0.2544078826904297, [[279, 0.254408, " the", false], [264, 0.166713, " a", false], [5068, 0.083839, " performance", false], [419, 0.063061, " this", false], [6588, 0.04657, " practice", false], [3793, 0.026816, " terms", false], [458, 0.026541, " an", false], [1741, 0.026428, " such", false], [429, 0.022521, " that", false], [220, 0.018603, " ", false]]]}, "raw_delta": -0.07657912373542786, "tuned_delta": -0.06924198522172512}, {"byte_start": 724, "byte_end": 732, "display": {"text": " shorter", "kind": "normal"}, "is_word": true, "word_id": 119, "word_key": " shorter", "bytes_hex": "20 73 68 6f 72 74 65 72", "compression": {"rwkv": "16.62% 16.62% 16.62% 16.62% 16.62% 16.62% 16.62% 16.62%", "qwen": "12.48% 12.48% 12.48% 12.48% 12.48% 12.48% 12.48% 12.48%"}, "model_tokens": {"rwkv": [[52888, " shorter", "normal", 0.0006355251534841955]], "qwen": [[23327, " shorter", "normal", 0.003942768555134535]]}, "loss": {"rwkv": 16.62480613524391, "qwen": 12.479024600292085}, "topk": {"rwkv": [52888, 134, 0.0006355251534841955, [[31835, 0.19428, " real", false], [40213, 0.088118, " world", false], [31323, 0.069582, " long", false], [30807, 0.050246, " face", false], [39675, 0.041536, " short", false], [31515, 0.036005, " next", false], [32251, 0.029583, " time", false], [31503, 0.019971, " near", false], [46064, 0.01799, " future", false], [38621, 0.015178, " grand", false]]], "qwen": [23327, 38, 0.003942768555134535, [[2805, 0.128871, " short", false], [3143, 0.081736, " near", false], [882, 0.065915, " time", false], [1293, 0.049215, " long", false], [1790, 0.041966, " next", false], [1931, 0.032048, " real", false], [5068, 0.026856, " performance", false], [1879, 0.024192, " world", false], [3853, 0.015901, " future", false], [1482, 0.015439, " current", false]]]}, "raw_delta": 0.22989094257354736, "tuned_delta": 0.2372280810872501}, {"byte_start": 732, "byte_end": 737, "display": {"text": " term", "kind": "normal"}, "is_word": true, "word_id": 120, "word_key": " term", "bytes_hex": "20 74 65 72 6d", "compression": {"rwkv": "1.55% 1.55% 1.55% 1.55% 1.55%", "qwen": "2.21% 2.21% 2.21% 2.21% 2.21%"}, "model_tokens": {"rwkv": [[32219, " term", "normal", 0.6534224152565002]], "qwen": [[4647, " term", "normal", 0.5424668192863464]]}, "loss": {"rwkv": 1.549770063454941, "qwen": 2.205982766520802}, "topk": {"rwkv": [32219, 1, 0.6534224152565002, [[32219, 0.653422, " term", false], [22418, 0.1405, " run", false], [32251, 0.086982, " time", false], [46, 0.057006, "-", false], [51940, 0.007935, " horizon", false], [39962, 0.005454, " times", false], [4715, 0.005118, " or", false], [21265, 0.003559, " and", false], [46064, 0.00324, " future", false], [39920, 0.003005, " terms", false]]], "qwen": [4647, 1, 0.5424668192863464, [[4647, 0.542467, " term", false], [882, 0.221836, " time", false], [1598, 0.063362, " run", false], [9663, 0.045174, "-term", false], [3039, 0.035426, " times", false], [69953, 0.024584, " timeframe", false], [4168, 0.010569, " period", false], [11, 0.008014, ",", false], [3793, 0.003769, " terms", false], [34074, 0.003366, " horizon", false]]]}, "raw_delta": -0.03638815879821777, "tuned_delta": -0.029051020284515037}, {"byte_start": 737, "byte_end": 738, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "40.29%", "qwen": "43.78%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.10498012602329254]], "qwen": [[11, ",", "normal", 0.08825676888227463]]}, "loss": {"rwkv": 40.294021649828466, "qwen": 43.776868109848834}, "topk": {"rwkv": [45, 2, 0.10498012602329254, [[4600, 0.293702, " is", false], [45, 0.10498, ",", false], [275, 0.047777, " (", false], [57102, 0.038099, " requires", false], [32475, 0.03689, " will", false], [22074, 0.035225, " may", false], [21413, 0.032759, " can", false], [4450, 0.031965, " by", false], [53356, 0.01873, " without", false], [40219, 0.016737, " would", false]]], "qwen": [11, 2, 0.08825676888227463, [[374, 0.300275, " is", false], [11, 0.088257, ",", false], [320, 0.058578, " (", false], [646, 0.038089, " can", false], [7460, 0.036124, " requires", false], [686, 0.034283, " will", false], [702, 0.026786, " has", false], [9044, 0.025306, " becomes", false], [1231, 0.024479, " may", false], [3363, 0.018381, " means", false]]]}, "raw_delta": -0.1931300163269043, "tuned_delta": -0.18579287781320156}, {"byte_start": 738, "byte_end": 750, "display": {"text": " researchers", "kind": "normal"}, "is_word": true, "word_id": 121, "word_key": " researchers", "bytes_hex": "20 72 65 73 65 61 72 63 68 65 72 73", "compression": {"rwkv": "4.93% 4.93% 4.93% 4.93% 4.93% 4.93% 4.93% 4.93% 4.93% 4.93% 4.93% 4.93%", "qwen": "6.27% 6.27% 6.27% 6.27% 6.27% 6.27% 6.27% 6.27% 6.27% 6.27% 6.27% 6.27%"}, "model_tokens": {"rwkv": [[63843, " researchers", "normal", 0.0376972034573555]], "qwen": [[11811, " researchers", "normal", 0.015444123186171055]]}, "loss": {"rwkv": 4.931086565538449, "qwen": 6.267497818710502}, "topk": {"rwkv": [63843, 5, 0.0376972034573555, [[22590, 0.058891, " the", false], [4858, 0.056574, " we", false], [40187, 0.050609, " while", false], [21265, 0.047302, " and", false], [63843, 0.037697, " researchers", false], [21400, 0.030886, " but", false], [22226, 0.029276, " one", false], [53356, 0.028301, " without", false], [4450, 0.026598, " by", false], [4715, 0.026236, " or", false]]], "qwen": [11811, 19, 0.015444123186171055, [[323, 0.06536, " and", false], [476, 0.056072, " or", false], [1741, 0.053032, " such", false], [4764, 0.039624, " however", false], [279, 0.035106, " the", false], [304, 0.032476, " in", false], [438, 0.029488, " as", false], [1393, 0.027959, " while", false], [1221, 0.025311, " then", false], [714, 0.025235, " but", false]]]}, "raw_delta": -0.0741063753763835, "tuned_delta": -0.06676923686268076}, {"byte_start": 750, "byte_end": 755, "display": {"text": " seek", "kind": "normal"}, "is_word": true, "word_id": 122, "word_key": " seek", "bytes_hex": "20 73 65 65 6b", "compression": {"rwkv": "21.19% 21.19% 21.19% 21.19% 21.19%", "qwen": "20.72% 20.72% 20.72% 20.72% 20.72%"}, "model_tokens": {"rwkv": [[31966, " seek", "normal", 0.0028180989902466536]], "qwen": [[5931, " seek", "normal", 0.003198388498276472]]}, "loss": {"rwkv": 21.18958341305665, "qwen": 20.72109751262683}, "topk": {"rwkv": [31966, 39, 0.0028180989902466536, [[31059, 0.204285, " have", false], [39171, 0.094283, " often", false], [32475, 0.068604, " will", false], [32216, 0.052431, " tend", false], [21286, 0.052156, " are", false], [21413, 0.025847, " can", false], [60687, 0.025119, " typically", false], [22074, 0.020277, " may", false], [47266, 0.015542, " should", false], [4596, 0.015538, " in", false]]], "qwen": [5931, 37, 0.003198388498276472, [[614, 0.303681, " have", false], [525, 0.074676, " are", false], [8376, 0.058613, " tend", false], [686, 0.058181, " will", false], [3545, 0.05436, " often", false], [646, 0.025166, " can", false], [1969, 0.024153, " must", false], [11136, 0.020928, " typically", false], [1265, 0.02013, " should", false], [1231, 0.017721, " may", false]]]}, "raw_delta": 0.025978374481201216, "tuned_delta": 0.033315512994903956}, {"byte_start": 755, "byte_end": 758, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 123, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "6.43% 6.43% 6.43%", "qwen": "7.10% 7.10% 7.10%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.3439498543739319]], "qwen": [[311, " to", "normal", 0.30715322494506836]]}, "loss": {"rwkv": 6.433893899797785, "qwen": 7.095706787932366}, "topk": {"rwkv": [4811, 1, 0.3439498543739319, [[4811, 0.34395, " to", false], [332, 0.088637, " a", false], [52224, 0.060815, " methods", false], [22249, 0.054364, " out", false], [32448, 0.034725, " ways", false], [4419, 0.029618, " an", false], [22590, 0.028553, " the", false], [64423, 0.026607, " improvements", false], [22168, 0.012943, " new", false], [31458, 0.011837, " more", false]]], "qwen": [311, 1, 0.30715322494506836, [[311, 0.307153, " to", false], [264, 0.063881, " a", false], [5510, 0.056106, " ways", false], [5413, 0.046561, " methods", false], [18142, 0.034417, " improvements", false], [700, 0.029936, " out", false], [279, 0.022782, " the", false], [54920, 0.019494, " shortcuts", false], [9904, 0.01759, " solutions", false], [458, 0.01636, " an", false]]]}, "raw_delta": -0.03669869899749756, "tuned_delta": -0.029361560483794822}, {"byte_start": 758, "byte_end": 767, "display": {"text": " leverage", "kind": "normal"}, "is_word": true, "word_id": 124, "word_key": " leverage", "bytes_hex": "20 6c 65 76 65 72 61 67 65", "compression": {"rwkv": "4.20% 4.20% 4.20% 4.20% 4.20% 4.20% 4.20% 4.20% 4.20%", "qwen": "3.38% 3.38% 3.38% 3.38% 3.38% 3.38% 3.38% 3.38% 3.38%"}, "model_tokens": {"rwkv": [[56540, " leverage", "normal", 0.12291303277015686]], "qwen": [[32064, " leverage", "normal", 0.1850433498620987]]}, "loss": {"rwkv": 4.195337141473982, "qwen": 3.3806455308803502}, "topk": {"rwkv": [56540, 2, 0.12291303277015686, [[51982, 0.141784, " improve", false], [56540, 0.122913, " leverage", false], [51690, 0.057226, " exploit", false], [30858, 0.038497, " find", false], [31358, 0.037455, " make", false], [22681, 0.032622, " use", false], [37730, 0.029026, " apply", false], [37923, 0.017015, " build", false], [4491, 0.016294, " do", false], [56433, 0.016195, " increase", false]]], "qwen": [32064, 1, 0.1850433498620987, [[32064, 0.185043, " leverage", false], [7269, 0.073056, " improve", false], [1477, 0.054696, " find", false], [32194, 0.050307, " exploit", false], [1936, 0.034749, " build", false], [1281, 0.033653, " make", false], [990, 0.031825, " use", false], [2225, 0.027895, " develop", false], [3796, 0.022643, " apply", false], [653, 0.016222, " do", false]]]}, "raw_delta": 0.04517609543270534, "tuned_delta": 0.05251323394640808}, {"byte_start": 767, "byte_end": 773, "display": {"text": " their", "kind": "normal"}, "is_word": true, "word_id": 125, "word_key": " their", "bytes_hex": "20 74 68 65 69 72", "compression": {"rwkv": "9.77% 9.77% 9.77% 9.77% 9.77% 9.77%", "qwen": "12.25% 12.25% 12.25% 12.25% 12.25% 12.25%"}, "model_tokens": {"rwkv": [[39931, " their", "normal", 0.03830163553357124]], "qwen": [[862, " their", "normal", 0.016973810270428658]]}, "loss": {"rwkv": 9.768247672685687, "qwen": 12.251136838983184}, "topk": {"rwkv": [39931, 6, 0.03830163553357124, [[22590, 0.205276, " the", false], [38720, 0.116191, " human", false], [32234, 0.092419, " this", false], [32227, 0.060419, " that", false], [32464, 0.045077, " what", false], [39931, 0.038302, " their", false], [56173, 0.032576, " existing", false], [57564, 0.021259, " whatever", false], [59943, 0.020347, " knowledge", false], [63370, 0.020123, " computation", false]]], "qwen": [862, 9, 0.016973810270428658, [[419, 0.2792, " this", false], [279, 0.185648, " the", false], [429, 0.078367, " that", false], [432, 0.056268, " it", false], [3738, 0.041902, " human", false], [34447, 0.036121, " computation", false], [6350, 0.028696, " existing", false], [1493, 0.018124, " these", false], [862, 0.016974, " their", false], [6540, 0.015419, " knowledge", false]]]}, "raw_delta": -0.13768061002095544, "tuned_delta": -0.1303434715072527}, {"byte_start": 773, "byte_end": 779, "display": {"text": " human", "kind": "normal"}, "is_word": true, "word_id": 126, "word_key": " human", "bytes_hex": "20 68 75 6d 61 6e", "compression": {"rwkv": "9.44% 9.44% 9.44% 9.44% 9.44% 9.44%", "qwen": "11.94% 11.94% 11.94% 11.94% 11.94% 11.94%"}, "model_tokens": {"rwkv": [[38720, " human", "normal", 0.04337504506111145]], "qwen": [[3738, " human", "normal", 0.01883947290480137]]}, "loss": {"rwkv": 9.439508568316459, "qwen": 11.937703473946366}, "topk": {"rwkv": [38720, 6, 0.04337504506111145, [[52140, 0.12878, " limited", false], [59943, 0.100831, " knowledge", false], [51372, 0.072739, " current", false], [56173, 0.072297, " existing", false], [22251, 0.07091, " own", false], [38720, 0.043375, " human", false], [39720, 0.022704, " small", false], [59206, 0.019819, " available", false], [65034, 0.017831, " understanding", false], [22168, 0.013918, " new", false]]], "qwen": [3738, 9, 0.01883947290480137, [[6540, 0.180166, " knowledge", false], [6350, 0.092155, " existing", false], [1482, 0.06157, " current", false], [1828, 0.058436, " own", false], [501, 0.031776, " new", false], [7199, 0.030736, " limited", false], [54480, 0.02952, " computational", false], [2500, 0.021754, " available", false], [3738, 0.018839, " human", false], [8660, 0.018359, " understanding", false]]]}, "raw_delta": -0.13852934042612708, "tuned_delta": -0.13119220191242434}, {"byte_start": 779, "byte_end": 789, "display": {"text": " knowledge", "kind": "normal"}, "is_word": true, "word_id": 127, "word_key": " knowledge", "bytes_hex": "20 6b 6e 6f 77 6c 65 64 67 65", "compression": {"rwkv": "0.51% 0.51% 0.51% 0.51% 0.51% 0.51% 0.51% 0.51% 0.51% 0.51%", "qwen": "1.12% 1.12% 1.12% 1.12% 1.12% 1.12% 1.12% 1.12% 1.12% 1.12%"}, "model_tokens": {"rwkv": [[59943, " knowledge", "normal", 0.7540845274925232]], "qwen": [[6540, " knowledge", "normal", 0.5378748774528503]]}, "loss": {"rwkv": 0.5142418846918667, "qwen": 1.1183219167583118}, "topk": {"rwkv": [59943, 1, 0.7540845274925232, [[59943, 0.754085, " knowledge", false], [64452, 0.024133, " intelligence", false], [46, 0.022596, "-", false], [59683, 0.017896, " expertise", false], [65034, 0.015934, " understanding", false], [59917, 0.013366, " intuition", false], [59305, 0.007544, " cognitive", false], [45346, 0.006096, " brains", false], [21265, 0.005048, " and", false], [64340, 0.004618, " counterparts", false]]], "qwen": [6540, 1, 0.5378748774528503, [[6540, 0.537875, " knowledge", false], [18726, 0.053629, " expertise", false], [56251, 0.046322, " intuition", false], [11229, 0.029525, " intelligence", false], [8660, 0.015324, " understanding", false], [6749, 0.015121, " ing", false], [4963, 0.01493, " resources", false], [7361, 0.013789, " skills", false], [24675, 0.009583, " cognitive", false], [20017, 0.008713, " insight", false]]]}, "raw_delta": -0.03349730968475342, "tuned_delta": -0.02616017117105068}, {"byte_start": 789, "byte_end": 792, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 128, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "19.35% 19.35% 19.35%", "qwen": "21.13% 21.13% 21.13%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.03971828147768974]], "qwen": [[315, " of", "normal", 0.029736023396253586]]}, "loss": {"rwkv": 19.348644428588962, "qwen": 21.13185227681502}, "topk": {"rwkv": [4706, 6, 0.03971828147768974, [[45, 0.185263, ",", false], [4811, 0.142993, " to", false], [47, 0.139115, ".", false], [21265, 0.101785, " and", false], [4596, 0.074085, " in", false], [4706, 0.039718, " of", false], [275, 0.031536, " (", false], [30243, 0.028269, " base", false], [4450, 0.026305, " by", false], [4423, 0.023799, " as", false]]], "qwen": [315, 8, 0.029736023396253586, [[11, 0.156832, ",", false], [323, 0.11761, " and", false], [304, 0.102445, " in", false], [311, 0.089361, " to", false], [13, 0.086746, ".", false], [553, 0.039992, " by", false], [320, 0.033706, " (", false], [315, 0.029736, " of", false], [803, 0.025906, " more", false], [438, 0.024378, " as", false]]]}, "raw_delta": -0.09888203938802076, "tuned_delta": -0.09154490087431802}, {"byte_start": 792, "byte_end": 796, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 129, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "3.17% 3.17% 3.17% 3.17%", "qwen": "2.29% 2.29% 2.29% 2.29%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.4997093081474304]], "qwen": [[279, " the", "normal", 0.6019660830497742]]}, "loss": {"rwkv": 3.1699842207032884, "qwen": 2.2882684032718967}, "topk": {"rwkv": [22590, 1, 0.4997093081474304, [[22590, 0.499709, " the", false], [21835, 0.098858, " how", false], [32464, 0.059666, " what", false], [332, 0.050073, " a", false], [40186, 0.010261, " which", false], [45, 0.007527, ",", false], [39931, 0.007518, " their", false], [32074, 0.007477, " some", false], [57564, 0.006917, " whatever", false], [4419, 0.006742, " an", false]]], "qwen": [279, 1, 0.6019660830497742, [[279, 0.601966, " the", false], [1246, 0.100687, " how", false], [1128, 0.06234, " what", false], [264, 0.047222, " a", false], [458, 0.008219, " an", false], [7947, 0.007775, " domain", false], [3491, 0.007697, " problem", false], [5322, 0.007279, " problems", false], [15235, 0.006428, " AI", false], [3151, 0.005127, " specific", false]]]}, "raw_delta": 0.048892706632614136, "tuned_delta": 0.056229845146316876}, {"byte_start": 796, "byte_end": 803, "display": {"text": " domain", "kind": "normal"}, "is_word": true, "word_id": 130, "word_key": " domain", "bytes_hex": "20 64 6f 6d 61 69 6e", "compression": {"rwkv": "5.03% 5.03% 5.03% 5.03% 5.03% 5.03% 5.03%", "qwen": "6.36% 6.36% 6.36% 6.36% 6.36% 6.36% 6.36%"}, "model_tokens": {"rwkv": [[45775, " domain", "normal", 0.14286352694034576]], "qwen": [[7947, " domain", "normal", 0.08477343618869781]]}, "loss": {"rwkv": 5.031720985243315, "qwen": 6.357578236407423}, "topk": {"rwkv": [45775, 3, 0.14286352694034576, [[40213, 0.29963, " world", false], [52569, 0.204778, " problem", false], [45775, 0.142864, " domain", false], [32202, 0.076263, " task", false], [63536, 0.038653, " environment", false], [57074, 0.017546, " relevant", false], [60511, 0.012009, " situation", false], [47506, 0.010821, " target", false], [56939, 0.01058, " problems", false], [57271, 0.010262, " specific", false]]], "qwen": [7947, 5, 0.08477343618869781, [[3491, 0.312582, " problem", false], [1879, 0.210592, " world", false], [4573, 0.120185, " environment", false], [3383, 0.095531, " task", false], [7947, 0.084773, " domain", false], [3151, 0.011941, " specific", false], [1849, 0.011441, " system", false], [8315, 0.010717, " agent", false], [5322, 0.007905, " problems", false], [1931, 0.006768, " real", false]]]}, "raw_delta": -0.07352113723754883, "tuned_delta": -0.06618399872384609}, {"byte_start": 803, "byte_end": 804, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "28.60%", "qwen": "28.85%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.208240807056427]], "qwen": [[11, ",", "normal", 0.20195549726486206]]}, "loss": {"rwkv": 28.600302080123, "qwen": 28.848632129270083}, "topk": {"rwkv": [45, 1, 0.208240807056427, [[45, 0.208241, ",", false], [47, 0.186016, ".", false], [4596, 0.095621, " in", false], [4811, 0.094185, " to", false], [21265, 0.073866, " and", false], [32232, 0.047489, " they", false], [4706, 0.041489, " of", false], [275, 0.031251, " (", false], [60, 0.021387, ";", false], [4424, 0.017913, " at", false]]], "qwen": [11, 1, 0.20195549726486206, [[11, 0.201955, ",", false], [311, 0.127244, " to", false], [13, 0.126718, ".", false], [304, 0.109078, " in", false], [323, 0.086082, " and", false], [320, 0.048249, " (", false], [553, 0.0362, " by", false], [624, 0.020436, ".\n", false], [438, 0.017697, " as", false], [26, 0.017592, ";", false]]]}, "raw_delta": -0.013770341873168945, "tuned_delta": -0.006433203359466209}, {"byte_start": 804, "byte_end": 808, "display": {"text": " but", "kind": "normal"}, "is_word": true, "word_id": 131, "word_key": " but", "bytes_hex": "20 62 75 74", "compression": {"rwkv": "6.23% 6.23% 6.23% 6.23%", "qwen": "6.62% 6.62% 6.62% 6.62%"}, "model_tokens": {"rwkv": [[21400, " but", "normal", 0.251830130815506]], "qwen": [[714, " but", "normal", 0.23051802814006805]]}, "loss": {"rwkv": 6.234302300716467, "qwen": 6.615776481149479}, "topk": {"rwkv": [21400, 1, 0.251830130815506, [[21400, 0.25183, " but", false], [21265, 0.13823, " and", false], [40186, 0.110941, " which", false], [40187, 0.042451, " while", false], [4715, 0.036846, " or", false], [4811, 0.019201, " to", false], [47001, 0.018512, " rather", false], [22590, 0.017393, " the", false], [4596, 0.015413, " in", false], [39171, 0.014352, " often", false]]], "qwen": [714, 1, 0.23051802814006805, [[714, 0.230518, " but", false], [323, 0.130085, " and", false], [892, 0.082421, " which", false], [1393, 0.053377, " while", false], [476, 0.041299, " or", false], [3545, 0.026077, " often", false], [19853, 0.024233, " whereas", false], [438, 0.01806, " as", false], [304, 0.015485, " in", false], [311, 0.014344, " to", false]]]}, "raw_delta": -0.021153420209884644, "tuned_delta": -0.013816281696181907}, {"byte_start": 808, "byte_end": 812, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 132, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "10.71% 10.71% 10.71% 10.71%", "qwen": "11.14% 11.14% 11.14% 11.14%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.09366680681705475]], "qwen": [[279, " the", "normal", 0.08452223241329193]]}, "loss": {"rwkv": 10.707502256597774, "qwen": 11.139142163950115}, "topk": {"rwkv": [22590, 3, 0.09366680681705475, [[32234, 0.115817, " this", false], [4596, 0.115752, " in", false], [22590, 0.093667, " the", false], [31601, 0.050396, " over", false], [32227, 0.049087, " that", false], [4423, 0.032681, " as", false], [4588, 0.026327, " if", false], [45, 0.024461, ",", false], [4601, 0.02399, " it", false], [32232, 0.022225, " they", false]]], "qwen": [279, 3, 0.08452223241329193, [[304, 0.141637, " in", false], [419, 0.093016, " this", false], [279, 0.084522, " the", false], [11, 0.068891, ",", false], [916, 0.061476, " over", false], [438, 0.060623, " as", false], [979, 0.027856, " when", false], [432, 0.024868, " it", false], [429, 0.024163, " that", false], [421, 0.023443, " if", false]]]}, "raw_delta": -0.02393519878387451, "tuned_delta": -0.016598060270171775}, {"byte_start": 812, "byte_end": 817, "display": {"text": " only", "kind": "normal"}, "is_word": true, "word_id": 133, "word_key": " only", "bytes_hex": "20 6f 6e 6c 79", "compression": {"rwkv": "12.45% 12.45% 12.45% 12.45% 12.45%", "qwen": "15.16% 15.16% 15.16% 15.16% 15.16%"}, "model_tokens": {"rwkv": [[31581, " only", "normal", 0.03149599954485893]], "qwen": [[1172, " only", "normal", 0.014963667839765549]]}, "loss": {"rwkv": 12.454515782674253, "qwen": 15.155981426244061}, "topk": {"rwkv": [31581, 4, 0.03149599954485893, [[46470, 0.074251, " longer", false], [31323, 0.064428, " long", false], [31461, 0.032997, " most", false], [31581, 0.031496, " only", false], [57481, 0.025686, " ultimate", false], [31458, 0.023001, " more", false], [31835, 0.021642, " real", false], [30510, 0.018201, " cost", false], [46397, 0.017979, " larger", false], [45305, 0.016338, " bigger", false]]], "qwen": [1172, 7, 0.014963667839765549, [[5021, 0.128067, " longer", false], [1293, 0.036176, " long", false], [803, 0.031229, " more", false], [16724, 0.0267, " ultimate", false], [2783, 0.025294, " cost", false], [3491, 0.017783, " problem", false], [1172, 0.014964, " only", false], [1429, 0.012337, " most", false], [882, 0.012052, " time", false], [8131, 0.011567, " larger", false]]]}, "raw_delta": -0.1498010635375976, "tuned_delta": -0.14246392502389485}, {"byte_start": 817, "byte_end": 823, "display": {"text": " thing", "kind": "normal"}, "is_word": true, "word_id": 134, "word_key": " thing", "bytes_hex": "20 74 68 69 6e 67", "compression": {"rwkv": "9.11% 9.11% 9.11% 9.11% 9.11% 9.11%", "qwen": "7.54% 7.54% 7.54% 7.54% 7.54% 7.54%"}, "model_tokens": {"rwkv": [[39941, " thing", "normal", 0.048600438982248306]], "qwen": [[3166, " thing", "normal", 0.08142250776290894]]}, "loss": {"rwkv": 9.11076946394723, "qwen": 7.538392281036371}, "topk": {"rwkv": [39941, 2, 0.048600438982248306, [[22752, 0.497402, " way", false], [39941, 0.0486, " thing", false], [31835, 0.02257, " real", false], [47009, 0.020523, " reason", false], [31323, 0.019892, " long", false], [59593, 0.018681, " effective", false], [51832, 0.012703, " general", false], [56540, 0.011773, " leverage", false], [57075, 0.009731, " reliable", false], [46561, 0.007627, " method", false]]], "qwen": [3166, 2, 0.08142250776290894, [[1616, 0.515129, " way", false], [3166, 0.081423, " thing", false], [7373, 0.028958, " effective", false], [5510, 0.019747, " ways", false], [3900, 0.019326, " hope", false], [1931, 0.012952, " real", false], [15673, 0.011414, " improvement", false], [1714, 0.010554, " method", false], [5413, 0.007542, " methods", false], [1293, 0.00617, " long", false]]]}, "raw_delta": 0.08719110488891607, "tuned_delta": 0.09452824340261881}, {"byte_start": 823, "byte_end": 828, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 135, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"rwkv": "1.58% 1.58% 1.58% 1.58% 1.58%", "qwen": "1.79% 1.79% 1.79% 1.79% 1.79%"}, "model_tokens": {"rwkv": [[32227, " that", "normal", 0.6426860094070435]], "qwen": [[429, " that", "normal", 0.6083807945251465]]}, "loss": {"rwkv": 1.5779477009723035, "qwen": 1.7923837317548124}, "topk": {"rwkv": [32227, 1, 0.6426860094070435, [[32227, 0.642686, " that", false], [32232, 0.093175, " they", false], [4858, 0.021197, " we", false], [32234, 0.018932, " this", false], [31458, 0.012871, " more", false], [59206, 0.010524, " available", false], [22799, 0.00951, " you", false], [4811, 0.009117, " to", false], [52072, 0.008687, " keeping", false], [62364, 0.00796, " preventing", false]]], "qwen": [429, 1, 0.6083807945251465, [[429, 0.608381, " that", false], [807, 0.079125, " they", false], [582, 0.034568, " we", false], [12677, 0.025728, " humans", false], [279, 0.016112, " the", false], [419, 0.013132, " this", false], [803, 0.011792, " more", false], [3738, 0.009933, " human", false], [311, 0.009811, " to", false], [264, 0.008783, " a", false]]]}, "raw_delta": -0.01189085841178894, "tuned_delta": -0.004553719898086204}, {"byte_start": 828, "byte_end": 836, "display": {"text": " matters", "kind": "normal"}, "is_word": true, "word_id": 136, "word_key": " matters", "bytes_hex": "20 6d 61 74 74 65 72 73", "compression": {"rwkv": "3.65% 3.65% 3.65% 3.65% 3.65% 3.65% 3.65% 3.65%", "qwen": "6.37% 6.37% 6.37% 6.37% 6.37% 6.37% 6.37% 6.37%"}, "model_tokens": {"rwkv": [[52201, " matters", "normal", 0.2004719376564026]], "qwen": [[12850, " matters", "normal", 0.05914688482880592]]}, "loss": {"rwkv": 3.6454818538087816, "qwen": 6.374303165313985}, "topk": {"rwkv": [52201, 1, 0.2004719376564026, [[52201, 0.200472, " matters", false], [21413, 0.114818, " can", false], [4600, 0.064571, " is", false], [32475, 0.056278, " will", false], [38964, 0.047384, " makes", false], [47008, 0.033447, " really", false], [460, 0.032282, "'s", false], [56540, 0.018474, " leverage", false], [21800, 0.018424, " has", false], [56925, 0.016481, " prevents", false]]], "qwen": [12850, 4, 0.05914688482880592, [[646, 0.182452, " can", false], [686, 0.080467, " will", false], [374, 0.078371, " is", false], [12850, 0.059147, " matters", false], [3643, 0.056159, " makes", false], [2167, 0.040223, " really", false], [702, 0.032976, " has", false], [12677, 0.023099, " humans", false], [9428, 0.021145, " truly", false], [594, 0.017699, "'s", false]]]}, "raw_delta": -0.15131798386573792, "tuned_delta": -0.14398084535203517}, {"byte_start": 836, "byte_end": 839, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 137, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "3.05% 3.05% 3.05%", "qwen": "4.64% 4.64% 4.64%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.6060921549797058]], "qwen": [[304, " in", "normal", 0.46231386065483093]]}, "loss": {"rwkv": 3.052577397714278, "qwen": 4.637731458395485}, "topk": {"rwkv": [4596, 1, 0.6060921549797058, [[4596, 0.606092, " in", false], [4600, 0.101898, " is", false], [21700, 0.082263, " for", false], [31601, 0.048016, " over", false], [31323, 0.045813, " long", false], [4811, 0.013915, " to", false], [4712, 0.008529, " on", false], [4424, 0.008273, " at", false], [32465, 0.007842, " when", false], [46470, 0.007599, " longer", false]]], "qwen": [304, 1, 0.46231386065483093, [[304, 0.462314, " in", false], [374, 0.248756, " is", false], [369, 0.083671, " for", false], [311, 0.033057, " to", false], [1293, 0.031607, " long", false], [916, 0.020673, " over", false], [979, 0.019231, " when", false], [438, 0.009893, " as", false], [518, 0.007377, " at", false], [911, 0.006492, " about", false]]]}, "raw_delta": -0.08789960543314616, "tuned_delta": -0.08056246691944342}, {"byte_start": 839, "byte_end": 843, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 138, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "0.17% 0.17% 0.17% 0.17%", "qwen": "0.45% 0.45% 0.45% 0.45%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.9638855457305908]], "qwen": [[279, " the", "normal", 0.9055376052856445]]}, "loss": {"rwkv": 0.16620403379381823, "qwen": 0.44735475489420745}, "topk": {"rwkv": [22590, 1, 0.9638855457305908, [[22590, 0.963886, " the", false], [332, 0.006474, " a", false], [39920, 0.003357, " terms", false], [56901, 0.003055, " practice", false], [32234, 0.002919, " this", false], [31323, 0.001549, " long", false], [32227, 0.001487, " that", false], [46470, 0.001411, " longer", false], [3609, 0.001314, " AI", false], [4419, 0.001299, " an", false]]], "qwen": [279, 1, 0.9055376052856445, [[279, 0.905538, " the", false], [3793, 0.022919, " terms", false], [264, 0.016748, " a", false], [419, 0.00897, " this", false], [15235, 0.003279, " AI", false], [1293, 0.00291, " long", false], [220, 0.002771, " ", false], [5021, 0.00245, " longer", false], [6588, 0.002284, " practice", false], [458, 0.002251, " an", false]]]}, "raw_delta": -0.015590306371450424, "tuned_delta": -0.008253167857747688}, {"byte_start": 843, "byte_end": 848, "display": {"text": " long", "kind": "normal"}, "is_word": true, "word_id": 139, "word_key": " long", "bytes_hex": "20 6c 6f 6e 67", "compression": {"rwkv": "2.13% 2.13% 2.13% 2.13% 2.13%", "qwen": "1.11% 1.11% 1.11% 1.11% 1.11%"}, "model_tokens": {"rwkv": [[31323, " long", "normal", 0.5550923943519592]], "qwen": [[1293, " long", "normal", 0.7342362403869629]]}, "loss": {"rwkv": 2.1274116325608734, "qwen": 1.1142093816195549}, "topk": {"rwkv": [31323, 1, 0.5550923943519592, [[31323, 0.555092, " long", false], [46470, 0.401848, " longer", false], [21616, 0.010697, " end", false], [32386, 0.003662, " very", false], [39675, 0.003292, " short", false], [52888, 0.002522, " shorter", false], [46536, 0.002027, " medium", false], [51310, 0.001605, " context", false], [46397, 0.001583, " larger", false], [46064, 0.001403, " future", false]]], "qwen": [1293, 1, 0.7342362403869629, [[1293, 0.734236, " long", false], [5021, 0.195004, " longer", false], [835, 0.021934, " end", false], [11051, 0.00635, " medium", false], [1602, 0.005318, " very", false], [2805, 0.003325, " short", false], [3853, 0.00324, " future", false], [3930, 0.002214, " limit", false], [8131, 0.001688, " larger", false], [2266, 0.001613, " context", false]]]}, "raw_delta": 0.05618386268615723, "tuned_delta": 0.06352100119985997}, {"byte_start": 848, "byte_end": 852, "display": {"text": " run", "kind": "normal"}, "is_word": true, "word_id": 140, "word_key": " run", "bytes_hex": "20 72 75 6e", "compression": {"rwkv": "3.12% 3.12% 3.12% 3.12%", "qwen": "5.04% 5.04% 5.04% 5.04%"}, "model_tokens": {"rwkv": [[22418, " run", "normal", 0.5008130669593811]], "qwen": [[1598, " run", "normal", 0.3270103633403778]]}, "loss": {"rwkv": 3.1171511503582336, "qwen": 5.0393491068108025}, "topk": {"rwkv": [22418, 1, 0.5008130669593811, [[22418, 0.500813, " run", false], [32219, 0.46085, " term", false], [46, 0.026011, "-", false], [31057, 0.003534, " haul", false], [30941, 0.001865, " game", false], [27132, 0.00141, "term", false], [32398, 0.0004, " view", false], [32186, 0.000369, " tail", false], [8661, 0.00035, "run", false], [45, 0.000263, ",", false]]], "qwen": [1598, 2, 0.3270103633403778, [[4647, 0.632555, " term", false], [1598, 0.32701, " run", false], [9663, 0.027619, "-term", false], [22973, 0.003781, "-run", false], [37868, 0.001621, " haul", false], [4991, 0.00115, "term", false], [1809, 0.000715, " game", false], [11, 0.000508, ",", false], [882, 0.000435, " time", false], [1651, 0.000375, " view", false]]]}, "raw_delta": -0.10658928751945496, "tuned_delta": -0.09925214900575222}, {"byte_start": 852, "byte_end": 855, "display": {"text": " is", "kind": "normal"}, "is_word": true, "word_id": 141, "word_key": " is", "bytes_hex": "20 69 73", "compression": {"rwkv": "0.41% 0.41% 0.41%", "qwen": "0.50% 0.50% 0.50%"}, "model_tokens": {"rwkv": [[4600, " is", "normal", 0.9338439106941223]], "qwen": [[374, " is", "normal", 0.9206897020339966]]}, "loss": {"rwkv": 0.4109238804615374, "qwen": 0.49672136711353176}, "topk": {"rwkv": [4600, 1, 0.9338439106941223, [[4600, 0.933844, " is", false], [21286, 0.024813, " are", false], [45, 0.015871, ",", false], [275, 0.005717, " (", false], [21700, 0.004262, " for", false], [4596, 0.002424, " in", false], [32475, 0.001577, " will", false], [37598, 0.000889, " about", false], [4601, 0.000624, " it", false], [4706, 0.000574, " of", false]]], "qwen": [374, 1, 0.9206897020339966, [[374, 0.92069, " is", false], [525, 0.025628, " are", false], [11, 0.016065, ",", false], [320, 0.009669, " (", false], [369, 0.004831, " for", false], [304, 0.00204, " in", false], [323, 0.002032, " and", false], [311, 0.001394, " to", false], [686, 0.00132, " will", false], [979, 0.001138, " when", false]]]}, "raw_delta": -0.004757622877756756, "tuned_delta": 0.002579515635945981}, {"byte_start": 855, "byte_end": 859, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 142, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "5.49% 5.49% 5.49% 5.49%", "qwen": "8.19% 8.19% 8.19% 8.19%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.29750856757164]], "qwen": [[279, " the", "normal", 0.16274243593215942]]}, "loss": {"rwkv": 5.4946393158857, "qwen": 8.185430426273081}, "topk": {"rwkv": [22590, 1, 0.29750856757164, [[22590, 0.297509, " the", false], [21835, 0.162856, " how", false], [32227, 0.111396, " that", false], [53342, 0.071444, " whether", false], [32464, 0.040439, " what", false], [38888, 0.034863, " lever", false], [40186, 0.020081, " which", false], [332, 0.011432, " a", false], [63370, 0.010117, " computation", false], [37832, 0.00981, " being", false]]], "qwen": [279, 1, 0.16274243593215942, [[279, 0.162742, " the", false], [76482, 0.093711, " leveraging", false], [311, 0.092522, " to", false], [34447, 0.065545, " computation", false], [1246, 0.045012, " how", false], [429, 0.041316, " that", false], [264, 0.034883, " a", false], [3425, 0.029197, " whether", false], [4586, 0.025029, " general", false], [1128, 0.024177, " what", false]]]}, "raw_delta": -0.1492091417312622, "tuned_delta": -0.14187200321755947}, {"byte_start": 859, "byte_end": 870, "display": {"text": " leveraging", "kind": "normal"}, "is_word": true, "word_id": 143, "word_key": " leveraging", "bytes_hex": "20 6c 65 76 65 72 61 67 69 6e 67", "compression": {"rwkv": "15.03% 15.03% 15.03% 15.03% 15.03% 15.03% 0.65% 0.65% 0.65% 0.65% 0.65%", "qwen": "9.31% 9.31% 9.31% 9.31% 9.31% 9.31% 9.31% 9.31% 9.31% 9.31% 9.31%"}, "model_tokens": {"rwkv": [[38888, " lever", "normal", 0.006670437753200531], [33672, "aging", "normal", 0.8370016813278198]], "qwen": [[76482, " leveraging", "normal", 0.0034172760788351297]]}, "loss": {"rwkv": 8.49171530636881, "qwen": 9.31015572616661}, "topk": {"rwkv": [38888, 31, 0.006670437753200531, [[50836, 0.067179, " ability", false], [30510, 0.055712, " cost", false], [45157, 0.045241, " amount", false], [63621, 0.030324, " improvement", false], [39984, 0.021354, " total", false], [31830, 0.020858, " rate", false], [64264, 0.019319, " availability", false], [51832, 0.018484, " general", false], [63370, 0.018444, " computation", false], [56540, 0.018008, " leverage", false]]], "qwen": [76482, 47, 0.0034172760788351297, [[5726, 0.169427, " ability", false], [990, 0.040495, " use", false], [4586, 0.040453, " general", false], [34447, 0.029547, " computation", false], [3311, 0.026409, " amount", false], [4401, 0.021444, " development", false], [54480, 0.017618, " computational", false], [4271, 0.015834, " quality", false], [15673, 0.014703, " improvement", false], [12111, 0.014498, " algorithm", false]]]}, "raw_delta": -0.045383973555131414, "tuned_delta": -0.03804683504142868}, {"byte_start": 870, "byte_end": 873, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 144, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "0.18% 0.18% 0.18%", "qwen": "0.09% 0.09% 0.09%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.9696750044822693]], "qwen": [[315, " of", "normal", 0.9853333830833435]]}, "loss": {"rwkv": 0.18418195356401051, "qwen": 0.08881744489753073}, "topk": {"rwkv": [4706, 1, 0.9696750044822693, [[4706, 0.969675, " of", false], [22590, 0.004793, " the", false], [32227, 0.004511, " that", false], [63370, 0.002537, " computation", false], [31458, 0.001477, " more", false], [59206, 0.001291, " available", false], [21265, 0.00084, " and", false], [39339, 0.00065, " power", false], [38720, 0.000465, " human", false], [51832, 0.000454, " general", false]]], "qwen": [315, 1, 0.9853333830833435, [[315, 0.985333, " of", false], [279, 0.002407, " the", false], [323, 0.002221, " and", false], [429, 0.000901, " that", false], [320, 0.000591, " (", false], [34447, 0.000498, " computation", false], [11, 0.000456, ",", false], [2355, 0.000411, " power", false], [476, 0.000368, " or", false], [862, 0.000324, " their", false]]]}, "raw_delta": 0.005288131224612395, "tuned_delta": 0.012625269738315133}, {"byte_start": 873, "byte_end": 885, "display": {"text": " computation", "kind": "normal"}, "is_word": true, "word_id": 145, "word_key": " computation", "bytes_hex": "20 63 6f 6d 70 75 74 61 74 69 6f 6e", "compression": {"rwkv": "1.76% 1.76% 1.76% 1.76% 1.76% 1.76% 1.76% 1.76% 1.76% 1.76% 1.76% 1.76%", "qwen": "1.52% 1.52% 1.52% 1.52% 1.52% 1.52% 1.52% 1.52% 1.52% 1.52% 1.52% 1.52%"}, "model_tokens": {"rwkv": [[63370, " computation", "normal", 0.3080097734928131]], "qwen": [[34447, " computation", "normal", 0.3631451427936554]]}, "loss": {"rwkv": 1.7611023448351601, "qwen": 1.5222727248108976}, "topk": {"rwkv": [63370, 1, 0.3080097734928131, [[63370, 0.30801, " computation", false], [22590, 0.137894, " the", false], [30789, 0.054023, " ever", false], [31458, 0.053865, " more", false], [64862, 0.024949, " computational", false], [52195, 0.022591, " massive", false], [59988, 0.021915, " massively", false], [51832, 0.021304, " general", false], [64430, 0.019532, " increasingly", false], [21256, 0.015355, " all", false]]], "qwen": [34447, 1, 0.3631451427936554, [[34447, 0.363145, " computation", false], [279, 0.183433, " the", false], [54480, 0.059844, " computational", false], [10951, 0.026548, " massive", false], [419, 0.025934, " this", false], [2500, 0.025503, " available", false], [803, 0.013521, " more", false], [3512, 0.012963, " ever", false], [74151, 0.012141, " exponentially", false], [678, 0.009145, " all", false]]]}, "raw_delta": 0.013243526220321655, "tuned_delta": 0.020580664734024392}, {"byte_start": 885, "byte_end": 886, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "6.97%", "qwen": "20.20%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.6808716058731079]], "qwen": [[13, ".", "normal", 0.3262180685997009]]}, "loss": {"rwkv": 6.9739652855472345, "qwen": 20.201142364273302}, "topk": {"rwkv": [47, 1, 0.6808716058731079, [[47, 0.680872, ".", false], [45, 0.104497, ",", false], [32227, 0.028153, " that", false], [4811, 0.027379, " to", false], [21265, 0.020502, " and", false], [275, 0.014348, " (", false], [59206, 0.013714, " available", false], [46342, 0.011324, " itself", false], [4596, 0.010396, " in", false], [4423, 0.00735, " as", false]]], "qwen": [13, 2, 0.3262180685997009, [[624, 0.391796, ".\n", false], [13, 0.326218, ".", false], [11, 0.057867, ",", false], [5086, 0.030455, " itself", false], [311, 0.021595, " to", false], [382, 0.019031, ".\n\n", false], [304, 0.014615, " in", false], [320, 0.014332, " (", false], [2355, 0.011719, " power", false], [323, 0.011194, " and", false]]]}, "raw_delta": -0.7334704399108887, "tuned_delta": -0.7261333013971859}, {"byte_start": 886, "byte_end": 892, "display": {"text": " These", "kind": "normal"}, "is_word": true, "word_id": 146, "word_key": " these", "bytes_hex": "20 54 68 65 73 65", "compression": {"rwkv": "22.17% 22.17% 22.17% 22.17% 22.17% 22.17%", "qwen": "18.64% 18.64% 18.64% 18.64% 18.64% 18.64%"}, "model_tokens": {"rwkv": [[37453, " These", "normal", 0.0006089022499509156]], "qwen": [[4220, " These", "normal", 0.0020231707021594048]]}, "loss": {"rwkv": 22.166408180325217, "qwen": 18.64409600149811}, "topk": {"rwkv": [37453, 88, 0.0006089022499509156, [[11, 0.346385, "\n", false], [261, 0.145787, "\n\n", false], [20996, 0.072186, " The", false], [29894, 0.04926, " This", false], [3913, 0.023112, " In", false], [3908, 0.017988, " If", false], [3918, 0.017334, " It", false], [19417, 0.014145, " And", false], [3641, 0.013493, " As", false], [0, 0.013404, "[0]", false]]], "qwen": [4220, 65, 0.0020231707021594048, [[1096, 0.122805, " This", false], [576, 0.101877, " The", false], [758, 0.053649, " In", false], [1084, 0.03342, " It", false], [151643, 0.031468, "\u003c|endoftext|\u003e", false], [1597, 0.031053, " And", false], [1634, 0.027537, " As", false], [2938, 0.021748, " That", false], [2055, 0.020372, " So", false], [1416, 0.020039, " If", false]]]}, "raw_delta": 0.19531846046447754, "tuned_delta": 0.20265559897818028}, {"byte_start": 892, "byte_end": 896, "display": {"text": " two", "kind": "normal"}, "is_word": true, "word_id": 147, "word_key": " two", "bytes_hex": "20 74 77 6f", "compression": {"rwkv": "10.07% 10.07% 10.07% 10.07%", "qwen": "9.48% 9.48% 9.48% 9.48%"}, "model_tokens": {"rwkv": [[22638, " two", "normal", 0.1077016070485115]], "qwen": [[1378, " two", "normal", 0.122063048183918]]}, "loss": {"rwkv": 10.073505412457116, "qwen": 9.482192512477472}, "topk": {"rwkv": [22638, 3, 0.1077016070485115, [[52127, 0.146012, " lessons", false], [21286, 0.122184, " are", false], [22638, 0.107702, " two", false], [30582, 0.057521, " days", false], [52738, 0.040241, " results", false], [64495, 0.024175, " observations", false], [56463, 0.022977, " insights", false], [47539, 0.021141, " things", false], [38735, 0.018038, " ideas", false], [51832, 0.01765, " general", false]]], "qwen": [1378, 2, 0.122063048183918, [[18366, 0.141717, " lessons", false], [1378, 0.122063, " two", false], [2849, 0.100338, " days", false], [525, 0.08124, " are", false], [4586, 0.054305, " general", false], [23722, 0.028487, " observations", false], [25709, 0.026367, " insights", false], [6708, 0.024223, " ideas", false], [16170, 0.021039, " principles", false], [5413, 0.017733, " methods", false]]]}, "raw_delta": 0.03278934955596924, "tuned_delta": 0.04012648806967198}, {"byte_start": 896, "byte_end": 901, "display": {"text": " need", "kind": "normal"}, "is_word": true, "word_id": 148, "word_key": " need", "bytes_hex": "20 6e 65 65 64", "compression": {"rwkv": "39.45% 39.45% 39.45% 39.45% 39.45%", "qwen": "30.38% 30.38% 30.38% 30.38% 30.38%"}, "model_tokens": {"rwkv": [[31506, " need", "normal", 1.74155538843479e-05]], "qwen": [[1184, " need", "normal", 0.00021952726820018142]]}, "loss": {"rwkv": 39.44869252430759, "qwen": 30.38328061814791}, "topk": {"rwkv": [31506, 1077, 1.74155538843479e-05, [[52127, 0.174941, " lessons", false], [46853, 0.101062, " points", false], [38440, 0.085588, " facts", false], [51703, 0.055023, " factors", false], [47539, 0.051902, " things", false], [64495, 0.041187, " observations", false], [38735, 0.040776, " ideas", false], [62370, 0.025653, " principles", false], [56463, 0.023427, " insights", false], [47613, 0.02007, " trends", false]]], "qwen": [1184, 323, 0.00021952726820018142, [[18366, 0.094548, " lessons", false], [6708, 0.061324, " ideas", false], [9363, 0.049633, " factors", false], [2513, 0.046846, " things", false], [23722, 0.043611, " observations", false], [3501, 0.031732, " points", false], [16170, 0.03025, " principles", false], [525, 0.028089, " are", false], [12239, 0.026806, " statements", false], [13064, 0.024781, " facts", false]]]}, "raw_delta": 0.5026931762695312, "tuned_delta": 0.510030314783234}, {"byte_start": 901, "byte_end": 905, "display": {"text": " not", "kind": "normal"}, "is_word": true, "word_id": 149, "word_key": " not", "bytes_hex": "20 6e 6f 74", "compression": {"rwkv": "1.66% 1.66% 1.66% 1.66%", "qwen": "2.32% 2.32% 2.32% 2.32%"}, "model_tokens": {"rwkv": [[22187, " not", "normal", 0.6915689706802368]], "qwen": [[537, " not", "normal", 0.59713214635849]]}, "loss": {"rwkv": 1.6642417158692264, "qwen": 2.324618280146211}, "topk": {"rwkv": [22187, 1, 0.6915689706802368, [[22187, 0.691569, " not", false], [4811, 0.235217, " to", false], [111, 0.041012, "n", false], [30719, 0.011426, " each", false], [122, 0.00359, "y", false], [4435, 0.001611, " be", false], [4692, 0.001215, " no", false], [39115, 0.001136, " never", false], [31581, 0.000939, " only", false], [46, 0.000854, "-", false]]], "qwen": [537, 1, 0.59713214635849, [[537, 0.597132, " not", false], [311, 0.290475, " to", false], [77, 0.057425, "n", false], [1817, 0.022967, " each", false], [2581, 0.006973, " never", false], [387, 0.004935, " be", false], [1172, 0.002542, " only", false], [264, 0.002226, " a", false], [1045, 0.000731, " some", false], [279, 0.000689, " the", false]]]}, "raw_delta": -0.03661905229091644, "tuned_delta": -0.029281913777213706}, {"byte_start": 905, "byte_end": 909, "display": {"text": " run", "kind": "normal"}, "is_word": true, "word_id": 150, "word_key": " run", "bytes_hex": "20 72 75 6e", "compression": {"rwkv": "28.88% 28.88% 28.88% 28.88%", "qwen": "29.47% 29.47% 29.47% 29.47%"}, "model_tokens": {"rwkv": [[22418, " run", "normal", 0.0016423269407823682]], "qwen": [[1598, " run", "normal", 0.0014501496916636825]]}, "loss": {"rwkv": 28.88207845529663, "qwen": 29.467445055122692}, "topk": {"rwkv": [22418, 22, 0.0016423269407823682, [[4435, 0.711506, " be", false], [55824, 0.079605, " conflict", false], [51255, 0.034128, " compete", false], [63717, 0.022092, " necessarily", false], [61779, 0.019742, " contradict", false], [4559, 0.018441, " go", false], [45150, 0.013224, " always", false], [30788, 0.0077, " even", false], [30482, 0.004462, " come", false], [55769, 0.003619, " coincide", false]]], "qwen": [1598, 23, 0.0014501496916636825, [[387, 0.701583, " be", false], [2677, 0.060365, " always", false], [12055, 0.055626, " conflict", false], [728, 0.034565, " go", false], [14312, 0.01243, " necessarily", false], [42461, 0.012189, " contradict", false], [2525, 0.007426, " come", false], [614, 0.006855, " have", false], [20259, 0.006407, " compete", false], [2803, 0.005127, " seem", false]]]}, "raw_delta": -0.03245961666107178, "tuned_delta": -0.02512247814736904}, {"byte_start": 909, "byte_end": 917, "display": {"text": " counter", "kind": "normal"}, "is_word": true, "word_id": 151, "word_key": " counter", "bytes_hex": "20 63 6f 75 6e 74 65 72", "compression": {"rwkv": "6.97% 6.97% 6.97% 6.97% 6.97% 6.97% 6.97% 6.97%", "qwen": "8.42% 8.42% 8.42% 8.42% 8.42% 8.42% 8.42% 8.42%"}, "model_tokens": {"rwkv": [[51336, " counter", "normal", 0.0456528440117836]], "qwen": [[5546, " counter", "normal", 0.02388518676161766]]}, "loss": {"rwkv": 6.9739652855472345, "qwen": 8.418343843107662}, "topk": {"rwkv": [51336, 5, 0.0456528440117836, [[4596, 0.649332, " in", false], [56812, 0.08121, " parallel", false], [57435, 0.058403, " together", false], [64301, 0.050189, " concurrently", false], [51336, 0.045653, " counter", false], [65167, 0.023828, " simultaneously", false], [4424, 0.009536, " at", false], [31162, 0.008869, " into", false], [56131, 0.00564, " entirely", false], [31044, 0.005572, " hand", false]]], "qwen": [5546, 6, 0.02388518676161766, [[304, 0.442034, " in", false], [15279, 0.205334, " parallel", false], [1424, 0.089002, " hand", false], [78026, 0.040503, " concurrently", false], [3108, 0.029114, " side", false], [5546, 0.023885, " counter", false], [518, 0.021003, " at", false], [3786, 0.014364, " together", false], [1119, 0.01417, " into", false], [700, 0.013769, " out", false]]]}, "raw_delta": -0.08009335398674011, "tuned_delta": -0.07275621547303737}, {"byte_start": 917, "byte_end": 920, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 152, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "1.48% 1.48% 1.48%", "qwen": "2.00% 2.00% 2.00%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.7822018265724182]], "qwen": [[311, " to", "normal", 0.717501699924469]]}, "loss": {"rwkv": 1.4793259696615346, "qwen": 1.9956076760817911}, "topk": {"rwkv": [4811, 1, 0.7822018265724182, [[4811, 0.782202, " to", false], [45, 0.083101, ",", false], [60, 0.02423, ";", false], [59, 0.022022, ":", false], [47, 0.021087, ".", false], [46, 0.017517, "-", false], [21400, 0.00491, " but", false], [30719, 0.003971, " each", false], [9816, 0.003615, "—", false], [4596, 0.002958, " in", false]]], "qwen": [311, 1, 0.717501699924469, [[311, 0.717502, " to", false], [11, 0.076769, ",", false], [13, 0.03808, ".", false], [26, 0.031395, ";", false], [304, 0.01582, " in", false], [25, 0.01469, ":", false], [624, 0.010889, ".\n", false], [396, 0.009218, "int", false], [20052, 0.006652, "-int", false], [1576, 0.006468, " because", false]]]}, "raw_delta": -0.02862873673439026, "tuned_delta": -0.021291598220687522}, {"byte_start": 920, "byte_end": 925, "display": {"text": " each", "kind": "normal"}, "is_word": true, "word_id": 153, "word_key": " each", "bytes_hex": "20 65 61 63 68", "compression": {"rwkv": "1.31% 1.31% 1.31% 1.31% 1.31%", "qwen": "1.14% 1.14% 1.14% 1.14% 1.14%"}, "model_tokens": {"rwkv": [[30719, " each", "normal", 0.6956994533538818]], "qwen": [[1817, " each", "normal", 0.7294825911521912]]}, "loss": {"rwkv": 1.3102601445573594, "qwen": 1.1376362133851459}, "topk": {"rwkv": [30719, 1, 0.6956994533538818, [[30719, 0.695699, " each", false], [22226, 0.298829, " one", false], [22590, 0.001742, " the", false], [332, 0.000639, " a", false], [21273, 0.000315, " any", false], [50919, 0.000278, " another", false], [39193, 0.000204, " other", false], [45, 0.000186, ",", false], [38720, 0.000176, " human", false], [4419, 0.000105, " an", false]]], "qwen": [1817, 1, 0.7294825911521912, [[1817, 0.729483, " each", false], [825, 0.256977, " one", false], [279, 0.003538, " the", false], [264, 0.001226, " a", false], [5577, 0.000648, " themselves", false], [862, 0.000487, " their", false], [894, 0.000421, " any", false], [2987, 0.00039, " either", false], [1008, 0.000318, " other", false], [387, 0.000254, " be", false]]]}, "raw_delta": 0.009572303295135504, "tuned_delta": 0.01690944180883824}, {"byte_start": 925, "byte_end": 931, "display": {"text": " other", "kind": "normal"}, "is_word": true, "word_id": 154, "word_key": " other", "bytes_hex": "20 6f 74 68 65 72", "compression": {"rwkv": "0.01% 0.01% 0.01% 0.01% 0.01% 0.01%", "qwen": "0.01% 0.01% 0.01% 0.01% 0.01% 0.01%"}, "model_tokens": {"rwkv": [[39193, " other", "normal", 0.995051920413971]], "qwen": [[1008, " other", "normal", 0.9954625964164734]]}, "loss": {"rwkv": 0.014859301034546664, "qwen": 0.013668722862061278}, "topk": {"rwkv": [39193, 1, 0.995051920413971, [[39193, 0.995052, " other", false], [46, 0.0013, "-", false], [35297, 0.001039, "other", false], [50919, 0.000662, " another", false], [46726, 0.000546, " others", false], [45, 0.000415, ",", false], [47, 0.000112, ".", false], [11, 7.1e-05, "\n", false], [4811, 5.3e-05, " to", false], [4596, 5.3e-05, " in", false]]], "qwen": [1008, 1, 0.9954625964164734, [[1008, 0.995463, " other", false], [1575, 0.001111, "other", false], [2441, 0.0007, " another", false], [72472, 0.000452, "-other", false], [11, 0.000449, ",", false], [3800, 0.000196, " others", false], [13, 0.000177, ".", false], [26, 0.000133, ";", false], [198, 9.8e-05, "\n", false], [304, 9.2e-05, " in", false]]]}, "raw_delta": 6.601967227955663e-05, "tuned_delta": 0.007403158185982293}, {"byte_start": 931, "byte_end": 932, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "17.12%", "qwen": "18.97%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.38150742650032043]], "qwen": [[11, ",", "normal", 0.34930193424224854]]}, "loss": {"rwkv": 17.11791479179776, "qwen": 18.968168643273927}, "topk": {"rwkv": [45, 1, 0.38150742650032043, [[45, 0.381507, ",", false], [47, 0.189391, ".", false], [59, 0.120424, ":", false], [60, 0.111213, ";", false], [21400, 0.019748, " but", false], [280, 0.014641, " -", false], [4596, 0.014301, " in", false], [275, 0.014202, " (", false], [51018, 0.013625, " because", false], [4423, 0.011757, " as", false]]], "qwen": [11, 1, 0.34930193424224854, [[11, 0.349302, ",", false], [13, 0.165296, ".", false], [26, 0.099456, ";", false], [25, 0.069394, ":", false], [624, 0.048078, ".\n", false], [304, 0.028062, " in", false], [438, 0.026407, " as", false], [323, 0.024873, " and", false], [1576, 0.023704, " because", false], [714, 0.02264, " but", false]]]}, "raw_delta": -0.1025998592376709, "tuned_delta": -0.09526272072396816}, {"byte_start": 932, "byte_end": 936, "display": {"text": " but", "kind": "normal"}, "is_word": true, "word_id": 155, "word_key": " but", "bytes_hex": "20 62 75 74", "compression": {"rwkv": "4.61% 4.61% 4.61% 4.61%", "qwen": "5.57% 5.57% 5.57% 5.57%"}, "model_tokens": {"rwkv": [[21400, " but", "normal", 0.3602905869483948]], "qwen": [[714, " but", "normal", 0.2908656597137451]]}, "loss": {"rwkv": 4.61408814346812, "qwen": 5.567422373730841}, "topk": {"rwkv": [21400, 1, 0.3602905869483948, [[21400, 0.360291, " but", false], [4423, 0.145208, " as", false], [21265, 0.077879, " and", false], [51948, 0.058812, " however", false], [39690, 0.058614, " since", false], [47544, 0.047032, " though", false], [51018, 0.044716, " because", false], [4596, 0.035663, " in", false], [4706, 0.024838, " of", false], [21700, 0.014742, " for", false]]], "qwen": [714, 1, 0.2908656597137451, [[714, 0.290866, " but", false], [323, 0.15414, " and", false], [438, 0.137591, " as", false], [4764, 0.078339, " however", false], [3498, 0.045718, " though", false], [315, 0.043956, " of", false], [304, 0.034507, " in", false], [1576, 0.03194, " because", false], [2474, 0.028332, " since", false], [369, 0.015484, " for", false]]]}, "raw_delta": -0.05286407470703125, "tuned_delta": -0.04552693619332851}, {"byte_start": 936, "byte_end": 939, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 156, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "19.44% 19.44% 19.44%", "qwen": "16.65% 16.65% 16.65%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.03926531597971916]], "qwen": [[304, " in", "normal", 0.06268417090177536]]}, "loss": {"rwkv": 19.44256988698017, "qwen": 16.64897829682268}, "topk": {"rwkv": [4596, 4, 0.03926531597971916, [[32232, 0.257525, " they", false], [4601, 0.09722, " it", false], [22590, 0.086384, " the", false], [4596, 0.039265, " in", false], [4588, 0.02383, " if", false], [39934, 0.021568, " there", false], [21286, 0.020547, " are", false], [21700, 0.017478, " for", false], [47001, 0.015481, " rather", false], [22226, 0.014887, " one", false]]], "qwen": [304, 3, 0.06268417090177536, [[807, 0.221437, " they", false], [279, 0.135123, " the", false], [304, 0.062684, " in", false], [432, 0.059239, " it", false], [421, 0.030862, " if", false], [1052, 0.027152, " there", false], [979, 0.017533, " when", false], [438, 0.017005, " as", false], [825, 0.016756, " one", false], [11, 0.015249, ",", false]]]}, "raw_delta": 0.15490961074829102, "tuned_delta": 0.16224674926199376}, {"byte_start": 939, "byte_end": 948, "display": {"text": " practice", "kind": "normal"}, "is_word": true, "word_id": 157, "word_key": " practice", "bytes_hex": "20 70 72 61 63 74 69 63 65", "compression": {"rwkv": "2.43% 2.43% 2.43% 2.43% 2.43% 2.43% 2.43% 2.43% 2.43%", "qwen": "3.59% 3.59% 3.59% 3.59% 3.59% 3.59% 3.59% 3.59% 3.59%"}, "model_tokens": {"rwkv": [[56901, " practice", "normal", 0.3003268241882324]], "qwen": [[6588, " practice", "normal", 0.16660629212856293]]}, "loss": {"rwkv": 2.4264076751062214, "qwen": 3.5909516491104214}, "topk": {"rwkv": [56901, 2, 0.3003268241882324, [[22590, 0.315525, " the", false], [56901, 0.300327, " practice", false], [31370, 0.037434, " many", false], [30808, 0.036834, " fact", false], [31461, 0.034533, " most", false], [332, 0.022626, " a", false], [39189, 0.021526, " order", false], [51832, 0.019543, " general", false], [32074, 0.018971, " some", false], [32234, 0.013494, " this", false]]], "qwen": [6588, 2, 0.16660629212856293, [[279, 0.245173, " the", false], [6588, 0.166606, " practice", false], [2097, 0.10056, " fact", false], [4586, 0.077328, " general", false], [1657, 0.065613, " many", false], [1429, 0.044612, " most", false], [1973, 0.030774, " order", false], [264, 0.029953, " a", false], [894, 0.020458, " any", false], [847, 0.018656, " my", false]]]}, "raw_delta": -0.06457602977752686, "tuned_delta": -0.057238891263824115}, {"byte_start": 948, "byte_end": 953, "display": {"text": " they", "kind": "normal"}, "is_word": true, "word_id": 158, "word_key": " they", "bytes_hex": "20 74 68 65 79", "compression": {"rwkv": "3.66% 3.66% 3.66% 3.66% 3.66%", "qwen": "3.45% 3.45% 3.45% 3.45% 3.45%"}, "model_tokens": {"rwkv": [[32232, " they", "normal", 0.3613346219062805]], "qwen": [[807, " they", "normal", 0.3845542073249817]]}, "loss": {"rwkv": 3.6630928772571334, "qwen": 3.4468526409779168}, "topk": {"rwkv": [32232, 1, 0.3613346219062805, [[32232, 0.361335, " they", false], [45, 0.129498, ",", false], [22590, 0.097437, " the", false], [4601, 0.067404, " it", false], [39934, 0.032399, " there", false], [32234, 0.025096, " this", false], [31461, 0.018627, " most", false], [63843, 0.016978, " researchers", false], [4858, 0.01596, " we", false], [31370, 0.013023, " many", false]]], "qwen": [807, 1, 0.3845542073249817, [[807, 0.384554, " they", false], [11, 0.197659, ",", false], [279, 0.096124, " the", false], [432, 0.056831, " it", false], [1052, 0.02848, " there", false], [419, 0.017806, " this", false], [825, 0.012207, " one", false], [1429, 0.008678, " most", false], [11811, 0.008366, " researchers", false], [582, 0.007938, " we", false]]]}, "raw_delta": 0.011990904808044434, "tuned_delta": 0.01932804332174717}, {"byte_start": 953, "byte_end": 958, "display": {"text": " tend", "kind": "normal"}, "is_word": true, "word_id": 159, "word_key": " tend", "bytes_hex": "20 74 65 6e 64", "compression": {"rwkv": "10.99% 10.99% 10.99% 10.99% 10.99%", "qwen": "9.85% 9.85% 9.85% 9.85% 9.85%"}, "model_tokens": {"rwkv": [[32216, " tend", "normal", 0.04663814976811409]], "qwen": [[8376, " tend", "normal", 0.06506852805614471]]}, "loss": {"rwkv": 10.9892786317714, "qwen": 9.854740040906607}, "topk": {"rwkv": [32216, 5, 0.04663814976811409, [[4491, 0.274393, " do", false], [31059, 0.185332, " have", false], [39171, 0.158644, " often", false], [21286, 0.087728, " are", false], [32216, 0.046638, " tend", false], [21413, 0.024764, " can", false], [31967, 0.021529, " seem", false], [60523, 0.018317, " sometimes", false], [53248, 0.014575, " usually", false], [45145, 0.010654, " almost", false]]], "qwen": [8376, 3, 0.06506852805614471, [[653, 0.352733, " do", false], [3545, 0.258844, " often", false], [8376, 0.065069, " tend", false], [614, 0.053291, " have", false], [525, 0.047206, " are", false], [646, 0.021988, " can", false], [686, 0.017243, " will", false], [5990, 0.016247, " usually", false], [13814, 0.015728, " frequently", false], [4558, 0.013145, " almost", false]]]}, "raw_delta": 0.06291217803955074, "tuned_delta": 0.07024931655325348}, {"byte_start": 958, "byte_end": 961, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 160, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "0.11% 0.11% 0.11%", "qwen": "0.10% 0.10% 0.10%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.9813953042030334]], "qwen": [[311, " to", "normal", 0.9841543436050415]]}, "loss": {"rwkv": 0.11227027448324146, "qwen": 0.09601448775983339}, "topk": {"rwkv": [4811, 1, 0.9813953042030334, [[4811, 0.981395, " to", false], [22187, 0.010584, " not", false], [47585, 0.001118, " toward", false], [53169, 0.000913, " towards", false], [4491, 0.000852, " do", false], [4596, 0.000531, " in", false], [21700, 0.000355, " for", false], [45, 0.000278, ",", false], [32227, 0.000243, " that", false], [22418, 0.00024, " run", false]]], "qwen": [311, 1, 0.9841543436050415, [[311, 0.984154, " to", false], [537, 0.008721, " not", false], [653, 0.002119, " do", false], [6974, 0.000615, " towards", false], [8841, 0.000587, " toward", false], [11, 0.000378, ",", false], [320, 0.000358, " (", false], [304, 0.000216, " in", false], [13, 0.000197, ".", false], [2238, 0.000171, " too", false]]]}, "raw_delta": 0.0009014122188091278, "tuned_delta": 0.008238550732511864}, {"byte_start": 961, "byte_end": 962, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "27.19%", "qwen": "33.55%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.22389283776283264]], "qwen": [[13, ".", "normal", 0.15557077527046204]]}, "loss": {"rwkv": 27.191420204254875, "qwen": 33.55446226805783}, "topk": {"rwkv": [47, 1, 0.22389283776283264, [[47, 0.223893, ".", false], [4491, 0.178426, " do", false], [4435, 0.118649, " be", false], [22418, 0.059203, " run", false], [45, 0.05003, ",", false], [4559, 0.021842, " go", false], [51255, 0.021358, " compete", false], [59, 0.020446, ":", false], [55824, 0.017613, " conflict", false], [31059, 0.013936, " have", false]]], "qwen": [13, 2, 0.15557077527046204, [[653, 0.266169, " do", false], [13, 0.155571, ".", false], [624, 0.094433, ".\n", false], [11, 0.067669, ",", false], [387, 0.065015, " be", false], [1598, 0.059061, " run", false], [12055, 0.045034, " conflict", false], [20259, 0.038881, " compete", false], [26, 0.013864, ";", false], [1576, 0.011937, " because", false]]]}, "raw_delta": -0.35284197330474854, "tuned_delta": -0.3455048347910458}, {"byte_start": 962, "byte_end": 967, "display": {"text": " Time", "kind": "normal"}, "is_word": true, "word_id": 161, "word_key": " time", "bytes_hex": "20 54 69 6d 65", "compression": {"rwkv": "30.66% 30.66% 30.66% 30.66% 30.66%", "qwen": "31.47% 31.47% 31.47% 31.47% 31.47%"}, "model_tokens": {"rwkv": [[29904, " Time", "normal", 0.00020828412380069494]], "qwen": [[4120, " Time", "normal", 0.00016235960356425494]]}, "loss": {"rwkv": 30.657269618890467, "qwen": 31.471297901954316}, "topk": {"rwkv": [29904, 219, 0.00020828412380069494, [[11, 0.373229, "\n", false], [261, 0.148338, "\n\n", false], [20996, 0.073175, " The", false], [19907, 0.022584, " For", false], [3913, 0.021781, " In", false], [29894, 0.018647, " This", false], [3918, 0.017181, " It", false], [0, 0.013529, "[0]", false], [3908, 0.012511, " If", false], [300, 0.011899, " A", false]]], "qwen": [4120, 388, 0.00016235960356425494, [[576, 0.118124, " The", false], [758, 0.058879, " In", false], [1752, 0.055984, " For", false], [1096, 0.052615, " This", false], [1084, 0.03124, " It", false], [362, 0.02583, " A", false], [2619, 0.022786, " There", false], [1634, 0.021489, " As", false], [1416, 0.021447, " If", false], [151643, 0.019918, "\u003c|endoftext|\u003e", false]]]}, "raw_delta": -0.045139312744140625, "tuned_delta": -0.037802174230437885}, {"byte_start": 967, "byte_end": 973, "display": {"text": " spent", "kind": "normal"}, "is_word": true, "word_id": 162, "word_key": " spent", "bytes_hex": "20 73 70 65 6e 74", "compression": {"rwkv": "8.03% 8.03% 8.03% 8.03% 8.03% 8.03%", "qwen": "10.61% 10.61% 10.61% 10.61% 10.61% 10.61%"}, "model_tokens": {"rwkv": [[39762, " spent", "normal", 0.06852001696825027]], "qwen": [[7391, " spent", "normal", 0.02930413745343685]]}, "loss": {"rwkv": 8.030626692448331, "qwen": 10.609899235855616}, "topk": {"rwkv": [39762, 4, 0.06852001696825027, [[21265, 0.262972, " and", false], [32475, 0.145997, " will", false], [4600, 0.117169, " is", false], [39762, 0.06852, " spent", false], [4811, 0.045507, " to", false], [62307, 0.036976, " permitting", false], [46, 0.036822, "-", false], [45, 0.020927, ",", false], [21800, 0.018456, " has", false], [21700, 0.015891, " for", false]]], "qwen": [7391, 5, 0.02930413745343685, [[323, 0.213747, " and", false], [374, 0.143557, " is", false], [311, 0.109366, " to", false], [11, 0.035483, ",", false], [7391, 0.029304, " spent", false], [686, 0.027268, " will", false], [369, 0.02348, " for", false], [1283, 0.022726, " after", false], [702, 0.021844, " has", false], [16982, 0.011835, " constraints", false]]]}, "raw_delta": -0.14302523930867517, "tuned_delta": -0.13568810079497243}, {"byte_start": 973, "byte_end": 976, "display": {"text": " on", "kind": "normal"}, "is_word": true, "word_id": 163, "word_key": " on", "bytes_hex": "20 6f 6e", "compression": {"rwkv": "9.30% 9.30% 9.30%", "qwen": "7.70% 7.70% 7.70%"}, "model_tokens": {"rwkv": [[4712, " on", "normal", 0.2109820395708084]], "qwen": [[389, " on", "normal", 0.2779558300971985]]}, "loss": {"rwkv": 9.298620380729647, "qwen": 7.696135485002118}, "topk": {"rwkv": [4712, 1, 0.2109820395708084, [[4712, 0.210982, " on", false], [4596, 0.051402, " in", false], [47629, 0.042108, " trying", false], [52834, 0.03503, " seeking", false], [61857, 0.033262, " developing", false], [38888, 0.03225, " lever", false], [56537, 0.021335, " learning", false], [60463, 0.019026, " searching", false], [59832, 0.018682, " improving", false], [62271, 0.017027, " optimizing", false]]], "qwen": [389, 1, 0.2779558300971985, [[389, 0.277956, " on", false], [304, 0.045176, " in", false], [6832, 0.044051, " learning", false], [11220, 0.035835, " developing", false], [18392, 0.032943, " improving", false], [4460, 0.031147, " trying", false], [76482, 0.024253, " leveraging", false], [10887, 0.023543, " seeking", false], [4752, 0.023109, " building", false], [553, 0.017318, " by", false]]]}, "raw_delta": 0.08886063098907471, "tuned_delta": 0.09619776950277745}, {"byte_start": 976, "byte_end": 980, "display": {"text": " one", "kind": "normal"}, "is_word": true, "word_id": 164, "word_key": " one", "bytes_hex": "20 6f 6e 65", "compression": {"rwkv": "21.56% 21.56% 21.56% 21.56%", "qwen": "16.67% 16.67% 16.67% 16.67%"}, "model_tokens": {"rwkv": [[22226, " one", "normal", 0.00824460107833147]], "qwen": [[825, " one", "normal", 0.024803495034575462]]}, "loss": {"rwkv": 21.555892700782362, "qwen": 16.666602218969846}, "topk": {"rwkv": [22226, 15, 0.00824460107833147, [[22590, 0.097739, " the", false], [38720, 0.069893, " human", false], [332, 0.043735, " a", false], [57103, 0.030834, " research", false], [38888, 0.029943, " lever", false], [59832, 0.023211, " improving", false], [45775, 0.019221, " domain", false], [45490, 0.017193, " clever", false], [61857, 0.012943, " developing", false], [55666, 0.011315, " building", false]]], "qwen": [825, 6, 0.024803495034575462, [[76482, 0.065829, " leveraging", false], [279, 0.063352, " the", false], [3738, 0.052422, " human", false], [264, 0.041404, " a", false], [4586, 0.038453, " general", false], [825, 0.024803, " one", false], [7947, 0.024309, " domain", false], [3412, 0.023295, " research", false], [6540, 0.019125, " knowledge", false], [11220, 0.01882, " developing", false]]]}, "raw_delta": 0.2711198329925537, "tuned_delta": 0.2784569715062564}, {"byte_start": 980, "byte_end": 983, "display": {"text": " is", "kind": "normal"}, "is_word": true, "word_id": 165, "word_key": " is", "bytes_hex": "20 69 73", "compression": {"rwkv": "11.74% 11.74% 11.74%", "qwen": "11.59% 11.59% 11.59%"}, "model_tokens": {"rwkv": [[4600, " is", "normal", 0.141598641872406]], "qwen": [[374, " is", "normal", 0.14543162286281586]]}, "loss": {"rwkv": 11.740682298901067, "qwen": 11.589945954769224}, "topk": {"rwkv": [4600, 1, 0.141598641872406, [[4600, 0.141599, " is", false], [21413, 0.048834, " can", false], [4715, 0.032528, " or", false], [39914, 0.030102, " tends", false], [32475, 0.029054, " will", false], [39941, 0.025355, " thing", false], [30659, 0.024798, " does", false], [55532, 0.02252, " approach", false], [45214, 0.019393, " aspect", false], [22074, 0.018047, " may", false]]], "qwen": [374, 1, 0.14543162286281586, [[374, 0.145432, " is", false], [3545, 0.093406, " often", false], [646, 0.040591, " can", false], [27236, 0.036611, " tends", false], [1231, 0.035747, " may", false], [686, 0.033684, " will", false], [315, 0.02875, " of", false], [476, 0.026719, " or", false], [5990, 0.022938, " usually", false], [11, 0.021252, ",", false]]]}, "raw_delta": 0.008358597755432129, "tuned_delta": 0.015695736269134865}, {"byte_start": 983, "byte_end": 988, "display": {"text": " time", "kind": "normal"}, "is_word": true, "word_id": 166, "word_key": " time", "bytes_hex": "20 74 69 6d 65", "compression": {"rwkv": "2.32% 2.32% 2.32% 2.32% 2.32%", "qwen": "5.03% 5.03% 5.03% 5.03% 5.03%"}, "model_tokens": {"rwkv": [[32251, " time", "normal", 0.5230417847633362]], "qwen": [[882, " time", "normal", 0.24824698269367218]]}, "loss": {"rwkv": 2.3246550951824116, "qwen": 5.025379923483627}, "topk": {"rwkv": [32251, 1, 0.5230417847633362, [[32251, 0.523042, " time", false], [62110, 0.094653, " inevitably", false], [39762, 0.033021, " spent", false], [332, 0.027941, " a", false], [39171, 0.022911, " often", false], [47768, 0.018195, " wasted", false], [63717, 0.017668, " necessarily", false], [46439, 0.014512, " likely", false], [31334, 0.013798, " lost", false], [22187, 0.011358, " not", false]]], "qwen": [882, 1, 0.24824698269367218, [[882, 0.248247, " time", false], [3545, 0.205592, " often", false], [38828, 0.053793, " wasted", false], [5558, 0.037867, " lost", false], [4363, 0.029061, " likely", false], [5990, 0.02739, " usually", false], [7391, 0.022486, " spent", false], [264, 0.019575, " a", false], [518, 0.017265, " at", false], [537, 0.015288, " not", false]]]}, "raw_delta": -0.14975998401641843, "tuned_delta": -0.1424228455027157}, {"byte_start": 988, "byte_end": 992, "display": {"text": " not", "kind": "normal"}, "is_word": true, "word_id": 167, "word_key": " not", "bytes_hex": "20 6e 6f 74", "compression": {"rwkv": "3.03% 3.03% 3.03% 3.03%", "qwen": "2.82% 2.82% 2.82% 2.82%"}, "model_tokens": {"rwkv": [[22187, " not", "normal", 0.5100496411323547]], "qwen": [[537, " not", "normal", 0.5350255966186523]]}, "loss": {"rwkv": 3.029096033116476, "qwen": 2.819750688799506}, "topk": {"rwkv": [22187, 1, 0.5100496411323547, [[22187, 0.51005, " not", false], [39762, 0.153392, " spent", false], [31334, 0.11682, " lost", false], [32227, 0.056716, " that", false], [47768, 0.04543, " wasted", false], [30211, 0.028315, " away", false], [39887, 0.024288, " taken", false], [31277, 0.005486, " less", false], [63954, 0.004658, " unavailable", false], [57339, 0.002788, " subtract", false]]], "qwen": [537, 1, 0.5350255966186523, [[537, 0.535026, " not", false], [429, 0.126795, " that", false], [7391, 0.11351, " spent", false], [5558, 0.090603, " lost", false], [38828, 0.022851, " wasted", false], [4429, 0.022105, " taken", false], [13628, 0.007204, " missed", false], [2115, 0.005417, " left", false], [2686, 0.004425, " less", false], [369, 0.002363, " for", false]]]}, "raw_delta": 0.01160857081413269, "tuned_delta": 0.018945709327835427}, {"byte_start": 992, "byte_end": 998, "display": {"text": " spent", "kind": "normal"}, "is_word": true, "word_id": 168, "word_key": " spent", "bytes_hex": "20 73 70 65 6e 74", "compression": {"rwkv": "0.12% 0.12% 0.12% 0.12% 0.12% 0.12%", "qwen": "0.38% 0.38% 0.38% 0.38% 0.38% 0.38%"}, "model_tokens": {"rwkv": [[39762, " spent", "normal", 0.9594951272010803]], "qwen": [[7391, " spent", "normal", 0.8816502690315247]]}, "loss": {"rwkv": 0.12327716413846121, "qwen": 0.37858661859731446}, "topk": {"rwkv": [39762, 1, 0.9594951272010803, [[39762, 0.959495, " spent", false], [59206, 0.017641, " available", false], [4712, 0.005025, " on", false], [51459, 0.003691, " devoted", false], [56495, 0.002876, " invested", false], [32354, 0.00118, " used", false], [39761, 0.001047, " spend", false], [57278, 0.000714, " spending", false], [22339, 0.000603, " put", false], [38594, 0.00056, " given", false]]], "qwen": [7391, 1, 0.8816502690315247, [[7391, 0.88165, " spent", false], [2500, 0.076201, " available", false], [1660, 0.00788, " being", false], [27991, 0.003958, " invested", false], [8329, 0.002552, " spend", false], [4429, 0.00148, " taken", false], [38828, 0.001363, " wasted", false], [2115, 0.001313, " left", false], [18163, 0.001256, " gained", false], [28229, 0.001159, " devoted", false]]]}, "raw_delta": -0.014157362282276154, "tuned_delta": -0.006820223768573417}, {"byte_start": 998, "byte_end": 1001, "display": {"text": " on", "kind": "normal"}, "is_word": true, "word_id": 169, "word_key": " on", "bytes_hex": "20 6f 6e", "compression": {"rwkv": "0.20% 0.20% 0.20%", "qwen": "0.26% 0.26% 0.26%"}, "model_tokens": {"rwkv": [[4712, " on", "normal", 0.9673864245414734]], "qwen": [[389, " on", "normal", 0.9569395780563354]]}, "loss": {"rwkv": 0.19959159908131818, "qwen": 0.2645843802881575}, "topk": {"rwkv": [4712, 1, 0.9673864245414734, [[4712, 0.967386, " on", false], [38888, 0.002285, " lever", false], [38279, 0.001832, " doing", false], [4596, 0.001812, " in", false], [61857, 0.001704, " developing", false], [22590, 0.001606, " the", false], [59608, 0.001414, " elsewhere", false], [59832, 0.001087, " improving", false], [32487, 0.000967, " with", false], [59686, 0.00089, " exploring", false]]], "qwen": [389, 1, 0.9569395780563354, [[389, 0.95694, " on", false], [304, 0.005158, " in", false], [3730, 0.00416, " doing", false], [76482, 0.001945, " leveraging", false], [3238, 0.001614, " working", false], [18392, 0.001541, " improving", false], [33018, 0.001485, " pursuing", false], [279, 0.001283, " the", false], [17920, 0.001109, " elsewhere", false], [448, 0.000944, " with", false]]]}, "raw_delta": -0.0036039650440216064, "tuned_delta": 0.00373317346968113}, {"byte_start": 1001, "byte_end": 1005, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 170, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "0.13% 0.13% 0.13% 0.13%", "qwen": "0.17% 0.17% 0.17% 0.17%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.9721909761428833]], "qwen": [[279, " the", "normal", 0.9620660543441772]]}, "loss": {"rwkv": 0.12712957551778814, "qwen": 0.17435043544470694}, "topk": {"rwkv": [22590, 1, 0.9721909761428833, [[22590, 0.972191, " the", false], [50919, 0.012999, " another", false], [39193, 0.001409, " other", false], [59832, 0.001343, " improving", false], [38888, 0.000959, " lever", false], [332, 0.000644, " a", false], [30322, 0.000496, " both", false], [31458, 0.000411, " more", false], [45833, 0.000382, " either", false], [60522, 0.000341, " something", false]]], "qwen": [279, 1, 0.9620660543441772, [[279, 0.962066, " the", false], [2441, 0.015389, " another", false], [1008, 0.00288, " other", false], [34447, 0.001726, " computation", false], [2494, 0.001625, " something", false], [264, 0.00138, " a", false], [76482, 0.001128, " leveraging", false], [2176, 0.001003, " both", false], [2987, 0.000812, " either", false], [18392, 0.000755, " improving", false]]]}, "raw_delta": -0.00261848047375679, "tuned_delta": 0.004718658039945946}, {"byte_start": 1005, "byte_end": 1011, "display": {"text": " other", "kind": "normal"}, "is_word": true, "word_id": 171, "word_key": " other", "bytes_hex": "20 6f 74 68 65 72", "compression": {"rwkv": "0.02% 0.02% 0.02% 0.02% 0.02% 0.02%", "qwen": "0.02% 0.02% 0.02% 0.02% 0.02% 0.02%"}, "model_tokens": {"rwkv": [[39193, " other", "normal", 0.9923527836799622]], "qwen": [[1008, " other", "normal", 0.994239330291748]]}, "loss": {"rwkv": 0.023022744195501314, "qwen": 0.017364419809424003}, "topk": {"rwkv": [39193, 1, 0.9923527836799622, [[39193, 0.992353, " other", false], [31515, 0.001573, " next", false], [46726, 0.000718, " others", false], [45301, 0.000546, " better", false], [46405, 0.000525, " latter", false], [47205, 0.000512, " second", false], [31458, 0.000507, " more", false], [45961, 0.000186, " faster", false], [31323, 0.000143, " long", false], [46470, 0.000111, " longer", false]]], "qwen": [1008, 1, 0.994239330291748, [[1008, 0.994239, " other", false], [2086, 0.000546, " second", false], [2664, 0.000468, " better", false], [1790, 0.000465, " next", false], [15271, 0.000428, " latter", false], [3800, 0.000427, " others", false], [803, 0.000415, " more", false], [825, 0.000179, " one", false], [279, 0.00012, " the", false], [10555, 8e-05, " alternative", false]]]}, "raw_delta": 0.0003137641275922458, "tuned_delta": 0.007650902641294983}, {"byte_start": 1011, "byte_end": 1012, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "7.40%", "qwen": "22.39%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.662509560585022]], "qwen": [[13, ".", "normal", 0.28900769352912903]]}, "loss": {"rwkv": 7.396629848307673, "qwen": 22.38525108738749}, "topk": {"rwkv": [47, 1, 0.662509560585022, [[47, 0.66251, ".", false], [45, 0.267916, ",", false], [60, 0.016903, ";", false], [21265, 0.015169, " and", false], [275, 0.010558, " (", false], [59, 0.003099, ":", false], [9816, 0.001964, "—", false], [280, 0.001594, " -", false], [34, 0.001506, "!", false], [4596, 0.001495, " in", false]]], "qwen": [13, 2, 0.28900769352912903, [[624, 0.336423, ".\n", false], [13, 0.289008, ".", false], [11, 0.257568, ",", false], [26, 0.023685, ";", false], [323, 0.020717, " and", false], [382, 0.016234, ".\n\n", false], [320, 0.014207, " (", false], [25, 0.006255, ":", false], [481, 0.002701, " -", false], [1959, 0.002082, " —", false]]]}, "raw_delta": -0.8311456441879272, "tuned_delta": -0.8238085056742245}, {"byte_start": 1012, "byte_end": 1018, "display": {"text": " There", "kind": "normal"}, "is_word": true, "word_id": 172, "word_key": " there", "bytes_hex": "20 54 68 65 72 65", "compression": {"rwkv": "14.09% 14.09% 14.09% 14.09% 14.09% 14.09%", "qwen": "11.67% 11.67% 11.67% 11.67% 11.67% 11.67%"}, "model_tokens": {"rwkv": [[37451, " There", "normal", 0.009242170490324497]], "qwen": [[2619, " There", "normal", 0.020563559606671333]]}, "loss": {"rwkv": 14.088818758681281, "qwen": 11.674512690575982}, "topk": {"rwkv": [37451, 14, 0.009242170490324497, [[11, 0.35978, "\n", false], [261, 0.12513, "\n\n", false], [20996, 0.071207, " The", false], [29894, 0.032017, " This", false], [3913, 0.02316, " In", false], [19555, 0.019774, " But", false], [19417, 0.017832, " And", false], [3918, 0.017051, " It", false], [3908, 0.014984, " If", false], [0, 0.011716, "[0]", false]]], "qwen": [2619, 11, 0.020563559606671333, [[576, 0.113834, " The", false], [1096, 0.077977, " This", false], [758, 0.055176, " In", false], [1084, 0.037365, " It", false], [151643, 0.031481, "\u003c|endoftext|\u003e", false], [1597, 0.026793, " And", false], [1752, 0.025339, " For", false], [362, 0.02348, " A", false], [1634, 0.023457, " As", false], [1416, 0.020591, " If", false]]]}, "raw_delta": 0.1338775555292765, "tuned_delta": 0.14121469404297923}, {"byte_start": 1018, "byte_end": 1022, "display": {"text": " are", "kind": "normal"}, "is_word": true, "word_id": 173, "word_key": " are", "bytes_hex": "20 61 72 65", "compression": {"rwkv": "5.99% 5.99% 5.99% 5.99%", "qwen": "4.50% 4.50% 4.50% 4.50%"}, "model_tokens": {"rwkv": [[21286, " are", "normal", 0.26505884528160095]], "qwen": [[525, " are", "normal", 0.36894965171813965]]}, "loss": {"rwkv": 5.987747972439545, "qwen": 4.495325255191915}, "topk": {"rwkv": [21286, 2, 0.26505884528160095, [[4600, 0.48111, " is", false], [21286, 0.265059, " are", false], [460, 0.11924, "'s", false], [32475, 0.021635, " will", false], [21800, 0.018267, " has", false], [31059, 0.018194, " have", false], [22074, 0.011503, " may", false], [22748, 0.006548, " was", false], [21413, 0.005934, " can", false], [21896, 0.003619, " isn", false]]], "qwen": [525, 2, 0.36894965171813965, [[374, 0.456053, " is", false], [525, 0.36895, " are", false], [594, 0.058748, "'s", false], [614, 0.019578, " have", false], [702, 0.015429, " has", false], [686, 0.010607, " will", false], [572, 0.008044, " was", false], [1231, 0.007163, " may", false], [646, 0.00578, " can", false], [258, 0.003887, "in", false]]]}, "raw_delta": 0.08275748789310455, "tuned_delta": 0.0900946264068073}, {"byte_start": 1022, "byte_end": 1036, "display": {"text": " psychological", "kind": "normal"}, "is_word": true, "word_id": 174, "word_key": " psychological", "bytes_hex": "20 70 73 79 63 68 6f 6c 6f 67 69 63 61 6c", "compression": {"rwkv": "14.17% 14.17% 14.17% 14.17% 14.17% 14.17% 14.17% 14.17% 14.17% 14.17% 14.17% 14.17% 14.17% 14.17%", "qwen": "13.97% 13.97% 13.97% 13.97% 13.97% 13.97% 13.97% 13.97% 13.97% 13.97% 13.97% 13.97% 13.97% 13.97%"}, "model_tokens": {"rwkv": [[64997, " psychological", "normal", 1.6758427591412328e-05]], "qwen": [[23187, " psychological", "normal", 1.9427410734351724e-05]]}, "loss": {"rwkv": 14.169326294445177, "qwen": 13.97459525266324}, "topk": {"rwkv": [64997, 1285, 1.6758427591412328e-05, [[31370, 0.11797, " many", false], [332, 0.064457, " a", false], [32074, 0.058708, " some", false], [61963, 0.052498, " exceptions", false], [22638, 0.044137, " two", false], [45, 0.031984, ",", false], [39193, 0.026325, " other", false], [46844, 0.023928, " plenty", false], [4706, 0.022422, " of", false], [4692, 0.018762, " no", false]]], "qwen": [23187, 1076, 1.9427410734351724e-05, [[1657, 0.127512, " many", false], [1378, 0.086523, " two", false], [264, 0.079205, " a", false], [1045, 0.068575, " some", false], [19585, 0.064439, " exceptions", false], [11, 0.03917, ",", false], [5510, 0.029527, " ways", false], [1083, 0.024977, " also", false], [1008, 0.022655, " other", false], [902, 0.021747, " no", false]]]}, "raw_delta": 0.010798181806291884, "tuned_delta": 0.01813532031999462}, {"byte_start": 1036, "byte_end": 1048, "display": {"text": " commitments", "kind": "normal"}, "is_word": true, "word_id": 175, "word_key": " commitments", "bytes_hex": "20 63 6f 6d 6d 69 74 6d 65 6e 74 73", "compression": {"rwkv": "12.12% 12.12% 12.12% 12.12% 12.12% 12.12% 12.12% 12.12% 12.12% 12.12% 12.12% 12.12%", "qwen": "14.92% 14.92% 14.92% 14.92% 14.92% 14.92% 14.92% 14.92% 14.92% 14.92% 14.92% 14.92%"}, "model_tokens": {"rwkv": [[63351, " commitments", "normal", 0.0003166237147524953]], "qwen": [[41256, " commitments", "normal", 4.8848836740944535e-05]]}, "loss": {"rwkv": 12.116384132465903, "qwen": 14.918037409382585}, "topk": {"rwkv": [63351, 97, 0.0003166237147524953, [[52654, 0.274881, " reasons", false], [21265, 0.226573, " and", false], [55600, 0.054519, " barriers", false], [45, 0.046649, ",", false], [51703, 0.040113, " factors", false], [45304, 0.033817, " biases", false], [2030, 0.023172, "ly", false], [38124, 0.017705, " costs", false], [51565, 0.016497, " effects", false], [62202, 0.016261, " mechanisms", false]]], "qwen": [41256, 380, 4.8848836740944535e-05, [[7966, 0.364535, " reasons", false], [323, 0.129478, " and", false], [29640, 0.075673, " barriers", false], [9363, 0.072835, " factors", false], [40841, 0.033968, " explanations", false], [11, 0.032794, ",", false], [49083, 0.028542, " biases", false], [13566, 0.018777, " aspects", false], [6239, 0.015736, " effects", false], [13388, 0.012311, " limits", false]]]}, "raw_delta": -0.15535664558410645, "tuned_delta": -0.1480195070704037}, {"byte_start": 1048, "byte_end": 1051, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 176, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "7.33% 7.33% 7.33%", "qwen": "5.65% 5.65% 5.65%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.2954440116882324]], "qwen": [[311, " to", "normal", 0.3906971216201782]]}, "loss": {"rwkv": 7.326185754514267, "qwen": 5.649489270047869}, "topk": {"rwkv": [4811, 1, 0.2954440116882324, [[4811, 0.295444, " to", false], [32227, 0.284173, " that", false], [21265, 0.068668, " and", false], [45, 0.051922, ",", false], [56500, 0.043565, " involved", false], [4596, 0.022672, " in", false], [4712, 0.016787, " on", false], [4423, 0.016741, " as", false], [4424, 0.015267, " at", false], [31351, 0.0122, " made", false]]], "qwen": [311, 1, 0.3906971216201782, [[311, 0.390697, " to", false], [429, 0.278774, " that", false], [323, 0.05839, " and", false], [11, 0.050985, ",", false], [304, 0.031427, " in", false], [320, 0.016949, " (", false], [518, 0.014043, " at", false], [389, 0.013031, " on", false], [1865, 0.012849, " made", false], [6398, 0.010115, " involved", false]]]}, "raw_delta": 0.09297579526901245, "tuned_delta": 0.10031293378271519}, {"byte_start": 1051, "byte_end": 1062, "display": {"text": " investment", "kind": "normal"}, "is_word": true, "word_id": 177, "word_key": " investment", "bytes_hex": "20 69 6e 76 65 73 74 6d 65 6e 74", "compression": {"rwkv": "13.22% 13.22% 13.22% 13.22% 13.22% 13.22% 13.22% 13.22% 13.22% 13.22% 13.22%", "qwen": "15.02% 15.02% 15.02% 15.02% 15.02% 15.02% 15.02% 15.02% 15.02% 15.02% 15.02%"}, "model_tokens": {"rwkv": [[62157, " investment", "normal", 0.0003249699075240642]], "qwen": [[9162, " investment", "normal", 0.00010466409003129229]]}, "loss": {"rwkv": 13.217873599053709, "qwen": 15.024939089071282}, "topk": {"rwkv": [62157, 226, 0.0003249699075240642, [[22590, 0.137648, " the", false], [30322, 0.079073, " both", false], [22226, 0.054111, " one", false], [38720, 0.04535, " human", false], [30719, 0.035037, " each", false], [39936, 0.032024, " these", false], [332, 0.02854, " a", false], [32234, 0.02119, " this", false], [38279, 0.019833, " doing", false], [51161, 0.017086, " certain", false]]], "qwen": [9162, 575, 0.00010466409003129229, [[279, 0.175419, " the", false], [3738, 0.05676, " human", false], [825, 0.047213, " one", false], [264, 0.036088, " a", false], [3953, 0.027353, " particular", false], [2176, 0.026776, " both", false], [387, 0.023164, " be", false], [32064, 0.020483, " leverage", false], [3654, 0.019666, " certain", false], [2987, 0.01964, " either", false]]]}, "raw_delta": -0.10020498795942835, "tuned_delta": -0.09286784944572561}, {"byte_start": 1062, "byte_end": 1065, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 178, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "3.31% 3.31% 3.31%", "qwen": "3.51% 3.51% 3.51%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.578748881816864]], "qwen": [[304, " in", "normal", 0.5578750967979431]]}, "loss": {"rwkv": 3.310872408290101, "qwen": 3.508274453247622}, "topk": {"rwkv": [4596, 1, 0.578748881816864, [[4596, 0.578749, " in", false], [4706, 0.049789, " of", false], [32227, 0.042259, " that", false], [45, 0.034397, ",", false], [21265, 0.034355, " and", false], [56832, 0.033749, " patterns", false], [62581, 0.016967, " strategies", false], [59451, 0.011482, " decisions", false], [31162, 0.011475, " into", false], [4712, 0.01087, " on", false]]], "qwen": [304, 1, 0.5578750967979431, [[304, 0.557875, " in", false], [429, 0.184454, " that", false], [11, 0.043663, ",", false], [315, 0.028122, " of", false], [323, 0.020908, " and", false], [14830, 0.016038, " strategies", false], [320, 0.009569, " (", false], [389, 0.007911, " on", false], [1865, 0.007348, " made", false], [311, 0.004942, " to", false]]]}, "raw_delta": -0.010946293671925872, "tuned_delta": -0.0036091551582231353}, {"byte_start": 1065, "byte_end": 1069, "display": {"text": " one", "kind": "normal"}, "is_word": true, "word_id": 179, "word_key": " one", "bytes_hex": "20 6f 6e 65", "compression": {"rwkv": "7.82% 7.82% 7.82% 7.82%", "qwen": "6.33% 6.33% 6.33% 6.33%"}, "model_tokens": {"rwkv": [[22226, " one", "normal", 0.17677997052669525]], "qwen": [[825, " one", "normal", 0.24557806551456451]]}, "loss": {"rwkv": 7.819294411068111, "qwen": 6.330457263368079}, "topk": {"rwkv": [22226, 2, 0.17677997052669525, [[22590, 0.181995, " the", false], [22226, 0.17678, " one", false], [38720, 0.072982, " human", false], [332, 0.042931, " a", false], [45833, 0.033019, " either", false], [57103, 0.030363, " research", false], [30322, 0.025476, " both", false], [59943, 0.022794, " knowledge", false], [30719, 0.022056, " each", false], [39675, 0.021613, " short", false]]], "qwen": [825, 1, 0.24557806551456451, [[825, 0.245578, " one", false], [3738, 0.138559, " human", false], [279, 0.09495, " the", false], [2987, 0.048882, " either", false], [264, 0.036417, " a", false], [1817, 0.034237, " each", false], [3953, 0.033059, " particular", false], [6540, 0.031027, " knowledge", false], [2176, 0.030117, " both", false], [7947, 0.019244, " domain", false]]]}, "raw_delta": 0.08255866169929504, "tuned_delta": 0.08989580021299778}, {"byte_start": 1069, "byte_end": 1078, "display": {"text": " approach", "kind": "normal"}, "is_word": true, "word_id": 180, "word_key": " approach", "bytes_hex": "20 61 70 70 72 6f 61 63 68", "compression": {"rwkv": "12.02% 12.02% 12.02% 12.02% 12.02% 12.02% 12.02% 12.02% 12.02%", "qwen": "9.74% 9.74% 9.74% 9.74% 9.74% 9.74% 9.74% 9.74% 9.74%"}, "model_tokens": {"rwkv": [[55532, " approach", "normal", 0.0025353594683110714]], "qwen": [[5486, " approach", "normal", 0.007759560830891132]]}, "loss": {"rwkv": 12.022458674074693, "qwen": 9.735846141263135}, "topk": {"rwkv": [55532, 31, 0.0025353594683110714, [[4715, 0.424857, " or", false], [31601, 0.113159, " over", false], [47717, 0.058924, " versus", false], [32227, 0.056178, " that", false], [47001, 0.040839, " rather", false], [30173, 0.037704, " area", false], [45775, 0.032978, " domain", false], [21265, 0.021951, " and", false], [45, 0.021464, ",", false], [59526, 0.014929, " direction", false]]], "qwen": [5486, 12, 0.007759560830891132, [[476, 0.472018, " or", false], [429, 0.140561, " that", false], [3082, 0.041787, " area", false], [11, 0.038737, ",", false], [916, 0.038003, " over", false], [315, 0.026333, " of", false], [518, 0.022409, " at", false], [323, 0.021068, " and", false], [4751, 0.020208, " rather", false], [7947, 0.008771, " domain", false]]]}, "raw_delta": 0.12679672241210938, "tuned_delta": 0.13413386092581212}, {"byte_start": 1078, "byte_end": 1081, "display": {"text": " or", "kind": "normal"}, "is_word": true, "word_id": 181, "word_key": " or", "bytes_hex": "20 6f 72", "compression": {"rwkv": "5.66% 5.66% 5.66%", "qwen": "6.65% 6.65% 6.65%"}, "model_tokens": {"rwkv": [[4715, " or", "normal", 0.38778847455978394]], "qwen": [[476, " or", "normal", 0.3309338688850403]]}, "loss": {"rwkv": 5.659008868070314, "qwen": 6.647437591430349}, "topk": {"rwkv": [4715, 1, 0.38778847455978394, [[4715, 0.387788, " or", false], [31601, 0.301755, " over", false], [47001, 0.05884, " rather", false], [32227, 0.050337, " that", false], [45, 0.039582, ",", false], [47717, 0.027719, " versus", false], [21265, 0.017528, " and", false], [4424, 0.012347, " at", false], [4811, 0.011177, " to", false], [47, 0.010148, ".", false]]], "qwen": [476, 1, 0.3309338688850403, [[476, 0.330934, " or", false], [429, 0.311298, " that", false], [916, 0.093059, " over", false], [11, 0.073283, ",", false], [4751, 0.024069, " rather", false], [518, 0.022481, " at", false], [323, 0.018029, " and", false], [320, 0.017136, " (", false], [19041, 0.01512, " versus", false], [892, 0.009402, " which", false]]]}, "raw_delta": -0.05481012662251794, "tuned_delta": -0.0474729881088152}, {"byte_start": 1081, "byte_end": 1085, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 182, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "2.92% 2.92% 2.92% 2.92%", "qwen": "2.20% 2.20% 2.20% 2.20%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.525206983089447]], "qwen": [[279, " the", "normal", 0.6140246987342834]]}, "loss": {"rwkv": 2.923429892426366, "qwen": 2.198848039377469}, "topk": {"rwkv": [22590, 1, 0.525206983089447, [[22590, 0.525207, " the", false], [50919, 0.446133, " another", false], [39193, 0.008205, " other", false], [46561, 0.001941, " method", false], [4811, 0.001195, " to", false], [332, 0.001071, " a", false], [4596, 0.001041, " in", false], [57317, 0.00083, " strategy", false], [45775, 0.000573, " domain", false], [60624, 0.000529, " technique", false]]], "qwen": [279, 1, 0.6140246987342834, [[279, 0.614025, " the", false], [2441, 0.35995, " another", false], [311, 0.006021, " to", false], [1008, 0.004131, " other", false], [304, 0.001888, " in", false], [1496, 0.00076, " even", false], [1714, 0.000687, " method", false], [14762, 0.000628, " technique", false], [264, 0.000546, " a", false], [8282, 0.000436, " strategy", false]]]}, "raw_delta": 0.04017934948205948, "tuned_delta": 0.04751648799576222}, {"byte_start": 1085, "byte_end": 1091, "display": {"text": " other", "kind": "normal"}, "is_word": true, "word_id": 183, "word_key": " other", "bytes_hex": "20 6f 74 68 65 72", "compression": {"rwkv": "0.00% 0.00% 0.00% 0.00% 0.00% 0.00%", "qwen": "0.01% 0.01% 0.01% 0.01% 0.01% 0.01%"}, "model_tokens": {"rwkv": [[39193, " other", "normal", 0.9986311793327332]], "qwen": [[1008, " other", "normal", 0.9981380701065063]]}, "loss": {"rwkv": 0.004127583620707407, "qwen": 0.0056014114668144314}, "topk": {"rwkv": [39193, 1, 0.9986311793327332, [[39193, 0.998631, " other", false], [31515, 0.000415, " next", false], [50919, 0.000212, " another", false], [46726, 0.000121, " others", false], [11, 3.3e-05, "\n", false], [22590, 2.6e-05, " the", false], [63469, 1.2e-05, " development", false], [22226, 1.1e-05, " one", false], [261, 1.1e-05, "\n\n", false], [46561, 1e-05, " method", false]]], "qwen": [1008, 1, 0.9981380701065063, [[1008, 0.998138, " other", false], [1790, 0.000309, " next", false], [2441, 0.000148, " another", false], [3800, 0.000101, " others", false], [198, 9.3e-05, "\n", false], [297, 3.4e-05, " o", false], [2086, 3.2e-05, " second", false], [320, 1.9e-05, " (", false], [279, 1.6e-05, " the", false], [1575, 1.5e-05, "other", false]]]}, "raw_delta": -8.17263692927857e-05, "tuned_delta": 0.007255412144409951}, {"byte_start": 1091, "byte_end": 1092, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "25.36%", "qwen": "55.87%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.2507374882698059]], "qwen": [[13, ".", "normal", 0.04514032602310181]]}, "loss": {"rwkv": 25.359873765626308, "qwen": 55.86799229046926}, "topk": {"rwkv": [47, 2, 0.2507374882698059, [[45, 0.450508, ",", false], [47, 0.250737, ".", false], [32227, 0.126618, " that", false], [275, 0.024009, " (", false], [21265, 0.021829, " and", false], [60, 0.021243, ";", false], [59, 0.012643, ":", false], [4423, 0.010254, " as", false], [40186, 0.008122, " which", false], [21400, 0.007854, " but", false]]], "qwen": [13, 3, 0.04514032602310181, [[429, 0.454984, " that", false], [11, 0.318301, ",", false], [13, 0.04514, ".", false], [320, 0.032908, " (", false], [892, 0.01886, " which", false], [323, 0.018353, " and", false], [624, 0.01653, ".\n", false], [26, 0.014231, ";", false], [714, 0.009631, " but", false], [518, 0.005769, " at", false]]]}, "raw_delta": -1.6917293071746826, "tuned_delta": -1.68439216866098}, {"byte_start": 1092, "byte_end": 1096, "display": {"text": " And", "kind": "normal"}, "is_word": true, "word_id": 184, "word_key": " and", "bytes_hex": "20 41 6e 64", "compression": {"rwkv": "15.00% 15.00% 15.00% 15.00%", "qwen": "15.35% 15.35% 15.35% 15.35%"}, "model_tokens": {"rwkv": [[19417, " And", "normal", 0.03591116890311241]], "qwen": [[1597, " And", "normal", 0.0332515574991703]]}, "loss": {"rwkv": 15.004591977995565, "qwen": 15.345106877788247}, "topk": {"rwkv": [19417, 6, 0.03591116890311241, [[11, 0.151776, "\n", false], [20996, 0.090496, " The", false], [37451, 0.079061, " There", false], [19555, 0.070882, " But", false], [261, 0.05359, "\n\n", false], [19417, 0.035911, " And", false], [3918, 0.027824, " It", false], [3913, 0.022463, " In", false], [29894, 0.018908, " This", false], [19907, 0.014213, " For", false]]], "qwen": [1597, 7, 0.0332515574991703, [[576, 0.096157, " The", false], [2619, 0.086248, " There", false], [758, 0.045308, " In", false], [1084, 0.041811, " It", false], [1988, 0.041437, " But", false], [1096, 0.038606, " This", false], [1597, 0.033252, " And", false], [1752, 0.025937, " For", false], [1205, 0.019243, " We", false], [362, 0.018521, " A", false]]]}, "raw_delta": -0.018882155418395996, "tuned_delta": -0.01154501690469326}, {"byte_start": 1096, "byte_end": 1100, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 185, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "11.69% 11.69% 11.69% 11.69%", "qwen": "10.92% 10.92% 10.92% 10.92%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.07428289949893951]], "qwen": [[279, " the", "normal", 0.08881886303424835]]}, "loss": {"rwkv": 11.693719569705465, "qwen": 10.915593739900798}, "topk": {"rwkv": [22590, 3, 0.07428289949893951, [[39934, 0.185246, " there", false], [45, 0.109386, ",", false], [22590, 0.074283, " the", false], [4788, 0.053854, " so", false], [4601, 0.031136, " it", false], [4596, 0.029017, " in", false], [22797, 0.028349, " yet", false], [4706, 0.026189, " of", false], [30788, 0.016423, " even", false], [32230, 0.014364, " then", false]]], "qwen": [279, 3, 0.08881886303424835, [[1052, 0.102656, " there", false], [11, 0.094348, ",", false], [279, 0.088819, " the", false], [304, 0.047588, " in", false], [432, 0.04032, " it", false], [773, 0.035085, " so", false], [419, 0.03046, " this", false], [1496, 0.024501, " even", false], [421, 0.024116, " if", false], [438, 0.023613, " as", false]]]}, "raw_delta": 0.0431484580039978, "tuned_delta": 0.05048559651770054}, {"byte_start": 1100, "byte_end": 1106, "display": {"text": " human", "kind": "normal"}, "is_word": true, "word_id": 186, "word_key": " human", "bytes_hex": "20 68 75 6d 61 6e", "compression": {"rwkv": "13.81% 13.81% 13.81% 13.81% 13.81% 13.81%", "qwen": "14.69% 14.69% 14.69% 14.69% 14.69% 14.69%"}, "model_tokens": {"rwkv": [[38720, " human", "normal", 0.010104949586093426]], "qwen": [[3738, " human", "normal", 0.007529765367507935]]}, "loss": {"rwkv": 13.807042383507657, "qwen": 14.694123163902994}, "topk": {"rwkv": [38720, 11, 0.010104949586093426, [[64997, 0.018251, " psychological", false], [30808, 0.013502, " fact", false], [22638, 0.013181, " two", false], [31461, 0.012426, " most", false], [30510, 0.011553, " cost", false], [62157, 0.011513, " investment", false], [32251, 0.010927, " time", false], [57103, 0.010553, " research", false], [31458, 0.0103, " more", false], [46470, 0.010141, " longer", false]]], "qwen": [3738, 22, 0.007529765367507935, [[803, 0.027121, " more", false], [1378, 0.022444, " two", false], [5021, 0.021849, " longer", false], [1850, 0.016703, " best", false], [2783, 0.014548, " cost", false], [1172, 0.01435, " only", false], [3412, 0.014166, " research", false], [2097, 0.013188, " fact", false], [7049, 0.011543, " costs", false], [1102, 0.011421, " result", false]]]}, "raw_delta": -0.049190203348795536, "tuned_delta": -0.041853064835092796}, {"byte_start": 1106, "byte_end": 1116, "display": {"text": "-knowledge", "kind": "normal"}, "is_word": true, "word_id": 187, "word_key": "-knowledge", "bytes_hex": "2d 6b 6e 6f 77 6c 65 64 67 65", "compression": {"rwkv": "73.83% 2.86% 2.86% 2.86% 2.86% 2.86% 2.86% 2.86% 2.86% 2.86%", "qwen": "70.27% 70.27% 0.00% 0.00% 0.00% 0.00% 0.00% 0.00% 0.00% 0.00%"}, "model_tokens": {"rwkv": [[46, "-", "normal", 0.016668841242790222], [58313, "knowledge", "normal", 0.23826813697814941]], "qwen": [[12646, "-k", "normal", 0.0004126753774471581], [51186, "nowledge", "normal", 0.9992349147796631]]}, "loss": {"rwkv": 9.96079486238767, "qwen": 14.05476201086571}, "topk": {"rwkv": [46, 7, 0.016668841242790222, [[59943, 0.201704, " knowledge", false], [31427, 0.047724, " mind", false], [37898, 0.037034, " brain", false], [57404, 0.029673, " tendency", false], [45775, 0.022722, " domain", false], [34889, 0.018835, "ities", false], [46, 0.016669, "-", false], [32011, 0.014306, " side", false], [59324, 0.013369, " community", false], [31506, 0.013334, " need", false]]], "qwen": [12646, 214, 0.0004126753774471581, [[6540, 0.142265, " knowledge", false], [8109, 0.11091, " brain", false], [3971, 0.089827, " mind", false], [8168, 0.021975, " factor", false], [2783, 0.01864, " cost", false], [49083, 0.017235, " biases", false], [30854, 0.015653, " tendency", false], [24675, 0.014819, " cognitive", false], [5726, 0.014369, " ability", false], [15470, 0.012073, " bias", false]]]}, "raw_delta": -0.2270177429018078, "tuned_delta": -0.21968060438810505}, {"byte_start": 1116, "byte_end": 1125, "display": {"text": " approach", "kind": "normal"}, "is_word": true, "word_id": 188, "word_key": " approach", "bytes_hex": "20 61 70 70 72 6f 61 63 68", "compression": {"rwkv": "1.99% 1.99% 1.99% 1.99% 1.99% 1.99% 1.99% 1.99% 1.99%", "qwen": "2.10% 2.10% 2.10% 2.10% 2.10% 2.10% 2.10% 2.10% 2.10%"}, "model_tokens": {"rwkv": [[55532, " approach", "normal", 0.372172474861145]], "qwen": [[5486, " approach", "normal", 0.34987860918045044]]}, "loss": {"rwkv": 1.9880888692805812, "qwen": 2.1042688826934364}, "topk": {"rwkv": [55532, 1, 0.372172474861145, [[55532, 0.372172, " approach", false], [46, 0.17449, "-", false], [38888, 0.037183, " lever", false], [61590, 0.033571, " approaches", false], [62157, 0.020121, " investment", false], [56540, 0.019535, " leverage", false], [37810, 0.016773, " based", false], [39552, 0.012702, " route", false], [46561, 0.012164, " method", false], [52224, 0.01184, " methods", false]]], "qwen": [5486, 1, 0.34987860918045044, [[5486, 0.349879, " approach", false], [5980, 0.078859, "-based", false], [27505, 0.03808, " lever", false], [31405, 0.022445, "-driven", false], [3108, 0.021996, " side", false], [19827, 0.021535, " approaches", false], [3692, 0.017431, " component", false], [949, 0.016315, " part", false], [32064, 0.016224, " leverage", false], [3419, 0.011277, "-in", false]]]}, "raw_delta": -0.00644238789876303, "tuned_delta": 0.0008947506149397065}, {"byte_start": 1125, "byte_end": 1131, "display": {"text": " tends", "kind": "normal"}, "is_word": true, "word_id": 189, "word_key": " tends", "bytes_hex": "20 74 65 6e 64 73", "compression": {"rwkv": "9.44% 9.44% 9.44% 9.44% 9.44% 9.44%", "qwen": "8.36% 8.36% 8.36% 8.36% 8.36% 8.36%"}, "model_tokens": {"rwkv": [[39914, " tends", "normal", 0.043363772332668304]], "qwen": [[27236, " tends", "normal", 0.061878807842731476]]}, "loss": {"rwkv": 9.439508568316459, "qwen": 8.363355794317577}, "topk": {"rwkv": [39914, 4, 0.043363772332668304, [[4600, 0.357123, " is", false], [21800, 0.118874, " has", false], [21413, 0.064016, " can", false], [39914, 0.043364, " tends", false], [45, 0.041847, ",", false], [4811, 0.031759, " to", false], [39620, 0.019592, " seems", false], [30659, 0.018299, " does", false], [32475, 0.018119, " will", false], [22074, 0.0175, " may", false]]], "qwen": [27236, 3, 0.061878807842731476, [[374, 0.292251, " is", false], [702, 0.086251, " has", false], [27236, 0.061879, " tends", false], [646, 0.058099, " can", false], [11, 0.045678, ",", false], [3545, 0.032364, " often", false], [7460, 0.022891, " requires", false], [686, 0.020688, " will", false], [311, 0.019517, " to", false], [1231, 0.018998, " may", false]]]}, "raw_delta": 0.059674580891927065, "tuned_delta": 0.0670117194056298}, {"byte_start": 1131, "byte_end": 1134, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 190, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "0.19% 0.19% 0.19%", "qwen": "0.15% 0.15% 0.15%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.9693784117698669]], "qwen": [[311, " to", "normal", 0.9761614203453064]]}, "loss": {"rwkv": 0.18638333149505446, "qwen": 0.1450348505328503}, "topk": {"rwkv": [4811, 1, 0.9693784117698669, [[4811, 0.969378, " to", false], [22187, 0.007403, " not", false], [47585, 0.005301, " toward", false], [45, 0.003122, ",", false], [53169, 0.002957, " towards", false], [31458, 0.002131, " more", false], [4596, 0.000895, " in", false], [4435, 0.000757, " be", false], [275, 0.000585, " (", false], [30135, 0.000561, " also", false]]], "qwen": [311, 1, 0.9761614203453064, [[311, 0.976161, " to", false], [537, 0.007941, " not", false], [11, 0.002714, ",", false], [8841, 0.001297, " toward", false], [6974, 0.001067, " towards", false], [387, 0.00085, " be", false], [803, 0.000807, " more", false], [1083, 0.00072, " also", false], [320, 0.000687, " (", false], [304, 0.000529, " in", false]]]}, "raw_delta": 0.0022928466399510707, "tuned_delta": 0.009629985153653807}, {"byte_start": 1134, "byte_end": 1145, "display": {"text": " complicate", "kind": "normal"}, "is_word": true, "word_id": 191, "word_key": " complicate", "bytes_hex": "20 63 6f 6d 70 6c 69 63 61 74 65", "compression": {"rwkv": "21.98% 21.98% 21.98% 21.98% 21.98% 21.98% 21.98% 21.98% 0.00% 0.00% 0.00%", "qwen": "35.72% 35.72% 35.72% 35.72% 35.72% 0.00% 0.00% 0.00% 0.00% 0.00% 0.00%"}, "model_tokens": {"rwkv": [[51259, " complic", "normal", 5.776841499027796e-05], [7066, "ate", "normal", 0.9992092847824097]], "qwen": [[1367, " comp", "normal", 4.99966845382005e-05], [48795, "licate", "normal", 0.999305009841919]]}, "loss": {"rwkv": 15.985687335064835, "qwen": 16.23728544000862}, "topk": {"rwkv": [51259, 655, 5.776841499027796e-05, [[4435, 0.388601, " be", false], [31059, 0.053649, " have", false], [32499, 0.030203, " work", false], [56041, 0.023762, " dominate", false], [52724, 0.020926, " require", false], [32187, 0.018803, " take", false], [21751, 0.018684, " get", false], [22770, 0.017817, " win", false], [52573, 0.017649, " produce", false], [31358, 0.017335, " make", false]]], "qwen": [1367, 775, 4.99966845382005e-05, [[387, 0.36151, " be", false], [614, 0.042109, " have", false], [1373, 0.036102, " require", false], [975, 0.030456, " work", false], [633, 0.021392, " get", false], [3690, 0.017015, " fail", false], [1896, 0.015833, " take", false], [1281, 0.013949, " make", false], [5244, 0.013403, " focus", false], [7676, 0.013377, " suffer", false]]]}, "raw_delta": -0.013951561366080896, "tuned_delta": -0.006614422852378159}, {"byte_start": 1145, "byte_end": 1153, "display": {"text": " methods", "kind": "normal"}, "is_word": true, "word_id": 192, "word_key": " methods", "bytes_hex": "20 6d 65 74 68 6f 64 73", "compression": {"rwkv": "13.60% 13.60% 13.60% 13.60% 13.60% 13.60% 13.60% 13.60%", "qwen": "18.08% 18.08% 18.08% 18.08% 18.08% 18.08% 18.08% 18.08%"}, "model_tokens": {"rwkv": [[52224, " methods", "normal", 0.0023864831309765577]], "qwen": [[5413, " methods", "normal", 0.00032932707108557224]]}, "loss": {"rwkv": 13.595710102127438, "qwen": 18.075299213488297}, "topk": {"rwkv": [52224, 23, 0.0023864831309765577, [[22590, 0.355017, " the", false], [47539, 0.16304, " things", false], [52201, 0.145719, " matters", false], [21265, 0.050993, " and", false], [47001, 0.018624, " rather", false], [57103, 0.016483, " research", false], [332, 0.016335, " a", false], [3609, 0.015908, " AI", false], [45, 0.01119, ",", false], [32464, 0.00908, " what", false]]], "qwen": [5413, 156, 0.00032932707108557224, [[279, 0.495973, " the", false], [2513, 0.067816, " things", false], [323, 0.064714, " and", false], [12850, 0.032657, " matters", false], [4751, 0.024639, " rather", false], [11, 0.02087, ",", false], [3412, 0.010926, " research", false], [8129, 0.009122, " implementation", false], [264, 0.008041, " a", false], [4401, 0.005654, " development", false]]]}, "raw_delta": -0.24840116500854492, "tuned_delta": -0.24106402649484218}, {"byte_start": 1153, "byte_end": 1156, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 193, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "18.50% 18.50% 18.50%", "qwen": "22.10% 22.10% 22.10%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.046075787395238876]], "qwen": [[304, " in", "normal", 0.025293856859207153]]}, "loss": {"rwkv": 18.503315303068085, "qwen": 22.104454296729404}, "topk": {"rwkv": [4596, 5, 0.046075787395238876, [[45, 0.196107, ",", false], [32227, 0.164546, " that", false], [21265, 0.120361, " and", false], [47, 0.056569, ".", false], [4596, 0.046076, " in", false], [4811, 0.030052, " to", false], [31458, 0.025053, " more", false], [4450, 0.023437, " by", false], [4706, 0.022104, " of", false], [47001, 0.021964, " rather", false]]], "qwen": [304, 6, 0.025293856859207153, [[429, 0.390262, " that", false], [11, 0.095794, ",", false], [323, 0.070518, " and", false], [369, 0.041975, " for", false], [4751, 0.027086, " rather", false], [304, 0.025294, " in", false], [315, 0.022812, " of", false], [553, 0.022671, " by", false], [13, 0.020143, ".", false], [1576, 0.016294, " because", false]]]}, "raw_delta": -0.19968954722086574, "tuned_delta": -0.192352408707163}, {"byte_start": 1156, "byte_end": 1161, "display": {"text": " ways", "kind": "normal"}, "is_word": true, "word_id": 194, "word_key": " ways", "bytes_hex": "20 77 61 79 73", "compression": {"rwkv": "2.58% 2.58% 2.58% 2.58% 2.58%", "qwen": "6.36% 6.36% 6.36% 6.36% 6.36%"}, "model_tokens": {"rwkv": [[32448, " ways", "normal", 0.49242207407951355]], "qwen": [[5510, " ways", "normal", 0.17169059813022614]]}, "loss": {"rwkv": 2.5782538328386746, "qwen": 6.355292525555081}, "topk": {"rwkv": [32448, 1, 0.49242207407951355, [[32448, 0.492422, " ways", false], [332, 0.222644, " a", false], [32139, 0.037806, " such", false], [22590, 0.036475, " the", false], [4419, 0.014206, " an", false], [63667, 0.00911, " interesting", false], [39189, 0.008461, " order", false], [39193, 0.006104, " other", false], [22184, 0.005555, " non", false], [31458, 0.005343, " more", false]]], "qwen": [5510, 2, 0.17169059813022614, [[279, 0.208881, " the", false], [5510, 0.171691, " ways", false], [264, 0.13501, " a", false], [1008, 0.060408, " other", false], [4586, 0.037049, " general", false], [1741, 0.024941, " such", false], [1657, 0.021943, " many", false], [1045, 0.018936, " some", false], [1973, 0.018058, " order", false], [458, 0.016294, " an", false]]]}, "raw_delta": -0.20944349765777587, "tuned_delta": -0.20210635914407313}, {"byte_start": 1161, "byte_end": 1166, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 195, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"rwkv": "0.18% 0.18% 0.18% 0.18% 0.18%", "qwen": "0.27% 0.27% 0.27% 0.27% 0.27%"}, "model_tokens": {"rwkv": [[32227, " that", "normal", 0.9502723217010498]], "qwen": [[429, " that", "normal", 0.9284818768501282]]}, "loss": {"rwkv": 0.18403519503527424, "qwen": 0.2676359078751071}, "topk": {"rwkv": [32227, 1, 0.9502723217010498, [[32227, 0.950272, " that", false], [40186, 0.008509, " which", false], [22590, 0.006456, " the", false], [22187, 0.004018, " not", false], [40185, 0.00294, " where", false], [4811, 0.001744, " to", false], [275, 0.00139, " (", false], [32232, 0.001223, " they", false], [4596, 0.000899, " in", false], [31458, 0.000809, " more", false]]], "qwen": [429, 1, 0.9284818768501282, [[429, 0.928482, " that", false], [279, 0.011645, " the", false], [537, 0.005787, " not", false], [892, 0.005376, " which", false], [34447, 0.004525, " computation", false], [304, 0.003858, " in", false], [1380, 0.002201, " where", false], [807, 0.002154, " they", false], [432, 0.001872, " it", false], [311, 0.001355, " to", false]]]}, "raw_delta": -0.004635807871818543, "tuned_delta": 0.0027013306418841934}, {"byte_start": 1166, "byte_end": 1171, "display": {"text": " make", "kind": "normal"}, "is_word": true, "word_id": 196, "word_key": " make", "bytes_hex": "20 6d 61 6b 65", "compression": {"rwkv": "4.40% 4.40% 4.40% 4.40% 4.40%", "qwen": "6.13% 6.13% 6.13% 6.13% 6.13%"}, "model_tokens": {"rwkv": [[31358, " make", "normal", 0.2986183166503906]], "qwen": [[1281, " make", "normal", 0.18291719257831573]]}, "loss": {"rwkv": 4.39571145270856, "qwen": 6.12684367084774}, "topk": {"rwkv": [31358, 1, 0.2986183166503906, [[31358, 0.298618, " make", false], [21286, 0.094077, " are", false], [22590, 0.040051, " the", false], [47030, 0.038869, " reduce", false], [21413, 0.024777, " can", false], [56433, 0.020624, " increase", false], [32053, 0.01843, " slow", false], [32216, 0.013875, " tend", false], [38900, 0.0136, " limit", false], [4491, 0.0128, " do", false]]], "qwen": [1281, 1, 0.18291719257831573, [[1281, 0.182917, " make", false], [525, 0.147376, " are", false], [279, 0.042186, " the", false], [646, 0.036885, " can", false], [1367, 0.018263, " comp", false], [7949, 0.014246, " reduce", false], [653, 0.013098, " do", false], [11, 0.011434, ",", false], [1373, 0.01119, " require", false], [1231, 0.010123, " may", false]]]}, "raw_delta": -0.09599435329437259, "tuned_delta": -0.08865721478066985}, {"byte_start": 1171, "byte_end": 1176, "display": {"text": " them", "kind": "normal"}, "is_word": true, "word_id": 197, "word_key": " them", "bytes_hex": "20 74 68 65 6d", "compression": {"rwkv": "2.86% 2.86% 2.86% 2.86% 2.86%", "qwen": "2.85% 2.85% 2.85% 2.85% 2.85%"}, "model_tokens": {"rwkv": [[32229, " them", "normal", 0.4544193148612976]], "qwen": [[1105, " them", "normal", 0.4536651372909546]]}, "loss": {"rwkv": 2.8600302080123003, "qwen": 2.850750669106684}, "topk": {"rwkv": [32229, 1, 0.4544193148612976, [[32229, 0.454419, " them", false], [4601, 0.189278, " it", false], [22590, 0.057462, " the", false], [63370, 0.038965, " computation", false], [39931, 0.034191, " their", false], [38888, 0.01964, " lever", false], [332, 0.007406, " a", false], [51832, 0.005709, " general", false], [65135, 0.005196, " generalization", false], [31323, 0.004986, " long", false]]], "qwen": [1105, 1, 0.4536651372909546, [[1105, 0.453665, " them", false], [432, 0.178793, " it", false], [279, 0.064649, " the", false], [76482, 0.037198, " leveraging", false], [862, 0.026683, " their", false], [34447, 0.023364, " computation", false], [32064, 0.012587, " leverage", false], [990, 0.008797, " use", false], [4623, 0.00801, " further", false], [4586, 0.00795, " general", false]]]}, "raw_delta": 0.0005145668983459473, "tuned_delta": 0.007851705412048684}, {"byte_start": 1176, "byte_end": 1181, "display": {"text": " less", "kind": "normal"}, "is_word": true, "word_id": 198, "word_key": " less", "bytes_hex": "20 6c 65 73 73", "compression": {"rwkv": "3.92% 3.92% 3.92% 3.92% 3.92%", "qwen": "5.01% 5.01% 5.01% 5.01% 5.01%"}, "model_tokens": {"rwkv": [[31277, " less", "normal", 0.3325381278991699]], "qwen": [[2686, " less", "normal", 0.248989537358284]]}, "loss": {"rwkv": 3.9166916149133963, "qwen": 5.014607360190208}, "topk": {"rwkv": [31277, 1, 0.3325381278991699, [[31277, 0.332538, " less", false], [46162, 0.256747, " harder", false], [31458, 0.093874, " more", false], [31048, 0.040134, " hard", false], [59516, 0.028548, " difficult", false], [31466, 0.01387, " much", false], [40216, 0.010271, " worse", false], [47313, 0.009941, " slower", false], [62699, 0.00725, " unsuitable", false], [45819, 0.007038, " easier", false]]], "qwen": [2686, 1, 0.248989537358284, [[2686, 0.24899, " less", false], [15750, 0.230981, " harder", false], [803, 0.126236, " more", false], [5000, 0.041384, " difficult", false], [2588, 0.036845, " hard", false], [3716, 0.024595, " comput", false], [28393, 0.021285, " slower", false], [1753, 0.014994, " much", false], [94649, 0.009414, " brittle", false], [10960, 0.00875, " worse", false]]]}, "raw_delta": -0.06088137626647947, "tuned_delta": -0.05354423775277674}, {"byte_start": 1181, "byte_end": 1188, "display": {"text": " suited", "kind": "normal"}, "is_word": true, "word_id": 199, "word_key": " suited", "bytes_hex": "20 73 75 69 74 65 64", "compression": {"rwkv": "15.30% 15.30% 15.30% 15.30% 15.30% 15.30% 15.30%", "qwen": "15.30% 15.30% 15.30% 15.30% 15.30% 15.30% 15.30%"}, "model_tokens": {"rwkv": [[47460, " suited", "normal", 0.0026439959183335304]], "qwen": [[31499, " suited", "normal", 0.002638147445395589]]}, "loss": {"rwkv": 15.296431795139677, "qwen": 15.296891234506983}, "topk": {"rwkv": [47460, 28, 0.0026439959183335304, [[30140, 0.244275, " amen", false], [59593, 0.205373, " effective", false], [51832, 0.098337, " general", false], [59594, 0.057628, " efficient", false], [46439, 0.027589, " likely", false], [47687, 0.024685, " useful", false], [47129, 0.020946, " robust", false], [57160, 0.020066, " scalable", false], [56248, 0.015411, " flexible", false], [64862, 0.01379, " computational", false]]], "qwen": [31499, 38, 0.002638147445395589, [[4586, 0.170988, " general", false], [7373, 0.162518, " effective", false], [3716, 0.074594, " comput", false], [68211, 0.073624, " scalable", false], [1079, 0.056863, " am", false], [11050, 0.039339, " efficient", false], [21765, 0.022776, " robust", false], [6707, 0.021299, " easily", false], [41829, 0.016703, " tract", false], [93748, 0.015319, " adaptable", false]]]}, "raw_delta": -2.54767281668844e-05, "tuned_delta": 0.007311661785535852}, {"byte_start": 1188, "byte_end": 1191, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 200, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "1.41% 1.41% 1.41%", "qwen": "1.70% 1.70% 1.70%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.791496992111206]], "qwen": [[311, " to", "normal", 0.7539805173873901]]}, "loss": {"rwkv": 1.4088818758681283, "qwen": 1.6975033396946884}, "topk": {"rwkv": [4811, 1, 0.791496992111206, [[4811, 0.791497, " to", false], [21700, 0.184726, " for", false], [32226, 0.005441, " than", false], [4423, 0.002805, " as", false], [4596, 0.002101, " in", false], [45, 0.001973, ",", false], [53169, 0.001522, " towards", false], [4715, 0.001194, " or", false], [275, 0.00109, " (", false], [21265, 0.001061, " and", false]]], "qwen": [311, 1, 0.7539805173873901, [[311, 0.753981, " to", false], [369, 0.22766, " for", false], [1091, 0.004099, " than", false], [438, 0.001821, " as", false], [11, 0.001675, ",", false], [6974, 0.001194, " towards", false], [476, 0.000963, " or", false], [320, 0.000937, " (", false], [323, 0.000754, " and", false], [304, 0.000699, " in", false]]]}, "raw_delta": -0.016004572312037155, "tuned_delta": -0.008667433798334418}, {"byte_start": 1191, "byte_end": 1198, "display": {"text": " taking", "kind": "normal"}, "is_word": true, "word_id": 201, "word_key": " taking", "bytes_hex": "20 74 61 6b 69 6e 67", "compression": {"rwkv": "12.16% 12.16% 12.16% 12.16% 12.16% 12.16% 12.16%", "qwen": "12.58% 12.58% 12.58% 12.58% 12.58% 12.58% 12.58%"}, "model_tokens": {"rwkv": [[47497, " taking", "normal", 0.008828354068100452]], "qwen": [[4633, " taking", "normal", 0.007579374127089977]]}, "loss": {"rwkv": 12.156637900347851, "qwen": 12.578045761309482}, "topk": {"rwkv": [47497, 13, 0.008828354068100452, [[22590, 0.219742, " the", false], [38888, 0.088561, " lever", false], [52805, 0.036033, " scaling", false], [63370, 0.035005, " computation", false], [37832, 0.033528, " being", false], [51832, 0.030345, " general", false], [56540, 0.02944, " leverage", false], [31323, 0.027916, " long", false], [38864, 0.014215, " large", false], [332, 0.013337, " a", false]]], "qwen": [4633, 19, 0.007579374127089977, [[279, 0.168114, " the", false], [32064, 0.113406, " leverage", false], [76482, 0.088211, " leveraging", false], [34447, 0.035141, " computation", false], [26943, 0.030086, " scaling", false], [70601, 0.021356, " exploiting", false], [4586, 0.02086, " general", false], [39661, 0.020574, " exploitation", false], [3460, 0.018556, " large", false], [990, 0.013438, " use", false]]]}, "raw_delta": -0.023367813655308267, "tuned_delta": -0.01603067514160553}, {"byte_start": 1198, "byte_end": 1208, "display": {"text": " advantage", "kind": "normal"}, "is_word": true, "word_id": 202, "word_key": " advantage", "bytes_hex": "20 61 64 76 61 6e 74 61 67 65", "compression": {"rwkv": "0.44% 0.44% 0.44% 0.44% 0.44% 0.44% 0.44% 0.44% 0.44% 0.44%", "qwen": "0.14% 0.14% 0.14% 0.14% 0.14% 0.14% 0.14% 0.14% 0.14% 0.14%"}, "model_tokens": {"rwkv": [[59093, " advantage", "normal", 0.7817210555076599]], "qwen": [[9423, " advantage", "normal", 0.9232712388038635]]}, "loss": {"rwkv": 0.4437977908984603, "qwen": 0.14396693232400448}, "topk": {"rwkv": [59093, 1, 0.7817210555076599, [[59093, 0.781721, " advantage", false], [30923, 0.186134, " full", false], [52204, 0.004355, " maximum", false], [22590, 0.003752, " the", false], [56540, 0.002693, " leverage", false], [52203, 0.002638, " maximal", false], [61544, 0.001528, " advantages", false], [30273, 0.000988, " best", false], [4712, 0.00072, " on", false], [332, 0.000663, " a", false]]], "qwen": [9423, 1, 0.9232712388038635, [[9423, 0.923271, " advantage", false], [2480, 0.047825, " full", false], [279, 0.004137, " the", false], [22146, 0.001789, " advantages", false], [8760, 0.00139, " benefit", false], [54480, 0.001342, " computational", false], [389, 0.001265, " on", false], [32064, 0.00112, " leverage", false], [2664, 0.001028, " better", false], [7192, 0.00101, " maximum", false]]]}, "raw_delta": 0.016626153141260147, "tuned_delta": 0.023963291654962884}, {"byte_start": 1208, "byte_end": 1211, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 203, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "0.01% 0.01% 0.01%", "qwen": "0.02% 0.02% 0.02%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.9978208541870117]], "qwen": [[315, " of", "normal", 0.9961793422698975]]}, "loss": {"rwkv": 0.013116543505803536, "qwen": 0.02301089239628658}, "topk": {"rwkv": [4706, 1, 0.9978208541870117, [[4706, 0.997821, " of", false], [22590, 0.000467, " the", false], [45, 0.000131, ",", false], [4811, 0.0001, " to", false], [4715, 9.9e-05, " or", false], [275, 8.7e-05, " (", false], [21265, 8.4e-05, " and", false], [4596, 7.9e-05, " in", false], [47, 5.9e-05, ".", false], [30917, 3.9e-05, " from", false]]], "qwen": [315, 1, 0.9961793422698975, [[315, 0.996179, " of", false], [279, 0.000355, " the", false], [916, 0.000197, " over", false], [11, 0.000181, ",", false], [320, 0.000174, " (", false], [304, 0.000158, " in", false], [979, 0.000141, " when", false], [13, 0.00014, ".", false], [624, 0.000134, ".\n", false], [3716, 0.000128, " comput", false]]]}, "raw_delta": -0.0005486592029531797, "tuned_delta": 0.006788479310749557}, {"byte_start": 1211, "byte_end": 1219, "display": {"text": " general", "kind": "normal"}, "is_word": true, "word_id": 204, "word_key": " general", "bytes_hex": "20 67 65 6e 65 72 61 6c", "compression": {"rwkv": "10.07% 10.07% 10.07% 10.07% 10.07% 10.07% 10.07% 10.07%", "qwen": "15.64% 15.64% 15.64% 15.64% 15.64% 15.64% 15.64% 15.64%"}, "model_tokens": {"rwkv": [[51832, " general", "normal", 0.011424032039940357]], "qwen": [[4586, " general", "normal", 0.0009715748601593077]]}, "loss": {"rwkv": 10.073505412457116, "qwen": 15.636542228590956}, "topk": {"rwkv": [51832, 15, 0.011424032039940357, [[22590, 0.303405, " the", false], [63370, 0.157458, " computation", false], [30789, 0.027819, " ever", false], [59846, 0.02251, " increased", false], [37045, 0.022385, " Moore", false], [52195, 0.020302, " massive", false], [46064, 0.018045, " future", false], [22168, 0.017638, " new", false], [31458, 0.017612, " more", false], [64862, 0.017045, " computational", false]]], "qwen": [4586, 78, 0.0009715748601593077, [[279, 0.377646, " the", false], [34447, 0.123759, " computation", false], [501, 0.036997, " new", false], [54480, 0.03647, " computational", false], [10951, 0.024283, " massive", false], [3853, 0.02029, " future", false], [7172, 0.017718, " increased", false], [74151, 0.014298, " exponentially", false], [264, 0.010983, " a", false], [419, 0.009906, " this", false]]]}, "raw_delta": -0.30848026275634766, "tuned_delta": -0.30114312424264494}, {"byte_start": 1219, "byte_end": 1227, "display": {"text": " methods", "kind": "normal"}, "is_word": true, "word_id": 205, "word_key": " methods", "bytes_hex": "20 6d 65 74 68 6f 64 73", "compression": {"rwkv": "3.31% 3.31% 3.31% 3.31% 3.31% 3.31% 3.31% 3.31%", "qwen": "3.72% 3.72% 3.72% 3.72% 3.72% 3.72% 3.72% 3.72%"}, "model_tokens": {"rwkv": [[52224, " methods", "normal", 0.23186956346035004]], "qwen": [[5413, " methods", "normal", 0.19181130826473236]]}, "loss": {"rwkv": 3.310872408290101, "qwen": 3.722250340864776}, "topk": {"rwkv": [52224, 2, 0.23186956346035004, [[63370, 0.4417, " computation", false], [52224, 0.23187, " methods", false], [46, 0.03256, "-", false], [64862, 0.030287, " computational", false], [61590, 0.028573, " approaches", false], [7933, 0.021709, "ity", false], [41729, 0.01786, "izable", false], [45, 0.01437, ",", false], [59346, 0.012275, " computing", false], [62633, 0.011489, " techniques", false]]], "qwen": [5413, 2, 0.19181130826473236, [[58238, 0.214484, "-purpose", false], [5413, 0.191811, " methods", false], [34447, 0.178298, " computation", false], [18142, 0.0596, " improvements", false], [54480, 0.056473, " computational", false], [2022, 0.028061, "ization", false], [24231, 0.019293, " computing", false], [12538, 0.017913, " techniques", false], [11, 0.01274, ",", false], [15673, 0.012652, " improvement", false]]]}, "raw_delta": -0.022811636328697205, "tuned_delta": -0.015474497814994468}, {"byte_start": 1227, "byte_end": 1238, "display": {"text": " leveraging", "kind": "normal"}, "is_word": true, "word_id": 206, "word_key": " leveraging", "bytes_hex": "20 6c 65 76 65 72 61 67 69 6e 67", "compression": {"rwkv": "14.46% 14.46% 14.46% 14.46% 14.46% 14.46% 0.01% 0.01% 0.01% 0.01% 0.01%", "qwen": "9.42% 9.42% 9.42% 9.42% 9.42% 9.42% 9.42% 9.42% 9.42% 9.42% 9.42%"}, "model_tokens": {"rwkv": [[38888, " lever", "normal", 0.007997123524546623], [33672, "aging", "normal", 0.9960817694664001]], "qwen": [[76482, " leveraging", "normal", 0.003186533460393548]]}, "loss": {"rwkv": 7.896142513388193, "qwen": 9.424768873398197}, "topk": {"rwkv": [38888, 12, 0.007997123524546623, [[47, 0.564041, ".", false], [32227, 0.121789, " that", false], [45, 0.082142, ",", false], [21265, 0.028665, " and", false], [4706, 0.023123, " of", false], [21700, 0.020084, " for", false], [275, 0.017528, " (", false], [31296, 0.01184, " like", false], [37810, 0.010116, " based", false], [4596, 0.010013, " in", false]]], "qwen": [76482, 22, 0.003186533460393548, [[624, 0.246874, ".\n", false], [13, 0.230331, ".", false], [429, 0.156389, " that", false], [11, 0.072402, ",", false], [315, 0.049732, " of", false], [323, 0.033619, " and", false], [369, 0.023689, " for", false], [382, 0.019129, ".\n\n", false], [320, 0.01717, " (", false], [304, 0.014904, " in", false]]]}, "raw_delta": -0.08476504412564366, "tuned_delta": -0.07742790561194092}, {"byte_start": 1238, "byte_end": 1250, "display": {"text": " computation", "kind": "normal"}, "is_word": true, "word_id": 207, "word_key": " computation", "bytes_hex": "20 63 6f 6d 70 75 74 61 74 69 6f 6e", "compression": {"rwkv": "0.18% 0.18% 0.18% 0.18% 0.18% 0.18% 0.18% 0.18% 0.18% 0.18% 0.18% 0.18%", "qwen": "0.25% 0.25% 0.25% 0.25% 0.25% 0.25% 0.25% 0.25% 0.25% 0.25% 0.25% 0.25%"}, "model_tokens": {"rwkv": [[63370, " computation", "normal", 0.8859444260597229]], "qwen": [[34447, " computation", "normal", 0.8454323410987854]]}, "loss": {"rwkv": 0.18124678298928526, "qwen": 0.25233207199651386}, "topk": {"rwkv": [63370, 1, 0.8859444260597229, [[63370, 0.885944, " computation", false], [22590, 0.01314, " the", false], [52195, 0.006724, " massive", false], [64862, 0.005695, " computational", false], [31458, 0.003408, " more", false], [59846, 0.003176, " increased", false], [59346, 0.002973, " computing", false], [30789, 0.002966, " ever", false], [64298, 0.002932, " computations", false], [38864, 0.002575, " large", false]]], "qwen": [34447, 1, 0.8454323410987854, [[34447, 0.845432, " computation", false], [279, 0.034439, " the", false], [54480, 0.015215, " computational", false], [803, 0.007779, " more", false], [10951, 0.006185, " massive", false], [7172, 0.004161, " increased", false], [7703, 0.003956, " increasing", false], [74151, 0.003853, " exponentially", false], [8570, 0.003264, " continued", false], [3460, 0.002766, " large", false]]]}, "raw_delta": -0.003941805412371955, "tuned_delta": 0.003395333101330782}, {"byte_start": 1250, "byte_end": 1251, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "2.55%", "qwen": "17.46%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.8681315779685974]], "qwen": [[13, ".", "normal", 0.37966933846473694]]}, "loss": {"rwkv": 2.553598400010982, "qwen": 17.464808098154315}, "topk": {"rwkv": [47, 1, 0.8681315779685974, [[47, 0.868132, ".", false], [45, 0.06411, ",", false], [275, 0.016747, " (", false], [32227, 0.004403, " that", false], [4596, 0.004052, " in", false], [4811, 0.003372, " to", false], [21265, 0.003167, " and", false], [60, 0.003072, ";", false], [4423, 0.001935, " as", false], [9816, 0.001897, "—", false]]], "qwen": [13, 2, 0.37966933846473694, [[624, 0.447089, ".\n", false], [13, 0.379669, ".", false], [11, 0.054649, ",", false], [382, 0.028451, ".\n\n", false], [320, 0.017153, " (", false], [304, 0.008535, " in", false], [311, 0.006268, " to", false], [26, 0.00412, ";", false], [429, 0.004086, " that", false], [323, 0.003441, " and", false]]]}, "raw_delta": -0.8268530368804932, "tuned_delta": -0.8195158983667904}, {"byte_start": 1251, "byte_end": 1258, "display": {"text": "  There", "kind": "normal"}, "is_word": true, "word_id": 208, "word_key": "  there", "bytes_hex": "20 20 54 68 65 72 65", "compression": {"rwkv": "78.33% 78.33% 11.67% 11.67% 11.67% 11.67% 11.67%", "qwen": "101.92% 13.40% 13.40% 13.40% 13.40% 13.40% 13.40%"}, "model_tokens": {"rwkv": [[267, "  ", "normal", 0.00017019797815009952], [33504, "There", "normal", 0.03908878564834595]], "qwen": [[220, " ", "normal", 0.0035120798274874687], [2619, " There", "normal", 0.011573479510843754]]}, "loss": {"rwkv": 30.71362489392519, "qwen": 26.047306847837543}, "topk": {"rwkv": [267, 197, 0.00017019797815009952, [[11, 0.400473, "\n", false], [261, 0.118609, "\n\n", false], [20996, 0.067599, " The", false], [29894, 0.030724, " This", false], [19555, 0.028749, " But", false], [3913, 0.023361, " In", false], [3918, 0.020811, " It", false], [4217, 0.014991, " So", false], [37451, 0.012859, " There", false], [19907, 0.012382, " For", false]]], "qwen": [220, 44, 0.0035120798274874687, [[576, 0.122041, " The", false], [1096, 0.072077, " This", false], [758, 0.061168, " In", false], [1084, 0.035065, " It", false], [1988, 0.033449, " But", false], [2619, 0.027887, " There", false], [151643, 0.026966, "\u003c|endoftext|\u003e", false], [1752, 0.026654, " For", false], [2055, 0.021972, " So", false], [4220, 0.021806, " These", false]]]}, "raw_delta": 0.2587556157793318, "tuned_delta": 0.26609275429303453}, {"byte_start": 1258, "byte_end": 1263, "display": {"text": " were", "kind": "normal"}, "is_word": true, "word_id": 209, "word_key": " were", "bytes_hex": "20 77 65 72 65", "compression": {"rwkv": "17.81% 17.81% 17.81% 17.81% 17.81%", "qwen": "18.96% 18.96% 18.96% 18.96% 18.96%"}, "model_tokens": {"rwkv": [[32462, " were", "normal", 0.0070932237431406975]], "qwen": [[1033, " were", "normal", 0.005216585472226143]]}, "loss": {"rwkv": 17.808266910973142, "qwen": 18.956696540548123}, "topk": {"rwkv": [32462, 8, 0.0070932237431406975, [[21286, 0.494507, " are", false], [4600, 0.314811, " is", false], [460, 0.074907, "'s", false], [31059, 0.033032, " have", false], [21800, 0.020632, " has", false], [22748, 0.01004, " was", false], [22074, 0.007759, " may", false], [32462, 0.007093, " were", false], [32475, 0.00575, " will", false], [21413, 0.003, " can", false]]], "qwen": [1033, 8, 0.005216585472226143, [[525, 0.480714, " are", false], [374, 0.368058, " is", false], [594, 0.03353, "'s", false], [614, 0.032211, " have", false], [702, 0.02271, " has", false], [572, 0.008697, " was", false], [1231, 0.005935, " may", false], [1033, 0.005217, " were", false], [646, 0.003663, " can", false], [686, 0.003034, " will", false]]]}, "raw_delta": -0.06368246078491202, "tuned_delta": -0.05634532227120928}, {"byte_start": 1263, "byte_end": 1268, "display": {"text": " many", "kind": "normal"}, "is_word": true, "word_id": 210, "word_key": " many", "bytes_hex": "20 6d 61 6e 79", "compression": {"rwkv": "9.41% 9.41% 9.41% 9.41% 9.41%", "qwen": "8.42% 8.42% 8.42% 8.42% 8.42%"}, "model_tokens": {"rwkv": [[31370, " many", "normal", 0.07423875480890274]], "qwen": [[1657, " many", "normal", 0.09687885642051697]]}, "loss": {"rwkv": 9.411330930799096, "qwen": 8.41918623562942}, "topk": {"rwkv": [31370, 4, 0.07423875480890274, [[332, 0.11888, " a", false], [32074, 0.090574, " some", false], [22638, 0.085378, " two", false], [31370, 0.074239, " many", false], [52869, 0.048259, " several", false], [39193, 0.039918, " other", false], [61963, 0.029018, " exceptions", false], [39962, 0.026907, " times", false], [45, 0.02348, ",", false], [39946, 0.018904, " three", false]]], "qwen": [1657, 3, 0.09687885642051697, [[1378, 0.182187, " two", false], [264, 0.116732, " a", false], [1657, 0.096879, " many", false], [1045, 0.0537, " some", false], [2326, 0.037893, " three", false], [3807, 0.036552, " several", false], [11, 0.035038, ",", false], [1008, 0.023848, " other", false], [3039, 0.022582, " times", false], [19585, 0.018904, " exceptions", false]]]}, "raw_delta": 0.05501618385314938, "tuned_delta": 0.06235332236685212}, {"byte_start": 1268, "byte_end": 1277, "display": {"text": " examples", "kind": "normal"}, "is_word": true, "word_id": 211, "word_key": " examples", "bytes_hex": "20 65 78 61 6d 70 6c 65 73", "compression": {"rwkv": "5.76% 5.76% 5.76% 5.76% 5.76% 5.76% 5.76% 5.76% 5.76%", "qwen": "9.31% 9.31% 9.31% 9.31% 9.31% 9.31% 9.31% 9.31% 9.31%"}, "model_tokens": {"rwkv": [[56162, " examples", "normal", 0.0561143197119236]], "qwen": [[10295, " examples", "normal", 0.009600982069969177]]}, "loss": {"rwkv": 5.760761447994124, "qwen": 9.309170560900908}, "topk": {"rwkv": [56162, 2, 0.0561143197119236, [[39193, 0.064558, " other", false], [56162, 0.056114, " examples", false], [3609, 0.031489, " AI", false], [52654, 0.030757, " reasons", false], [46787, 0.023954, " people", false], [30992, 0.023132, " good", false], [38328, 0.022827, " early", false], [55572, 0.020883, " attempts", false], [32448, 0.020377, " ways", false], [39962, 0.019316, " times", false]]], "qwen": [10295, 13, 0.009600982069969177, [[7966, 0.098679, " reasons", false], [4124, 0.048259, " early", false], [1008, 0.04031, " other", false], [2989, 0.033604, " important", false], [19827, 0.031808, " approaches", false], [1661, 0.029696, " good", false], [18366, 0.028182, " lessons", false], [13553, 0.025138, " attempts", false], [2244, 0.024823, " great", false], [5510, 0.014277, " ways", false]]]}, "raw_delta": -0.1967655817667644, "tuned_delta": -0.18942844325306166}, {"byte_start": 1277, "byte_end": 1280, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 212, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "2.96% 2.96% 2.96%", "qwen": "2.10% 2.10% 2.10%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.61343914270401]], "qwen": [[315, " of", "normal", 0.7047458291053772]]}, "loss": {"rwkv": 2.9586519393230692, "qwen": 2.103437752646663}, "topk": {"rwkv": [4706, 1, 0.61343914270401, [[4706, 0.613439, " of", false], [4596, 0.168451, " in", false], [45805, 0.028667, " during", false], [31601, 0.024389, " over", false], [30917, 0.018995, " from", false], [32227, 0.018298, " that", false], [62650, 0.015974, " throughout", false], [40185, 0.015438, " where", false], [45, 0.012821, ",", false], [37678, 0.008415, " along", false]]], "qwen": [315, 1, 0.7047458291053772, [[315, 0.704746, " of", false], [304, 0.100277, " in", false], [1380, 0.026316, " where", false], [429, 0.018377, " that", false], [6814, 0.015871, " throughout", false], [11, 0.011269, ",", false], [2337, 0.010415, " during", false], [4124, 0.010242, " early", false], [3156, 0.008302, " along", false], [1573, 0.008228, " before", false]]]}, "raw_delta": 0.04742314418156942, "tuned_delta": 0.05476028269527215}, {"byte_start": 1280, "byte_end": 1283, "display": {"text": " AI", "kind": "normal"}, "is_word": true, "word_id": 213, "word_key": " ai", "bytes_hex": "20 41 49", "compression": {"rwkv": "20.19% 20.19% 20.19%", "qwen": "23.33% 23.33% 23.33%"}, "model_tokens": {"rwkv": [[3609, " AI", "normal", 0.03427301347255707]], "qwen": [[15235, " AI", "normal", 0.02062762901186943]]}, "loss": {"rwkv": 20.19397355410984, "qwen": 23.330326567436906}, "topk": {"rwkv": [3609, 3, 0.03427301347255707, [[32234, 0.494103, " this", false], [22590, 0.073582, " the", false], [3609, 0.034273, " AI", false], [57103, 0.021341, " research", false], [52224, 0.016555, " methods", false], [39936, 0.015279, " these", false], [63843, 0.014843, " researchers", false], [38720, 0.013557, " human", false], [51832, 0.012078, " general", false], [32139, 0.011971, " such", false]]], "qwen": [15235, 8, 0.02062762901186943, [[419, 0.215455, " this", false], [279, 0.10999, " the", false], [3738, 0.044208, " human", false], [11811, 0.023512, " researchers", false], [3412, 0.021636, " research", false], [4124, 0.02119, " early", false], [4586, 0.020909, " general", false], [15235, 0.020628, " AI", false], [1741, 0.016156, " such", false], [1493, 0.016148, " these", false]]]}, "raw_delta": -0.17391633987426758, "tuned_delta": -0.16657920136056484}, {"byte_start": 1283, "byte_end": 1295, "display": {"text": " researchers", "kind": "normal"}, "is_word": true, "word_id": 214, "word_key": " researchers", "bytes_hex": "20 72 65 73 65 61 72 63 68 65 72 73", "compression": {"rwkv": "3.80% 3.80% 3.80% 3.80% 3.80% 3.80% 3.80% 3.80% 3.80% 3.80% 3.80% 3.80%", "qwen": "2.33% 2.33% 2.33% 2.33% 2.33% 2.33% 2.33% 2.33% 2.33% 2.33% 2.33% 2.33%"}, "model_tokens": {"rwkv": [[63843, " researchers", "normal", 0.0790698379278183]], "qwen": [[11811, " researchers", "normal", 0.21270927786827087]]}, "loss": {"rwkv": 3.803981064843946, "qwen": 2.3260886422367912}, "topk": {"rwkv": [63843, 3, 0.0790698379278183, [[57103, 0.302787, " research", false], [53087, 0.086116, " systems", false], [63843, 0.07907, " researchers", false], [56952, 0.060216, " projects", false], [32227, 0.046042, " that", false], [52224, 0.04192, " methods", false], [61590, 0.025808, " approaches", false], [4596, 0.023636, " in", false], [45124, 0.0177, " agents", false], [60587, 0.0137, " successes", false]]], "qwen": [11811, 2, 0.21270927786827087, [[3412, 0.24725, " research", false], [11811, 0.212709, " researchers", false], [5942, 0.050485, " systems", false], [5413, 0.049835, " methods", false], [304, 0.035385, " in", false], [429, 0.03287, " that", false], [19827, 0.027719, " approaches", false], [7079, 0.020352, " projects", false], [1660, 0.017214, " being", false], [13009, 0.015859, " agents", false]]]}, "raw_delta": 0.08195175727208458, "tuned_delta": 0.08928889578578732}, {"byte_start": 1295, "byte_end": 1296, "display": {"text": "'", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "27", "compression": {"rwkv": "89.60%", "qwen": "76.98%"}, "model_tokens": {"rwkv": [[40, "'", "normal", 0.00689466018229723]], "qwen": [[6, "'", "normal", 0.013998657464981079]]}, "loss": {"rwkv": 89.60488730521296, "qwen": 76.98210025728152}, "topk": {"rwkv": [40, 27, 0.00689466018229723, [[22762, 0.219243, " who", false], [4596, 0.059549, " in", false], [46500, 0.036394, " making", false], [51709, 0.026463, " falling", false], [31601, 0.022415, " over", false], [51844, 0.020594, " getting", false], [47629, 0.018075, " trying", false], [32227, 0.017296, " that", false], [45, 0.016855, ",", false], [38279, 0.015547, " doing", false]]], "qwen": [6, 13, 0.013998657464981079, [[879, 0.162335, " who", false], [304, 0.061561, " in", false], [3259, 0.037806, " making", false], [4460, 0.024903, " trying", false], [429, 0.023692, " that", false], [10164, 0.019427, " spending", false], [1660, 0.018906, " being", false], [19405, 0.016969, " attempting", false], [3238, 0.01593, " working", false], [10887, 0.015721, " seeking", false]]]}, "raw_delta": 0.699955940246582, "tuned_delta": 0.7072930787602848}, {"byte_start": 1296, "byte_end": 1300, "display": {"text": " bel", "kind": "normal"}, "is_word": true, "word_id": 215, "word_key": " bel", "bytes_hex": "20 62 65 6c", "compression": {"rwkv": "41.70% 41.70% 41.70% 41.70%", "qwen": "38.94% 38.94% 38.94% 38.94%"}, "model_tokens": {"rwkv": [[21344, " bel", "normal", 9.651881555328146e-05]], "qwen": [[1656, " bel", "normal", 0.00017736996232997626]]}, "loss": {"rwkv": 41.70290352569659, "qwen": 38.94047089230917}, "topk": {"rwkv": [21344, 899, 9.651881555328146e-05, [[51708, 0.059587, " failure", false], [61701, 0.042615, " commitment", false], [62157, 0.02999, " investment", false], [55572, 0.021724, " attempts", false], [59834, 0.021614, " inability", false], [31601, 0.015991, " over", false], [38530, 0.015452, " focus", false], [56652, 0.013955, " mistakes", false], [63678, 0.013449, " investments", false], [57404, 0.012401, " tendency", false]]], "qwen": [1656, 650, 0.00017736996232997626, [[7901, 0.056277, " failure", false], [13553, 0.052514, " attempts", false], [8869, 0.043999, " efforts", false], [27850, 0.018851, " failures", false], [37450, 0.017477, " inability", false], [4124, 0.015337, " early", false], [15155, 0.013318, " commitment", false], [23187, 0.012418, " psychological", false], [975, 0.011972, " work", false], [5786, 0.011803, " mis", false]]]}, "raw_delta": 0.153181791305542, "tuned_delta": 0.16051892981924473}, {"byte_start": 1300, "byte_end": 1304, "display": {"text": "ated", "kind": "normal"}, "is_word": true, "word_id": 216, "word_key": "ated", "bytes_hex": "61 74 65 64", "compression": {"rwkv": "1.55% 1.55% 1.55% 1.55%", "qwen": "0.37% 0.37% 0.37% 0.37%"}, "model_tokens": {"rwkv": [[24738, "ated", "normal", 0.7104941606521606]], "qwen": [[657, "ated", "normal", 0.9212166666984558]]}, "loss": {"rwkv": 1.549770063454941, "qwen": 0.3699612855722067}, "topk": {"rwkv": [24738, 1, 0.7104941606521606, [[24738, 0.710494, "ated", false], [1840, 0.120446, "ea", false], [7931, 0.088189, "itt", false], [27525, 0.023769, "ying", false], [24385, 0.011716, "abor", false], [1848, 0.00722, "ei", false], [34907, 0.007218, "ittle", false], [33943, 0.003728, "ating", false], [34116, 0.002651, "ching", false], [1956, 0.001914, "it", false]]], "qwen": [657, 1, 0.9212166666984558, [[657, 0.921217, "ated", false], [1442, 0.039761, "itt", false], [415, 0.008735, "lic", false], [370, 0.00741, "ab", false], [550, 0.004834, "ies", false], [7272, 0.003059, "iger", false], [4324, 0.002297, "abor", false], [6711, 0.001472, "lying", false], [1122, 0.000989, "ied", false], [4738, 0.000925, "ief", false]]]}, "raw_delta": 0.06542249023914337, "tuned_delta": 0.07275962875284611}, {"byte_start": 1304, "byte_end": 1313, "display": {"text": " learning", "kind": "normal"}, "is_word": true, "word_id": 217, "word_key": " learning", "bytes_hex": "20 6c 65 61 72 6e 69 6e 67", "compression": {"rwkv": "11.21% 11.21% 11.21% 11.21% 11.21% 11.21% 11.21% 11.21% 11.21%", "qwen": "12.19% 12.19% 12.19% 12.19% 12.19% 12.19% 12.19% 12.19% 12.19%"}, "model_tokens": {"rwkv": [[56537, " learning", "normal", 0.003671869868412614]], "qwen": [[6832, " learning", "normal", 0.0022810553200542927]]}, "loss": {"rwkv": 11.20843803468422, "qwen": 12.189003806792723}, "topk": {"rwkv": [56537, 18, 0.003671869868412614, [[63821, 0.456058, " recognition", false], [63820, 0.235123, " realization", false], [59544, 0.049065, " discovery", false], [64253, 0.025682, " appreciation", false], [59209, 0.024355, " awareness", false], [65034, 0.021681, " understanding", false], [61518, 0.012078, " acceptance", false], [21265, 0.009162, " and", false], [55572, 0.008584, " attempts", false], [63257, 0.007496, " acknowledge", false]]], "qwen": [6832, 34, 0.0022810553200542927, [[398, 0.201051, "ly", false], [1931, 0.200269, " real", false], [17843, 0.121466, " recognition", false], [48703, 0.045398, " realization", false], [34896, 0.044657, " appreciation", false], [323, 0.020546, " and", false], [8660, 0.01876, " understanding", false], [17526, 0.013366, " awareness", false], [18335, 0.012287, " discovery", false], [24376, 0.011437, " adoption", false]]]}, "raw_delta": -0.0543741120232476, "tuned_delta": -0.04703697350954486}, {"byte_start": 1313, "byte_end": 1316, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 218, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "2.64% 2.64% 2.64%", "qwen": "7.03% 7.03% 7.03%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.6419601440429688]], "qwen": [[315, " of", "normal", 0.31049299240112305]]}, "loss": {"rwkv": 2.6416535172527404, "qwen": 7.0306973459062245}, "topk": {"rwkv": [4706, 1, 0.6419601440429688, [[4706, 0.64196, " of", false], [32227, 0.093698, " that", false], [30917, 0.064453, " from", false], [37598, 0.051916, " about", false], [4811, 0.027651, " to", false], [116, 0.018768, "s", false], [32234, 0.017658, " this", false], [4596, 0.012471, " in", false], [22590, 0.012027, " the", false], [45, 0.009202, ",", false]]], "qwen": [315, 1, 0.31049299240112305, [[315, 0.310493, " of", false], [429, 0.251639, " that", false], [419, 0.092231, " this", false], [311, 0.089571, " to", false], [911, 0.055374, " about", false], [279, 0.032315, " the", false], [504, 0.026661, " from", false], [304, 0.021464, " in", false], [11, 0.015319, ",", false], [13, 0.012185, ".", false]]]}, "raw_delta": -0.24338026841481528, "tuned_delta": -0.23604312990111254}, {"byte_start": 1316, "byte_end": 1321, "display": {"text": " this", "kind": "normal"}, "is_word": true, "word_id": 219, "word_key": " this", "bytes_hex": "20 74 68 69 73", "compression": {"rwkv": "2.90% 2.90% 2.90% 2.90% 2.90%", "qwen": "2.70% 2.70% 2.70% 2.70% 2.70%"}, "model_tokens": {"rwkv": [[32234, " this", "normal", 0.44505393505096436]], "qwen": [[419, " this", "normal", 0.472516268491745]]}, "loss": {"rwkv": 2.902296664288344, "qwen": 2.7039101619735093}, "topk": {"rwkv": [32234, 1, 0.44505393505096436, [[32234, 0.445054, " this", false], [22590, 0.340882, " the", false], [39936, 0.077245, " these", false], [51832, 0.018005, " general", false], [21835, 0.014844, " how", false], [32464, 0.010144, " what", false], [32227, 0.009772, " that", false], [37045, 0.009548, " Moore", false], [332, 0.007326, " a", false], [52127, 0.005772, " lessons", false]]], "qwen": [419, 1, 0.472516268491745, [[419, 0.472516, " this", false], [279, 0.384657, " the", false], [1493, 0.041137, " these", false], [1246, 0.019493, " how", false], [20219, 0.010266, " Moore", false], [429, 0.008741, " that", false], [1128, 0.007593, " what", false], [18366, 0.004646, " lessons", false], [862, 0.004166, " their", false], [4586, 0.002033, " general", false]]]}, "raw_delta": 0.011000883579254161, "tuned_delta": 0.018338022092956898}, {"byte_start": 1321, "byte_end": 1328, "display": {"text": " bitter", "kind": "normal"}, "is_word": true, "word_id": 220, "word_key": " bitter", "bytes_hex": "20 62 69 74 74 65 72", "compression": {"rwkv": "18.19% 18.19% 18.19% 18.19% 18.19% 18.19% 18.19%", "qwen": "13.15% 13.15% 13.15% 13.15% 13.15% 13.15% 13.15%"}, "model_tokens": {"rwkv": [[45315, " bitter", "normal", 0.0008620054577477276]], "qwen": [[25180, " bitter", "normal", 0.006068412680178881]]}, "loss": {"rwkv": 18.194703082639826, "qwen": 13.150830294665546}, "topk": {"rwkv": [45315, 47, 0.0008620054577477276, [[46430, 0.586187, " lesson", false], [30808, 0.083532, " fact", false], [4596, 0.032103, " in", false], [45, 0.024598, ",", false], [47, 0.022076, ".", false], [45805, 0.02088, " during", false], [31601, 0.020035, " over", false], [40029, 0.01554, " truth", false], [63591, 0.01467, " fundamental", false], [51832, 0.012961, " general", false]]], "qwen": [25180, 16, 0.006068412680178881, [[17755, 0.46085, " lesson", false], [8046, 0.050063, " truth", false], [2097, 0.04775, " fact", false], [13, 0.041519, ".", false], [11, 0.03482, ",", false], [304, 0.03178, " in", false], [17508, 0.019368, " principle", false], [916, 0.016598, " over", false], [2989, 0.015332, " important", false], [504, 0.009869, " from", false]]]}, "raw_delta": 0.2796916961669922, "tuned_delta": 0.2870288346806949}, {"byte_start": 1328, "byte_end": 1335, "display": {"text": " lesson", "kind": "normal"}, "is_word": true, "word_id": 221, "word_key": " lesson", "bytes_hex": "20 6c 65 73 73 6f 6e", "compression": {"rwkv": "0.10% 0.10% 0.10% 0.10% 0.10% 0.10% 0.10%", "qwen": "0.31% 0.31% 0.31% 0.31% 0.31% 0.31% 0.31%"}, "model_tokens": {"rwkv": [[46430, " lesson", "normal", 0.9634103775024414]], "qwen": [[17755, " lesson", "normal", 0.8855627179145813]]}, "loss": {"rwkv": 0.095602698719623, "qwen": 0.31309572112121836}, "topk": {"rwkv": [46430, 1, 0.9634103775024414, [[46430, 0.96341, " lesson", false], [40029, 0.014694, " truth", false], [30808, 0.00243, " fact", false], [45, 0.001943, ",", false], [21400, 0.001412, " but", false], [7513, 0.001314, "est", false], [21265, 0.001013, " and", false], [46454, 0.000934, " little", false], [31683, 0.000742, " pill", false], [52127, 0.00059, " lessons", false]]], "qwen": [17755, 1, 0.8855627179145813, [[17755, 0.885563, " lesson", false], [8046, 0.06927, " truth", false], [8729, 0.00557, " reality", false], [11, 0.003873, ",", false], [320, 0.003319, " (", false], [323, 0.002949, " and", false], [714, 0.002562, " but", false], [3139, 0.001814, " experience", false], [2097, 0.001787, " fact", false], [15177, 0.001644, " pill", false]]]}, "raw_delta": -0.01206037402153015, "tuned_delta": -0.004723235507827413}, {"byte_start": 1335, "byte_end": 1336, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "30.57%", "qwen": "27.29%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.18239976465702057]], "qwen": [[11, ",", "normal", 0.22016479074954987]]}, "loss": {"rwkv": 30.572736706338382, "qwen": 27.29180432778036}, "topk": {"rwkv": [45, 3, 0.18239976465702057, [[47, 0.287882, ".", false], [4596, 0.18818, " in", false], [45, 0.1824, ",", false], [31601, 0.066895, " over", false], [45805, 0.061286, " during", false], [59, 0.019234, ":", false], [32227, 0.017887, " that", false], [30917, 0.013504, " from", false], [62650, 0.012266, " throughout", false], [37634, 0.011038, " after", false]]], "qwen": [11, 2, 0.22016479074954987, [[13, 0.405673, ".", false], [11, 0.220165, ",", false], [304, 0.093385, " in", false], [916, 0.030259, " over", false], [25, 0.029627, ":", false], [2337, 0.021025, " during", false], [320, 0.013752, " (", false], [504, 0.013353, " from", false], [26, 0.012638, ";", false], [1573, 0.011087, " before", false]]]}, "raw_delta": 0.18193352222442627, "tuned_delta": 0.189270660738129}, {"byte_start": 1336, "byte_end": 1340, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 222, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"rwkv": "8.59% 8.59% 8.59% 8.59%", "qwen": "8.53% 8.53% 8.53% 8.53%"}, "model_tokens": {"rwkv": [[21265, " and", "normal", 0.1504797339439392]], "qwen": [[323, " and", "normal", 0.15088005363941193]]}, "loss": {"rwkv": 8.594179442795582, "qwen": 8.52664346813911}, "topk": {"rwkv": [21265, 2, 0.1504797339439392, [[21400, 0.353385, " but", false], [21265, 0.15048, " and", false], [59841, 0.0459, " including", false], [40186, 0.035547, " which", false], [4423, 0.024487, " as", false], [32139, 0.022184, " such", false], [4596, 0.021414, " in", false], [30917, 0.016931, " from", false], [22590, 0.014308, " the", false], [57295, 0.013829, " starting", false]]], "qwen": [323, 2, 0.15088005363941193, [[714, 0.256902, " but", false], [323, 0.15088, " and", false], [2670, 0.06764, " including", false], [1741, 0.031191, " such", false], [1429, 0.030556, " most", false], [892, 0.024749, " which", false], [3545, 0.023168, " often", false], [1045, 0.021803, " some", false], [438, 0.021583, " as", false], [504, 0.02001, " from", false]]]}, "raw_delta": 0.0037449896335601807, "tuned_delta": 0.011082128147262917}, {"byte_start": 1340, "byte_end": 1343, "display": {"text": " it", "kind": "normal"}, "is_word": true, "word_id": 223, "word_key": " it", "bytes_hex": "20 69 74", "compression": {"rwkv": "16.44% 16.44% 16.44%", "qwen": "17.43% 17.43% 17.43%"}, "model_tokens": {"rwkv": [[4601, " it", "normal", 0.06486406177282333]], "qwen": [[432, " it", "normal", 0.05506710335612297]]}, "loss": {"rwkv": 16.436955218461495, "qwen": 17.427773067479766}, "topk": {"rwkv": [4601, 3, 0.06486406177282333, [[22590, 0.109998, " the", false], [31370, 0.080386, " many", false], [4601, 0.064864, " it", false], [39934, 0.062625, " there", false], [308, 0.044103, " I", false], [32074, 0.040354, " some", false], [4706, 0.03066, " of", false], [32232, 0.029102, " they", false], [332, 0.028398, " a", false], [22226, 0.02774, " one", false]]], "qwen": [432, 4, 0.05506710335612297, [[279, 0.090421, " the", false], [1657, 0.079639, " many", false], [1045, 0.060173, " some", false], [432, 0.055067, " it", false], [358, 0.049406, " I", false], [807, 0.046728, " they", false], [304, 0.043768, " in", false], [1052, 0.042553, " there", false], [419, 0.037198, " this", false], [264, 0.030768, " a", false]]]}, "raw_delta": -0.05494260787963867, "tuned_delta": -0.04760546936593593}, {"byte_start": 1343, "byte_end": 1346, "display": {"text": " is", "kind": "normal"}, "is_word": true, "word_id": 224, "word_key": " is", "bytes_hex": "20 69 73", "compression": {"rwkv": "8.22% 8.22% 8.22%", "qwen": "8.51% 8.51% 8.51%"}, "model_tokens": {"rwkv": [[4600, " is", "normal", 0.25524985790252686]], "qwen": [[374, " is", "normal", 0.24256405234336853]]}, "loss": {"rwkv": 8.218477609230748, "qwen": 8.514843129358189}, "topk": {"rwkv": [4600, 1, 0.25524985790252686, [[4600, 0.25525, " is", false], [22748, 0.137, " was", false], [460, 0.133585, "'s", false], [32272, 0.078788, " took", false], [21800, 0.047001, " has", false], [40219, 0.021153, " would", false], [39620, 0.020439, " seems", false], [59393, 0.016272, " continues", false], [32475, 0.013923, " will", false], [39820, 0.013292, " still", false]]], "qwen": [374, 1, 0.24256405234336853, [[374, 0.242564, " is", false], [572, 0.19145, " was", false], [594, 0.078296, "'s", false], [3867, 0.069163, " took", false], [702, 0.052033, " has", false], [1035, 0.019592, " would", false], [4977, 0.01895, " seems", false], [646, 0.014081, " can", false], [6069, 0.012516, " led", false], [1231, 0.012319, " may", false]]]}, "raw_delta": -0.016433993975321415, "tuned_delta": -0.009096855461618678}, {"byte_start": 1346, "byte_end": 1355, "display": {"text": " instruct", "kind": "normal"}, "is_word": true, "word_id": 225, "word_key": " instruct", "bytes_hex": "20 69 6e 73 74 72 75 63 74", "compression": {"rwkv": "8.08% 8.08% 8.08% 8.08% 8.08% 8.08% 8.08% 8.08% 8.08%", "qwen": "7.18% 7.18% 7.18% 7.18% 7.18% 7.18% 7.18% 7.18% 7.18%"}, "model_tokens": {"rwkv": [[56469, " instruct", "normal", 0.01778090000152588]], "qwen": [[21066, " instruct", "normal", 0.027793802320957184]]}, "loss": {"rwkv": 8.077589421643935, "qwen": 7.179295850141927}, "topk": {"rwkv": [56469, 9, 0.01778090000152588, [[22187, 0.115775, " not", false], [332, 0.082044, " a", false], [39820, 0.065593, " still", false], [22226, 0.051031, " one", false], [40218, 0.042103, " worth", false], [31581, 0.0296, " only", false], [22590, 0.020627, " the", false], [31048, 0.019601, " hard", false], [56469, 0.017781, " instruct", false], [30724, 0.01616, " easy", false]]], "qwen": [21066, 6, 0.027793802320957184, [[537, 0.062966, " not", false], [264, 0.055177, " a", false], [5802, 0.052327, " worth", false], [2588, 0.032805, " hard", false], [2058, 0.031659, " still", false], [21066, 0.027794, " instruct", false], [279, 0.025145, " the", false], [2989, 0.024531, " important", false], [825, 0.022382, " one", false], [4135, 0.021515, " easy", false]]]}, "raw_delta": 0.04981197251213926, "tuned_delta": 0.057149111025842}, {"byte_start": 1355, "byte_end": 1358, "display": {"text": "ive", "kind": "normal"}, "is_word": true, "word_id": 226, "word_key": "ive", "bytes_hex": "69 76 65", "compression": {"rwkv": "0.01% 0.01% 0.01%", "qwen": "0.01% 0.01% 0.01%"}, "model_tokens": {"rwkv": [[7938, "ive", "normal", 0.9984034895896912]], "qwen": [[533, "ive", "normal", 0.9985384941101074]]}, "loss": {"rwkv": 0.009631028448317282, "qwen": 0.008791913226163243}, "topk": {"rwkv": [7938, 1, 0.9984034895896912, [[7938, 0.998403, "ive", false], [34918, 0.00098, "ively", false], [7856, 0.000432, "ing", false], [24381, 3.7e-05, "able", false], [4811, 2.5e-05, " to", false], [33948, 9e-06, "ative", false], [25656, 8e-06, "ible", false], [1958, 7e-06, "iv", false], [49338, 7e-06, "iveness", false], [2255, 4e-06, "ve", false]]], "qwen": [533, 1, 0.9985384941101074, [[533, 0.998538, "ive", false], [3132, 0.000996, "ively", false], [1262, 0.000238, "ful", false], [287, 9.4e-05, "ing", false], [1388, 4.7e-05, "ative", false], [1238, 1.1e-05, "ible", false], [480, 7e-06, "able", false], [311, 6e-06, " to", false], [344, 6e-06, "iv", false], [82, 4e-06, "s", false]]]}, "raw_delta": 4.653042803208035e-05, "tuned_delta": 0.007383668941734817}, {"byte_start": 1358, "byte_end": 1361, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 227, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "0.95% 0.95% 0.95%", "qwen": "0.73% 0.73% 0.73%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.8543063402175903]], "qwen": [[311, " to", "normal", 0.8852441310882568]]}, "loss": {"rwkv": 0.945124925061536, "qwen": 0.7327195883865194}, "topk": {"rwkv": [4811, 1, 0.8543063402175903, [[4811, 0.854306, " to", false], [32227, 0.059943, " that", false], [21700, 0.015725, " for", false], [47, 0.014993, ".", false], [4596, 0.010182, " in", false], [21265, 0.006619, " and", false], [21835, 0.004622, " how", false], [45, 0.004382, ",", false], [31077, 0.003279, " here", false], [4423, 0.002962, " as", false]]], "qwen": [311, 1, 0.8852441310882568, [[311, 0.885244, " to", false], [429, 0.027062, " that", false], [369, 0.016089, " for", false], [13, 0.015356, ".", false], [304, 0.00887, " in", false], [11, 0.006595, ",", false], [323, 0.003971, " and", false], [1588, 0.003628, " here", false], [537, 0.002653, " not", false], [315, 0.002501, " of", false]]]}, "raw_delta": 0.011778252820173897, "tuned_delta": 0.019115391333876634}, {"byte_start": 1361, "byte_end": 1368, "display": {"text": " review", "kind": "normal"}, "is_word": true, "word_id": 228, "word_key": " review", "bytes_hex": "20 72 65 76 69 65 77", "compression": {"rwkv": "6.40% 6.40% 6.40% 6.40% 6.40% 6.40% 6.40%", "qwen": "8.00% 8.00% 8.00% 8.00% 8.00% 8.00% 8.00%"}, "model_tokens": {"rwkv": [[47108, " review", "normal", 0.083371102809906]], "qwen": [[3395, " review", "normal", 0.04484003409743309]]}, "loss": {"rwkv": 6.400349093229498, "qwen": 7.998336949748838}, "topk": {"rwkv": [47108, 3, 0.083371102809906, [[31324, 0.228605, " look", false], [22449, 0.093835, " see", false], [47108, 0.083371, " review", false], [55832, 0.07908, " consider", false], [51667, 0.050267, " examine", false], [52751, 0.031012, " revisit", false], [31834, 0.022021, " read", false], [52672, 0.018677, " reflect", false], [39942, 0.017824, " think", false], [4559, 0.01681, " go", false]]], "qwen": [3395, 5, 0.04484003409743309, [[1401, 0.232227, " look", false], [1490, 0.08595, " see", false], [2908, 0.08425, " consider", false], [20961, 0.046059, " examine", false], [3395, 0.04484, " review", false], [1140, 0.028893, " list", false], [1896, 0.020682, " take", false], [11167, 0.019772, " highlight", false], [1349, 0.019264, " read", false], [38296, 0.016471, " cite", false]]]}, "raw_delta": -0.08861126218523296, "tuned_delta": -0.08127412367153022}, {"byte_start": 1368, "byte_end": 1373, "display": {"text": " some", "kind": "normal"}, "is_word": true, "word_id": 229, "word_key": " some", "bytes_hex": "20 73 6f 6d 65", "compression": {"rwkv": "3.78% 3.78% 3.78% 3.78% 3.78%", "qwen": "3.33% 3.33% 3.33% 3.33% 3.33%"}, "model_tokens": {"rwkv": [[32074, " some", "normal", 0.3506676256656647]], "qwen": [[1045, " some", "normal", 0.39698800444602966]]}, "loss": {"rwkv": 3.7758034273265837, "qwen": 3.33208173875113}, "topk": {"rwkv": [32074, 1, 0.3506676256656647, [[32074, 0.350668, " some", false], [32229, 0.223376, " them", false], [332, 0.171608, " a", false], [22590, 0.071761, " the", false], [39936, 0.029968, " these", false], [39944, 0.021978, " those", false], [52869, 0.01404, " several", false], [31198, 0.012341, " just", false], [32464, 0.010032, " what", false], [22226, 0.00944, " one", false]]], "qwen": [1045, 1, 0.39698800444602966, [[1045, 0.396988, " some", false], [1105, 0.183857, " them", false], [264, 0.129938, " a", false], [279, 0.071827, " the", false], [1846, 0.032438, " those", false], [1493, 0.028706, " these", false], [862, 0.018064, " their", false], [3807, 0.015456, " several", false], [1246, 0.013721, " how", false], [1128, 0.013609, " what", false]]]}, "raw_delta": 0.024605154991149902, "tuned_delta": 0.03194229350485264}, {"byte_start": 1373, "byte_end": 1376, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 230, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "1.10% 1.10% 1.10%", "qwen": "1.10% 1.10% 1.10%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.8311388492584229]], "qwen": [[315, " of", "normal", 0.8333882093429565]]}, "loss": {"rwkv": 1.09775379494725, "qwen": 1.0955809912170524}, "topk": {"rwkv": [4706, 1, 0.8311388492584229, [[4706, 0.831139, " of", false], [47, 0.067199, ".", false], [56162, 0.022314, " examples", false], [32227, 0.007299, " that", false], [45, 0.00459, ",", false], [59, 0.00444, ":", false], [47014, 0.003807, " recent", false], [30917, 0.003069, " from", false], [37970, 0.002848, " cases", false], [4596, 0.001827, " in", false]]], "qwen": [315, 1, 0.8333882093429565, [[315, 0.833388, " of", false], [13, 0.05021, ".", false], [429, 0.014256, " that", false], [10295, 0.013134, " examples", false], [624, 0.007572, ".\n", false], [11, 0.0059, ",", false], [5048, 0.005518, " cases", false], [304, 0.004061, " in", false], [3213, 0.003573, " recent", false], [1376, 0.002602, " key", false]]]}, "raw_delta": 0.00012048582235972549, "tuned_delta": 0.007457624336062462}, {"byte_start": 1376, "byte_end": 1380, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 231, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "7.92% 7.92% 7.92% 7.92%", "qwen": "8.53% 8.53% 8.53% 8.53%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.1723017543554306]], "qwen": [[279, " the", "normal", 0.15079525113105774]]}, "loss": {"rwkv": 7.924960551758221, "qwen": 8.5291780624562}, "topk": {"rwkv": [22590, 2, 0.1723017543554306, [[32229, 0.620776, " them", false], [22590, 0.172302, " the", false], [39936, 0.135149, " these", false], [39944, 0.052931, " those", false], [39931, 0.011279, " their", false], [32234, 0.001238, " this", false], [32464, 0.001019, " what", false], [32227, 0.000812, " that", false], [4677, 0.000543, " my", false], [22248, 0.000517, " our", false]]], "qwen": [279, 2, 0.15079525113105774, [[1105, 0.632266, " them", false], [279, 0.150795, " the", false], [1493, 0.111533, " these", false], [1846, 0.076856, " those", false], [862, 0.017848, " their", false], [1181, 0.004362, " its", false], [419, 0.001052, " this", false], [432, 0.000924, " it", false], [429, 0.000873, " that", false], [1128, 0.000716, " what", false]]]}, "raw_delta": -0.03350493311882019, "tuned_delta": -0.026167794605117454}, {"byte_start": 1380, "byte_end": 1385, "display": {"text": " most", "kind": "normal"}, "is_word": true, "word_id": 232, "word_key": " most", "bytes_hex": "20 6d 6f 73 74", "compression": {"rwkv": "5.49% 5.49% 5.49% 5.49% 5.49%", "qwen": "5.22% 5.22% 5.22% 5.22% 5.22%"}, "model_tokens": {"rwkv": [[31461, " most", "normal", 0.21500150859355927]], "qwen": [[1429, " most", "normal", 0.2352813184261322]]}, "loss": {"rwkv": 5.4946393158857, "qwen": 5.218853526398253}, "topk": {"rwkv": [31461, 1, 0.21500150859355927, [[31461, 0.215002, " most", false], [31458, 0.078078, " more", false], [56162, 0.056937, " examples", false], [32448, 0.035712, " ways", false], [37970, 0.02767, " cases", false], [30273, 0.023474, " best", false], [38328, 0.018856, " early", false], [21952, 0.018518, " key", false], [31580, 0.017798, " ones", false], [56200, 0.017, " failures", false]]], "qwen": [1429, 1, 0.2352813184261322, [[1429, 0.235281, " most", false], [803, 0.115337, " more", false], [1376, 0.040874, " key", false], [10295, 0.033427, " examples", false], [3598, 0.029234, " major", false], [1850, 0.02745, " best", false], [5510, 0.024026, " ways", false], [5048, 0.020669, " cases", false], [6174, 0.016742, " ones", false], [18366, 0.01493, " lessons", false]]]}, "raw_delta": 0.015292811393737782, "tuned_delta": 0.02262994990744052}, {"byte_start": 1385, "byte_end": 1395, "display": {"text": " prominent", "kind": "normal"}, "is_word": true, "word_id": 233, "word_key": " prominent", "bytes_hex": "20 70 72 6f 6d 69 6e 65 6e 74", "compression": {"rwkv": "3.97% 3.97% 3.97% 3.97% 3.97% 3.97% 3.97% 3.97% 3.97% 3.97%", "qwen": "3.58% 3.58% 3.58% 3.58% 3.58% 3.58% 3.58% 3.58% 3.58% 3.58%"}, "model_tokens": {"rwkv": [[60273, " prominent", "normal", 0.11204054206609726]], "qwen": [[20469, " prominent", "normal", 0.13768811523914337]]}, "loss": {"rwkv": 3.973046889948121, "qwen": 3.5756549627536587}, "topk": {"rwkv": [60273, 1, 0.11204054206609726, [[60273, 0.112041, " prominent", false], [52321, 0.090158, " notable", false], [45958, 0.089647, " famous", false], [59829, 0.075627, " important", false], [57323, 0.051954, " striking", false], [56056, 0.047452, " dramatic", false], [52796, 0.039792, " salient", false], [63870, 0.034335, " significant", false], [52346, 0.028489, " obvious", false], [47014, 0.026156, " recent", false]]], "qwen": [20469, 2, 0.13768811523914337, [[27190, 0.155824, " notable", false], [20469, 0.137688, " prominent", false], [2989, 0.103076, " important", false], [11245, 0.07209, " famous", false], [89068, 0.059458, " egregious", false], [21771, 0.050865, " dramatic", false], [5089, 0.043584, " significant", false], [4274, 0.026176, " sal", false], [7040, 0.020387, " interesting", false], [4185, 0.018432, " common", false]]]}, "raw_delta": 0.022036087512969954, "tuned_delta": 0.02937322602667269}, {"byte_start": 1395, "byte_end": 1397, "display": {"text": ".\n", "kind": "control"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e 0a", "compression": {"rwkv": "18.32% 27.90%", "qwen": "47.88% 47.88%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.3613024950027466], [261, "\n\n", "control", 0.04540111869573593]], "qwen": [[382, ".\n\n", "control", 0.0003474658587947488]]}, "loss": {"rwkv": 23.1056627642373, "qwen": 47.87850528129607}, "topk": {"rwkv": [47, 1, 0.3613024950027466, [[47, 0.361302, ".", false], [31580, 0.168972, " ones", false], [56162, 0.135224, " examples", false], [4706, 0.083775, " of", false], [37970, 0.050332, " cases", false], [21265, 0.031778, " and", false], [45, 0.024493, ",", false], [59, 0.021562, ":", false], [4596, 0.011399, " in", false], [56200, 0.008392, " failures", false]]], "qwen": [382, 68, 0.0003474658587947488, [[6174, 0.231678, " ones", false], [13, 0.230389, ".", false], [10295, 0.146838, " examples", false], [5048, 0.070555, " cases", false], [315, 0.062951, " of", false], [323, 0.03409, " and", false], [624, 0.033358, ".\n", false], [11, 0.029415, ",", false], [4221, 0.014615, " among", false], [27850, 0.010837, " failures", false]]]}, "raw_delta": -1.3736980756123862, "tuned_delta": -1.3663609370986836}, {"byte_start": 1397, "byte_end": 1398, "display": {"text": "\n", "kind": "control"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "0a", "compression": {"rwkv": "27.90%", "qwen": "47.88%"}, "model_tokens": {"rwkv": [[261, "\n\n", "control", 0.04540111869573593]], "qwen": [[382, ".\n\n", "control", 0.0003474658587947488]]}, "loss": {"rwkv": 27.895861142188938, "qwen": 47.87850528129607}, "topk": {"rwkv": [261, 4, 0.04540111869573593, [[267, 0.270423, "  ", false], [11, 0.158195, "\n", false], [20996, 0.091044, " The", false], [261, 0.045401, "\n\n", false], [3913, 0.036204, " In", false], [20556, 0.025023, " One", false], [308, 0.014227, " I", false], [265, 0.013609, " \n", false], [19907, 0.012375, " For", false], [37453, 0.010242, " These", false]]], "qwen": [382, 68, 0.0003474658587947488, [[6174, 0.231678, " ones", false], [13, 0.230389, ".", false], [10295, 0.146838, " examples", false], [5048, 0.070555, " cases", false], [315, 0.062951, " of", false], [323, 0.03409, " and", false], [624, 0.033358, ".\n", false], [11, 0.029415, ",", false], [4221, 0.014615, " among", false], [27850, 0.010837, " failures", false]]]}, "raw_delta": -1.1080730756123862, "tuned_delta": -1.1007359370986836}, {"byte_start": 1398, "byte_end": 1400, "display": {"text": "In", "kind": "normal"}, "is_word": true, "word_id": 234, "word_key": "in", "bytes_hex": "49 6e", "compression": {"rwkv": "31.28% 31.28%", "qwen": "28.37% 28.37%"}, "model_tokens": {"rwkv": [[1136, "In", "normal", 0.030992809683084488]], "qwen": [[641, "In", "normal", 0.043021783232688904]]}, "loss": {"rwkv": 31.277177644272445, "qwen": 28.367428971722216}, "topk": {"rwkv": [1136, 4, 0.030992809683084488, [[53648, 0.335636, "Question", false], [6699, 0.082598, "The", false], [66, 0.03101, "A", false], [1136, 0.030993, "In", false], [33161, 0.02246, "Human", false], [820, 0.018689, "AI", false], [6393, 0.017629, "One", false], [5585, 0.012256, "Ass", false], [50, 0.012169, "1", false], [36, 0.008044, "#", false]]], "qwen": [641, 2, 0.043021783232688904, [[785, 0.132259, "The", false], [641, 0.043022, "In", false], [16, 0.029539, "1", false], [33975, 0.027545, "Human", false], [32, 0.022505, "A", false], [3966, 0.01935, "One", false], [22029, 0.013633, "Figure", false], [5338, 0.012848, "First", false], [2132, 0.011323, "It", false], [17, 0.009716, "2", false]]]}, "raw_delta": 0.16135072708129883, "tuned_delta": 0.16868786559500157}, {"byte_start": 1400, "byte_end": 1409, "display": {"text": " computer", "kind": "normal"}, "is_word": true, "word_id": 235, "word_key": " computer", "bytes_hex": "20 63 6f 6d 70 75 74 65 72", "compression": {"rwkv": "11.21% 11.21% 11.21% 11.21% 11.21% 11.21% 11.21% 11.21% 11.21%", "qwen": "12.68% 12.68% 12.68% 12.68% 12.68% 12.68% 12.68% 12.68% 12.68%"}, "model_tokens": {"rwkv": [[55809, " computer", "normal", 0.0038407498504966497]], "qwen": [[6366, " computer", "normal", 0.001782963052392006]]}, "loss": {"rwkv": 11.20843803468422, "qwen": 12.682649431400927}, "topk": {"rwkv": [55809, 22, 0.0038407498504966497, [[22590, 0.40058, " the", false], [3492, 0.194823, " 19", false], [3493, 0.033186, " 20", false], [332, 0.030165, " a", false], [38328, 0.022916, " early", false], [21823, 0.014145, " his", false], [62293, 0.013164, " particular", false], [32234, 0.012904, " this", false], [31370, 0.012034, " many", false], [4677, 0.010389, " my", false]]], "qwen": [6366, 32, 0.001782963052392006, [[279, 0.399548, " the", false], [220, 0.326221, " ", false], [264, 0.019494, " a", false], [825, 0.011365, " one", false], [419, 0.009697, " this", false], [847, 0.008932, " my", false], [1657, 0.007462, " many", false], [1045, 0.006665, " some", false], [71278, 0.006415, " reinforcement", false], [806, 0.00632, " his", false]]]}, "raw_delta": -0.08174763785468209, "tuned_delta": -0.07441049934097935}, {"byte_start": 1409, "byte_end": 1415, "display": {"text": " chess", "kind": "normal"}, "is_word": true, "word_id": 236, "word_key": " chess", "bytes_hex": "20 63 68 65 73 73", "compression": {"rwkv": "10.90% 10.90% 10.90% 10.90% 10.90% 10.90%", "qwen": "7.39% 7.39% 7.39% 7.39% 7.39% 7.39%"}, "model_tokens": {"rwkv": [[38013, " chess", "normal", 0.02678052894771099]], "qwen": [[32719, " chess", "normal", 0.08553595095872879]]}, "loss": {"rwkv": 10.89535317338019, "qwen": 7.39026075747072}, "topk": {"rwkv": [38013, 4, 0.02678052894771099, [[47732, 0.7331, " vision", false], [52814, 0.119229, " science", false], [56329, 0.041168, " graphics", false], [38013, 0.026781, " chess", false], [38576, 0.020042, " games", false], [46, 0.01298, "-", false], [63795, 0.004451, " programming", false], [46075, 0.003657, " gaming", false], [57181, 0.003153, " security", false], [30941, 0.001821, " game", false]]], "qwen": [32719, 3, 0.08553595095872879, [[11129, 0.712659, " vision", false], [8038, 0.097844, " science", false], [32719, 0.085536, " chess", false], [3868, 0.012228, " games", false], [5994, 0.011351, " Go", false], [1809, 0.008439, " game", false], [14181, 0.006157, " graphics", false], [12, 0.005733, "-", false], [1506, 0.004232, "ized", false], [15473, 0.003795, " programming", false]]]}, "raw_delta": 0.19436359405517575, "tuned_delta": 0.2017007325688785}, {"byte_start": 1415, "byte_end": 1416, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "3.31%", "qwen": "5.84%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.8331737518310547]], "qwen": [[11, ",", "normal", 0.7231948971748352]]}, "loss": {"rwkv": 3.310872408290101, "qwen": 5.84429509357174}, "topk": {"rwkv": [45, 1, 0.8331737518310547, [[45, 0.833174, ",", false], [22590, 0.016775, " the", false], [21265, 0.014909, " and", false], [4596, 0.01273, " in", false], [39934, 0.012584, " there", false], [275, 0.010477, " (", false], [4858, 0.008383, " we", false], [59, 0.005784, ":", false], [3609, 0.005103, " AI", false], [4601, 0.00481, " it", false]]], "qwen": [11, 1, 0.7231948971748352, [[11, 0.723195, ",", false], [320, 0.040994, " (", false], [7468, 0.030147, " programs", false], [304, 0.029816, " in", false], [3412, 0.019746, " research", false], [323, 0.01594, " and", false], [279, 0.013935, " the", false], [1052, 0.012069, " there", false], [369, 0.007485, " for", false], [432, 0.005921, " it", false]]]}, "raw_delta": -0.14048278331756592, "tuned_delta": -0.13314564480386318}, {"byte_start": 1416, "byte_end": 1420, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 237, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "4.97% 4.97% 4.97% 4.97%", "qwen": "6.35% 6.35% 6.35% 6.35%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.3297352194786072]], "qwen": [[279, " the", "normal", 0.24443350732326508]]}, "loss": {"rwkv": 4.966308612435152, "qwen": 6.351518688749366}, "topk": {"rwkv": [22590, 1, 0.3297352194786072, [[22590, 0.329735, " the", false], [21700, 0.071832, " for", false], [332, 0.042511, " a", false], [4601, 0.038076, " it", false], [39934, 0.029431, " there", false], [22226, 0.023152, " one", false], [4596, 0.0171, " in", false], [38328, 0.011894, " early", false], [63843, 0.010243, " researchers", false], [4858, 0.009744, " we", false]]], "qwen": [279, 1, 0.24443350732326508, [[279, 0.244434, " the", false], [264, 0.051798, " a", false], [369, 0.051381, " for", false], [1052, 0.042275, " there", false], [432, 0.040178, " it", false], [11811, 0.018852, " researchers", false], [304, 0.017217, " in", false], [825, 0.016138, " one", false], [32719, 0.013971, " chess", false], [892, 0.011749, " which", false]]]}, "raw_delta": -0.07681235671043396, "tuned_delta": -0.06947521819673122}, {"byte_start": 1420, "byte_end": 1428, "display": {"text": " methods", "kind": "normal"}, "is_word": true, "word_id": 238, "word_key": " methods", "bytes_hex": "20 6d 65 74 68 6f 64 73", "compression": {"rwkv": "14.72% 14.72% 14.72% 14.72% 14.72% 14.72% 14.72% 14.72%", "qwen": "14.12% 14.12% 14.12% 14.12% 14.12% 14.12% 14.12% 14.12%"}, "model_tokens": {"rwkv": [[52224, " methods", "normal", 0.0014621098525822163]], "qwen": [[5413, " methods", "normal", 0.0019067905377596617]]}, "loss": {"rwkv": 14.722815602821939, "qwen": 14.116621903976391}, "topk": {"rwkv": [52224, 101, 0.0014621098525822163, [[38499, 0.15102, " first", false], [31461, 0.046441, " most", false], [38328, 0.023978, " early", false], [30273, 0.021852, " best", false], [31581, 0.019396, " only", false], [31356, 0.016604, " main", false], [38720, 0.015297, " human", false], [39802, 0.013773, " state", false], [52013, 0.013427, " initial", false], [56075, 0.009821, " earliest", false]]], "qwen": [5413, 86, 0.0019067905377596617, [[1156, 0.0676, " first", false], [1429, 0.042103, " most", false], [1850, 0.030411, " best", false], [4124, 0.021152, " early", false], [3738, 0.020591, " human", false], [220, 0.016693, " ", false], [17755, 0.015041, " lesson", false], [3491, 0.01422, " problem", false], [5486, 0.012232, " approach", false], [2856, 0.01215, " initial", false]]]}, "raw_delta": 0.033614516258239746, "tuned_delta": 0.040951654771942486}, {"byte_start": 1428, "byte_end": 1433, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 239, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"rwkv": "3.78% 3.78% 3.78% 3.78% 3.78%", "qwen": "4.31% 4.31% 4.31% 4.31% 4.31%"}, "model_tokens": {"rwkv": [[32227, " that", "normal", 0.35258957743644714]], "qwen": [[429, " that", "normal", 0.3024786710739136]]}, "loss": {"rwkv": 3.7758034273265837, "qwen": 4.3127367029732895}, "topk": {"rwkv": [32227, 1, 0.35258957743644714, [[32227, 0.35259, " that", false], [4706, 0.223543, " of", false], [32354, 0.035704, " used", false], [59506, 0.034674, " developed", false], [37810, 0.032013, " based", false], [21700, 0.031595, " for", false], [31461, 0.02932, " most", false], [32462, 0.017588, " were", false], [59206, 0.009571, " available", false], [59868, 0.009306, " initially", false]]], "qwen": [429, 1, 0.3024786710739136, [[429, 0.302479, " that", false], [315, 0.16364, " of", false], [369, 0.053253, " for", false], [1483, 0.048816, " used", false], [7881, 0.047778, " developed", false], [1033, 0.037098, " were", false], [525, 0.017987, " are", false], [3118, 0.016369, " based", false], [614, 0.01535, " have", false], [1429, 0.014283, " most", false]]]}, "raw_delta": -0.02977390289306639, "tuned_delta": -0.022436764379363653}, {"byte_start": 1433, "byte_end": 1442, "display": {"text": " defeated", "kind": "normal"}, "is_word": true, "word_id": 240, "word_key": " defeated", "bytes_hex": "20 64 65 66 65 61 74 65 64", "compression": {"rwkv": "13.46% 13.46% 13.46% 13.46% 13.46% 13.46% 13.46% 13.46% 13.46%", "qwen": "15.80% 15.80% 15.80% 15.80% 15.80% 15.80% 15.80% 15.80% 15.80%"}, "model_tokens": {"rwkv": [[55934, " defeated", "normal", 0.001210186630487442]], "qwen": [[23283, " defeated", "normal", 0.00037607268313877285]]}, "loss": {"rwkv": 13.462649036073225, "qwen": 15.800972930162544}, "topk": {"rwkv": [55934, 86, 0.001210186630487442, [[56540, 0.105166, " leverage", false], [32462, 0.093876, " were", false], [31059, 0.062672, " have", false], [22777, 0.044717, " won", false], [31351, 0.03763, " made", false], [21286, 0.033535, " are", false], [47812, 0.02916, " worked", false], [21795, 0.021707, " had", false], [46936, 0.019499, " proved", false], [32272, 0.016634, " took", false]]], "qwen": [23283, 231, 0.00037607268313877285, [[1033, 0.102351, " were", false], [614, 0.076363, " have", false], [32064, 0.056497, " leverage", false], [525, 0.055837, " are", false], [27505, 0.033256, " lever", false], [6439, 0.030144, " worked", false], [29701, 0.024997, " dominated", false], [975, 0.01789, " work", false], [1865, 0.016655, " made", false], [18651, 0.013735, " proved", false]]]}, "raw_delta": -0.12966420915391708, "tuned_delta": -0.12232707064021434}, {"byte_start": 1442, "byte_end": 1446, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 241, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "3.66% 3.66% 3.66% 3.66%", "qwen": "5.75% 5.75% 5.75% 5.75%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.4459788501262665]], "qwen": [[279, " the", "normal", 0.27914050221443176]]}, "loss": {"rwkv": 3.6630928772571334, "qwen": 5.7529271605177374}, "topk": {"rwkv": [22590, 1, 0.4459788501262665, [[22590, 0.445979, " the", false], [38720, 0.107684, " human", false], [38013, 0.058026, " chess", false], [20184, 0.055435, " Kas", false], [46227, 0.043093, " humans", false], [40213, 0.043047, " world", false], [19948, 0.030642, " Gar", false], [38621, 0.029322, " grand", false], [332, 0.013454, " a", false], [28951, 0.011026, " Gary", false]]], "qwen": [279, 1, 0.27914050221443176, [[279, 0.279141, " the", false], [1879, 0.105652, " world", false], [3738, 0.097588, " human", false], [12677, 0.088407, " humans", false], [6662, 0.064503, " grand", false], [1909, 0.062897, " top", false], [32719, 0.05791, " chess", false], [3746, 0.012339, " strong", false], [678, 0.010331, " all", false], [37542, 0.009515, " Kas", false]]]}, "raw_delta": -0.11588501930236816, "tuned_delta": -0.10854788078866542}, {"byte_start": 1446, "byte_end": 1452, "display": {"text": " world", "kind": "normal"}, "is_word": true, "word_id": 242, "word_key": " world", "bytes_hex": "20 77 6f 72 6c 64", "compression": {"rwkv": "2.42% 2.42% 2.42% 2.42% 2.42% 2.42%", "qwen": "4.30% 4.30% 4.30% 4.30% 4.30% 4.30%"}, "model_tokens": {"rwkv": [[40213, " world", "normal", 0.44720733165740967]], "qwen": [[1879, " world", "normal", 0.2394600361585617]]}, "loss": {"rwkv": 2.4185805535736202, "qwen": 4.29613163471361}, "topk": {"rwkv": [40213, 1, 0.44720733165740967, [[40213, 0.447207, " world", false], [30273, 0.145508, " best", false], [38720, 0.083815, " human", false], [60571, 0.055241, " strongest", false], [22615, 0.039457, " top", false], [38621, 0.036869, " grand", false], [39471, 0.016173, " reign", false], [52196, 0.00868, " masters", false], [37576, 0.008287, " World", false], [31461, 0.007305, " most", false]]], "qwen": [1879, 2, 0.2394600361585617, [[1850, 0.356442, " best", false], [1879, 0.23946, " world", false], [29905, 0.048002, " strongest", false], [6662, 0.046616, " grand", false], [3738, 0.045049, " human", false], [1909, 0.040378, " top", false], [89956, 0.026188, " reigning", false], [32719, 0.013202, " chess", false], [1602, 0.012916, " very", false], [12677, 0.011226, " humans", false]]]}, "raw_delta": -0.10411353905995684, "tuned_delta": -0.0967764005462541}, {"byte_start": 1452, "byte_end": 1461, "display": {"text": " champion", "kind": "normal"}, "is_word": true, "word_id": 243, "word_key": " champion", "bytes_hex": "20 63 68 61 6d 70 69 6f 6e", "compression": {"rwkv": "1.17% 1.17% 1.17% 1.17% 1.17% 1.17% 1.17% 1.17% 1.17%", "qwen": "3.55% 3.55% 3.55% 3.55% 3.55% 3.55% 3.55% 3.55% 3.55%"}, "model_tokens": {"rwkv": [[55716, " champion", "normal", 0.5576945543289185]], "qwen": [[18319, " champion", "normal", 0.17004424333572388]]}, "loss": {"rwkv": 1.1740682298901068, "qwen": 3.550024794365723}, "topk": {"rwkv": [55716, 1, 0.5576945543289185, [[55716, 0.557695, " champion", false], [59283, 0.2461, " champions", false], [460, 0.073844, "'s", false], [38013, 0.045878, " chess", false], [46, 0.01518, "-", false], [37996, 0.012199, " champ", false], [38621, 0.0098, " grand", false], [64275, 0.009065, " championship", false], [52196, 0.007237, " masters", false], [46526, 0.002918, " master", false]]], "qwen": [18319, 2, 0.17004424333572388, [[33738, 0.404083, " champions", false], [18319, 0.170044, " champion", false], [594, 0.129451, "'s", false], [32719, 0.105916, " chess", false], [14800, 0.066794, "-class", false], [536, 0.024879, " class", false], [11582, 0.016839, "-ch", false], [21553, 0.013702, " championship", false], [1909, 0.005558, " top", false], [6662, 0.005017, " grand", false]]]}, "raw_delta": -0.1317510075039334, "tuned_delta": -0.12441386899023066}, {"byte_start": 1461, "byte_end": 1462, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "45.65%", "qwen": "45.26%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.08059445768594742]], "qwen": [[11, ",", "normal", 0.08129944652318954]]}, "loss": {"rwkv": 45.647772778127354, "qwen": 45.25763013464507}, "topk": {"rwkv": [45, 3, 0.08059445768594742, [[32462, 0.211825, " were", false], [4596, 0.198268, " in", false], [45, 0.080594, ",", false], [275, 0.037478, " (", false], [21286, 0.027403, " are", false], [36381, 0.021289, " Bobby", false], [28951, 0.021216, " Gary", false], [52628, 0.019219, " quickly", false], [21265, 0.016568, " and", false], [4450, 0.015073, " by", false]]], "qwen": [11, 3, 0.08129944652318954, [[1033, 0.322275, " were", false], [304, 0.116513, " in", false], [11, 0.081299, ",", false], [525, 0.051066, " are", false], [320, 0.028895, " (", false], [37542, 0.015117, " Kas", false], [323, 0.013393, " and", false], [518, 0.013335, " at", false], [479, 0.011227, " G", false], [553, 0.00992, " by", false]]]}, "raw_delta": 0.02163410186767578, "tuned_delta": 0.028971240381378518}, {"byte_start": 1462, "byte_end": 1466, "display": {"text": " Kas", "kind": "normal"}, "is_word": true, "word_id": 244, "word_key": " kas", "bytes_hex": "20 4b 61 73", "compression": {"rwkv": "9.79% 9.79% 9.79% 9.79%", "qwen": "14.67% 14.67% 14.67% 14.67%"}, "model_tokens": {"rwkv": [[20184, " Kas", "normal", 0.11462292075157166]], "qwen": [[37542, " Kas", "normal", 0.03861033543944359]]}, "loss": {"rwkv": 9.79172903728349, "qwen": 14.671465882840577}, "topk": {"rwkv": [20184, 1, 0.11462292075157166, [[20184, 0.114623, " Kas", false], [28753, 0.082309, " Deep", false], [21265, 0.078031, " and", false], [37404, 0.060041, " Stock", false], [19948, 0.04952, " Gar", false], [22590, 0.048999, " the", false], [32139, 0.040686, " such", false], [28951, 0.036372, " Gary", false], [50239, 0.023732, " Fischer", false], [4596, 0.015922, " in", false]]], "qwen": [37542, 3, 0.03861033543944359, [[18183, 0.49022, " Deep", false], [479, 0.073292, " G", false], [37542, 0.03861, " Kas", false], [27922, 0.027501, " IBM", false], [24708, 0.025863, " Alpha", false], [279, 0.020899, " the", false], [323, 0.018803, " and", false], [2670, 0.017984, " including", false], [1075, 0.016334, " like", false], [23826, 0.010039, " Gary", false]]]}, "raw_delta": -0.27059006690979004, "tuned_delta": -0.2632529283960873}, {"byte_start": 1466, "byte_end": 1469, "display": {"text": "par", "kind": "normal"}, "is_word": true, "word_id": 245, "word_key": "par", "bytes_hex": "70 61 72", "compression": {"rwkv": "0.09% 0.09% 0.09%", "qwen": "0.00% 0.00% 0.00%"}, "model_tokens": {"rwkv": [[8469, "par", "normal", 0.985406756401062]], "qwen": [[1732, "par", "normal", 0.9997996687889099]]}, "loss": {"rwkv": 0.08805511724175802, "qwen": 0.0012044744350566269}, "topk": {"rwkv": [8469, 1, 0.985406756401062, [[8469, 0.985407, "par", false], [113, 0.003105, "p", false], [8484, 0.001874, "per", false], [2184, 0.000893, "si", false], [46, 0.000576, "-", false], [2111, 0.000575, "pa", false], [2190, 0.000481, "so", false], [2124, 0.000424, "po", false], [8517, 0.000362, "por", false], [25823, 0.00036, "imir", false]]], "qwen": [1732, 1, 0.9997996687889099, [[1732, 0.9998, "par", false], [318, 5.5e-05, "im", false], [712, 2.2e-05, "per", false], [4270, 2.1e-05, " Par", false], [4272, 1.8e-05, "Par", false], [1346, 1e-05, " par", false], [12, 6e-06, "-", false], [2396, 4e-06, "ram", false], [370, 4e-06, "ab", false], [3380, 3e-06, "pare", false]]]}, "raw_delta": 0.004816022255302717, "tuned_delta": 0.012153160769005453}, {"byte_start": 1469, "byte_end": 1471, "display": {"text": "ov", "kind": "normal"}, "is_word": true, "word_id": 246, "word_key": "ov", "bytes_hex": "6f 76", "compression": {"rwkv": "0.01% 0.01%", "qwen": "0.02% 0.02%"}, "model_tokens": {"rwkv": [[2105, "ov", "normal", 0.9990443587303162]], "qwen": [[859, "ov", "normal", 0.99774569272995]]}, "loss": {"rwkv": 0.00859913254314043, "qwen": 0.020349439880208684}, "topk": {"rwkv": [2105, 1, 0.9990443587303162, [[2105, 0.999044, "ov", false], [2106, 0.000673, "ow", false], [8311, 7.2e-05, "off", false], [28017, 5.9e-05, "ов", false], [8443, 4.4e-05, "ova", false], [112, 2.3e-05, "o", false], [45, 1.3e-05, ",", false], [7745, 8e-06, "ian", false], [119, 7e-06, "v", false], [8444, 6e-06, "ove", false]]], "qwen": [859, 1, 0.99774569272995, [[859, 0.997746, "ov", false], [994, 0.001156, "ove", false], [363, 0.000447, "ow", false], [45088, 0.000114, "ovi", false], [1103, 7e-05, "ian", false], [1055, 5.9e-05, "of", false], [12660, 4.8e-05, "ova", false], [50114, 3.2e-05, "ovich", false], [30835, 2.2e-05, "iov", false], [2308, 1.8e-05, " No", false]]]}, "raw_delta": -0.0006515753921121359, "tuned_delta": 0.006685563121590601}, {"byte_start": 1471, "byte_end": 1472, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "1.92%", "qwen": "2.13%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.8989022374153137]], "qwen": [[11, ",", "normal", 0.8888115882873535]]}, "loss": {"rwkv": 1.9196015558703245, "qwen": 2.125631262784684}, "topk": {"rwkv": [45, 1, 0.8989022374153137, [[45, 0.898902, ",", false], [4596, 0.040417, " in", false], [275, 0.039308, " (", false], [21265, 0.007526, " and", false], [460, 0.001377, "'s", false], [4424, 0.001179, " at", false], [32462, 0.000656, " were", false], [326, 0.00058, " [", false], [4450, 0.000424, " by", false], [9816, 0.000418, "—", false]]], "qwen": [11, 1, 0.8888115882873535, [[11, 0.888812, ",", false], [304, 0.052188, " in", false], [320, 0.023062, " (", false], [323, 0.009136, " and", false], [594, 0.004451, "'s", false], [1154, 0.002869, " ,", false], [508, 0.002651, " [", false], [518, 0.001571, " at", false], [220, 0.001497, " ", false], [1033, 0.000954, " were", false]]]}, "raw_delta": -0.011424712836742401, "tuned_delta": -0.0040875743230396645}, {"byte_start": 1472, "byte_end": 1475, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 247, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "7.28% 7.28% 7.28%", "qwen": "8.98% 8.98% 8.98%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.29931896924972534]], "qwen": [[304, " in", "normal", 0.22436822950839996]]}, "loss": {"rwkv": 7.279223025318662, "qwen": 8.983582560879153}, "topk": {"rwkv": [4596, 2, 0.29931896924972534, [[32462, 0.325402, " were", false], [4596, 0.299319, " in", false], [21265, 0.04416, " and", false], [21286, 0.028597, " are", false], [32354, 0.013853, " used", false], [47054, 0.013424, " relied", false], [4450, 0.013053, " by", false], [4424, 0.009876, " at", false], [21532, 0.008928, " did", false], [21795, 0.008128, " had", false]]], "qwen": [304, 2, 0.22436822950839996, [[1033, 0.40179, " were", false], [304, 0.224368, " in", false], [39913, 0.022348, " relied", false], [1030, 0.02026, " had", false], [323, 0.019035, " and", false], [1483, 0.018675, " used", false], [525, 0.01754, " are", false], [6398, 0.015118, " involved", false], [1521, 0.012167, " did", false], [518, 0.011098, " at", false]]]}, "raw_delta": -0.094509760538737, "tuned_delta": -0.08717262202503426}, {"byte_start": 1475, "byte_end": 1478, "display": {"text": " 19", "kind": "normal"}, "is_word": true, "word_id": 248, "word_key": " 19", "bytes_hex": "20 31 39", "compression": {"rwkv": "5.47% 5.47% 5.47%", "qwen": "11.89% 1.11% 0.01%"}, "model_tokens": {"rwkv": [[3492, " 19", "normal", 0.40221062302589417]], "qwen": [[220, " ", "normal", 0.5171647071838379], [16, "1", "normal", 0.9404540061950684], [24, "9", "normal", 0.999442994594574]]}, "loss": {"rwkv": 5.471157951287898, "qwen": 4.336161768515685}, "topk": {"rwkv": [3492, 1, 0.40221062302589417, [[3492, 0.402211, " 19", false], [22590, 0.29502, " the", false], [3493, 0.161605, " 20", false], [332, 0.046352, " a", false], [31277, 0.005773, " less", false], [21823, 0.005666, " his", false], [31198, 0.005471, " just", false], [22638, 0.002772, " two", false], [38013, 0.00275, " chess", false], [37598, 0.002701, " about", false]]], "qwen": [220, 1, 0.5171647071838379, [[220, 0.517165, " ", false], [279, 0.350851, " the", false], [264, 0.03867, " a", false], [806, 0.00853, " his", false], [32719, 0.006975, " chess", false], [1378, 0.003782, " two", false], [862, 0.003536, " their", false], [458, 0.002794, " an", false], [2326, 0.002367, " three", false], [39061, 0.002184, " tournaments", false]]]}, "raw_delta": 0.0629375523227888, "tuned_delta": 0.07027469083649154}, {"byte_start": 1478, "byte_end": 1480, "display": {"text": "97", "kind": "normal"}, "is_word": true, "word_id": 249, "word_key": "97", "bytes_hex": "39 37", "compression": {"rwkv": "2.48% 2.48%", "qwen": "0.83% 2.49%"}, "model_tokens": {"rwkv": [[717, "97", "normal", 0.7598889470100403]], "qwen": [[24, "9", "normal", 0.9547744393348694], [22, "7", "normal", 0.8708397746086121]]}, "loss": {"rwkv": 2.483154306217576, "qwen": 1.6643060414114925}, "topk": {"rwkv": [717, 1, 0.7598889470100403, [[717, 0.759889, "97", false], [716, 0.172356, "96", false], [719, 0.03698, "99", false], [718, 0.007953, "98", false], [710, 0.006689, "90", false], [715, 0.004646, "95", false], [709, 0.002977, "89", false], [713, 0.002428, "93", false], [714, 0.001502, "94", false], [705, 0.001084, "85", false]]], "qwen": [24, 1, 0.9547744393348694, [[24, 0.954774, "9", false], [23, 0.043984, "8", false], [22, 0.001088, "7", false], [21, 7.7e-05, "6", false], [20, 1.7e-05, "5", false], [339, 1.6e-05, "th", false], [19, 7e-06, "4", false], [220, 4e-06, " ", false], [15, 4e-06, "0", false], [18, 4e-06, "3", false]]]}, "raw_delta": 0.04540658928453922, "tuned_delta": 0.05274372779824196}, {"byte_start": 1480, "byte_end": 1481, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "36.35%", "qwen": "42.10%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.13172271847724915]], "qwen": [[11, ",", "normal", 0.09688328206539154]]}, "loss": {"rwkv": 36.34915239739771, "qwen": 42.095105661422956}, "topk": {"rwkv": [45, 3, 0.13172271847724915, [[32462, 0.372542, " were", false], [21265, 0.212345, " and", false], [45, 0.131723, ",", false], [275, 0.04925, " (", false], [32354, 0.02472, " used", false], [21286, 0.017753, " are", false], [21795, 0.013238, " had", false], [56500, 0.009378, " involved", false], [21532, 0.008898, " did", false], [47054, 0.007967, " relied", false]]], "qwen": [11, 3, 0.09688328206539154, [[1033, 0.439887, " were", false], [323, 0.13122, " and", false], [11, 0.096883, ",", false], [320, 0.035252, " (", false], [12, 0.027816, "-", false], [6398, 0.019639, " involved", false], [5230, 0.019083, " included", false], [525, 0.017318, " are", false], [1030, 0.014978, " had", false], [1521, 0.012527, " did", false]]]}, "raw_delta": -0.31862330436706543, "tuned_delta": -0.3112861658533627}, {"byte_start": 1481, "byte_end": 1486, "display": {"text": " were", "kind": "normal"}, "is_word": true, "word_id": 250, "word_key": " were", "bytes_hex": "20 77 65 72 65", "compression": {"rwkv": "5.80% 5.80% 5.80% 5.80% 5.80%", "qwen": "2.68% 2.68% 2.68% 2.68% 2.68%"}, "model_tokens": {"rwkv": [[32462, " were", "normal", 0.19863517582416534]], "qwen": [[1033, " were", "normal", 0.47591105103492737]]}, "loss": {"rwkv": 5.804593328576688, "qwen": 2.678090406599476}, "topk": {"rwkv": [32462, 2, 0.19863517582416534, [[3493, 0.210868, " 20", false], [32462, 0.198635, " were", false], [21265, 0.13443, " and", false], [3492, 0.130007, " 19", false], [32354, 0.019197, " used", false], [21286, 0.016826, " are", false], [22590, 0.015092, " the", false], [21795, 0.009884, " had", false], [47054, 0.009432, " relied", false], [4596, 0.0091, " in", false]]], "qwen": [1033, 1, 0.47591105103492737, [[1033, 0.475911, " were", false], [220, 0.043079, " ", false], [39913, 0.037907, " relied", false], [323, 0.032855, " and", false], [1521, 0.031137, " did", false], [1483, 0.029892, " used", false], [5230, 0.016554, " included", false], [1030, 0.015625, " had", false], [6398, 0.014981, " involved", false], [525, 0.013672, " are", false]]]}, "raw_delta": 0.17337013483047486, "tuned_delta": 0.1807072733441776}, {"byte_start": 1486, "byte_end": 1492, "display": {"text": " based", "kind": "normal"}, "is_word": true, "word_id": 251, "word_key": " based", "bytes_hex": "20 62 61 73 65 64", "compression": {"rwkv": "6.95% 6.95% 6.95% 6.95% 6.95% 6.95%", "qwen": "6.65% 6.65% 6.65% 6.65% 6.65% 6.65%"}, "model_tokens": {"rwkv": [[37810, " based", "normal", 0.09908859431743622]], "qwen": [[3118, " based", "normal", 0.109536312520504]]}, "loss": {"rwkv": 6.9504839209494325, "qwen": 6.646914477533975}, "topk": {"rwkv": [37810, 1, 0.09908859431743622, [[37810, 0.099089, " based", false], [22187, 0.073979, " not", false], [22590, 0.05035, " the", false], [52094, 0.043374, " largely", false], [332, 0.039552, " a", false], [63541, 0.032907, " essentially", false], [52224, 0.030115, " methods", false], [39944, 0.025436, " those", false], [21256, 0.021113, " all", false], [32386, 0.012959, " very", false]]], "qwen": [3118, 1, 0.109536312520504, [[3118, 0.109536, " based", false], [537, 0.085856, " not", false], [279, 0.033277, " the", false], [678, 0.031775, " all", false], [264, 0.024103, " a", false], [1602, 0.01956, " very", false], [4586, 0.017779, " general", false], [13771, 0.016204, " largely", false], [1846, 0.0123, " those", false], [11368, 0.011981, " entirely", false]]]}, "raw_delta": 0.01683346430460614, "tuned_delta": 0.024170602818308875}, {"byte_start": 1492, "byte_end": 1495, "display": {"text": " on", "kind": "normal"}, "is_word": true, "word_id": 252, "word_key": " on", "bytes_hex": "20 6f 6e", "compression": {"rwkv": "1.15% 1.15% 1.15%", "qwen": "0.91% 0.91% 0.91%"}, "model_tokens": {"rwkv": [[4712, " on", "normal", 0.8257889747619629]], "qwen": [[389, " on", "normal", 0.860114574432373]]}, "loss": {"rwkv": 1.1505868652923046, "qwen": 0.9058302035883852}, "topk": {"rwkv": [4712, 1, 0.8257889747619629, [[4712, 0.825789, " on", false], [56131, 0.020041, " entirely", false], [45145, 0.01592, " almost", false], [60247, 0.01544, " primarily", false], [4596, 0.015189, " in", false], [52094, 0.013975, " largely", false], [32350, 0.011241, " upon", false], [22187, 0.009883, " not", false], [51919, 0.007783, " heavily", false], [47330, 0.006069, " solely", false]]], "qwen": [389, 1, 0.860114574432373, [[389, 0.860115, " on", false], [304, 0.015985, " in", false], [4558, 0.01554, " almost", false], [11368, 0.014561, " entirely", false], [13771, 0.012379, " largely", false], [537, 0.011577, " not", false], [5193, 0.008528, " upon", false], [15503, 0.00716, " primarily", false], [2163, 0.005406, " around", false], [16916, 0.004664, " heavily", false]]]}, "raw_delta": 0.013572191198666886, "tuned_delta": 0.020909329712369622}, {"byte_start": 1495, "byte_end": 1503, "display": {"text": " massive", "kind": "normal"}, "is_word": true, "word_id": 253, "word_key": " massive", "bytes_hex": "20 6d 61 73 73 69 76 65", "compression": {"rwkv": "10.78% 10.78% 10.78% 10.78% 10.78% 10.78% 10.78% 10.78%", "qwen": "14.62% 14.62% 14.62% 14.62% 14.62% 14.62% 14.62% 14.62%"}, "model_tokens": {"rwkv": [[52195, " massive", "normal", 0.008450211025774479]], "qwen": [[10951, " massive", "normal", 0.0015222453512251377]]}, "loss": {"rwkv": 10.777946350391181, "qwen": 14.624349085853574}, "topk": {"rwkv": [52195, 16, 0.008450211025774479, [[332, 0.126157, " a", false], [22590, 0.109157, " the", false], [51832, 0.049681, " general", false], [52224, 0.028682, " methods", false], [30597, 0.02115, " deep", false], [52167, 0.019129, " machine", false], [46658, 0.01896, " neural", false], [56537, 0.017406, " learning", false], [4419, 0.012217, " an", false], [47284, 0.010632, " simple", false]]], "qwen": [10951, 84, 0.0015222453512251377, [[264, 0.132264, " a", false], [279, 0.095771, " the", false], [4586, 0.042222, " general", false], [5538, 0.023053, " deep", false], [6832, 0.022309, " learning", false], [64098, 0.022067, " brute", false], [3738, 0.02184, " human", false], [458, 0.01992, " an", false], [2711, 0.019204, " search", false], [5662, 0.018349, " machine", false]]]}, "raw_delta": -0.21328985691070557, "tuned_delta": -0.20595271839700283}, {"byte_start": 1503, "byte_end": 1504, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "80.02%", "qwen": "80.63%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.011884907260537148]], "qwen": [[11, ",", "normal", 0.011436567641794682]]}, "loss": {"rwkv": 80.02449054930968, "qwen": 80.62753051629504}, "topk": {"rwkv": [45, 15, 0.011884907260537148, [[63370, 0.142193, " computation", false], [50897, 0.126351, " amounts", false], [64423, 0.110214, " improvements", false], [22681, 0.042738, " use", false], [56812, 0.030253, " parallel", false], [38720, 0.019748, " human", false], [64862, 0.018973, " computational", false], [63621, 0.017687, " improvement", false], [59847, 0.016177, " increases", false], [59346, 0.015876, " computing", false]]], "qwen": [11, 13, 0.011436567641794682, [[14713, 0.15872, " amounts", false], [34447, 0.131126, " computation", false], [2711, 0.066927, " search", false], [82599, 0.051758, " computations", false], [54480, 0.044446, " computational", false], [31806, 0.039818, " databases", false], [821, 0.031169, " data", false], [990, 0.029515, " use", false], [24231, 0.02003, " computing", false], [64098, 0.015096, " brute", false]]]}, "raw_delta": -0.03343963623046875, "tuned_delta": -0.026102497716766013}, {"byte_start": 1504, "byte_end": 1509, "display": {"text": " deep", "kind": "normal"}, "is_word": true, "word_id": 254, "word_key": " deep", "bytes_hex": "20 64 65 65 70", "compression": {"rwkv": "15.78% 15.78% 15.78% 15.78% 15.78%", "qwen": "14.99% 14.99% 14.99% 14.99% 14.99%"}, "model_tokens": {"rwkv": [[30597, " deep", "normal", 0.012478463351726532]], "qwen": [[5538, " deep", "normal", 0.01565556600689888]]}, "loss": {"rwkv": 15.779477009723035, "qwen": 14.99295219218517}, "topk": {"rwkv": [30597, 14, 0.012478463351726532, [[38720, 0.069331, " human", false], [51832, 0.052989, " general", false], [31044, 0.043828, " hand", false], [59988, 0.042053, " massively", false], [59262, 0.031456, " carefully", false], [21400, 0.024367, " but", false], [22323, 0.018564, " pre", false], [39802, 0.018469, " state", false], [56812, 0.016704, " parallel", false], [52195, 0.014567, " massive", false]]], "qwen": [5538, 10, 0.01565556600689888, [[855, 0.049514, " pre", false], [4586, 0.047162, " general", false], [64098, 0.044898, " brute", false], [63707, 0.034973, " massively", false], [15279, 0.026881, " parallel", false], [10951, 0.023684, " massive", false], [1424, 0.020637, " hand", false], [1550, 0.019098, " high", false], [3738, 0.017058, " human", false], [5538, 0.015656, " deep", false]]]}, "raw_delta": 0.043614196777343794, "tuned_delta": 0.050951335291046534}, {"byte_start": 1509, "byte_end": 1516, "display": {"text": " search", "kind": "normal"}, "is_word": true, "word_id": 255, "word_key": " search", "bytes_hex": "20 73 65 61 72 63 68", "compression": {"rwkv": "10.18% 10.18% 10.18% 10.18% 10.18% 10.18% 10.18%", "qwen": "5.54% 5.54% 5.54% 5.54% 5.54% 5.54% 5.54%"}, "model_tokens": {"rwkv": [[47202, " search", "normal", 0.018990609794855118]], "qwen": [[2711, " search", "normal", 0.11630882322788239]]}, "loss": {"rwkv": 10.18420327413247, "qwen": 5.542799371917312}, "topk": {"rwkv": [47202, 5, 0.018990609794855118, [[56537, 0.26494, " learning", false], [45, 0.174228, ",", false], [46658, 0.15646, " neural", false], [46, 0.038754, "-", false], [47202, 0.018991, " search", false], [56705, 0.017187, " networks", false], [63384, 0.013295, " connections", false], [32298, 0.012241, " tree", false], [63370, 0.009841, " computation", false], [51832, 0.009801, " general", false]]], "qwen": [2711, 4, 0.11630882322788239, [[29728, 0.228634, " neural", false], [6832, 0.141765, " learning", false], [11, 0.125937, ",", false], [2711, 0.116309, " search", false], [14155, 0.035094, " networks", false], [26475, 0.026614, " searches", false], [6540, 0.022596, " knowledge", false], [6358, 0.015513, " analysis", false], [34447, 0.014, " computation", false], [82599, 0.011676, " computations", false]]]}, "raw_delta": 0.25737408229282926, "tuned_delta": 0.264711220806532}, {"byte_start": 1516, "byte_end": 1517, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "33.81%", "qwen": "39.40%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.15502455830574036]], "qwen": [[13, ".", "normal", 0.11249887943267822]]}, "loss": {"rwkv": 33.81316502083508, "qwen": 39.40021921416191}, "topk": {"rwkv": [47, 2, 0.15502455830574036, [[45, 0.158469, ",", false], [47, 0.155025, ".", false], [21265, 0.086348, " and", false], [40085, 0.072374, " using", false], [4706, 0.052561, " of", false], [4596, 0.048629, " in", false], [32487, 0.045554, " with", false], [55780, 0.043031, " combined", false], [275, 0.035293, " (", false], [31601, 0.032924, " over", false]]], "qwen": [13, 2, 0.11249887943267822, [[315, 0.154114, " of", false], [13, 0.112499, ".", false], [11, 0.110164, ",", false], [323, 0.099218, " and", false], [429, 0.052457, " that", false], [320, 0.047566, " (", false], [448, 0.046324, " with", false], [10856, 0.041333, " combined", false], [1667, 0.030094, " using", false], [304, 0.020681, " in", false]]]}, "raw_delta": -0.309812068939209, "tuned_delta": -0.30247493042550627}, {"byte_start": 1517, "byte_end": 1520, "display": {"text": " At", "kind": "normal"}, "is_word": true, "word_id": 256, "word_key": " at", "bytes_hex": "20 41 74", "compression": {"rwkv": "28.74% 28.74% 28.74%", "qwen": "25.76% 25.76% 25.76%"}, "model_tokens": {"rwkv": [[3642, " At", "normal", 0.008409584872424603]], "qwen": [[2411, " At", "normal", 0.013779883272945881]]}, "loss": {"rwkv": 28.741190267709815, "qwen": 25.755385134193023}, "topk": {"rwkv": [3642, 17, 0.008409584872424603, [[20996, 0.196119, " The", false], [3913, 0.089501, " In", false], [29894, 0.064125, " This", false], [28753, 0.031609, " Deep", false], [19555, 0.029305, " But", false], [20184, 0.0287, " Kas", false], [29893, 0.027915, " They", false], [267, 0.027069, "  ", false], [3918, 0.024974, " It", false], [29889, 0.022741, " That", false]]], "qwen": [2411, 12, 0.013779883272945881, [[576, 0.210873, " The", false], [1096, 0.054783, " This", false], [2379, 0.052526, " They", false], [220, 0.048822, " ", false], [4220, 0.045169, " These", false], [758, 0.041157, " In", false], [1988, 0.029914, " But", false], [1084, 0.025989, " It", false], [2619, 0.018194, " There", false], [18183, 0.015407, " Deep", false]]]}, "raw_delta": 0.165568192799886, "tuned_delta": 0.17290533131358873}, {"byte_start": 1520, "byte_end": 1524, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 257, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "1.98% 1.98% 1.98% 1.98%", "qwen": "2.66% 2.66% 2.66% 2.66%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.6441946029663086]], "qwen": [[279, " the", "normal", 0.5542927980422974]]}, "loss": {"rwkv": 1.9812401379395552, "qwen": 2.6602496788230656}, "topk": {"rwkv": [22590, 1, 0.6441946029663086, [[22590, 0.644195, " the", false], [32227, 0.208498, " that", false], [332, 0.017823, " a", false], [38879, 0.017627, " least", false], [38499, 0.015834, " first", false], [37598, 0.010254, " about", false], [32234, 0.008121, " this", false], [32074, 0.007097, " some", false], [22226, 0.007068, " one", false], [21902, 0.005249, " its", false]]], "qwen": [279, 1, 0.5542927980422974, [[279, 0.554293, " the", false], [429, 0.188296, " that", false], [1156, 0.067455, " first", false], [825, 0.020725, " one", false], [264, 0.01993, " a", false], [3245, 0.018709, " least", false], [1817, 0.017859, " each", false], [419, 0.017575, " this", false], [1181, 0.008022, " its", false], [220, 0.007143, " ", false]]]}, "raw_delta": -0.037652283906936646, "tuned_delta": -0.03031514539323391}, {"byte_start": 1524, "byte_end": 1529, "display": {"text": " time", "kind": "normal"}, "is_word": true, "word_id": 258, "word_key": " time", "bytes_hex": "20 74 69 6d 65", "compression": {"rwkv": "0.59% 0.59% 0.59% 0.59% 0.59%", "qwen": "1.04% 1.04% 1.04% 1.04% 1.04%"}, "model_tokens": {"rwkv": [[32251, " time", "normal", 0.8512951731681824]], "qwen": [[882, " time", "normal", 0.748907744884491]]}, "loss": {"rwkv": 0.5882081831749435, "qwen": 1.0428501251452447}, "topk": {"rwkv": [32251, 1, 0.8512951731681824, [[32251, 0.851295, " time", false], [31937, 0.035279, " same", false], [21616, 0.030662, " end", false], [59220, 0.008421, " beginning", false], [38887, 0.007381, " level", false], [39801, 0.007043, " start", false], [22615, 0.004064, " top", false], [38676, 0.00393, " heart", false], [3492, 0.002393, " 19", false], [32321, 0.002162, " turn", false]]], "qwen": [882, 1, 0.748907744884491, [[882, 0.748908, " time", false], [1852, 0.050884, " same", false], [1191, 0.023412, " start", false], [3704, 0.02151, " root", false], [835, 0.019151, " end", false], [7167, 0.014188, " beginning", false], [1909, 0.010463, " top", false], [4746, 0.008314, " heart", false], [1602, 0.006322, " very", false], [16162, 0.005947, " peak", false]]]}, "raw_delta": -0.025210702419281007, "tuned_delta": -0.01787356390557827}, {"byte_start": 1529, "byte_end": 1530, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "5.81%", "qwen": "5.66%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.725545346736908]], "qwen": [[11, ",", "normal", 0.7307966351509094]]}, "loss": {"rwkv": 5.811637737956029, "qwen": 5.655725790924782}, "topk": {"rwkv": [45, 1, 0.725545346736908, [[45, 0.725545, ",", false], [4706, 0.080008, " of", false], [22590, 0.03385, " the", false], [32234, 0.0283, " this", false], [4601, 0.025524, " it", false], [32227, 0.015919, " that", false], [32232, 0.015049, " they", false], [39934, 0.01147, " there", false], [20184, 0.010874, " Kas", false], [39936, 0.005643, " these", false]]], "qwen": [11, 1, 0.7307966351509094, [[11, 0.730797, ",", false], [315, 0.122308, " of", false], [279, 0.024006, " the", false], [432, 0.020119, " it", false], [419, 0.017418, " this", false], [807, 0.012417, " they", false], [1052, 0.010927, " there", false], [320, 0.009159, " (", false], [1493, 0.006985, " these", false], [429, 0.006148, " that", false]]]}, "raw_delta": 0.008645594120025635, "tuned_delta": 0.01598273263372837}, {"byte_start": 1530, "byte_end": 1535, "display": {"text": " this", "kind": "normal"}, "is_word": true, "word_id": 259, "word_key": " this", "bytes_hex": "20 74 68 69 73", "compression": {"rwkv": "7.95% 7.95% 7.95% 7.95% 7.95%", "qwen": "10.78% 10.78% 10.78% 10.78% 10.78%"}, "model_tokens": {"rwkv": [[32234, " this", "normal", 0.10871747136116028]], "qwen": [[419, " this", "normal", 0.05038928985595703]]}, "loss": {"rwkv": 7.946093779896243, "qwen": 10.776847381252168}, "topk": {"rwkv": [32234, 2, 0.10871747136116028, [[22590, 0.226634, " the", false], [32234, 0.108717, " this", false], [4601, 0.086941, " it", false], [39934, 0.040709, " there", false], [32232, 0.037625, " they", false], [39936, 0.032501, " these", false], [4692, 0.023731, " no", false], [332, 0.020772, " a", false], [32227, 0.017063, " that", false], [38013, 0.016646, " chess", false]]], "qwen": [419, 5, 0.05038928985595703, [[279, 0.223538, " the", false], [432, 0.092244, " it", false], [1052, 0.054495, " there", false], [32719, 0.054022, " chess", false], [419, 0.050389, " this", false], [902, 0.04243, " no", false], [1493, 0.02881, " these", false], [807, 0.024149, " they", false], [264, 0.02267, " a", false], [1429, 0.020667, " most", false]]]}, "raw_delta": -0.15697031021118163, "tuned_delta": -0.1496331716974789}, {"byte_start": 1535, "byte_end": 1539, "display": {"text": " was", "kind": "normal"}, "is_word": true, "word_id": 260, "word_key": " was", "bytes_hex": "20 77 61 73", "compression": {"rwkv": "2.52% 2.52% 2.52% 2.52%", "qwen": "3.42% 3.42% 3.42% 3.42%"}, "model_tokens": {"rwkv": [[22748, " was", "normal", 0.5746609568595886]], "qwen": [[572, " was", "normal", 0.46857208013534546]]}, "loss": {"rwkv": 2.518376353114279, "qwen": 3.417678471487961}, "topk": {"rwkv": [22748, 1, 0.5746609568595886, [[22748, 0.574661, " was", false], [47211, 0.056424, " seemed", false], [55532, 0.052585, " approach", false], [46561, 0.038547, " method", false], [47202, 0.016355, " search", false], [63841, 0.015321, " represented", false], [57101, 0.012581, " required", false], [21795, 0.011267, " had", false], [38990, 0.011147, " meant", false], [31351, 0.010582, " made", false]]], "qwen": [572, 1, 0.46857208013534546, [[572, 0.468572, " was", false], [9324, 0.09243, " seemed", false], [5486, 0.078204, " approach", false], [1714, 0.041065, " method", false], [2567, 0.038069, " required", false], [2711, 0.021175, " search", false], [8791, 0.019898, " meant", false], [1030, 0.016118, " had", false], [1035, 0.015172, " would", false], [6398, 0.013176, " involved", false]]]}, "raw_delta": -0.0498678982257843, "tuned_delta": -0.04253075971208156}, {"byte_start": 1539, "byte_end": 1546, "display": {"text": " looked", "kind": "normal"}, "is_word": true, "word_id": 261, "word_key": " looked", "bytes_hex": "20 6c 6f 6f 6b 65 64", "compression": {"rwkv": "22.38% 22.38% 22.38% 22.38% 22.38% 22.38% 22.38%", "qwen": "21.48% 21.48% 21.48% 21.48% 21.48% 21.48% 21.48%"}, "model_tokens": {"rwkv": [[46471, " looked", "normal", 0.00016469473484903574]], "qwen": [[6966, " looked", "normal", 0.00023941117979120463]]}, "loss": {"rwkv": 22.381094942362264, "qwen": 21.47896731794644}, "topk": {"rwkv": [46471, 233, 0.00016469473484903574, [[22590, 0.265187, " the", false], [332, 0.135234, " a", false], [61755, 0.110696, " considered", false], [53137, 0.038112, " thought", false], [22187, 0.032455, " not", false], [31968, 0.03192, " seen", false], [4419, 0.030151, " an", false], [57059, 0.013828, " regarded", false], [39802, 0.011979, " state", false], [22226, 0.011517, " one", false]]], "qwen": [6966, 208, 0.00023941117979120463, [[279, 0.19248, " the", false], [264, 0.174535, " a", false], [6509, 0.114077, " considered", false], [537, 0.080483, " not", false], [458, 0.058191, " an", false], [3884, 0.025644, " seen", false], [3381, 0.022485, " thought", false], [29969, 0.009631, " unprecedented", false], [13570, 0.009015, " widely", false], [825, 0.008999, " one", false]]]}, "raw_delta": 0.050024577549525606, "tuned_delta": 0.057361716063228346}, {"byte_start": 1546, "byte_end": 1551, "display": {"text": " upon", "kind": "normal"}, "is_word": true, "word_id": 262, "word_key": " upon", "bytes_hex": "20 75 70 6f 6e", "compression": {"rwkv": "3.10% 3.10% 3.10% 3.10% 3.10%", "qwen": "1.64% 1.64% 1.64% 1.64% 1.64%"}, "model_tokens": {"rwkv": [[32350, " upon", "normal", 0.42306748032569885]], "qwen": [[5193, " upon", "normal", 0.6352965831756592]]}, "loss": {"rwkv": 3.099540126909882, "qwen": 1.6362445526461131}, "topk": {"rwkv": [32350, 1, 0.42306748032569885, [[32350, 0.423067, " upon", false], [4424, 0.270821, " at", false], [4712, 0.268243, " on", false], [30678, 0.014708, " down", false], [4811, 0.00771, " to", false], [4423, 0.003743, " as", false], [4833, 0.001497, " up", false], [21295, 0.001472, " ask", false], [4450, 0.001008, " by", false], [30218, 0.000938, " back", false]]], "qwen": [5193, 1, 0.6352965831756592, [[5193, 0.635297, " upon", false], [518, 0.167502, " at", false], [389, 0.115316, " on", false], [1495, 0.05384, " down", false], [311, 0.015149, " to", false], [1182, 0.00164, " back", false], [369, 0.001565, " for", false], [1075, 0.001294, " like", false], [438, 0.001074, " as", false], [4637, 0.000624, " forward", false]]]}, "raw_delta": 0.08114233613014221, "tuned_delta": 0.08847947464384495}, {"byte_start": 1551, "byte_end": 1556, "display": {"text": " with", "kind": "normal"}, "is_word": true, "word_id": 263, "word_key": " with", "bytes_hex": "20 77 69 74 68", "compression": {"rwkv": "7.33% 7.33% 7.33% 7.33% 7.33%", "qwen": "12.53% 12.53% 12.53% 12.53% 12.53%"}, "model_tokens": {"rwkv": [[32487, " with", "normal", 0.13237915933132172]], "qwen": [[448, " with", "normal", 0.03100200742483139]]}, "loss": {"rwkv": 7.326185754514267, "qwen": 12.528736615480607}, "topk": {"rwkv": [32487, 2, 0.13237915933132172, [[4423, 0.697396, " as", false], [32487, 0.132379, " with", false], [4450, 0.089892, " by", false], [60512, 0.028225, " skeptical", false], [4596, 0.006074, " in", false], [38458, 0.003928, " favor", false], [57263, 0.003034, " somewhat", false], [45, 0.002795, ",", false], [21295, 0.002741, " ask", false], [62624, 0.002031, " suspicious", false]]], "qwen": [448, 3, 0.03100200742483139, [[438, 0.876166, " as", false], [553, 0.03154, " by", false], [448, 0.031002, " with", false], [36579, 0.009905, " skept", false], [11, 0.006082, ",", false], [311, 0.004734, " to", false], [304, 0.004288, " in", false], [320, 0.002634, " (", false], [4694, 0.00257, " favor", false], [537, 0.002294, " not", false]]]}, "raw_delta": -0.28849067687988283, "tuned_delta": -0.2811535383661801}, {"byte_start": 1556, "byte_end": 1563, "display": {"text": " dismay", "kind": "normal"}, "is_word": true, "word_id": 264, "word_key": " dismay", "bytes_hex": "20 64 69 73 6d 61 79", "compression": {"rwkv": "13.28% 13.28% 13.28% 13.28% 13.28% 13.28% 13.28%", "qwen": "11.90% 11.90% 11.90% 11.90% 11.90% 11.90% 11.90%"}, "model_tokens": {"rwkv": [[45756, " dismay", "normal", 0.005752681288868189]], "qwen": [[71982, " dismay", "normal", 0.00986457522958517]]}, "loss": {"rwkv": 13.283743401042354, "qwen": 11.899155303056101}, "topk": {"rwkv": [45756, 20, 0.005752681288868189, [[62561, 0.240901, " skepticism", false], [60609, 0.196995, " suspicion", false], [32074, 0.070455, " some", false], [21542, 0.060081, " dis", false], [332, 0.046316, " a", false], [46271, 0.030396, " incred", false], [38629, 0.029573, " great", false], [21523, 0.025235, " der", false], [39608, 0.022898, " scorn", false], [64313, 0.020014, " considerable", false]]], "qwen": [71982, 18, 0.00986457522958517, [[66133, 0.185542, " skepticism", false], [2244, 0.114888, " great", false], [37041, 0.105034, " suspicion", false], [1045, 0.05703, " some", false], [264, 0.036511, " a", false], [23839, 0.035585, " considerable", false], [9653, 0.031005, " incred", false], [87006, 0.024041, " scorn", false], [50417, 0.020561, " awe", false], [78398, 0.019158, " disdain", false]]]}, "raw_delta": 0.0767778669084822, "tuned_delta": 0.08411500542218495}, {"byte_start": 1563, "byte_end": 1566, "display": {"text": " by", "kind": "normal"}, "is_word": true, "word_id": 265, "word_key": " by", "bytes_hex": "20 62 79", "compression": {"rwkv": "4.48% 4.48% 4.48%", "qwen": "8.77% 8.77% 8.77%"}, "model_tokens": {"rwkv": [[4450, " by", "normal", 0.47529152035713196]], "qwen": [[553, " by", "normal", 0.23240253329277039]]}, "loss": {"rwkv": 4.484940638180208, "qwen": 8.772092628735642}, "topk": {"rwkv": [4450, 1, 0.47529152035713196, [[4450, 0.475292, " by", false], [45, 0.154973, ",", false], [4423, 0.139672, " as", false], [47, 0.0645, ".", false], [51018, 0.038305, " because", false], [21265, 0.031231, " and", false], [4596, 0.020537, " in", false], [59, 0.011885, ":", false], [37694, 0.009861, " among", false], [30917, 0.009172, " from", false]]], "qwen": [553, 2, 0.23240253329277039, [[11, 0.27647, ",", false], [553, 0.232403, " by", false], [13, 0.163083, ".", false], [1576, 0.070035, " because", false], [323, 0.067026, " and", false], [438, 0.052422, " as", false], [25, 0.034901, ":", false], [26, 0.016396, ";", false], [320, 0.012731, " (", false], [2474, 0.009707, " since", false]]]}, "raw_delta": -0.23773018519083658, "tuned_delta": -0.23039304667713384}, {"byte_start": 1566, "byte_end": 1570, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 266, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "7.85% 7.85% 7.85% 7.85%", "qwen": "9.55% 9.55% 9.55% 9.55%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.1756531149148941]], "qwen": [[279, " the", "normal", 0.12037070840597153]]}, "loss": {"rwkv": 7.854516457964815, "qwen": 9.545136012910124}, "topk": {"rwkv": [22590, 1, 0.1756531149148941, [[22590, 0.175653, " the", false], [31370, 0.168577, " many", false], [39944, 0.091417, " those", false], [32074, 0.079957, " some", false], [38720, 0.075896, " human", false], [38013, 0.071999, " chess", false], [31461, 0.026216, " most", false], [3609, 0.017833, " AI", false], [46787, 0.016414, " people", false], [20184, 0.016071, " Kas", false]]], "qwen": [279, 3, 0.12037070840597153, [[1657, 0.225981, " many", false], [32719, 0.209662, " chess", false], [279, 0.120371, " the", false], [1846, 0.0733, " those", false], [1045, 0.071325, " some", false], [3738, 0.027125, " human", false], [1429, 0.026412, " most", false], [264, 0.017876, " a", false], [11811, 0.017368, " researchers", false], [6366, 0.017071, " computer", false]]]}, "raw_delta": -0.09374785423278809, "tuned_delta": -0.08641071571908535}, {"byte_start": 1570, "byte_end": 1579, "display": {"text": " majority", "kind": "normal"}, "is_word": true, "word_id": 267, "word_key": " majority", "bytes_hex": "20 6d 61 6a 6f 72 69 74 79", "compression": {"rwkv": "10.77% 10.77% 10.77% 10.77% 10.77% 10.77% 10.77% 10.77% 10.77%", "qwen": "9.64% 9.64% 9.64% 9.64% 9.64% 9.64% 9.64% 9.64% 9.64%"}, "model_tokens": {"rwkv": [[56573, " majority", "normal", 0.004614981822669506]], "qwen": [[8686, " majority", "normal", 0.008159642107784748]]}, "loss": {"rwkv": 10.77011922885858, "qwen": 9.63510921443859}, "topk": {"rwkv": [56573, 27, 0.004614981822669506, [[38720, 0.192614, " human", false], [38013, 0.120018, " chess", false], [38621, 0.097352, " grand", false], [55809, 0.037162, " computer", false], [51685, 0.031074, " experts", false], [40213, 0.030688, " world", false], [3609, 0.023445, " AI", false], [45929, 0.020343, " expert", false], [22615, 0.016196, " top", false], [63933, 0.014232, " traditional", false]]], "qwen": [8686, 8, 0.008159642107784748, [[32719, 0.593104, " chess", false], [3738, 0.052657, " human", false], [15235, 0.021827, " AI", false], [6366, 0.015761, " computer", false], [6662, 0.015289, " grand", false], [1879, 0.012535, " world", false], [3942, 0.012518, " community", false], [8686, 0.00816, " majority", false], [1251, 0.008023, " people", false], [47387, 0.007971, " Chess", false]]]}, "raw_delta": 0.06293831931220162, "tuned_delta": 0.07027545782590436}, {"byte_start": 1579, "byte_end": 1582, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 268, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "0.12% 0.12% 0.12%", "qwen": "0.25% 0.25% 0.25%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.9809170961380005]], "qwen": [[315, " of", "normal", 0.9587160348892212]]}, "loss": {"rwkv": 0.11593923770164805, "qwen": 0.25343560494597595}, "topk": {"rwkv": [4706, 1, 0.9809170961380005, [[4706, 0.980917, " of", false], [45, 0.004015, ",", false], [4596, 0.001874, " in", false], [22762, 0.001854, " who", false], [47, 0.001831, ".", false], [38013, 0.001064, " chess", false], [3609, 0.000967, " AI", false], [59324, 0.000728, " community", false], [275, 0.000652, " (", false], [52367, 0.000534, " opinion", false]]], "qwen": [315, 1, 0.9587160348892212, [[315, 0.958716, " of", false], [11, 0.014388, ",", false], [13, 0.005598, ".", false], [879, 0.003266, " who", false], [320, 0.002792, " (", false], [304, 0.001867, " in", false], [9459, 0.00135, " opinion", false], [1576, 0.001321, " because", false], [25, 0.000955, ":", false], [438, 0.000939, " as", false]]]}, "raw_delta": -0.007624417543411256, "tuned_delta": -0.00028727902970851916}, {"byte_start": 1582, "byte_end": 1591, "display": {"text": " computer", "kind": "normal"}, "is_word": true, "word_id": 269, "word_key": " computer", "bytes_hex": "20 63 6f 6d 70 75 74 65 72", "compression": {"rwkv": "5.35% 5.35% 5.35% 5.35% 5.35% 5.35% 5.35% 5.35% 5.35%", "qwen": "4.84% 4.84% 4.84% 4.84% 4.84% 4.84% 4.84% 4.84% 4.84%"}, "model_tokens": {"rwkv": [[55809, " computer", "normal", 0.06905443221330643]], "qwen": [[6366, " computer", "normal", 0.08924874663352966]]}, "loss": {"rwkv": 5.353751128298887, "qwen": 4.841700493670846}, "topk": {"rwkv": [55809, 5, 0.06905443221330643, [[38013, 0.263274, " chess", false], [3609, 0.226674, " AI", false], [22590, 0.195946, " the", false], [63843, 0.083175, " researchers", false], [55809, 0.069054, " computer", false], [46787, 0.023975, " people", false], [51685, 0.020179, " experts", false], [38720, 0.015138, " human", false], [39944, 0.010044, " those", false], [52489, 0.008606, " players", false]]], "qwen": [6366, 4, 0.08924874663352966, [[32719, 0.430236, " chess", false], [279, 0.177072, " the", false], [11811, 0.107766, " researchers", false], [6366, 0.089249, " computer", false], [15235, 0.059845, " AI", false], [1251, 0.017006, " people", false], [3738, 0.011981, " human", false], [11647, 0.009664, " experts", false], [1846, 0.007894, " those", false], [3412, 0.007429, " research", false]]]}, "raw_delta": 0.028394116295708538, "tuned_delta": 0.03573125480941128}, {"byte_start": 1591, "byte_end": 1597, "display": {"text": "-chess", "kind": "normal"}, "is_word": true, "word_id": 270, "word_key": "-chess", "bytes_hex": "2d 63 68 65 73 73", "compression": {"rwkv": "55.51% 8.59% 8.59% 8.59% 8.59% 0.04%", "qwen": "22.36% 22.36% 22.36% 0.00% 0.00% 0.00%"}, "model_tokens": {"rwkv": [[46, "-", "normal", 0.04608757793903351], [24991, "ches", "normal", 0.1493699848651886], [116, "s", "normal", 0.9980239868164062]], "qwen": [[11582, "-ch", "normal", 0.02424108237028122], [433, "ess", "normal", 0.9995290040969849]]}, "loss": {"rwkv": 14.987026816587443, "qwen": 11.181420540360765}, "topk": {"rwkv": [46, 4, 0.04608757793903351, [[38013, 0.60557, " chess", false], [62532, 0.167592, " scientists", false], [51685, 0.048257, " experts", false], [46, 0.046088, "-", false], [52814, 0.026499, " science", false], [52489, 0.021772, " players", false], [63794, 0.015424, " programmers", false], [63843, 0.013914, " researchers", false], [3609, 0.006537, " AI", false], [47732, 0.005008, " vision", false]]], "qwen": [11582, 4, 0.02424108237028122, [[13923, 0.414545, " scientists", false], [32719, 0.39622, " chess", false], [8038, 0.050103, " science", false], [11582, 0.024241, "-ch", false], [54846, 0.019488, " programmers", false], [4217, 0.016435, " players", false], [11811, 0.016364, " researchers", false], [27468, 0.007223, " scientist", false], [11129, 0.006301, " vision", false], [11647, 0.003527, " experts", false]]]}, "raw_delta": 0.21102762085502028, "tuned_delta": 0.21836475936872302}, {"byte_start": 1597, "byte_end": 1609, "display": {"text": " researchers", "kind": "normal"}, "is_word": true, "word_id": 271, "word_key": " researchers", "bytes_hex": "20 72 65 73 65 61 72 63 68 65 72 73", "compression": {"rwkv": "0.41% 0.41% 0.41% 0.41% 0.41% 0.41% 0.41% 0.41% 0.41% 0.41% 0.41% 0.41%", "qwen": "0.84% 0.84% 0.84% 0.84% 0.84% 0.84% 0.84% 0.84% 0.84% 0.84% 0.84% 0.84%"}, "model_tokens": {"rwkv": [[63843, " researchers", "normal", 0.7623742818832397]], "qwen": [[11811, " researchers", "normal", 0.5727719068527222]]}, "loss": {"rwkv": 0.407988709886812, "qwen": 0.8374660249788509}, "topk": {"rwkv": [63843, 1, 0.7623742818832397, [[63843, 0.762374, " researchers", false], [51685, 0.099354, " experts", false], [52489, 0.038574, " players", false], [63533, 0.016932, " enthusiasts", false], [64985, 0.008474, " practitioners", false], [46, 0.00782, "-", false], [57103, 0.006958, " research", false], [46787, 0.006531, " people", false], [63874, 0.006406, " specialists", false], [57166, 0.004386, " scholars", false]]], "qwen": [11811, 1, 0.5727719068527222, [[11811, 0.572772, " researchers", false], [4217, 0.101854, " players", false], [11647, 0.098618, " experts", false], [54846, 0.034473, " programmers", false], [42348, 0.030855, " enthusiasts", false], [72085, 0.026601, "-playing", false], [3412, 0.015379, " research", false], [82962, 0.012889, " theorists", false], [15387, 0.006701, " professionals", false], [42095, 0.006361, " practitioners", false]]]}, "raw_delta": -0.023815279205640156, "tuned_delta": -0.01647814069193742}, {"byte_start": 1609, "byte_end": 1613, "display": {"text": " who", "kind": "normal"}, "is_word": true, "word_id": 272, "word_key": " who", "bytes_hex": "20 77 68 6f", "compression": {"rwkv": "13.24% 13.24% 13.24% 13.24%", "qwen": "11.10% 11.10% 11.10% 11.10%"}, "model_tokens": {"rwkv": [[22762, " who", "normal", 0.05310344323515892]], "qwen": [[879, " who", "normal", 0.08526797592639923]]}, "loss": {"rwkv": 13.243489633160404, "qwen": 11.099538859022683}, "topk": {"rwkv": [22762, 4, 0.05310344323515892, [[45, 0.472392, ",", false], [47, 0.272927, ".", false], [4423, 0.056405, " as", false], [22762, 0.053103, " who", false], [51018, 0.046674, " because", false], [275, 0.019423, " (", false], [60, 0.015016, ";", false], [59, 0.014098, ":", false], [21265, 0.012627, " and", false], [4596, 0.006176, " in", false]]], "qwen": [879, 3, 0.08526797592639923, [[11, 0.460601, ",", false], [13, 0.243955, ".", false], [879, 0.085268, " who", false], [1576, 0.048636, " because", false], [320, 0.030388, " (", false], [323, 0.02917, " and", false], [25, 0.018105, ":", false], [438, 0.018057, " as", false], [26, 0.015047, ";", false], [2474, 0.005002, " since", false]]]}, "raw_delta": 0.11888587474822998, "tuned_delta": 0.12622301326193272}, {"byte_start": 1613, "byte_end": 1617, "display": {"text": " had", "kind": "normal"}, "is_word": true, "word_id": 273, "word_key": " had", "bytes_hex": "20 68 61 64", "compression": {"rwkv": "8.35% 8.35% 8.35% 8.35%", "qwen": "6.76% 6.76% 6.76% 6.76%"}, "model_tokens": {"rwkv": [[21795, " had", "normal", 0.1566888839006424]], "qwen": [[1030, " had", "normal", 0.2232958972454071]]}, "loss": {"rwkv": 8.34762511451866, "qwen": 6.759285254378814}, "topk": {"rwkv": [21795, 1, 0.1566888839006424, [[21795, 0.156689, " had", false], [55616, 0.139689, " believed", false], [32462, 0.112534, " were", false], [53137, 0.104162, " thought", false], [30840, 0.0412, " felt", false], [22439, 0.027101, " saw", false], [39820, 0.024053, " still", false], [45, 0.023236, ",", false], [60227, 0.022341, " preferred", false], [56175, 0.015599, " expected", false]]], "qwen": [1030, 1, 0.2232958972454071, [[1030, 0.223296, " had", false], [1033, 0.171908, " were", false], [11585, 0.130731, " believed", false], [3381, 0.049534, " thought", false], [14890, 0.037662, " preferred", false], [11, 0.028434, ",", false], [6476, 0.017256, " felt", false], [4829, 0.015278, " wanted", false], [45503, 0.012905, " favored", false], [4518, 0.011503, " instead", false]]]}, "raw_delta": 0.08807626366615295, "tuned_delta": 0.0954134021798557}, {"byte_start": 1617, "byte_end": 1625, "display": {"text": " pursued", "kind": "normal"}, "is_word": true, "word_id": 274, "word_key": " pursued", "bytes_hex": "20 70 75 72 73 75 65 64", "compression": {"rwkv": "13.10% 13.10% 13.10% 13.10% 13.10% 13.10% 13.10% 13.10%", "qwen": "11.11% 11.11% 11.11% 11.11% 11.11% 11.11% 11.11% 11.11%"}, "model_tokens": {"rwkv": [[52611, " pursued", "normal", 0.0029854485765099525]], "qwen": [[45431, " pursued", "normal", 0.007243321277201176]]}, "loss": {"rwkv": 13.102601445573592, "qwen": 11.108019753493355}, "topk": {"rwkv": [52611, 45, 0.0029854485765099525, [[30259, 0.252889, " been", false], [39762, 0.095071, " spent", false], [62367, 0.062336, " previously", false], [56495, 0.030823, " invested", false], [55616, 0.024418, " believed", false], [30482, 0.024284, " come", false], [53137, 0.022804, " thought", false], [47812, 0.022358, " worked", false], [51770, 0.017495, " focused", false], [22187, 0.017438, " not", false]]], "qwen": [45431, 21, 0.007243321277201176, [[1012, 0.228198, " been", false], [7391, 0.173035, " spent", false], [27991, 0.042318, " invested", false], [10735, 0.036404, " focused", false], [8597, 0.023174, " previously", false], [7881, 0.022822, " developed", false], [6439, 0.019705, " worked", false], [11585, 0.019437, " believed", false], [6679, 0.016472, " tried", false], [28229, 0.013101, " devoted", false]]]}, "raw_delta": 0.11060309410095215, "tuned_delta": 0.11794023261465489}, {"byte_start": 1625, "byte_end": 1633, "display": {"text": " methods", "kind": "normal"}, "is_word": true, "word_id": 275, "word_key": " methods", "bytes_hex": "20 6d 65 74 68 6f 64 73", "compression": {"rwkv": "6.06% 6.06% 6.06% 6.06% 6.06% 6.06% 6.06% 6.06%", "qwen": "5.07% 5.07% 5.07% 5.07% 5.07% 5.07% 5.07% 5.07%"}, "model_tokens": {"rwkv": [[52224, " methods", "normal", 0.06921660155057907]], "qwen": [[5413, " methods", "normal", 0.10562748461961746]]}, "loss": {"rwkv": 6.058192066232952, "qwen": 5.067097970081733}, "topk": {"rwkv": [52224, 4, 0.06921660155057907, [[22590, 0.174211, " the", false], [332, 0.134013, " a", false], [39193, 0.089745, " other", false], [52224, 0.069217, " methods", false], [31458, 0.036255, " more", false], [63277, 0.035551, " alternative", false], [4419, 0.023579, " an", false], [38720, 0.017617, " human", false], [47202, 0.014963, " search", false], [53265, 0.014322, " various", false]]], "qwen": [5413, 2, 0.10562748461961746, [[264, 0.154715, " a", false], [5413, 0.105627, " methods", false], [279, 0.101364, " the", false], [1008, 0.059124, " other", false], [458, 0.029129, " an", false], [803, 0.02519, " more", false], [2155, 0.020887, " different", false], [25600, 0.016323, " shallow", false], [10555, 0.016134, " alternative", false], [1128, 0.016059, " what", false]]]}, "raw_delta": 0.05495792627334595, "tuned_delta": 0.06229506478704869}, {"byte_start": 1633, "byte_end": 1638, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 276, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"rwkv": "5.38% 5.38% 5.38% 5.38% 5.38%", "qwen": "4.99% 4.99% 4.99% 4.99% 4.99%"}, "model_tokens": {"rwkv": [[32227, " that", "normal", 0.22712847590446472]], "qwen": [[429, " that", "normal", 0.25049540400505066]]}, "loss": {"rwkv": 5.38192876581625, "qwen": 4.992860153988606}, "topk": {"rwkv": [32227, 2, 0.22712847590446472, [[37810, 0.418116, " based", false], [32227, 0.227128, " that", false], [4706, 0.056887, " of", false], [59927, 0.033228, " involving", false], [4596, 0.020792, " in", false], [38888, 0.019895, " lever", false], [52700, 0.019537, " relying", false], [31296, 0.017888, " like", false], [21700, 0.016594, " for", false], [32139, 0.014849, " such", false]]], "qwen": [429, 2, 0.25049540400505066, [[3118, 0.496231, " based", false], [429, 0.250495, " that", false], [315, 0.041951, " of", false], [38561, 0.014541, " relying", false], [1667, 0.012073, " using", false], [14606, 0.011522, " inspired", false], [448, 0.009377, " with", false], [369, 0.008967, " for", false], [803, 0.008254, " more", false], [311, 0.007694, " to", false]]]}, "raw_delta": 0.021574544906616255, "tuned_delta": 0.028911683420318992}, {"byte_start": 1638, "byte_end": 1648, "display": {"text": " leveraged", "kind": "normal"}, "is_word": true, "word_id": 277, "word_key": " leveraged", "bytes_hex": "20 6c 65 76 65 72 61 67 65 64", "compression": {"rwkv": "4.10% 4.10% 4.10% 4.10% 4.10% 4.10% 4.10% 4.10% 4.10% 0.16%", "qwen": "8.38% 8.38% 8.38% 8.38% 8.38% 8.38% 0.00% 0.00% 0.00% 0.00%"}, "model_tokens": {"rwkv": [[56540, " leverage", "normal", 0.12964870035648346], [101, "d", "normal", 0.9910750389099121]], "qwen": [[27505, " lever", "normal", 0.06148497387766838], [3279, "aged", "normal", 0.9993828535079956]]}, "loss": {"rwkv": 3.7075607114642213, "qwen": 5.030640959058762}, "topk": {"rwkv": [56540, 2, 0.12964870035648346, [[32462, 0.131339, " were", false], [56540, 0.129649, " leverage", false], [47054, 0.068338, " relied", false], [32354, 0.062131, " used", false], [56500, 0.035729, " involved", false], [21532, 0.03314, " did", false], [59685, 0.030331, " exploited", false], [31351, 0.024942, " made", false], [47340, 0.021319, " sought", false], [40219, 0.018744, " would", false]]], "qwen": [27505, 3, 0.06148497387766838, [[39913, 0.185761, " relied", false], [1033, 0.15033, " were", false], [27505, 0.061485, " lever", false], [1483, 0.056543, " used", false], [50663, 0.024234, " exploited", false], [6398, 0.024042, " involved", false], [32064, 0.021802, " leverage", false], [1030, 0.017015, " had", false], [6966, 0.014276, " looked", false], [10735, 0.013199, " focused", false]]]}, "raw_delta": -0.07336714746197685, "tuned_delta": -0.06603000894827411}, {"byte_start": 1648, "byte_end": 1654, "display": {"text": " human", "kind": "normal"}, "is_word": true, "word_id": 278, "word_key": " human", "bytes_hex": "20 68 75 6d 61 6e", "compression": {"rwkv": "1.47% 1.47% 1.47% 1.47% 1.47% 1.47%", "qwen": "1.39% 1.39% 1.39% 1.39% 1.39% 1.39%"}, "model_tokens": {"rwkv": [[38720, " human", "normal", 0.6066601276397705]], "qwen": [[3738, " human", "normal", 0.6296586990356445]]}, "loss": {"rwkv": 1.4675852873626334, "qwen": 1.3903292474063027}, "topk": {"rwkv": [38720, 1, 0.6066601276397705, [[38720, 0.60666, " human", false], [22590, 0.071049, " the", false], [59943, 0.065051, " knowledge", false], [39931, 0.048378, " their", false], [45775, 0.017868, " domain", false], [332, 0.012074, " a", false], [51832, 0.011673, " general", false], [38013, 0.01107, " chess", false], [55809, 0.008659, " computer", false], [59792, 0.008355, " heuristic", false]]], "qwen": [3738, 1, 0.6296586990356445, [[3738, 0.629659, " human", false], [6540, 0.071354, " knowledge", false], [279, 0.045133, " the", false], [862, 0.042105, " their", false], [264, 0.014281, " a", false], [32719, 0.011978, " chess", false], [7947, 0.010835, " domain", false], [803, 0.007386, " more", false], [1172, 0.005906, " only", false], [4586, 0.005699, " general", false]]]}, "raw_delta": 0.004283984502156571, "tuned_delta": 0.011621123015859307}, {"byte_start": 1654, "byte_end": 1668, "display": {"text": " understanding", "kind": "normal"}, "is_word": true, "word_id": 279, "word_key": " understanding", "bytes_hex": "20 75 6e 64 65 72 73 74 61 6e 64 69 6e 67", "compression": {"rwkv": "6.48% 6.48% 6.48% 6.48% 6.48% 6.48% 6.48% 6.48% 6.48% 6.48% 6.48% 6.48% 6.48% 6.48%", "qwen": "7.90% 7.90% 7.90% 7.90% 7.90% 7.90% 7.90% 7.90% 7.90% 7.90% 7.90% 7.90% 7.90% 7.90%"}, "model_tokens": {"rwkv": [[65034, " understanding", "normal", 0.006553909741342068]], "qwen": [[8660, " understanding", "normal", 0.0021649186965078115]]}, "loss": {"rwkv": 6.48085662899339, "qwen": 7.903099714162297}, "topk": {"rwkv": [65034, 5, 0.006553909741342068, [[59943, 0.85734, " knowledge", false], [59683, 0.029356, " expertise", false], [46, 0.024584, "-", false], [38013, 0.016232, " chess", false], [65034, 0.006554, " understanding", false], [62418, 0.004614, " psychology", false], [59917, 0.004117, " intuition", false], [64452, 0.002617, " intelligence", false], [45775, 0.00253, " domain", false], [52022, 0.002464, " insight", false]]], "qwen": [8660, 9, 0.0021649186965078115, [[6540, 0.831445, " knowledge", false], [12646, 0.055003, "-k", false], [18726, 0.026358, " expertise", false], [32719, 0.025361, " chess", false], [6203, 0.004151, " expert", false], [7947, 0.004118, " domain", false], [56251, 0.003225, " intuition", false], [3139, 0.002364, " experience", false], [8660, 0.002165, " understanding", false], [6358, 0.001524, " analysis", false]]]}, "raw_delta": -0.07886590276445658, "tuned_delta": -0.07152876425075384}, {"byte_start": 1668, "byte_end": 1671, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 280, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "2.98% 2.98% 2.98%", "qwen": "2.64% 2.64% 2.64%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.610899806022644]], "qwen": [[315, " of", "normal", 0.6447494029998779]]}, "loss": {"rwkv": 2.9821333039208713, "qwen": 2.63829000238821}, "topk": {"rwkv": [4706, 1, 0.610899806022644, [[4706, 0.6109, " of", false], [47, 0.184021, ".", false], [45, 0.06062, ",", false], [21265, 0.052372, " and", false], [275, 0.018815, " (", false], [4596, 0.014956, " in", false], [4811, 0.011062, " to", false], [4715, 0.004685, " or", false], [59, 0.003517, ":", false], [60, 0.002721, ";", false]]], "qwen": [315, 1, 0.6447494029998779, [[315, 0.644749, " of", false], [13, 0.137459, ".", false], [11, 0.060294, ",", false], [323, 0.028427, " and", false], [320, 0.027727, " (", false], [311, 0.01483, " to", false], [304, 0.013108, " in", false], [4751, 0.007219, " rather", false], [553, 0.005149, " by", false], [803, 0.005016, " more", false]]]}, "raw_delta": 0.019066721200942993, "tuned_delta": 0.02640385971464573}, {"byte_start": 1671, "byte_end": 1675, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 281, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "1.90% 1.90% 1.90% 1.90%", "qwen": "2.04% 2.04% 2.04% 2.04%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.653801679611206]], "qwen": [[279, " the", "normal", 0.6357907056808472]]}, "loss": {"rwkv": 1.901990532421973, "qwen": 2.041800469404744}, "topk": {"rwkv": [22590, 1, 0.653801679611206, [[22590, 0.653802, " the", false], [38013, 0.215117, " chess", false], [30941, 0.018497, " game", false], [38576, 0.010411, " games", false], [21835, 0.009089, " how", false], [57317, 0.006266, " strategy", false], [31702, 0.005739, " play", false], [32464, 0.004067, " what", false], [39072, 0.003732, " moves", false], [31464, 0.003405, " move", false]]], "qwen": [279, 1, 0.6357907056808472, [[279, 0.635791, " the", false], [32719, 0.282524, " chess", false], [1246, 0.015043, " how", false], [1809, 0.006775, " game", false], [1128, 0.003794, " what", false], [3868, 0.003788, " games", false], [4479, 0.00322, " board", false], [264, 0.002583, " a", false], [9892, 0.002425, " positions", false], [2309, 0.002364, " position", false]]]}, "raw_delta": -0.007752709090709686, "tuned_delta": -0.0004155705770069497}, {"byte_start": 1675, "byte_end": 1683, "display": {"text": " special", "kind": "normal"}, "is_word": true, "word_id": 282, "word_key": " special", "bytes_hex": "20 73 70 65 63 69 61 6c", "compression": {"rwkv": "22.12% 22.12% 22.12% 22.12% 22.12% 22.12% 22.12% 22.12%", "qwen": "21.71% 21.71% 21.71% 21.71% 21.71% 21.71% 21.71% 21.71%"}, "model_tokens": {"rwkv": [[52964, " special", "normal", 5.7143333833664656e-05]], "qwen": [[3281, " special", "normal", 6.576983287231997e-05]]}, "loss": {"rwkv": 22.11944545112961, "qwen": 21.706583899468352}, "topk": {"rwkv": [52964, 193, 5.7143333833664656e-05, [[30941, 0.729372, " game", false], [45775, 0.142235, " domain", false], [38013, 0.020638, " chess", false], [56893, 0.008852, " position", false], [52569, 0.008164, " problem", false], [39558, 0.006798, " rules", false], [37876, 0.006435, " board", false], [46642, 0.004903, " nature", false], [32202, 0.003147, " task", false], [60572, 0.002767, " structure", false]]], "qwen": [3281, 153, 6.576983287231997e-05, [[1809, 0.705544, " game", false], [7947, 0.075646, " domain", false], [32719, 0.062908, " chess", false], [5601, 0.027749, " rules", false], [4479, 0.024367, " board", false], [3491, 0.019437, " problem", false], [3868, 0.008428, " games", false], [2309, 0.006874, " position", false], [9666, 0.005155, " pieces", false], [16170, 0.003218, " principles", false]]]}, "raw_delta": 0.022893905639648438, "tuned_delta": 0.030231044153351174}, {"byte_start": 1683, "byte_end": 1693, "display": {"text": " structure", "kind": "normal"}, "is_word": true, "word_id": 283, "word_key": " structure", "bytes_hex": "20 73 74 72 75 63 74 75 72 65", "compression": {"rwkv": "4.23% 4.23% 4.23% 4.23% 4.23% 4.23% 4.23% 4.23% 4.23% 4.23%", "qwen": "4.73% 4.73% 4.73% 4.73% 4.73% 4.73% 4.73% 4.73% 4.73% 4.73%"}, "model_tokens": {"rwkv": [[60572, " structure", "normal", 0.09705828875303268]], "qwen": [[5944, " structure", "normal", 0.07244773954153061]]}, "loss": {"rwkv": 4.226645627604385, "qwen": 4.733644462955164}, "topk": {"rwkv": [60572, 3, 0.09705828875303268, [[56215, 0.171193, " features", false], [46642, 0.1053, " nature", false], [60572, 0.097058, " structure", false], [62404, 0.090629, " properties", false], [65258, 0.085195, " characteristics", false], [30405, 0.067743, " case", false], [50964, 0.03416, " aspects", false], [45775, 0.025181, " domain", false], [46, 0.024101, "-", false], [59943, 0.02066, " knowledge", false]]], "qwen": [5944, 3, 0.07244773954153061, [[4419, 0.226434, " features", false], [5888, 0.196031, " properties", false], [5944, 0.072448, " structure", false], [17452, 0.046335, " characteristics", false], [6540, 0.043927, " knowledge", false], [1361, 0.035753, "ities", false], [13566, 0.027856, " aspects", false], [5601, 0.0259, " rules", false], [32719, 0.025622, " chess", false], [6993, 0.019552, " nature", false]]]}, "raw_delta": -0.02811398506164553, "tuned_delta": -0.020776846547942793}, {"byte_start": 1693, "byte_end": 1696, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 284, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "0.47% 0.47% 0.47%", "qwen": "0.28% 0.28% 0.28%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.9253952503204346]], "qwen": [[315, " of", "normal", 0.9550149440765381]]}, "loss": {"rwkv": 0.46669212138131744, "qwen": 0.2766864276960394}, "topk": {"rwkv": [4706, 1, 0.9253952503204346, [[4706, 0.925395, " of", false], [21265, 0.048445, " and", false], [32227, 0.005418, " that", false], [4596, 0.004927, " in", false], [45, 0.00313, ",", false], [275, 0.002026, " (", false], [4715, 0.000862, " or", false], [52544, 0.000839, " present", false], [56500, 0.00059, " involved", false], [56454, 0.000574, " inherent", false]]], "qwen": [315, 1, 0.9550149440765381, [[315, 0.955015, " of", false], [323, 0.013298, " and", false], [304, 0.010245, " in", false], [429, 0.003382, " that", false], [16533, 0.002991, " underlying", false], [36988, 0.001696, " inherent", false], [3042, 0.001604, " present", false], [320, 0.001567, " (", false], [11, 0.001048, ",", false], [807, 0.000631, " they", false]]]}, "raw_delta": 0.010536152869462967, "tuned_delta": 0.017873291383165704}, {"byte_start": 1696, "byte_end": 1702, "display": {"text": " chess", "kind": "normal"}, "is_word": true, "word_id": 285, "word_key": " chess", "bytes_hex": "20 63 68 65 73 73", "compression": {"rwkv": "2.90% 2.90% 2.90% 2.90% 2.90% 2.90%", "qwen": "1.21% 1.21% 1.21% 1.21% 1.21% 1.21%"}, "model_tokens": {"rwkv": [[38013, " chess", "normal", 0.37551337480545044]], "qwen": [[32719, " chess", "normal", 0.6691892147064209]]}, "loss": {"rwkv": 2.8999485278285637, "qwen": 1.2073206275629442}, "topk": {"rwkv": [38013, 2, 0.37551337480545044, [[22590, 0.496908, " the", false], [38013, 0.375513, " chess", false], [37876, 0.015188, " board", false], [332, 0.015056, " a", false], [38576, 0.013702, " games", false], [32234, 0.010573, " this", false], [32227, 0.005655, " that", false], [60202, 0.004639, " positions", false], [30941, 0.003311, " game", false], [55809, 0.003146, " computer", false]]], "qwen": [32719, 1, 0.6691892147064209, [[32719, 0.669189, " chess", false], [279, 0.276381, " the", false], [3868, 0.006729, " games", false], [264, 0.006351, " a", false], [419, 0.005637, " this", false], [1779, 0.005631, " check", false], [6366, 0.003659, " computer", false], [5994, 0.001782, " Go", false], [4479, 0.001778, " board", false], [47387, 0.001769, " Chess", false]]]}, "raw_delta": 0.09385922054449715, "tuned_delta": 0.10119635905819989}, {"byte_start": 1702, "byte_end": 1703, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "18.46%", "qwen": "14.68%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.36210203170776367]], "qwen": [[13, ".", "normal", 0.44312065839767456]]}, "loss": {"rwkv": 18.45635257387248, "qwen": 14.677857188103266}, "topk": {"rwkv": [47, 1, 0.36210203170776367, [[47, 0.362102, ".", false], [60202, 0.128553, " positions", false], [45, 0.121647, ",", false], [21265, 0.053651, " and", false], [275, 0.049135, " (", false], [38576, 0.03564, " games", false], [4423, 0.028107, " as", false], [41111, 0.021506, "boards", false], [56939, 0.017484, " problems", false], [52616, 0.017119, " puzzles", false]]], "qwen": [13, 1, 0.44312065839767456, [[13, 0.443121, ".", false], [11, 0.128804, ",", false], [320, 0.080235, " (", false], [311, 0.048823, " to", false], [9892, 0.044417, " positions", false], [323, 0.028027, " and", false], [4751, 0.018054, " rather", false], [304, 0.017365, " in", false], [5322, 0.014898, " problems", false], [382, 0.010414, ".\n\n", false]]]}, "raw_delta": 0.2095242738723755, "tuned_delta": 0.21686141238607823}, {"byte_start": 1703, "byte_end": 1708, "display": {"text": " When", "kind": "normal"}, "is_word": true, "word_id": 286, "word_key": " when", "bytes_hex": "20 57 68 65 6e", "compression": {"rwkv": "17.58% 17.58% 17.58% 17.58% 17.58%", "qwen": "17.97% 17.97% 17.97% 17.97% 17.97%"}, "model_tokens": {"rwkv": [[30032, " When", "normal", 0.0075057134963572025]], "qwen": [[3197, " When", "normal", 0.00685387896373868]]}, "loss": {"rwkv": 17.58284581083424, "qwen": 17.972159497939362}, "topk": {"rwkv": [30032, 25, 0.0075057134963572025, [[20996, 0.151728, " The", false], [19555, 0.102088, " But", false], [3913, 0.058009, " In", false], [267, 0.041189, "  ", false], [3918, 0.034303, " It", false], [261, 0.031547, "\n\n", false], [29894, 0.031345, " This", false], [37453, 0.025237, " These", false], [50318, 0.025211, " However", false], [29893, 0.022564, " They", false]]], "qwen": [3197, 26, 0.00685387896373868, [[576, 0.144867, " The", false], [220, 0.068299, " ", false], [4220, 0.058249, " These", false], [2379, 0.047176, " They", false], [758, 0.044735, " In", false], [1096, 0.041127, " This", false], [1084, 0.033302, " It", false], [1988, 0.029506, " But", false], [47387, 0.023685, " Chess", false], [10964, 0.023642, " Their", false]]]}, "raw_delta": -0.021588134765625044, "tuned_delta": -0.014250996251922308}, {"byte_start": 1708, "byte_end": 1710, "display": {"text": " a", "kind": "normal"}, "is_word": true, "word_id": 287, "word_key": " a", "bytes_hex": "20 61", "compression": {"rwkv": "30.43% 30.43%", "qwen": "28.05% 28.05%"}, "model_tokens": {"rwkv": [[332, " a", "normal", 0.033675067126750946]], "qwen": [[264, " a", "normal", 0.04458407685160637]]}, "loss": {"rwkv": 30.43184851875157, "qwen": 28.04579776699427}, "topk": {"rwkv": [332, 5, 0.033675067126750946, [[22590, 0.225349, " the", false], [20184, 0.094974, " Kas", false], [28753, 0.058784, " Deep", false], [4601, 0.046256, " it", false], [332, 0.033675, " a", false], [39936, 0.028527, " these", false], [36274, 0.026068, " Alpha", false], [20077, 0.022134, " IBM", false], [308, 0.020514, " I", false], [39944, 0.018339, " those", false]]], "qwen": [264, 4, 0.04458407685160637, [[279, 0.201523, " the", false], [18183, 0.087553, " Deep", false], [358, 0.055487, " I", false], [264, 0.044584, " a", false], [37542, 0.044462, " Kas", false], [807, 0.039931, " they", false], [1493, 0.030735, " these", false], [32719, 0.020001, " chess", false], [5538, 0.01991, " deep", false], [419, 0.019768, " this", false]]]}, "raw_delta": 0.13231074810028076, "tuned_delta": 0.1396478866139835}, {"byte_start": 1710, "byte_end": 1718, "display": {"text": " simpler", "kind": "normal"}, "is_word": true, "word_id": 288, "word_key": " simpler", "bytes_hex": "20 73 69 6d 70 6c 65 72", "compression": {"rwkv": "14.37% 14.37% 14.37% 14.37% 14.37% 14.37% 14.37% 14.37%", "qwen": "19.53% 19.53% 19.53% 19.53% 19.53% 19.53% 19.53% 19.53%"}, "model_tokens": {"rwkv": [[52907, " simpler", "normal", 0.0017289828974753618]], "qwen": [[34288, " simpler", "normal", 0.00017262586334254593]]}, "loss": {"rwkv": 14.370595133854907, "qwen": 19.531349481138687}, "topk": {"rwkv": [52907, 62, 0.0017289828974753618, [[30597, 0.073992, " deep", false], [55809, 0.071242, " computer", false], [46561, 0.069926, " method", false], [52167, 0.060719, " machine", false], [38013, 0.060306, " chess", false], [38720, 0.054628, " human", false], [52580, 0.044414, " program", false], [51832, 0.042469, " general", false], [22168, 0.036157, " new", false], [47202, 0.025902, " search", false]]], "qwen": [34288, 364, 0.00017262586334254593, [[6366, 0.117928, " computer", false], [1714, 0.09407, " method", false], [32719, 0.084993, " chess", false], [3738, 0.071491, " human", false], [501, 0.042914, " new", false], [5538, 0.034239, " deep", false], [2025, 0.027557, " program", false], [6662, 0.022282, " grand", false], [1879, 0.015855, " world", false], [1849, 0.014348, " system", false]]]}, "raw_delta": -0.2861729860305786, "tuned_delta": -0.2788358475168759}, {"byte_start": 1718, "byte_end": 1719, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "34.09%", "qwen": "39.88%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.15095080435276031]], "qwen": [[11, ",", "normal", 0.10952530801296234]]}, "loss": {"rwkv": 34.0949413960087, "qwen": 39.88329698260418}, "topk": {"rwkv": [45, 2, 0.15095080435276031, [[46561, 0.470805, " method", false], [45, 0.150951, ",", false], [55532, 0.070964, " approach", false], [47202, 0.042612, " search", false], [21265, 0.029134, " and", false], [51832, 0.026085, " general", false], [53275, 0.015443, " version", false], [21400, 0.013708, " but", false], [47487, 0.011006, " system", false], [46, 0.009916, "-", false]]], "qwen": [11, 3, 0.10952530801296234, [[1714, 0.446108, " method", false], [5486, 0.126378, " approach", false], [11, 0.109525, ",", false], [12111, 0.029682, " algorithm", false], [323, 0.02904, " and", false], [2711, 0.021826, " search", false], [714, 0.018789, " but", false], [1849, 0.016111, " system", false], [2025, 0.013475, " program", false], [2319, 0.012094, " version", false]]]}, "raw_delta": -0.32097458839416504, "tuned_delta": -0.3136374498804623}, {"byte_start": 1719, "byte_end": 1726, "display": {"text": " search", "kind": "normal"}, "is_word": true, "word_id": 289, "word_key": " search", "bytes_hex": "20 73 65 61 72 63 68", "compression": {"rwkv": "11.75% 11.75% 11.75% 11.75% 11.75% 11.75% 11.75%", "qwen": "12.96% 12.96% 12.96% 12.96% 12.96% 12.96% 12.96%"}, "model_tokens": {"rwkv": [[47202, " search", "normal", 0.010601676069200039]], "qwen": [[2711, " search", "normal", 0.0065371133387088776]]}, "loss": {"rwkv": 11.754100221528384, "qwen": 12.95916177251648}, "topk": {"rwkv": [47202, 13, 0.010601676069200039, [[31458, 0.19792, " more", false], [51832, 0.082319, " general", false], [38720, 0.079051, " human", false], [31277, 0.064862, " less", false], [21400, 0.06311, " but", false], [45961, 0.053792, " faster", false], [45683, 0.022779, " deeper", false], [45301, 0.020685, " better", false], [37920, 0.019007, " brute", false], [52873, 0.015728, " shallow", false]]], "qwen": [2711, 21, 0.0065371133387088776, [[2686, 0.149039, " less", false], [803, 0.129059, " more", false], [3738, 0.076043, " human", false], [714, 0.072923, " but", false], [10596, 0.04321, " faster", false], [25600, 0.020209, " shallow", false], [19117, 0.019998, " deeper", false], [4586, 0.017421, " general", false], [5538, 0.015501, " deep", false], [2477, 0.013525, " non", false]]]}, "raw_delta": -0.06682280131748741, "tuned_delta": -0.05948566280378467}, {"byte_start": 1726, "byte_end": 1732, "display": {"text": "-based", "kind": "normal"}, "is_word": true, "word_id": 290, "word_key": "-based", "bytes_hex": "2d 62 61 73 65 64", "compression": {"rwkv": "0.63% 0.53% 0.53% 0.53% 0.53% 0.53%", "qwen": "3.60% 3.60% 3.60% 3.60% 3.60% 3.60%"}, "model_tokens": {"rwkv": [[46, "-", "normal", 0.965585470199585], [34011, "based", "normal", 0.8625272512435913]], "qwen": [[5980, "-based", "normal", 0.3017718195915222]]}, "loss": {"rwkv": 0.5481431048299437, "qwen": 3.600979193114894}, "topk": {"rwkv": [46, 1, 0.965585470199585, [[46, 0.965585, "-", false], [46561, 0.007734, " method", false], [37810, 0.00646, " based", false], [26127, 0.002765, "less", false], [35003, 0.001772, "light", false], [34011, 0.001384, "based", false], [45862, 0.00137, " engine", false], [55532, 0.001157, " approach", false], [24381, 0.001043, "able", false], [32298, 0.000818, " tree", false]]], "qwen": [5980, 1, 0.3017718195915222, [[5980, 0.301772, "-based", false], [1717, 0.245659, "less", false], [12577, 0.082205, "-free", false], [54909, 0.076161, "-less", false], [12, 0.033105, "-", false], [2852, 0.026122, "-l", false], [3419, 0.017647, "-in", false], [6810, 0.01748, "-de", false], [17709, 0.015087, "-light", false], [18376, 0.013742, "-exp", false]]]}, "raw_delta": -0.16928517818450928, "tuned_delta": -0.16194803967080654}, {"byte_start": 1732, "byte_end": 1741, "display": {"text": " approach", "kind": "normal"}, "is_word": true, "word_id": 291, "word_key": " approach", "bytes_hex": "20 61 70 70 72 6f 61 63 68", "compression": {"rwkv": "3.22% 3.22% 3.22% 3.22% 3.22% 3.22% 3.22% 3.22% 3.22%", "qwen": "2.77% 2.77% 2.77% 2.77% 2.77% 2.77% 2.77% 2.77% 2.77%"}, "model_tokens": {"rwkv": [[55532, " approach", "normal", 0.20019187033176422]], "qwen": [[5486, " approach", "normal", 0.2512800395488739]]}, "loss": {"rwkv": 3.2247740714314936, "qwen": 2.7675443399547306}, "topk": {"rwkv": [55532, 2, 0.20019187033176422, [[46561, 0.57882, " method", false], [55532, 0.200192, " approach", false], [47487, 0.032087, " system", false], [45, 0.027005, ",", false], [57260, 0.021796, " solution", false], [52580, 0.018966, " program", false], [38013, 0.014693, " chess", false], [55809, 0.012788, " computer", false], [3609, 0.012454, " AI", false], [59113, 0.005877, " algorithm", false]]], "qwen": [5486, 2, 0.2512800395488739, [[1714, 0.624797, " method", false], [5486, 0.25128, " approach", false], [1849, 0.044035, " system", false], [2025, 0.013728, " program", false], [11, 0.01117, ",", false], [14762, 0.006686, " technique", false], [12111, 0.005863, " algorithm", false], [6291, 0.003235, " solution", false], [8282, 0.003155, " strategy", false], [6366, 0.002419, " computer", false]]]}, "raw_delta": 0.025354199939303934, "tuned_delta": 0.032691338453006674}, {"byte_start": 1741, "byte_end": 1746, "display": {"text": " with", "kind": "normal"}, "is_word": true, "word_id": 292, "word_key": " with", "bytes_hex": "20 77 69 74 68", "compression": {"rwkv": "20.40% 20.40% 20.40% 20.40% 20.40%", "qwen": "19.36% 19.36% 19.36% 19.36% 19.36%"}, "model_tokens": {"rwkv": [[32487, " with", "normal", 0.0034536058083176613]], "qwen": [[448, " with", "normal", 0.004661415237933397]]}, "loss": {"rwkv": 20.400609562570498, "qwen": 19.36253948022767}, "topk": {"rwkv": [32487, 39, 0.0034536058083176613, [[22748, 0.162406, " was", false], [22777, 0.079652, " won", false], [30256, 0.079456, " beat", false], [55934, 0.072724, " defeated", false], [4811, 0.050523, " to", false], [45, 0.039458, ",", false], [51744, 0.039419, " finally", false], [61959, 0.036292, " eventually", false], [32227, 0.026896, " that", false], [30383, 0.017874, " came", false]]], "qwen": [448, 36, 0.004661415237933397, [[572, 0.184156, " was", false], [2765, 0.070575, " won", false], [23283, 0.055593, " defeated", false], [374, 0.041249, " is", false], [9583, 0.028863, " eventually", false], [429, 0.026253, " that", false], [6116, 0.026081, " became", false], [29701, 0.020218, " dominated", false], [11, 0.01994, ",", false], [14816, 0.019933, " wins", false]]]}, "raw_delta": 0.057562828063964844, "tuned_delta": 0.06489996657766758}, {"byte_start": 1746, "byte_end": 1754, "display": {"text": " special", "kind": "normal"}, "is_word": true, "word_id": 293, "word_key": " special", "bytes_hex": "20 73 70 65 63 69 61 6c", "compression": {"rwkv": "16.20% 16.20% 16.20% 16.20% 16.20% 16.20% 16.20% 16.20%", "qwen": "20.77% 20.77% 20.77% 20.77% 20.77% 20.77% 20.77% 20.77%"}, "model_tokens": {"rwkv": [[52964, " special", "normal", 0.0007525916444137692]], "qwen": [[3281, " special", "normal", 9.964989294530824e-05]]}, "loss": {"rwkv": 16.202141572483473, "qwen": 20.769957783736956}, "topk": {"rwkv": [52964, 141, 0.0007525916444137692, [[332, 0.197732, " a", false], [22590, 0.044761, " the", false], [30597, 0.043978, " deep", false], [31277, 0.037738, " less", false], [38720, 0.028309, " human", false], [31466, 0.025724, " much", false], [52906, 0.025454, " similar", false], [4692, 0.019758, " no", false], [38475, 0.019744, " fewer", false], [31458, 0.019387, " more", false]]], "qwen": [3281, 456, 9.964989294530824e-05, [[264, 0.162726, " a", false], [2686, 0.070888, " less", false], [279, 0.054744, " the", false], [16745, 0.040869, " fewer", false], [902, 0.036982, " no", false], [2664, 0.029638, " better", false], [29039, 0.028325, " comparable", false], [1172, 0.027494, " only", false], [4428, 0.02705, " similar", false], [1753, 0.022012, " much", false]]]}, "raw_delta": -0.253293514251709, "tuned_delta": -0.24595637573800624}, {"byte_start": 1754, "byte_end": 1763, "display": {"text": " hardware", "kind": "normal"}, "is_word": true, "word_id": 294, "word_key": " hardware", "bytes_hex": "20 68 61 72 64 77 61 72 65", "compression": {"rwkv": "8.58% 8.58% 8.58% 8.58% 8.58% 8.58% 8.58% 8.58% 8.58%", "qwen": "12.55% 12.55% 12.55% 12.55% 12.55% 12.55% 12.55% 12.55% 12.55%"}, "model_tokens": {"rwkv": [[56353, " hardware", "normal", 0.013823731802403927]], "qwen": [[11773, " hardware", "normal", 0.0019082442158833146]]}, "loss": {"rwkv": 8.578525199730382, "qwen": 12.546581535334132}, "topk": {"rwkv": [56353, 12, 0.013823731802403927, [[46, 0.182535, "-", false], [62586, 0.063041, " structures", false], [60572, 0.061316, " structure", false], [52224, 0.055758, " methods", false], [59943, 0.050734, " knowledge", false], [39558, 0.032187, " rules", false], [59792, 0.031583, " heuristic", false], [62633, 0.026017, " techniques", false], [56215, 0.021656, " features", false], [61559, 0.014752, " algorithms", false]]], "qwen": [11773, 41, 0.0019082442158833146, [[58238, 0.186541, "-purpose", false], [6540, 0.087972, " knowledge", false], [32719, 0.080224, " chess", false], [7428, 0.069225, " purpose", false], [5944, 0.042278, " structure", false], [5601, 0.032705, " rules", false], [566, 0.03113, " he", false], [3738, 0.030087, " human", false], [38485, 0.026627, "-case", false], [5413, 0.023169, " methods", false]]]}, "raw_delta": -0.22003576490614152, "tuned_delta": -0.21269862639243878}, {"byte_start": 1763, "byte_end": 1767, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 295, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"rwkv": "15.00% 15.00% 15.00% 15.00%", "qwen": "16.46% 16.46% 16.46% 16.46%"}, "model_tokens": {"rwkv": [[21265, " and", "normal", 0.035736218094825745]], "qwen": [[323, " and", "normal", 0.025942524895071983]]}, "loss": {"rwkv": 15.004591977995565, "qwen": 16.464178638904322}, "topk": {"rwkv": [21265, 7, 0.035736218094825745, [[22748, 0.166658, " was", false], [22777, 0.155209, " won", false], [55934, 0.084613, " defeated", false], [275, 0.045936, " (", false], [45, 0.044431, ",", false], [51744, 0.03621, " finally", false], [21265, 0.035736, " and", false], [30256, 0.026896, " beat", false], [61959, 0.024916, " eventually", false], [4811, 0.018971, " to", false]]], "qwen": [323, 7, 0.025942524895071983, [[572, 0.161828, " was", false], [6116, 0.055485, " became", false], [320, 0.053677, " (", false], [311, 0.04978, " to", false], [369, 0.043006, " for", false], [11, 0.026602, ",", false], [323, 0.025943, " and", false], [374, 0.025237, " is", false], [6519, 0.022702, " turned", false], [9583, 0.019155, " eventually", false]]]}, "raw_delta": -0.08093667030334473, "tuned_delta": -0.07359953178964199}, {"byte_start": 1767, "byte_end": 1776, "display": {"text": " software", "kind": "normal"}, "is_word": true, "word_id": 296, "word_key": " software", "bytes_hex": "20 73 6f 66 74 77 61 72 65", "compression": {"rwkv": "3.90% 3.90% 3.90% 3.90% 3.90% 3.90% 3.90% 3.90% 3.90%", "qwen": "3.74% 3.74% 3.74% 3.74% 3.74% 3.74% 3.74% 3.74% 3.74%"}, "model_tokens": {"rwkv": [[57257, " software", "normal", 0.1439296007156372]], "qwen": [[3162, " software", "normal", 0.1549476981163025]]}, "loss": {"rwkv": 3.897906523235154, "qwen": 3.73631496859156}, "topk": {"rwkv": [57257, 1, 0.1439296007156372, [[57257, 0.14393, " software", false], [332, 0.094777, " a", false], [52195, 0.04578, " massive", false], [38720, 0.027167, " human", false], [52964, 0.021364, " special", false], [59988, 0.020274, " massively", false], [4419, 0.016993, " an", false], [30597, 0.01431, " deep", false], [57453, 0.012993, " training", false], [31044, 0.012632, " hand", false]]], "qwen": [3162, 1, 0.1549476981163025, [[3162, 0.154948, " software", false], [264, 0.118348, " a", false], [25185, 0.044363, " algorithms", false], [12538, 0.024099, " techniques", false], [3281, 0.020289, " special", false], [2711, 0.019608, " search", false], [15473, 0.017461, " programming", false], [458, 0.016747, " an", false], [27699, 0.015374, " clever", false], [27076, 0.012723, " specialized", false]]]}, "raw_delta": 0.008960538440280497, "tuned_delta": 0.016297676953983233}, {"byte_start": 1776, "byte_end": 1783, "display": {"text": " proved", "kind": "normal"}, "is_word": true, "word_id": 297, "word_key": " proved", "bytes_hex": "20 70 72 6f 76 65 64", "compression": {"rwkv": "12.96% 12.96% 12.96% 12.96% 12.96% 12.96% 12.96%", "qwen": "11.02% 11.02% 11.02% 11.02% 11.02% 11.02% 11.02%"}, "model_tokens": {"rwkv": [[46936, " proved", "normal", 0.006560480687767267]], "qwen": [[18651, " proved", "normal", 0.01385732926428318]]}, "loss": {"rwkv": 12.96171325798678, "qwen": 11.023584256828508}, "topk": {"rwkv": [46936, 22, 0.006560480687767267, [[22748, 0.189994, " was", false], [22777, 0.128222, " won", false], [55934, 0.081535, " defeated", false], [45, 0.048328, ",", false], [30256, 0.034962, " beat", false], [275, 0.034174, " (", false], [32227, 0.033626, " that", false], [51744, 0.025537, " finally", false], [61959, 0.022438, " eventually", false], [45283, 0.017992, " became", false]]], "qwen": [18651, 13, 0.01385732926428318, [[572, 0.160549, " was", false], [311, 0.048153, " to", false], [6116, 0.041038, " became", false], [6519, 0.034666, " turned", false], [369, 0.02844, " for", false], [320, 0.025774, " (", false], [1824, 0.019725, " support", false], [374, 0.01963, " is", false], [3697, 0.019219, " came", false], [11, 0.019093, ",", false]]]}, "raw_delta": 0.10747269221714562, "tuned_delta": 0.11480983073084836}, {"byte_start": 1783, "byte_end": 1790, "display": {"text": " vastly", "kind": "normal"}, "is_word": true, "word_id": 298, "word_key": " vastly", "bytes_hex": "20 76 61 73 74 6c 79", "compression": {"rwkv": "12.08% 12.08% 12.08% 12.08% 12.08% 12.08% 12.08%", "qwen": "16.44% 16.44% 16.44% 16.44% 16.44% 16.44% 16.44%"}, "model_tokens": {"rwkv": [[47708, " vastly", "normal", 0.009170375764369965]], "qwen": [[52008, " vastly", "normal", 0.0016954494640231133]]}, "loss": {"rwkv": 12.076130364583953, "qwen": 16.43592250359131}, "topk": {"rwkv": [47708, 18, 0.009170375764369965, [[4811, 0.283178, " to", false], [57350, 0.102654, " superior", false], [51127, 0.055229, " capable", false], [31458, 0.047023, " more", false], [62603, 0.04064, " successful", false], [32227, 0.037056, " that", false], [59593, 0.027314, " effective", false], [32393, 0.024783, " vict", false], [46342, 0.024625, " itself", false], [30093, 0.019693, " able", false]]], "qwen": [52008, 58, 0.0016954494640231133, [[311, 0.251034, " to", false], [6849, 0.098068, " successful", false], [16353, 0.072676, " superior", false], [14680, 0.052867, " competitive", false], [803, 0.036943, " more", false], [14016, 0.031679, " sufficient", false], [73710, 0.03152, " victorious", false], [18308, 0.025031, " equally", false], [438, 0.024942, " as", false], [7373, 0.024878, " effective", false]]]}, "raw_delta": -0.2417582103184292, "tuned_delta": -0.23442107180472646}, {"byte_start": 1790, "byte_end": 1795, "display": {"text": " more", "kind": "normal"}, "is_word": true, "word_id": 299, "word_key": " more", "bytes_hex": "20 6d 6f 72 65", "compression": {"rwkv": "3.49% 3.49% 3.49% 3.49% 3.49%", "qwen": "6.16% 6.16% 6.16% 6.16% 6.16%"}, "model_tokens": {"rwkv": [[31458, " more", "normal", 0.38035309314727783]], "qwen": [[803, " more", "normal", 0.1812962144613266]]}, "loss": {"rwkv": 3.494027052152958, "qwen": 6.158948102240927}, "topk": {"rwkv": [31458, 2, 0.38035309314727783, [[57350, 0.443022, " superior", false], [31458, 0.380353, " more", false], [45301, 0.1049, " better", false], [45961, 0.023988, " faster", false], [57326, 0.012291, " stronger", false], [22249, 0.005137, " out", false], [59593, 0.004061, " effective", false], [62603, 0.002644, " successful", false], [56445, 0.001992, " inferior", false], [31277, 0.001528, " less", false]]], "qwen": [803, 2, 0.1812962144613266, [[16353, 0.660181, " superior", false], [803, 0.181296, " more", false], [37179, 0.058894, " inferior", false], [700, 0.024377, " out", false], [2664, 0.023047, " better", false], [6849, 0.009693, " successful", false], [2686, 0.005975, " less", false], [10596, 0.005228, " faster", false], [7373, 0.003773, " effective", false], [8661, 0.00299, " easier", false]]]}, "raw_delta": -0.147774600982666, "tuned_delta": -0.14043746246896327}, {"byte_start": 1795, "byte_end": 1805, "display": {"text": " effective", "kind": "normal"}, "is_word": true, "word_id": 300, "word_key": " effective", "bytes_hex": "20 65 66 66 65 63 74 69 76 65", "compression": {"rwkv": "1.26% 1.26% 1.26% 1.26% 1.26% 1.26% 1.26% 1.26% 1.26% 1.26%", "qwen": "1.37% 1.37% 1.37% 1.37% 1.37% 1.37% 1.37% 1.37% 1.37% 1.37%"}, "model_tokens": {"rwkv": [[59593, " effective", "normal", 0.49625787138938904]], "qwen": [[7373, " effective", "normal", 0.46875810623168945]]}, "loss": {"rwkv": 1.260949278901975, "qwen": 1.3663556183001244}, "topk": {"rwkv": [59593, 1, 0.49625787138938904, [[59593, 0.496258, " effective", false], [56900, 0.264037, " powerful", false], [62603, 0.088721, " successful", false], [51127, 0.045243, " capable", false], [59594, 0.034338, " efficient", false], [63362, 0.008855, " competitive", false], [47129, 0.006128, " robust", false], [55435, 0.005984, " accurate", false], [46876, 0.004087, " potent", false], [59330, 0.003486, " competent", false]]], "qwen": [7373, 1, 0.46875810623168945, [[7373, 0.468758, " effective", false], [6849, 0.270519, " successful", false], [7988, 0.08256, " powerful", false], [11050, 0.06984, " efficient", false], [14976, 0.015863, " practical", false], [14680, 0.00762, " competitive", false], [5390, 0.006265, " useful", false], [5411, 0.005939, " popular", false], [12875, 0.005797, " capable", false], [5000, 0.004134, " difficult", false]]]}, "raw_delta": -0.005844968557357791, "tuned_delta": 0.0014921699563449457}, {"byte_start": 1805, "byte_end": 1806, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "14.16%", "qwen": "11.38%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.4507598280906677]], "qwen": [[11, ",", "normal", 0.5320721864700317]]}, "loss": {"rwkv": 14.159262852474688, "qwen": 11.378826860216636}, "topk": {"rwkv": [45, 1, 0.4507598280906677, [[45, 0.45076, ",", false], [32226, 0.355843, " than", false], [4596, 0.073934, " in", false], [4424, 0.037503, " at", false], [275, 0.014372, " (", false], [50870, 0.013329, " against", false], [21265, 0.008108, " and", false], [21700, 0.006374, " for", false], [4712, 0.00494, " on", false], [32227, 0.004001, " that", false]]], "qwen": [11, 1, 0.5320721864700317, [[11, 0.532072, ",", false], [1091, 0.212294, " than", false], [304, 0.092278, " in", false], [518, 0.045037, " at", false], [320, 0.022672, " (", false], [369, 0.015273, " for", false], [2348, 0.008727, " against", false], [323, 0.006842, " and", false], [1283, 0.005439, " after", false], [389, 0.004736, " on", false]]]}, "raw_delta": 0.154180109500885, "tuned_delta": 0.16151724801458775}, {"byte_start": 1806, "byte_end": 1812, "display": {"text": " these", "kind": "normal"}, "is_word": true, "word_id": 301, "word_key": " these", "bytes_hex": "20 74 68 65 73 65", "compression": {"rwkv": "9.72% 9.72% 9.72% 9.72% 9.72% 9.72%", "qwen": "10.84% 10.84% 10.84% 10.84% 10.84% 10.84%"}, "model_tokens": {"rwkv": [[39936, " these", "normal", 0.039762143045663834]], "qwen": [[1493, " these", "normal", 0.02717256359755993]]}, "loss": {"rwkv": 9.721284943490085, "qwen": 10.836886238030623}, "topk": {"rwkv": [39936, 6, 0.039762143045663834, [[22590, 0.289744, " the", false], [4601, 0.125181, " it", false], [31370, 0.055867, " many", false], [39934, 0.0436, " there", false], [32232, 0.042891, " they", false], [39936, 0.039762, " these", false], [32234, 0.036736, " this", false], [39944, 0.035561, " those", false], [332, 0.025154, " a", false], [32074, 0.021639, " some", false]]], "qwen": [1493, 8, 0.02717256359755993, [[279, 0.257182, " the", false], [432, 0.19001, " it", false], [1657, 0.046408, " many", false], [807, 0.03432, " they", false], [264, 0.033781, " a", false], [419, 0.031577, " this", false], [1052, 0.028688, " there", false], [1493, 0.027173, " these", false], [1429, 0.02651, " most", false], [11811, 0.023335, " researchers", false]]]}, "raw_delta": -0.061862071355183956, "tuned_delta": -0.054524932841481216}, {"byte_start": 1812, "byte_end": 1818, "display": {"text": " human", "kind": "normal"}, "is_word": true, "word_id": 302, "word_key": " human", "bytes_hex": "20 68 75 6d 61 6e", "compression": {"rwkv": "11.74% 11.74% 11.74% 11.74% 11.74% 11.74%", "qwen": "15.86% 15.86% 15.86% 15.86% 15.86% 15.86%"}, "model_tokens": {"rwkv": [[38720, " human", "normal", 0.020059790462255478]], "qwen": [[3738, " human", "normal", 0.0051124123856425285]]}, "loss": {"rwkv": 11.740682298901067, "qwen": 15.857875301118847}, "topk": {"rwkv": [38720, 5, 0.020059790462255478, [[63843, 0.3559, " researchers", false], [52224, 0.207911, " methods", false], [61590, 0.033713, " approaches", false], [31937, 0.031906, " same", false], [38720, 0.02006, " human", false], [46787, 0.014991, " people", false], [39193, 0.013989, " other", false], [32462, 0.012697, " were", false], [51551, 0.011838, " earlier", false], [47202, 0.010468, " search", false]]], "qwen": [3738, 6, 0.0051124123856425285, [[11811, 0.839768, " researchers", false], [1852, 0.028461, " same", false], [5413, 0.018997, " methods", false], [1251, 0.010135, " people", false], [6366, 0.009566, " computer", false], [3738, 0.005112, " human", false], [3412, 0.004544, " research", false], [11647, 0.003293, " experts", false], [1033, 0.00309, " were", false], [803, 0.002939, " more", false]]]}, "raw_delta": -0.2283056577046713, "tuned_delta": -0.22096851919096855}, {"byte_start": 1818, "byte_end": 1828, "display": {"text": "-knowledge", "kind": "normal"}, "is_word": true, "word_id": 303, "word_key": "-knowledge", "bytes_hex": "2d 6b 6e 6f 77 6c 65 64 67 65", "compression": {"rwkv": "3.54% 0.98% 0.98% 0.98% 0.98% 0.98% 0.98% 0.98% 0.98% 0.98%", "qwen": "9.30% 9.30% 0.00% 0.00% 0.00% 0.00% 0.00% 0.00% 0.00% 0.00%"}, "model_tokens": {"rwkv": [[46, "-", "normal", 0.8196974992752075], [58313, "knowledge", "normal", 0.6092947721481323]], "qwen": [[12646, "-k", "normal", 0.3563463091850281], [51186, "nowledge", "normal", 0.9994348883628845]]}, "loss": {"rwkv": 1.238054948419118, "qwen": 1.8618295005851109}, "topk": {"rwkv": [46, 1, 0.8196974992752075, [[46, 0.819697, "-", false], [38013, 0.032698, " chess", false], [25971, 0.022212, "ists", false], [52224, 0.021739, " methods", false], [51685, 0.020463, " experts", false], [61590, 0.010254, " approaches", false], [63843, 0.007661, " researchers", false], [47202, 0.006432, " search", false], [7919, 0.005843, "ist", false], [59943, 0.005747, " knowledge", false]]], "qwen": [12646, 1, 0.3563463091850281, [[12646, 0.356346, "-k", false], [71107, 0.225456, "-under", false], [12, 0.107033, "-", false], [8660, 0.059608, " understanding", false], [5980, 0.023717, "-based", false], [6540, 0.023538, " knowledge", false], [35085, 0.017064, "-oriented", false], [18376, 0.013196, "-exp", false], [3419, 0.010298, "-in", false], [51273, 0.009458, "-focused", false]]]}, "raw_delta": -0.03458940577111204, "tuned_delta": -0.027252267257409302}, {"byte_start": 1828, "byte_end": 1834, "display": {"text": "-based", "kind": "normal"}, "is_word": true, "word_id": 304, "word_key": "-based", "bytes_hex": "2d 62 61 73 65 64", "compression": {"rwkv": "29.59% 1.58% 1.58% 1.58% 1.58% 1.58%", "qwen": "6.90% 6.90% 6.90% 6.90% 6.90% 6.90%"}, "model_tokens": {"rwkv": [[46, "-", "normal", 0.19292104244232178], [34011, "based", "normal", 0.6487024426460266]], "qwen": [[5980, "-based", "normal", 0.10055873543024063]]}, "loss": {"rwkv": 6.246042983015367, "qwen": 6.903936816493413}, "topk": {"rwkv": [46, 3, 0.19292104244232178, [[52224, 0.277321, " methods", false], [61590, 0.22435, " approaches", false], [46, 0.192921, "-", false], [63843, 0.142646, " researchers", false], [37810, 0.054862, " based", false], [56777, 0.009565, " oriented", false], [38013, 0.008441, " chess", false], [51685, 0.006303, " experts", false], [63533, 0.003975, " enthusiasts", false], [59099, 0.003356, " advocates", false]]], "qwen": [5980, 3, 0.10055873543024063, [[11811, 0.458921, " researchers", false], [5413, 0.179589, " methods", false], [5980, 0.100559, "-based", false], [19827, 0.086535, " approaches", false], [3118, 0.018875, " based", false], [35085, 0.01782, "-oriented", false], [34316, 0.010812, " specialists", false], [11647, 0.009548, " experts", false], [1251, 0.007044, " people", false], [3412, 0.005827, " research", false]]]}, "raw_delta": -0.03648138046264654, "tuned_delta": -0.029144241948943803}, {"byte_start": 1834, "byte_end": 1840, "display": {"text": " chess", "kind": "normal"}, "is_word": true, "word_id": 305, "word_key": " chess", "bytes_hex": "20 63 68 65 73 73", "compression": {"rwkv": "10.61% 10.61% 10.61% 10.61% 10.61% 10.61%", "qwen": "18.40% 18.40% 18.40% 18.40% 18.40% 18.40%"}, "model_tokens": {"rwkv": [[38013, " chess", "normal", 0.029647238552570343]], "qwen": [[32719, " chess", "normal", 0.0021924730390310287]]}, "loss": {"rwkv": 10.613576798206566, "qwen": 18.40255210111632}, "topk": {"rwkv": [38013, 4, 0.029647238552570343, [[52224, 0.408024, " methods", false], [63843, 0.271433, " researchers", false], [61590, 0.197577, " approaches", false], [38013, 0.029647, " chess", false], [47202, 0.006844, " search", false], [55809, 0.005887, " computer", false], [57103, 0.005309, " research", false], [51685, 0.005099, " experts", false], [3609, 0.004379, " AI", false], [51566, 0.003511, " efforts", false]]], "qwen": [32719, 9, 0.0021924730390310287, [[11811, 0.666725, " researchers", false], [5413, 0.185187, " methods", false], [19827, 0.078376, " approaches", false], [3412, 0.008964, " research", false], [6366, 0.004887, " computer", false], [8869, 0.004315, " efforts", false], [11647, 0.003867, " experts", false], [1714, 0.002293, " method", false], [32719, 0.002192, " chess", false], [12538, 0.002084, " techniques", false]]]}, "raw_delta": -0.4319125016530356, "tuned_delta": -0.42457536313933286}, {"byte_start": 1840, "byte_end": 1852, "display": {"text": " researchers", "kind": "normal"}, "is_word": true, "word_id": 306, "word_key": " researchers", "bytes_hex": "20 72 65 73 65 61 72 63 68 65 72 73", "compression": {"rwkv": "0.58% 0.58% 0.58% 0.58% 0.58% 0.58% 0.58% 0.58% 0.58% 0.58% 0.58% 0.58%", "qwen": "0.99% 0.99% 0.99% 0.99% 0.99% 0.99% 0.99% 0.99% 0.99% 0.99% 0.99% 0.99%"}, "model_tokens": {"rwkv": [[63843, " researchers", "normal", 0.678986668586731]], "qwen": [[11811, " researchers", "normal", 0.5165534615516663]]}, "loss": {"rwkv": 0.5840989443703283, "qwen": 0.9927191530532772}, "topk": {"rwkv": [63843, 1, 0.678986668586731, [[63843, 0.678987, " researchers", false], [52224, 0.089169, " methods", false], [51685, 0.050594, " experts", false], [46, 0.041831, "-", false], [61590, 0.02322, " approaches", false], [52489, 0.016024, " players", false], [3609, 0.015904, " AI", false], [56949, 0.013566, " programs", false], [57103, 0.008387, " research", false], [63874, 0.004643, " specialists", false]]], "qwen": [11811, 1, 0.5165534615516663, [[11811, 0.516553, " researchers", false], [7468, 0.102095, " programs", false], [5413, 0.096953, " methods", false], [54846, 0.035029, " programmers", false], [4217, 0.031163, " players", false], [72085, 0.028395, "-playing", false], [11647, 0.023772, " experts", false], [3412, 0.019797, " research", false], [5942, 0.016329, " systems", false], [19827, 0.013321, " approaches", false]]]}, "raw_delta": -0.022658715645472217, "tuned_delta": -0.01532157713176948}, {"byte_start": 1852, "byte_end": 1857, "display": {"text": " were", "kind": "normal"}, "is_word": true, "word_id": 307, "word_key": " were", "bytes_hex": "20 77 65 72 65", "compression": {"rwkv": "4.82% 4.82% 4.82% 4.82% 4.82%", "qwen": "4.53% 4.53% 4.53% 4.53% 4.53%"}, "model_tokens": {"rwkv": [[32462, " were", "normal", 0.26230260729789734]], "qwen": [[1033, " were", "normal", 0.2846704423427582]]}, "loss": {"rwkv": 4.818376015468999, "qwen": 4.531588495805858}, "topk": {"rwkv": [32462, 1, 0.26230260729789734, [[32462, 0.262303, " were", false], [21795, 0.049061, " had", false], [45, 0.024452, ",", false], [21532, 0.020609, " did", false], [38547, 0.019982, " found", false], [30840, 0.017043, " felt", false], [31334, 0.016069, " lost", false], [40, 0.013418, "'", false], [60419, 0.012279, " retreated", false], [46471, 0.01164, " looked", false]]], "qwen": [1033, 1, 0.2846704423427582, [[1033, 0.28467, " were", false], [1030, 0.053464, " had", false], [11, 0.023811, ",", false], [6476, 0.022545, " felt", false], [5558, 0.019401, " lost", false], [6966, 0.015394, " looked", false], [22978, 0.014257, " abandoned", false], [6116, 0.014051, " became", false], [6157, 0.013707, " quickly", false], [1730, 0.013475, " found", false]]]}, "raw_delta": 0.01590287685394287, "tuned_delta": 0.023240015367645608}, {"byte_start": 1857, "byte_end": 1861, "display": {"text": " not", "kind": "normal"}, "is_word": true, "word_id": 308, "word_key": " not", "bytes_hex": "20 6e 6f 74", "compression": {"rwkv": "14.72% 14.72% 14.72% 14.72%", "qwen": "15.12% 15.12% 15.12% 15.12%"}, "model_tokens": {"rwkv": [[22187, " not", "normal", 0.03844701126217842]], "qwen": [[537, " not", "normal", 0.03495302423834801]]}, "loss": {"rwkv": 14.722815602821939, "qwen": 15.120121323712658}, "topk": {"rwkv": [22187, 4, 0.03844701126217842, [[32053, 0.115585, " slow", false], [46021, 0.061815, " forced", false], [31269, 0.058035, " left", false], [22187, 0.038447, " not", false], [47650, 0.019068, " unable", false], [62683, 0.018966, " understand", false], [39418, 0.018857, " quick", false], [45, 0.017145, ",", false], [37694, 0.012344, " among", false], [60601, 0.012065, " surprised", false]]], "qwen": [537, 3, 0.03495302423834801, [[26620, 0.055359, " shocked", false], [71982, 0.038058, " dismay", false], [537, 0.034953, " not", false], [14453, 0.031572, " surprised", false], [2115, 0.028282, " left", false], [9575, 0.022694, " forced", false], [46926, 0.021046, " stunned", false], [86998, 0.019709, " understandably", false], [11889, 0.015698, " unable", false], [3974, 0.015696, " quick", false]]]}, "raw_delta": -0.022031307220458984, "tuned_delta": -0.014694168706756248}, {"byte_start": 1861, "byte_end": 1866, "display": {"text": " good", "kind": "normal"}, "is_word": true, "word_id": 309, "word_key": " good", "bytes_hex": "20 67 6f 6f 64", "compression": {"rwkv": "30.66% 30.66% 30.66% 30.66% 30.66%", "qwen": "29.23% 29.23% 29.23% 29.23% 29.23%"}, "model_tokens": {"rwkv": [[30992, " good", "normal", 0.0002091236092383042]], "qwen": [[1661, " good", "normal", 0.0003018275019712746]]}, "loss": {"rwkv": 30.657269618890467, "qwen": 29.234969656602026}, "topk": {"rwkv": [30992, 300, 0.0002091236092383042, [[31581, 0.078475, " only", false], [39418, 0.074228, " quick", false], [30093, 0.058538, " able", false], [56914, 0.056739, " prepared", false], [53350, 0.045678, " willing", false], [32053, 0.036148, " slow", false], [60601, 0.032818, " surprised", false], [39449, 0.024514, " ready", false], [56426, 0.020271, " inclined", false], [4424, 0.020194, " at", false]]], "qwen": [1661, 234, 0.0003018275019712746, [[14453, 0.06331, " surprised", false], [24404, 0.051046, " impressed", false], [7945, 0.044645, " particularly", false], [518, 0.037477, " at", false], [2952, 0.037358, " able", false], [6247, 0.036072, " happy", false], [22166, 0.030846, " convinced", false], [279, 0.02569, " the", false], [8014, 0.024005, " interested", false], [1172, 0.023934, " only", false]]]}, "raw_delta": 0.07886905670166011, "tuned_delta": 0.08620619521536285}, {"byte_start": 1866, "byte_end": 1873, "display": {"text": " losers", "kind": "normal"}, "is_word": true, "word_id": 310, "word_key": " losers", "bytes_hex": "20 6c 6f 73 65 72 73", "compression": {"rwkv": "19.35% 19.35% 19.35% 19.35% 19.35% 19.35% 0.00%", "qwen": "23.81% 23.81% 23.81% 23.81% 23.81% 23.81% 23.81%"}, "model_tokens": {"rwkv": [[38935, " loser", "normal", 0.0016296644462272525], [116, "s", "normal", 0.9997296929359436]], "qwen": [[67356, " losers", "normal", 9.699879592517391e-05]]}, "loss": {"rwkv": 16.585250125545468, "qwen": 23.806560859563593}, "topk": {"rwkv": [38935, 16, 0.0016296644462272525, [[4424, 0.551741, " at", false], [45865, 0.286928, " enough", false], [37598, 0.039555, " about", false], [46, 0.016016, "-", false], [32487, 0.013266, " with", false], [61653, 0.007463, " candidates", false], [4811, 0.007277, " to", false], [57330, 0.006346, " students", false], [21700, 0.003933, " for", false], [4596, 0.003172, " in", false]]], "qwen": [67356, 199, 9.699879592517391e-05, [[518, 0.431798, " at", false], [3322, 0.350935, " enough", false], [4143, 0.015584, " students", false], [23562, 0.013815, " listeners", false], [4780, 0.010812, " friends", false], [11178, 0.01081, " candidates", false], [369, 0.010241, " for", false], [911, 0.008406, " about", false], [10030, 0.006562, " prepared", false], [448, 0.00574, " with", false]]]}, "raw_delta": -0.40043449401855463, "tuned_delta": -0.3930973555048519}, {"byte_start": 1873, "byte_end": 1874, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "5.11%", "qwen": "11.44%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.750744640827179]], "qwen": [[13, ".", "normal", 0.5303573608398438]]}, "loss": {"rwkv": 5.107196800021964, "qwen": 11.43704191264213}, "topk": {"rwkv": [47, 1, 0.750744640827179, [[47, 0.750745, ".", false], [45, 0.12418, ",", false], [21265, 0.02849, " and", false], [60, 0.01825, ";", false], [59, 0.010957, ":", false], [4596, 0.008942, " in", false], [275, 0.008228, " (", false], [4424, 0.007992, " at", false], [21400, 0.006351, " but", false], [4450, 0.003153, " by", false]]], "qwen": [13, 1, 0.5303573608398438, [[13, 0.530357, ".", false], [11, 0.106582, ",", false], [382, 0.087159, ".\n\n", false], [624, 0.053129, ".\n", false], [304, 0.035469, " in", false], [26, 0.029752, ";", false], [323, 0.027361, " and", false], [714, 0.024008, " but", false], [320, 0.017181, " (", false], [25, 0.0155, ":", false]]]}, "raw_delta": -0.35100114345550537, "tuned_delta": -0.34366400494180266}, {"byte_start": 1874, "byte_end": 1879, "display": {"text": " They", "kind": "normal"}, "is_word": true, "word_id": 311, "word_key": " they", "bytes_hex": "20 54 68 65 79", "compression": {"rwkv": "7.83% 7.83% 7.83% 7.83% 7.83%", "qwen": "7.04% 7.04% 7.04% 7.04% 7.04%"}, "model_tokens": {"rwkv": [[29893, " They", "normal", 0.11327960342168808]], "qwen": [[2379, " They", "normal", 0.14182904362678528]]}, "loss": {"rwkv": 7.833383229826793, "qwen": 7.044437756478033}, "topk": {"rwkv": [29893, 2, 0.11327960342168808, [[261, 0.265244, "\n\n", false], [29893, 0.11328, " They", false], [20996, 0.068138, " The", false], [267, 0.058135, "  ", false], [19555, 0.047465, " But", false], [3913, 0.034531, " In", false], [37449, 0.028259, " Their", false], [3918, 0.020147, " It", false], [19417, 0.013162, " And", false], [300, 0.011927, " A", false]]], "qwen": [2379, 1, 0.14182904362678528, [[2379, 0.141829, " They", false], [220, 0.131886, " ", false], [576, 0.082841, " The", false], [758, 0.04453, " In", false], [10964, 0.038897, " Their", false], [12090, 0.034402, " Instead", false], [1988, 0.029294, " But", false], [1084, 0.028173, " It", false], [320, 0.026805, " (", false], [1096, 0.018467, " This", false]]]}, "raw_delta": 0.04374842643737792, "tuned_delta": 0.05108556495108066}, {"byte_start": 1879, "byte_end": 1884, "display": {"text": " said", "kind": "normal"}, "is_word": true, "word_id": 312, "word_key": " said", "bytes_hex": "20 73 61 69 64", "compression": {"rwkv": "22.99% 22.99% 22.99% 22.99% 22.99%", "qwen": "24.38% 24.38% 24.38% 24.38% 24.38%"}, "model_tokens": {"rwkv": [[31929, " said", "normal", 0.001689327065832913]], "qwen": [[1053, " said", "normal", 0.0011602459708228707]]}, "loss": {"rwkv": 22.99295221416785, "qwen": 24.378384255590834}, "topk": {"rwkv": [31929, 96, 0.001689327065832913, [[32462, 0.122848, " were", false], [21795, 0.105217, " had", false], [21532, 0.055999, " did", false], [59392, 0.030125, " continued", false], [38128, 0.018687, " could", false], [39820, 0.017825, " still", false], [40013, 0.017681, " tried", false], [39762, 0.017126, " spent", false], [31334, 0.015271, " lost", false], [60158, 0.013023, " persisted", false]]], "qwen": [1053, 110, 0.0011602459708228707, [[1033, 0.182277, " were", false], [1030, 0.157047, " had", false], [1521, 0.037867, " did", false], [8570, 0.02375, " continued", false], [5558, 0.023589, " lost", false], [7391, 0.017444, " spent", false], [1410, 0.017068, " could", false], [1035, 0.013185, " would", false], [6476, 0.011364, " felt", false], [11585, 0.010578, " believed", false]]]}, "raw_delta": -0.07682466506958008, "tuned_delta": -0.06948752655587734}, {"byte_start": 1884, "byte_end": 1889, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 313, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"rwkv": "4.06% 4.06% 4.06% 4.06% 4.06%", "qwen": "4.76% 4.76% 4.76% 4.76% 4.76%"}, "model_tokens": {"rwkv": [[32227, " that", "normal", 0.321382611989975]], "qwen": [[429, " that", "normal", 0.26710042357444763]]}, "loss": {"rwkv": 4.057579802500209, "qwen": 4.761364626621232}, "topk": {"rwkv": [32227, 1, 0.321382611989975, [[32227, 0.321383, " that", false], [45, 0.111687, ",", false], [32232, 0.108608, " they", false], [22590, 0.093631, " the", false], [4601, 0.04436, " it", false], [47539, 0.0393, " things", false], [39931, 0.031534, " their", false], [269, 0.027369, " \"", false], [4788, 0.015758, " so", false], [38013, 0.01351, " chess", false]]], "qwen": [429, 1, 0.26710042357444763, [[429, 0.2671, " that", false], [11, 0.250771, ",", false], [330, 0.068366, " \"", false], [807, 0.055191, " they", false], [432, 0.050815, " it", false], [2513, 0.03838, " things", false], [4302, 0.036074, " nothing", false], [279, 0.033549, " the", false], [25, 0.031332, ":", false], [311, 0.012669, " to", false]]]}, "raw_delta": -0.03902611732482911, "tuned_delta": -0.03168897881112637}, {"byte_start": 1889, "byte_end": 1892, "display": {"text": " ``", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "20 60 60", "compression": {"rwkv": "65.00% 65.00% 65.00%", "qwen": "64.29% 64.29% 64.29%"}, "model_tokens": {"rwkv": [[4404, " ``", "normal", 1.9605748093454167e-05]], "qwen": [[9902, " ``", "normal", 2.2649990569334477e-05]]}, "loss": {"rwkv": 64.99641720671632, "qwen": 64.29221131173843}, "topk": {"rwkv": [4404, 745, 1.9605748093454167e-05, [[22590, 0.304712, " the", false], [39931, 0.111965, " their", false], [32232, 0.095369, " they", false], [47202, 0.066325, " search", false], [4601, 0.034731, " it", false], [32234, 0.03161, " this", false], [332, 0.024907, " a", false], [30597, 0.020345, " deep", false], [45, 0.018288, ",", false], [39934, 0.017122, " there", false]]], "qwen": [9902, 723, 2.2649990569334477e-05, [[279, 0.227069, " the", false], [807, 0.152814, " they", false], [862, 0.072788, " their", false], [432, 0.062657, " it", false], [32719, 0.034045, " chess", false], [2711, 0.031921, " search", false], [264, 0.027836, " a", false], [419, 0.02541, " this", false], [1052, 0.022813, " there", false], [11, 0.019629, ",", false]]]}, "raw_delta": 0.03904946645100882, "tuned_delta": 0.04638660496471156}, {"byte_start": 1892, "byte_end": 1897, "display": {"text": "brute", "kind": "normal"}, "is_word": true, "word_id": 314, "word_key": "brute", "bytes_hex": "62 72 75 74 65", "compression": {"rwkv": "46.02% 46.02% 46.02% 0.02% 0.02%", "qwen": "64.52% 64.52% 0.20% 0.20% 0.20%"}, "model_tokens": {"rwkv": [[7184, "bru", "normal", 0.0004696889081969857], [2206, "te", "normal", 0.9980928301811218]], "qwen": [[1323, "br", "normal", 0.0007809735834598541], [1070, "ute", "normal", 0.9664857387542725]]}, "loss": {"rwkv": 27.620964073049826, "qwen": 25.92904569975074}, "topk": {"rwkv": [7184, 194, 0.0004696889081969857, [[8801, 0.135322, "the", false], [25116, 0.074247, "deep", false], [34580, 0.047243, "human", false], [42233, 0.044004, "search", false], [24991, 0.027492, "ches", false], [2278, 0.023764, "we", false], [53865, 0.021072, "computer", false], [35755, 0.020009, "there", false], [2073, 0.019322, "no", false], [1956, 0.01864, "it", false]]], "qwen": [1323, 137, 0.0007809735834598541, [[1782, 0.152667, "the", false], [896, 0.046311, "we", false], [331, 0.044493, "ch", false], [25312, 0.034654, "human", false], [1836, 0.031319, "search", false], [18532, 0.030247, "there", false], [275, 0.030046, "it", false], [64, 0.024511, "a", false], [64947, 0.020238, "comput", false], [785, 0.015029, "The", false]]]}, "raw_delta": 0.0938198760151864, "tuned_delta": 0.10115701452888914}, {"byte_start": 1897, "byte_end": 1903, "display": {"text": " force", "kind": "normal"}, "is_word": true, "word_id": 315, "word_key": " force", "bytes_hex": "20 66 6f 72 63 65", "compression": {"rwkv": "1.15% 1.15% 1.15% 1.15% 1.15% 1.15%", "qwen": "0.64% 0.64% 0.64% 0.64% 0.64% 0.64%"}, "model_tokens": {"rwkv": [[38536, " force", "normal", 0.6817542314529419]], "qwen": [[5344, " force", "normal", 0.8073176741600037]]}, "loss": {"rwkv": 1.1505868652923046, "qwen": 0.6433158405242455}, "topk": {"rwkv": [38536, 1, 0.6817542314529419, [[38536, 0.681754, " force", false], [46, 0.275447, "-", false], [57319, 0.005979, " strength", false], [439, 0.004454, "''", false], [59346, 0.004219, " computing", false], [47202, 0.003735, " search", false], [63370, 0.002892, " computation", false], [39339, 0.002578, " power", false], [51779, 0.002002, " forcing", false], [34470, 0.00184, "force", false]]], "qwen": [5344, 1, 0.8073176741600037, [[5344, 0.807318, " force", false], [80049, 0.155477, "-force", false], [2355, 0.013885, " power", false], [8170, 0.005856, " strength", false], [2711, 0.002685, " search", false], [24231, 0.001879, " computing", false], [24913, 0.001521, " forcing", false], [34447, 0.001121, " computation", false], [15039, 0.000489, " searching", false], [19428, 0.000473, "-search", false]]]}, "raw_delta": 0.028129078447818753, "tuned_delta": 0.03546621696152149}, {"byte_start": 1903, "byte_end": 1904, "display": {"text": "\"", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "22", "compression": {"rwkv": "69.04%", "qwen": "60.17%"}, "model_tokens": {"rwkv": [[35, "\"", "normal", 0.021721690893173218]], "qwen": [[1, "\"", "normal", 0.0355585552752018]]}, "loss": {"rwkv": 69.03521191753828, "qwen": 60.17074454064671}, "topk": {"rwkv": [35, 3, 0.021721690893173218, [[439, 0.702859, "''", false], [4600, 0.06262, " is", false], [35, 0.021722, "\"", false], [22748, 0.015737, " was", false], [47202, 0.014293, " search", false], [32475, 0.01262, " will", false], [5341, 0.011799, ",''", false], [32481, 0.010871, " wins", false], [40, 0.010127, "'", false], [1732, 0.007694, "``", false]]], "qwen": [1, 5, 0.0355585552752018, [[4605, 0.666866, "''", false], [374, 0.046522, " is", false], [6, 0.040162, "'", false], [2711, 0.039583, " search", false], [1, 0.035559, "\"", false], [40510, 0.018344, ",''", false], [572, 0.010485, " was", false], [50817, 0.007851, "'',", false], [11, 0.007359, ",", false], [686, 0.006617, " will", false]]]}, "raw_delta": 0.4915504455566406, "tuned_delta": 0.49888758407034334}, {"byte_start": 1904, "byte_end": 1911, "display": {"text": " search", "kind": "normal"}, "is_word": true, "word_id": 316, "word_key": " search", "bytes_hex": "20 73 65 61 72 63 68", "compression": {"rwkv": "7.69% 7.69% 7.69% 7.69% 7.69% 7.69% 7.69%", "qwen": "5.22% 5.22% 5.22% 5.22% 5.22% 5.22% 5.22%"}, "model_tokens": {"rwkv": [[47202, " search", "normal", 0.05003240332007408]], "qwen": [[2711, " search", "normal", 0.13174693286418915]]}, "loss": {"rwkv": 7.688469665451784, "qwen": 5.22171206232272}, "topk": {"rwkv": [47202, 5, 0.05003240332007408, [[22748, 0.278192, " was", false], [52224, 0.161743, " methods", false], [40219, 0.096457, " would", false], [21795, 0.051671, " had", false], [47202, 0.050032, " search", false], [4600, 0.034837, " is", false], [38128, 0.027567, " could", false], [61590, 0.027405, " approaches", false], [275, 0.016912, " (", false], [21265, 0.011785, " and", false]]], "qwen": [2711, 2, 0.13174693286418915, [[572, 0.244206, " was", false], [2711, 0.131747, " search", false], [1035, 0.095376, " would", false], [5413, 0.057583, " methods", false], [374, 0.057558, " is", false], [320, 0.044885, " (", false], [1030, 0.040804, " had", false], [323, 0.020798, " and", false], [32719, 0.013899, " chess", false], [476, 0.01116, " or", false]]]}, "raw_delta": 0.13678608621869762, "tuned_delta": 0.14412322473240036}, {"byte_start": 1911, "byte_end": 1915, "display": {"text": " may", "kind": "normal"}, "is_word": true, "word_id": 317, "word_key": " may", "bytes_hex": "20 6d 61 79", "compression": {"rwkv": "37.48% 37.48% 37.48% 37.48%", "qwen": "34.56% 34.56% 34.56% 34.56%"}, "model_tokens": {"rwkv": [[22074, " may", "normal", 0.00024583944468759]], "qwen": [[1231, " may", "normal", 0.00046904574264772236]]}, "loss": {"rwkv": 37.47625789809221, "qwen": 34.556198865622754}, "topk": {"rwkv": [22074, 124, 0.00024583944468759, [[22748, 0.407429, " was", false], [40219, 0.096179, " would", false], [21795, 0.067765, " had", false], [52224, 0.058271, " methods", false], [38128, 0.052859, " could", false], [4600, 0.045826, " is", false], [45, 0.020378, ",", false], [21532, 0.016121, " did", false], [47285, 0.00948, " simply", false], [275, 0.008168, " (", false]]], "qwen": [1231, 92, 0.00046904574264772236, [[572, 0.389624, " was", false], [1035, 0.13415, " would", false], [374, 0.099906, " is", false], [1030, 0.037142, " had", false], [11, 0.030969, ",", false], [1410, 0.024413, " could", false], [5413, 0.017751, " methods", false], [320, 0.016459, " (", false], [686, 0.015828, " will", false], [323, 0.012574, " and", false]]]}, "raw_delta": 0.16192245483398438, "tuned_delta": 0.16925959334768712}, {"byte_start": 1915, "byte_end": 1920, "display": {"text": " have", "kind": "normal"}, "is_word": true, "word_id": 318, "word_key": " have", "bytes_hex": "20 68 61 76 65", "compression": {"rwkv": "4.28% 4.28% 4.28% 4.28% 4.28%", "qwen": "7.79% 7.79% 7.79% 7.79% 7.79%"}, "model_tokens": {"rwkv": [[31059, " have", "normal", 0.30517929792404175]], "qwen": [[614, " have", "normal", 0.11545616388320923]]}, "loss": {"rwkv": 4.28300090263911, "qwen": 7.786456903625622}, "topk": {"rwkv": [31059, 2, 0.30517929792404175, [[4435, 0.346597, " be", false], [31059, 0.305179, " have", false], [32499, 0.111617, " work", false], [22187, 0.033479, " not", false], [22770, 0.025282, " win", false], [32458, 0.019102, " well", false], [61959, 0.016036, " eventually", false], [30256, 0.015691, " beat", false], [46272, 0.007777, " indeed", false], [45685, 0.005528, " defeat", false]]], "qwen": [614, 3, 0.11545616388320923, [[387, 0.394511, " be", false], [537, 0.152496, " not", false], [614, 0.115456, " have", false], [975, 0.048592, " work", false], [1632, 0.045093, " well", false], [9583, 0.024234, " eventually", false], [3164, 0.020108, " win", false], [13653, 0.011506, " ultimately", false], [12824, 0.009843, " indeed", false], [12118, 0.008267, " prove", false]]]}, "raw_delta": -0.19427285194396976, "tuned_delta": -0.18693571343026702}, {"byte_start": 1920, "byte_end": 1924, "display": {"text": " won", "kind": "normal"}, "is_word": true, "word_id": 319, "word_key": " won", "bytes_hex": "20 77 6f 6e", "compression": {"rwkv": "8.45% 8.45% 8.45% 8.45%", "qwen": "8.65% 8.65% 8.65% 8.65%"}, "model_tokens": {"rwkv": [[22777, " won", "normal", 0.15451325476169586]], "qwen": [[2765, " won", "normal", 0.14682579040527344]]}, "loss": {"rwkv": 8.45329125520877, "qwen": 8.649445530204561}, "topk": {"rwkv": [22777, 3, 0.15451325476169586, [[30259, 0.314318, " been", false], [47812, 0.162782, " worked", false], [22777, 0.154513, " won", false], [55934, 0.063907, " defeated", false], [45281, 0.035243, " beaten", false], [61959, 0.015295, " eventually", false], [47333, 0.012838, " solved", false], [30256, 0.012007, " beat", false], [332, 0.01081, " a", false], [60586, 0.010657, " succeeded", false]]], "qwen": [2765, 2, 0.14682579040527344, [[1012, 0.28794, " been", false], [2765, 0.146826, " won", false], [30294, 0.072956, " beaten", false], [23283, 0.069093, " defeated", false], [6439, 0.037148, " worked", false], [264, 0.025148, " a", false], [700, 0.013904, " out", false], [279, 0.013003, " the", false], [6069, 0.010961, " led", false], [1030, 0.010471, " had", false]]]}, "raw_delta": -0.010877102613449097, "tuned_delta": -0.00353996409974636}, {"byte_start": 1924, "byte_end": 1929, "display": {"text": " this", "kind": "normal"}, "is_word": true, "word_id": 320, "word_key": " this", "bytes_hex": "20 74 68 69 73", "compression": {"rwkv": "16.79% 16.79% 16.79% 16.79% 16.79%", "qwen": "17.28% 17.28% 17.28% 17.28% 17.28%"}, "model_tokens": {"rwkv": [[32234, " this", "normal", 0.009346220642328262]], "qwen": [[419, " this", "normal", 0.008304568938910961]]}, "loss": {"rwkv": 16.79387196034809, "qwen": 17.279697151637894}, "topk": {"rwkv": [32234, 12, 0.009346220642328262, [[22590, 0.506178, " the", false], [45, 0.138587, ",", false], [50870, 0.066034, " against", false], [4712, 0.050993, " on", false], [4596, 0.047675, " in", false], [32229, 0.027905, " them", false], [332, 0.018049, " a", false], [21400, 0.014775, " but", false], [21700, 0.012965, " for", false], [4424, 0.011868, " at", false]]], "qwen": [419, 9, 0.008304568938910961, [[279, 0.444667, " the", false], [11, 0.260208, ",", false], [32719, 0.059978, " chess", false], [304, 0.037963, " in", false], [37542, 0.02516, " Kas", false], [714, 0.015706, " but", false], [2348, 0.012235, " against", false], [13, 0.009391, ".", false], [419, 0.008305, " this", false], [264, 0.007524, " a", false]]]}, "raw_delta": -0.026939868927001953, "tuned_delta": -0.019602730413299217}, {"byte_start": 1929, "byte_end": 1934, "display": {"text": " time", "kind": "normal"}, "is_word": true, "word_id": 321, "word_key": " time", "bytes_hex": "20 74 69 6d 65", "compression": {"rwkv": "6.00% 6.00% 6.00% 6.00% 6.00%", "qwen": "13.29% 13.29% 13.29% 13.29% 13.29%"}, "model_tokens": {"rwkv": [[32251, " time", "normal", 0.19099120795726776]], "qwen": [[882, " time", "normal", 0.02511478215456009]]}, "loss": {"rwkv": 6.001836791198226, "qwen": 13.288298852929454}, "topk": {"rwkv": [32251, 2, 0.19099120795726776, [[62293, 0.221423, " particular", false], [32251, 0.190991, " time", false], [39551, 0.11412, " round", false], [30941, 0.088748, " game", false], [38981, 0.067855, " match", false], [45278, 0.05144, " battle", false], [22226, 0.035552, " one", false], [38013, 0.028165, " chess", false], [57271, 0.027475, " specific", false], [62653, 0.023894, " tournament", false]]], "qwen": [882, 12, 0.02511478215456009, [[3953, 0.221175, " particular", false], [1809, 0.1886, " game", false], [2432, 0.102998, " match", false], [8049, 0.067648, " battle", false], [32719, 0.04686, " chess", false], [825, 0.041474, " one", false], [6957, 0.034948, " race", false], [4116, 0.029859, " war", false], [10707, 0.02819, " competition", false], [4778, 0.028065, " round", false]]]}, "raw_delta": -0.40404725074768055, "tuned_delta": -0.39671011223397784}, {"byte_start": 1934, "byte_end": 1935, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "2.38%", "qwen": "5.44%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.8763938546180725]], "qwen": [[11, ",", "normal", 0.7395690679550171]]}, "loss": {"rwkv": 2.3774881655274664, "qwen": 5.440540023273668}, "topk": {"rwkv": [45, 1, 0.8763938546180725, [[45, 0.876394, ",", false], [21400, 0.054141, " but", false], [275, 0.014545, " (", false], [45202, 0.01356, " around", false], [51018, 0.009226, " because", false], [50870, 0.004833, " against", false], [21265, 0.003069, " and", false], [47, 0.002756, ".", false], [4596, 0.002124, " in", false], [4450, 0.001848, " by", false]]], "qwen": [11, 1, 0.7395690679550171, [[11, 0.739569, ",", false], [714, 0.134095, " but", false], [13, 0.026886, ".", false], [1576, 0.021813, " because", false], [320, 0.012209, " (", false], [323, 0.008291, " and", false], [26, 0.007506, ";", false], [2163, 0.006502, " around", false], [304, 0.005369, " in", false], [553, 0.002741, " by", false]]]}, "raw_delta": -0.1698516607284546, "tuned_delta": -0.16251452221475185}, {"byte_start": 1935, "byte_end": 1939, "display": {"text": " but", "kind": "normal"}, "is_word": true, "word_id": 322, "word_key": " but", "bytes_hex": "20 62 75 74", "compression": {"rwkv": "0.13% 0.13% 0.13% 0.13%", "qwen": "0.29% 0.29% 0.29% 0.29%"}, "model_tokens": {"rwkv": [[21400, " but", "normal", 0.971335768699646]], "qwen": [[714, " but", "normal", 0.9371599555015564]]}, "loss": {"rwkv": 0.13153233137987602, "qwen": 0.2926023471418245}, "topk": {"rwkv": [21400, 1, 0.971335768699646, [[21400, 0.971336, " but", false], [21265, 0.012572, " and", false], [51018, 0.002946, " because", false], [4596, 0.000849, " in", false], [4423, 0.000716, " as", false], [32227, 0.000674, " that", false], [21700, 0.000618, " for", false], [4715, 0.000606, " or", false], [4601, 0.000515, " it", false], [39690, 0.000414, " since", false]]], "qwen": [714, 1, 0.9371599555015564, [[714, 0.93716, " but", false], [323, 0.028797, " and", false], [9902, 0.002806, " ``", false], [1576, 0.002413, " because", false], [537, 0.00212, " not", false], [1393, 0.001582, " while", false], [773, 0.001197, " so", false], [304, 0.001113, " in", false], [429, 0.001088, " that", false], [892, 0.001065, " which", false]]]}, "raw_delta": -0.008931618183851242, "tuned_delta": -0.0015944796701485055}, {"byte_start": 1939, "byte_end": 1942, "display": {"text": " it", "kind": "normal"}, "is_word": true, "word_id": 323, "word_key": " it", "bytes_hex": "20 69 74", "compression": {"rwkv": "5.85% 5.85% 5.85%", "qwen": "10.12% 10.12% 10.12%"}, "model_tokens": {"rwkv": [[4601, " it", "normal", 0.3802494704723358]], "qwen": [[432, " it", "normal", 0.1857195794582367]]}, "loss": {"rwkv": 5.846859784852732, "qwen": 10.120008804656042}, "topk": {"rwkv": [4601, 1, 0.3802494704723358, [[4601, 0.380249, " it", false], [32227, 0.120324, " that", false], [22590, 0.049006, " the", false], [32232, 0.047984, " they", false], [4596, 0.043935, " in", false], [40219, 0.03708, " would", false], [37920, 0.032546, " brute", false], [39934, 0.017977, " there", false], [4404, 0.014236, " ``", false], [32234, 0.01294, " this", false]]], "qwen": [432, 2, 0.1857195794582367, [[429, 0.205034, " that", false], [432, 0.18572, " it", false], [807, 0.076933, " they", false], [279, 0.07421, " the", false], [9902, 0.054034, " ``", false], [304, 0.031521, " in", false], [3738, 0.027188, " human", false], [862, 0.02355, " their", false], [11, 0.012975, ",", false], [1052, 0.012856, " there", false]]]}, "raw_delta": -0.2369536956151327, "tuned_delta": -0.22961655710142995}, {"byte_start": 1942, "byte_end": 1946, "display": {"text": " was", "kind": "normal"}, "is_word": true, "word_id": 324, "word_key": " was", "bytes_hex": "20 77 61 73", "compression": {"rwkv": "9.16% 9.16% 9.16% 9.16%", "qwen": "6.05% 6.05% 6.05% 6.05%"}, "model_tokens": {"rwkv": [[22748, " was", "normal", 0.13307714462280273]], "qwen": [[572, " was", "normal", 0.26141783595085144]]}, "loss": {"rwkv": 9.157732193142833, "qwen": 6.048657778025745}, "topk": {"rwkv": [22748, 3, 0.13307714462280273, [[40219, 0.338368, " would", false], [32475, 0.146674, " will", false], [22748, 0.133077, " was", false], [4600, 0.066446, " is", false], [38128, 0.052382, " could", false], [22777, 0.052064, " won", false], [47816, 0.043443, " wouldn", false], [45599, 0.017773, " couldn", false], [21795, 0.016517, " had", false], [32445, 0.01399, " wasn", false]]], "qwen": [572, 1, 0.26141783595085144, [[572, 0.261418, " was", false], [1035, 0.232932, " would", false], [1030, 0.083405, " had", false], [374, 0.064521, " is", false], [686, 0.062818, " will", false], [5710, 0.039827, " wasn", false], [1521, 0.028683, " did", false], [1410, 0.025184, " could", false], [8270, 0.020922, " wouldn", false], [2765, 0.013033, " won", false]]]}, "raw_delta": 0.17240369319915771, "tuned_delta": 0.17974083171286045}, {"byte_start": 1946, "byte_end": 1950, "display": {"text": " not", "kind": "normal"}, "is_word": true, "word_id": 325, "word_key": " not", "bytes_hex": "20 6e 6f 74", "compression": {"rwkv": "6.23% 6.23% 6.23% 6.23%", "qwen": "5.50% 5.50% 5.50% 5.50%"}, "model_tokens": {"rwkv": [[22187, " not", "normal", 0.24669300019741058]], "qwen": [[537, " not", "normal", 0.295030802488327]]}, "loss": {"rwkv": 6.234302300716467, "qwen": 5.503320140188}, "topk": {"rwkv": [22187, 1, 0.24669300019741058, [[22187, 0.246693, " not", false], [332, 0.140015, " a", false], [31581, 0.056063, " only", false], [22590, 0.044186, " the", false], [4692, 0.038048, " no", false], [4419, 0.031014, " an", false], [57492, 0.021912, " unlikely", false], [31198, 0.020682, " just", false], [4404, 0.017342, " ``", false], [45781, 0.015636, " doomed", false]]], "qwen": [537, 1, 0.295030802488327, [[537, 0.295031, " not", false], [264, 0.097277, " a", false], [1172, 0.061949, " only", false], [279, 0.038257, " the", false], [9902, 0.028887, " ``", false], [2058, 0.022418, " still", false], [2581, 0.021681, " never", false], [902, 0.018413, " no", false], [458, 0.015422, " an", false], [4969, 0.014254, " wrong", false]]]}, "raw_delta": 0.040534257888793945, "tuned_delta": 0.047871396402496685}, {"byte_start": 1950, "byte_end": 1952, "display": {"text": " a", "kind": "normal"}, "is_word": true, "word_id": 326, "word_key": " a", "bytes_hex": "20 61", "compression": {"rwkv": "11.62% 11.62%", "qwen": "19.45% 19.45%"}, "model_tokens": {"rwkv": [[332, " a", "normal", 0.2752308249473572]], "qwen": [[264, " a", "normal", 0.11562146991491318]]}, "loss": {"rwkv": 11.623275475912058, "qwen": 19.453241410466205}, "topk": {"rwkv": [332, 1, 0.2752308249473572, [[332, 0.275231, " a", false], [22590, 0.163763, " the", false], [38606, 0.11521, " going", false], [4419, 0.046154, " an", false], [46439, 0.028494, " likely", false], [51832, 0.027988, " general", false], [30992, 0.02088, " good", false], [47008, 0.019274, " really", false], [32464, 0.012122, " what", false], [4404, 0.010592, " ``", false]]], "qwen": [264, 2, 0.11562146991491318, [[279, 0.455008, " the", false], [264, 0.115621, " a", false], [2087, 0.036553, " going", false], [862, 0.026023, " their", false], [1128, 0.024629, " what", false], [2167, 0.020695, " really", false], [4586, 0.015172, " general", false], [458, 0.013861, " an", false], [14312, 0.013161, " necessarily", false], [1576, 0.007926, " because", false]]]}, "raw_delta": -0.4341855049133301, "tuned_delta": -0.42684836639962737}, {"byte_start": 1952, "byte_end": 1960, "display": {"text": " general", "kind": "normal"}, "is_word": true, "word_id": 327, "word_key": " general", "bytes_hex": "20 67 65 6e 65 72 61 6c", "compression": {"rwkv": "3.84% 3.84% 3.84% 3.84% 3.84% 3.84% 3.84% 3.84%", "qwen": "5.09% 5.09% 5.09% 5.09% 5.09% 5.09% 5.09% 5.09%"}, "model_tokens": {"rwkv": [[51832, " general", "normal", 0.18141528964042664]], "qwen": [[4586, " general", "normal", 0.10466268658638]]}, "loss": {"rwkv": 3.839203111740649, "qwen": 5.087782645968473}, "topk": {"rwkv": [51832, 1, 0.18141528964042664, [[51832, 0.181415, " general", false], [30992, 0.09993, " good", false], [46561, 0.072371, " method", false], [30811, 0.048113, " fair", false], [31835, 0.032848, " real", false], [4404, 0.030497, " ``", false], [53283, 0.027436, " victory", false], [40091, 0.026735, " valid", false], [32313, 0.026552, " true", false], [53354, 0.024331, " winning", false]]], "qwen": [4586, 1, 0.10466268658638, [[4586, 0.104663, " general", false], [1661, 0.085055, " good", false], [1602, 0.039174, " very", false], [1714, 0.03682, " method", false], [830, 0.034978, " true", false], [10987, 0.030614, " winning", false], [6624, 0.029465, " fair", false], [6291, 0.025684, " solution", false], [12560, 0.022494, " victory", false], [7394, 0.017502, " princip", false]]]}, "raw_delta": -0.06923595070838928, "tuned_delta": -0.06189881219468654}, {"byte_start": 1960, "byte_end": 1969, "display": {"text": " strategy", "kind": "normal"}, "is_word": true, "word_id": 328, "word_key": " strategy", "bytes_hex": "20 73 74 72 61 74 65 67 79", "compression": {"rwkv": "8.33% 8.33% 8.33% 8.33% 8.33% 8.33% 8.33% 8.33% 8.33%", "qwen": "9.24% 9.24% 9.24% 9.24% 9.24% 9.24% 9.24% 9.24% 9.24%"}, "model_tokens": {"rwkv": [[57317, " strategy", "normal", 0.01569780707359314]], "qwen": [[8282, " strategy", "normal", 0.009917660616338253]]}, "loss": {"rwkv": 8.328057310687155, "qwen": 9.244144876068852}, "topk": {"rwkv": [57317, 6, 0.01569780707359314, [[46561, 0.515984, " method", false], [55532, 0.187459, " approach", false], [57260, 0.080377, " solution", false], [41729, 0.071523, "izable", false], [22752, 0.023617, " way", false], [57317, 0.015698, " strategy", false], [46, 0.01415, "-", false], [60250, 0.012662, " principle", false], [45, 0.007885, ",", false], [60624, 0.006416, " technique", false]]], "qwen": [8282, 11, 0.009917660616338253, [[1714, 0.38849, " method", false], [5486, 0.148424, " approach", false], [8335, 0.098412, "izable", false], [6291, 0.068549, " solution", false], [58238, 0.068317, "-purpose", false], [10987, 0.02087, " winning", false], [12111, 0.01473, " algorithm", false], [7428, 0.013208, " purpose", false], [14762, 0.012738, " technique", false], [11, 0.012299, ",", false]]]}, "raw_delta": -0.05079868104722762, "tuned_delta": -0.04346154253352488}, {"byte_start": 1969, "byte_end": 1970, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "34.24%", "qwen": "33.33%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.1478322297334671]], "qwen": [[11, ",", "normal", 0.15751907229423523]]}, "loss": {"rwkv": 34.23582958359552, "qwen": 33.33002060911559}, "topk": {"rwkv": [45, 3, 0.1478322297334671, [[47, 0.360468, ".", false], [21700, 0.190099, " for", false], [45, 0.147832, ",", false], [32227, 0.129187, " that", false], [21265, 0.068768, " and", false], [60, 0.020001, ";", false], [4811, 0.011991, " to", false], [275, 0.008957, " (", false], [61586, 0.007828, " applicable", false], [59, 0.004899, ":", false]]], "qwen": [11, 3, 0.15751907229423523, [[13, 0.267979, ".", false], [429, 0.184571, " that", false], [11, 0.157519, ",", false], [369, 0.122608, " for", false], [323, 0.089749, " and", false], [26, 0.032851, ";", false], [382, 0.022751, ".\n\n", false], [8415, 0.016348, " applicable", false], [311, 0.011225, " to", false], [320, 0.009869, " (", false]]]}, "raw_delta": 0.05022871494293213, "tuned_delta": 0.05756585345663487}, {"byte_start": 1970, "byte_end": 1974, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 329, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"rwkv": "0.98% 0.98% 0.98% 0.98%", "qwen": "1.64% 1.64% 1.64% 1.64%"}, "model_tokens": {"rwkv": [[21265, " and", "normal", 0.8041521310806274]], "qwen": [[323, " and", "normal", 0.6953110098838806]]}, "loss": {"rwkv": 0.9774118013835139, "qwen": 1.6383427409866393}, "topk": {"rwkv": [21265, 1, 0.8041521310806274, [[21265, 0.804152, " and", false], [4601, 0.033862, " it", false], [4788, 0.022992, " so", false], [22185, 0.017838, " nor", false], [32227, 0.007959, " that", false], [22187, 0.007808, " not", false], [40186, 0.007174, " which", false], [51018, 0.006987, " because", false], [4715, 0.006676, " or", false], [53339, 0.006482, " whereas", false]]], "qwen": [323, 1, 0.6953110098838806, [[323, 0.695311, " and", false], [432, 0.04768, " it", false], [773, 0.025122, " so", false], [6329, 0.021133, " nor", false], [1576, 0.018084, " because", false], [438, 0.017532, " as", false], [2474, 0.014623, " since", false], [892, 0.014369, " which", false], [1101, 0.012344, " just", false], [537, 0.007646, " not", false]]]}, "raw_delta": -0.03664979338645935, "tuned_delta": -0.029312654872756614}, {"byte_start": 1974, "byte_end": 1981, "display": {"text": " anyway", "kind": "normal"}, "is_word": true, "word_id": 330, "word_key": " anyway", "bytes_hex": "20 61 6e 79 77 61 79", "compression": {"rwkv": "17.95% 17.95% 17.95% 17.95% 17.95% 17.95% 17.95%", "qwen": "25.02% 25.02% 25.02% 25.02% 25.02% 25.02% 25.02%"}, "model_tokens": {"rwkv": [[45179, " anyway", "normal", 0.0009522438049316406]], "qwen": [[13657, " anyway", "normal", 6.052275057299994e-05]]}, "loss": {"rwkv": 17.953180475348148, "qwen": 25.021719020604834}, "topk": {"rwkv": [45179, 86, 0.0009522438049316406, [[4601, 0.175157, " it", false], [32232, 0.095536, " they", false], [40219, 0.08627, " would", false], [22590, 0.069498, " the", false], [32227, 0.069164, " that", false], [4596, 0.029288, " in", false], [39934, 0.025243, " there", false], [60645, 0.01988, " therefore", false], [4788, 0.019584, " so", false], [32239, 0.016024, " thus", false]]], "qwen": [13657, 396, 6.052275057299994e-05, [[432, 0.176351, " it", false], [429, 0.112898, " that", false], [807, 0.084212, " they", false], [279, 0.076921, " the", false], [1035, 0.040495, " would", false], [304, 0.031902, " in", false], [862, 0.025066, " their", false], [1052, 0.022272, " there", false], [11, 0.020961, ",", false], [773, 0.020704, " so", false]]]}, "raw_delta": -0.3919630050659179, "tuned_delta": -0.3846258665522152}, {"byte_start": 1981, "byte_end": 1984, "display": {"text": " it", "kind": "normal"}, "is_word": true, "word_id": 331, "word_key": " it", "bytes_hex": "20 69 74", "compression": {"rwkv": "11.41% 11.41% 11.41%", "qwen": "10.77% 10.77% 10.77%"}, "model_tokens": {"rwkv": [[4601, " it", "normal", 0.14992888271808624]], "qwen": [[432, " it", "normal", 0.16680200397968292]]}, "loss": {"rwkv": 11.411943194531839, "qwen": 10.765798642485237}, "topk": {"rwkv": [4601, 2, 0.14992888271808624, [[45, 0.260864, ",", false], [4601, 0.149929, " it", false], [32232, 0.111213, " they", false], [22590, 0.098566, " the", false], [37920, 0.035451, " brute", false], [39934, 0.024524, " there", false], [39931, 0.01487, " their", false], [20184, 0.014433, " Kas", false], [38013, 0.013939, " chess", false], [22748, 0.013499, " was", false]]], "qwen": [432, 2, 0.16680200397968292, [[11, 0.396045, ",", false], [432, 0.166802, " it", false], [279, 0.084714, " the", false], [807, 0.055127, " they", false], [9902, 0.024949, " ``", false], [1052, 0.022042, " there", false], [37542, 0.019368, " Kas", false], [429, 0.012784, " that", false], [862, 0.012405, " their", false], [32719, 0.011599, " chess", false]]]}, "raw_delta": 0.03582986195882165, "tuned_delta": 0.04316700047252439}, {"byte_start": 1984, "byte_end": 1988, "display": {"text": " was", "kind": "normal"}, "is_word": true, "word_id": 332, "word_key": " was", "bytes_hex": "20 77 61 73", "compression": {"rwkv": "4.12% 4.12% 4.12% 4.12%", "qwen": "4.60% 4.60% 4.60% 4.60%"}, "model_tokens": {"rwkv": [[22748, " was", "normal", 0.40044859051704407]], "qwen": [[572, " was", "normal", 0.3602137267589569]]}, "loss": {"rwkv": 4.120979486914275, "qwen": 4.6033591132832}, "topk": {"rwkv": [22748, 1, 0.40044859051704407, [[22748, 0.400449, " was", false], [40219, 0.094344, " would", false], [21795, 0.073877, " had", false], [21532, 0.045244, " did", false], [57101, 0.036518, " required", false], [38128, 0.035038, " could", false], [4600, 0.030002, " is", false], [32272, 0.026945, " took", false], [30633, 0.016612, " didn", false], [32445, 0.013249, " wasn", false]]], "qwen": [572, 1, 0.3602137267589569, [[572, 0.360214, " was", false], [1035, 0.139555, " would", false], [1030, 0.070819, " had", false], [1521, 0.059803, " did", false], [374, 0.039697, " is", false], [1410, 0.034259, " could", false], [2567, 0.022039, " required", false], [3867, 0.017384, " took", false], [3207, 0.012466, " didn", false], [5710, 0.011562, " wasn", false]]]}, "raw_delta": -0.02674880623817444, "tuned_delta": -0.019411667724471702}, {"byte_start": 1988, "byte_end": 1992, "display": {"text": " not", "kind": "normal"}, "is_word": true, "word_id": 333, "word_key": " not", "bytes_hex": "20 6e 6f 74", "compression": {"rwkv": "6.48% 6.48% 6.48% 6.48%", "qwen": "7.19% 7.19% 7.19% 7.19%"}, "model_tokens": {"rwkv": [[22187, " not", "normal", 0.23639720678329468]], "qwen": [[537, " not", "normal", 0.2031400054693222]]}, "loss": {"rwkv": 6.48085662899339, "qwen": 7.185793091940252}, "topk": {"rwkv": [22187, 1, 0.23639720678329468, [[22187, 0.236397, " not", false], [22614, 0.066059, " too", false], [332, 0.055896, " a", false], [31581, 0.033237, " only", false], [55725, 0.02647, " cheating", false], [4404, 0.024352, " ``", false], [31198, 0.020228, " just", false], [4788, 0.015796, " so", false], [4692, 0.013287, " no", false], [4419, 0.012479, " an", false]]], "qwen": [537, 1, 0.2031400054693222, [[537, 0.20314, " not", false], [264, 0.068181, " a", false], [2238, 0.048861, " too", false], [1172, 0.045624, " only", false], [279, 0.023624, " the", false], [1101, 0.018506, " just", false], [3118, 0.017074, " based", false], [458, 0.014615, " an", false], [9902, 0.013939, " ``", false], [2588, 0.010936, " hard", false]]]}, "raw_delta": -0.039089977741241455, "tuned_delta": -0.031752839227538715}, {"byte_start": 1992, "byte_end": 1996, "display": {"text": " how", "kind": "normal"}, "is_word": true, "word_id": 334, "word_key": " how", "bytes_hex": "20 68 6f 77", "compression": {"rwkv": "20.57% 20.57% 20.57% 20.57%", "qwen": "22.53% 22.53% 22.53% 22.53%"}, "model_tokens": {"rwkv": [[21835, " how", "normal", 0.010352861136198044]], "qwen": [[1246, " how", "normal", 0.00675914017483592]]}, "loss": {"rwkv": 20.56967538767467, "qwen": 22.52795154215777}, "topk": {"rwkv": [21835, 16, 0.010352861136198044, [[332, 0.108725, " a", false], [22590, 0.059874, " the", false], [30992, 0.045532, " good", false], [32386, 0.043513, " very", false], [47008, 0.040074, " really", false], [30788, 0.036511, " even", false], [4404, 0.03413, " ``", false], [4423, 0.033186, " as", false], [32464, 0.032125, " what", false], [38606, 0.023324, " going", false]]], "qwen": [1246, 25, 0.00675914017483592, [[279, 0.142635, " the", false], [264, 0.096139, " a", false], [1128, 0.042469, " what", false], [862, 0.025291, " their", false], [1602, 0.023666, " very", false], [4586, 0.017903, " general", false], [438, 0.017367, " as", false], [3204, 0.016983, " possible", false], [2797, 0.01667, " clear", false], [2087, 0.016029, " going", false]]]}, "raw_delta": -0.10858988761901855, "tuned_delta": -0.10125274910531581}, {"byte_start": 1996, "byte_end": 2003, "display": {"text": " people", "kind": "normal"}, "is_word": true, "word_id": 335, "word_key": " people", "bytes_hex": "20 70 65 6f 70 6c 65", "compression": {"rwkv": "7.85% 7.85% 7.85% 7.85% 7.85% 7.85% 7.85%", "qwen": "12.17% 12.17% 12.17% 12.17% 12.17% 12.17% 12.17%"}, "model_tokens": {"rwkv": [[46787, " people", "normal", 0.0481235571205616]], "qwen": [[1251, " people", "normal", 0.00887445081025362]]}, "loss": {"rwkv": 7.849484736979571, "qwen": 12.171654442663186}, "topk": {"rwkv": [46787, 6, 0.0481235571205616, [[32232, 0.244676, " they", false], [46227, 0.240237, " humans", false], [38720, 0.064251, " human", false], [38013, 0.063049, " chess", false], [22590, 0.056909, " the", false], [46787, 0.048124, " people", false], [332, 0.04004, " a", false], [4858, 0.029868, " we", false], [22226, 0.028949, " one", false], [59345, 0.028204, " computers", false]]], "qwen": [1251, 12, 0.00887445081025362, [[807, 0.505775, " they", false], [32719, 0.172376, " chess", false], [279, 0.065239, " the", false], [12677, 0.054809, " humans", false], [18495, 0.032193, " computers", false], [37542, 0.024116, " Kas", false], [862, 0.017381, " their", false], [264, 0.014293, " a", false], [432, 0.012555, " it", false], [3738, 0.011437, " human", false]]]}, "raw_delta": -0.23967197963169642, "tuned_delta": -0.23233484111799368}, {"byte_start": 2003, "byte_end": 2010, "display": {"text": " played", "kind": "normal"}, "is_word": true, "word_id": 336, "word_key": " played", "bytes_hex": "20 70 6c 61 79 65 64", "compression": {"rwkv": "2.78% 2.78% 2.78% 2.78% 2.78% 2.78% 2.78%", "qwen": "2.96% 2.96% 2.96% 2.96% 2.96% 2.96% 2.96%"}, "model_tokens": {"rwkv": [[46840, " played", "normal", 0.3398122191429138]], "qwen": [[6342, " played", "normal", 0.31700965762138367]]}, "loss": {"rwkv": 2.7775099838543107, "qwen": 2.9596451391318017}, "topk": {"rwkv": [46840, 1, 0.3398122191429138, [[46840, 0.339812, " played", false], [31702, 0.243607, " play", false], [55448, 0.061848, " actually", false], [39942, 0.04563, " think", false], [56714, 0.037026, " normally", false], [53137, 0.036649, " thought", false], [47008, 0.034827, " really", false], [40219, 0.030374, " would", false], [47333, 0.017763, " solved", false], [53248, 0.009824, " usually", false]]], "qwen": [6342, 1, 0.31700965762138367, [[6342, 0.31701, " played", false], [1486, 0.260489, " play", false], [1744, 0.073582, " think", false], [3381, 0.072214, " thought", false], [3520, 0.031797, " actually", false], [1030, 0.023478, " had", false], [14279, 0.016623, " normally", false], [11136, 0.015295, " typically", false], [9498, 0.011615, " learned", false], [5990, 0.011504, " usually", false]]]}, "raw_delta": -0.01009971754891531, "tuned_delta": -0.0027625790352125736}, {"byte_start": 2010, "byte_end": 2016, "display": {"text": " chess", "kind": "normal"}, "is_word": true, "word_id": 337, "word_key": " chess", "bytes_hex": "20 63 68 65 73 73", "compression": {"rwkv": "1.12% 1.12% 1.12% 1.12% 1.12% 1.12%", "qwen": "0.36% 0.36% 0.36% 0.36% 0.36% 0.36%"}, "model_tokens": {"rwkv": [[38013, " chess", "normal", 0.6849300861358643]], "qwen": [[32719, " chess", "normal", 0.8862245678901672]]}, "loss": {"rwkv": 1.121235159545052, "qwen": 0.36303296000348356}, "topk": {"rwkv": [38013, 1, 0.6849300861358643, [[38013, 0.68493, " chess", false], [47, 0.168942, ".", false], [22590, 0.071832, " the", false], [45, 0.025891, ",", false], [275, 0.006708, " (", false], [4715, 0.00549, " or", false], [21265, 0.005037, " and", false], [4596, 0.003733, " in", false], [60, 0.003067, ";", false], [38576, 0.002303, " games", false]]], "qwen": [32719, 1, 0.8862245678901672, [[32719, 0.886225, " chess", false], [279, 0.046825, " the", false], [13, 0.031141, ".", false], [11, 0.006314, ",", false], [3868, 0.003067, " games", false], [382, 0.002365, ".\n\n", false], [320, 0.002193, " (", false], [304, 0.001716, " in", false], [862, 0.001423, " their", false], [323, 0.001294, " and", false]]]}, "raw_delta": 0.04204365735252697, "tuned_delta": 0.049380795866229704}, {"byte_start": 2016, "byte_end": 2017, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "4.93%", "qwen": "7.36%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.7621021866798401]], "qwen": [[13, ".", "normal", 0.6647235751152039]]}, "loss": {"rwkv": 4.931086565538449, "qwen": 7.364670097319523}, "topk": {"rwkv": [47, 1, 0.7621021866798401, [[47, 0.762102, ".", false], [45, 0.102764, ",", false], [275, 0.026121, " (", false], [45179, 0.015512, " anyway", false], [34, 0.012853, "!", false], [4596, 0.012293, " in", false], [21265, 0.010729, " and", false], [60, 0.009357, ";", false], [4715, 0.004538, " or", false], [4424, 0.003494, " at", false]]], "qwen": [13, 1, 0.6647235751152039, [[13, 0.664724, ".", false], [11, 0.093925, ",", false], [382, 0.059952, ".\n\n", false], [320, 0.025962, " (", false], [304, 0.022525, " in", false], [13657, 0.021117, " anyway", false], [26, 0.015994, ";", false], [624, 0.009761, ".\n", false], [323, 0.009525, " and", false], [1573, 0.007049, " before", false]]]}, "raw_delta": -0.1349465250968933, "tuned_delta": -0.12760938658319057}, {"byte_start": 2017, "byte_end": 2023, "display": {"text": " These", "kind": "normal"}, "is_word": true, "word_id": 338, "word_key": " these", "bytes_hex": "20 54 68 65 73 65", "compression": {"rwkv": "13.15% 13.15% 13.15% 13.15% 13.15% 13.15%", "qwen": "13.75% 13.75% 13.75% 13.75% 13.75% 13.75%"}, "model_tokens": {"rwkv": [[37453, " These", "normal", 0.012398803606629372]], "qwen": [[4220, " These", "normal", 0.010298359207808971]]}, "loss": {"rwkv": 13.149564174769196, "qwen": 13.753004001417803}, "topk": {"rwkv": [37453, 13, 0.012398803606629372, [[261, 0.204068, "\n\n", false], [29893, 0.090572, " They", false], [267, 0.08416, "  ", false], [20996, 0.066793, " The", false], [19555, 0.042464, " But", false], [29894, 0.036606, " This", false], [3913, 0.032488, " In", false], [3918, 0.025622, " It", false], [275, 0.02133, " (", false], [19417, 0.017193, " And", false]]], "qwen": [4220, 16, 0.010298359207808971, [[2379, 0.138351, " They", false], [220, 0.111454, " ", false], [576, 0.09405, " The", false], [1096, 0.040878, " This", false], [1084, 0.038529, " It", false], [758, 0.035303, " In", false], [1597, 0.02738, " And", false], [10964, 0.026182, " Their", false], [1988, 0.024559, " But", false], [320, 0.024182, " (", false]]]}, "raw_delta": -0.033461809158325195, "tuned_delta": -0.02612467064462246}, {"byte_start": 2023, "byte_end": 2035, "display": {"text": " researchers", "kind": "normal"}, "is_word": true, "word_id": 339, "word_key": " researchers", "bytes_hex": "20 72 65 73 65 61 72 63 68 65 72 73", "compression": {"rwkv": "2.40% 2.40% 2.40% 2.40% 2.40% 2.40% 2.40% 2.40% 2.40% 2.40% 2.40% 2.40%", "qwen": "0.81% 0.81% 0.81% 0.81% 0.81% 0.81% 0.81% 0.81% 0.81% 0.81% 0.81% 0.81%"}, "model_tokens": {"rwkv": [[63843, " researchers", "normal", 0.20519065856933594]], "qwen": [[11811, " researchers", "normal", 0.5851952433586121]]}, "loss": {"rwkv": 2.3950991889758177, "qwen": 0.8052188300705875}, "topk": {"rwkv": [63843, 1, 0.20519065856933594, [[63843, 0.205191, " researchers", false], [46787, 0.130875, " people", false], [32462, 0.089287, " were", false], [38720, 0.063876, " human", false], [38013, 0.029856, " chess", false], [31937, 0.02641, " same", false], [21286, 0.020829, " are", false], [59165, 0.020126, " arguments", false], [40119, 0.012151, " views", false], [45484, 0.010526, " claims", false]]], "qwen": [11811, 1, 0.5851952433586121, [[11811, 0.585195, " researchers", false], [3738, 0.069799, " human", false], [32719, 0.031066, " chess", false], [1033, 0.029196, " were", false], [1251, 0.026365, " people", false], [1852, 0.025132, " same", false], [525, 0.018851, " are", false], [5413, 0.014455, " methods", false], [6366, 0.013637, " computer", false], [9902, 0.008271, " ``", false]]]}, "raw_delta": 0.08816168705622353, "tuned_delta": 0.09549882556992627}, {"byte_start": 2035, "byte_end": 2042, "display": {"text": " wanted", "kind": "normal"}, "is_word": true, "word_id": 340, "word_key": " wanted", "bytes_hex": "20 77 61 6e 74 65 64", "compression": {"rwkv": "15.05% 15.05% 15.05% 15.05% 15.05% 15.05% 15.05%", "qwen": "13.46% 13.46% 13.46% 13.46% 13.46% 13.46% 13.46%"}, "model_tokens": {"rwkv": [[47763, " wanted", "normal", 0.0028634225018322468]], "qwen": [[4829, " wanted", "normal", 0.005385169759392738]]}, "loss": {"rwkv": 15.054909187848, "qwen": 13.458558851854368}, "topk": {"rwkv": [47763, 47, 0.0028634225018322468, [[32462, 0.203473, " were", false], [21795, 0.096339, " had", false], [40, 0.051387, "'", false], [21532, 0.047541, " did", false], [45, 0.036152, ",", false], [31059, 0.019407, " have", false], [21286, 0.017547, " are", false], [40219, 0.017518, " would", false], [30135, 0.016229, " also", false], [38128, 0.014155, " could", false]]], "qwen": [4829, 30, 0.005385169759392738, [[1033, 0.212382, " were", false], [1030, 0.053234, " had", false], [1521, 0.046063, " did", false], [1083, 0.040398, " also", false], [11, 0.032438, ",", false], [6, 0.021224, "'", false], [11585, 0.020043, " believed", false], [1053, 0.017736, " said", false], [525, 0.016484, " are", false], [614, 0.014885, " have", false]]]}, "raw_delta": 0.08852045876639236, "tuned_delta": 0.0958575972800951}, {"byte_start": 2042, "byte_end": 2050, "display": {"text": " methods", "kind": "normal"}, "is_word": true, "word_id": 341, "word_key": " methods", "bytes_hex": "20 6d 65 74 68 6f 64 73", "compression": {"rwkv": "9.86% 9.86% 9.86% 9.86% 9.86% 9.86% 9.86% 9.86%", "qwen": "12.30% 12.30% 12.30% 12.30% 12.30% 12.30% 12.30% 12.30%"}, "model_tokens": {"rwkv": [[52224, " methods", "normal", 0.012568442150950432]], "qwen": [[5413, " methods", "normal", 0.004273268394172192]]}, "loss": {"rwkv": 9.862173131076897, "qwen": 12.29756893004144}, "topk": {"rwkv": [52224, 6, 0.012568442150950432, [[4811, 0.65451, " to", false], [332, 0.067261, " a", false], [39931, 0.056689, " their", false], [22590, 0.032257, " the", false], [38013, 0.017936, " chess", false], [52224, 0.012568, " methods", false], [4419, 0.012363, " an", false], [31458, 0.012235, " more", false], [38720, 0.009168, " human", false], [46787, 0.009115, " people", false]]], "qwen": [5413, 10, 0.004273268394172192, [[311, 0.74202, " to", false], [264, 0.061502, " a", false], [279, 0.032519, " the", false], [862, 0.027466, " their", false], [803, 0.01411, " more", false], [3738, 0.009216, " human", false], [458, 0.008059, " an", false], [32719, 0.006059, " chess", false], [2494, 0.005639, " something", false], [5413, 0.004273, " methods", false]]]}, "raw_delta": -0.13504701852798462, "tuned_delta": -0.12770988001428188}, {"byte_start": 2050, "byte_end": 2056, "display": {"text": " based", "kind": "normal"}, "is_word": true, "word_id": 342, "word_key": " based", "bytes_hex": "20 62 61 73 65 64", "compression": {"rwkv": "9.11% 9.11% 9.11% 9.11% 9.11% 9.11%", "qwen": "7.00% 7.00% 7.00% 7.00% 7.00% 7.00%"}, "model_tokens": {"rwkv": [[37810, " based", "normal", 0.04862090200185776]], "qwen": [[3118, " based", "normal", 0.09755192697048187]]}, "loss": {"rwkv": 9.11076946394723, "qwen": 6.995178628936783}, "topk": {"rwkv": [37810, 3, 0.04862090200185776, [[32227, 0.77345, " that", false], [4811, 0.064983, " to", false], [37810, 0.048621, " based", false], [21700, 0.024841, " for", false], [4706, 0.011451, " of", false], [32232, 0.008478, " they", false], [32487, 0.006753, " with", false], [31458, 0.005156, " more", false], [45, 0.004879, ",", false], [4596, 0.00486, " in", false]]], "qwen": [3118, 2, 0.09755192697048187, [[429, 0.764439, " that", false], [3118, 0.097552, " based", false], [311, 0.034021, " to", false], [1075, 0.013267, " like", false], [315, 0.012646, " of", false], [369, 0.011456, " for", false], [448, 0.006683, " with", false], [4428, 0.004272, " similar", false], [803, 0.003858, " more", false], [76482, 0.003539, " leveraging", false]]]}, "raw_delta": 0.11731326580047612, "tuned_delta": 0.12465040431417886}, {"byte_start": 2056, "byte_end": 2059, "display": {"text": " on", "kind": "normal"}, "is_word": true, "word_id": 343, "word_key": " on", "bytes_hex": "20 6f 6e", "compression": {"rwkv": "0.19% 0.19% 0.19%", "qwen": "0.25% 0.25% 0.25%"}, "model_tokens": {"rwkv": [[4712, " on", "normal", 0.968268632888794]], "qwen": [[389, " on", "normal", 0.959489107131958]]}, "loss": {"rwkv": 0.19372125793186762, "qwen": 0.24859024008723393}, "topk": {"rwkv": [4712, 1, 0.968268632888794, [[4712, 0.968269, " on", false], [32350, 0.006686, " upon", false], [31458, 0.005703, " more", false], [4596, 0.004556, " in", false], [22187, 0.003418, " not", false], [56003, 0.000828, " directly", false], [45, 0.000809, ",", false], [31581, 0.000791, " only", false], [46957, 0.000704, " purely", false], [4423, 0.000629, " as", false]]], "qwen": [389, 1, 0.959489107131958, [[389, 0.959489, " on", false], [803, 0.008495, " more", false], [304, 0.007239, " in", false], [5193, 0.006055, " upon", false], [537, 0.002056, " not", false], [21063, 0.001594, " solely", false], [2163, 0.001537, " around", false], [1172, 0.001132, " only", false], [31127, 0.001066, " purely", false], [11, 0.001, ",", false]]]}, "raw_delta": -0.0030425824224948883, "tuned_delta": 0.004294556091207848}, {"byte_start": 2059, "byte_end": 2065, "display": {"text": " human", "kind": "normal"}, "is_word": true, "word_id": 344, "word_key": " human", "bytes_hex": "20 68 75 6d 61 6e", "compression": {"rwkv": "3.62% 3.62% 3.62% 3.62% 3.62% 3.62%", "qwen": "2.34% 2.34% 2.34% 2.34% 2.34% 2.34%"}, "model_tokens": {"rwkv": [[38720, " human", "normal", 0.3018374443054199]], "qwen": [[3738, " human", "normal", 0.4591285288333893]]}, "loss": {"rwkv": 3.6161301480615293, "qwen": 2.3396458912854303}, "topk": {"rwkv": [38720, 1, 0.3018374443054199, [[38720, 0.301837, " human", false], [39931, 0.094784, " their", false], [22590, 0.084485, " the", false], [65034, 0.04697, " understanding", false], [51832, 0.041414, " general", false], [30597, 0.033947, " deep", false], [38013, 0.032251, " chess", false], [332, 0.029831, " a", false], [59943, 0.020443, " knowledge", false], [32464, 0.015261, " what", false]]], "qwen": [3738, 1, 0.4591285288333893, [[3738, 0.459129, " human", false], [862, 0.141376, " their", false], [279, 0.061694, " the", false], [4586, 0.028779, " general", false], [264, 0.02666, " a", false], [8660, 0.018119, " understanding", false], [6540, 0.016029, " knowledge", false], [76482, 0.014361, " leveraging", false], [5538, 0.012181, " deep", false], [70601, 0.009768, " exploiting", false]]]}, "raw_delta": 0.07078331708908081, "tuned_delta": 0.07812045560278355}, {"byte_start": 2065, "byte_end": 2071, "display": {"text": " input", "kind": "normal"}, "is_word": true, "word_id": 345, "word_key": " input", "bytes_hex": "20 69 6e 70 75 74", "compression": {"rwkv": "25.55% 25.55% 25.55% 25.55% 25.55% 25.55%", "qwen": "24.75% 24.75% 24.75% 24.75% 24.75% 24.75%"}, "model_tokens": {"rwkv": [[38786, " input", "normal", 0.00019754479581024498]], "qwen": [[1946, " input", "normal", 0.00026557513047009706]]}, "loss": {"rwkv": 25.547724682408727, "qwen": 24.747068050449464}, "topk": {"rwkv": [38786, 89, 0.00019754479581024498, [[59943, 0.390049, " knowledge", false], [65034, 0.322511, " understanding", false], [59683, 0.048261, " expertise", false], [46, 0.039702, "-", false], [38013, 0.039517, " chess", false], [31702, 0.016451, " play", false], [62418, 0.013408, " psychology", false], [59917, 0.012565, " intuition", false], [60323, 0.008795, " reasoning", false], [61979, 0.007701, " experience", false]]], "qwen": [1946, 53, 0.00026557513047009706, [[6540, 0.446881, " knowledge", false], [8660, 0.339385, " understanding", false], [12646, 0.115004, "-k", false], [18726, 0.016356, " expertise", false], [56251, 0.010285, " intuition", false], [71107, 0.004593, "-under", false], [32719, 0.004265, " chess", false], [32711, 0.003989, " reasoning", false], [20017, 0.003962, " insight", false], [12681, 0.002659, "-like", false]]]}, "raw_delta": 0.044397830963134766, "tuned_delta": 0.051734969476837506}, {"byte_start": 2071, "byte_end": 2074, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 346, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "15.03% 15.03% 15.03%", "qwen": "12.74% 12.74% 12.74%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.08181919157505035]], "qwen": [[311, " to", "normal", 0.12003070116043091]]}, "loss": {"rwkv": 15.028073342593368, "qwen": 12.743852801817559}, "topk": {"rwkv": [4811, 4, 0.08181919157505035, [[45, 0.300712, ",", false], [21265, 0.173088, " and", false], [47, 0.130697, ".", false], [4811, 0.081819, " to", false], [32227, 0.077531, " that", false], [31162, 0.046377, " into", false], [4706, 0.04507, " of", false], [60, 0.013199, ";", false], [275, 0.012908, " (", false], [47001, 0.012686, " rather", false]]], "qwen": [311, 3, 0.12003070116043091, [[11, 0.312136, ",", false], [323, 0.121356, " and", false], [311, 0.120031, " to", false], [13, 0.104371, ".", false], [315, 0.044556, " of", false], [429, 0.036089, " that", false], [320, 0.025742, " (", false], [304, 0.018819, " in", false], [369, 0.017285, " for", false], [4751, 0.017163, " rather", false]]]}, "raw_delta": 0.12666408220926928, "tuned_delta": 0.13400122072297202}, {"byte_start": 2074, "byte_end": 2078, "display": {"text": " win", "kind": "normal"}, "is_word": true, "word_id": 347, "word_key": " win", "bytes_hex": "20 77 69 6e", "compression": {"rwkv": "13.10% 13.10% 13.10% 13.10%", "qwen": "17.09% 17.09% 17.09% 17.09%"}, "model_tokens": {"rwkv": [[22770, " win", "normal", 0.05493321642279625]], "qwen": [[3164, " win", "normal", 0.022558091208338737]]}, "loss": {"rwkv": 13.102601445573592, "qwen": 17.09441013788265}, "topk": {"rwkv": [22770, 3, 0.05493321642279625, [[4435, 0.212132, " be", false], [22590, 0.107361, " the", false], [22770, 0.054933, " win", false], [38013, 0.040736, " chess", false], [30256, 0.02615, " beat", false], [31702, 0.021312, " play", false], [47059, 0.01973, " remain", false], [55851, 0.018291, " continue", false], [39931, 0.017495, " their", false], [51982, 0.016325, " improve", false]]], "qwen": [3164, 6, 0.022558091208338737, [[387, 0.205114, " be", false], [279, 0.061523, " the", false], [1486, 0.047995, " play", false], [8474, 0.047719, " guide", false], [7269, 0.041327, " improve", false], [3164, 0.022558, " win", false], [11625, 0.022102, " solve", false], [1281, 0.021222, " make", false], [975, 0.018889, " work", false], [32719, 0.017693, " chess", false]]]}, "raw_delta": -0.22135287523269653, "tuned_delta": -0.2140157367189938}, {"byte_start": 2078, "byte_end": 2082, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 348, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"rwkv": "24.23% 24.23% 24.23% 24.23%", "qwen": "21.92% 21.92% 21.92% 21.92%"}, "model_tokens": {"rwkv": [[21265, " and", "normal", 0.0047121369279921055]], "qwen": [[323, " and", "normal", 0.007743414957076311]]}, "loss": {"rwkv": 24.232768264931806, "qwen": 21.915044070579164}, "topk": {"rwkv": [21265, 18, 0.0047121369279921055, [[45, 0.211643, ",", false], [22590, 0.168732, " the", false], [4596, 0.114145, " in", false], [47, 0.095814, ".", false], [37635, 0.091331, " again", false], [38013, 0.077859, " chess", false], [50870, 0.02339, " against", false], [46064, 0.0204, " future", false], [4424, 0.012697, " at", false], [4712, 0.010882, " on", false]]], "qwen": [323, 16, 0.007743414957076311, [[11, 0.236852, ",", false], [279, 0.183753, " the", false], [32719, 0.144311, " chess", false], [13, 0.087307, ".", false], [518, 0.040148, " at", false], [304, 0.030065, " in", false], [1182, 0.021278, " back", false], [1549, 0.018115, " again", false], [678, 0.017551, " all", false], [803, 0.014423, " more", false]]]}, "raw_delta": 0.12852191925048828, "tuned_delta": 0.13585905776419102}, {"byte_start": 2082, "byte_end": 2087, "display": {"text": " were", "kind": "normal"}, "is_word": true, "word_id": 349, "word_key": " were", "bytes_hex": "20 77 65 72 65", "compression": {"rwkv": "9.86% 9.86% 9.86% 9.86% 9.86%", "qwen": "6.67% 6.67% 6.67% 6.67% 6.67%"}, "model_tokens": {"rwkv": [[32462, " were", "normal", 0.0650070309638977]], "qwen": [[1033, " were", "normal", 0.1573631316423416]]}, "loss": {"rwkv": 9.862173131076897, "qwen": 6.669576201481539}, "topk": {"rwkv": [32462, 3, 0.0650070309638977, [[32232, 0.123059, " they", false], [45, 0.069184, ",", false], [32462, 0.065007, " were", false], [4811, 0.043769, " to", false], [4788, 0.034006, " so", false], [22187, 0.032885, " not", false], [21795, 0.027544, " had", false], [21532, 0.025145, " did", false], [22777, 0.020722, " won", false], [22590, 0.020685, " the", false]]], "qwen": [1033, 1, 0.1573631316423416, [[1033, 0.157363, " were", false], [11, 0.057803, ",", false], [537, 0.046059, " not", false], [807, 0.045585, " they", false], [311, 0.04225, " to", false], [773, 0.031472, " so", false], [11585, 0.03093, " believed", false], [1521, 0.029817, " did", false], [1035, 0.022363, " would", false], [1030, 0.015981, " had", false]]]}, "raw_delta": 0.17703516483306886, "tuned_delta": 0.1843723033467716}, {"byte_start": 2087, "byte_end": 2100, "display": {"text": " disappointed", "kind": "normal"}, "is_word": true, "word_id": 350, "word_key": " disappointed", "bytes_hex": "20 64 69 73 61 70 70 6f 69 6e 74 65 64", "compression": {"rwkv": "4.47% 4.47% 4.47% 4.47% 4.47% 4.47% 4.47% 4.47% 4.47% 4.47% 4.47% 4.47% 4.47%", "qwen": "4.56% 4.56% 4.56% 4.56% 4.56% 4.56% 4.56% 4.56% 4.56% 4.56% 4.56% 4.56% 4.56%"}, "model_tokens": {"rwkv": [[64362, " disappointed", "normal", 0.03956648334860802]], "qwen": [[24402, " disappointed", "normal", 0.03749189153313637]]}, "loss": {"rwkv": 4.465071791212836, "qwen": 4.555074611975615}, "topk": {"rwkv": [64362, 3, 0.03956648334860802, [[22187, 0.205338, " not", false], [60713, 0.050075, " unwilling", false], [64362, 0.039566, " disappointed", false], [32239, 0.030003, " thus", false], [53350, 0.02633, " willing", false], [62028, 0.023138, " frustrated", false], [47650, 0.013431, " unable", false], [45756, 0.013333, " dismay", false], [60645, 0.012927, " therefore", false], [60374, 0.01234, " reluctant", false]]], "qwen": [24402, 4, 0.03749189153313637, [[537, 0.212352, " not", false], [45143, 0.057787, " unwilling", false], [9831, 0.049617, " willing", false], [24402, 0.037492, " disappointed", false], [6247, 0.029933, " happy", false], [14453, 0.021838, " surprised", false], [1602, 0.015655, " very", false], [10030, 0.014863, " prepared", false], [8450, 0.012646, " thus", false], [42940, 0.011894, " reluctant", false]]]}, "raw_delta": -0.004990816116333008, "tuned_delta": 0.0023463223973697288}, {"byte_start": 2100, "byte_end": 2105, "display": {"text": " when", "kind": "normal"}, "is_word": true, "word_id": 351, "word_key": " when", "bytes_hex": "20 77 68 65 6e", "compression": {"rwkv": "4.09% 4.09% 4.09% 4.09% 4.09%", "qwen": "3.83% 3.83% 3.83% 3.83% 3.83%"}, "model_tokens": {"rwkv": [[32465, " when", "normal", 0.322946697473526]], "qwen": [[979, " when", "normal", 0.34567907452583313]]}, "loss": {"rwkv": 4.085757440017572, "qwen": 3.8312368753526838}, "topk": {"rwkv": [32465, 1, 0.322946697473526, [[32465, 0.322947, " when", false], [32227, 0.251197, " that", false], [47, 0.089479, ".", false], [4811, 0.087533, " to", false], [4450, 0.077957, " by", false], [4424, 0.029682, " at", false], [4596, 0.029172, " in", false], [32487, 0.023368, " with", false], [45, 0.020234, ",", false], [21265, 0.016676, " and", false]]], "qwen": [979, 1, 0.34567907452583313, [[979, 0.345679, " when", false], [429, 0.229684, " that", false], [311, 0.205805, " to", false], [553, 0.114107, " by", false], [448, 0.034713, " with", false], [323, 0.011793, " and", false], [304, 0.011361, " in", false], [518, 0.009385, " at", false], [11, 0.007122, ",", false], [537, 0.00442, " not", false]]]}, "raw_delta": 0.014113616943359386, "tuned_delta": 0.021450755457062123}, {"byte_start": 2105, "byte_end": 2110, "display": {"text": " they", "kind": "normal"}, "is_word": true, "word_id": 352, "word_key": " they", "bytes_hex": "20 74 68 65 79", "compression": {"rwkv": "4.31% 4.31% 4.31% 4.31% 4.31%", "qwen": "5.51% 5.51% 5.51% 5.51% 5.51%"}, "model_tokens": {"rwkv": [[32232, " they", "normal", 0.3016994893550873]], "qwen": [[807, " they", "normal", 0.21718207001686096]]}, "loss": {"rwkv": 4.311178540156472, "qwen": 5.50755779270526}, "topk": {"rwkv": [32232, 1, 0.3016994893550873, [[32232, 0.301699, " they", false], [22590, 0.127508, " the", false], [37920, 0.11673, " brute", false], [4601, 0.062519, " it", false], [39931, 0.061611, " their", false], [332, 0.040609, " a", false], [52224, 0.028608, " methods", false], [32234, 0.027365, " this", false], [32227, 0.022751, " that", false], [47202, 0.021632, " search", false]]], "qwen": [807, 1, 0.21718207001686096, [[807, 0.217182, " they", false], [279, 0.146606, " the", false], [862, 0.087454, " their", false], [2711, 0.058103, " search", false], [432, 0.040035, " it", false], [1741, 0.038384, " such", false], [64098, 0.038306, " brute", false], [419, 0.037, " this", false], [264, 0.031455, " a", false], [429, 0.029938, " that", false]]]}, "raw_delta": -0.06634135246276857, "tuned_delta": -0.059004213949065826}, {"byte_start": 2110, "byte_end": 2114, "display": {"text": " did", "kind": "normal"}, "is_word": true, "word_id": 353, "word_key": " did", "bytes_hex": "20 64 69 64", "compression": {"rwkv": "4.24% 4.24% 4.24% 4.24%", "qwen": "8.23% 8.23% 8.23% 8.23%"}, "model_tokens": {"rwkv": [[21532, " did", "normal", 0.3936825394630432]], "qwen": [[1521, " did", "normal", 0.1610872596502304]]}, "loss": {"rwkv": 4.244256651052736, "qwen": 8.231518014583825}, "topk": {"rwkv": [21532, 1, 0.3936825394630432, [[21532, 0.393683, " did", false], [30633, 0.160342, " didn", false], [45953, 0.123574, " failed", false], [31334, 0.096012, " lost", false], [32462, 0.057858, " were", false], [38128, 0.0177, " could", false], [38547, 0.01111, " found", false], [30383, 0.009448, " came", false], [46936, 0.00913, " proved", false], [45599, 0.006965, " couldn", false]]], "qwen": [1521, 1, 0.1610872596502304, [[1521, 0.161087, " did", false], [1033, 0.117427, " were", false], [1730, 0.114327, " found", false], [9498, 0.108848, " learned", false], [5485, 0.076586, " saw", false], [4641, 0.070985, " failed", false], [1410, 0.044698, " could", false], [11105, 0.033996, " discovered", false], [3207, 0.028945, " didn", false], [15043, 0.02417, " realized", false]]]}, "raw_delta": -0.22110071778297424, "tuned_delta": -0.2137635792692715}, {"byte_start": 2114, "byte_end": 2118, "display": {"text": " not", "kind": "normal"}, "is_word": true, "word_id": 354, "word_key": " not", "bytes_hex": "20 6e 6f 74", "compression": {"rwkv": "0.05% 0.05% 0.05% 0.05%", "qwen": "0.03% 0.03% 0.03% 0.03%"}, "model_tokens": {"rwkv": [[22187, " not", "normal", 0.9891003966331482]], "qwen": [[537, " not", "normal", 0.9942071437835693]]}, "loss": {"rwkv": 0.049255831207108386, "qwen": 0.02619250425652555}, "topk": {"rwkv": [22187, 1, 0.9891003966331482, [[22187, 0.9891, " not", false], [47, 0.005667, ".", false], [4788, 0.001933, " so", false], [45, 0.000799, ",", false], [22770, 0.000373, " win", false], [45301, 0.00012, " better", false], [4692, 9.6e-05, " no", false], [275, 9.1e-05, " (", false], [22590, 8.4e-05, " the", false], [31332, 7.8e-05, " lose", false]]], "qwen": [537, 1, 0.9942071437835693, [[537, 0.994207, " not", false], [13, 0.001272, ".", false], [279, 0.000411, " the", false], [902, 0.00031, " no", false], [773, 0.000306, " so", false], [382, 0.000292, ".\n\n", false], [11, 0.000233, ",", false], [4302, 0.000182, " nothing", false], [2664, 0.000141, " better", false], [4518, 0.000124, " instead", false]]]}, "raw_delta": 0.0012789024040102959, "tuned_delta": 0.008616040917713032}, {"byte_start": 2118, "byte_end": 2120, "display": {"text": ".\n", "kind": "control"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e 0a", "compression": {"rwkv": "2.71% 7.92%", "qwen": "16.34% 16.34%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.8607010245323181], [261, "\n\n", "control", 0.4140413999557495]], "qwen": [[382, ".\n\n", "control", 0.06594829261302948]]}, "loss": {"rwkv": 5.3185290814021835, "qwen": 16.343836645340584}, "topk": {"rwkv": [47, 1, 0.8607010245323181, [[47, 0.860701, ".", false], [45, 0.04268, ",", false], [22770, 0.02441, " win", false], [32499, 0.016643, " work", false], [275, 0.005055, " (", false], [60, 0.004693, ";", false], [4491, 0.004473, " do", false], [53051, 0.00368, " succeed", false], [4596, 0.002741, " in", false], [30256, 0.001929, " beat", false]]], "qwen": [382, 5, 0.06594829261302948, [[13, 0.292512, ".", false], [3164, 0.140883, " win", false], [633, 0.097434, " get", false], [1477, 0.067145, " find", false], [382, 0.065948, ".\n\n", false], [11996, 0.057187, " succeed", false], [614, 0.046361, " have", false], [1490, 0.02706, " see", false], [11, 0.022252, ",", false], [975, 0.018473, " work", false]]]}, "raw_delta": -0.6113728682200114, "tuned_delta": -0.6040357297063086}, {"byte_start": 2120, "byte_end": 2121, "display": {"text": "\n", "kind": "control"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "0a", "compression": {"rwkv": "7.92%", "qwen": "16.34%"}, "model_tokens": {"rwkv": [[261, "\n\n", "control", 0.4140413999557495]], "qwen": [[382, ".\n\n", "control", 0.06594829261302948]]}, "loss": {"rwkv": 7.924960551758221, "qwen": 16.343836645340584}, "topk": {"rwkv": [261, 1, 0.4140413999557495, [[261, 0.414041, "\n\n", false], [267, 0.081954, "  ", false], [29893, 0.061329, " They", false], [20996, 0.04255, " The", false], [19555, 0.034074, " But", false], [29894, 0.031064, " This", false], [3913, 0.025355, " In", false], [3918, 0.019383, " It", false], [3336, 0.013782, " \n\n", false], [37449, 0.011653, " Their", false]]], "qwen": [382, 5, 0.06594829261302948, [[13, 0.292512, ".", false], [3164, 0.140883, " win", false], [633, 0.097434, " get", false], [1477, 0.067145, " find", false], [382, 0.065948, ".\n\n", false], [11996, 0.057187, " succeed", false], [614, 0.046361, " have", false], [1490, 0.02706, " see", false], [11, 0.022252, ",", false], [975, 0.018473, " work", false]]]}, "raw_delta": -0.46684161822001136, "tuned_delta": -0.45950447970630864}, {"byte_start": 2121, "byte_end": 2122, "display": {"text": "A", "kind": "normal"}, "is_word": true, "word_id": 355, "word_key": "a", "bytes_hex": "41", "compression": {"rwkv": "52.97%", "qwen": "60.08%"}, "model_tokens": {"rwkv": [[66, "A", "normal", 0.05255685746669769]], "qwen": [[32, "A", "normal", 0.03574218973517418]]}, "loss": {"rwkv": 52.97395853264162, "qwen": 60.07785241134943}, "topk": {"rwkv": [66, 3, 0.05255685746669769, [[1136, 0.330548, "In", false], [6699, 0.159281, "The", false], [66, 0.052557, "A", false], [58094, 0.0449, "Similarly", false], [24242, 0.027452, "This", false], [33504, 0.021264, "There", false], [1141, 0.016584, "It", false], [24327, 0.016567, "When", false], [23560, 0.01256, "Deep", false], [48358, 0.010411, "Another", false]]], "qwen": [32, 4, 0.03574218973517418, [[641, 0.353845, "In", false], [785, 0.115869, "The", false], [67691, 0.045728, "Similarly", false], [32, 0.035742, "A", false], [3862, 0.02463, "There", false], [14037, 0.023558, "Another", false], [4498, 0.021734, "When", false], [1986, 0.018385, "This", false], [3966, 0.011602, "One", false], [1655, 0.011292, "At", false]]]}, "raw_delta": -0.3939235210418701, "tuned_delta": -0.3865863825281674}, {"byte_start": 2122, "byte_end": 2130, "display": {"text": " similar", "kind": "normal"}, "is_word": true, "word_id": 356, "word_key": " similar", "bytes_hex": "20 73 69 6d 69 6c 61 72", "compression": {"rwkv": "1.58% 1.58% 1.58% 1.58% 1.58% 1.58% 1.58% 1.58%", "qwen": "1.47% 1.47% 1.47% 1.47% 1.47% 1.47% 1.47% 1.47%"}, "model_tokens": {"rwkv": [[52906, " similar", "normal", 0.49130916595458984]], "qwen": [[4428, " similar", "normal", 0.5214805603027344]]}, "loss": {"rwkv": 1.5849921103516442, "qwen": 1.4676789820776348}, "topk": {"rwkv": [52906, 1, 0.49130916595458984, [[52906, 0.491309, " similar", false], [31458, 0.041211, " more", false], [21674, 0.034366, " few", false], [52693, 0.031682, " related", false], [47205, 0.025441, " second", false], [32386, 0.016325, " very", false], [30992, 0.016127, " good", false], [45674, 0.013372, " decade", false], [59513, 0.01303, " different", false], [57263, 0.01258, " somewhat", false]]], "qwen": [4428, 1, 0.5214805603027344, [[4428, 0.521481, " similar", false], [803, 0.048354, " more", false], [5435, 0.031472, " related", false], [2086, 0.028084, " second", false], [2421, 0.02363, " few", false], [2155, 0.022031, " different", false], [1602, 0.01837, " very", false], [14400, 0.010205, " somewhat", false], [13212, 0.009056, " decade", false], [11416, 0.008557, " classic", false]]]}, "raw_delta": 0.006505221128463745, "tuned_delta": 0.013842359642166482}, {"byte_start": 2130, "byte_end": 2138, "display": {"text": " pattern", "kind": "normal"}, "is_word": true, "word_id": 357, "word_key": " pattern", "bytes_hex": "20 70 61 74 74 65 72 6e", "compression": {"rwkv": "6.52% 6.52% 6.52% 6.52% 6.52% 6.52% 6.52% 6.52%", "qwen": "6.29% 6.29% 6.29% 6.29% 6.29% 6.29% 6.29% 6.29%"}, "model_tokens": {"rwkv": [[52427, " pattern", "normal", 0.05514274165034294]], "qwen": [[5383, " pattern", "normal", 0.06150469928979874]]}, "loss": {"rwkv": 6.516078675890093, "qwen": 6.286187316698641}, "topk": {"rwkv": [52427, 4, 0.05514274165034294, [[39831, 0.211977, " story", false], [45315, 0.099972, " bitter", false], [60511, 0.094377, " situation", false], [52427, 0.055143, " pattern", false], [65126, 0.051618, " disappointment", false], [46430, 0.043731, " lesson", false], [30405, 0.023768, " case", false], [51668, 0.019863, " example", false], [45, 0.018499, ",", false], [22459, 0.017042, " set", false]]], "qwen": [5383, 4, 0.06150469928979874, [[6534, 0.161408, " situation", false], [3364, 0.133674, " story", false], [17755, 0.097952, " lesson", false], [5383, 0.061505, " pattern", false], [3110, 0.033002, " example", false], [3166, 0.029063, " thing", false], [12720, 0.022721, " reaction", false], [40598, 0.022441, " disappointment", false], [18915, 0.021367, " attitude", false], [24382, 0.020877, " fate", false]]]}, "raw_delta": 0.012747883796691895, "tuned_delta": 0.02008502231039463}, {"byte_start": 2138, "byte_end": 2141, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 358, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "16.72% 16.72% 16.72%", "qwen": "15.92% 15.92% 15.92%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.061711300164461136]], "qwen": [[315, " of", "normal", 0.07075536251068115]]}, "loss": {"rwkv": 16.718731593635123, "qwen": 15.920904076282552}, "topk": {"rwkv": [4706, 6, 0.061711300164461136, [[56745, 0.133771, " occurred", false], [4600, 0.119927, " is", false], [22748, 0.11512, " was", false], [21413, 0.093714, " can", false], [46840, 0.067173, " played", false], [4706, 0.061711, " of", false], [51585, 0.055689, " emerged", false], [21800, 0.035938, " has", false], [57093, 0.028849, " repeated", false], [51586, 0.028626, " emerges", false]]], "qwen": [315, 5, 0.07075536251068115, [[572, 0.173193, " was", false], [21992, 0.146087, " emerged", false], [646, 0.09904, " can", false], [10017, 0.076013, " occurred", false], [315, 0.070755, " of", false], [374, 0.05973, " is", false], [702, 0.042734, " has", false], [6342, 0.0253, " played", false], [58596, 0.023844, " emerges", false], [312, 0.017661, " re", false]]]}, "raw_delta": 0.04424095153808594, "tuned_delta": 0.05157809005178868}, {"byte_start": 2141, "byte_end": 2150, "display": {"text": " research", "kind": "normal"}, "is_word": true, "word_id": 359, "word_key": " research", "bytes_hex": "20 72 65 73 65 61 72 63 68", "compression": {"rwkv": "10.21% 10.21% 10.21% 10.21% 10.21% 10.21% 10.21% 10.21% 10.21%", "qwen": "7.76% 7.76% 7.76% 7.76% 7.76% 7.76% 7.76% 7.76% 7.76%"}, "model_tokens": {"rwkv": [[57103, " research", "normal", 0.0061441510915756226]], "qwen": [[3412, " research", "normal", 0.02082969807088375]]}, "loss": {"rwkv": 10.206566478511329, "qwen": 7.757242115177639}, "topk": {"rwkv": [57103, 18, 0.0061441510915756226, [[45315, 0.333407, " bitter", false], [65126, 0.107253, " disappointment", false], [61640, 0.037202, " bitterness", false], [51708, 0.035005, " failure", false], [38720, 0.027782, " human", false], [45685, 0.016555, " defeat", false], [62500, 0.01553, " resistance", false], [55615, 0.012756, " behavior", false], [45294, 0.012221, " belief", false], [45909, 0.010515, " events", false]]], "qwen": [3412, 8, 0.02082969807088375, [[40598, 0.106948, " disappointment", false], [7709, 0.059513, " behavior", false], [3738, 0.049548, " human", false], [12720, 0.045738, " reaction", false], [1656, 0.034726, " bel", false], [7901, 0.033575, " failure", false], [13643, 0.023229, " resistance", false], [3412, 0.02083, " research", false], [7274, 0.019194, " thinking", false], [6832, 0.019006, " learning", false]]]}, "raw_delta": 0.13581938213772246, "tuned_delta": 0.1431565206514252}, {"byte_start": 2150, "byte_end": 2159, "display": {"text": " progress", "kind": "normal"}, "is_word": true, "word_id": 360, "word_key": " progress", "bytes_hex": "20 70 72 6f 67 72 65 73 73", "compression": {"rwkv": "12.46% 12.46% 12.46% 12.46% 12.46% 12.46% 12.46% 12.46% 12.46%", "qwen": "10.72% 10.72% 10.72% 10.72% 10.72% 10.72% 10.72% 10.72% 10.72%"}, "model_tokens": {"rwkv": [[56950, " progress", "normal", 0.00199777795933187]], "qwen": [[5098, " progress", "normal", 0.00474706431850791]]}, "loss": {"rwkv": 12.460777479900333, "qwen": 10.720484080360402}, "topk": {"rwkv": [56950, 54, 0.00199777795933187, [[51708, 0.134063, " failure", false], [22748, 0.072728, " was", false], [4600, 0.05929, " is", false], [65126, 0.056187, " disappointment", false], [21413, 0.051231, " can", false], [21265, 0.035001, " and", false], [4596, 0.032864, " in", false], [56745, 0.030861, " occurred", false], [21800, 0.030583, " has", false], [46, 0.026723, "-", false]]], "qwen": [5098, 36, 0.00474706431850791, [[572, 0.076821, " was", false], [323, 0.066671, " and", false], [374, 0.032934, " is", false], [7901, 0.028421, " failure", false], [10017, 0.023164, " occurred", false], [702, 0.020978, " has", false], [304, 0.020233, " in", false], [9162, 0.020032, " investment", false], [5041, 0.01999, " effort", false], [11, 0.017641, ",", false]]]}, "raw_delta": 0.09650235705905486, "tuned_delta": 0.1038394955727576}, {"byte_start": 2159, "byte_end": 2163, "display": {"text": " was", "kind": "normal"}, "is_word": true, "word_id": 361, "word_key": " was", "bytes_hex": "20 77 61 73", "compression": {"rwkv": "8.91% 8.91% 8.91% 8.91%", "qwen": "6.99% 6.99% 6.99% 6.99%"}, "model_tokens": {"rwkv": [[22748, " was", "normal", 0.13758288323879242]], "qwen": [[572, " was", "normal", 0.21211445331573486]]}, "loss": {"rwkv": 8.91117786486591, "qwen": 6.990891065621055}, "topk": {"rwkv": [22748, 1, 0.13758288323879242, [[22748, 0.137583, " was", false], [4596, 0.131443, " in", false], [21413, 0.121519, " can", false], [4600, 0.118101, " is", false], [56745, 0.08715, " occurred", false], [21800, 0.053751, " has", false], [21265, 0.040225, " and", false], [45, 0.023538, ",", false], [46840, 0.017392, " played", false], [51585, 0.017186, " emerged", false]]], "qwen": [572, 1, 0.21211445331573486, [[572, 0.212114, " was", false], [646, 0.094362, " can", false], [10017, 0.088096, " occurred", false], [374, 0.070937, " is", false], [304, 0.0703, " in", false], [323, 0.058003, " and", false], [8110, 0.03405, " followed", false], [702, 0.031553, " has", false], [21992, 0.026239, " emerged", false], [11, 0.018598, ",", false]]]}, "raw_delta": 0.10648331046104431, "tuned_delta": 0.11382044897474705}, {"byte_start": 2163, "byte_end": 2168, "display": {"text": " seen", "kind": "normal"}, "is_word": true, "word_id": 362, "word_key": " seen", "bytes_hex": "20 73 65 65 6e", "compression": {"rwkv": "3.14% 3.14% 3.14% 3.14% 3.14%", "qwen": "4.22% 4.22% 4.22% 4.22% 4.22%"}, "model_tokens": {"rwkv": [[31968, " seen", "normal", 0.4186335802078247]], "qwen": [[3884, " seen", "normal", 0.31041789054870605]]}, "loss": {"rwkv": 3.141806583185926, "qwen": 4.2192912194968635}, "topk": {"rwkv": [31968, 1, 0.4186335802078247, [[31968, 0.418634, " seen", false], [51661, 0.125233, " evident", false], [56734, 0.091303, " observed", false], [57093, 0.054551, " repeated", false], [56255, 0.048041, " followed", false], [38547, 0.035393, " found", false], [53296, 0.026607, " visible", false], [55524, 0.025388, " apparent", false], [59676, 0.009283, " exhibited", false], [22590, 0.007211, " the", false]]], "qwen": [3884, 1, 0.31041789054870605, [[3884, 0.310418, " seen", false], [13166, 0.190853, " observed", false], [29476, 0.077438, " evident", false], [1730, 0.048113, " found", false], [11504, 0.029763, " repeated", false], [31026, 0.028457, " witnessed", false], [8110, 0.024862, " followed", false], [1083, 0.015594, " also", false], [304, 0.013705, " in", false], [10321, 0.010507, " experienced", false]]]}, "raw_delta": -0.05974843502044678, "tuned_delta": -0.052411296506744046}, {"byte_start": 2168, "byte_end": 2171, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 363, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "0.74% 0.74% 0.74%", "qwen": "0.94% 0.94% 0.94%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.8835338354110718]], "qwen": [[304, " in", "normal", 0.8556819558143616]]}, "loss": {"rwkv": 0.7396629848307673, "qwen": 0.9368891954426406}, "topk": {"rwkv": [4596, 1, 0.8835338354110718, [[4596, 0.883534, " in", false], [32487, 0.043043, " with", false], [32465, 0.011884, " when", false], [21700, 0.008378, " for", false], [45, 0.005761, ",", false], [45805, 0.004462, " during", false], [4424, 0.003692, " at", false], [31601, 0.002604, " over", false], [45202, 0.002392, " around", false], [4712, 0.002093, " on", false]]], "qwen": [304, 1, 0.8556819558143616, [[304, 0.855682, " in", false], [448, 0.046766, " with", false], [369, 0.018555, " for", false], [979, 0.011921, " when", false], [518, 0.011762, " at", false], [553, 0.010531, " by", false], [11, 0.005457, ",", false], [2337, 0.00533, " during", false], [916, 0.004182, " over", false], [4221, 0.003949, " among", false]]]}, "raw_delta": -0.010936543345451355, "tuned_delta": -0.0035994048317486184}, {"byte_start": 2171, "byte_end": 2180, "display": {"text": " computer", "kind": "normal"}, "is_word": true, "word_id": 364, "word_key": " computer", "bytes_hex": "20 63 6f 6d 70 75 74 65 72", "compression": {"rwkv": "4.54% 4.54% 4.54% 4.54% 4.54% 4.54% 4.54% 4.54% 4.54%", "qwen": "6.31% 6.31% 6.31% 6.31% 6.31% 6.31% 6.31% 6.31% 6.31%"}, "model_tokens": {"rwkv": [[55809, " computer", "normal", 0.10315738618373871]], "qwen": [[6366, " computer", "normal", 0.04282262921333313]]}, "loss": {"rwkv": 4.539730488908413, "qwen": 6.313170678024638}, "topk": {"rwkv": [55809, 2, 0.10315738618373871, [[22590, 0.291755, " the", false], [55809, 0.103157, " computer", false], [38328, 0.055753, " early", false], [52299, 0.035754, " natural", false], [52167, 0.033924, " machine", false], [3609, 0.028548, " AI", false], [3851, 0.028047, " Go", false], [45929, 0.023011, " expert", false], [61594, 0.019222, " artificial", false], [38013, 0.014862, " chess", false]]], "qwen": [6366, 3, 0.04282262921333313, [[279, 0.321339, " the", false], [1809, 0.056189, " game", false], [6366, 0.042823, " computer", false], [1008, 0.027065, " other", false], [6203, 0.022183, " expert", false], [5994, 0.020669, " Go", false], [5662, 0.018329, " machine", false], [20443, 0.016123, " artificial", false], [3868, 0.014979, " games", false], [5810, 0.013605, " natural", false]]]}, "raw_delta": -0.09834040535820854, "tuned_delta": -0.0910032668445058}, {"byte_start": 2180, "byte_end": 2183, "display": {"text": " Go", "kind": "normal"}, "is_word": true, "word_id": 365, "word_key": " go", "bytes_hex": "20 47 6f", "compression": {"rwkv": "5.47% 5.47% 5.47%", "qwen": "2.32% 2.32% 2.32%"}, "model_tokens": {"rwkv": [[3851, " Go", "normal", 0.4003258943557739]], "qwen": [[5994, " Go", "normal", 0.6799574494361877]]}, "loss": {"rwkv": 5.471157951287898, "qwen": 2.3186817435910383}, "topk": {"rwkv": [3851, 1, 0.4003258943557739, [[3851, 0.400326, " Go", false], [52814, 0.078316, " science", false], [46, 0.068309, "-", false], [39311, 0.047114, " poker", false], [47732, 0.03738, " vision", false], [38576, 0.030898, " games", false], [4559, 0.024256, " go", false], [47350, 0.023706, " speech", false], [56529, 0.022703, " language", false], [31044, 0.02121, " hand", false]]], "qwen": [5994, 1, 0.6799574494361877, [[5994, 0.679957, " Go", false], [3868, 0.049785, " games", false], [20814, 0.030803, " poker", false], [728, 0.029928, " go", false], [1809, 0.02932, " game", false], [19926, 0.023104, "-go", false], [1182, 0.015382, " back", false], [1779, 0.009107, " check", false], [3701, 0.009033, " card", false], [12604, 0.007157, " GO", false]]]}, "raw_delta": 0.17481039961179098, "tuned_delta": 0.18214753812549372}, {"byte_start": 2183, "byte_end": 2184, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "20.99%", "qwen": "16.10%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.3140634298324585]], "qwen": [[11, ",", "normal", 0.40962767601013184]]}, "loss": {"rwkv": 20.99233995043511, "qwen": 16.09518771169503}, "topk": {"rwkv": [45, 2, 0.3140634298324585, [[47, 0.512348, ".", false], [45, 0.314063, ",", false], [4596, 0.054341, " in", false], [275, 0.017628, " (", false], [21265, 0.017024, " and", false], [59, 0.013558, ":", false], [31601, 0.006679, " over", false], [30917, 0.005319, " from", false], [332, 0.00452, " a", false], [4424, 0.002949, " at", false]]], "qwen": [11, 2, 0.40962767601013184, [[13, 0.442132, ".", false], [11, 0.409628, ",", false], [304, 0.034679, " in", false], [320, 0.023862, " (", false], [323, 0.015349, " and", false], [3412, 0.006555, " research", false], [25, 0.006412, ":", false], [553, 0.005444, " by", false], [979, 0.005193, " when", false], [26, 0.002816, ";", false]]]}, "raw_delta": 0.2715557813644409, "tuned_delta": 0.27889291987814363}, {"byte_start": 2184, "byte_end": 2189, "display": {"text": " only", "kind": "normal"}, "is_word": true, "word_id": 366, "word_key": " only", "bytes_hex": "20 6f 6e 6c 79", "compression": {"rwkv": "26.60% 26.60% 26.60% 26.60% 26.60%", "qwen": "31.91% 31.91% 31.91% 31.91% 31.91%"}, "model_tokens": {"rwkv": [[31581, " only", "normal", 0.000615722790826112]], "qwen": [[1172, " only", "normal", 0.00014375371392816305]]}, "loss": {"rwkv": 26.599689816390264, "qwen": 31.910283618281632}, "topk": {"rwkv": [31581, 59, 0.000615722790826112, [[40185, 0.436021, " where", false], [40186, 0.099996, " which", false], [22590, 0.054603, " the", false], [4596, 0.048806, " in", false], [21265, 0.041304, " and", false], [32487, 0.034222, " with", false], [332, 0.030197, " a", false], [32465, 0.019826, " when", false], [55495, 0.017408, " although", false], [50919, 0.016711, " another", false]]], "qwen": [1172, 146, 0.00014375371392816305, [[1380, 0.360335, " where", false], [892, 0.147696, " which", false], [264, 0.065947, " a", false], [304, 0.062296, " in", false], [279, 0.05924, " the", false], [448, 0.042481, " with", false], [323, 0.029347, " and", false], [979, 0.018793, " when", false], [458, 0.015009, " an", false], [2441, 0.012311, " another", false]]]}, "raw_delta": -0.29448184967041, "tuned_delta": -0.2871447111567073}, {"byte_start": 2189, "byte_end": 2197, "display": {"text": " delayed", "kind": "normal"}, "is_word": true, "word_id": 367, "word_key": " delayed", "bytes_hex": "20 64 65 6c 61 79 65 64", "compression": {"rwkv": "15.57% 15.57% 15.57% 15.57% 15.57% 15.57% 15.57% 15.57%", "qwen": "14.29% 14.29% 14.29% 14.29% 14.29% 14.29% 14.29% 14.29%"}, "model_tokens": {"rwkv": [[51419, " delayed", "normal", 0.0009985610377043486]], "qwen": [[22706, " delayed", "normal", 0.0017680253367871046]]}, "loss": {"rwkv": 15.568144728342816, "qwen": 14.28694599714994}, "topk": {"rwkv": [51419, 68, 0.0009985610377043486, [[31458, 0.103107, " more", false], [332, 0.09764, " a", false], [31466, 0.084316, " much", false], [32487, 0.068627, " with", false], [38869, 0.054411, " later", false], [57245, 0.037554, " slightly", false], [4601, 0.036191, " it", false], [4596, 0.035639, " in", false], [57263, 0.035586, " somewhat", false], [32234, 0.035539, " this", false]]], "qwen": [22706, 45, 0.0017680253367871046, [[419, 0.243399, " this", false], [803, 0.134981, " more", false], [448, 0.060628, " with", false], [264, 0.05519, " a", false], [1753, 0.054965, " much", false], [304, 0.050239, " in", false], [311, 0.034538, " to", false], [432, 0.031966, " it", false], [279, 0.025637, " the", false], [429, 0.025317, " that", false]]]}, "raw_delta": 0.07104474306106567, "tuned_delta": 0.07838188157476841}, {"byte_start": 2197, "byte_end": 2200, "display": {"text": " by", "kind": "normal"}, "is_word": true, "word_id": 368, "word_key": " by", "bytes_hex": "20 62 79", "compression": {"rwkv": "3.05% 3.05% 3.05%", "qwen": "4.23% 4.23% 4.23%"}, "model_tokens": {"rwkv": [[4450, " by", "normal", 0.6046222448348999]], "qwen": [[553, " by", "normal", 0.49497660994529724]]}, "loss": {"rwkv": 3.052577397714278, "qwen": 4.227365804954872}, "topk": {"rwkv": [4450, 1, 0.6046222448348999, [[4450, 0.604622, " by", false], [332, 0.071658, " a", false], [57263, 0.049368, " somewhat", false], [21700, 0.036908, " for", false], [57245, 0.025594, " slightly", false], [51018, 0.024588, " because", false], [40076, 0.024008, " until", false], [47, 0.023905, ".", false], [21265, 0.02015, " and", false], [37598, 0.012601, " about", false]]], "qwen": [553, 1, 0.49497660994529724, [[553, 0.494977, " by", false], [3080, 0.072059, " until", false], [304, 0.060012, " in", false], [13, 0.051781, ".", false], [264, 0.044172, " a", false], [369, 0.040421, " for", false], [311, 0.02979, " to", false], [10078, 0.021066, " slightly", false], [1576, 0.020199, " because", false], [803, 0.016974, " more", false]]]}, "raw_delta": -0.06514410177866617, "tuned_delta": -0.05780696326496343}, {"byte_start": 2200, "byte_end": 2202, "display": {"text": " a", "kind": "normal"}, "is_word": true, "word_id": 369, "word_key": " a", "bytes_hex": "20 61", "compression": {"rwkv": "11.62% 11.62%", "qwen": "13.95% 13.95%"}, "model_tokens": {"rwkv": [[332, " a", "normal", 0.2733345031738281]], "qwen": [[264, " a", "normal", 0.21295078098773956]]}, "loss": {"rwkv": 11.623275475912058, "qwen": 13.946301035477545}, "topk": {"rwkv": [332, 1, 0.2733345031738281, [[332, 0.273335, " a", false], [37598, 0.163303, " about", false], [52869, 0.090072, " several", false], [22590, 0.058603, " the", false], [3483, 0.032514, " 10", false], [22638, 0.031864, " two", false], [31370, 0.030215, " many", false], [31458, 0.026873, " more", false], [32074, 0.019449, " some", false], [30869, 0.018279, " five", false]]], "qwen": [264, 1, 0.21295078098773956, [[264, 0.212951, " a", false], [279, 0.190157, " the", false], [220, 0.099973, " ", false], [10793, 0.051928, " decades", false], [3807, 0.040558, " several", false], [803, 0.03866, " more", false], [1657, 0.034201, " many", false], [1378, 0.029853, " two", false], [911, 0.025934, " about", false], [2441, 0.018902, " another", false]]]}, "raw_delta": -0.1288158893585205, "tuned_delta": -0.12147875084481777}, {"byte_start": 2202, "byte_end": 2210, "display": {"text": " further", "kind": "normal"}, "is_word": true, "word_id": 370, "word_key": " further", "bytes_hex": "20 66 75 72 74 68 65 72", "compression": {"rwkv": "13.95% 13.95% 13.95% 13.95% 13.95% 13.95% 13.95% 13.95%", "qwen": "11.41% 11.41% 11.41% 11.41% 11.41% 11.41% 11.41% 11.41%"}, "model_tokens": {"rwkv": [[51816, " further", "normal", 0.002088395180180669]], "qwen": [[4623, " further", "normal", 0.006346368696540594]]}, "loss": {"rwkv": 13.947930571094469, "qwen": 11.406020541992751}, "topk": {"rwkv": [51816, 14, 0.002088395180180669, [[21674, 0.401154, " few", false], [45674, 0.329602, " decade", false], [45602, 0.11188, " couple", false], [32512, 0.038871, " year", false], [62035, 0.022812, " generation", false], [45950, 0.013889, " factor", false], [21365, 0.012133, " bit", false], [46685, 0.007511, " number", false], [46454, 0.006821, " little", false], [31040, 0.003239, " half", false]]], "qwen": [4623, 17, 0.006346368696540594, [[13212, 0.361089, " decade", false], [2421, 0.127623, " few", false], [8168, 0.081854, " factor", false], [9471, 0.06511, " generation", false], [5021, 0.057878, " longer", false], [9294, 0.037375, " century", false], [5625, 0.029724, " couple", false], [1753, 0.023602, " much", false], [803, 0.017667, " more", false], [1042, 0.013761, " year", false]]]}, "raw_delta": 0.1409534215927124, "tuned_delta": 0.14829056010641514}, {"byte_start": 2210, "byte_end": 2213, "display": {"text": " 20", "kind": "normal"}, "is_word": true, "word_id": 371, "word_key": " 20", "bytes_hex": "20 32 30", "compression": {"rwkv": "20.57% 20.57% 20.57%", "qwen": "14.81% 15.29% 5.23%"}, "model_tokens": {"rwkv": [[3493, " 20", "normal", 0.03232622146606445]], "qwen": [[220, " ", "normal", 0.43981674313545227], [17, "2", "normal", 0.42840680480003357], [15, "0", "normal", 0.7482753396034241]]}, "loss": {"rwkv": 20.56967538767467, "qwen": 11.77637980616797}, "topk": {"rwkv": [3493, 9, 0.03232622146606445, [[45674, 0.237946, " decade", false], [3483, 0.102525, " 10", false], [30869, 0.074982, " five", false], [22638, 0.054564, " two", false], [22583, 0.052025, " ten", false], [3488, 0.049272, " 15", false], [30905, 0.037443, " four", false], [39644, 0.03725, " seven", false], [3493, 0.032326, " 20", false], [39946, 0.030975, " three", false]]], "qwen": [220, 1, 0.43981674313545227, [[220, 0.439817, " ", false], [13212, 0.100761, " decade", false], [1378, 0.053785, " two", false], [5779, 0.039719, " ten", false], [4236, 0.037992, " five", false], [17073, 0.03225, " twenty", false], [9471, 0.030196, " generation", false], [2326, 0.028439, " three", false], [8168, 0.02575, " factor", false], [36655, 0.022671, " fifteen", false]]]}, "raw_delta": 0.4876038432121277, "tuned_delta": 0.4949409817258304}, {"byte_start": 2213, "byte_end": 2219, "display": {"text": " years", "kind": "normal"}, "is_word": true, "word_id": 372, "word_key": " years", "bytes_hex": "20 79 65 61 72 73", "compression": {"rwkv": "0.14% 0.14% 0.14% 0.14% 0.14% 0.14%", "qwen": "0.08% 0.08% 0.08% 0.08% 0.08% 0.08%"}, "model_tokens": {"rwkv": [[40237, " years", "normal", 0.9537624716758728]], "qwen": [[1635, " years", "normal", 0.9749020338058472]]}, "loss": {"rwkv": 0.14235577287417547, "qwen": 0.07639755989077397}, "topk": {"rwkv": [40237, 1, 0.9537624716758728, [[40237, 0.953762, " years", false], [4715, 0.014782, " or", false], [46, 0.011682, "-", false], [44, 0.006092, "+", false], [49, 0.001893, "0", false], [4811, 0.001795, " to", false], [620, 0.001349, "00", false], [32512, 0.000838, " year", false], [46596, 0.000794, " months", false], [38, 0.000632, "%", false]]], "qwen": [1635, 1, 0.9749020338058472, [[1635, 0.974902, " years", false], [476, 0.005643, " or", false], [12, 0.004019, "-", false], [311, 0.002986, " to", false], [4102, 0.00289, " ", false], [10, 0.002163, "+", false], [15, 0.001481, "0", false], [4142, 0.001073, "–", false], [56088, 0.00053, "-years", false], [22934, 0.000528, "-plus", false]]]}, "raw_delta": 0.0036574999491373705, "tuned_delta": 0.010994638462840108}, {"byte_start": 2219, "byte_end": 2220, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "5.35%", "qwen": "6.47%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.7437606453895569]], "qwen": [[13, ".", "normal", 0.6986647844314575]]}, "loss": {"rwkv": 5.353751128298887, "qwen": 6.466596042562159}, "topk": {"rwkv": [47, 1, 0.7437606453895569, [[47, 0.743761, ".", false], [45, 0.082853, ",", false], [4715, 0.042741, " or", false], [21265, 0.026759, " and", false], [51018, 0.016204, " because", false], [275, 0.013843, " (", false], [59, 0.013139, ":", false], [21572, 0.011861, " due", false], [4706, 0.00625, " of", false], [37634, 0.005491, " after", false]]], "qwen": [13, 1, 0.6986647844314575, [[13, 0.698665, ".", false], [11, 0.08126, ",", false], [320, 0.02321, " (", false], [1576, 0.021752, " because", false], [315, 0.019394, " of", false], [323, 0.015811, " and", false], [476, 0.012819, " or", false], [1573, 0.011566, " before", false], [4152, 0.010564, " due", false], [504, 0.010561, " from", false]]]}, "raw_delta": -0.06170922517776489, "tuned_delta": -0.05437208666406215}, {"byte_start": 2220, "byte_end": 2223, "display": {"text": " En", "kind": "normal"}, "is_word": true, "word_id": 373, "word_key": " en", "bytes_hex": "20 45 6e", "compression": {"rwkv": "63.49% 63.49% 63.49%", "qwen": "67.94% 67.94% 67.94%"}, "model_tokens": {"rwkv": [[3785, " En", "normal", 2.6273775802110322e-05]], "qwen": [[2925, " En", "normal", 1.2355040780676063e-05]]}, "loss": {"rwkv": 63.49360987245698, "qwen": 67.93558351169662}, "topk": {"rwkv": [3785, 822, 2.6273775802110322e-05, [[20996, 0.194399, " The", false], [3913, 0.133609, " In", false], [37451, 0.033058, " There", false], [261, 0.030011, "\n\n", false], [30032, 0.027889, " When", false], [28753, 0.026108, " Deep", false], [267, 0.024632, "  ", false], [29894, 0.024508, " This", false], [29059, 0.024433, " Here", false], [300, 0.022151, " A", false]]], "qwen": [2925, 1381, 1.2355040780676063e-05, [[576, 0.194352, " The", false], [758, 0.129986, " In", false], [3197, 0.042168, " When", false], [1084, 0.029462, " It", false], [1096, 0.028426, " This", false], [362, 0.026568, " A", false], [5994, 0.024987, " Go", false], [2411, 0.024318, " At", false], [18183, 0.022559, " Deep", false], [2619, 0.021317, " There", false]]]}, "raw_delta": -0.24631532033284476, "tuned_delta": -0.23897818181914202}, {"byte_start": 2223, "byte_end": 2226, "display": {"text": "orm", "kind": "normal"}, "is_word": true, "word_id": 374, "word_key": "orm", "bytes_hex": "6f 72 6d", "compression": {"rwkv": "10.90% 10.90% 10.90%", "qwen": "0.88% 0.88% 0.88%"}, "model_tokens": {"rwkv": [[8404, "orm", "normal", 0.1636972725391388]], "qwen": [[493, "orm", "normal", 0.8644454479217529]]}, "loss": {"rwkv": 10.89535317338019, "qwen": 0.8756382013579326}, "topk": {"rwkv": [8404, 2, 0.1636972725391388, [[26596, 0.452748, "ough", false], [8404, 0.163697, "orm", false], [35003, 0.117841, "light", false], [27567, 0.03702, "zyme", false], [39552, 0.031765, " route", false], [34698, 0.030725, "igmat", false], [40885, 0.030457, "abling", false], [9163, 0.009534, "zig", false], [26883, 0.009153, "rico", false], [7460, 0.008367, "emy", false]]], "qwen": [493, 1, 0.8644454479217529, [[493, 0.864445, "orm", false], [33132, 0.049235, "thus", false], [309, 0.017022, "am", false], [13013, 0.016572, "vision", false], [55247, 0.014893, "rico", false], [2152, 0.003988, "no", false], [18768, 0.002521, "abling", false], [12738, 0.002172, "zo", false], [1494, 0.001699, " pass", false], [98730, 0.001685, "igmatic", false]]]}, "raw_delta": 0.55561097462972, "tuned_delta": 0.5629481131434227}, {"byte_start": 2226, "byte_end": 2229, "display": {"text": "ous", "kind": "normal"}, "is_word": true, "word_id": 375, "word_key": "ous", "bytes_hex": "6f 75 73", "compression": {"rwkv": "0.42% 0.42% 0.42%", "qwen": "0.45% 0.45% 0.45%"}, "model_tokens": {"rwkv": [[8439, "ous", "normal", 0.9326043128967285]], "qwen": [[782, "ous", "normal", 0.9285297393798828]]}, "loss": {"rwkv": 0.41972939218571315, "qwen": 0.4457498298154722}, "topk": {"rwkv": [8439, 1, 0.9326043128967285, [[8439, 0.932604, "ous", false], [35323, 0.066431, "ously", false], [27340, 0.00015, "uous", false], [2243, 0.000118, "us", false], [25902, 9.9e-05, "ious", false], [8435, 4.8e-05, "oul", false], [7933, 4.8e-05, "ity", false], [7450, 3.6e-05, "ely", false], [2102, 3.5e-05, "os", false], [8440, 3e-05, "out", false]]], "qwen": [782, 1, 0.9285297393798828, [[782, 0.92853, "ous", false], [7017, 0.070054, "ously", false], [288, 0.000248, "es", false], [1530, 0.000137, "ouse", false], [283, 0.000123, "ou", false], [68, 0.000119, "e", false], [487, 0.000111, "ity", false], [78, 8.3e-05, "o", false], [33072, 7.9e-05, "eous", false], [480, 6.4e-05, "able", false]]]}, "raw_delta": -0.0014428794384002686, "tuned_delta": 0.005894259075302468}, {"byte_start": 2229, "byte_end": 2237, "display": {"text": " initial", "kind": "normal"}, "is_word": true, "word_id": 376, "word_key": " initial", "bytes_hex": "20 69 6e 69 74 69 61 6c", "compression": {"rwkv": "15.64% 15.64% 15.64% 15.64% 15.64% 15.64% 15.64% 15.64%", "qwen": "18.19% 18.19% 18.19% 18.19% 18.19% 18.19% 18.19% 18.19%"}, "model_tokens": {"rwkv": [[52013, " initial", "normal", 0.0009623137884773314]], "qwen": [[2856, " initial", "normal", 0.00031285788281820714]]}, "loss": {"rwkv": 15.638588822136223, "qwen": 18.19094464749472}, "topk": {"rwkv": [52013, 66, 0.0009623137884773314, [[56950, 0.331239, " progress", false], [64423, 0.126566, " improvements", false], [51566, 0.036245, " efforts", false], [55465, 0.036221, " advances", false], [50897, 0.034089, " amounts", false], [63621, 0.030865, " improvement", false], [45829, 0.028776, " effort", false], [57103, 0.023368, " research", false], [45, 0.022004, ",", false], [47202, 0.017118, " search", false]]], "qwen": [2856, 145, 0.00031285788281820714, [[2711, 0.142274, " search", false], [54480, 0.113539, " computational", false], [5098, 0.08119, " progress", false], [5041, 0.073557, " effort", false], [29903, 0.052898, " advances", false], [34447, 0.049092, " computation", false], [18142, 0.04861, " improvements", false], [14713, 0.038292, " amounts", false], [11, 0.025313, ",", false], [8869, 0.015892, " efforts", false]]]}, "raw_delta": -0.14153265953063965, "tuned_delta": -0.1341955210169369}, {"byte_start": 2237, "byte_end": 2245, "display": {"text": " efforts", "kind": "normal"}, "is_word": true, "word_id": 377, "word_key": " efforts", "bytes_hex": "20 65 66 66 6f 72 74 73", "compression": {"rwkv": "6.90% 6.90% 6.90% 6.90% 6.90% 6.90% 6.90% 6.90%", "qwen": "5.33% 5.33% 5.33% 5.33% 5.33% 5.33% 5.33% 5.33%"}, "model_tokens": {"rwkv": [[51566, " efforts", "normal", 0.046972520649433136]], "qwen": [[8869, " efforts", "normal", 0.09407690912485123]]}, "loss": {"rwkv": 6.903521191753828, "qwen": 5.328149360934822}, "topk": {"rwkv": [51566, 5, 0.046972520649433136, [[56950, 0.343629, " progress", false], [62157, 0.133092, " investment", false], [63678, 0.087827, " investments", false], [53052, 0.071165, " success", false], [51566, 0.046973, " efforts", false], [57103, 0.043113, " research", false], [45829, 0.039016, " effort", false], [60587, 0.028184, " successes", false], [55465, 0.027802, " advances", false], [38575, 0.018011, " gains", false]]], "qwen": [8869, 3, 0.09407690912485123, [[5041, 0.139331, " effort", false], [5098, 0.133733, " progress", false], [8869, 0.094077, " efforts", false], [9162, 0.085854, " investment", false], [29903, 0.07295, " advances", false], [54480, 0.068006, " computational", false], [2393, 0.050085, " success", false], [47088, 0.041195, " successes", false], [19619, 0.0384, " gains", false], [2711, 0.030214, " search", false]]]}, "raw_delta": 0.08735716342926025, "tuned_delta": 0.094694301942963}, {"byte_start": 2245, "byte_end": 2250, "display": {"text": " went", "kind": "normal"}, "is_word": true, "word_id": 378, "word_key": " went", "bytes_hex": "20 77 65 6e 74", "compression": {"rwkv": "13.98% 13.98% 13.98% 13.98% 13.98%", "qwen": "14.21% 14.21% 14.21% 14.21% 14.21%"}, "model_tokens": {"rwkv": [[32460, " went", "normal", 0.020899198949337006]], "qwen": [[3937, " went", "normal", 0.01947474665939808]]}, "loss": {"rwkv": 13.976108208611832, "qwen": 14.205629375147302}, "topk": {"rwkv": [32460, 9, 0.020899198949337006, [[4811, 0.237796, " to", false], [32462, 0.224705, " were", false], [4596, 0.096955, " in", false], [4450, 0.064416, " by", false], [4424, 0.058863, " at", false], [51770, 0.036334, " focused", false], [4712, 0.023021, " on", false], [45, 0.022696, ",", false], [32460, 0.020899, " went", false], [37810, 0.017758, " based", false]]], "qwen": [3937, 9, 0.01947474665939808, [[1033, 0.326123, " were", false], [311, 0.202252, " to", false], [304, 0.091795, " in", false], [553, 0.044073, " by", false], [518, 0.034734, " at", false], [11, 0.032869, ",", false], [3118, 0.023143, " based", false], [1030, 0.020815, " had", false], [3937, 0.019475, " went", false], [389, 0.01851, " on", false]]]}, "raw_delta": -0.012727355957031228, "tuned_delta": -0.005390217443328491}, {"byte_start": 2250, "byte_end": 2255, "display": {"text": " into", "kind": "normal"}, "is_word": true, "word_id": 379, "word_key": " into", "bytes_hex": "20 69 6e 74 6f", "compression": {"rwkv": "0.55% 0.55% 0.55% 0.55% 0.55%", "qwen": "0.39% 0.39% 0.39% 0.39% 0.39%"}, "model_tokens": {"rwkv": [[31162, " into", "normal", 0.8601644039154053]], "qwen": [[1119, " into", "normal", 0.8965668678283691]]}, "loss": {"rwkv": 0.5459417268988996, "qwen": 0.39379216907816855}, "topk": {"rwkv": [31162, 1, 0.8601644039154053, [[31162, 0.860164, " into", false], [4811, 0.075848, " to", false], [47585, 0.02569, " toward", false], [4596, 0.015513, " in", false], [53169, 0.011535, " towards", false], [4712, 0.002807, " on", false], [56003, 0.000718, " directly", false], [52028, 0.000529, " instead", false], [45, 0.000518, ",", false], [38543, 0.000493, " forth", false]]], "qwen": [1119, 1, 0.8965668678283691, [[1119, 0.896567, " into", false], [8841, 0.040515, " toward", false], [6974, 0.020418, " towards", false], [311, 0.020106, " to", false], [304, 0.012883, " in", false], [389, 0.001529, " on", false], [1283, 0.001193, " after", false], [369, 0.000768, " for", false], [13771, 0.00056, " largely", false], [537, 0.000338, " not", false]]]}, "raw_delta": 0.008436962962150574, "tuned_delta": 0.01577410147585331}, {"byte_start": 2255, "byte_end": 2264, "display": {"text": " avoiding", "kind": "normal"}, "is_word": true, "word_id": 380, "word_key": " avoiding", "bytes_hex": "20 61 76 6f 69 64 69 6e 67", "compression": {"rwkv": "19.29% 19.29% 19.29% 19.29% 19.29% 19.29% 19.29% 19.29% 19.29%", "qwen": "18.25% 18.25% 18.25% 18.25% 18.25% 18.25% 18.25% 18.25% 18.25%"}, "model_tokens": {"rwkv": [[55586, " avoiding", "normal", 6.820954877184704e-05]], "qwen": [[30426, " avoiding", "normal", 0.0001108758442569524]]}, "loss": {"rwkv": 19.286027456328153, "qwen": 18.248287962858655}, "topk": {"rwkv": [55586, 617, 6.820954877184704e-05, [[52224, 0.109243, " methods", false], [22590, 0.080172, " the", false], [61857, 0.077266, " developing", false], [38720, 0.063262, " human", false], [47202, 0.027701, " search", false], [55882, 0.026596, " creating", false], [47629, 0.024944, " trying", false], [55666, 0.023747, " building", false], [59832, 0.019443, " improving", false], [57103, 0.01843, " research", false]]], "qwen": [30426, 397, 0.0001108758442569524, [[11220, 0.192012, " developing", false], [5413, 0.153821, " methods", false], [3738, 0.062345, " human", false], [279, 0.032841, " the", false], [4460, 0.024713, " trying", false], [76482, 0.022661, " leveraging", false], [4752, 0.022024, " building", false], [6825, 0.019116, " creating", false], [9271, 0.019007, " finding", false], [8660, 0.016814, " understanding", false]]]}, "raw_delta": 0.05754449632432723, "tuned_delta": 0.06488163483802997}, {"byte_start": 2264, "byte_end": 2271, "display": {"text": " search", "kind": "normal"}, "is_word": true, "word_id": 381, "word_key": " search", "bytes_hex": "20 73 65 61 72 63 68", "compression": {"rwkv": "7.21% 7.21% 7.21% 7.21% 7.21% 7.21% 7.21%", "qwen": "6.52% 6.52% 6.52% 6.52% 6.52% 6.52% 6.52%"}, "model_tokens": {"rwkv": [[47202, " search", "normal", 0.05990307405591011]], "qwen": [[2711, " search", "normal", 0.07964933663606644]]}, "loss": {"rwkv": 7.205424450868429, "qwen": 6.518203890075754}, "topk": {"rwkv": [47202, 3, 0.05990307405591011, [[22590, 0.363314, " the", false], [37920, 0.171771, " brute", false], [47202, 0.059903, " search", false], [38720, 0.030309, " human", false], [30597, 0.027414, " deep", false], [332, 0.020735, " a", false], [4404, 0.0148, " ``", false], [63370, 0.00994, " computation", false], [21273, 0.007938, " any", false], [51832, 0.0078, " general", false]]], "qwen": [2711, 3, 0.07964933663606644, [[279, 0.160157, " the", false], [9902, 0.08651, " ``", false], [2711, 0.079649, " search", false], [64098, 0.058393, " brute", false], [264, 0.039142, " a", false], [5538, 0.028358, " deep", false], [3738, 0.02146, " human", false], [5413, 0.01834, " methods", false], [6366, 0.017076, " computer", false], [4285, 0.015536, " simple", false]]]}, "raw_delta": 0.03810759953090126, "tuned_delta": 0.045444738044604}, {"byte_start": 2271, "byte_end": 2274, "display": {"text": " by", "kind": "normal"}, "is_word": true, "word_id": 382, "word_key": " by", "bytes_hex": "20 62 79", "compression": {"rwkv": "14.28% 14.28% 14.28%", "qwen": "16.33% 16.33% 16.33%"}, "model_tokens": {"rwkv": [[4450, " by", "normal", 0.09386609494686127]], "qwen": [[553, " by", "normal", 0.06609392911195755]]}, "loss": {"rwkv": 14.276669675463697, "qwen": 16.33057678295906}, "topk": {"rwkv": [4450, 3, 0.09386609494686127, [[45, 0.205587, ",", false], [21265, 0.120165, " and", false], [4450, 0.093866, " by", false], [61566, 0.079639, " altogether", false], [46, 0.078035, "-", false], [47, 0.063316, ".", false], [52224, 0.051303, " methods", false], [4596, 0.033076, " in", false], [4424, 0.032295, " at", false], [56131, 0.029959, " entirely", false]]], "qwen": [553, 5, 0.06609392911195755, [[11, 0.249933, ",", false], [5980, 0.190714, "-based", false], [13, 0.076707, ".", false], [323, 0.074601, " and", false], [553, 0.066094, " by", false], [30055, 0.035941, " altogether", false], [5413, 0.028147, " methods", false], [304, 0.026033, " in", false], [320, 0.025177, " (", false], [518, 0.020442, " at", false]]]}, "raw_delta": -0.11389279365539551, "tuned_delta": -0.10655565514169277}, {"byte_start": 2274, "byte_end": 2281, "display": {"text": " taking", "kind": "normal"}, "is_word": true, "word_id": 383, "word_key": " taking", "bytes_hex": "20 74 61 6b 69 6e 67", "compression": {"rwkv": "14.57% 14.57% 14.57% 14.57% 14.57% 14.57% 14.57%", "qwen": "11.33% 11.33% 11.33% 11.33% 11.33% 11.33% 11.33%"}, "model_tokens": {"rwkv": [[47497, " taking", "normal", 0.003462399123236537]], "qwen": [[4633, " taking", "normal", 0.012311335653066635]]}, "loss": {"rwkv": 14.571863973264641, "qwen": 11.328337514157404}, "topk": {"rwkv": [47497, 52, 0.003462399123236537, [[40085, 0.082163, " using", false], [38720, 0.076843, " human", false], [38888, 0.047545, " lever", false], [31044, 0.04487, " hand", false], [46227, 0.031016, " humans", false], [38989, 0.027069, " means", false], [61857, 0.024385, " developing", false], [61984, 0.021108, " exploiting", false], [56537, 0.020513, " learning", false], [47629, 0.019095, " trying", false]]], "qwen": [4633, 10, 0.012311335653066635, [[76482, 0.19438, " leveraging", false], [1667, 0.092285, " using", false], [70601, 0.072228, " exploiting", false], [38561, 0.036308, " relying", false], [11220, 0.028414, " developing", false], [3738, 0.022611, " human", false], [4460, 0.020352, " trying", false], [3259, 0.019752, " making", false], [9271, 0.012575, " finding", false], [4633, 0.012311, " taking", false]]]}, "raw_delta": 0.1798592976161412, "tuned_delta": 0.18719643612984393}, {"byte_start": 2281, "byte_end": 2291, "display": {"text": " advantage", "kind": "normal"}, "is_word": true, "word_id": 384, "word_key": " advantage", "bytes_hex": "20 61 64 76 61 6e 74 61 67 65", "compression": {"rwkv": "0.54% 0.54% 0.54% 0.54% 0.54% 0.54% 0.54% 0.54% 0.54% 0.54%", "qwen": "0.21% 0.21% 0.21% 0.21% 0.21% 0.21% 0.21% 0.21% 0.21% 0.21%"}, "model_tokens": {"rwkv": [[59093, " advantage", "normal", 0.7435867786407471]], "qwen": [[9423, " advantage", "normal", 0.8883240818977356]]}, "loss": {"rwkv": 0.5353751128298887, "qwen": 0.21355244304141213}, "topk": {"rwkv": [59093, 1, 0.7435867786407471, [[59093, 0.743587, " advantage", false], [38720, 0.048959, " human", false], [332, 0.031887, " a", false], [22590, 0.024873, " the", false], [31044, 0.010123, " hand", false], [45929, 0.005852, " expert", false], [4419, 0.00574, " an", false], [30923, 0.004843, " full", false], [46227, 0.004628, " humans", false], [31162, 0.004046, " into", false]]], "qwen": [9423, 1, 0.8883240818977356, [[9423, 0.888324, " advantage", false], [3738, 0.020714, " human", false], [264, 0.013984, " a", false], [279, 0.010219, " the", false], [3281, 0.004454, " special", false], [458, 0.003345, " an", false], [1119, 0.003085, " into", false], [19760, 0.00281, " inspiration", false], [22146, 0.002526, " advantages", false], [2480, 0.001395, " full", false]]]}, "raw_delta": 0.01784563809633255, "tuned_delta": 0.025182776610035287}, {"byte_start": 2291, "byte_end": 2294, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 385, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "0.03% 0.03% 0.03%", "qwen": "0.02% 0.02% 0.02%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.9947741627693176]], "qwen": [[315, " of", "normal", 0.997437596321106]]}, "loss": {"rwkv": 0.03155308367829662, "qwen": 0.015422807340620752}, "topk": {"rwkv": [4706, 1, 0.9947741627693176, [[4706, 0.994774, " of", false], [38720, 0.001486, " human", false], [45, 0.001225, ",", false], [52028, 0.000407, " instead", false], [22590, 0.000232, " the", false], [275, 0.000226, " (", false], [4596, 0.000171, " in", false], [31581, 0.000149, " only", false], [4423, 7.6e-05, " as", false], [21265, 5.6e-05, " and", false]]], "qwen": [315, 1, 0.997437596321106, [[315, 0.997438, " of", false], [3738, 0.000296, " human", false], [1172, 0.0002, " only", false], [11, 0.000194, ",", false], [4518, 0.000167, " instead", false], [320, 0.000163, " (", false], [916, 0.000138, " over", false], [279, 9.3e-05, " the", false], [198, 9e-05, "\n", false], [220, 7.1e-05, " ", false]]]}, "raw_delta": 0.0008944524452090264, "tuned_delta": 0.008231590958911763}, {"byte_start": 2294, "byte_end": 2300, "display": {"text": " human", "kind": "normal"}, "is_word": true, "word_id": 386, "word_key": " human", "bytes_hex": "20 68 75 6d 61 6e", "compression": {"rwkv": "2.62% 2.62% 2.62% 2.62% 2.62% 2.62%", "qwen": "6.58% 6.58% 6.58% 6.58% 6.58% 6.58%"}, "model_tokens": {"rwkv": [[38720, " human", "normal", 0.4173719584941864]], "qwen": [[3738, " human", "normal", 0.11216458678245544]]}, "loss": {"rwkv": 2.618172152654938, "qwen": 6.575647733393941}, "topk": {"rwkv": [38720, 1, 0.4173719584941864, [[38720, 0.417372, " human", false], [22590, 0.184514, " the", false], [52964, 0.037001, " special", false], [59943, 0.032043, " knowledge", false], [59792, 0.017825, " heuristic", false], [332, 0.015341, " a", false], [45775, 0.014989, " domain", false], [51832, 0.013362, " general", false], [31044, 0.012728, " hand", false], [46227, 0.011162, " humans", false]]], "qwen": [3738, 3, 0.11216458678245544, [[279, 0.509798, " the", false], [5994, 0.117232, " Go", false], [3738, 0.112165, " human", false], [3281, 0.049416, " special", false], [264, 0.015319, " a", false], [6540, 0.010242, " knowledge", false], [7947, 0.005956, " domain", false], [5888, 0.005153, " properties", false], [1045, 0.004887, " some", false], [1809, 0.003871, " game", false]]]}, "raw_delta": -0.2194490432739258, "tuned_delta": -0.21211190476022307}, {"byte_start": 2300, "byte_end": 2310, "display": {"text": " knowledge", "kind": "normal"}, "is_word": true, "word_id": 387, "word_key": " knowledge", "bytes_hex": "20 6b 6e 6f 77 6c 65 64 67 65", "compression": {"rwkv": "1.32% 1.32% 1.32% 1.32% 1.32% 1.32% 1.32% 1.32% 1.32% 1.32%", "qwen": "1.42% 1.42% 1.42% 1.42% 1.42% 1.42% 1.42% 1.42% 1.42% 1.42%"}, "model_tokens": {"rwkv": [[59943, " knowledge", "normal", 0.4794679284095764]], "qwen": [[6540, " knowledge", "normal", 0.45614248514175415]]}, "loss": {"rwkv": 1.3173045539366997, "qwen": 1.4155544802541344}, "topk": {"rwkv": [59943, 1, 0.4794679284095764, [[59943, 0.479468, " knowledge", false], [65034, 0.169094, " understanding", false], [59683, 0.047853, " expertise", false], [46, 0.041428, "-", false], [38786, 0.032535, " input", false], [59917, 0.030823, " intuition", false], [52022, 0.013833, " insight", false], [38013, 0.008111, " chess", false], [31702, 0.007905, " play", false], [62418, 0.006792, " psychology", false]]], "qwen": [6540, 1, 0.45614248514175415, [[6540, 0.456142, " knowledge", false], [8660, 0.220656, " understanding", false], [1946, 0.077828, " input", false], [18726, 0.045055, " expertise", false], [12646, 0.020202, "-k", false], [56251, 0.018437, " intuition", false], [71107, 0.007661, "-under", false], [20017, 0.00634, " insight", false], [5994, 0.004771, " Go", false], [6203, 0.004634, " expert", false]]]}, "raw_delta": -0.005448132753372192, "tuned_delta": 0.0018890057603305442}, {"byte_start": 2310, "byte_end": 2311, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "36.91%", "qwen": "45.93%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.1284930408000946]], "qwen": [[11, ",", "normal", 0.07831751555204391]]}, "loss": {"rwkv": 36.91270514774496, "qwen": 45.931514055087085}, "topk": {"rwkv": [45, 3, 0.1284930408000946, [[4706, 0.488144, " of", false], [47, 0.164439, ".", false], [45, 0.128493, ",", false], [37598, 0.062634, " about", false], [21265, 0.056146, " and", false], [4596, 0.025345, " in", false], [275, 0.018066, " (", false], [4811, 0.009671, " to", false], [60, 0.007168, ";", false], [59, 0.003624, ":", false]]], "qwen": [11, 4, 0.07831751555204391, [[315, 0.576531, " of", false], [911, 0.126413, " about", false], [13, 0.089047, ".", false], [11, 0.078318, ",", false], [429, 0.028862, " that", false], [323, 0.024365, " and", false], [320, 0.016268, " (", false], [304, 0.009154, " in", false], [311, 0.009109, " to", false], [26, 0.005714, ";", false]]]}, "raw_delta": -0.5001089572906494, "tuned_delta": -0.4927718187769467}, {"byte_start": 2311, "byte_end": 2314, "display": {"text": " or", "kind": "normal"}, "is_word": true, "word_id": 388, "word_key": " or", "bytes_hex": "20 6f 72", "compression": {"rwkv": "29.68% 29.68% 29.68%", "qwen": "34.32% 34.32% 34.32%"}, "model_tokens": {"rwkv": [[4715, " or", "normal", 0.007184943184256554]], "qwen": [[476, " or", "normal", 0.003315593581646681]]}, "loss": {"rwkv": 29.6804448516219, "qwen": 34.31882267814688}, "topk": {"rwkv": [4715, 15, 0.007184943184256554, [[21400, 0.381282, " but", false], [21265, 0.189607, " and", false], [32139, 0.031424, " such", false], [59841, 0.021942, " including", false], [32487, 0.021907, " with", false], [40186, 0.018878, " which", false], [4596, 0.017954, " in", false], [4423, 0.017325, " as", false], [61953, 0.010099, " especially", false], [31581, 0.009887, " only", false]]], "qwen": [476, 25, 0.003315593581646681, [[714, 0.434782, " but", false], [323, 0.181965, " and", false], [448, 0.038411, " with", false], [1741, 0.030794, " such", false], [2670, 0.028073, " including", false], [1172, 0.024085, " only", false], [892, 0.023578, " which", false], [3080, 0.011885, " until", false], [304, 0.010632, " in", false], [438, 0.00972, " as", false]]]}, "raw_delta": -0.2572062810262046, "tuned_delta": -0.24986914251250184}, {"byte_start": 2314, "byte_end": 2317, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 389, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "16.91% 16.91% 16.91%", "qwen": "20.35% 20.35% 20.35%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.05976875498890877]], "qwen": [[315, " of", "normal", 0.03386511653661728]]}, "loss": {"rwkv": 16.90658251041754, "qwen": 20.350234124306272}, "topk": {"rwkv": [4706, 3, 0.05976875498890877, [[4450, 0.195898, " by", false], [4424, 0.074449, " at", false], [4706, 0.059769, " of", false], [4404, 0.045314, " ``", false], [30788, 0.039335, " even", false], [4596, 0.026464, " in", false], [31458, 0.025246, " more", false], [59943, 0.023925, " knowledge", false], [45, 0.022975, ",", false], [40085, 0.022758, " using", false]]], "qwen": [315, 7, 0.03386511653661728, [[9902, 0.18007, " ``", false], [11, 0.061641, ",", false], [518, 0.060405, " at", false], [553, 0.057777, " by", false], [304, 0.05474, " in", false], [1496, 0.033909, " even", false], [315, 0.033865, " of", false], [773, 0.029784, " so", false], [4751, 0.028175, " rather", false], [1119, 0.021958, " into", false]]]}, "raw_delta": -0.19095659255981445, "tuned_delta": -0.1836194540461117}, {"byte_start": 2317, "byte_end": 2321, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 390, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "10.99% 10.99% 10.99% 10.99%", "qwen": "6.59% 6.59% 6.59% 6.59%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.08757662773132324]], "qwen": [[279, " the", "normal", 0.23200125992298126]]}, "loss": {"rwkv": 10.9892786317714, "qwen": 6.586860823081602}, "topk": {"rwkv": [22590, 1, 0.08757662773132324, [[22590, 0.087577, " the", false], [38720, 0.067338, " human", false], [59792, 0.044686, " heuristic", false], [59943, 0.039669, " knowledge", false], [31044, 0.039512, " hand", false], [4404, 0.034781, " ``", false], [39193, 0.034321, " other", false], [332, 0.021453, " a", false], [32074, 0.018961, " some", false], [52964, 0.013585, " special", false]]], "qwen": [279, 1, 0.23200125992298126, [[279, 0.232001, " the", false], [3281, 0.062086, " special", false], [3738, 0.054244, " human", false], [5994, 0.043076, " Go", false], [1008, 0.037108, " other", false], [264, 0.033044, " a", false], [1045, 0.021499, " some", false], [9902, 0.019784, " ``", false], [1667, 0.007692, " using", false], [27076, 0.007412, " specialized", false]]]}, "raw_delta": 0.24412187933921814, "tuned_delta": 0.25145901785292085}, {"byte_start": 2321, "byte_end": 2329, "display": {"text": " special", "kind": "normal"}, "is_word": true, "word_id": 391, "word_key": " special", "bytes_hex": "20 73 70 65 63 69 61 6c", "compression": {"rwkv": "5.57% 5.57% 5.57% 5.57% 5.57% 5.57% 5.57% 5.57%", "qwen": "3.71% 3.71% 3.71% 3.71% 3.71% 3.71% 3.71% 3.71%"}, "model_tokens": {"rwkv": [[52964, " special", "normal", 0.08480515331029892]], "qwen": [[3281, " special", "normal", 0.1932644546031952]]}, "loss": {"rwkv": 5.565083409679106, "qwen": 3.7052372258510644}, "topk": {"rwkv": [52964, 2, 0.08480515331029892, [[60572, 0.127585, " structure", false], [52964, 0.084805, " special", false], [38720, 0.059464, " human", false], [30808, 0.028467, " fact", false], [62293, 0.026341, " particular", false], [4404, 0.021674, " ``", false], [30941, 0.019235, " game", false], [39558, 0.013855, " rules", false], [57271, 0.012155, " specific", false], [47484, 0.011488, " symmet", false]]], "qwen": [3281, 1, 0.1932644546031952, [[3281, 0.193264, " special", false], [5944, 0.122526, " structure", false], [2097, 0.03143, " fact", false], [5994, 0.02518, " Go", false], [1809, 0.020541, " game", false], [3738, 0.017236, " human", false], [7199, 0.01705, " limited", false], [9902, 0.012231, " ``", false], [1602, 0.011476, " very", false], [9981, 0.009489, " apparent", false]]]}, "raw_delta": 0.10313177108764648, "tuned_delta": 0.11046890960134922}, {"byte_start": 2329, "byte_end": 2338, "display": {"text": " features", "kind": "normal"}, "is_word": true, "word_id": 392, "word_key": " features", "bytes_hex": "20 66 65 61 74 75 72 65 73", "compression": {"rwkv": "9.08% 9.08% 9.08% 9.08% 9.08% 9.08% 9.08% 9.08% 9.08%", "qwen": "8.23% 8.23% 8.23% 8.23% 8.23% 8.23% 8.23% 8.23% 8.23%"}, "model_tokens": {"rwkv": [[56215, " features", "normal", 0.010999530553817749]], "qwen": [[4419, " features", "normal", 0.0164879709482193]]}, "loss": {"rwkv": 9.079460977816826, "qwen": 8.225613933782384}, "topk": {"rwkv": [56215, 6, 0.010999530553817749, [[60572, 0.671288, " structure", false], [46642, 0.031629, " nature", false], [62404, 0.031195, " properties", false], [62586, 0.019539, " structures", false], [65258, 0.012082, " characteristics", false], [56215, 0.011, " features", false], [56353, 0.009929, " hardware", false], [39558, 0.007128, " rules", false], [39654, 0.007115, " shape", false], [56310, 0.006932, " geometry", false]]], "qwen": [4419, 4, 0.0164879709482193, [[5944, 0.698773, " structure", false], [5888, 0.067933, " properties", false], [6993, 0.024992, " nature", false], [4419, 0.016488, " features", false], [14389, 0.009091, " structures", false], [1809, 0.006874, " game", false], [17452, 0.00664, " characteristics", false], [6540, 0.00576, " knowledge", false], [5601, 0.005621, " rules", false], [45120, 0.004294, " symmetry", false]]]}, "raw_delta": 0.047347333696153404, "tuned_delta": 0.054684472209856144}, {"byte_start": 2338, "byte_end": 2341, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 393, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "0.18% 0.18% 0.18%", "qwen": "0.21% 0.21% 0.21%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.9708913564682007]], "qwen": [[315, " of", "normal", 0.9655314683914185]]}, "loss": {"rwkv": 0.17757781977087866, "qwen": 0.21085330521885146}, "topk": {"rwkv": [4706, 1, 0.9708913564682007, [[4706, 0.970891, " of", false], [32227, 0.007583, " that", false], [21265, 0.004214, " and", false], [4596, 0.003079, " in", false], [275, 0.002844, " (", false], [45, 0.00093, ",", false], [4715, 0.000526, " or", false], [47660, 0.0005, " unique", false], [32139, 0.000356, " such", false], [56454, 0.00035, " inherent", false]]], "qwen": [315, 1, 0.9655314683914185, [[315, 0.965531, " of", false], [304, 0.006975, " in", false], [429, 0.006378, " that", false], [323, 0.004845, " and", false], [36988, 0.002197, " inherent", false], [320, 0.001166, " (", false], [11, 0.001155, ",", false], [3042, 0.000999, " present", false], [4911, 0.000969, " unique", false], [476, 0.000662, " or", false]]]}, "raw_delta": -0.001845184713602066, "tuned_delta": 0.0054919538001006706}, {"byte_start": 2341, "byte_end": 2345, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 394, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "3.75% 3.75% 3.75% 3.75%", "qwen": "5.12% 5.12% 5.12% 5.12%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.4325893223285675]], "qwen": [[279, " the", "normal", 0.3214719593524933]]}, "loss": {"rwkv": 3.7511479944988912, "qwen": 5.116360250638249}, "topk": {"rwkv": [22590, 1, 0.4325893223285675, [[22590, 0.432589, " the", false], [3851, 0.235731, " Go", false], [37876, 0.062621, " board", false], [332, 0.024545, " a", false], [62293, 0.018514, " particular", false], [30941, 0.017006, " game", false], [52491, 0.013592, " playing", false], [38576, 0.01121, " games", false], [51161, 0.007022, " certain", false], [32234, 0.006821, " this", false]]], "qwen": [279, 2, 0.3214719593524933, [[5994, 0.547585, " Go", false], [279, 0.321472, " the", false], [419, 0.021368, " this", false], [264, 0.011347, " a", false], [4479, 0.008572, " board", false], [3738, 0.005747, " human", false], [32719, 0.00415, " chess", false], [6366, 0.003771, " computer", false], [728, 0.003709, " go", false], [9902, 0.003297, " ``", false]]]}, "raw_delta": -0.0757034420967102, "tuned_delta": -0.06836630358300747}, {"byte_start": 2345, "byte_end": 2350, "display": {"text": " game", "kind": "normal"}, "is_word": true, "word_id": 395, "word_key": " game", "bytes_hex": "20 67 61 6d 65", "compression": {"rwkv": "3.78% 3.78% 3.78% 3.78% 3.78%", "qwen": "4.66% 4.66% 4.66% 4.66% 4.66%"}, "model_tokens": {"rwkv": [[30941, " game", "normal", 0.3533889651298523]], "qwen": [[1809, " game", "normal", 0.275059312582016]]}, "loss": {"rwkv": 3.7758034273265837, "qwen": 4.655463299656067}, "topk": {"rwkv": [30941, 1, 0.3533889651298523, [[30941, 0.353389, " game", false], [37876, 0.270152, " board", false], [3851, 0.135271, " Go", false], [62293, 0.021198, " particular", false], [45775, 0.016289, " domain", false], [22638, 0.007942, " two", false], [52569, 0.007173, " problem", false], [52491, 0.006801, " playing", false], [38720, 0.006326, " human", false], [39558, 0.006011, " rules", false]]], "qwen": [1809, 2, 0.275059312582016, [[5994, 0.436529, " Go", false], [1809, 0.275059, " game", false], [4479, 0.128263, " board", false], [7947, 0.017312, " domain", false], [220, 0.008379, " ", false], [3738, 0.004586, " human", false], [3953, 0.004514, " particular", false], [2613, 0.004435, " small", false], [3491, 0.00443, " problem", false], [5944, 0.004076, " structure", false]]]}, "raw_delta": -0.04877870082855226, "tuned_delta": -0.04144156231484952}, {"byte_start": 2350, "byte_end": 2351, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "29.45%", "qwen": "29.58%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.19347816705703735]], "qwen": [[11, ",", "normal", 0.19395911693572998]]}, "loss": {"rwkv": 29.445631205643878, "qwen": 29.57719578377079}, "topk": {"rwkv": [45, 2, 0.19347816705703735, [[47, 0.356938, ".", false], [45, 0.193478, ",", false], [4706, 0.09627, " of", false], [275, 0.070143, " (", false], [32139, 0.035664, " such", false], [32227, 0.031594, " that", false], [460, 0.030245, "'s", false], [60572, 0.024385, " structure", false], [46342, 0.022294, " itself", false], [37876, 0.010796, " board", false]]], "qwen": [11, 2, 0.19395911693572998, [[13, 0.347763, ".", false], [11, 0.193959, ",", false], [315, 0.146011, " of", false], [4479, 0.062257, " board", false], [5086, 0.059378, " itself", false], [320, 0.048018, " (", false], [5994, 0.014755, " Go", false], [429, 0.014364, " that", false], [1741, 0.009644, " such", false], [323, 0.008801, " and", false]]]}, "raw_delta": -0.007295489311218262, "tuned_delta": 4.164920248447487e-05}, {"byte_start": 2351, "byte_end": 2355, "display": {"text": " but", "kind": "normal"}, "is_word": true, "word_id": 396, "word_key": " but", "bytes_hex": "20 62 75 74", "compression": {"rwkv": "5.81% 5.81% 5.81% 5.81%", "qwen": "5.01% 5.01% 5.01% 5.01%"}, "model_tokens": {"rwkv": [[21400, " but", "normal", 0.2766144275665283]], "qwen": [[714, " but", "normal", 0.3293311893939972]]}, "loss": {"rwkv": 5.811637737956029, "qwen": 5.007465673123974}, "topk": {"rwkv": [21400, 1, 0.2766144275665283, [[21400, 0.276614, " but", false], [32139, 0.202373, " such", false], [4715, 0.142192, " or", false], [21265, 0.107633, " and", false], [31296, 0.028154, " like", false], [4596, 0.025608, " in", false], [4811, 0.015871, " to", false], [59841, 0.015543, " including", false], [4423, 0.012479, " as", false], [47001, 0.011773, " rather", false]]], "qwen": [714, 1, 0.3293311893939972, [[714, 0.329331, " but", false], [323, 0.146605, " and", false], [476, 0.131584, " or", false], [1741, 0.044465, " such", false], [3080, 0.036367, " until", false], [1172, 0.026147, " only", false], [892, 0.023762, " which", false], [448, 0.02018, " with", false], [2670, 0.018039, " including", false], [304, 0.016751, " in", false]]]}, "raw_delta": 0.04459276795387268, "tuned_delta": 0.05192990646757542}, {"byte_start": 2355, "byte_end": 2359, "display": {"text": " all", "kind": "normal"}, "is_word": true, "word_id": 397, "word_key": " all", "bytes_hex": "20 61 6c 6c", "compression": {"rwkv": "18.32% 18.32% 18.32% 18.32%", "qwen": "21.68% 21.68% 21.68% 21.68%"}, "model_tokens": {"rwkv": [[21256, " all", "normal", 0.017056068405508995]], "qwen": [[678, " all", "normal", 0.00816090777516365]]}, "loss": {"rwkv": 18.315464386285665, "qwen": 21.678297052967693}, "topk": {"rwkv": [21256, 12, 0.017056068405508995, [[39936, 0.166694, " these", false], [22590, 0.096323, " the", false], [32465, 0.087044, " when", false], [32234, 0.072538, " this", false], [4596, 0.059055, " in", false], [4601, 0.037027, " it", false], [4423, 0.02839, " as", false], [32232, 0.027402, " they", false], [32230, 0.021441, " then", false], [61959, 0.019798, " eventually", false]]], "qwen": [678, 25, 0.00816090777516365, [[1493, 0.137282, " these", false], [279, 0.095442, " the", false], [419, 0.089494, " this", false], [432, 0.06762, " it", false], [9583, 0.064241, " eventually", false], [304, 0.043861, " in", false], [979, 0.037487, " when", false], [1172, 0.029987, " only", false], [1221, 0.024956, " then", false], [11, 0.023043, ",", false]]]}, "raw_delta": -0.18647503852844238, "tuned_delta": -0.17913790001473964}, {"byte_start": 2359, "byte_end": 2365, "display": {"text": " those", "kind": "normal"}, "is_word": true, "word_id": 398, "word_key": " those", "bytes_hex": "20 74 68 6f 73 65", "compression": {"rwkv": "10.57% 10.57% 10.57% 10.57% 10.57% 10.57%", "qwen": "12.36% 12.36% 12.36% 12.36% 12.36% 12.36%"}, "model_tokens": {"rwkv": [[39944, " those", "normal", 0.030141286551952362]], "qwen": [[1846, " those", "normal", 0.01638016290962696]]}, "loss": {"rwkv": 10.566614069010962, "qwen": 12.358138711594995}, "topk": {"rwkv": [39944, 9, 0.030141286551952362, [[4706, 0.250124, " of", false], [39936, 0.159733, " these", false], [32139, 0.077698, " such", false], [45953, 0.072466, " failed", false], [32234, 0.066598, " this", false], [32462, 0.061453, " were", false], [32227, 0.044146, " that", false], [22590, 0.036933, " the", false], [39944, 0.030141, " those", false], [46936, 0.024968, " proved", false]]], "qwen": [1846, 11, 0.01638016290962696, [[315, 0.231068, " of", false], [1493, 0.211625, " these", false], [419, 0.083974, " this", false], [429, 0.068219, " that", false], [1741, 0.039104, " such", false], [1033, 0.033162, " were", false], [4641, 0.032745, " failed", false], [279, 0.027002, " the", false], [8869, 0.020748, " efforts", false], [304, 0.020119, " in", false]]]}, "raw_delta": -0.09934322039286292, "tuned_delta": -0.09200608187916018}, {"byte_start": 2365, "byte_end": 2373, "display": {"text": " efforts", "kind": "normal"}, "is_word": true, "word_id": 399, "word_key": " efforts", "bytes_hex": "20 65 66 66 6f 72 74 73", "compression": {"rwkv": "1.51% 1.51% 1.51% 1.51% 1.51% 1.51% 1.51% 1.51%", "qwen": "1.16% 1.16% 1.16% 1.16% 1.16% 1.16% 1.16% 1.16%"}, "model_tokens": {"rwkv": [[51566, " efforts", "normal", 0.5074682831764221]], "qwen": [[8869, " efforts", "normal", 0.5964605808258057]]}, "loss": {"rwkv": 1.514548016558238, "qwen": 1.164845749811886}, "topk": {"rwkv": [51566, 1, 0.5074682831764221, [[51566, 0.507468, " efforts", false], [52224, 0.117665, " methods", false], [61590, 0.078472, " approaches", false], [38720, 0.023063, " human", false], [55572, 0.019791, " attempts", false], [32462, 0.018326, " were", false], [38328, 0.011677, " early", false], [22762, 0.010225, " who", false], [45953, 0.00944, " failed", false], [32227, 0.00718, " that", false]]], "qwen": [8869, 1, 0.5964605808258057, [[8869, 0.596461, " efforts", false], [5413, 0.095559, " methods", false], [19827, 0.069919, " approaches", false], [13553, 0.038784, " attempts", false], [4124, 0.02333, " early", false], [1635, 0.008638, " years", false], [2856, 0.007268, " initial", false], [12538, 0.005982, " techniques", false], [6708, 0.005706, " ideas", false], [3412, 0.005579, " research", false]]]}, "raw_delta": 0.019391611218452454, "tuned_delta": 0.02672874973215519}, {"byte_start": 2373, "byte_end": 2380, "display": {"text": " proved", "kind": "normal"}, "is_word": true, "word_id": 400, "word_key": " proved", "bytes_hex": "20 70 72 6f 76 65 64", "compression": {"rwkv": "6.48% 6.48% 6.48% 6.48% 6.48% 6.48% 6.48%", "qwen": "7.26% 7.26% 7.26% 7.26% 7.26% 7.26% 7.26%"}, "model_tokens": {"rwkv": [[46936, " proved", "normal", 0.07995548844337463]], "qwen": [[18651, " proved", "normal", 0.05967317521572113]]}, "loss": {"rwkv": 6.48085662899339, "qwen": 7.262095805446487}, "topk": {"rwkv": [46936, 3, 0.07995548844337463, [[32462, 0.355696, " were", false], [45953, 0.147377, " failed", false], [46936, 0.079955, " proved", false], [62676, 0.043323, " ultimately", false], [30383, 0.025952, " came", false], [21532, 0.022537, " did", false], [38367, 0.020028, " ended", false], [61959, 0.01987, " eventually", false], [32460, 0.014106, " went", false], [31059, 0.013414, " have", false]]], "qwen": [18651, 3, 0.05967317521572113, [[1033, 0.367029, " were", false], [4641, 0.179818, " failed", false], [18651, 0.059673, " proved", false], [13653, 0.048752, " ultimately", false], [9583, 0.031623, " eventually", false], [9482, 0.028981, " ended", false], [11, 0.015861, ",", false], [11052, 0.014836, " fell", false], [614, 0.014054, " have", false], [3697, 0.012633, " came", false]]]}, "raw_delta": -0.04332109860011507, "tuned_delta": -0.03598396008641233}, {"byte_start": 2380, "byte_end": 2391, "display": {"text": " irrelevant", "kind": "normal"}, "is_word": true, "word_id": 401, "word_key": " irrelevant", "bytes_hex": "20 69 72 72 65 6c 65 76 61 6e 74", "compression": {"rwkv": "8.35% 8.35% 8.35% 8.35% 8.35% 8.35% 8.35% 8.35% 8.35% 8.35% 8.35%", "qwen": "10.89% 10.89% 10.89% 10.89% 10.89% 10.89% 10.89% 10.89% 10.89% 10.89% 10.89%"}, "model_tokens": {"rwkv": [[62161, " irrelevant", "normal", 0.006078746169805527]], "qwen": [[39715, " irrelevant", "normal", 0.0013073112349957228]]}, "loss": {"rwkv": 8.350827118781995, "qwen": 10.885433943701791}, "topk": {"rwkv": [62161, 23, 0.006078746169805527, [[4811, 0.193784, " to", false], [62676, 0.104622, " ultimately", false], [62088, 0.069425, " inadequate", false], [63631, 0.058628, " ineffective", false], [21719, 0.058389, " fut", false], [64450, 0.042278, " insufficient", false], [31277, 0.038941, " less", false], [64616, 0.02663, " unsuccessful", false], [38562, 0.021994, " fruit", false], [47650, 0.01836, " unable", false]]], "qwen": [39715, 63, 0.0013073112349957228, [[44925, 0.188567, " unsuccessful", false], [13779, 0.135968, " fruit", false], [311, 0.112288, " to", false], [84527, 0.065561, " futile", false], [38313, 0.053151, " insufficient", false], [54188, 0.041893, " ineffective", false], [13653, 0.034876, " ultimately", false], [45479, 0.024206, " inadequate", false], [38123, 0.017821, " disappointing", false], [2238, 0.01687, " too", false]]]}, "raw_delta": -0.1405484459616921, "tuned_delta": -0.13321130744798937}, {"byte_start": 2391, "byte_end": 2392, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "63.96%", "qwen": "49.52%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.02906819060444832]], "qwen": [[11, ",", "normal", 0.06418482959270477]]}, "loss": {"rwkv": 63.96323716441302, "qwen": 49.520297528472675}, "topk": {"rwkv": [45, 7, 0.02906819060444832, [[32465, 0.277863, " when", false], [4811, 0.182514, " to", false], [4596, 0.152418, " in", false], [47, 0.127229, ".", false], [4423, 0.066178, " as", false], [31578, 0.037939, " once", false], [45, 0.029068, ",", false], [55794, 0.016874, " compared", false], [21265, 0.015047, " and", false], [51018, 0.011938, " because", false]]], "qwen": [11, 6, 0.06418482959270477, [[13, 0.225093, ".", false], [979, 0.184171, " when", false], [304, 0.139454, " in", false], [311, 0.097434, " to", false], [438, 0.075705, " as", false], [11, 0.064185, ",", false], [3055, 0.046634, " once", false], [1283, 0.021483, " after", false], [369, 0.014886, " for", false], [323, 0.014392, " and", false]]]}, "raw_delta": 0.8008866310119629, "tuned_delta": 0.8082237695256657}, {"byte_start": 2392, "byte_end": 2395, "display": {"text": " or", "kind": "normal"}, "is_word": true, "word_id": 402, "word_key": " or", "bytes_hex": "20 6f 72", "compression": {"rwkv": "18.97% 18.97% 18.97%", "qwen": "25.52% 25.52% 25.52%"}, "model_tokens": {"rwkv": [[4715, " or", "normal", 0.042305782437324524]], "qwen": [[476, " or", "normal", 0.01434085238724947]]}, "loss": {"rwkv": 18.972942595024126, "qwen": 25.515523797412175}, "topk": {"rwkv": [4715, 5, 0.042305782437324524, [[21265, 0.32769, " and", false], [4423, 0.135105, " as", false], [51018, 0.067449, " because", false], [4596, 0.053281, " in", false], [4715, 0.042306, " or", false], [32465, 0.04056, " when", false], [40187, 0.033892, " while", false], [31578, 0.020258, " once", false], [39690, 0.019332, " since", false], [32487, 0.015702, " with", false]]], "qwen": [476, 8, 0.01434085238724947, [[323, 0.510421, " and", false], [438, 0.138638, " as", false], [1576, 0.072281, " because", false], [2474, 0.031531, " since", false], [1496, 0.024779, " even", false], [304, 0.017724, " in", false], [448, 0.016665, " with", false], [476, 0.014341, " or", false], [369, 0.013842, " for", false], [518, 0.010165, " at", false]]]}, "raw_delta": -0.36279773712158203, "tuned_delta": -0.3554605986078793}, {"byte_start": 2395, "byte_end": 2401, "display": {"text": " worse", "kind": "normal"}, "is_word": true, "word_id": 403, "word_key": " worse", "bytes_hex": "20 77 6f 72 73 65", "compression": {"rwkv": "7.65% 7.65% 7.65% 7.65% 7.65% 7.65%", "qwen": "6.50% 6.50% 6.50% 6.50% 6.50% 6.50%"}, "model_tokens": {"rwkv": [[40216, " worse", "normal", 0.07876795530319214]], "qwen": [[10960, " worse", "normal", 0.1149168461561203]]}, "loss": {"rwkv": 7.654924858883497, "qwen": 6.502787283355913}, "topk": {"rwkv": [40216, 2, 0.07876795530319214, [[4424, 0.364148, " at", false], [40216, 0.078768, " worse", false], [30788, 0.052791, " even", false], [31581, 0.028107, " only", false], [31277, 0.020633, " less", false], [22187, 0.015001, " not", false], [62161, 0.014878, " irrelevant", false], [63631, 0.013968, " ineffective", false], [22614, 0.013547, " too", false], [51336, 0.010361, " counter", false]]], "qwen": [10960, 2, 0.1149168461561203, [[518, 0.291973, " at", false], [10960, 0.114917, " worse", false], [1496, 0.109925, " even", false], [1033, 0.072651, " were", false], [11, 0.019511, ",", false], [304, 0.019083, " in", false], [1172, 0.018328, " only", false], [4751, 0.0173, " rather", false], [1602, 0.008229, " very", false], [421, 0.007831, " if", false]]]}, "raw_delta": 0.0638880729675293, "tuned_delta": 0.07122521148123204}, {"byte_start": 2401, "byte_end": 2402, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "3.63%", "qwen": "5.24%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.817914605140686]], "qwen": [[11, ",", "normal", 0.7480016350746155]]}, "loss": {"rwkv": 3.62787083036043, "qwen": 5.2360832858074735}, "topk": {"rwkv": [45, 1, 0.817914605140686, [[45, 0.817915, ",", false], [47, 0.135256, ".", false], [32226, 0.008731, " than", false], [59, 0.005737, ":", false], [275, 0.003944, " (", false], [39820, 0.003645, " still", false], [4596, 0.002625, " in", false], [22797, 0.001886, " yet", false], [32465, 0.001794, " when", false], [62161, 0.001486, " irrelevant", false]]], "qwen": [11, 1, 0.7480016350746155, [[11, 0.748002, ",", false], [13, 0.156205, ".", false], [1091, 0.024821, " than", false], [25, 0.013021, ":", false], [2058, 0.011146, " still", false], [382, 0.007431, ".\n\n", false], [320, 0.006354, " (", false], [3602, 0.006277, " yet", false], [304, 0.002296, " in", false], [1496, 0.001828, " even", false]]]}, "raw_delta": -0.08917823433876038, "tuned_delta": -0.08184109582505764}, {"byte_start": 2402, "byte_end": 2407, "display": {"text": " once", "kind": "normal"}, "is_word": true, "word_id": 404, "word_key": " once", "bytes_hex": "20 6f 6e 63 65", "compression": {"rwkv": "11.05% 11.05% 11.05% 11.05% 11.05%", "qwen": "17.17% 17.17% 17.17% 17.17% 17.17%"}, "model_tokens": {"rwkv": [[31578, " once", "normal", 0.04680713266134262]], "qwen": [[3055, " once", "normal", 0.008549327030777931]]}, "loss": {"rwkv": 11.045633906806126, "qwen": 17.174933919864813}, "topk": {"rwkv": [31578, 5, 0.04680713266134262, [[32465, 0.449328, " when", false], [4596, 0.120948, " in", false], [4423, 0.113755, " as", false], [4811, 0.113299, " to", false], [31578, 0.046807, " once", false], [51018, 0.013608, " because", false], [37634, 0.011977, " after", false], [22590, 0.009124, " the", false], [21265, 0.00582, " and", false], [4424, 0.00492, " at", false]]], "qwen": [3055, 16, 0.008549327030777931, [[979, 0.130104, " when", false], [304, 0.094937, " in", false], [438, 0.081083, " as", false], [311, 0.047145, " to", false], [5546, 0.046519, " counter", false], [807, 0.035521, " they", false], [1033, 0.033083, " were", false], [1576, 0.0218, " because", false], [323, 0.018987, " and", false], [1283, 0.014799, " after", false]]]}, "raw_delta": -0.33988056182861326, "tuned_delta": -0.33254342331491055}, {"byte_start": 2407, "byte_end": 2414, "display": {"text": " search", "kind": "normal"}, "is_word": true, "word_id": 405, "word_key": " search", "bytes_hex": "20 73 65 61 72 63 68", "compression": {"rwkv": "7.17% 7.17% 7.17% 7.17% 7.17% 7.17% 7.17%", "qwen": "5.30% 5.30% 5.30% 5.30% 5.30% 5.30% 5.30%"}, "model_tokens": {"rwkv": [[47202, " search", "normal", 0.061495181173086166]], "qwen": [[2711, " search", "normal", 0.12801995873451233]]}, "loss": {"rwkv": 7.165170682986479, "qwen": 5.295641875914862}, "topk": {"rwkv": [47202, 4, 0.061495181173086166, [[22590, 0.253577, " the", false], [332, 0.096527, " a", false], [51832, 0.083636, " general", false], [47202, 0.061495, " search", false], [30597, 0.045817, " deep", false], [52224, 0.028162, " methods", false], [52195, 0.024438, " massive", false], [63370, 0.020693, " computation", false], [4601, 0.020411, " it", false], [59345, 0.015016, " computers", false]]], "qwen": [2711, 2, 0.12801995873451233, [[279, 0.272289, " the", false], [2711, 0.12802, " search", false], [264, 0.067083, " a", false], [5538, 0.042659, " deep", false], [64098, 0.025337, " brute", false], [5994, 0.021651, " Go", false], [6366, 0.020424, " computer", false], [432, 0.020042, " it", false], [10951, 0.016654, " massive", false], [803, 0.01515, " more", false]]]}, "raw_delta": 0.1036686897277832, "tuned_delta": 0.11100582824148594}, {"byte_start": 2414, "byte_end": 2418, "display": {"text": " was", "kind": "normal"}, "is_word": true, "word_id": 406, "word_key": " was", "bytes_hex": "20 77 61 73", "compression": {"rwkv": "8.45% 8.45% 8.45% 8.45%", "qwen": "9.35% 9.35% 9.35% 9.35%"}, "model_tokens": {"rwkv": [[22748, " was", "normal", 0.15219539403915405]], "qwen": [[572, " was", "normal", 0.12576831877231598]]}, "loss": {"rwkv": 8.45329125520877, "qwen": 9.347373162682981}, "topk": {"rwkv": [22748, 3, 0.15219539403915405, [[45283, 0.236366, " became", false], [46, 0.153231, "-", false], [22748, 0.152195, " was", false], [52224, 0.093136, " methods", false], [21795, 0.033279, " had", false], [21265, 0.014711, " and", false], [32487, 0.014573, " with", false], [61559, 0.013327, " algorithms", false], [62633, 0.012905, " techniques", false], [37810, 0.012044, " based", false]]], "qwen": [572, 3, 0.12576831877231598, [[5980, 0.388347, "-based", false], [6116, 0.183554, " became", false], [572, 0.125768, " was", false], [5413, 0.037246, " methods", false], [1030, 0.026783, " had", false], [18651, 0.025728, " proved", false], [3118, 0.018455, " based", false], [3697, 0.013409, " came", false], [1410, 0.012272, " could", false], [6009, 0.009349, " began", false]]]}, "raw_delta": -0.04957842826843262, "tuned_delta": -0.04224128975472988}, {"byte_start": 2418, "byte_end": 2426, "display": {"text": " applied", "kind": "normal"}, "is_word": true, "word_id": 407, "word_key": " applied", "bytes_hex": "20 61 70 70 6c 69 65 64", "compression": {"rwkv": "6.09% 6.09% 6.09% 6.09% 6.09% 6.09% 6.09% 6.09%", "qwen": "8.78% 8.78% 8.78% 8.78% 8.78% 8.78% 8.78% 8.78%"}, "model_tokens": {"rwkv": [[50937, " applied", "normal", 0.06760700047016144]], "qwen": [[9251, " applied", "normal", 0.0203444492071867]]}, "loss": {"rwkv": 6.093414113129654, "qwen": 8.780032494450476}, "topk": {"rwkv": [50937, 3, 0.06760700047016144, [[59206, 0.087078, " available", false], [31351, 0.080367, " made", false], [50937, 0.067607, " applied", false], [32354, 0.032771, " used", false], [59506, 0.028604, " developed", false], [51744, 0.02755, " finally", false], [51097, 0.026204, " brought", false], [22590, 0.025432, " the", false], [64583, 0.025269, " sufficiently", false], [63616, 0.020609, " implemented", false]]], "qwen": [9251, 12, 0.0203444492071867, [[1865, 0.053315, " made", false], [2500, 0.049449, " available", false], [5499, 0.049129, " finally", false], [11523, 0.040386, " introduced", false], [7117, 0.037536, " brought", false], [1483, 0.036969, " used", false], [11537, 0.035659, " implemented", false], [5420, 0.032594, " allowed", false], [279, 0.023325, " the", false], [3694, 0.021444, " added", false]]]}, "raw_delta": -0.14897775650024414, "tuned_delta": -0.1416406179865414}, {"byte_start": 2426, "byte_end": 2438, "display": {"text": " effectively", "kind": "normal"}, "is_word": true, "word_id": 408, "word_key": " effectively", "bytes_hex": "20 65 66 66 65 63 74 69 76 65 6c 79", "compression": {"rwkv": "8.50% 8.50% 8.50% 8.50% 8.50% 8.50% 8.50% 8.50% 8.50% 8.50% 8.50% 8.50%", "qwen": "6.01% 6.01% 6.01% 6.01% 6.01% 6.01% 6.01% 6.01% 6.01% 6.01% 6.01% 6.01%"}, "model_tokens": {"rwkv": [[63507, " effectively", "normal", 0.003408447140827775]], "qwen": [[13444, " effectively", "normal", 0.018304264172911644]]}, "loss": {"rwkv": 8.500253984404374, "qwen": 6.012163059512656}, "topk": {"rwkv": [63507, 22, 0.003408447140827775, [[47, 0.43855, ".", false], [4811, 0.161787, " to", false], [4596, 0.085154, " in", false], [21265, 0.042884, " and", false], [45, 0.035811, ",", false], [4712, 0.030048, " on", false], [4517, 0.020354, " en", false], [32487, 0.018491, " with", false], [4424, 0.017752, " at", false], [4423, 0.015177, " as", false]]], "qwen": [13444, 9, 0.018304264172911644, [[13, 0.52186, ".", false], [311, 0.097049, " to", false], [382, 0.055723, ".\n\n", false], [304, 0.043837, " in", false], [518, 0.029843, " at", false], [11, 0.029381, ",", false], [448, 0.027847, " with", false], [389, 0.02059, " on", false], [13444, 0.018304, " effectively", false], [323, 0.014927, " and", false]]]}, "raw_delta": 0.1379690567652385, "tuned_delta": 0.14530619527894123}, {"byte_start": 2438, "byte_end": 2441, "display": {"text": " at", "kind": "normal"}, "is_word": true, "word_id": 409, "word_key": " at", "bytes_hex": "20 61 74", "compression": {"rwkv": "32.12% 32.12% 32.12%", "qwen": "30.17% 30.17% 30.17%"}, "model_tokens": {"rwkv": [[4424, " at", "normal", 0.004785093944519758]], "qwen": [[518, " at", "normal", 0.006613673642277718]]}, "loss": {"rwkv": 32.122506769793326, "qwen": 30.16805292972565}, "topk": {"rwkv": [4424, 11, 0.004785093944519758, [[47, 0.566376, ".", false], [4811, 0.223827, " to", false], [21265, 0.057329, " and", false], [45, 0.038662, ",", false], [4596, 0.027702, " in", false], [275, 0.011519, " (", false], [4450, 0.010911, " by", false], [4712, 0.009293, " on", false], [32487, 0.008872, " with", false], [40085, 0.006443, " using", false]]], "qwen": [518, 12, 0.006613673642277718, [[13, 0.617983, ".", false], [382, 0.087803, ".\n\n", false], [311, 0.062098, " to", false], [11, 0.055043, ",", false], [3322, 0.032495, " enough", false], [323, 0.030829, " and", false], [304, 0.020317, " in", false], [553, 0.012897, " by", false], [320, 0.010857, " (", false], [448, 0.010341, " with", false]]]}, "raw_delta": 0.10837793350219727, "tuned_delta": 0.1157150720159}, {"byte_start": 2441, "byte_end": 2447, "display": {"text": " scale", "kind": "normal"}, "is_word": true, "word_id": 410, "word_key": " scale", "bytes_hex": "20 73 63 61 6c 65", "compression": {"rwkv": "5.26% 5.26% 5.26% 5.26% 5.26% 5.26%", "qwen": "5.67% 5.67% 5.67% 5.67% 5.67% 5.67%"}, "model_tokens": {"rwkv": [[39590, " scale", "normal", 0.17481854557991028]], "qwen": [[5452, " scale", "normal", 0.151595801115036]]}, "loss": {"rwkv": 5.259825669907679, "qwen": 5.670204938641484}, "topk": {"rwkv": [39590, 3, 0.17481854557991028, [[332, 0.198232, " a", false], [22590, 0.190199, " the", false], [39590, 0.174819, " scale", false], [38864, 0.088783, " large", false], [21256, 0.036157, " all", false], [52195, 0.032227, " massive", false], [4419, 0.027902, " an", false], [62606, 0.016145, " sufficient", false], [62431, 0.013205, " reasonable", false], [31082, 0.010543, " high", false]]], "qwen": [5452, 3, 0.151595801115036, [[279, 0.230702, " the", false], [264, 0.194575, " a", false], [5452, 0.151596, " scale", false], [678, 0.06696, " all", false], [458, 0.024789, " an", false], [3460, 0.013573, " large", false], [1602, 0.013524, " very", false], [1045, 0.01254, " some", false], [28405, 0.012332, " scales", false], [1550, 0.012189, " high", false]]]}, "raw_delta": -0.0227562586466471, "tuned_delta": -0.015419120132944362}, {"byte_start": 2447, "byte_end": 2448, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "3.56%", "qwen": "5.67%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.8200810551643372]], "qwen": [[13, ".", "normal", 0.7302824258804321]]}, "loss": {"rwkv": 3.557426736567024, "qwen": 5.668420260341593}, "topk": {"rwkv": [47, 1, 0.8200810551643372, [[47, 0.820081, ".", false], [45, 0.043111, ",", false], [4811, 0.041318, " to", false], [21265, 0.028015, " and", false], [275, 0.013228, " (", false], [4596, 0.008781, " in", false], [4450, 0.007929, " by", false], [40085, 0.007204, " using", false], [32487, 0.006512, " with", false], [4712, 0.002872, " on", false]]], "qwen": [13, 1, 0.7302824258804321, [[13, 0.730282, ".", false], [382, 0.108808, ".\n\n", false], [11, 0.040343, ",", false], [311, 0.02045, " to", false], [323, 0.018308, " and", false], [320, 0.016744, " (", false], [304, 0.008748, " in", false], [448, 0.007164, " with", false], [624, 0.006981, ".\n", false], [553, 0.006571, " by", false]]]}, "raw_delta": -0.11705833673477173, "tuned_delta": -0.10972119822106899}, {"byte_start": 2448, "byte_end": 2453, "display": {"text": " Also", "kind": "normal"}, "is_word": true, "word_id": 411, "word_key": " also", "bytes_hex": "20 41 6c 73 6f", "compression": {"rwkv": "27.39% 27.39% 27.39% 27.39% 27.39%", "qwen": "28.49% 28.49% 28.49% 28.49% 28.49%"}, "model_tokens": {"rwkv": [[28402, " Also", "normal", 0.000499704503454268]], "qwen": [[7281, " Also", "normal", 0.0003707799769472331]]}, "loss": {"rwkv": 27.38866366687641, "qwen": 28.49287311726155}, "topk": {"rwkv": [28402, 110, 0.000499704503454268, [[261, 0.298872, "\n\n", false], [20996, 0.123689, " The", false], [3913, 0.036181, " In", false], [267, 0.032975, "  ", false], [29894, 0.028715, " This", false], [36251, 0.028461, " Again", false], [3918, 0.025146, " It", false], [300, 0.017857, " A", false], [29511, 0.016831, " Once", false], [37451, 0.016446, " There", false]]], "qwen": [7281, 176, 0.0003707799769472331, [[576, 0.178201, " The", false], [758, 0.057772, " In", false], [1096, 0.054582, " This", false], [220, 0.050601, " ", false], [1084, 0.038084, " It", false], [13759, 0.030587, " Again", false], [4220, 0.022767, " These", false], [362, 0.022738, " A", false], [320, 0.020443, " (", false], [2619, 0.020139, " There", false]]]}, "raw_delta": -0.061230373382568315, "tuned_delta": -0.053893234868865575}, {"byte_start": 2453, "byte_end": 2463, "display": {"text": " important", "kind": "normal"}, "is_word": true, "word_id": 412, "word_key": " important", "bytes_hex": "20 69 6d 70 6f 72 74 61 6e 74", "compression": {"rwkv": "14.99% 14.99% 14.99% 14.99% 14.99% 14.99% 14.99% 14.99% 14.99% 14.99%", "qwen": "11.92% 11.92% 11.92% 11.92% 11.92% 11.92% 11.92% 11.92% 11.92% 11.92%"}, "model_tokens": {"rwkv": [[59829, " important", "normal", 0.00024038294213823974]], "qwen": [[2989, " important", "normal", 0.0013470856938511133]]}, "loss": {"rwkv": 14.990503159236885, "qwen": 11.919928350385316}, "topk": {"rwkv": [59829, 116, 0.00024038294213823974, [[45, 0.422338, ",", false], [4596, 0.196018, " in", false], [31296, 0.078569, " like", false], [4423, 0.047365, " as", false], [4424, 0.02467, " at", false], [32487, 0.013517, " with", false], [51419, 0.011332, " delayed", false], [332, 0.011317, " a", false], [52906, 0.009428, " similar", false], [31077, 0.009052, " here", false]]], "qwen": [2989, 33, 0.0013470856938511133, [[11, 0.518282, ",", false], [304, 0.154027, " in", false], [4428, 0.038448, " similar", false], [1075, 0.03246, " like", false], [518, 0.026148, " at", false], [1490, 0.014715, " see", false], [79330, 0.012672, " delaying", false], [22706, 0.011817, " delayed", false], [438, 0.011266, " as", false], [279, 0.006489, " the", false]]]}, "raw_delta": 0.17026882171630864, "tuned_delta": 0.17760596023001138}, {"byte_start": 2463, "byte_end": 2467, "display": {"text": " was", "kind": "normal"}, "is_word": true, "word_id": 413, "word_key": " was", "bytes_hex": "20 77 61 73", "compression": {"rwkv": "7.64% 7.64% 7.64% 7.64%", "qwen": "5.04% 5.04% 5.04% 5.04%"}, "model_tokens": {"rwkv": [[22748, " was", "normal", 0.18366031348705292]], "qwen": [[572, " was", "normal", 0.32709893584251404]]}, "loss": {"rwkv": 7.643184176584596, "qwen": 5.038128029989677}, "topk": {"rwkv": [22748, 2, 0.18366031348705292, [[4596, 0.242537, " in", false], [22748, 0.18366, " was", false], [31077, 0.129802, " here", false], [45, 0.110551, ",", false], [32462, 0.101758, " were", false], [4811, 0.081848, " to", false], [4600, 0.054336, " is", false], [21700, 0.021692, " for", false], [21286, 0.016028, " are", false], [21400, 0.007726, " but", false]]], "qwen": [572, 1, 0.32709893584251404, [[572, 0.327099, " was", false], [304, 0.145178, " in", false], [374, 0.132326, " is", false], [1588, 0.093775, " here", false], [311, 0.089232, " to", false], [11, 0.0642, ",", false], [1033, 0.047665, " were", false], [369, 0.025981, " for", false], [25, 0.022407, ":", false], [525, 0.013844, " are", false]]]}, "raw_delta": 0.1444549858570099, "tuned_delta": 0.15179212437071263}, {"byte_start": 2467, "byte_end": 2471, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 414, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "1.37% 1.37% 1.37% 1.37%", "qwen": "2.14% 2.14% 2.14% 2.14%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.7396533489227295]], "qwen": [[279, " the", "normal", 0.622162401676178]]}, "loss": {"rwkv": 1.373659828971425, "qwen": 2.1394903772153064}, "topk": {"rwkv": [22590, 1, 0.7396533489227295, [[22590, 0.739653, " the", false], [332, 0.068729, " a", false], [32227, 0.057327, " that", false], [4419, 0.013847, " an", false], [32499, 0.006147, " work", false], [21835, 0.00568, " how", false], [57103, 0.005415, " research", false], [56950, 0.005397, " progress", false], [50919, 0.004085, " another", false], [38720, 0.003787, " human", false]]], "qwen": [279, 1, 0.622162401676178, [[279, 0.622162, " the", false], [429, 0.178184, " that", false], [264, 0.082814, " a", false], [458, 0.020369, " an", false], [1246, 0.009444, " how", false], [3738, 0.003298, " human", false], [3412, 0.00252, " research", false], [5994, 0.00251, " Go", false], [537, 0.002483, " not", false], [5098, 0.002443, " progress", false]]]}, "raw_delta": -0.0424666628241539, "tuned_delta": -0.03512952431045116}, {"byte_start": 2471, "byte_end": 2475, "display": {"text": " use", "kind": "normal"}, "is_word": true, "word_id": 415, "word_key": " use", "bytes_hex": "20 75 73 65", "compression": {"rwkv": "18.17% 18.17% 18.17% 18.17%", "qwen": "21.57% 21.57% 21.57% 21.57%"}, "model_tokens": {"rwkv": [[22681, " use", "normal", 0.017895683646202087]], "qwen": [[990, " use", "normal", 0.008351313881576061]]}, "loss": {"rwkv": 18.174576198698855, "qwen": 21.57431634225604}, "topk": {"rwkv": [22681, 5, 0.017895683646202087, [[30808, 0.076886, " fact", false], [59544, 0.039034, " discovery", false], [63469, 0.036202, " development", false], [63820, 0.030885, " realization", false], [22681, 0.017896, " use", false], [63729, 0.014946, " observation", false], [51708, 0.014701, " failure", false], [59612, 0.013345, " emergence", false], [63821, 0.013257, " recognition", false], [52013, 0.01299, " initial", false]]], "qwen": [990, 13, 0.008351313881576061, [[2097, 0.131559, " fact", false], [48703, 0.073433, " realization", false], [4401, 0.028247, " development", false], [18335, 0.026365, " discovery", false], [7901, 0.019405, " failure", false], [7626, 0.018758, " delay", false], [17843, 0.017594, " recognition", false], [6853, 0.017374, " lack", false], [48079, 0.0142, " emergence", false], [21930, 0.011831, " observation", false]]]}, "raw_delta": -0.1885216236114502, "tuned_delta": -0.18118448509774746}, {"byte_start": 2475, "byte_end": 2478, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 416, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "0.24% 0.24% 0.24%", "qwen": "0.25% 0.25% 0.25%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.9601859450340271]], "qwen": [[315, " of", "normal", 0.9587425589561462]]}, "loss": {"rwkv": 0.24361915770219716, "qwen": 0.25326935505014186}, "topk": {"rwkv": [4706, 1, 0.9601859450340271, [[4706, 0.960186, " of", false], [45, 0.013908, ",", false], [4450, 0.009366, " by", false], [4596, 0.007208, " in", false], [275, 0.001272, " (", false], [4424, 0.000753, " at", false], [21265, 0.000689, " and", false], [31601, 0.000536, " over", false], [32227, 0.000328, " that", false], [21700, 0.000291, " for", false]]], "qwen": [315, 1, 0.9587425589561462, [[315, 0.958743, " of", false], [553, 0.015525, " by", false], [304, 0.007103, " in", false], [11, 0.006722, ",", false], [323, 0.001733, " and", false], [429, 0.001189, " that", false], [320, 0.001157, " (", false], [1865, 0.001034, " made", false], [311, 0.000661, " to", false], [518, 0.000401, " at", false]]]}, "raw_delta": -0.0005351205666859933, "tuned_delta": 0.006802017947016743}, {"byte_start": 2478, "byte_end": 2487, "display": {"text": " learning", "kind": "normal"}, "is_word": true, "word_id": 417, "word_key": " learning", "bytes_hex": "20 6c 65 61 72 6e 69 6e 67", "compression": {"rwkv": "11.96% 11.96% 11.96% 11.96% 11.96% 11.96% 11.96% 11.96% 11.96%", "qwen": "12.02% 12.02% 12.02% 12.02% 12.02% 12.02% 12.02% 12.02% 12.02%"}, "model_tokens": {"rwkv": [[56537, " learning", "normal", 0.0025880855973809958]], "qwen": [[6832, " learning", "normal", 0.0024785639252513647]]}, "loss": {"rwkv": 11.95984170181389, "qwen": 12.022611547542127}, "topk": {"rwkv": [56537, 55, 0.0025880855973809958, [[38720, 0.063247, " human", false], [332, 0.051261, " a", false], [46658, 0.046635, " neural", false], [22590, 0.042072, " the", false], [30597, 0.039506, " deep", false], [52195, 0.033947, " massive", false], [65003, 0.022989, " reinforcement", false], [59988, 0.022974, " massively", false], [52167, 0.019536, " machine", false], [56812, 0.017953, " parallel", false]]], "qwen": [6832, 63, 0.0024785639252513647, [[264, 0.079057, " a", false], [3738, 0.068136, " human", false], [279, 0.0513, " the", false], [5538, 0.047295, " deep", false], [29728, 0.02188, " neural", false], [11773, 0.018944, " hardware", false], [45767, 0.017372, " Monte", false], [9902, 0.01727, " ``", false], [71278, 0.014542, " reinforcement", false], [1602, 0.013646, " very", false]]]}, "raw_delta": -0.0034806993272569198, "tuned_delta": 0.003856439186445817}, {"byte_start": 2487, "byte_end": 2490, "display": {"text": " by", "kind": "normal"}, "is_word": true, "word_id": 418, "word_key": " by", "bytes_hex": "20 62 79", "compression": {"rwkv": "20.85% 20.85% 20.85%", "qwen": "23.24% 23.24% 23.24%"}, "model_tokens": {"rwkv": [[4450, " by", "normal", 0.03101550228893757]], "qwen": [[553, " by", "normal", 0.02092740871012211]]}, "loss": {"rwkv": 20.851451762848296, "qwen": 23.243592850229273}, "topk": {"rwkv": [4450, 8, 0.03101550228893757, [[4811, 0.170209, " to", false], [52224, 0.169493, " methods", false], [61559, 0.121447, " algorithms", false], [30917, 0.095079, " from", false], [45, 0.092623, ",", false], [46, 0.035423, "-", false], [62633, 0.031319, " techniques", false], [4450, 0.031016, " by", false], [21265, 0.023255, " and", false], [4596, 0.021238, " in", false]]], "qwen": [553, 11, 0.02092740871012211, [[311, 0.189302, " to", false], [5413, 0.157174, " methods", false], [11, 0.103816, ",", false], [5980, 0.077431, "-based", false], [25185, 0.067118, " algorithms", false], [12538, 0.049246, " techniques", false], [504, 0.0439, " from", false], [13, 0.031723, ".", false], [304, 0.028716, " in", false], [323, 0.027407, " and", false]]]}, "raw_delta": -0.13264846801757812, "tuned_delta": -0.12531132950387538}, {"byte_start": 2490, "byte_end": 2495, "display": {"text": " self", "kind": "normal"}, "is_word": true, "word_id": 419, "word_key": " self", "bytes_hex": "20 73 65 6c 66", "compression": {"rwkv": "16.57% 16.57% 16.57% 16.57% 16.57%", "qwen": "13.08% 13.08% 13.08% 13.08% 13.08%"}, "model_tokens": {"rwkv": [[31978, " self", "normal", 0.009957978501915932]], "qwen": [[656, " self", "normal", 0.026586027815937996]]}, "loss": {"rwkv": 16.568450860209186, "qwen": 13.082969625977602}, "topk": {"rwkv": [31978, 15, 0.009957978501915932, [[65003, 0.191397, " reinforcement", false], [59815, 0.147939, " imitation", false], [30597, 0.071219, " deep", false], [51668, 0.050254, " example", false], [46658, 0.044844, " neural", false], [38720, 0.028988, " human", false], [30218, 0.025808, " back", false], [52491, 0.020132, " playing", false], [62557, 0.01997, " simulation", false], [64886, 0.016509, " demonstration", false]]], "qwen": [656, 7, 0.026586027815937996, [[5619, 0.168756, " playing", false], [3738, 0.110576, " human", false], [12677, 0.065122, " humans", false], [71278, 0.053049, " reinforcement", false], [3110, 0.036931, " example", false], [9091, 0.028179, " trial", false], [656, 0.026586, " self", false], [86840, 0.024489, " imitation", false], [1486, 0.023211, " play", false], [55103, 0.018182, " analogy", false]]]}, "raw_delta": 0.1932761192321777, "tuned_delta": 0.20061325774588043}, {"byte_start": 2495, "byte_end": 2500, "display": {"text": " play", "kind": "normal"}, "is_word": true, "word_id": 420, "word_key": " play", "bytes_hex": "20 70 6c 61 79", "compression": {"rwkv": "11.83% 11.83% 11.83% 11.83% 11.83%", "qwen": "15.15% 15.15% 15.15% 15.15% 15.15%"}, "model_tokens": {"rwkv": [[31702, " play", "normal", 0.03800477087497711]], "qwen": [[1486, " play", "normal", 0.014976556412875652]]}, "loss": {"rwkv": 11.834607757292277, "qwen": 15.15287541956948}, "topk": {"rwkv": [31702, 2, 0.03800477087497711, [[46, 0.941312, "-", false], [31702, 0.038005, " play", false], [26697, 0.010844, "play", false], [57453, 0.000973, " training", false], [52491, 0.000885, " playing", false], [63621, 0.000687, " improvement", false], [21265, 0.000544, " and", false], [4715, 0.00039, " or", false], [45, 0.000342, ",", false], [61793, 0.000308, " correction", false]]], "qwen": [1486, 3, 0.014976556412875652, [[26544, 0.943901, "-play", false], [1363, 0.017777, "play", false], [1486, 0.014977, " play", false], [12, 0.005114, "-", false], [72085, 0.003058, "-playing", false], [2371, 0.001586, "-g", false], [48793, 0.001382, "-te", false], [85370, 0.001343, "-training", false], [1331, 0.001274, "-s", false], [41912, 0.001197, "playing", false]]]}, "raw_delta": -0.1840038299560547, "tuned_delta": -0.17666669144235195}, {"byte_start": 2500, "byte_end": 2503, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 421, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "11.69% 11.69% 11.69%", "qwen": "12.75% 12.75% 12.75%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.1415397822856903]], "qwen": [[311, " to", "normal", 0.11986345052719116]]}, "loss": {"rwkv": 11.693719569705465, "qwen": 12.752235522858365}, "topk": {"rwkv": [4811, 2, 0.1415397822856903, [[45, 0.39722, ",", false], [4811, 0.14154, " to", false], [47, 0.126414, ".", false], [275, 0.042302, " (", false], [21265, 0.03218, " and", false], [4596, 0.027257, " in", false], [32487, 0.021702, " with", false], [4706, 0.020843, " of", false], [4712, 0.017068, " on", false], [59, 0.016175, ":", false]]], "qwen": [311, 3, 0.11986345052719116, [[11, 0.426174, ",", false], [13, 0.142018, ".", false], [311, 0.119863, " to", false], [304, 0.036712, " in", false], [320, 0.03566, " (", false], [382, 0.021482, ".\n\n", false], [323, 0.020301, " and", false], [4751, 0.017265, " rather", false], [25, 0.015469, ":", false], [429, 0.015155, " that", false]]]}, "raw_delta": -0.05869658788045251, "tuned_delta": -0.05135944936674977}, {"byte_start": 2503, "byte_end": 2509, "display": {"text": " learn", "kind": "normal"}, "is_word": true, "word_id": 422, "word_key": " learn", "bytes_hex": "20 6c 65 61 72 6e", "compression": {"rwkv": "10.57% 10.57% 10.57% 10.57% 10.57% 10.57%", "qwen": "11.45% 11.45% 11.45% 11.45% 11.45% 11.45%"}, "model_tokens": {"rwkv": [[38877, " learn", "normal", 0.02970532514154911]], "qwen": [[3960, " learn", "normal", 0.02213427983224392]]}, "loss": {"rwkv": 10.566614069010962, "qwen": 11.453278508072337}, "topk": {"rwkv": [38877, 2, 0.02970532514154911, [[51982, 0.156393, " improve", false], [38877, 0.029705, " learn", false], [40000, 0.02712, " train", false], [30858, 0.026678, " find", false], [51456, 0.026171, " develop", false], [56010, 0.025573, " discover", false], [37786, 0.021548, " avoid", false], [37923, 0.018305, " build", false], [31358, 0.017134, " make", false], [59771, 0.016011, " gradually", false]]], "qwen": [3960, 9, 0.02213427983224392, [[7269, 0.099804, " improve", false], [1477, 0.056095, " find", false], [6923, 0.047802, " generate", false], [6997, 0.040892, " discover", false], [5426, 0.039814, " train", false], [2225, 0.038448, " develop", false], [8193, 0.032726, " produce", false], [1855, 0.023893, " create", false], [3960, 0.022134, " learn", false], [13186, 0.020129, " explore", false]]]}, "raw_delta": -0.04916711648305261, "tuned_delta": -0.04182997796934987}, {"byte_start": 2509, "byte_end": 2511, "display": {"text": " a", "kind": "normal"}, "is_word": true, "word_id": 423, "word_key": " a", "bytes_hex": "20 61", "compression": {"rwkv": "23.95% 23.95%", "qwen": "24.36% 24.36%"}, "model_tokens": {"rwkv": [[332, " a", "normal", 0.06919506937265396]], "qwen": [[264, " a", "normal", 0.06712794303894043]]}, "loss": {"rwkv": 23.95099188975818, "qwen": 24.355892794467625}, "topk": {"rwkv": [332, 4, 0.06919506937265396, [[22590, 0.136374, " the", false], [4811, 0.125286, " to", false], [30917, 0.103793, " from", false], [332, 0.069195, " a", false], [21835, 0.062136, " how", false], [37598, 0.026206, " about", false], [47202, 0.025223, " search", false], [32464, 0.018529, " what", false], [51832, 0.015947, " general", false], [22168, 0.015177, " new", false]]], "qwen": [264, 3, 0.06712794303894043, [[279, 0.236323, " the", false], [1246, 0.075652, " how", false], [264, 0.067128, " a", false], [504, 0.066064, " from", false], [311, 0.053305, " to", false], [3738, 0.026512, " human", false], [14830, 0.02373, " strategies", false], [1128, 0.020004, " what", false], [2664, 0.019458, " better", false], [1809, 0.017289, " game", false]]]}, "raw_delta": -0.022452473640441895, "tuned_delta": -0.015115335126739158}, {"byte_start": 2511, "byte_end": 2517, "display": {"text": " value", "kind": "normal"}, "is_word": true, "word_id": 424, "word_key": " value", "bytes_hex": "20 76 61 6c 75 65", "compression": {"rwkv": "16.34% 16.34% 16.34% 16.34% 16.34% 16.34%", "qwen": "17.96% 17.96% 17.96% 17.96% 17.96% 17.96%"}, "model_tokens": {"rwkv": [[40093, " value", "normal", 0.004384035710245371]], "qwen": [[897, " value", "normal", 0.0025432310067117214]]}, "loss": {"rwkv": 16.343029760070287, "qwen": 17.95650363059357}, "topk": {"rwkv": [40093, 33, 0.004384035710245371, [[51832, 0.073376, " general", false], [46857, 0.063685, " policy", false], [47202, 0.055546, " search", false], [30992, 0.047701, " good", false], [65161, 0.041892, " representation", false], [57317, 0.038562, " strategy", false], [30597, 0.037457, " deep", false], [39043, 0.031612, " model", false], [38864, 0.027655, " large", false], [45301, 0.02379, " better", false]]], "qwen": [897, 50, 0.0025432310067117214, [[8282, 0.080409, " strategy", false], [1661, 0.051989, " good", false], [1809, 0.05055, " game", false], [4842, 0.049585, " policy", false], [10987, 0.045937, " winning", false], [3738, 0.035362, " human", false], [1602, 0.032474, " very", false], [2664, 0.032441, " better", false], [9902, 0.030276, " ``", false], [501, 0.028941, " new", false]]]}, "raw_delta": -0.08946998914082849, "tuned_delta": -0.08213285062712575}, {"byte_start": 2517, "byte_end": 2526, "display": {"text": " function", "kind": "normal"}, "is_word": true, "word_id": 425, "word_key": " function", "bytes_hex": "20 66 75 6e 63 74 69 6f 6e", "compression": {"rwkv": "0.77% 0.77% 0.77% 0.77% 0.77% 0.77% 0.77% 0.77% 0.77%", "qwen": "0.65% 0.65% 0.65% 0.65% 0.65% 0.65% 0.65% 0.65% 0.65%"}, "model_tokens": {"rwkv": [[56292, " function", "normal", 0.6790925860404968]], "qwen": [[729, " function", "normal", 0.7247667908668518]]}, "loss": {"rwkv": 0.7709714709611701, "qwen": 0.6450156173193224}, "topk": {"rwkv": [56292, 1, 0.6790925860404968, [[56292, 0.679093, " function", false], [21700, 0.054344, " for", false], [56149, 0.051269, " estimate", false], [46, 0.051204, "-", false], [4706, 0.024685, " of", false], [65161, 0.014392, " representation", false], [39043, 0.012356, " model", false], [61955, 0.007471, " estimation", false], [59793, 0.005654, " hierarchy", false], [64831, 0.005635, " approximation", false]]], "qwen": [729, 1, 0.7247667908668518, [[729, 0.724767, " function", false], [3922, 0.118357, " network", false], [5980, 0.032652, "-based", false], [33749, 0.022315, "-function", false], [16045, 0.013704, " estimate", false], [369, 0.00758, " for", false], [4179, 0.007473, " net", false], [315, 0.00721, " of", false], [16460, 0.006187, " evaluation", false], [13042, 0.004347, " representation", false]]]}, "raw_delta": 0.006984475586149431, "tuned_delta": 0.014321614099852168}, {"byte_start": 2526, "byte_end": 2528, "display": {"text": " (", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "20 28", "compression": {"rwkv": "35.64% 35.64%", "qwen": "27.56% 27.56%"}, "model_tokens": {"rwkv": [[275, " (", "normal", 0.019283566623926163]], "qwen": [[320, " (", "normal", 0.0470462329685688]]}, "loss": {"rwkv": 35.64471145946364, "qwen": 27.561105511417026}, "topk": {"rwkv": [275, 9, 0.019283566623926163, [[21700, 0.169628, " for", false], [45, 0.169504, ",", false], [32227, 0.168416, " that", false], [47, 0.083785, ".", false], [30917, 0.057111, " from", false], [4811, 0.051118, " to", false], [21265, 0.04593, " and", false], [4706, 0.044605, " of", false], [275, 0.019284, " (", false], [55536, 0.018563, " approxim", false]]], "qwen": [320, 6, 0.0470462329685688, [[11, 0.200767, ",", false], [429, 0.133146, " that", false], [369, 0.1235, " for", false], [13, 0.109011, ".", false], [323, 0.062236, " and", false], [320, 0.047046, " (", false], [311, 0.043689, " to", false], [504, 0.035917, " from", false], [3118, 0.021552, " based", false], [304, 0.018403, " in", false]]]}, "raw_delta": 0.44825029373168945, "tuned_delta": 0.45558743224539217}, {"byte_start": 2528, "byte_end": 2530, "display": {"text": "as", "kind": "normal"}, "is_word": true, "word_id": 426, "word_key": "as", "bytes_hex": "61 73", "compression": {"rwkv": "30.57% 30.57%", "qwen": "29.55% 29.55%"}, "model_tokens": {"rwkv": [[1751, "as", "normal", 0.0334651917219162]], "qwen": [[300, "as", "normal", 0.03771577402949333]]}, "loss": {"rwkv": 30.572736706338382, "qwen": 29.55430059337468}, "topk": {"rwkv": [1751, 6, 0.0334651917219162, [[36003, 0.082153, "which", false], [2101, 0.073073, "or", false], [98, 0.05765, "a", false], [8801, 0.057546, "the", false], [7005, 0.044791, "and", false], [1751, 0.033465, "as", false], [7579, 0.032232, "for", false], [1950, 0.024929, "in", false], [2215, 0.024777, "to", false], [1746, 0.019411, "an", false]]], "qwen": [300, 6, 0.03771577402949333, [[1782, 0.097205, "the", false], [8206, 0.075568, "which", false], [64, 0.075485, "a", false], [437, 0.049882, "and", false], [269, 0.042432, "or", false], [300, 0.037716, "as", false], [4060, 0.029328, "see", false], [258, 0.028759, "in", false], [276, 0.027044, "an", false], [9033, 0.024652, "that", false]]]}, "raw_delta": 0.05647408962249756, "tuned_delta": 0.0638112281362003}, {"byte_start": 2530, "byte_end": 2533, "display": {"text": " it", "kind": "normal"}, "is_word": true, "word_id": 427, "word_key": " it", "bytes_hex": "20 69 74", "compression": {"rwkv": "31.18% 31.18% 31.18%", "qwen": "35.37% 35.37% 35.37%"}, "model_tokens": {"rwkv": [[4601, " it", "normal", 0.005531010217964649]], "qwen": [[432, " it", "normal", 0.0027835743967443705]]}, "loss": {"rwkv": 31.183252185881237, "qwen": 35.37018988577891}, "topk": {"rwkv": [4601, 20, 0.005531010217964649, [[4596, 0.289191, " in", false], [52369, 0.22026, " opposed", false], [22748, 0.045509, " was", false], [332, 0.03625, " a", false], [32458, 0.03191, " well", false], [32487, 0.022574, " with", false], [4600, 0.01547, " is", false], [22590, 0.015353, " the", false], [21795, 0.015132, " had", false], [4419, 0.012379, " an", false]]], "qwen": [432, 23, 0.0027835743967443705, [[16087, 0.457368, " opposed", false], [304, 0.130405, " in", false], [1632, 0.102626, " well", false], [264, 0.022272, " a", false], [7481, 0.02131, " described", false], [14078, 0.018769, " discussed", false], [12460, 0.018734, " distinct", false], [572, 0.013752, " was", false], [279, 0.009101, " the", false], [1483, 0.00864, " used", false]]]}, "raw_delta": -0.23217312494913722, "tuned_delta": -0.22483598643543448}, {"byte_start": 2533, "byte_end": 2537, "display": {"text": " was", "kind": "normal"}, "is_word": true, "word_id": 428, "word_key": " was", "bytes_hex": "20 77 61 73", "compression": {"rwkv": "6.73% 6.73% 6.73% 6.73%", "qwen": "8.25% 8.25% 8.25% 8.25%"}, "model_tokens": {"rwkv": [[22748, " was", "normal", 0.22459329664707184]], "qwen": [[572, " was", "normal", 0.16035059094429016]]}, "loss": {"rwkv": 6.727410957270312, "qwen": 8.252182267530776}, "topk": {"rwkv": [22748, 1, 0.22459329664707184, [[22748, 0.224593, " was", false], [47638, 0.182939, " turned", false], [4600, 0.154301, " is", false], [32462, 0.118613, " were", false], [40040, 0.087781, " turns", false], [51896, 0.029593, " happens", false], [21795, 0.023825, " had", false], [40219, 0.01806, " would", false], [56348, 0.016823, " happened", false], [21800, 0.011359, " has", false]]], "qwen": [572, 2, 0.16035059094429016, [[374, 0.257658, " is", false], [572, 0.160351, " was", false], [10577, 0.100438, " turns", false], [6519, 0.080026, " turned", false], [1521, 0.034738, " did", false], [1035, 0.034517, " would", false], [1030, 0.034259, " had", false], [6116, 0.028161, " became", false], [1558, 0.026933, " does", false], [702, 0.023676, " has", false]]]}, "raw_delta": -0.08455127477645874, "tuned_delta": -0.077214136262756}, {"byte_start": 2537, "byte_end": 2540, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 429, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "24.23% 24.23% 24.23%", "qwen": "21.74% 21.74% 21.74%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.017858993262052536]], "qwen": [[304, " in", "normal", 0.026875125244259834]]}, "loss": {"rwkv": 24.232768264931806, "qwen": 21.73993706822568}, "topk": {"rwkv": [4596, 10, 0.017858993262052536, [[45395, 0.282471, " called", false], [32230, 0.04923, " then", false], [38848, 0.041376, " known", false], [38869, 0.031014, " later", false], [30666, 0.029048, " done", false], [22187, 0.027166, " not", false], [62275, 0.025501, " originally", false], [52112, 0.01967, " learned", false], [62684, 0.018368, " understood", false], [4596, 0.017859, " in", false]]], "qwen": [304, 6, 0.026875125244259834, [[2598, 0.379656, " called", false], [2814, 0.082709, " done", false], [1221, 0.063428, " then", false], [3881, 0.049845, " known", false], [2937, 0.031391, " later", false], [304, 0.026875, " in", false], [537, 0.017914, " not", false], [60837, 0.016524, " termed", false], [9251, 0.013353, " applied", false], [1083, 0.01199, " also", false]]]}, "raw_delta": 0.138231913248698, "tuned_delta": 0.14556905176240073}, {"byte_start": 2540, "byte_end": 2545, "display": {"text": " many", "kind": "normal"}, "is_word": true, "word_id": 430, "word_key": " many", "bytes_hex": "20 6d 61 6e 79", "compression": {"rwkv": "17.81% 17.81% 17.81% 17.81% 17.81%", "qwen": "16.15% 16.15% 16.15% 16.15% 16.15%"}, "model_tokens": {"rwkv": [[31370, " many", "normal", 0.007079240400344133]], "qwen": [[1657, " many", "normal", 0.011345302686095238]]}, "loss": {"rwkv": 17.808266910973142, "qwen": 16.154402628256975}, "topk": {"rwkv": [31370, 20, 0.007079240400344133, [[38013, 0.328695, " chess", false], [22590, 0.148687, " the", false], [3851, 0.080459, " Go", false], [55809, 0.039768, " computer", false], [36274, 0.031598, " Alpha", false], [30322, 0.022598, " both", false], [3492, 0.021164, " 19", false], [38720, 0.019494, " human", false], [36466, 0.019181, " Chess", false], [38328, 0.015466, " early", false]]], "qwen": [1657, 11, 0.011345302686095238, [[279, 0.303091, " the", false], [32719, 0.109606, " chess", false], [24708, 0.061578, " Alpha", false], [6366, 0.041331, " computer", false], [5994, 0.040199, " Go", false], [18183, 0.035052, " Deep", false], [264, 0.019417, " a", false], [1182, 0.017414, " back", false], [220, 0.01583, " ", false], [1008, 0.012868, " other", false]]]}, "raw_delta": 0.09170970916748056, "tuned_delta": 0.0990468476811833}, {"byte_start": 2545, "byte_end": 2551, "display": {"text": " other", "kind": "normal"}, "is_word": true, "word_id": 431, "word_key": " other", "bytes_hex": "20 6f 74 68 65 72", "compression": {"rwkv": "3.19% 3.19% 3.19% 3.19% 3.19% 3.19%", "qwen": "4.74% 4.74% 4.74% 4.74% 4.74% 4.74%"}, "model_tokens": {"rwkv": [[39193, " other", "normal", 0.34638914465904236]], "qwen": [[1008, " other", "normal", 0.20644254982471466]]}, "loss": {"rwkv": 3.193465585301091, "qwen": 4.742057925894811}, "topk": {"rwkv": [39193, 1, 0.34638914465904236, [[39193, 0.346389, " other", false], [51551, 0.092391, " earlier", false], [4706, 0.07354, " of", false], [38328, 0.057158, " early", false], [51515, 0.042734, " domains", false], [38013, 0.028152, " chess", false], [55809, 0.027247, " computer", false], [3609, 0.024189, " AI", false], [38576, 0.024158, " games", false], [56926, 0.022924, " previous", false]]], "qwen": [1008, 1, 0.20644254982471466, [[1008, 0.206443, " other", false], [315, 0.192479, " of", false], [6366, 0.066459, " computer", false], [32719, 0.054559, " chess", false], [5048, 0.036724, " cases", false], [3868, 0.02637, " games", false], [4124, 0.02322, " early", false], [6788, 0.016202, " earlier", false], [5510, 0.014827, " ways", false], [3738, 0.011991, " human", false]]]}, "raw_delta": -0.08587219317754112, "tuned_delta": -0.07853505466383838}, {"byte_start": 2551, "byte_end": 2557, "display": {"text": " games", "kind": "normal"}, "is_word": true, "word_id": 432, "word_key": " games", "bytes_hex": "20 67 61 6d 65 73", "compression": {"rwkv": "8.03% 8.03% 8.03% 8.03% 8.03% 8.03%", "qwen": "5.62% 5.62% 5.62% 5.62% 5.62% 5.62%"}, "model_tokens": {"rwkv": [[38576, " games", "normal", 0.06916578859090805]], "qwen": [[3868, " games", "normal", 0.15397393703460693]]}, "loss": {"rwkv": 8.030626692448331, "qwen": 5.62342064144615}, "topk": {"rwkv": [38576, 4, 0.06916578859090805, [[51515, 0.493115, " domains", false], [3609, 0.083584, " AI", false], [37738, 0.078465, " areas", false], [38576, 0.069166, " games", false], [45976, 0.034355, " fields", false], [37970, 0.034298, " cases", false], [64251, 0.01622, " applications", false], [56939, 0.014302, " problems", false], [38328, 0.012653, " early", false], [55809, 0.012399, " computer", false]]], "qwen": [3868, 2, 0.15397393703460693, [[30476, 0.331291, " domains", false], [3868, 0.153974, " games", false], [5671, 0.08402, " areas", false], [8357, 0.054478, " applications", false], [15235, 0.034859, " AI", false], [5322, 0.029711, " problems", false], [37597, 0.027073, " contexts", false], [5048, 0.021655, " cases", false], [1809, 0.017305, " game", false], [5043, 0.016215, " fields", false]]]}, "raw_delta": 0.1334838469823201, "tuned_delta": 0.14082098549602284}, {"byte_start": 2557, "byte_end": 2561, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 433, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"rwkv": "20.01% 20.01% 20.01% 20.01%", "qwen": "16.39% 16.39% 16.39% 16.39%"}, "model_tokens": {"rwkv": [[21265, " and", "normal", 0.012099945917725563]], "qwen": [[323, " and", "normal", 0.02634415403008461]]}, "loss": {"rwkv": 20.00612263732742, "qwen": 16.394916925835595}, "topk": {"rwkv": [21265, 7, 0.012099945917725563, [[42, 0.276377, ")", false], [497, 0.231257, "),", false], [499, 0.173698, ").", false], [45, 0.116553, ",", false], [4423, 0.049054, " as", false], [4424, 0.015448, " at", false], [21265, 0.0121, " and", false], [4706, 0.00918, " of", false], [22614, 0.008848, " too", false], [32139, 0.008484, " such", false]]], "qwen": [323, 5, 0.02634415403008461, [[8, 0.282654, ")", false], [568, 0.194803, ").", false], [701, 0.179022, "),", false], [11, 0.100799, ",", false], [323, 0.026344, " and", false], [438, 0.024904, " as", false], [3593, 0.021138, ").\n\n", false], [518, 0.017665, " at", false], [1573, 0.015239, " before", false], [315, 0.011811, " of", false]]]}, "raw_delta": 0.20024776458740234, "tuned_delta": 0.20758490310110508}, {"byte_start": 2561, "byte_end": 2566, "display": {"text": " even", "kind": "normal"}, "is_word": true, "word_id": 434, "word_key": " even", "bytes_hex": "20 65 76 65 6e", "compression": {"rwkv": "18.15% 18.15% 18.15% 18.15% 18.15%", "qwen": "16.42% 16.42% 16.42% 16.42% 16.42%"}, "model_tokens": {"rwkv": [[30788, " even", "normal", 0.006624673958867788]], "qwen": [[1496, " even", "normal", 0.010534564033150673]]}, "loss": {"rwkv": 18.146398561181492, "qwen": 16.42181501243054}, "topk": {"rwkv": [30788, 20, 0.006624673958867788, [[51515, 0.365458, " domains", false], [4596, 0.119494, " in", false], [64251, 0.043412, " applications", false], [4423, 0.035278, " as", false], [39193, 0.02771, " other", false], [3609, 0.026046, " AI", false], [4811, 0.020319, " to", false], [56939, 0.012922, " problems", false], [31370, 0.01231, " many", false], [39898, 0.012151, " tasks", false]]], "qwen": [1496, 16, 0.010534564033150673, [[30476, 0.274515, " domains", false], [8357, 0.089942, " applications", false], [304, 0.088429, " in", false], [1008, 0.036862, " other", false], [5322, 0.032097, " problems", false], [374, 0.028859, " is", false], [9079, 0.026332, " tasks", false], [21737, 0.025758, " environments", false], [537, 0.017821, " not", false], [11, 0.014259, ",", false]]]}, "raw_delta": 0.09563121795654306, "tuned_delta": 0.1029683564702458}, {"byte_start": 2566, "byte_end": 2569, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 435, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "4.48% 4.48% 4.48%", "qwen": "4.87% 4.87% 4.87%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.4736306667327881]], "qwen": [[304, " in", "normal", 0.44450274109840393]]}, "loss": {"rwkv": 4.484940638180208, "qwen": 4.873898751154672}, "topk": {"rwkv": [4596, 1, 0.4736306667327881, [[4596, 0.473631, " in", false], [38013, 0.062208, " chess", false], [22184, 0.03612, " non", false], [31458, 0.034591, " more", false], [32074, 0.029234, " some", false], [4423, 0.018208, " as", false], [4811, 0.018066, " to", false], [52391, 0.010942, " outside", false], [22190, 0.010299, " now", false], [31370, 0.010171, " many", false]]], "qwen": [304, 1, 0.44450274109840393, [[304, 0.444503, " in", false], [1045, 0.042425, " some", false], [32719, 0.033628, " chess", false], [1008, 0.0305, " other", false], [279, 0.02201, " the", false], [7797, 0.019831, " beyond", false], [2272, 0.019661, " life", false], [1657, 0.018959, " many", false], [803, 0.018664, " more", false], [11, 0.012248, ",", false]]]}, "raw_delta": -0.02156841754913333, "tuned_delta": -0.014231279035430592}, {"byte_start": 2569, "byte_end": 2575, "display": {"text": " chess", "kind": "normal"}, "is_word": true, "word_id": 436, "word_key": " chess", "bytes_hex": "20 63 68 65 73 73", "compression": {"rwkv": "4.23% 4.23% 4.23% 4.23% 4.23% 4.23%", "qwen": "4.06% 4.06% 4.06% 4.06% 4.06% 4.06%"}, "model_tokens": {"rwkv": [[38013, " chess", "normal", 0.24172928929328918]], "qwen": [[32719, " chess", "normal", 0.25881946086883545]]}, "loss": {"rwkv": 4.226645627604385, "qwen": 4.062462389958204}, "topk": {"rwkv": [38013, 1, 0.24172928929328918, [[38013, 0.241729, " chess", false], [3851, 0.085215, " Go", false], [22590, 0.079574, " the", false], [55809, 0.04814, " computer", false], [32074, 0.043792, " some", false], [31370, 0.025823, " many", false], [38328, 0.019842, " early", false], [38720, 0.01704, " human", false], [39311, 0.016009, " poker", false], [47202, 0.015788, " search", false]]], "qwen": [32719, 1, 0.25881946086883545, [[32719, 0.258819, " chess", false], [279, 0.13382, " the", false], [1045, 0.055217, " some", false], [1008, 0.039027, " other", false], [1931, 0.031313, " real", false], [3738, 0.031129, " human", false], [6366, 0.029792, " computer", false], [1657, 0.025833, " many", false], [5810, 0.024103, " natural", false], [5994, 0.0238, " Go", false]]]}, "raw_delta": 0.009104251861572266, "tuned_delta": 0.016441390375275002}, {"byte_start": 2575, "byte_end": 2576, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "43.68%", "qwen": "48.06%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.08948458731174469]], "qwen": [[11, ",", "normal", 0.06960668414831161]]}, "loss": {"rwkv": 43.67533815191197, "qwen": 48.05787745339095}, "topk": {"rwkv": [45, 4, 0.08948458731174469, [[499, 0.284219, ").", false], [42, 0.229231, ")", false], [497, 0.211683, "),", false], [45, 0.089485, ",", false], [45285, 0.055404, " before", false], [4596, 0.014007, " in", false], [4424, 0.013518, " at", false], [39356, 0.012203, " prior", false], [502, 0.005165, ");", false], [37634, 0.004787, " after", false]]], "qwen": [11, 4, 0.06960668414831161, [[8, 0.311405, ")", false], [568, 0.216466, ").", false], [701, 0.159245, "),", false], [11, 0.069607, ",", false], [323, 0.032871, " and", false], [3593, 0.028469, ").\n\n", false], [304, 0.021751, " in", false], [518, 0.018202, " at", false], [1573, 0.014773, " before", false], [1215, 0.011096, ");", false]]]}, "raw_delta": -0.24301958084106445, "tuned_delta": -0.2356824423273617}, {"byte_start": 2576, "byte_end": 2585, "display": {"text": " although", "kind": "normal"}, "is_word": true, "word_id": 437, "word_key": " although", "bytes_hex": "20 61 6c 74 68 6f 75 67 68", "compression": {"rwkv": "7.04% 7.04% 7.04% 7.04% 7.04% 7.04% 7.04% 7.04% 7.04%", "qwen": "6.11% 6.11% 6.11% 6.11% 6.11% 6.11% 6.11% 6.11% 6.11%"}, "model_tokens": {"rwkv": [[55495, " although", "normal", 0.02955758012831211]], "qwen": [[7892, " although", "normal", 0.04747393727302551]]}, "loss": {"rwkv": 7.044409379340641, "qwen": 6.106556454033087}, "topk": {"rwkv": [55495, 6, 0.02955758012831211, [[21400, 0.194065, " but", false], [40185, 0.118716, " where", false], [45285, 0.058988, " before", false], [47544, 0.056149, " though", false], [21265, 0.032054, " and", false], [55495, 0.029558, " although", false], [4423, 0.028066, " as", false], [22449, 0.025959, " see", false], [40186, 0.022474, " which", false], [21700, 0.021753, " for", false]]], "qwen": [7892, 4, 0.04747393727302551, [[714, 0.253728, " but", false], [1380, 0.079006, " where", false], [3498, 0.063448, " though", false], [7892, 0.047474, " although", false], [1490, 0.044499, " see", false], [438, 0.039695, " as", false], [323, 0.024683, " and", false], [892, 0.022883, " which", false], [304, 0.021609, " in", false], [1573, 0.019246, " before", false]]]}, "raw_delta": 0.052005608876546205, "tuned_delta": 0.059342747390248946}, {"byte_start": 2585, "byte_end": 2594, "display": {"text": " learning", "kind": "normal"}, "is_word": true, "word_id": 438, "word_key": " learning", "bytes_hex": "20 6c 65 61 72 6e 69 6e 67", "compression": {"rwkv": "10.39% 10.39% 10.39% 10.39% 10.39% 10.39% 10.39% 10.39% 10.39%", "qwen": "10.41% 10.41% 10.41% 10.41% 10.41% 10.41% 10.41% 10.41% 10.41%"}, "model_tokens": {"rwkv": [[56537, " learning", "normal", 0.005565821658819914]], "qwen": [[6832, " learning", "normal", 0.005532432813197374]]}, "loss": {"rwkv": 10.394417395293745, "qwen": 10.413708115965523}, "topk": {"rwkv": [56537, 19, 0.005565821658819914, [[22590, 0.150539, " the", false], [4596, 0.117913, " in", false], [32227, 0.099789, " that", false], [39934, 0.068084, " there", false], [4601, 0.066587, " it", false], [22187, 0.06187, " not", false], [32234, 0.054847, " this", false], [38013, 0.027975, " chess", false], [31277, 0.019741, " less", false], [31077, 0.018261, " here", false]]], "qwen": [6832, 25, 0.005532432813197374, [[537, 0.222352, " not", false], [279, 0.082857, " the", false], [432, 0.069599, " it", false], [419, 0.059519, " this", false], [304, 0.058971, " in", false], [1052, 0.040108, " there", false], [429, 0.036923, " that", false], [5994, 0.033935, " Go", false], [1588, 0.025159, " here", false], [311, 0.020415, " to", false]]]}, "raw_delta": -0.0010697046915690844, "tuned_delta": 0.006267433822133652}, {"byte_start": 2594, "byte_end": 2598, "display": {"text": " did", "kind": "normal"}, "is_word": true, "word_id": 439, "word_key": " did", "bytes_hex": "20 64 69 64", "compression": {"rwkv": "26.35% 26.35% 26.35% 26.35%", "qwen": "20.85% 20.85% 20.85% 20.85%"}, "model_tokens": {"rwkv": [[21532, " did", "normal", 0.0028810889925807714]], "qwen": [[1521, " did", "normal", 0.009800087660551071]]}, "loss": {"rwkv": 26.346091078734, "qwen": 20.8530920473809}, "topk": {"rwkv": [21532, 25, 0.0028810889925807714, [[4450, 0.380989, " by", false], [332, 0.126184, " a", false], [22590, 0.071093, " the", false], [22748, 0.068771, " was", false], [4706, 0.056963, " of", false], [4596, 0.03874, " in", false], [4811, 0.033535, " to", false], [30917, 0.02326, " from", false], [46, 0.016442, "-", false], [4600, 0.016001, " is", false]]], "qwen": [1521, 14, 0.009800087660551071, [[553, 0.234046, " by", false], [572, 0.159847, " was", false], [304, 0.06377, " in", false], [264, 0.042462, " a", false], [374, 0.030726, " is", false], [897, 0.029572, " value", false], [279, 0.025313, " the", false], [311, 0.023479, " to", false], [504, 0.020341, " from", false], [5413, 0.018399, " methods", false]]]}, "raw_delta": 0.30459654331207275, "tuned_delta": 0.31193368182577547}, {"byte_start": 2598, "byte_end": 2602, "display": {"text": " not", "kind": "normal"}, "is_word": true, "word_id": 440, "word_key": " not", "bytes_hex": "20 6e 6f 74", "compression": {"rwkv": "0.21% 0.21% 0.21% 0.21%", "qwen": "0.24% 0.24% 0.24% 0.24%"}, "model_tokens": {"rwkv": [[22187, " not", "normal", 0.954839289188385]], "qwen": [[537, " not", "normal", 0.9479894638061523]]}, "loss": {"rwkv": 0.2080302144836533, "qwen": 0.2408033560754438}, "topk": {"rwkv": [22187, 1, 0.954839289188385, [[22187, 0.954839, " not", false], [32187, 0.003571, " take", false], [31702, 0.00322, " play", false], [39166, 0.002873, " occur", false], [31466, 0.001909, " much", false], [46159, 0.001633, " happen", false], [31458, 0.001395, " more", false], [61959, 0.00134, " eventually", false], [31967, 0.0013, " seem", false], [31059, 0.001004, " have", false]]], "qwen": [537, 1, 0.9479894638061523, [[537, 0.947989, " not", false], [1486, 0.011866, " play", false], [1896, 0.003933, " take", false], [12170, 0.002203, " occur", false], [614, 0.002135, " have", false], [12118, 0.002025, " prove", false], [1172, 0.001618, " only", false], [2803, 0.001143, " seem", false], [1492, 0.000945, " help", false], [2632, 0.000863, " little", false]]]}, "raw_delta": -0.001817328855395317, "tuned_delta": 0.0055198096583074195}, {"byte_start": 2602, "byte_end": 2607, "display": {"text": " play", "kind": "normal"}, "is_word": true, "word_id": 441, "word_key": " play", "bytes_hex": "20 70 6c 61 79", "compression": {"rwkv": "8.85% 8.85% 8.85% 8.85% 8.85%", "qwen": "5.06% 5.06% 5.06% 5.06% 5.06%"}, "model_tokens": {"rwkv": [[31702, " play", "normal", 0.08666630834341049]], "qwen": [[1486, " play", "normal", 0.2457631230354309]]}, "loss": {"rwkv": 8.847778180451845, "qwen": 5.061649344724086}, "topk": {"rwkv": [31702, 1, 0.08666630834341049, [[31702, 0.086666, " play", false], [31967, 0.063153, " seem", false], [56041, 0.038945, " dominate", false], [32499, 0.032124, " work", false], [45185, 0.031616, " appear", false], [39166, 0.030756, " occur", false], [39801, 0.028981, " start", false], [22770, 0.02753, " win", false], [46159, 0.025182, " happen", false], [39374, 0.023773, " prove", false]]], "qwen": [1486, 1, 0.2457631230354309, [[1486, 0.245763, " play", false], [12118, 0.057356, " prove", false], [2803, 0.044004, " seem", false], [4994, 0.038472, " appear", false], [3635, 0.03657, " become", false], [975, 0.027108, " work", false], [1492, 0.026829, " help", false], [12170, 0.026608, " occur", false], [2525, 0.023338, " come", false], [3602, 0.022493, " yet", false]]]}, "raw_delta": 0.2099475622177124, "tuned_delta": 0.21728470073141515}, {"byte_start": 2607, "byte_end": 2609, "display": {"text": " a", "kind": "normal"}, "is_word": true, "word_id": 442, "word_key": " a", "bytes_hex": "20 61", "compression": {"rwkv": "8.77% 8.77%", "qwen": "4.35% 4.35%"}, "model_tokens": {"rwkv": [[332, " a", "normal", 0.3755667805671692]], "qwen": [[264, " a", "normal", 0.6170863509178162]]}, "loss": {"rwkv": 8.770289677279099, "qwen": 4.3528478404219735}, "topk": {"rwkv": [332, 1, 0.3755667805671692, [[332, 0.375567, " a", false], [4423, 0.230581, " as", false], [22590, 0.11632, " the", false], [32139, 0.096036, " such", false], [32227, 0.035363, " that", false], [4419, 0.02994, " an", false], [31466, 0.027224, " much", false], [21273, 0.017189, " any", false], [46647, 0.012085, " nearly", false], [32234, 0.011513, " this", false]]], "qwen": [264, 1, 0.6170863509178162, [[264, 0.617086, " a", false], [438, 0.147431, " as", false], [1741, 0.048873, " such", false], [458, 0.047076, " an", false], [279, 0.029216, " the", false], [1753, 0.021222, " much", false], [894, 0.016069, " any", false], [7009, 0.013102, " nearly", false], [5008, 0.007137, " quite", false], [1052, 0.007039, " there", false]]]}, "raw_delta": 0.24495498836040497, "tuned_delta": 0.2522921268741077}, {"byte_start": 2609, "byte_end": 2613, "display": {"text": " big", "kind": "normal"}, "is_word": true, "word_id": 443, "word_key": " big", "bytes_hex": "20 62 69 67", "compression": {"rwkv": "17.61% 17.61% 17.61% 17.61%", "qwen": "13.34% 13.34% 13.34% 13.34%"}, "model_tokens": {"rwkv": [[21357, " big", "normal", 0.02009044960141182]], "qwen": [[2409, " big", "normal", 0.05184754729270935]]}, "loss": {"rwkv": 17.611023448351602, "qwen": 13.342438776442753}, "topk": {"rwkv": [21357, 11, 0.02009044960141182, [[31894, 0.32776, " role", false], [51156, 0.097959, " central", false], [38961, 0.073442, " major", false], [38864, 0.058188, " large", false], [60273, 0.056718, " prominent", false], [63870, 0.039793, " significant", false], [56040, 0.038624, " dominant", false], [31633, 0.035638, " part", false], [45752, 0.030285, " direct", false], [52555, 0.020123, " primary", false]]], "qwen": [2409, 5, 0.05184754729270935, [[3476, 0.349896, " role", false], [3598, 0.160371, " major", false], [3460, 0.089409, " large", false], [5089, 0.068478, " significant", false], [2409, 0.051848, " big", false], [8622, 0.050104, " central", false], [20469, 0.038747, " prominent", false], [949, 0.029593, " part", false], [2118, 0.012775, " direct", false], [1376, 0.012518, " key", false]]]}, "raw_delta": 0.23670059442520142, "tuned_delta": 0.24403773293890416}, {"byte_start": 2613, "byte_end": 2618, "display": {"text": " role", "kind": "normal"}, "is_word": true, "word_id": 444, "word_key": " role", "bytes_hex": "20 72 6f 6c 65", "compression": {"rwkv": "0.63% 0.63% 0.63% 0.63% 0.63%", "qwen": "0.51% 0.51% 0.51% 0.51% 0.51%"}, "model_tokens": {"rwkv": [[31894, " role", "normal", 0.8398662805557251]], "qwen": [[3476, " role", "normal", 0.867730975151062]]}, "loss": {"rwkv": 0.6269524347613171, "qwen": 0.5117005723024768}, "topk": {"rwkv": [31894, 1, 0.8398662805557251, [[31894, 0.839866, " role", false], [31633, 0.116483, " part", false], [45865, 0.021799, " enough", false], [52013, 0.008769, " initial", false], [45752, 0.002001, " direct", false], [45, 0.001574, ",", false], [4715, 0.000728, " or", false], [39568, 0.000721, " rôle", false], [31895, 0.000619, " roll", false], [38328, 0.000547, " early", false]]], "qwen": [3476, 1, 0.867730975151062, [[3476, 0.867731, " role", false], [949, 0.121771, " part", false], [8168, 0.002727, " factor", false], [3322, 0.002314, " enough", false], [6502, 0.000408, " roll", false], [11, 0.000291, ",", false], [1809, 0.00026, " game", false], [2118, 0.00023, " direct", false], [14976, 0.000209, " practical", false], [2456, 0.000182, " effect", false]]]}, "raw_delta": 0.00639092028141022, "tuned_delta": 0.013728058795112956}, {"byte_start": 2618, "byte_end": 2621, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 445, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "3.33% 3.33% 3.33%", "qwen": "2.27% 2.27% 2.27%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.5772871375083923]], "qwen": [[304, " in", "normal", 0.6852281093597412]]}, "loss": {"rwkv": 3.3343537728879036, "qwen": 2.272265417609112}, "topk": {"rwkv": [4596, 1, 0.5772871375083923, [[4596, 0.577287, " in", false], [39934, 0.145351, " there", false], [499, 0.071883, ").", false], [4424, 0.035775, " at", false], [40076, 0.029034, " until", false], [59868, 0.020631, " initially", false], [31077, 0.013599, " here", false], [497, 0.012967, "),", false], [42, 0.01223, ")", false], [32230, 0.010474, " then", false]]], "qwen": [304, 1, 0.6852281093597412, [[304, 0.685228, " in", false], [1052, 0.096012, " there", false], [3080, 0.035162, " until", false], [568, 0.034877, ").", false], [518, 0.027178, " at", false], [369, 0.01464, " for", false], [8, 0.013315, ")", false], [15102, 0.011603, " initially", false], [1221, 0.007446, " then", false], [1588, 0.007177, " here", false]]]}, "raw_delta": 0.058894683917363494, "tuned_delta": 0.06623182243106623}, {"byte_start": 2621, "byte_end": 2625, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 446, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "5.57% 5.57% 5.57% 5.57%", "qwen": "7.64% 7.64% 7.64% 7.64%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.2928292751312256]], "qwen": [[279, " the", "normal", 0.18346962332725525]]}, "loss": {"rwkv": 5.565083409679106, "qwen": 7.644958822563186}, "topk": {"rwkv": [22590, 1, 0.2928292751312256, [[22590, 0.292829, " the", false], [38013, 0.219499, " chess", false], [3851, 0.093535, " Go", false], [55809, 0.046308, " computer", false], [32227, 0.042282, " that", false], [38328, 0.02273, " early", false], [53354, 0.02017, " winning", false], [39944, 0.017885, " those", false], [47202, 0.014441, " search", false], [45833, 0.012294, " either", false]]], "qwen": [279, 2, 0.18346962332725525, [[32719, 0.341252, " chess", false], [279, 0.18347, " the", false], [5994, 0.154985, " Go", false], [6366, 0.07453, " computer", false], [1846, 0.02422, " those", false], [429, 0.018696, " that", false], [4124, 0.010531, " early", false], [1181, 0.010355, " its", false], [419, 0.010157, " this", false], [1493, 0.009928, " these", false]]]}, "raw_delta": -0.11533278226852417, "tuned_delta": -0.10799564375482143}, {"byte_start": 2625, "byte_end": 2628, "display": {"text": " 19", "kind": "normal"}, "is_word": true, "word_id": 447, "word_key": " 19", "bytes_hex": "20 31 39", "compression": {"rwkv": "23.58% 23.58% 23.58%", "qwen": "46.90% 1.40% 0.09%"}, "model_tokens": {"rwkv": [[3492, " 19", "normal", 0.019657691940665245]], "qwen": [[220, " ", "normal", 0.07424170523881912], [16, "1", "normal", 0.925460696220398], [24, "9", "normal", 0.9950696229934692]]}, "loss": {"rwkv": 23.575290056193346, "qwen": 16.127139440185175}, "topk": {"rwkv": [3492, 13, 0.019657691940665245, [[38328, 0.10517, " early", false], [47202, 0.08699, " search", false], [52013, 0.075046, " initial", false], [38013, 0.055422, " chess", false], [3851, 0.053055, " Go", false], [51551, 0.040986, " earlier", false], [38491, 0.03608, " final", false], [38720, 0.03344, " human", false], [38499, 0.032116, " first", false], [38869, 0.021641, " later", false]]], "qwen": [220, 3, 0.07424170523881912, [[4124, 0.121692, " early", false], [32719, 0.103933, " chess", false], [220, 0.074242, " ", false], [6366, 0.056794, " computer", false], [2856, 0.037899, " initial", false], [2711, 0.036277, " search", false], [6788, 0.032006, " earlier", false], [3738, 0.031073, " human", false], [4401, 0.030849, " development", false], [5994, 0.026553, " Go", false]]]}, "raw_delta": 0.4130131679897508, "tuned_delta": 0.4203503065034535}, {"byte_start": 2628, "byte_end": 2630, "display": {"text": "97", "kind": "normal"}, "is_word": true, "word_id": 448, "word_key": "97", "bytes_hex": "39 37", "compression": {"rwkv": "1.67% 1.67%", "qwen": "0.56% 2.55%"}, "model_tokens": {"rwkv": [[717, "97", "normal", 0.8302068710327148]], "qwen": [[24, "9", "normal", 0.969538152217865], [22, "7", "normal", 0.8682795763015747]]}, "loss": {"rwkv": 1.6730472275934023, "qwen": 1.5524927134108706}, "topk": {"rwkv": [717, 1, 0.8302068710327148, [[717, 0.830207, "97", false], [710, 0.105307, "90", false], [716, 0.029014, "96", false], [700, 0.008104, "80", false], [690, 0.003935, "70", false], [719, 0.003715, "99", false], [709, 0.003683, "89", false], [670, 0.002747, "50", false], [715, 0.002712, "95", false], [718, 0.001416, "98", false]]], "qwen": [24, 1, 0.969538152217865, [[24, 0.969538, "9", false], [23, 0.017938, "8", false], [22, 0.009043, "7", false], [21, 0.001301, "6", false], [20, 0.00081, "5", false], [19, 0.00038, "4", false], [339, 0.000238, "th", false], [17, 0.000152, "2", false], [15, 0.000122, "0", false], [18, 8.3e-05, "3", false]]]}, "raw_delta": 0.006684961728751659, "tuned_delta": 0.014022100242454396}, {"byte_start": 2630, "byte_end": 2638, "display": {"text": " program", "kind": "normal"}, "is_word": true, "word_id": 449, "word_key": " program", "bytes_hex": "20 70 72 6f 67 72 61 6d", "compression": {"rwkv": "10.99% 10.99% 10.99% 10.99% 10.99% 10.99% 10.99% 10.99%", "qwen": "11.39% 11.39% 11.39% 11.39% 11.39% 11.39% 11.39% 11.39%"}, "model_tokens": {"rwkv": [[52580, " program", "normal", 0.00766520481556654]], "qwen": [[2025, " program", "normal", 0.00640413723886013]]}, "loss": {"rwkv": 10.9892786317714, "qwen": 11.385594377528088}, "topk": {"rwkv": [52580, 21, 0.00766520481556654, [[53283, 0.12737, " victory", false], [38981, 0.069941, " match", false], [45685, 0.067613, " defeat", false], [30941, 0.066407, " game", false], [38013, 0.058695, " chess", false], [21265, 0.052622, " and", false], [46, 0.047299, "-", false], [20184, 0.044737, " Kas", false], [40213, 0.04342, " world", false], [47202, 0.031241, " search", false]]], "qwen": [2025, 18, 0.00640413723886013, [[32719, 0.263852, " chess", false], [6366, 0.208496, " computer", false], [5994, 0.076176, " Go", false], [1879, 0.036089, " world", false], [12560, 0.034823, " victory", false], [37542, 0.027709, " Kas", false], [12, 0.023072, "-", false], [1142, 0.01972, " case", false], [1809, 0.017739, " game", false], [47387, 0.012744, " Chess", false]]]}, "raw_delta": -0.02197641134262085, "tuned_delta": -0.014639272828918113}, {"byte_start": 2638, "byte_end": 2643, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 450, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"rwkv": "13.92% 13.92% 13.92% 13.92% 13.92%", "qwen": "10.15% 10.15% 10.15% 10.15% 10.15%"}, "model_tokens": {"rwkv": [[32227, " that", "normal", 0.021264201030135155]], "qwen": [[429, " that", "normal", 0.06002192944288254]]}, "loss": {"rwkv": 13.919752933577106, "qwen": 10.145916127863138}, "topk": {"rwkv": [32227, 5, 0.021264201030135155, [[499, 0.690594, ").", false], [497, 0.082804, "),", false], [42, 0.061698, ")", false], [45, 0.03472, ",", false], [32227, 0.021264, " that", false], [21700, 0.01732, " for", false], [580, 0.016732, ".)", false], [21265, 0.011418, " and", false], [4706, 0.005581, " of", false], [460, 0.004232, "'s", false]]], "qwen": [429, 5, 0.06002192944288254, [[568, 0.498181, ").", false], [8, 0.109327, ")", false], [3593, 0.094091, ").\n\n", false], [701, 0.070225, "),", false], [429, 0.060022, " that", false], [11, 0.027611, ",", false], [369, 0.026642, " for", false], [304, 0.00916, " in", false], [2348, 0.007056, " against", false], [594, 0.006991, "'s", false]]]}, "raw_delta": 0.20926594734191895, "tuned_delta": 0.21660308585562169}, {"byte_start": 2643, "byte_end": 2649, "display": {"text": " first", "kind": "normal"}, "is_word": true, "word_id": 451, "word_key": " first", "bytes_hex": "20 66 69 72 73 74", "compression": {"rwkv": "15.78% 15.78% 15.78% 15.78% 15.78% 15.78%", "qwen": "17.83% 17.83% 17.83% 17.83% 17.83% 17.83%"}, "model_tokens": {"rwkv": [[38499, " first", "normal", 0.005304576829075813]], "qwen": [[1156, " first", "normal", 0.002655275631695986]]}, "loss": {"rwkv": 15.779477009723035, "qwen": 17.82692186911223}, "topk": {"rwkv": [38499, 9, 0.005304576829075813, [[22777, 0.406379, " won", false], [55934, 0.274453, " defeated", false], [30256, 0.097376, " beat", false], [51744, 0.0171, " finally", false], [22748, 0.017015, " was", false], [61959, 0.009941, " eventually", false], [62676, 0.009769, " ultimately", false], [21994, 0.007706, " led", false], [38499, 0.005305, " first", false], [32272, 0.005085, " took", false]]], "qwen": [1156, 15, 0.002655275631695986, [[23283, 0.532717, " defeated", false], [9382, 0.188874, " beat", false], [2765, 0.122936, " won", false], [572, 0.010686, " was", false], [6342, 0.009291, " played", false], [3867, 0.008745, " took", false], [3937, 0.007337, " went", false], [29701, 0.006301, " dominated", false], [9583, 0.005843, " eventually", false], [18651, 0.003529, " proved", false]]]}, "raw_delta": -0.11353445053100586, "tuned_delta": -0.10619731201730312}, {"byte_start": 2649, "byte_end": 2654, "display": {"text": " beat", "kind": "normal"}, "is_word": true, "word_id": 452, "word_key": " beat", "bytes_hex": "20 62 65 61 74", "compression": {"rwkv": "5.61% 5.61% 5.61% 5.61% 5.61%", "qwen": "6.08% 6.08% 6.08% 6.08% 6.08%"}, "model_tokens": {"rwkv": [[30256, " beat", "normal", 0.21381770074367523]], "qwen": [[9382, " beat", "normal", 0.18517979979515076]]}, "loss": {"rwkv": 5.6073498659551495, "qwen": 6.082503533758917}, "topk": {"rwkv": [30256, 3, 0.21381770074367523, [[55934, 0.277631, " defeated", false], [22777, 0.246833, " won", false], [30256, 0.213818, " beat", false], [31351, 0.012145, " made", false], [55437, 0.00926, " achieved", false], [32272, 0.009244, " took", false], [32354, 0.008687, " used", false], [52086, 0.006128, " knocked", false], [51097, 0.005451, " brought", false], [47333, 0.004737, " solved", false]]], "qwen": [9382, 2, 0.18517979979515076, [[23283, 0.474552, " defeated", false], [9382, 0.18518, " beat", false], [2765, 0.039459, " won", false], [18651, 0.020258, " proved", false], [16994, 0.015913, " achieved", false], [3867, 0.015192, " took", false], [1483, 0.013701, " used", false], [3937, 0.013551, " went", false], [20459, 0.011575, " demonstrated", false], [6342, 0.010672, " played", false]]]}, "raw_delta": -0.026348114013671875, "tuned_delta": -0.01901097549996914}, {"byte_start": 2654, "byte_end": 2656, "display": {"text": " a", "kind": "normal"}, "is_word": true, "word_id": 453, "word_key": " a", "bytes_hex": "20 61", "compression": {"rwkv": "36.63% 36.63%", "qwen": "42.06% 42.06%"}, "model_tokens": {"rwkv": [[332, " a", "normal", 0.01698998175561428]], "qwen": [[264, " a", "normal", 0.009427649900317192]]}, "loss": {"rwkv": 36.63092877257133, "qwen": 42.0555367530257}, "topk": {"rwkv": [332, 3, 0.01698998175561428, [[20184, 0.831147, " Kas", false], [22590, 0.100774, " the", false], [332, 0.01699, " a", false], [40213, 0.011454, " world", false], [38720, 0.009857, " human", false], [19948, 0.003623, " Gar", false], [38013, 0.003403, " chess", false], [46227, 0.001617, " humans", false], [38621, 0.001196, " grand", false], [28951, 0.001195, " Gary", false]]], "qwen": [264, 3, 0.009427649900317192, [[37542, 0.890068, " Kas", false], [279, 0.062893, " the", false], [264, 0.009428, " a", false], [730, 0.005613, " K", false], [3738, 0.005219, " human", false], [1879, 0.003376, " world", false], [32719, 0.002167, " chess", false], [220, 0.001656, " ", false], [5994, 0.000883, " Go", false], [12677, 0.000816, " humans", false]]]}, "raw_delta": -0.30080413818359375, "tuned_delta": -0.29346699966989104}, {"byte_start": 2656, "byte_end": 2662, "display": {"text": " world", "kind": "normal"}, "is_word": true, "word_id": 454, "word_key": " world", "bytes_hex": "20 77 6f 72 6c 64", "compression": {"rwkv": "2.82% 2.82% 2.82% 2.82% 2.82% 2.82%", "qwen": "3.36% 3.36% 3.36% 3.36% 3.36% 3.36%"}, "model_tokens": {"rwkv": [[40213, " world", "normal", 0.3914233446121216]], "qwen": [[1879, " world", "normal", 0.3270755708217621]]}, "loss": {"rwkv": 2.8177637517362566, "qwen": 3.358966998306696}, "topk": {"rwkv": [40213, 1, 0.3914233446121216, [[40213, 0.391423, " world", false], [38720, 0.293753, " human", false], [38621, 0.131522, " grand", false], [38013, 0.04957, " chess", false], [22615, 0.047595, " top", false], [55716, 0.013824, " champion", false], [64532, 0.009259, " professional", false], [20184, 0.007315, " Kas", false], [47436, 0.006144, " strong", false], [39471, 0.005894, " reign", false]]], "qwen": [1879, 2, 0.3270755708217621, [[3738, 0.441339, " human", false], [1879, 0.327076, " world", false], [6662, 0.093183, " grand", false], [1909, 0.017116, " top", false], [6584, 0.016489, " professional", false], [32719, 0.01559, " chess", false], [89956, 0.012008, " reigning", false], [18319, 0.010819, " champion", false], [10304, 0.008297, " Grand", false], [2781, 0.005426, " player", false]]]}, "raw_delta": -0.030010680357615144, "tuned_delta": -0.022673541843912407}, {"byte_start": 2662, "byte_end": 2671, "display": {"text": " champion", "kind": "normal"}, "is_word": true, "word_id": 455, "word_key": " champion", "bytes_hex": "20 63 68 61 6d 70 69 6f 6e", "compression": {"rwkv": "0.53% 0.53% 0.53% 0.53% 0.53% 0.53% 0.53% 0.53% 0.53%", "qwen": "0.33% 0.33% 0.33% 0.33% 0.33% 0.33% 0.33% 0.33% 0.33%"}, "model_tokens": {"rwkv": [[55716, " champion", "normal", 0.7686011791229248]], "qwen": [[18319, " champion", "normal", 0.8487852215766907]]}, "loss": {"rwkv": 0.5283307034505481, "qwen": 0.32851188423501704}, "topk": {"rwkv": [55716, 1, 0.7686011791229248, [[55716, 0.768601, " champion", false], [38013, 0.106775, " chess", false], [46, 0.081304, "-", false], [37996, 0.01172, " champ", false], [64275, 0.008239, " championship", false], [38621, 0.008012, " grand", false], [38046, 0.002355, " class", false], [46526, 0.002321, " master", false], [38720, 0.002225, " human", false], [46841, 0.000875, " player", false]]], "qwen": [18319, 1, 0.8487852215766907, [[18319, 0.848785, " champion", false], [32719, 0.050926, " chess", false], [14800, 0.030213, "-class", false], [11582, 0.019481, "-ch", false], [6662, 0.008552, " grand", false], [34541, 0.0065, " champ", false], [21553, 0.006274, " championship", false], [536, 0.004128, " class", false], [2781, 0.003682, " player", false], [5994, 0.002991, " Go", false]]]}, "raw_delta": 0.011080308092965022, "tuned_delta": 0.018417446606667758}, {"byte_start": 2671, "byte_end": 2673, "display": {"text": ").", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "29 2e", "compression": {"rwkv": "2.89% 2.89%", "qwen": "5.28% 5.28%"}, "model_tokens": {"rwkv": [[499, ").", "normal", 0.7266738414764404]], "qwen": [[568, ").", "normal", 0.5565124750137329]]}, "loss": {"rwkv": 2.8882078455296627, "qwen": 5.284463080386749}, "topk": {"rwkv": [499, 1, 0.7266738414764404, [[499, 0.726674, ").", false], [497, 0.057502, "),", false], [42, 0.049568, ")", false], [45, 0.04009, ",", false], [580, 0.032478, ".)", false], [4596, 0.018732, " in", false], [47, 0.0165, ".", false], [4424, 0.011887, " at", false], [21265, 0.004822, " and", false], [4450, 0.00456, " by", false]]], "qwen": [568, 1, 0.5565124750137329, [[568, 0.556512, ").", false], [3593, 0.125492, ").\n\n", false], [8, 0.088581, ")", false], [304, 0.068221, " in", false], [701, 0.046289, "),", false], [11, 0.028162, ",", false], [6138, 0.011887, ".)", false], [518, 0.010606, " at", false], [553, 0.006713, " by", false], [448, 0.004133, " with", false]]]}, "raw_delta": -0.13287660479545593, "tuned_delta": -0.1255394662817532}, {"byte_start": 2673, "byte_end": 2682, "display": {"text": " Learning", "kind": "normal"}, "is_word": true, "word_id": 456, "word_key": " learning", "bytes_hex": "20 4c 65 61 72 6e 69 6e 67", "compression": {"rwkv": "8.45% 8.45% 8.45% 8.45% 8.45% 8.45% 8.45% 8.45% 8.45%", "qwen": "7.34% 7.34% 7.34% 7.34% 7.34% 7.34% 7.34% 7.34% 7.34%"}, "model_tokens": {"rwkv": [[55122, " Learning", "normal", 0.015134541317820549]], "qwen": [[20909, " Learning", "normal", 0.025673646479845047]]}, "loss": {"rwkv": 8.45329125520877, "qwen": 7.338289033568737}, "topk": {"rwkv": [55122, 10, 0.015134541317820549, [[261, 0.279088, "\n\n", false], [20996, 0.110158, " The", false], [267, 0.057187, "  ", false], [29894, 0.049585, " This", false], [3913, 0.040867, " In", false], [19555, 0.038474, " But", false], [3918, 0.021844, " It", false], [36251, 0.020257, " Again", false], [37453, 0.018361, " These", false], [55122, 0.015135, " Learning", false]]], "qwen": [20909, 6, 0.025673646479845047, [[1096, 0.131989, " This", false], [576, 0.113991, " The", false], [220, 0.064805, " ", false], [758, 0.056152, " In", false], [1084, 0.032568, " It", false], [20909, 0.025674, " Learning", false], [10115, 0.025323, " Self", false], [4220, 0.022711, " These", false], [362, 0.018038, " A", false], [3197, 0.017117, " When", false]]]}, "raw_delta": 0.0618288516998291, "tuned_delta": 0.06916599021353184}, {"byte_start": 2682, "byte_end": 2685, "display": {"text": " by", "kind": "normal"}, "is_word": true, "word_id": 457, "word_key": " by", "bytes_hex": "20 62 79", "compression": {"rwkv": "7.84% 7.84% 7.84%", "qwen": "7.34% 7.34% 7.34%"}, "model_tokens": {"rwkv": [[4450, " by", "normal", 0.27113616466522217]], "qwen": [[553, " by", "normal", 0.2946818768978119]]}, "loss": {"rwkv": 7.842775775665913, "qwen": 7.344873819313647}, "topk": {"rwkv": [4450, 1, 0.27113616466522217, [[4450, 0.271136, " by", false], [4600, 0.082569, " is", false], [22748, 0.081993, " was", false], [332, 0.049744, " a", false], [30917, 0.046386, " from", false], [4811, 0.038372, " to", false], [22590, 0.031638, " the", false], [4706, 0.031098, " of", false], [45, 0.023575, ",", false], [21800, 0.020569, " has", false]]], "qwen": [553, 1, 0.2946818768978119, [[553, 0.294682, " by", false], [572, 0.101215, " was", false], [374, 0.06683, " is", false], [702, 0.032769, " has", false], [11, 0.026648, ",", false], [304, 0.022976, " in", false], [1030, 0.01806, " had", false], [5980, 0.016686, "-based", false], [646, 0.016298, " can", false], [5413, 0.015814, " methods", false]]]}, "raw_delta": 0.027609546979268373, "tuned_delta": 0.034946685492971113}, {"byte_start": 2685, "byte_end": 2690, "display": {"text": " self", "kind": "normal"}, "is_word": true, "word_id": 458, "word_key": " self", "bytes_hex": "20 73 65 6c 66", "compression": {"rwkv": "0.65% 0.65% 0.65% 0.65% 0.65%", "qwen": "0.08% 0.08% 0.08% 0.08% 0.08%"}, "model_tokens": {"rwkv": [[31978, " self", "normal", 0.8354401588439941]], "qwen": [[656, " self", "normal", 0.9773311018943787]]}, "loss": {"rwkv": 0.6480856628993389, "qwen": 0.08270163994208604}, "topk": {"rwkv": [31978, 1, 0.8354401588439941, [[31978, 0.83544, " self", false], [47202, 0.014871, " search", false], [38720, 0.013084, " human", false], [40093, 0.010785, " value", false], [65003, 0.009184, " reinforcement", false], [46342, 0.00874, " itself", false], [52491, 0.007665, " playing", false], [59815, 0.006051, " imitation", false], [31702, 0.004061, " play", false], [62557, 0.003161, " simulation", false]]], "qwen": [656, 1, 0.9773311018943787, [[656, 0.977331, " self", false], [5086, 0.004029, " itself", false], [5619, 0.001925, " playing", false], [71278, 0.001007, " reinforcement", false], [3738, 0.000895, " human", false], [1486, 0.000809, " play", false], [11504, 0.000486, " repeated", false], [4862, 0.00044, " training", false], [10115, 0.000352, " Self", false], [2711, 0.000339, " search", false]]]}, "raw_delta": 0.03135154731571674, "tuned_delta": 0.03868868582941948}, {"byte_start": 2690, "byte_end": 2695, "display": {"text": " play", "kind": "normal"}, "is_word": true, "word_id": 459, "word_key": " play", "bytes_hex": "20 70 6c 61 79", "compression": {"rwkv": "0.94% 0.94% 0.94% 0.94% 0.94%", "qwen": "0.63% 0.63% 0.63% 0.63% 0.63%"}, "model_tokens": {"rwkv": [[31702, " play", "normal", 0.7712420225143433]], "qwen": [[1486, " play", "normal", 0.8401477932929993]]}, "loss": {"rwkv": 0.9369064474523053, "qwen": 0.6282122614234654}, "topk": {"rwkv": [31702, 1, 0.7712420225143433, [[31702, 0.771242, " play", false], [46, 0.224068, "-", false], [26697, 0.001684, "play", false], [52491, 0.00039, " playing", false], [39301, 0.000277, " plays", false], [4715, 0.000181, " or", false], [47077, 0.000125, " replay", false], [11, 0.000106, "\n", false], [261, 7.5e-05, "\n\n", false], [21265, 6.4e-05, " and", false]]], "qwen": [1486, 1, 0.8401477932929993, [[1486, 0.840148, " play", false], [26544, 0.153109, "-play", false], [1363, 0.002449, "play", false], [5619, 0.00096, " playing", false], [12, 0.000871, "-", false], [6342, 0.000397, " played", false], [11088, 0.00036, " plays", false], [72085, 0.000153, "-playing", false], [2268, 0.000136, "-p", false], [481, 0.000131, " -", false]]]}, "raw_delta": 0.01711764037609101, "tuned_delta": 0.024454778889793746}, {"byte_start": 2695, "byte_end": 2696, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "51.28%", "qwen": "51.11%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.0589311309158802]], "qwen": [[11, ",", "normal", 0.058770012110471725]]}, "loss": {"rwkv": 51.283300281599864, "qwen": 51.10970099381895}, "topk": {"rwkv": [45, 3, 0.0589311309158802, [[4600, 0.273234, " is", false], [22748, 0.16693, " was", false], [45, 0.058931, ",", false], [21800, 0.047295, " has", false], [46936, 0.028118, " proved", false], [21795, 0.017565, " had", false], [21413, 0.017187, " can", false], [30135, 0.016378, " also", false], [4596, 0.016375, " in", false], [21265, 0.013506, " and", false]]], "qwen": [11, 3, 0.058770012110471725, [[374, 0.186056, " is", false], [572, 0.16232, " was", false], [11, 0.05877, ",", false], [702, 0.054755, " has", false], [18651, 0.041368, " proved", false], [646, 0.024019, " can", false], [1558, 0.022965, " does", false], [1030, 0.018434, " had", false], [1521, 0.016502, " did", false], [1083, 0.015467, " also", false]]]}, "raw_delta": 0.009626388549804688, "tuned_delta": 0.016963527063507424}, {"byte_start": 2696, "byte_end": 2700, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 460, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"rwkv": "11.55% 11.55% 11.55% 11.55%", "qwen": "11.83% 11.83% 11.83% 11.83%"}, "model_tokens": {"rwkv": [[21265, " and", "normal", 0.07718450576066971]], "qwen": [[323, " and", "normal", 0.07252924889326096]]}, "loss": {"rwkv": 11.55283138211865, "qwen": 11.82904196875373}, "topk": {"rwkv": [21265, 2, 0.07718450576066971, [[4715, 0.101046, " or", false], [21265, 0.077185, " and", false], [51948, 0.075303, " however", false], [4596, 0.066998, " in", false], [40186, 0.055727, " which", false], [4423, 0.040547, " as", false], [4450, 0.030813, " by", false], [32487, 0.02467, " with", false], [32465, 0.021649, " when", false], [55780, 0.018576, " combined", false]]], "qwen": [323, 3, 0.07252924889326096, [[892, 0.120817, " which", false], [4764, 0.08481, " however", false], [323, 0.072529, " and", false], [304, 0.052395, " in", false], [476, 0.047287, " or", false], [438, 0.041698, " as", false], [1075, 0.030872, " like", false], [10856, 0.029464, " combined", false], [979, 0.023073, " when", false], [264, 0.018457, " a", false]]]}, "raw_delta": -0.015316367149353027, "tuned_delta": -0.00797922863565029}, {"byte_start": 2700, "byte_end": 2709, "display": {"text": " learning", "kind": "normal"}, "is_word": true, "word_id": 461, "word_key": " learning", "bytes_hex": "20 6c 65 61 72 6e 69 6e 67", "compression": {"rwkv": "6.04% 6.04% 6.04% 6.04% 6.04% 6.04% 6.04% 6.04% 6.04%", "qwen": "5.58% 5.58% 5.58% 5.58% 5.58% 5.58% 5.58% 5.58% 5.58%"}, "model_tokens": {"rwkv": [[56537, " learning", "normal", 0.04902108386158943]], "qwen": [[6832, " learning", "normal", 0.061622485518455505]]}, "loss": {"rwkv": 6.042537823167749, "qwen": 5.583887801632613}, "topk": {"rwkv": [56537, 4, 0.04902108386158943, [[22590, 0.133339, " the", false], [4450, 0.089687, " by", false], [32230, 0.050493, " then", false], [56537, 0.049021, " learning", false], [47202, 0.038665, " search", false], [4596, 0.035348, " in", false], [21902, 0.033388, " its", false], [39193, 0.030281, " other", false], [40085, 0.024732, " using", false], [61953, 0.022399, " especially", false]]], "qwen": [6832, 2, 0.061622485518455505, [[279, 0.169488, " the", false], [6832, 0.061622, " learning", false], [1181, 0.055484, " its", false], [304, 0.049826, " in", false], [5310, 0.043404, " especially", false], [1008, 0.036733, " other", false], [2937, 0.02753, " later", false], [1221, 0.024226, " then", false], [553, 0.023626, " by", false], [71278, 0.023571, " reinforcement", false]]]}, "raw_delta": 0.025432957543267132, "tuned_delta": 0.03277009605696987}, {"byte_start": 2709, "byte_end": 2712, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 462, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "20.76% 20.76% 20.76%", "qwen": "9.63% 9.63% 9.63%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.031219901517033577]], "qwen": [[304, " in", "normal", 0.20149588584899902]]}, "loss": {"rwkv": 20.75752630445709, "qwen": 9.62990697811478}, "topk": {"rwkv": [4596, 6, 0.031219901517033577, [[4450, 0.424668, " by", false], [30917, 0.107858, " from", false], [4811, 0.085296, " to", false], [332, 0.039875, " a", false], [22590, 0.032588, " the", false], [4596, 0.03122, " in", false], [32487, 0.030772, " with", false], [4706, 0.02913, " of", false], [22705, 0.01113, " via", false], [40085, 0.010648, " using", false]]], "qwen": [304, 2, 0.20149588584899902, [[553, 0.460229, " by", false], [304, 0.201496, " in", false], [504, 0.032372, " from", false], [803, 0.028194, " more", false], [311, 0.026235, " to", false], [8789, 0.022546, " generally", false], [315, 0.015536, " of", false], [448, 0.015369, " with", false], [5086, 0.011464, " itself", false], [518, 0.009877, " at", false]]]}, "raw_delta": 0.6170462369918824, "tuned_delta": 0.6243833755055852}, {"byte_start": 2712, "byte_end": 2720, "display": {"text": " general", "kind": "normal"}, "is_word": true, "word_id": 463, "word_key": " general", "bytes_hex": "20 67 65 6e 65 72 61 6c", "compression": {"rwkv": "1.87% 1.87% 1.87% 1.87% 1.87% 1.87% 1.87% 1.87%", "qwen": "0.29% 0.29% 0.29% 0.29% 0.29% 0.29% 0.29% 0.29%"}, "model_tokens": {"rwkv": [[51832, " general", "normal", 0.4373762905597687]], "qwen": [[4586, " general", "normal", 0.8802781701087952]]}, "loss": {"rwkv": 1.8667684855252697, "qwen": 0.2874509964834224}, "topk": {"rwkv": [51832, 1, 0.4373762905597687, [[51832, 0.437376, " general", false], [22590, 0.114505, " the", false], [332, 0.068765, " a", false], [39193, 0.03129, " other", false], [62293, 0.016834, " particular", false], [38576, 0.016768, " games", false], [38864, 0.015925, " large", false], [47202, 0.013883, " search", false], [56812, 0.012825, " parallel", false], [4419, 0.012641, " an", false]]], "qwen": [4586, 1, 0.8802781701087952, [[4586, 0.880278, " general", false], [1008, 0.024624, " other", false], [803, 0.015842, " more", false], [279, 0.009629, " the", false], [3953, 0.009389, " particular", false], [264, 0.006392, " a", false], [1657, 0.005726, " many", false], [3868, 0.004921, " games", false], [894, 0.003346, " any", false], [71278, 0.001897, " reinforcement", false]]]}, "raw_delta": 0.08757595717906952, "tuned_delta": 0.09491309569277226}, {"byte_start": 2720, "byte_end": 2721, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "1.18%", "qwen": "0.88%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.9366965889930725]], "qwen": [[11, ",", "normal", 0.9525086283683777]]}, "loss": {"rwkv": 1.1799385710395573, "qwen": 0.8774496399791492}, "topk": {"rwkv": [45, 1, 0.9366965889930725, [[45, 0.936697, ",", false], [275, 0.008862, " (", false], [4450, 0.00712, " by", false], [30917, 0.006089, " from", false], [4596, 0.004227, " in", false], [21286, 0.003563, " are", false], [4600, 0.002205, " is", false], [4423, 0.002145, " as", false], [21700, 0.001876, " for", false], [32487, 0.001623, " with", false]]], "qwen": [11, 1, 0.9525086283683777, [[11, 0.952509, ",", false], [320, 0.011165, " (", false], [438, 0.003895, " as", false], [572, 0.002728, " was", false], [304, 0.002635, " in", false], [553, 0.002413, " by", false], [369, 0.001557, " for", false], [504, 0.001391, " from", false], [374, 0.001263, " is", false], [323, 0.001132, " and", false]]]}, "raw_delta": 0.01677354797720909, "tuned_delta": 0.024110686490911828}, {"byte_start": 2721, "byte_end": 2724, "display": {"text": " is", "kind": "normal"}, "is_word": true, "word_id": 464, "word_key": " is", "bytes_hex": "20 69 73", "compression": {"rwkv": "8.45% 8.45% 8.45%", "qwen": "9.93% 9.93% 9.93%"}, "model_tokens": {"rwkv": [[4600, " is", "normal", 0.2424180805683136]], "qwen": [[374, " is", "normal", 0.19180235266685486]]}, "loss": {"rwkv": 8.45329125520877, "qwen": 9.926281813969146}, "topk": {"rwkv": [4600, 1, 0.2424180805683136, [[4600, 0.242418, " is", false], [22748, 0.137141, " was", false], [21286, 0.091824, " are", false], [21800, 0.089791, " has", false], [32462, 0.047136, " were", false], [46936, 0.032661, " proved", false], [31059, 0.026704, " have", false], [21795, 0.023498, " had", false], [45283, 0.016601, " became", false], [21413, 0.015474, " can", false]]], "qwen": [374, 2, 0.19180235266685486, [[572, 0.203406, " was", false], [374, 0.191802, " is", false], [702, 0.08035, " has", false], [525, 0.051294, " are", false], [1033, 0.048801, " were", false], [18651, 0.029424, " proved", false], [614, 0.022187, " have", false], [1030, 0.021144, " had", false], [6116, 0.019618, " became", false], [646, 0.014353, " can", false]]]}, "raw_delta": -0.08167994022369385, "tuned_delta": -0.07434280170999111}, {"byte_start": 2724, "byte_end": 2729, "display": {"text": " like", "kind": "normal"}, "is_word": true, "word_id": 465, "word_key": " like", "bytes_hex": "20 6c 69 6b 65", "compression": {"rwkv": "28.85% 28.85% 28.85% 28.85% 28.85%", "qwen": "27.71% 27.71% 27.71% 27.71% 27.71%"}, "model_tokens": {"rwkv": [[31296, " like", "normal", 0.000330429058521986]], "qwen": [[1075, " like", "normal", 0.0004606365109793842]]}, "loss": {"rwkv": 28.853900817779266, "qwen": 27.710209310235552}, "topk": {"rwkv": [31296, 196, 0.000330429058521986, [[332, 0.281064, " a", false], [22590, 0.06593, " the", false], [22187, 0.061047, " not", false], [4419, 0.058671, " an", false], [22226, 0.032656, " one", false], [31466, 0.032285, " much", false], [39171, 0.022063, " often", false], [31458, 0.021698, " more", false], [50919, 0.020862, " another", false], [30135, 0.014315, " also", false]]], "qwen": [1075, 154, 0.0004606365109793842, [[264, 0.256609, " a", false], [537, 0.086539, " not", false], [279, 0.061306, " the", false], [458, 0.054938, " an", false], [825, 0.03098, " one", false], [1431, 0.028723, " now", false], [2441, 0.01771, " another", false], [1602, 0.014805, " very", false], [3118, 0.01421, " based", false], [3545, 0.013818, " often", false]]]}, "raw_delta": 0.06341972351074232, "tuned_delta": 0.07075686202444506}, {"byte_start": 2729, "byte_end": 2736, "display": {"text": " search", "kind": "normal"}, "is_word": true, "word_id": 466, "word_key": " search", "bytes_hex": "20 73 65 61 72 63 68", "compression": {"rwkv": "8.25% 8.25% 8.25% 8.25% 8.25% 8.25% 8.25%", "qwen": "8.18% 8.18% 8.18% 8.18% 8.18% 8.18% 8.18%"}, "model_tokens": {"rwkv": [[47202, " search", "normal", 0.04022342339158058]], "qwen": [[2711, " search", "normal", 0.04180444777011871]]}, "loss": {"rwkv": 8.252022415799035, "qwen": 8.178927946511084}, "topk": {"rwkv": [47202, 4, 0.04022342339158058, [[332, 0.183935, " a", false], [22590, 0.125593, " the", false], [38720, 0.049485, " human", false], [47202, 0.040223, " search", false], [37920, 0.034038, " brute", false], [4419, 0.01995, " an", false], [21273, 0.0191, " any", false], [60463, 0.016883, " searching", false], [30597, 0.016027, " deep", false], [38888, 0.016019, " lever", false]]], "qwen": [2711, 3, 0.04180444777011871, [[264, 0.205371, " a", false], [279, 0.14606, " the", false], [2711, 0.041804, " search", false], [3738, 0.039201, " human", false], [458, 0.029872, " an", false], [64098, 0.024256, " brute", false], [9902, 0.016597, " ``", false], [6832, 0.015212, " learning", false], [1667, 0.015136, " using", false], [15039, 0.014427, " searching", false]]]}, "raw_delta": 0.004053218024117566, "tuned_delta": 0.011390356537820303}, {"byte_start": 2736, "byte_end": 2739, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 467, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "5.26% 5.26% 5.26%", "qwen": "4.43% 4.43% 4.43%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.4204898774623871]], "qwen": [[304, " in", "normal", 0.478597491979599]]}, "loss": {"rwkv": 5.259825669907679, "qwen": 4.429646782739058}, "topk": {"rwkv": [4596, 1, 0.4204898774623871, [[4596, 0.42049, " in", false], [45, 0.22891, ",", false], [4450, 0.056023, " by", false], [59, 0.052907, ":", false], [21400, 0.040048, " but", false], [47, 0.039977, ".", false], [21265, 0.021196, " and", false], [60, 0.016397, ";", false], [32487, 0.011621, " with", false], [31581, 0.009878, " only", false]]], "qwen": [304, 1, 0.478597491979599, [[304, 0.478597, " in", false], [25, 0.13181, ":", false], [11, 0.102186, ",", false], [13, 0.028422, ".", false], [3118, 0.018091, " based", false], [26, 0.016742, ";", false], [369, 0.016629, " for", false], [714, 0.014212, " but", false], [5980, 0.01371, "-based", false], [448, 0.013334, " with", false]]]}, "raw_delta": 0.046034892400105804, "tuned_delta": 0.053372030913808544}, {"byte_start": 2739, "byte_end": 2744, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 468, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"rwkv": "1.62% 1.62% 1.62% 1.62% 1.62%", "qwen": "1.66% 1.66% 1.66% 1.66% 1.66%"}, "model_tokens": {"rwkv": [[32227, " that", "normal", 0.6359608173370361]], "qwen": [[429, " that", "normal", 0.6315386295318604]]}, "loss": {"rwkv": 1.6202141572483475, "qwen": 1.6576426340664636}, "topk": {"rwkv": [32227, 1, 0.6359608173370361, [[32227, 0.635961, " that", false], [22590, 0.083345, " the", false], [37832, 0.036785, " being", false], [31370, 0.035908, " many", false], [21902, 0.030627, " its", false], [38013, 0.019153, " chess", false], [332, 0.017353, " a", false], [32234, 0.016861, " this", false], [39920, 0.007708, " terms", false], [46170, 0.006663, " having", false]]], "qwen": [429, 1, 0.6315386295318604, [[429, 0.631539, " that", false], [279, 0.092578, " the", false], [419, 0.053061, " this", false], [264, 0.034964, " a", false], [32719, 0.02852, " chess", false], [1181, 0.0169, " its", false], [1657, 0.013024, " many", false], [825, 0.011143, " one", false], [2441, 0.009717, " another", false], [3793, 0.009374, " terms", false]]]}, "raw_delta": -0.0020754754543304416, "tuned_delta": 0.005261663059372295}, {"byte_start": 2744, "byte_end": 2747, "display": {"text": " it", "kind": "normal"}, "is_word": true, "word_id": 469, "word_key": " it", "bytes_hex": "20 69 74", "compression": {"rwkv": "2.45% 2.45% 2.45%", "qwen": "1.21% 1.21% 1.21%"}, "model_tokens": {"rwkv": [[4601, " it", "normal", 0.6641919612884521]], "qwen": [[432, " it", "normal", 0.8172699809074402]]}, "loss": {"rwkv": 2.4538026004703233, "qwen": 1.2129804691136825}, "topk": {"rwkv": [4601, 1, 0.6641919612884521, [[4601, 0.664192, " it", false], [22590, 0.108357, " the", false], [45, 0.023197, ",", false], [21902, 0.01994, " its", false], [332, 0.012142, " a", false], [30322, 0.011902, " both", false], [39934, 0.010964, " there", false], [56537, 0.009262, " learning", false], [22226, 0.006506, " one", false], [47202, 0.00572, " search", false]]], "qwen": [432, 1, 0.8172699809074402, [[432, 0.81727, " it", false], [279, 0.029159, " the", false], [11, 0.022253, ",", false], [1181, 0.019094, " its", false], [2176, 0.012306, " both", false], [807, 0.008344, " they", false], [1052, 0.006602, " there", false], [2711, 0.00489, " search", false], [264, 0.004275, " a", false], [304, 0.00391, " in", false]]]}, "raw_delta": 0.06880578895409903, "tuned_delta": 0.07614292746780177}, {"byte_start": 2747, "byte_end": 2755, "display": {"text": " enables", "kind": "normal"}, "is_word": true, "word_id": 470, "word_key": " enables", "bytes_hex": "20 65 6e 61 62 6c 65 73", "compression": {"rwkv": "11.98% 11.98% 11.98% 11.98% 11.98% 11.98% 11.98% 11.98%", "qwen": "11.85% 11.85% 11.85% 11.85% 11.85% 11.85% 11.85% 11.85%"}, "model_tokens": {"rwkv": [[51597, " enables", "normal", 0.004983329679816961]], "qwen": [[20081, " enables", "normal", 0.005207602400332689]]}, "loss": {"rwkv": 11.97549594487909, "qwen": 11.85181999596894}, "topk": {"rwkv": [51597, 27, 0.004983329679816961, [[4600, 0.24774, " is", false], [21413, 0.092399, " can", false], [56540, 0.059084, " leverage", false], [30659, 0.034625, " does", false], [57102, 0.030622, " requires", false], [47181, 0.030366, " scales", false], [56501, 0.025466, " involves", false], [21800, 0.023595, " has", false], [32356, 0.020999, " uses", false], [39914, 0.016981, " tends", false]]], "qwen": [20081, 26, 0.005207602400332689, [[374, 0.315095, " is", false], [1558, 0.083303, " does", false], [646, 0.064419, " can", false], [7460, 0.038913, " requires", false], [27505, 0.021124, " lever", false], [702, 0.020943, " has", false], [3643, 0.019325, " makes", false], [17601, 0.017854, " involves", false], [5711, 0.017011, " uses", false], [4990, 0.011349, " takes", false]]]}, "raw_delta": 0.00685805082321167, "tuned_delta": 0.014195189336914407}, {"byte_start": 2755, "byte_end": 2763, "display": {"text": " massive", "kind": "normal"}, "is_word": true, "word_id": 471, "word_key": " massive", "bytes_hex": "20 6d 61 73 73 69 76 65", "compression": {"rwkv": "7.26% 7.26% 7.26% 7.26% 7.26% 7.26% 7.26% 7.26%", "qwen": "12.42% 12.42% 12.42% 12.42% 12.42% 12.42% 12.42% 12.42%"}, "model_tokens": {"rwkv": [[52195, " massive", "normal", 0.040357425808906555]], "qwen": [[10951, " massive", "normal", 0.004051612690091133]]}, "loss": {"rwkv": 7.25574166072086, "qwen": 12.417637542849741}, "topk": {"rwkv": [52195, 3, 0.040357425808906555, [[22590, 0.181135, " the", false], [332, 0.109615, " a", false], [52195, 0.040357, " massive", false], [38888, 0.03349, " lever", false], [22226, 0.032826, " one", false], [4419, 0.03117, " an", false], [59988, 0.025902, " massively", false], [52224, 0.024894, " methods", false], [63370, 0.02327, " computation", false], [51832, 0.021012, " general", false]]], "qwen": [10951, 27, 0.004051612690091133, [[279, 0.188626, " the", false], [264, 0.10628, " a", false], [4586, 0.06056, " general", false], [5413, 0.052981, " methods", false], [458, 0.04216, " an", false], [39661, 0.036924, " exploitation", false], [13009, 0.036775, " agents", false], [76482, 0.023248, " leveraging", false], [26403, 0.022925, " exploration", false], [6832, 0.018577, " learning", false]]]}, "raw_delta": -0.2862362861633301, "tuned_delta": -0.27889914764962737}, {"byte_start": 2763, "byte_end": 2775, "display": {"text": " computation", "kind": "normal"}, "is_word": true, "word_id": 472, "word_key": " computation", "bytes_hex": "20 63 6f 6d 70 75 74 61 74 69 6f 6e", "compression": {"rwkv": "2.72% 2.72% 2.72% 2.72% 2.72% 2.72% 2.72% 2.72% 2.72% 2.72% 2.72% 2.72%", "qwen": "3.18% 3.18% 3.18% 3.18% 3.18% 3.18% 3.18% 3.18% 3.18% 3.18% 3.18% 3.18%"}, "model_tokens": {"rwkv": [[63370, " computation", "normal", 0.16332165896892548]], "qwen": [[34447, " computation", "normal", 0.12069942057132721]]}, "loss": {"rwkv": 2.723838293345048, "qwen": 3.17761380105219}, "topk": {"rwkv": [63370, 1, 0.16332165896892548, [[63370, 0.163322, " computation", false], [45, 0.138892, ",", false], [56812, 0.120582, " parallel", false], [63621, 0.092749, " improvement", false], [64423, 0.065934, " improvements", false], [56950, 0.049514, " progress", false], [63562, 0.033048, " exploration", false], [38888, 0.029448, " lever", false], [56540, 0.023476, " leverage", false], [59847, 0.016892, " increases", false]]], "qwen": [34447, 1, 0.12069942057132721, [[34447, 0.120699, " computation", false], [26403, 0.09624, " exploration", false], [2711, 0.075672, " search", false], [14713, 0.075473, " amounts", false], [15673, 0.049149, " improvement", false], [18142, 0.038987, " improvements", false], [39661, 0.034509, " exploitation", false], [11, 0.031238, ",", false], [26943, 0.031151, " scaling", false], [5452, 0.030295, " scale", false]]]}, "raw_delta": -0.025162657101949065, "tuned_delta": -0.01782551858824633}, {"byte_start": 2775, "byte_end": 2778, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 473, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "4.32% 4.32% 4.32%", "qwen": "6.63% 6.63% 6.63%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.48553267121315]], "qwen": [[311, " to", "normal", 0.3317577838897705]]}, "loss": {"rwkv": 4.320571085995593, "qwen": 6.632490865881613}, "topk": {"rwkv": [4811, 1, 0.48553267121315, [[4811, 0.485533, " to", false], [45, 0.09907, ",", false], [47, 0.073175, ".", false], [32487, 0.033088, " with", false], [21265, 0.032928, " and", false], [4424, 0.0323, " at", false], [4596, 0.028236, " in", false], [53356, 0.026915, " without", false], [4712, 0.020541, " on", false], [4706, 0.019663, " of", false]]], "qwen": [311, 1, 0.3317577838897705, [[311, 0.331758, " to", false], [11, 0.125657, ",", false], [13, 0.109759, ".", false], [2041, 0.058306, " without", false], [323, 0.0552, " and", false], [518, 0.033041, " at", false], [429, 0.032326, " that", false], [448, 0.026722, " with", false], [382, 0.02651, ".\n\n", false], [714, 0.022131, " but", false]]]}, "raw_delta": -0.12820005416870114, "tuned_delta": -0.1208629156549984}, {"byte_start": 2778, "byte_end": 2781, "display": {"text": " be", "kind": "normal"}, "is_word": true, "word_id": 474, "word_key": " be", "bytes_hex": "20 62 65", "compression": {"rwkv": "1.50% 1.50% 1.50%", "qwen": "2.03% 2.03% 2.03%"}, "model_tokens": {"rwkv": [[4435, " be", "normal", 0.7808938026428223]], "qwen": [[387, " be", "normal", 0.7130709290504456]]}, "loss": {"rwkv": 1.4969369931098861, "qwen": 2.032843532330941}, "topk": {"rwkv": [4435, 1, 0.7808938026428223, [[4435, 0.780894, " be", false], [56540, 0.05814, " leverage", false], [32187, 0.006568, " take", false], [45284, 0.006057, " become", false], [52570, 0.00537, " proceed", false], [51982, 0.005081, " improve", false], [31702, 0.005009, " play", false], [31358, 0.004936, " make", false], [30858, 0.003916, " find", false], [22249, 0.00347, " out", false]]], "qwen": [387, 1, 0.7130709290504456, [[387, 0.713071, " be", false], [1896, 0.027526, " take", false], [614, 0.013965, " have", false], [3635, 0.012586, " become", false], [32064, 0.010333, " leverage", false], [1281, 0.009125, " make", false], [7269, 0.008625, " improve", false], [11075, 0.008269, " achieve", false], [22279, 0.007899, " overcome", false], [1486, 0.006836, " play", false]]]}, "raw_delta": -0.029716968536376953, "tuned_delta": -0.022379830022674217}, {"byte_start": 2781, "byte_end": 2789, "display": {"text": " brought", "kind": "normal"}, "is_word": true, "word_id": 475, "word_key": " brought", "bytes_hex": "20 62 72 6f 75 67 68 74", "compression": {"rwkv": "11.27% 11.27% 11.27% 11.27% 11.27% 11.27% 11.27% 11.27%", "qwen": "11.49% 11.49% 11.49% 11.49% 11.49% 11.49% 11.49% 11.49%"}, "model_tokens": {"rwkv": [[51097, " brought", "normal", 0.00672551104798913]], "qwen": [[7117, " brought", "normal", 0.0061202989891171455]]}, "loss": {"rwkv": 11.271055006945026, "qwen": 11.487784318887634}, "topk": {"rwkv": [51097, 13, 0.00672551104798913, [[50937, 0.305008, " applied", false], [56540, 0.168066, " leverage", false], [60152, 0.092357, " performed", false], [30666, 0.080413, " done", false], [32354, 0.069184, " used", false], [51139, 0.023411, " carried", false], [59355, 0.022818, " conducted", false], [31351, 0.011627, " made", false], [55957, 0.00908, " deployed", false], [22418, 0.008846, " run", false]]], "qwen": [7117, 19, 0.0061202989891171455, [[1483, 0.209172, " used", false], [27505, 0.177003, " lever", false], [9251, 0.148379, " applied", false], [2814, 0.096124, " done", false], [10660, 0.041811, " performed", false], [1865, 0.026493, " made", false], [50663, 0.019872, " exploited", false], [26075, 0.011203, " deployed", false], [19446, 0.009398, " employed", false], [2182, 0.008854, " put", false]]]}, "raw_delta": -0.012018024921417236, "tuned_delta": -0.0046808864077145}, {"byte_start": 2789, "byte_end": 2792, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 476, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "0.24% 0.24% 0.24%", "qwen": "0.21% 0.21% 0.21%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.9612718224525452]], "qwen": [[311, " to", "normal", 0.965833842754364]]}, "loss": {"rwkv": 0.23921640184010928, "qwen": 0.2089710581155999}, "topk": {"rwkv": [4811, 1, 0.9612718224525452, [[4811, 0.961272, " to", false], [31162, 0.012103, " into", false], [40062, 0.004677, " under", false], [4596, 0.002279, " in", false], [56003, 0.00124, " directly", false], [52628, 0.001237, " quickly", false], [63507, 0.001169, " effectively", false], [30678, 0.001113, " down", false], [57435, 0.001085, " together", false], [51791, 0.000888, " forward", false]]], "qwen": [311, 1, 0.965833842754364, [[311, 0.965834, " to", false], [1119, 0.023412, " into", false], [304, 0.002711, " in", false], [1212, 0.001242, " under", false], [911, 0.000974, " about", false], [2860, 0.000767, " online", false], [3786, 0.000469, " together", false], [11872, 0.000411, " cheap", false], [389, 0.000329, " on", false], [8630, 0.000317, " onto", false]]]}, "raw_delta": 0.0016771579782168082, "tuned_delta": 0.009014296491919545}, {"byte_start": 2792, "byte_end": 2797, "display": {"text": " bear", "kind": "normal"}, "is_word": true, "word_id": 477, "word_key": " bear", "bytes_hex": "20 62 65 61 72", "compression": {"rwkv": "0.06% 0.06% 0.06% 0.06% 0.06%", "qwen": "0.03% 0.03% 0.03% 0.03% 0.03%"}, "model_tokens": {"rwkv": [[30255, " bear", "normal", 0.9847694635391235]], "qwen": [[11722, " bear", "normal", 0.9928228855133057]]}, "loss": {"rwkv": 0.05525458606920316, "qwen": 0.025979210499576095}, "topk": {"rwkv": [30255, 1, 0.9847694635391235, [[30255, 0.984769, " bear", false], [22590, 0.004673, " the", false], [332, 0.002701, " a", false], [4419, 0.000921, " an", false], [31702, 0.000572, " play", false], [39590, 0.000569, " scale", false], [30235, 0.000419, " bare", false], [32202, 0.000306, " task", false], [22681, 0.000219, " use", false], [32499, 0.000162, " work", false]]], "qwen": [11722, 1, 0.9928228855133057, [[11722, 0.992823, " bear", false], [279, 0.003907, " the", false], [264, 0.000731, " a", false], [1486, 0.000568, " play", false], [3383, 0.000198, " task", false], [5452, 0.000198, " scale", false], [458, 0.000177, " an", false], [894, 8.3e-05, " any", false], [21828, 6.7e-05, " solving", false], [3491, 5.7e-05, " problem", false]]]}, "raw_delta": 0.00162337152287364, "tuned_delta": 0.008960510036576377}, {"byte_start": 2797, "byte_end": 2798, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "45.93%", "qwen": "37.38%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.07866539806127548]], "qwen": [[13, ".", "normal", 0.12581726908683777]]}, "loss": {"rwkv": 45.92954915330098, "qwen": 37.38247575857672}, "topk": {"rwkv": [47, 2, 0.07866539806127548, [[4712, 0.613678, " on", false], [47, 0.078665, ".", false], [45, 0.073907, ",", false], [4596, 0.058302, " in", false], [4811, 0.026185, " to", false], [53356, 0.018578, " without", false], [4424, 0.012507, " at", false], [21265, 0.010231, " and", false], [52628, 0.006706, " quickly", false], [31601, 0.006414, " over", false]]], "qwen": [13, 3, 0.12581726908683777, [[389, 0.432773, " on", false], [11, 0.149686, ",", false], [13, 0.125817, ".", false], [304, 0.049302, " in", false], [382, 0.038853, ".\n\n", false], [2041, 0.035623, " without", false], [323, 0.029677, " and", false], [311, 0.019642, " to", false], [26, 0.011298, ";", false], [714, 0.00808, " but", false]]]}, "raw_delta": 0.4739503860473633, "tuned_delta": 0.481287524561066}, {"byte_start": 2798, "byte_end": 2805, "display": {"text": " Search", "kind": "normal"}, "is_word": true, "word_id": 478, "word_key": " search", "bytes_hex": "20 53 65 61 72 63 68", "compression": {"rwkv": "9.58% 9.58% 9.58% 9.58% 9.58% 9.58% 9.58%", "qwen": "10.67% 10.67% 10.67% 10.67% 10.67% 10.67% 10.67%"}, "model_tokens": {"rwkv": [[44844, " Search", "normal", 0.024017278105020523]], "qwen": [[7542, " Search", "normal", 0.015871211886405945]]}, "loss": {"rwkv": 9.580396755903271, "qwen": 10.674007406894734}, "topk": {"rwkv": [44844, 9, 0.024017278105020523, [[261, 0.160575, "\n\n", false], [19555, 0.106946, " But", false], [20996, 0.10121, " The", false], [3918, 0.076942, " It", false], [3913, 0.048261, " In", false], [19417, 0.031542, " And", false], [55122, 0.028116, " Learning", false], [267, 0.025282, "  ", false], [44844, 0.024017, " Search", false], [29894, 0.022862, " This", false]]], "qwen": [7542, 10, 0.015871211886405945, [[1084, 0.136113, " It", false], [576, 0.094023, " The", false], [220, 0.081177, " ", false], [758, 0.062874, " In", false], [1988, 0.036261, " But", false], [20909, 0.03, " Learning", false], [1597, 0.028712, " And", false], [1096, 0.025151, " This", false], [4354, 0.017457, " However", false], [7542, 0.015871, " Search", false]]]}, "raw_delta": -0.06064265114920475, "tuned_delta": -0.05330551263550201}, {"byte_start": 2805, "byte_end": 2809, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 479, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"rwkv": "9.72% 9.72% 9.72% 9.72%", "qwen": "10.57% 10.57% 10.57% 10.57%"}, "model_tokens": {"rwkv": [[21265, " and", "normal", 0.11666335165500641]], "qwen": [[323, " and", "normal", 0.09580511599779129]]}, "loss": {"rwkv": 9.721284943490085, "qwen": 10.57422967576948}, "topk": {"rwkv": [21265, 2, 0.11666335165500641, [[4600, 0.192088, " is", false], [21265, 0.116663, " and", false], [45, 0.072507, ",", false], [22748, 0.053892, " was", false], [4596, 0.043797, " in", false], [21800, 0.036154, " has", false], [21413, 0.035198, " can", false], [46, 0.030554, "-", false], [30659, 0.018901, " does", false], [4450, 0.018035, " by", false]]], "qwen": [323, 2, 0.09580511599779129, [[374, 0.206357, " is", false], [323, 0.095805, " and", false], [5980, 0.071295, "-based", false], [646, 0.046686, " can", false], [11, 0.045902, ",", false], [572, 0.042375, " was", false], [702, 0.0265, " has", false], [304, 0.024422, " in", false], [553, 0.023038, " by", false], [20081, 0.018307, " enables", false]]]}, "raw_delta": -0.04729729890823364, "tuned_delta": -0.0399601603945309}, {"byte_start": 2809, "byte_end": 2818, "display": {"text": " learning", "kind": "normal"}, "is_word": true, "word_id": 480, "word_key": " learning", "bytes_hex": "20 6c 65 61 72 6e 69 6e 67", "compression": {"rwkv": "0.49% 0.49% 0.49% 0.49% 0.49% 0.49% 0.49% 0.49% 0.49%", "qwen": "0.25% 0.25% 0.25% 0.25% 0.25% 0.25% 0.25% 0.25% 0.25%"}, "model_tokens": {"rwkv": [[56537, " learning", "normal", 0.7848356366157532]], "qwen": [[6832, " learning", "normal", 0.8839277029037476]]}, "loss": {"rwkv": 0.4872383154043943, "qwen": 0.2472218956567819}, "topk": {"rwkv": [56537, 1, 0.7848356366157532, [[56537, 0.784836, " learning", false], [31978, 0.19264, " self", false], [30597, 0.002628, " deep", false], [22590, 0.001691, " the", false], [65003, 0.00165, " reinforcement", false], [51832, 0.001382, " general", false], [39193, 0.000961, " other", false], [21902, 0.000593, " its", false], [40093, 0.000495, " value", false], [38888, 0.000402, " lever", false]]], "qwen": [6832, 1, 0.8839277029037476, [[6832, 0.883928, " learning", false], [656, 0.037151, " self", false], [3738, 0.005913, " human", false], [279, 0.004736, " the", false], [4586, 0.003994, " general", false], [1008, 0.003665, " other", false], [3960, 0.003263, " learn", false], [71278, 0.003174, " reinforcement", false], [11, 0.002926, ",", false], [5662, 0.002919, " machine", false]]]}, "raw_delta": 0.013309336370891992, "tuned_delta": 0.02064647488459473}, {"byte_start": 2818, "byte_end": 2822, "display": {"text": " are", "kind": "normal"}, "is_word": true, "word_id": 481, "word_key": " are", "bytes_hex": "20 61 72 65", "compression": {"rwkv": "4.72% 4.72% 4.72% 4.72%", "qwen": "4.28% 4.28% 4.28% 4.28%"}, "model_tokens": {"rwkv": [[21286, " are", "normal", 0.3498106598854065]], "qwen": [[525, " are", "normal", 0.3873915672302246]]}, "loss": {"rwkv": 4.719754284158229, "qwen": 4.275423669509565}, "topk": {"rwkv": [21286, 1, 0.3498106598854065, [[21286, 0.349811, " are", false], [4450, 0.097696, " by", false], [21413, 0.06562, " can", false], [30322, 0.060809, " both", false], [31059, 0.051976, " have", false], [45, 0.033439, ",", false], [4596, 0.031343, " in", false], [32462, 0.029059, " were", false], [4491, 0.011978, " do", false], [22681, 0.011245, " use", false]]], "qwen": [525, 1, 0.3873915672302246, [[525, 0.387392, " are", false], [553, 0.133823, " by", false], [646, 0.054331, " can", false], [614, 0.044623, " have", false], [2176, 0.03334, " both", false], [11, 0.030488, ",", false], [1033, 0.025587, " were", false], [304, 0.018692, " in", false], [22766, 0.015927, " complement", false], [653, 0.012731, " do", false]]]}, "raw_delta": 0.02463892102241516, "tuned_delta": 0.0319760595361179}, {"byte_start": 2822, "byte_end": 2826, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 482, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "12.19% 12.19% 12.19% 12.19%", "qwen": "12.84% 12.84% 12.84% 12.84%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.06632135808467865]], "qwen": [[279, " the", "normal", 0.05798915773630142]]}, "loss": {"rwkv": 12.186828226259308, "qwen": 12.837728815196645}, "topk": {"rwkv": [22590, 4, 0.06632135808467865, [[64857, 0.121137, " complementary", false], [30322, 0.119442, " both", false], [22187, 0.070994, " not", false], [22590, 0.066321, " the", false], [22638, 0.04091, " two", false], [32239, 0.02672, " thus", false], [30135, 0.020186, " also", false], [59513, 0.017167, " different", false], [32386, 0.016981, " very", false], [45, 0.016536, ",", false]]], "qwen": [279, 5, 0.05798915773630142, [[2176, 0.143617, " both", false], [537, 0.10829, " not", false], [57435, 0.095817, " complementary", false], [1378, 0.078652, " two", false], [279, 0.057989, " the", false], [1602, 0.029411, " very", false], [2155, 0.021551, " different", false], [42493, 0.017764, " fundamentally", false], [1075, 0.015924, " like", false], [3545, 0.015657, " often", false]]]}, "raw_delta": -0.03609359264373779, "tuned_delta": -0.028756454130035056}, {"byte_start": 2826, "byte_end": 2830, "display": {"text": " two", "kind": "normal"}, "is_word": true, "word_id": 483, "word_key": " two", "bytes_hex": "20 74 77 6f", "compression": {"rwkv": "4.75% 4.75% 4.75% 4.75%", "qwen": "3.14% 3.14% 3.14% 3.14%"}, "model_tokens": {"rwkv": [[22638, " two", "normal", 0.3483581840991974]], "qwen": [[1378, " two", "normal", 0.49840816855430603]]}, "loss": {"rwkv": 4.754976331054933, "qwen": 3.139376414584656}, "topk": {"rwkv": [22638, 1, 0.3483581840991974, [[22638, 0.348358, " two", false], [31937, 0.105616, " same", false], [31461, 0.069442, " most", false], [31581, 0.061543, " only", false], [51832, 0.019432, " general", false], [57481, 0.017252, " ultimate", false], [31356, 0.016615, " main", false], [52224, 0.015191, " methods", false], [21952, 0.011114, " key", false], [21357, 0.009176, " big", false]]], "qwen": [1378, 1, 0.49840816855430603, [[1378, 0.498408, " two", false], [1429, 0.062366, " most", false], [1172, 0.056847, " only", false], [4586, 0.038485, " general", false], [1852, 0.034889, " same", false], [1850, 0.016256, " best", false], [5413, 0.014677, " methods", false], [3363, 0.011128, " means", false], [1887, 0.011071, " main", false], [27397, 0.007124, " twin", false]]]}, "raw_delta": 0.08958788216114044, "tuned_delta": 0.09692502067484318}, {"byte_start": 2830, "byte_end": 2835, "display": {"text": " most", "kind": "normal"}, "is_word": true, "word_id": 484, "word_key": " most", "bytes_hex": "20 6d 6f 73 74", "compression": {"rwkv": "5.24% 5.24% 5.24% 5.24% 5.24%", "qwen": "6.89% 6.89% 6.89% 6.89% 6.89%"}, "model_tokens": {"rwkv": [[31461, " most", "normal", 0.23447805643081665]], "qwen": [[1429, " most", "normal", 0.14800553023815155]]}, "loss": {"rwkv": 5.241040578229438, "qwen": 6.890692575869345}, "topk": {"rwkv": [31461, 1, 0.23447805643081665, [[31461, 0.234478, " most", false], [31356, 0.094586, " main", false], [51832, 0.06343, " general", false], [52224, 0.062682, " methods", false], [61590, 0.037512, " approaches", false], [52469, 0.028981, " pillars", false], [38961, 0.023033, " major", false], [21357, 0.022754, " big", false], [39682, 0.01994, " sides", false], [56040, 0.019224, " dominant", false]]], "qwen": [1429, 1, 0.14800553023815155, [[1429, 0.148006, " most", false], [4586, 0.087399, " general", false], [1887, 0.080456, " main", false], [5413, 0.06258, " methods", false], [3598, 0.042226, " major", false], [11067, 0.038367, " sides", false], [5510, 0.034518, " ways", false], [15811, 0.02932, " fundamental", false], [6028, 0.027451, " primary", false], [19827, 0.023461, " approaches", false]]]}, "raw_delta": -0.09147613048553466, "tuned_delta": -0.08413899197183192}, {"byte_start": 2835, "byte_end": 2845, "display": {"text": " important", "kind": "normal"}, "is_word": true, "word_id": 485, "word_key": " important", "bytes_hex": "20 69 6d 70 6f 72 74 61 6e 74", "compression": {"rwkv": "2.71% 2.71% 2.71% 2.71% 2.71% 2.71% 2.71% 2.71% 2.71% 2.71%", "qwen": "3.02% 3.02% 3.02% 3.02% 3.02% 3.02% 3.02% 3.02% 3.02% 3.02%"}, "model_tokens": {"rwkv": [[59829, " important", "normal", 0.2198876291513443]], "qwen": [[2989, " important", "normal", 0.18727020919322968]]}, "loss": {"rwkv": 2.7050532016668054, "qwen": 3.0210083339813387}, "topk": {"rwkv": [59829, 2, 0.2198876291513443, [[51832, 0.229168, " general", false], [59829, 0.219888, " important", false], [59593, 0.16456, " effective", false], [56900, 0.116635, " powerful", false], [63591, 0.03673, " fundamental", false], [60274, 0.022912, " promising", false], [45534, 0.018497, " common", false], [37812, 0.017187, " basic", false], [59594, 0.013031, " efficient", false], [62603, 0.010843, " successful", false]]], "qwen": [2989, 2, 0.18727020919322968, [[7373, 0.220257, " effective", false], [2989, 0.18727, " important", false], [7988, 0.147371, " powerful", false], [4586, 0.067652, " general", false], [4185, 0.057547, " common", false], [20469, 0.025604, " prominent", false], [15811, 0.019474, " fundamental", false], [6770, 0.019341, " basic", false], [8036, 0.018842, " obvious", false], [6849, 0.017663, " successful", false]]]}, "raw_delta": -0.017520272731781, "tuned_delta": -0.010183134218078264}, {"byte_start": 2845, "byte_end": 2853, "display": {"text": " classes", "kind": "normal"}, "is_word": true, "word_id": 486, "word_key": " classes", "bytes_hex": "20 63 6c 61 73 73 65 73", "compression": {"rwkv": "10.64% 10.64% 10.64% 10.64% 10.64% 10.64% 10.64% 10.64%", "qwen": "11.57% 11.57% 11.57% 11.57% 11.57% 11.57% 11.57% 11.57%"}, "model_tokens": {"rwkv": [[51200, " classes", "normal", 0.008807763457298279]], "qwen": [[6846, " classes", "normal", 0.005898187402635813]]}, "loss": {"rwkv": 10.637058162804367, "qwen": 11.571113137905368}, "topk": {"rwkv": [51200, 19, 0.008807763457298279, [[52224, 0.185416, " methods", false], [51832, 0.159741, " general", false], [32448, 0.048392, " ways", false], [61590, 0.042632, " approaches", false], [62633, 0.037186, " techniques", false], [21265, 0.027478, " and", false], [39979, 0.02586, " tools", false], [38888, 0.022677, " lever", false], [45, 0.021299, ",", false], [64862, 0.016938, " computational", false]]], "qwen": [6846, 20, 0.005898187402635813, [[4586, 0.143531, " general", false], [5413, 0.132431, " methods", false], [5510, 0.094557, " ways", false], [7375, 0.058382, " tools", false], [19827, 0.049997, " approaches", false], [12538, 0.038348, " techniques", false], [3363, 0.028763, " means", false], [6813, 0.025909, " components", false], [54480, 0.024748, " computational", false], [13966, 0.021211, " ingredients", false]]]}, "raw_delta": -0.051795005798339844, "tuned_delta": -0.044457867284637104}, {"byte_start": 2853, "byte_end": 2856, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 487, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "0.03% 0.03% 0.03%", "qwen": "0.03% 0.03% 0.03%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.9949312806129456]], "qwen": [[315, " of", "normal", 0.9943274855613708]]}, "loss": {"rwkv": 0.030635842873694974, "qwen": 0.034195892144145486}, "topk": {"rwkv": [4706, 1, 0.9949312806129456, [[4706, 0.994931, " of", false], [4596, 0.001776, " in", false], [21700, 0.000519, " for", false], [45, 0.000491, ",", false], [32227, 0.000277, " that", false], [4715, 0.000243, " or", false], [275, 0.000214, " (", false], [4811, 0.000171, " to", false], [47, 0.000151, ".", false], [21265, 0.000126, " and", false]]], "qwen": [315, 1, 0.9943274855613708, [[315, 0.994327, " of", false], [304, 0.001101, " in", false], [429, 0.000963, " that", false], [369, 0.000572, " for", false], [320, 0.000504, " (", false], [11, 0.000416, ",", false], [476, 0.000242, " or", false], [311, 0.000238, " to", false], [323, 0.000137, " and", false], [4221, 8.4e-05, " among", false]]]}, "raw_delta": -0.00019741104915738106, "tuned_delta": 0.0071397274645453555}, {"byte_start": 2856, "byte_end": 2867, "display": {"text": " techniques", "kind": "normal"}, "is_word": true, "word_id": 488, "word_key": " techniques", "bytes_hex": "20 74 65 63 68 6e 69 71 75 65 73", "compression": {"rwkv": "4.97% 4.97% 4.97% 4.97% 4.97% 4.97% 4.97% 4.97% 4.97% 4.97% 4.97%", "qwen": "5.74% 5.74% 5.74% 5.74% 5.74% 5.74% 5.74% 5.74% 5.74% 5.74% 5.74%"}, "model_tokens": {"rwkv": [[62633, " techniques", "normal", 0.04822281002998352]], "qwen": [[12538, " techniques", "normal", 0.030211452394723892]]}, "loss": {"rwkv": 4.9695106166984875, "qwen": 5.737227880581591}, "topk": {"rwkv": [62633, 4, 0.04822281002998352, [[52224, 0.407013, " methods", false], [51832, 0.179219, " general", false], [61559, 0.079326, " algorithms", false], [62633, 0.048223, " techniques", false], [3609, 0.044719, " AI", false], [61590, 0.035611, " approaches", false], [63370, 0.022687, " computation", false], [59113, 0.016687, " algorithm", false], [64862, 0.0114, " computational", false], [46561, 0.009747, " method", false]]], "qwen": [12538, 7, 0.030211452394723892, [[5413, 0.40924, " methods", false], [4586, 0.115374, " general", false], [1714, 0.07087, " method", false], [34447, 0.068192, " computation", false], [54480, 0.041362, " computational", false], [25185, 0.032391, " algorithms", false], [12538, 0.030211, " techniques", false], [19827, 0.02384, " approaches", false], [12111, 0.023117, " algorithm", false], [15235, 0.02189, " AI", false]]]}, "raw_delta": -0.042571284554221434, "tuned_delta": -0.035234146040518693}, {"byte_start": 2867, "byte_end": 2871, "display": {"text": " for", "kind": "normal"}, "is_word": true, "word_id": 489, "word_key": " for", "bytes_hex": "20 66 6f 72", "compression": {"rwkv": "5.07% 5.07% 5.07% 5.07%", "qwen": "5.20% 5.20% 5.20% 5.20%"}, "model_tokens": {"rwkv": [[21700, " for", "normal", 0.32260483503341675]], "qwen": [[369, " for", "normal", 0.31576159596443176]]}, "loss": {"rwkv": 5.071974753125262, "qwen": 5.19716361191722}, "topk": {"rwkv": [21700, 1, 0.32260483503341675, [[21700, 0.322605, " for", false], [32227, 0.232815, " that", false], [4596, 0.173715, " in", false], [45, 0.061196, ",", false], [4811, 0.034004, " to", false], [47, 0.030551, ".", false], [32354, 0.018465, " used", false], [59206, 0.013358, " available", false], [21265, 0.00738, " and", false], [4450, 0.006967, " by", false]]], "qwen": [369, 1, 0.31576159596443176, [[369, 0.315762, " for", false], [429, 0.26786, " that", false], [304, 0.126991, " in", false], [311, 0.066363, " to", false], [11, 0.043717, ",", false], [1483, 0.023521, " used", false], [2500, 0.016698, " available", false], [13, 0.015239, ".", false], [582, 0.005726, " we", false], [553, 0.00528, " by", false]]]}, "raw_delta": -0.006941944360733032, "tuned_delta": 0.00039519415296970437}, {"byte_start": 2871, "byte_end": 2881, "display": {"text": " utilizing", "kind": "normal"}, "is_word": true, "word_id": 490, "word_key": " utilizing", "bytes_hex": "20 75 74 69 6c 69 7a 69 6e 67", "compression": {"rwkv": "12.68% 12.68% 12.68% 12.68% 12.68% 12.68% 12.68% 12.68% 12.68% 12.68%", "qwen": "9.54% 9.54% 9.54% 9.54% 9.54% 9.54% 9.54% 9.54% 9.54% 9.54%"}, "model_tokens": {"rwkv": [[60720, " utilizing", "normal", 0.0008722257916815579]], "qwen": [[34888, " utilizing", "normal", 0.0050475276075303555]]}, "loss": {"rwkv": 12.679936882813154, "qwen": 9.537758817101363}, "topk": {"rwkv": [60720, 132, 0.0008722257916815579, [[59832, 0.061991, " improving", false], [3609, 0.059179, " AI", false], [51832, 0.058164, " general", false], [38888, 0.057947, " lever", false], [52949, 0.041036, " solving", false], [46500, 0.037364, " making", false], [47497, 0.021289, " taking", false], [51844, 0.021081, " getting", false], [51392, 0.020727, " dealing", false], [22590, 0.01947, " the", false]]], "qwen": [34888, 35, 0.0050475276075303555, [[76482, 0.162236, " leveraging", false], [21828, 0.083615, " solving", false], [4586, 0.049685, " general", false], [15235, 0.040716, " AI", false], [18392, 0.030699, " improving", false], [27362, 0.030692, " enabling", false], [4633, 0.023317, " taking", false], [70601, 0.022516, " exploiting", false], [1667, 0.017289, " using", false], [279, 0.016945, " the", false]]]}, "raw_delta": 0.17423934936523433, "tuned_delta": 0.18157648787893707}, {"byte_start": 2881, "byte_end": 2889, "display": {"text": " massive", "kind": "normal"}, "is_word": true, "word_id": 491, "word_key": " massive", "bytes_hex": "20 6d 61 73 73 69 76 65", "compression": {"rwkv": "4.37% 4.37% 4.37% 4.37% 4.37% 4.37% 4.37% 4.37%", "qwen": "4.69% 4.69% 4.69% 4.69% 4.69% 4.69% 4.69% 4.69%"}, "model_tokens": {"rwkv": [[52195, " massive", "normal", 0.143527552485466]], "qwen": [[10951, " massive", "normal", 0.12494955211877823]]}, "loss": {"rwkv": 4.367533815191197, "qwen": 4.688409908592699}, "topk": {"rwkv": [52195, 2, 0.143527552485466, [[63370, 0.531405, " computation", false], [52195, 0.143528, " massive", false], [51832, 0.06595, " general", false], [22590, 0.056844, " the", false], [59988, 0.040293, " massively", false], [38864, 0.021748, " large", false], [64862, 0.014995, " computational", false], [59346, 0.007142, " computing", false], [332, 0.005392, " a", false], [51266, 0.00449, " compute", false]]], "qwen": [10951, 2, 0.12494955211877823, [[34447, 0.473113, " computation", false], [10951, 0.12495, " massive", false], [279, 0.085623, " the", false], [63707, 0.04671, " massively", false], [54480, 0.033167, " computational", false], [4586, 0.028939, " general", false], [3460, 0.018179, " large", false], [6366, 0.014301, " computer", false], [419, 0.012215, " this", false], [74151, 0.007824, " exponentially", false]]]}, "raw_delta": -0.01779314875602722, "tuned_delta": -0.010456010242324485}, {"byte_start": 2889, "byte_end": 2897, "display": {"text": " amounts", "kind": "normal"}, "is_word": true, "word_id": 492, "word_key": " amounts", "bytes_hex": "20 61 6d 6f 75 6e 74 73", "compression": {"rwkv": "10.78% 10.78% 10.78% 10.78% 10.78% 10.78% 10.78% 10.78%", "qwen": "8.24% 8.24% 8.24% 8.24% 8.24% 8.24% 8.24% 8.24%"}, "model_tokens": {"rwkv": [[50897, " amounts", "normal", 0.008533269166946411]], "qwen": [[14713, " amounts", "normal", 0.02579469420015812]]}, "loss": {"rwkv": 10.777946350391181, "qwen": 8.244971894893352}, "topk": {"rwkv": [50897, 4, 0.008533269166946411, [[63370, 0.89807, " computation", false], [64862, 0.02223, " computational", false], [45, 0.018407, ",", false], [50897, 0.008533, " amounts", false], [59346, 0.006314, " computing", false], [64298, 0.006114, " computations", false], [56812, 0.004656, " parallel", false], [51266, 0.003307, " compute", false], [51832, 0.002735, " general", false], [56353, 0.002043, " hardware", false]]], "qwen": [14713, 3, 0.02579469420015812, [[34447, 0.834982, " computation", false], [54480, 0.052718, " computational", false], [14713, 0.025795, " amounts", false], [24231, 0.018217, " computing", false], [6366, 0.008259, " computer", false], [11, 0.006246, ",", false], [82599, 0.005775, " computations", false], [821, 0.002735, " data", false], [12564, 0.002578, " compute", false], [2500, 0.002349, " available", false]]]}, "raw_delta": 0.14045792818069458, "tuned_delta": 0.14779506669439732}, {"byte_start": 2897, "byte_end": 2900, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 493, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "0.01% 0.01% 0.01%", "qwen": "0.01% 0.01% 0.01%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.9986644983291626]], "qwen": [[315, " of", "normal", 0.9980055689811707]]}, "loss": {"rwkv": 0.008071719080494484, "qwen": 0.012001000602508067}, "topk": {"rwkv": [4706, 1, 0.9986644983291626, [[4706, 0.998664, " of", false], [63370, 0.000345, " computation", false], [21265, 0.000174, " and", false], [275, 0.000152, " (", false], [4715, 9.1e-05, " or", false], [45, 4.9e-05, ",", false], [11, 4.2e-05, "\n", false], [261, 3.5e-05, "\n\n", false], [4588, 3.4e-05, " if", false], [59346, 2.9e-05, " computing", false]]], "qwen": [315, 1, 0.9980055689811707, [[315, 0.998006, " of", false], [34447, 0.000474, " computation", false], [323, 0.000282, " and", false], [320, 0.000122, " (", false], [11, 9.3e-05, ",", false], [476, 8.8e-05, " or", false], [13, 7.9e-05, ".", false], [2500, 6.7e-05, " available", false], [198, 6e-05, "\n", false], [54480, 4.8e-05, " computational", false]]]}, "raw_delta": -0.00021788563268880048, "tuned_delta": 0.007119252881013936}, {"byte_start": 2900, "byte_end": 2912, "display": {"text": " computation", "kind": "normal"}, "is_word": true, "word_id": 494, "word_key": " computation", "bytes_hex": "20 63 6f 6d 70 75 74 61 74 69 6f 6e", "compression": {"rwkv": "0.16% 0.16% 0.16% 0.16% 0.16% 0.16% 0.16% 0.16% 0.16% 0.16% 0.16% 0.16%", "qwen": "0.22% 0.22% 0.22% 0.22% 0.22% 0.22% 0.22% 0.22% 0.22% 0.22% 0.22% 0.22%"}, "model_tokens": {"rwkv": [[63370, " computation", "normal", 0.9030185341835022]], "qwen": [[34447, " computation", "normal", 0.8663378953933716]]}, "loss": {"rwkv": 0.15556404046043915, "qwen": 0.21562315894494896}, "topk": {"rwkv": [63370, 1, 0.9030185341835022, [[63370, 0.903019, " computation", false], [64862, 0.028788, " computational", false], [59346, 0.014672, " computing", false], [51266, 0.009448, " compute", false], [55809, 0.004583, " computer", false], [59206, 0.004209, " available", false], [52167, 0.002465, " machine", false], [56812, 0.002179, " parallel", false], [51832, 0.002143, " general", false], [56353, 0.001819, " hardware", false]]], "qwen": [34447, 1, 0.8663378953933716, [[34447, 0.866338, " computation", false], [54480, 0.034819, " computational", false], [821, 0.017538, " data", false], [6366, 0.013891, " computer", false], [24231, 0.0123, " computing", false], [2500, 0.011808, " available", false], [1995, 0.005185, " information", false], [12564, 0.003155, " compute", false], [3738, 0.001975, " human", false], [4586, 0.001658, " general", false]]]}, "raw_delta": -0.0033303846915562936, "tuned_delta": 0.004006753822146443}, {"byte_start": 2912, "byte_end": 2915, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 495, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "14.46% 14.46% 14.46%", "qwen": "14.28% 14.28% 14.28%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.09011572599411011]], "qwen": [[304, " in", "normal", 0.09289742261171341]]}, "loss": {"rwkv": 14.464520592246117, "qwen": 14.284239778479177}, "topk": {"rwkv": [4596, 4, 0.09011572599411011, [[47, 0.444268, ".", false], [45, 0.173337, ",", false], [4811, 0.114559, " to", false], [4596, 0.090116, " in", false], [21700, 0.027015, " for", false], [21265, 0.018293, " and", false], [32227, 0.017344, " that", false], [60, 0.013864, ";", false], [63507, 0.011647, " effectively", false], [4712, 0.009159, " on", false]]], "qwen": [304, 4, 0.09289742261171341, [[13, 0.313173, ".", false], [11, 0.211635, ",", false], [382, 0.14766, ".\n\n", false], [304, 0.092897, " in", false], [311, 0.06056, " to", false], [323, 0.020972, " and", false], [26, 0.019117, ";", false], [369, 0.017094, " for", false], [624, 0.012426, ".\n", false], [429, 0.01229, " that", false]]]}, "raw_delta": 0.009996891021728516, "tuned_delta": 0.017334029535431252}, {"byte_start": 2915, "byte_end": 2918, "display": {"text": " AI", "kind": "normal"}, "is_word": true, "word_id": 496, "word_key": " ai", "bytes_hex": "20 41 49", "compression": {"rwkv": "4.65% 4.65% 4.65%", "qwen": "9.37% 9.37% 9.37%"}, "model_tokens": {"rwkv": [[3609, " AI", "normal", 0.4586777687072754]], "qwen": [[15235, " AI", "normal", 0.210323303937912]]}, "loss": {"rwkv": 4.649310190364823, "qwen": 9.372163745210477}, "topk": {"rwkv": [3609, 1, 0.4586777687072754, [[3609, 0.458678, " AI", false], [332, 0.084705, " a", false], [22590, 0.064146, " the", false], [51832, 0.046592, " general", false], [4419, 0.030424, " an", false], [52949, 0.024017, " solving", false], [61594, 0.01892, " artificial", false], [46588, 0.018793, " modern", false], [52167, 0.017314, " machine", false], [32448, 0.013587, " ways", false]]], "qwen": [15235, 1, 0.210323303937912, [[15235, 0.210323, " AI", false], [264, 0.094458, " a", false], [279, 0.078566, " the", false], [4586, 0.072917, " general", false], [458, 0.063759, " an", false], [5662, 0.041125, " machine", false], [1973, 0.030933, " order", false], [20443, 0.024568, " artificial", false], [71278, 0.022122, " reinforcement", false], [2711, 0.017161, " search", false]]]}, "raw_delta": -0.2618906100591024, "tuned_delta": -0.2545534715453997}, {"byte_start": 2918, "byte_end": 2927, "display": {"text": " research", "kind": "normal"}, "is_word": true, "word_id": 497, "word_key": " research", "bytes_hex": "20 72 65 73 65 61 72 63 68", "compression": {"rwkv": "2.79% 2.79% 2.79% 2.79% 2.79% 2.79% 2.79% 2.79% 2.79%", "qwen": "4.03% 4.03% 4.03% 4.03% 4.03% 4.03% 4.03% 4.03% 4.03%"}, "model_tokens": {"rwkv": [[57103, " research", "normal", 0.2478596568107605]], "qwen": [[3412, " research", "normal", 0.1335524618625641]]}, "loss": {"rwkv": 2.786455265605853, "qwen": 4.034057544249869}, "topk": {"rwkv": [57103, 2, 0.2478596568107605, [[47, 0.469999, ".", false], [57103, 0.24786, " research", false], [45, 0.133478, ",", false], [53087, 0.026666, " systems", false], [52224, 0.016976, " methods", false], [21265, 0.014366, " and", false], [56949, 0.010588, " programs", false], [60, 0.008723, ";", false], [275, 0.006393, " (", false], [39971, 0.004677, " today", false]]], "qwen": [3412, 4, 0.1335524618625641, [[13, 0.313332, ".", false], [382, 0.201284, ".\n\n", false], [11, 0.157925, ",", false], [3412, 0.133552, " research", false], [5942, 0.023116, " systems", false], [26, 0.020041, ";", false], [5322, 0.018045, " problems", false], [323, 0.016884, " and", false], [624, 0.013142, ".\n", false], [8357, 0.010693, " applications", false]]]}, "raw_delta": -0.06918176015218097, "tuned_delta": -0.06184462163847823}, {"byte_start": 2927, "byte_end": 2928, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "5.04%", "qwen": "15.99%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.7556390166282654]], "qwen": [[13, ".", "normal", 0.41206297278404236]]}, "loss": {"rwkv": 5.036752706228558, "qwen": 15.988290820159683}, "topk": {"rwkv": [47, 1, 0.7556390166282654, [[47, 0.755639, ".", false], [45, 0.161726, ",", false], [21265, 0.014211, " and", false], [60, 0.012137, ";", false], [275, 0.010651, " (", false], [39971, 0.007298, " today", false], [51018, 0.003667, " because", false], [56949, 0.003217, " programs", false], [4596, 0.003068, " in", false], [59, 0.003002, ":", false]]], "qwen": [13, 1, 0.41206297278404236, [[13, 0.412063, ".", false], [382, 0.242195, ".\n\n", false], [11, 0.20158, ",", false], [323, 0.02533, " and", false], [3351, 0.02175, " today", false], [26, 0.021355, ";", false], [624, 0.019663, ".\n", false], [320, 0.01351, " (", false], [4192, 0.003885, ".\n\n\n", false], [25, 0.003144, ":", false]]]}, "raw_delta": -0.6072822213172913, "tuned_delta": -0.5999450828035885}, {"byte_start": 2928, "byte_end": 2931, "display": {"text": " In", "kind": "normal"}, "is_word": true, "word_id": 498, "word_key": " in", "bytes_hex": "20 49 6e", "compression": {"rwkv": "21.13% 21.13% 21.13%", "qwen": "18.27% 18.27% 18.27%"}, "model_tokens": {"rwkv": [[3913, " In", "normal", 0.029775399714708328]], "qwen": [[758, " In", "normal", 0.047852978110313416]]}, "loss": {"rwkv": 21.133228138021924, "qwen": 18.27186391791443}, "topk": {"rwkv": [3913, 5, 0.029775399714708328, [[261, 0.421592, "\n\n", false], [20996, 0.066907, " The", false], [29893, 0.043399, " They", false], [267, 0.039527, "  ", false], [3913, 0.029775, " In", false], [44844, 0.022861, " Search", false], [3918, 0.020698, " It", false], [19417, 0.01929, " And", false], [28530, 0.018614, " Both", false], [19555, 0.016457, " But", false]]], "qwen": [758, 3, 0.047852978110313416, [[220, 0.127926, " ", false], [576, 0.096576, " The", false], [758, 0.047853, " In", false], [2379, 0.047493, " They", false], [7542, 0.038321, " Search", false], [1084, 0.034894, " It", false], [320, 0.028448, " (", false], [2619, 0.024459, " There", false], [4220, 0.018994, " These", false], [11733, 0.018804, " Both", false]]]}, "raw_delta": 0.15866772333780932, "tuned_delta": 0.16600486185151206}, {"byte_start": 2931, "byte_end": 2940, "display": {"text": " computer", "kind": "normal"}, "is_word": true, "word_id": 499, "word_key": " computer", "bytes_hex": "20 63 6f 6d 70 75 74 65 72", "compression": {"rwkv": "6.04% 6.04% 6.04% 6.04% 6.04% 6.04% 6.04% 6.04% 6.04%", "qwen": "5.53% 5.53% 5.53% 5.53% 5.53% 5.53% 5.53% 5.53% 5.53%"}, "model_tokens": {"rwkv": [[55809, " computer", "normal", 0.049491651356220245]], "qwen": [[6366, " computer", "normal", 0.06315793842077255]]}, "loss": {"rwkv": 6.042537823167749, "qwen": 5.534572731956873}, "topk": {"rwkv": [55809, 4, 0.049491651356220245, [[22590, 0.171705, " the", false], [30322, 0.103477, " both", false], [38013, 0.093484, " chess", false], [55809, 0.049492, " computer", false], [30808, 0.044222, " fact", false], [56901, 0.041997, " practice", false], [31370, 0.033308, " many", false], [32234, 0.032101, " this", false], [51832, 0.026929, " general", false], [332, 0.02177, " a", false]]], "qwen": [6366, 4, 0.06315793842077255, [[279, 0.183702, " the", false], [5994, 0.095047, " Go", false], [2097, 0.085396, " fact", false], [6366, 0.063158, " computer", false], [32719, 0.061677, " chess", false], [1657, 0.046327, " many", false], [2176, 0.041075, " both", false], [419, 0.034534, " this", false], [1045, 0.029164, " some", false], [264, 0.025614, " a", false]]]}, "raw_delta": 0.02816756566365558, "tuned_delta": 0.03550470417735832}, {"byte_start": 2940, "byte_end": 2943, "display": {"text": " Go", "kind": "normal"}, "is_word": true, "word_id": 500, "word_key": " go", "bytes_hex": "20 47 6f", "compression": {"rwkv": "4.48% 4.48% 4.48%", "qwen": "0.47% 0.47% 0.47%"}, "model_tokens": {"rwkv": [[3851, " Go", "normal", 0.4730294644832611]], "qwen": [[5994, " Go", "normal", 0.924994945526123]]}, "loss": {"rwkv": 4.484940638180208, "qwen": 0.468677580468661}, "topk": {"rwkv": [3851, 1, 0.4730294644832611, [[3851, 0.473029, " Go", false], [38013, 0.3588, " chess", false], [38576, 0.064519, " games", false], [46, 0.026104, "-", false], [52814, 0.020665, " science", false], [36466, 0.010621, " Chess", false], [47202, 0.003914, " search", false], [47732, 0.003721, " vision", false], [52491, 0.002778, " playing", false], [30941, 0.002632, " game", false]]], "qwen": [5994, 1, 0.924994945526123, [[5994, 0.924995, " Go", false], [32719, 0.050755, " chess", false], [3868, 0.005219, " games", false], [11129, 0.002533, " vision", false], [728, 0.001525, " go", false], [19926, 0.001371, "-go", false], [20814, 0.001265, " poker", false], [1809, 0.000784, " game", false], [8038, 0.000777, " science", false], [47387, 0.00046, " Chess", false]]]}, "raw_delta": 0.22270891318718591, "tuned_delta": 0.23004605170088865}, {"byte_start": 2943, "byte_end": 2944, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "3.26%", "qwen": "2.89%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.8336088061332703]], "qwen": [[11, ",", "normal", 0.851840615272522]]}, "loss": {"rwkv": 3.2580393379450463, "qwen": 2.891806851221859}, "topk": {"rwkv": [45, 1, 0.8336088061332703, [[45, 0.833609, ",", false], [21265, 0.044449, " and", false], [22590, 0.027182, " the", false], [39934, 0.012457, " there", false], [4423, 0.012252, " as", false], [4601, 0.008953, " it", false], [275, 0.007278, " (", false], [32232, 0.005239, " they", false], [4596, 0.005052, " in", false], [4424, 0.003106, " at", false]]], "qwen": [11, 1, 0.851840615272522, [[11, 0.851841, ",", false], [323, 0.023537, " and", false], [279, 0.017421, " the", false], [304, 0.013813, " in", false], [320, 0.009807, " (", false], [1052, 0.006973, " there", false], [432, 0.005671, " it", false], [419, 0.004637, " this", false], [1493, 0.004015, " these", false], [807, 0.003892, " they", false]]]}, "raw_delta": 0.0203082412481308, "tuned_delta": 0.027645379761833535}, {"byte_start": 2944, "byte_end": 2947, "display": {"text": " as", "kind": "normal"}, "is_word": true, "word_id": 501, "word_key": " as", "bytes_hex": "20 61 73", "compression": {"rwkv": "15.87% 15.87% 15.87%", "qwen": "17.78% 17.78% 17.78%"}, "model_tokens": {"rwkv": [[4423, " as", "normal", 0.07207941263914108]], "qwen": [[438, " as", "normal", 0.05194857344031334]]}, "loss": {"rwkv": 15.873402468114245, "qwen": 17.778216382387882}, "topk": {"rwkv": [4423, 4, 0.07207941263914108, [[22590, 0.240841, " the", false], [56537, 0.097014, " learning", false], [47202, 0.079971, " search", false], [4423, 0.072079, " as", false], [4601, 0.053005, " it", false], [39936, 0.035964, " these", false], [51948, 0.030038, " however", false], [32232, 0.024494, " they", false], [21265, 0.022851, " and", false], [332, 0.019221, " a", false]]], "qwen": [438, 5, 0.05194857344031334, [[279, 0.195139, " the", false], [2711, 0.096289, " search", false], [6832, 0.074085, " learning", false], [1493, 0.066387, " these", false], [438, 0.051949, " as", false], [264, 0.029, " a", false], [432, 0.028833, " it", false], [2176, 0.024597, " both", false], [807, 0.023639, " they", false], [3738, 0.018343, " human", false]]]}, "raw_delta": -0.10562531153360999, "tuned_delta": -0.09828817301990725}, {"byte_start": 2947, "byte_end": 2950, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 502, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "0.70% 0.70% 0.70%", "qwen": "1.53% 1.53% 1.53%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.8897480964660645]], "qwen": [[304, " in", "normal", 0.7752819657325745]]}, "loss": {"rwkv": 0.6985705967846135, "qwen": 1.530029321513405}, "topk": {"rwkv": [4596, 1, 0.8897480964660645, [[4596, 0.889748, " in", false], [32458, 0.02741, " well", false], [32487, 0.027285, " with", false], [4601, 0.007152, " it", false], [59608, 0.004455, " elsewhere", false], [22748, 0.003807, " was", false], [4600, 0.003266, " is", false], [332, 0.003253, " a", false], [22590, 0.002271, " the", false], [22190, 0.001814, " now", false]]], "qwen": [304, 1, 0.7752819657325745, [[304, 0.775282, " in", false], [1632, 0.065017, " well", false], [448, 0.045322, " with", false], [17920, 0.014089, " elsewhere", false], [432, 0.009485, " it", false], [264, 0.008159, " a", false], [374, 0.007507, " is", false], [369, 0.007215, " for", false], [279, 0.006596, " the", false], [807, 0.004535, " they", false]]]}, "raw_delta": -0.046105861663818366, "tuned_delta": -0.03876872315011563}, {"byte_start": 2950, "byte_end": 2959, "display": {"text": " computer", "kind": "normal"}, "is_word": true, "word_id": 503, "word_key": " computer", "bytes_hex": "20 63 6f 6d 70 75 74 65 72", "compression": {"rwkv": "2.72% 2.72% 2.72% 2.72% 2.72% 2.72% 2.72% 2.72% 2.72%", "qwen": "2.47% 2.47% 2.47% 2.47% 2.47% 2.47% 2.47% 2.47% 2.47%"}, "model_tokens": {"rwkv": [[55809, " computer", "normal", 0.25532466173171997]], "qwen": [[6366, " computer", "normal", 0.29155558347702026]]}, "loss": {"rwkv": 2.7238382933450476, "qwen": 2.4696627449869744}, "topk": {"rwkv": [55809, 2, 0.25532466173171997, [[38013, 0.465499, " chess", false], [55809, 0.255325, " computer", false], [31370, 0.081564, " many", false], [39193, 0.041045, " other", false], [22590, 0.032236, " the", false], [31461, 0.016021, " most", false], [21256, 0.01213, " all", false], [3609, 0.008911, " AI", false], [4788, 0.005703, " so", false], [36466, 0.005531, " Chess", false]]], "qwen": [6366, 2, 0.29155558347702026, [[32719, 0.383288, " chess", false], [6366, 0.291556, " computer", false], [1657, 0.098925, " many", false], [1008, 0.058122, " other", false], [678, 0.038657, " all", false], [279, 0.024456, " the", false], [1429, 0.023449, " most", false], [773, 0.022911, " so", false], [1753, 0.004562, " much", false], [5994, 0.004359, " Go", false]]]}, "raw_delta": 0.014094485176934124, "tuned_delta": 0.02143162369063686}, {"byte_start": 2959, "byte_end": 2965, "display": {"text": " chess", "kind": "normal"}, "is_word": true, "word_id": 504, "word_key": " chess", "bytes_hex": "20 63 68 65 73 73", "compression": {"rwkv": "0.08% 0.08% 0.08% 0.08% 0.08% 0.08%", "qwen": "0.04% 0.04% 0.04% 0.04% 0.04% 0.04%"}, "model_tokens": {"rwkv": [[38013, " chess", "normal", 0.9752193689346313]], "qwen": [[32719, " chess", "normal", 0.9878679513931274]]}, "loss": {"rwkv": 0.07521374597733496, "qwen": 0.03668731444912257}, "topk": {"rwkv": [38013, 1, 0.9752193689346313, [[38013, 0.975219, " chess", false], [36466, 0.018929, " Chess", false], [47202, 0.001134, " search", false], [46, 0.000909, "-", false], [39311, 0.000493, " poker", false], [3851, 0.000492, " Go", false], [38576, 0.000311, " games", false], [51180, 0.00014, " checker", false], [20660, 0.000121, " Pok", false], [52814, 8.4e-05, " science", false]]], "qwen": [32719, 1, 0.9878679513931274, [[32719, 0.987868, " chess", false], [47387, 0.003848, " Chess", false], [20814, 0.001194, " poker", false], [5994, 0.001027, " Go", false], [1779, 0.00058, " check", false], [1182, 0.000245, " back", false], [14164, 0.000241, " bridge", false], [3868, 0.000149, " games", false], [11129, 0.00014, " vision", false], [61447, 0.000136, " tic", false]]]}, "raw_delta": 0.0021363589912652965, "tuned_delta": 0.009473497504968034}, {"byte_start": 2965, "byte_end": 2966, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "0.68%", "qwen": "1.98%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.9629252552986145]], "qwen": [[11, ",", "normal", 0.8959089517593384]]}, "loss": {"rwkv": 0.6824271586236246, "qwen": 1.9821993443024535}, "topk": {"rwkv": [45, 1, 0.9629252552986145, [[45, 0.962925, ",", false], [21265, 0.011886, " and", false], [45285, 0.006032, " before", false], [275, 0.005515, " (", false], [4596, 0.0019, " in", false], [22590, 0.001036, " the", false], [332, 0.000941, " a", false], [51551, 0.000575, " earlier", false], [39934, 0.000524, " there", false], [4424, 0.000464, " at", false]]], "qwen": [11, 1, 0.8959089517593384, [[11, 0.895909, ",", false], [323, 0.048074, " and", false], [1573, 0.013162, " before", false], [304, 0.009898, " in", false], [320, 0.009069, " (", false], [518, 0.001852, " at", false], [369, 0.00163, " for", false], [220, 0.001625, " ", false], [264, 0.001368, " a", false], [4867, 0.00135, " prior", false]]]}, "raw_delta": -0.07207467406988144, "tuned_delta": -0.0647375355561787}, {"byte_start": 2966, "byte_end": 2978, "display": {"text": " researchers", "kind": "normal"}, "is_word": true, "word_id": 505, "word_key": " researchers", "bytes_hex": "20 72 65 73 65 61 72 63 68 65 72 73", "compression": {"rwkv": "6.72% 6.72% 6.72% 6.72% 6.72% 6.72% 6.72% 6.72% 6.72% 6.72% 6.72% 6.72%", "qwen": "7.09% 7.09% 7.09% 7.09% 7.09% 7.09% 7.09% 7.09% 7.09% 7.09% 7.09% 7.09%"}, "model_tokens": {"rwkv": [[63843, " researchers", "normal", 0.011587098240852356]], "qwen": [[11811, " researchers", "normal", 0.008952687494456768]]}, "loss": {"rwkv": 6.71567027497141, "qwen": 7.086940688899014}, "topk": {"rwkv": [63843, 12, 0.011587098240852356, [[22590, 0.367073, " the", false], [47202, 0.073676, " search", false], [56537, 0.068261, " learning", false], [4601, 0.055851, " it", false], [39936, 0.049941, " these", false], [39934, 0.036267, " there", false], [38720, 0.035227, " human", false], [332, 0.016487, " a", false], [32232, 0.014506, " they", false], [52224, 0.013679, " methods", false]]], "qwen": [11811, 15, 0.008952687494456768, [[279, 0.266813, " the", false], [2711, 0.094763, " search", false], [6832, 0.081794, " learning", false], [1493, 0.067788, " these", false], [432, 0.04355, " it", false], [3738, 0.03791, " human", false], [1052, 0.033235, " there", false], [264, 0.026297, " a", false], [64098, 0.019366, " brute", false], [807, 0.017445, " they", false]]]}, "raw_delta": -0.02058760325113934, "tuned_delta": -0.013250464737436605}, {"byte_start": 2978, "byte_end": 2979, "display": {"text": "'", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "27", "compression": {"rwkv": "58.89%", "qwen": "79.26%"}, "model_tokens": {"rwkv": [[40, "'", "normal", 0.037737879902124405]], "qwen": [[6, "'", "normal", 0.012339101172983646]]}, "loss": {"rwkv": 58.891262411287755, "qwen": 79.25774029696802}, "topk": {"rwkv": [40, 4, 0.037737879902124405, [[22762, 0.250653, " who", false], [32462, 0.079991, " were", false], [21795, 0.039324, " had", false], [40, 0.037738, "'", false], [21532, 0.025517, " did", false], [32487, 0.023266, " with", false], [31059, 0.02076, " have", false], [59868, 0.020541, " initially", false], [32227, 0.015692, " that", false], [52112, 0.014657, " learned", false]]], "qwen": [6, 12, 0.012339101172983646, [[879, 0.154815, " who", false], [1033, 0.119077, " were", false], [1030, 0.043249, " had", false], [614, 0.031094, " have", false], [9498, 0.030262, " learned", false], [304, 0.020639, " in", false], [15102, 0.018902, " initially", false], [525, 0.017185, " are", false], [1521, 0.016844, " did", false], [9583, 0.01548, " eventually", false]]]}, "raw_delta": -1.1293573379516602, "tuned_delta": -1.1220201994379575}, {"byte_start": 2979, "byte_end": 2987, "display": {"text": " initial", "kind": "normal"}, "is_word": true, "word_id": 506, "word_key": " initial", "bytes_hex": "20 69 6e 69 74 69 61 6c", "compression": {"rwkv": "5.35% 5.35% 5.35% 5.35% 5.35% 5.35% 5.35% 5.35%", "qwen": "4.61% 4.61% 4.61% 4.61% 4.61% 4.61% 4.61% 4.61%"}, "model_tokens": {"rwkv": [[52013, " initial", "normal", 0.09282573312520981]], "qwen": [[2856, " initial", "normal", 0.12912534177303314]]}, "loss": {"rwkv": 5.353751128298887, "qwen": 4.614306346456402}, "topk": {"rwkv": [52013, 1, 0.09282573312520981, [[52013, 0.092826, " initial", false], [38720, 0.081883, " human", false], [62157, 0.076332, " investment", false], [51566, 0.049973, " efforts", false], [63678, 0.030683, " investments", false], [61701, 0.024596, " commitment", false], [55572, 0.02099, " attempts", false], [64997, 0.019406, " psychological", false], [45294, 0.017786, " belief", false], [65034, 0.017011, " understanding", false]]], "qwen": [2856, 1, 0.12912534177303314, [[2856, 0.129125, " initial", false], [7901, 0.106858, " failure", false], [3738, 0.028307, " human", false], [8660, 0.017108, " understanding", false], [40598, 0.014864, " disappointment", false], [82950, 0.014519, " reluctance", false], [6853, 0.014486, " lack", false], [5244, 0.013037, " focus", false], [8869, 0.011784, " efforts", false], [27850, 0.01027, " failures", false]]]}, "raw_delta": 0.041003525257110596, "tuned_delta": 0.048340663770813336}, {"byte_start": 2987, "byte_end": 2994, "display": {"text": " effort", "kind": "normal"}, "is_word": true, "word_id": 507, "word_key": " effort", "bytes_hex": "20 65 66 66 6f 72 74", "compression": {"rwkv": "14.09% 14.09% 14.09% 14.09% 14.09% 14.09% 14.09%", "qwen": "11.72% 11.72% 11.72% 11.72% 11.72% 11.72% 11.72%"}, "model_tokens": {"rwkv": [[45829, " effort", "normal", 0.004204032011330128]], "qwen": [[5041, " effort", "normal", 0.010584041476249695]]}, "loss": {"rwkv": 14.088818758681281, "qwen": 11.717795912378751}, "topk": {"rwkv": [45829, 37, 0.004204032011330128, [[51566, 0.136961, " efforts", false], [62157, 0.107512, " investment", false], [63678, 0.058537, " investments", false], [38530, 0.047789, " focus", false], [62500, 0.03476, " resistance", false], [61701, 0.031419, " commitment", false], [55572, 0.023247, " attempts", false], [57077, 0.021367, " reliance", false], [62476, 0.019632, " reluctance", false], [61590, 0.017706, " approaches", false]]], "qwen": [5041, 17, 0.010584041476249695, [[8869, 0.090965, " efforts", false], [7901, 0.074317, " failure", false], [5244, 0.066832, " focus", false], [40598, 0.032757, " disappointment", false], [15155, 0.032682, " commitment", false], [9162, 0.03148, " investment", false], [16396, 0.029786, " belief", false], [82950, 0.02839, " reluctance", false], [13553, 0.028032, " attempts", false], [3738, 0.026329, " human", false]]]}, "raw_delta": 0.13147742407662533, "tuned_delta": 0.13881456259032807}, {"byte_start": 2994, "byte_end": 2998, "display": {"text": " was", "kind": "normal"}, "is_word": true, "word_id": 508, "word_key": " was", "bytes_hex": "20 77 61 73", "compression": {"rwkv": "5.32% 5.32% 5.32% 5.32%", "qwen": "4.65% 4.65% 4.65% 4.65%"}, "model_tokens": {"rwkv": [[22748, " was", "normal", 0.30675947666168213]], "qwen": [[572, " was", "normal", 0.3565994203090668]]}, "loss": {"rwkv": 5.3185290814021835, "qwen": 4.648823801930352}, "topk": {"rwkv": [22748, 1, 0.30675947666168213, [[22748, 0.306759, " was", false], [4811, 0.167447, " to", false], [4424, 0.10197, " at", false], [32460, 0.069828, " went", false], [4596, 0.045016, " in", false], [51770, 0.026237, " focused", false], [31162, 0.022044, " into", false], [47518, 0.020572, " tended", false], [4712, 0.019785, " on", false], [21795, 0.014533, " had", false]]], "qwen": [572, 1, 0.3565994203090668, [[572, 0.356599, " was", false], [311, 0.163238, " to", false], [304, 0.111005, " in", false], [3937, 0.058702, " went", false], [10735, 0.040209, " focused", false], [518, 0.027906, " at", false], [1521, 0.01743, " did", false], [1033, 0.015174, " were", false], [1030, 0.009388, " had", false], [11, 0.009278, ",", false]]]}, "raw_delta": 0.037136346101760864, "tuned_delta": 0.044473484615463604}, {"byte_start": 2998, "byte_end": 3007, "display": {"text": " directed", "kind": "normal"}, "is_word": true, "word_id": 509, "word_key": " directed", "bytes_hex": "20 64 69 72 65 63 74 65 64", "compression": {"rwkv": "6.45% 6.45% 6.45% 6.45% 6.45% 6.45% 6.45% 6.45% 6.45%", "qwen": "7.23% 7.23% 7.23% 7.23% 7.23% 7.23% 7.23% 7.23% 7.23%"}, "model_tokens": {"rwkv": [[56002, " directed", "normal", 0.03996158763766289]], "qwen": [[15540, " directed", "normal", 0.02707730233669281]]}, "loss": {"rwkv": 6.449548142862987, "qwen": 7.231627782151552}, "topk": {"rwkv": [56002, 9, 0.03996158763766289, [[4811, 0.186037, " to", false], [39762, 0.072875, " spent", false], [22187, 0.065529, " not", false], [4596, 0.05974, " in", false], [51459, 0.057461, " devoted", false], [51770, 0.052679, " focused", false], [37810, 0.052238, " based", false], [4712, 0.040471, " on", false], [56002, 0.039962, " directed", false], [56495, 0.029426, " invested", false]]], "qwen": [15540, 6, 0.02707730233669281, [[311, 0.359191, " to", false], [3118, 0.063251, " based", false], [304, 0.062321, " in", false], [10735, 0.050541, " focused", false], [537, 0.040582, " not", false], [15540, 0.027077, " directed", false], [13771, 0.021218, " largely", false], [7391, 0.021157, " spent", false], [28229, 0.019022, " devoted", false], [38828, 0.016841, " wasted", false]]]}, "raw_delta": -0.043367703755696596, "tuned_delta": -0.036030565241993856}, {"byte_start": 3007, "byte_end": 3015, "display": {"text": " towards", "kind": "normal"}, "is_word": true, "word_id": 510, "word_key": " towards", "bytes_hex": "20 74 6f 77 61 72 64 73", "compression": {"rwkv": "4.02% 4.02% 4.02% 4.02% 4.02% 4.02% 4.02% 4.02%", "qwen": "5.04% 5.04% 5.04% 5.04% 5.04% 5.04% 5.04% 5.04%"}, "model_tokens": {"rwkv": [[53169, " towards", "normal", 0.16615939140319824]], "qwen": [[6974, " towards", "normal", 0.10707979649305344]]}, "loss": {"rwkv": 4.015313346224166, "qwen": 5.036315225360426}, "topk": {"rwkv": [53169, 3, 0.16615939140319824, [[4424, 0.327573, " at", false], [47585, 0.223058, " toward", false], [53169, 0.166159, " towards", false], [4811, 0.117189, " to", false], [30211, 0.045436, " away", false], [50870, 0.015371, " against", false], [60247, 0.012907, " primarily", false], [4596, 0.01013, " in", false], [45145, 0.009101, " almost", false], [31162, 0.008167, " into", false]]], "qwen": [6974, 3, 0.10707979649305344, [[518, 0.484283, " at", false], [8841, 0.184966, " toward", false], [6974, 0.10708, " towards", false], [311, 0.043649, " to", false], [2348, 0.037031, " against", false], [3123, 0.022275, " away", false], [15503, 0.014535, " primarily", false], [304, 0.010548, " in", false], [537, 0.00793, " not", false], [803, 0.007657, " more", false]]]}, "raw_delta": -0.056616365909576416, "tuned_delta": -0.049279227395873676}, {"byte_start": 3015, "byte_end": 3025, "display": {"text": " utilizing", "kind": "normal"}, "is_word": true, "word_id": 511, "word_key": " utilizing", "bytes_hex": "20 75 74 69 6c 69 7a 69 6e 67", "compression": {"rwkv": "10.99% 10.99% 10.99% 10.99% 10.99% 10.99% 10.99% 10.99% 10.99% 10.99%", "qwen": "10.55% 10.55% 10.55% 10.55% 10.55% 10.55% 10.55% 10.55% 10.55% 10.55%"}, "model_tokens": {"rwkv": [[60720, " utilizing", "normal", 0.0022570525761693716]], "qwen": [[34888, " utilizing", "normal", 0.002871462842449546]]}, "loss": {"rwkv": 10.9892786317714, "qwen": 10.554998360771686}, "topk": {"rwkv": [60720, 38, 0.0022570525761693716, [[52224, 0.191724, " methods", false], [38720, 0.11504, " human", false], [22590, 0.10269, " the", false], [47202, 0.087525, " search", false], [38888, 0.054431, " lever", false], [55586, 0.043016, " avoiding", false], [61590, 0.023611, " approaches", false], [332, 0.023071, " a", false], [40085, 0.015784, " using", false], [61984, 0.014167, " exploiting", false]]], "qwen": [34888, 40, 0.002871462842449546, [[5413, 0.125822, " methods", false], [3738, 0.120421, " human", false], [76482, 0.10533, " leveraging", false], [2711, 0.053487, " search", false], [279, 0.053393, " the", false], [30426, 0.041448, " avoiding", false], [264, 0.034367, " a", false], [70601, 0.029746, " exploiting", false], [1667, 0.025237, " using", false], [6832, 0.024637, " learning", false]]]}, "raw_delta": 0.024081611633300803, "tuned_delta": 0.031418750147003544}, {"byte_start": 3025, "byte_end": 3031, "display": {"text": " human", "kind": "normal"}, "is_word": true, "word_id": 512, "word_key": " human", "bytes_hex": "20 68 75 6d 61 6e", "compression": {"rwkv": "1.09% 1.09% 1.09% 1.09% 1.09% 1.09%", "qwen": "1.52% 1.52% 1.52% 1.52% 1.52% 1.52%"}, "model_tokens": {"rwkv": [[38720, " human", "normal", 0.6973157525062561]], "qwen": [[3738, " human", "normal", 0.6021825075149536]]}, "loss": {"rwkv": 1.0918834537977993, "qwen": 1.5244318236736045}, "topk": {"rwkv": [38720, 1, 0.6973157525062561, [[38720, 0.697316, " human", false], [39931, 0.118973, " their", false], [22590, 0.047768, " the", false], [59943, 0.0293, " knowledge", false], [47202, 0.011139, " search", false], [32464, 0.005022, " what", false], [39936, 0.004971, " these", false], [46227, 0.004954, " humans", false], [332, 0.004112, " a", false], [52964, 0.00403, " special", false]]], "qwen": [3738, 1, 0.6021825075149536, [[3738, 0.602183, " human", false], [279, 0.087118, " the", false], [862, 0.060083, " their", false], [3281, 0.042672, " special", false], [6540, 0.030904, " knowledge", false], [2711, 0.016004, " search", false], [264, 0.011134, " a", false], [34447, 0.00597, " computation", false], [10951, 0.005759, " massive", false], [27076, 0.004542, " specialized", false]]]}, "raw_delta": -0.023985574642817184, "tuned_delta": -0.016648436129114447}, {"byte_start": 3031, "byte_end": 3045, "display": {"text": " understanding", "kind": "normal"}, "is_word": true, "word_id": 513, "word_key": " understanding", "bytes_hex": "20 75 6e 64 65 72 73 74 61 6e 64 69 6e 67", "compression": {"rwkv": "4.45% 4.45% 4.45% 4.45% 4.45% 4.45% 4.45% 4.45% 4.45% 4.45% 4.45% 4.45% 4.45% 4.45%", "qwen": "3.28% 3.28% 3.28% 3.28% 3.28% 3.28% 3.28% 3.28% 3.28% 3.28% 3.28% 3.28% 3.28% 3.28%"}, "model_tokens": {"rwkv": [[65034, " understanding", "normal", 0.03160172328352928]], "qwen": [[8660, " understanding", "normal", 0.07843122631311417]]}, "loss": {"rwkv": 4.44804135095509, "qwen": 3.2789536567374693}, "topk": {"rwkv": [65034, 2, 0.03160172328352928, [[59943, 0.894852, " knowledge", false], [65034, 0.031602, " understanding", false], [59683, 0.016361, " expertise", false], [46, 0.013313, "-", false], [38786, 0.010587, " input", false], [52022, 0.002075, " insight", false], [59917, 0.002073, " intuition", false], [38013, 0.001814, " chess", false], [31702, 0.001447, " play", false], [45775, 0.001412, " domain", false]]], "qwen": [8660, 3, 0.07843122631311417, [[6540, 0.738685, " knowledge", false], [12646, 0.111411, "-k", false], [8660, 0.078431, " understanding", false], [1946, 0.025349, " input", false], [18726, 0.008945, " expertise", false], [323, 0.001976, " and", false], [1995, 0.001632, " information", false], [11229, 0.001501, " intelligence", false], [476, 0.001448, " or", false], [56251, 0.001325, " intuition", false]]]}, "raw_delta": 0.06482798712594172, "tuned_delta": 0.07216512563964446}, {"byte_start": 3045, "byte_end": 3047, "display": {"text": " (", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "20 28", "compression": {"rwkv": "39.73% 39.73%", "qwen": "37.90% 37.90%"}, "model_tokens": {"rwkv": [[275, " (", "normal", 0.012095415964722633]], "qwen": [[320, " (", "normal", 0.01495111733675003]]}, "loss": {"rwkv": 39.73046889948122, "qwen": 37.897516502681846}, "topk": {"rwkv": [275, 8, 0.012095415964722633, [[4706, 0.442564, " of", false], [45, 0.217553, ",", false], [21265, 0.074389, " and", false], [47, 0.074088, ".", false], [4596, 0.045546, " in", false], [47001, 0.034163, " rather", false], [4811, 0.030743, " to", false], [275, 0.012095, " (", false], [4423, 0.009831, " as", false], [52028, 0.00697, " instead", false]]], "qwen": [320, 9, 0.01495111733675003, [[315, 0.460297, " of", false], [11, 0.168162, ",", false], [323, 0.082457, " and", false], [311, 0.07492, " to", false], [13, 0.05549, ".", false], [4751, 0.029435, " rather", false], [476, 0.024722, " or", false], [304, 0.020419, " in", false], [320, 0.014951, " (", false], [4518, 0.007982, " instead", false]]]}, "raw_delta": 0.10164046287536621, "tuned_delta": 0.10897760138906895}, {"byte_start": 3047, "byte_end": 3049, "display": {"text": "so", "kind": "normal"}, "is_word": true, "word_id": 514, "word_key": "so", "bytes_hex": "73 6f", "compression": {"rwkv": "50.16% 50.16%", "qwen": "60.55% 60.55%"}, "model_tokens": {"rwkv": [[2190, "so", "normal", 0.0037951830308884382]], "qwen": [[704, "so", "normal", 0.0012126192450523376]]}, "loss": {"rwkv": 50.156194780905366, "qwen": 60.54785949832613}, "topk": {"rwkv": [2190, 38, 0.0037951830308884382, [[2101, 0.098914, "or", false], [1950, 0.089274, "in", false], [7005, 0.087096, "and", false], [2090, 0.055693, "of", false], [36003, 0.051255, "which", false], [1751, 0.045923, "as", false], [8801, 0.033271, "the", false], [98, 0.022873, "a", false], [102, 0.016843, "e", false], [42135, 0.016155, "rather", false]]], "qwen": [704, 78, 0.0012126192450523376, [[269, 0.204208, "or", false], [437, 0.11614, "and", false], [258, 0.054871, "in", false], [300, 0.039512, "as", false], [8206, 0.037719, "which", false], [1782, 0.025826, "the", false], [1055, 0.025452, "of", false], [36141, 0.020878, "although", false], [64, 0.013947, "a", false], [4197, 0.013222, "with", false]]]}, "raw_delta": -0.5762362480163574, "tuned_delta": -0.5688991095026547}, {"byte_start": 3049, "byte_end": 3054, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 515, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"rwkv": "6.68% 6.68% 6.68% 6.68% 6.68%", "qwen": "7.08% 7.08% 7.08% 7.08% 7.08%"}, "model_tokens": {"rwkv": [[32227, " that", "normal", 0.15592114627361298]], "qwen": [[429, " that", "normal", 0.14031538367271423]]}, "loss": {"rwkv": 6.678100091614928, "qwen": 7.083137292575182}, "topk": {"rwkv": [32227, 2, 0.15592114627361298, [[46, 0.32385, "-", false], [32227, 0.155921, " that", false], [4423, 0.088511, " as", false], [45395, 0.069005, " called", false], [32232, 0.053603, " they", false], [22590, 0.022251, " the", false], [31466, 0.020639, " much", false], [45, 0.019847, ",", false], [4811, 0.019634, " to", false], [21660, 0.017661, " far", false]]], "qwen": [429, 2, 0.14031538367271423, [[18900, 0.328651, "-called", false], [429, 0.140315, " that", false], [2598, 0.064618, " called", false], [311, 0.061745, " to", false], [438, 0.047244, " as", false], [807, 0.039029, " they", false], [279, 0.023667, " the", false], [1753, 0.02324, " much", false], [11, 0.019221, ",", false], [432, 0.01812, " it", false]]]}, "raw_delta": -0.022460031509399403, "tuned_delta": -0.015122892995696666}, {"byte_start": 3054, "byte_end": 3059, "display": {"text": " less", "kind": "normal"}, "is_word": true, "word_id": 516, "word_key": " less", "bytes_hex": "20 6c 65 73 73", "compression": {"rwkv": "26.49% 26.49% 26.49% 26.49% 26.49%", "qwen": "24.53% 24.53% 24.53% 24.53% 24.53%"}, "model_tokens": {"rwkv": [[31277, " less", "normal", 0.0006553056300617754]], "qwen": [[2686, " less", "normal", 0.001113724778406322]]}, "loss": {"rwkv": 26.48697926632081, "qwen": 24.525978046734792}, "topk": {"rwkv": [31277, 93, 0.0006553056300617754, [[22590, 0.21128, " the", false], [32232, 0.111678, " they", false], [47202, 0.103913, " search", false], [4601, 0.062402, " it", false], [56537, 0.039403, " learning", false], [332, 0.037003, " a", false], [38720, 0.026984, " human", false], [39931, 0.024003, " their", false], [45, 0.022713, ",", false], [46227, 0.017999, " humans", false]]], "qwen": [2686, 73, 0.001113724778406322, [[279, 0.20481, " the", false], [807, 0.145276, " they", false], [432, 0.082475, " it", false], [11, 0.045246, ",", false], [3738, 0.043629, " human", false], [264, 0.041135, " a", false], [862, 0.032532, " their", false], [5994, 0.024569, " Go", false], [2711, 0.021499, " search", false], [12677, 0.017729, " humans", false]]]}, "raw_delta": 0.10874099731445308, "tuned_delta": 0.11607813582815582}, {"byte_start": 3059, "byte_end": 3066, "display": {"text": " search", "kind": "normal"}, "is_word": true, "word_id": 517, "word_key": " search", "bytes_hex": "20 73 65 61 72 63 68", "compression": {"rwkv": "6.76% 6.76% 6.76% 6.76% 6.76% 6.76% 6.76%", "qwen": "7.46% 7.46% 7.46% 7.46% 7.46% 7.46% 7.46%"}, "model_tokens": {"rwkv": [[47202, " search", "normal", 0.07276514172554016]], "qwen": [[2711, " search", "normal", 0.05523906648159027]]}, "loss": {"rwkv": 6.762633004167015, "qwen": 7.461012782105671}, "topk": {"rwkv": [47202, 3, 0.07276514172554016, [[63370, 0.297344, " computation", false], [52195, 0.088123, " massive", false], [47202, 0.072765, " search", false], [45829, 0.071532, " effort", false], [56537, 0.046744, " learning", false], [32251, 0.046004, " time", false], [4706, 0.036649, " of", false], [59346, 0.028044, " computing", false], [22748, 0.025192, " was", false], [38720, 0.020752, " human", false]]], "qwen": [2711, 3, 0.05523906648159027, [[34447, 0.337095, " computation", false], [882, 0.062932, " time", false], [2711, 0.055239, " search", false], [3738, 0.054309, " human", false], [5041, 0.049145, " effort", false], [315, 0.041335, " of", false], [54480, 0.029346, " computational", false], [24231, 0.026667, " computing", false], [6366, 0.022173, " computer", false], [572, 0.017356, " was", false]]]}, "raw_delta": -0.03872639792306082, "tuned_delta": -0.03138925940935808}, {"byte_start": 3066, "byte_end": 3070, "display": {"text": " was", "kind": "normal"}, "is_word": true, "word_id": 518, "word_key": " was", "bytes_hex": "20 77 61 73", "compression": {"rwkv": "3.68% 3.68% 3.68% 3.68%", "qwen": "3.46% 3.46% 3.46% 3.46%"}, "model_tokens": {"rwkv": [[22748, " was", "normal", 0.4389701783657074]], "qwen": [[572, " was", "normal", 0.46383416652679443]]}, "loss": {"rwkv": 3.6807039007054847, "qwen": 3.463496799460949}, "topk": {"rwkv": [22748, 1, 0.4389701783657074, [[22748, 0.43897, " was", false], [40219, 0.269956, " would", false], [38128, 0.056983, " could", false], [21265, 0.05322, " and", false], [4715, 0.035353, " or", false], [21795, 0.031574, " had", false], [4600, 0.017243, " is", false], [32251, 0.013911, " time", false], [31506, 0.013826, " need", false], [45829, 0.013074, " effort", false]]], "qwen": [572, 1, 0.46383416652679443, [[572, 0.463834, " was", false], [1035, 0.302694, " would", false], [1410, 0.052677, " could", false], [374, 0.044084, " is", false], [2578, 0.036068, " might", false], [5041, 0.022308, " effort", false], [323, 0.013622, " and", false], [11, 0.0084, ",", false], [5980, 0.006814, "-based", false], [1231, 0.005859, " may", false]]]}, "raw_delta": 0.012044519186019897, "tuned_delta": 0.019381657699722634}, {"byte_start": 3070, "byte_end": 3077, "display": {"text": " needed", "kind": "normal"}, "is_word": true, "word_id": 519, "word_key": " needed", "bytes_hex": "20 6e 65 65 64 65 64", "compression": {"rwkv": "1.88% 1.88% 1.88% 1.88% 1.88% 1.88% 1.88%", "qwen": "1.83% 1.83% 1.83% 1.83% 1.83% 1.83% 1.83%"}, "model_tokens": {"rwkv": [[46650, " needed", "normal", 0.4814949631690979]], "qwen": [[4362, " needed", "normal", 0.4906936287879944]]}, "loss": {"rwkv": 1.881863648481, "qwen": 1.834116965035213}, "topk": {"rwkv": [46650, 1, 0.4814949631690979, [[46650, 0.481495, " needed", false], [57101, 0.351842, " required", false], [60050, 0.122763, " necessary", false], [30666, 0.007482, " done", false], [56500, 0.005819, " involved", false], [55448, 0.004922, " actually", false], [60152, 0.003836, " performed", false], [32354, 0.002661, " used", false], [56895, 0.001517, " possible", false], [37832, 0.001117, " being", false]]], "qwen": [4362, 1, 0.4906936287879944, [[4362, 0.490694, " needed", false], [2567, 0.33809, " required", false], [5871, 0.128202, " necessary", false], [2814, 0.008532, " done", false], [1483, 0.004738, " used", false], [6398, 0.002998, " involved", false], [10660, 0.002806, " performed", false], [3204, 0.00258, " possible", false], [3520, 0.002044, " actually", false], [9251, 0.001293, " applied", false]]]}, "raw_delta": 0.0026476383209228516, "tuned_delta": 0.009984776834625588}, {"byte_start": 3077, "byte_end": 3078, "display": {"text": ")", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "29", "compression": {"rwkv": "19.44%", "qwen": "23.27%"}, "model_tokens": {"rwkv": [[42, ")", "normal", 0.3401392102241516]], "qwen": [[8, ")", "normal", 0.27510666847229004]]}, "loss": {"rwkv": 19.44256988698017, "qwen": 23.27421221143226}, "topk": {"rwkv": [42, 2, 0.3401392102241516, [[497, 0.364409, "),", false], [42, 0.340139, ")", false], [499, 0.119132, ").", false], [45, 0.052473, ",", false], [4811, 0.043008, " to", false], [21265, 0.017023, " and", false], [502, 0.009541, ");", false], [4596, 0.009236, " in", false], [4715, 0.008596, " or", false], [21700, 0.008153, " for", false]]], "qwen": [8, 2, 0.27510666847229004, [[701, 0.362747, "),", false], [8, 0.275107, ")", false], [568, 0.237883, ").", false], [11, 0.02339, ",", false], [1215, 0.020628, ");", false], [311, 0.02036, " to", false], [3593, 0.014575, ").\n\n", false], [323, 0.012792, " and", false], [304, 0.004909, " in", false], [369, 0.00392, " for", false]]]}, "raw_delta": -0.2124713659286499, "tuned_delta": -0.20513422741494716}, {"byte_start": 3078, "byte_end": 3082, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 520, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"rwkv": "5.00% 5.00% 5.00% 5.00%", "qwen": "6.03% 6.03% 6.03% 6.03%"}, "model_tokens": {"rwkv": [[21265, " and", "normal", 0.3284440338611603]], "qwen": [[323, " and", "normal", 0.2626458406448364]]}, "loss": {"rwkv": 5.001530659331855, "qwen": 6.02752863447568}, "topk": {"rwkv": [21265, 1, 0.3284440338611603, [[21265, 0.328444, " and", false], [47001, 0.248453, " rather", false], [21400, 0.195238, " but", false], [4715, 0.081953, " or", false], [40187, 0.020975, " while", false], [4596, 0.01556, " in", false], [52028, 0.014116, " instead", false], [4423, 0.01289, " as", false], [45285, 0.010617, " before", false], [4811, 0.006185, " to", false]]], "qwen": [323, 2, 0.2626458406448364, [[714, 0.439768, " but", false], [323, 0.262646, " and", false], [4751, 0.118464, " rather", false], [476, 0.043201, " or", false], [4518, 0.016896, " instead", false], [311, 0.012526, " to", false], [304, 0.011211, " in", false], [1177, 0.010443, " --", false], [438, 0.006834, " as", false], [1393, 0.006713, " while", false]]]}, "raw_delta": -0.05689340829849243, "tuned_delta": -0.04955626978478969}, {"byte_start": 3082, "byte_end": 3087, "display": {"text": " only", "kind": "normal"}, "is_word": true, "word_id": 521, "word_key": " only", "bytes_hex": "20 6f 6e 6c 79", "compression": {"rwkv": "10.88% 10.88% 10.88% 10.88% 10.88%", "qwen": "14.81% 14.81% 14.81% 14.81% 14.81%"}, "model_tokens": {"rwkv": [[31581, " only", "normal", 0.04921281337738037]], "qwen": [[1172, " only", "normal", 0.01648406870663166]]}, "loss": {"rwkv": 10.87656808170195, "qwen": 14.806959834583077}, "topk": {"rwkv": [31581, 6, 0.04921281337738037, [[32230, 0.10532, " then", false], [32234, 0.069656, " this", false], [22590, 0.065466, " the", false], [56537, 0.064435, " learning", false], [45, 0.053056, ",", false], [31581, 0.049213, " only", false], [32232, 0.042007, " they", false], [4601, 0.030335, " it", false], [32227, 0.029828, " that", false], [22187, 0.023035, " not", false]]], "qwen": [1172, 13, 0.01648406870663166, [[419, 0.085718, " this", false], [11, 0.082977, ",", false], [1221, 0.072507, " then", false], [279, 0.062896, " the", false], [862, 0.042075, " their", false], [6974, 0.042065, " towards", false], [807, 0.04025, " they", false], [429, 0.037697, " that", false], [537, 0.030036, " not", false], [432, 0.027768, " it", false]]]}, "raw_delta": -0.21794719696044917, "tuned_delta": -0.21061005844674643}, {"byte_start": 3087, "byte_end": 3092, "display": {"text": " much", "kind": "normal"}, "is_word": true, "word_id": 522, "word_key": " much", "bytes_hex": "20 6d 75 63 68", "compression": {"rwkv": "11.55% 11.55% 11.55% 11.55% 11.55%", "qwen": "15.20% 15.20% 15.20% 15.20% 15.20%"}, "model_tokens": {"rwkv": [[31466, " much", "normal", 0.04058396443724632]], "qwen": [[1753, " much", "normal", 0.0147688128054142]]}, "loss": {"rwkv": 11.55283138211865, "qwen": 15.20325601731323}, "topk": {"rwkv": [31466, 3, 0.04058396443724632, [[38869, 0.5323, " later", false], [37634, 0.080866, " after", false], [31466, 0.040584, " much", false], [32465, 0.036145, " when", false], [32230, 0.034983, " then", false], [47205, 0.033126, " second", false], [61552, 0.025154, " afterwards", false], [4596, 0.019905, " in", false], [4424, 0.014152, " at", false], [59771, 0.011203, " gradually", false]]], "qwen": [1753, 8, 0.0147688128054142, [[2937, 0.466931, " later", false], [1283, 0.152772, " after", false], [979, 0.060403, " when", false], [304, 0.04391, " in", false], [1221, 0.033484, " then", false], [264, 0.021305, " a", false], [26024, 0.015625, " gradually", false], [1753, 0.014769, " much", false], [518, 0.01123, " at", false], [3055, 0.008694, " once", false]]]}, "raw_delta": -0.20242252349853515, "tuned_delta": -0.1950853849848324}, {"byte_start": 3092, "byte_end": 3098, "display": {"text": " later", "kind": "normal"}, "is_word": true, "word_id": 523, "word_key": " later", "bytes_hex": "20 6c 61 74 65 72", "compression": {"rwkv": "0.06% 0.06% 0.06% 0.06% 0.06% 0.06%", "qwen": "0.05% 0.05% 0.05% 0.05% 0.05% 0.05%"}, "model_tokens": {"rwkv": [[38869, " later", "normal", 0.9786133170127869]], "qwen": [[2937, " later", "normal", 0.9822579026222229]]}, "loss": {"rwkv": 0.06494064896579653, "qwen": 0.053804716338493846}, "topk": {"rwkv": [38869, 1, 0.9786133170127869, [[38869, 0.978613, " later", false], [31458, 0.010601, " more", false], [45, 0.002514, ",", false], [46405, 0.001275, " latter", false], [31466, 0.001033, " much", false], [31277, 0.000933, " less", false], [51816, 0.000661, " further", false], [61552, 0.000637, " afterwards", false], [31255, 0.000468, " late", false], [64580, 0.000449, " subsequently", false]]], "qwen": [2937, 1, 0.9822579026222229, [[2937, 0.982258, " later", false], [803, 0.005995, " more", false], [11, 0.003197, ",", false], [5021, 0.002368, " longer", false], [4623, 0.002054, " further", false], [1283, 0.000772, " after", false], [15271, 0.00027, " latter", false], [28393, 0.000231, " slower", false], [2686, 0.000211, " less", false], [8131, 0.000192, " larger", false]]]}, "raw_delta": 0.0006175072242816291, "tuned_delta": 0.007954645737984366}, {"byte_start": 3098, "byte_end": 3102, "display": {"text": " was", "kind": "normal"}, "is_word": true, "word_id": 524, "word_key": " was", "bytes_hex": "20 77 61 73", "compression": {"rwkv": "10.21% 10.21% 10.21% 10.21%", "qwen": "11.38% 11.38% 11.38% 11.38%"}, "model_tokens": {"rwkv": [[22748, " was", "normal", 0.10333471745252609]], "qwen": [[572, " was", "normal", 0.08012823015451431]]}, "loss": {"rwkv": 10.214393600043929, "qwen": 11.37982973404948}, "topk": {"rwkv": [22748, 2, 0.10333471745252609, [[21532, 0.522922, " did", false], [22748, 0.103335, " was", false], [32462, 0.102123, " were", false], [45, 0.076492, ",", false], [53169, 0.028261, " towards", false], [47585, 0.014457, " toward", false], [275, 0.011006, " (", false], [30383, 0.010852, " came", false], [47638, 0.007237, " turned", false], [52112, 0.007163, " learned", false]]], "qwen": [572, 3, 0.08012823015451431, [[1521, 0.530067, " did", false], [11, 0.086312, ",", false], [572, 0.080128, " was", false], [1033, 0.063535, " were", false], [6974, 0.045399, " towards", false], [807, 0.045398, " they", false], [320, 0.023243, " (", false], [311, 0.015634, " to", false], [304, 0.007121, " in", false], [6519, 0.006442, " turned", false]]]}, "raw_delta": -0.06462550163269043, "tuned_delta": -0.05728836311898769}, {"byte_start": 3102, "byte_end": 3107, "display": {"text": " much", "kind": "normal"}, "is_word": true, "word_id": 525, "word_key": " much", "bytes_hex": "20 6d 75 63 68", "compression": {"rwkv": "20.63% 20.63% 20.63% 20.63% 20.63%", "qwen": "22.89% 22.89% 22.89% 22.89% 22.89%"}, "model_tokens": {"rwkv": [[31466, " much", "normal", 0.0032405531965196133]], "qwen": [[1753, " much", "normal", 0.0017537848325446248]]}, "loss": {"rwkv": 20.626030662709397, "qwen": 22.88828185302624}, "topk": {"rwkv": [31466, 21, 0.0032405531965196133, [[22590, 0.224024, " the", false], [56537, 0.170707, " learning", false], [4601, 0.158828, " it", false], [47202, 0.075603, " search", false], [32234, 0.037187, " this", false], [39934, 0.036405, " there", false], [39931, 0.032338, " their", false], [32227, 0.028434, " that", false], [51832, 0.019009, " general", false], [332, 0.016534, " a", false]]], "qwen": [1753, 29, 0.0017537848325446248, [[279, 0.308798, " the", false], [432, 0.210639, " it", false], [2711, 0.118688, " search", false], [1052, 0.045521, " there", false], [419, 0.039567, " this", false], [264, 0.033565, " a", false], [429, 0.027979, " that", false], [862, 0.023797, " their", false], [807, 0.012551, " they", false], [458, 0.012507, " an", false]]]}, "raw_delta": -0.12544584274291992, "tuned_delta": -0.11810870422921718}, {"byte_start": 3107, "byte_end": 3115, "display": {"text": " greater", "kind": "normal"}, "is_word": true, "word_id": 526, "word_key": " greater", "bytes_hex": "20 67 72 65 61 74 65 72", "compression": {"rwkv": "7.89% 7.89% 7.89% 7.89% 7.89% 7.89% 7.89% 7.89%", "qwen": "5.54% 5.54% 5.54% 5.54% 5.54% 5.54% 5.54% 5.54%"}, "model_tokens": {"rwkv": [[51867, " greater", "normal", 0.030625106766819954]], "qwen": [[7046, " greater", "normal", 0.08576159179210663]]}, "loss": {"rwkv": 7.889738504861517, "qwen": 5.536756792190434}, "topk": {"rwkv": [51867, 5, 0.030625106766819954, [[31458, 0.306286, " more", false], [4706, 0.215451, " of", false], [45829, 0.107686, " effort", false], [47202, 0.051433, " search", false], [51867, 0.030625, " greater", false], [31277, 0.028215, " less", false], [56537, 0.026787, " learning", false], [59193, 0.02469, " attention", false], [45683, 0.014824, " deeper", false], [45301, 0.013976, " better", false]]], "qwen": [7046, 3, 0.08576159179210663, [[803, 0.497301, " more", false], [315, 0.092637, " of", false], [7046, 0.085762, " greater", false], [2664, 0.043084, " better", false], [8131, 0.034521, " larger", false], [2686, 0.027994, " less", false], [5041, 0.015091, " effort", false], [11243, 0.013299, " bigger", false], [2711, 0.013052, " search", false], [6529, 0.012105, " attention", false]]]}, "raw_delta": 0.13047701120376587, "tuned_delta": 0.1378141497174686}, {"byte_start": 3115, "byte_end": 3123, "display": {"text": " success", "kind": "normal"}, "is_word": true, "word_id": 527, "word_key": " success", "bytes_hex": "20 73 75 63 63 65 73 73", "compression": {"rwkv": "4.86% 4.86% 4.86% 4.86% 4.86% 4.86% 4.86% 4.86%", "qwen": "12.94% 12.94% 12.94% 12.94% 12.94% 12.94% 12.94% 12.94%"}, "model_tokens": {"rwkv": [[53052, " success", "normal", 0.1148604080080986]], "qwen": [[2393, " success", "normal", 0.003210589289665222]]}, "loss": {"rwkv": 4.8606424717450425, "qwen": 12.942102936222147}, "topk": {"rwkv": [53052, 3, 0.1148604080080986, [[45829, 0.180634, " effort", false], [56950, 0.122517, " progress", false], [53052, 0.11486, " success", false], [64902, 0.051505, " effectiveness", false], [47202, 0.048972, " search", false], [63370, 0.045676, " computation", false], [64862, 0.032152, " computational", false], [51030, 0.02386, " benefit", false], [59346, 0.019677, " computing", false], [22681, 0.018528, " use", false]]], "qwen": [2393, 21, 0.003210589289665222, [[5041, 0.395522, " effort", false], [24654, 0.16705, " emphasis", false], [2711, 0.120219, " search", false], [6529, 0.045958, " attention", false], [54480, 0.03399, " computational", false], [5244, 0.025252, " focus", false], [990, 0.023858, " use", false], [32064, 0.016879, " leverage", false], [34447, 0.012279, " computation", false], [2355, 0.008149, " power", false]]]}, "raw_delta": -0.4481313228607178, "tuned_delta": -0.44079418434701506}, {"byte_start": 3123, "byte_end": 3127, "display": {"text": " had", "kind": "normal"}, "is_word": true, "word_id": 528, "word_key": " had", "bytes_hex": "20 68 61 64", "compression": {"rwkv": "15.57% 15.57% 15.57% 15.57%", "qwen": "15.10% 15.10% 15.10% 15.10%"}, "model_tokens": {"rwkv": [[21795, " had", "normal", 0.031969696283340454]], "qwen": [[1030, " had", "normal", 0.03509770333766937]]}, "loss": {"rwkv": 15.568144728342816, "qwen": 15.101498827298919}, "topk": {"rwkv": [21795, 6, 0.031969696283340454, [[55437, 0.462154, " achieved", false], [38547, 0.090741, " found", false], [56741, 0.071586, " obtained", false], [57027, 0.062898, " realized", false], [31968, 0.051986, " seen", false], [21795, 0.03197, " had", false], [55571, 0.027564, " attained", false], [4596, 0.018296, " in", false], [56895, 0.015362, " possible", false], [51097, 0.014334, " brought", false]]], "qwen": [1030, 6, 0.03509770333766937, [[16994, 0.519765, " achieved", false], [12180, 0.081078, " obtained", false], [15043, 0.071143, " realized", false], [1730, 0.054407, " found", false], [62160, 0.038328, " attained", false], [1030, 0.035098, " had", false], [18163, 0.021739, " gained", false], [3204, 0.017975, " possible", false], [3884, 0.014565, " seen", false], [1865, 0.014538, " made", false]]]}, "raw_delta": 0.025876343250274658, "tuned_delta": 0.0332134817639774}, {"byte_start": 3127, "byte_end": 3130, "display": {"text": " by", "kind": "normal"}, "is_word": true, "word_id": 529, "word_key": " by", "bytes_hex": "20 62 79", "compression": {"rwkv": "7.47% 7.47% 7.47%", "qwen": "16.99% 16.99% 16.99%"}, "model_tokens": {"rwkv": [[4450, " by", "normal", 0.28907766938209534]], "qwen": [[553, " by", "normal", 0.05922115221619606]]}, "loss": {"rwkv": 7.467073942101079, "qwen": 16.990598901741535}, "topk": {"rwkv": [4450, 2, 0.28907766938209534, [[32487, 0.32666, " with", false], [4450, 0.289078, " by", false], [4596, 0.110763, " in", false], [30917, 0.035458, " from", false], [32465, 0.030839, " when", false], [30259, 0.027934, " been", false], [40085, 0.022588, " using", false], [4712, 0.014818, " on", false], [4811, 0.01341, " to", false], [53140, 0.010716, " through", false]]], "qwen": [553, 4, 0.05922115221619606, [[16994, 0.270542, " achieved", false], [304, 0.08869, " in", false], [311, 0.084446, " to", false], [553, 0.059221, " by", false], [15043, 0.053533, " realized", false], [279, 0.039495, " the", false], [1730, 0.03894, " found", false], [448, 0.024488, " with", false], [13, 0.020905, ".", false], [62160, 0.017123, " attained", false]]]}, "raw_delta": -0.5280963579813639, "tuned_delta": -0.5207592194676611}, {"byte_start": 3130, "byte_end": 3140, "display": {"text": " embracing", "kind": "normal"}, "is_word": true, "word_id": 530, "word_key": " embracing", "bytes_hex": "20 65 6d 62 72 61 63 69 6e 67", "compression": {"rwkv": "8.40% 8.40% 8.40% 8.40% 8.40% 8.40% 8.40% 8.40% 8.40% 8.40%", "qwen": "10.73% 10.73% 10.73% 10.73% 10.73% 10.73% 10.73% 10.73% 10.73% 10.73%"}, "model_tokens": {"rwkv": [[59611, " embracing", "normal", 0.009467663243412971]], "qwen": [[55401, " embracing", "normal", 0.002601034939289093]]}, "loss": {"rwkv": 8.396935980174046, "qwen": 10.733373606767065}, "topk": {"rwkv": [59611, 23, 0.009467663243412971, [[40085, 0.100543, " using", false], [38888, 0.087163, " lever", false], [56537, 0.071316, " learning", false], [60720, 0.059614, " utilizing", false], [22590, 0.049918, " the", false], [47497, 0.042605, " taking", false], [55531, 0.033217, " applying", false], [47285, 0.024513, " simply", false], [332, 0.022889, " a", false], [39944, 0.019717, " those", false]]], "qwen": [55401, 51, 0.002601034939289093, [[76482, 0.100302, " leveraging", false], [1667, 0.070835, " using", false], [18950, 0.06986, " applying", false], [279, 0.038026, " the", false], [2711, 0.034177, " search", false], [34888, 0.033063, " utilizing", false], [5413, 0.032772, " methods", false], [11811, 0.031422, " researchers", false], [15039, 0.030786, " searching", false], [4633, 0.028974, " taking", false]]]}, "raw_delta": -0.12955961227416998, "tuned_delta": -0.12222247376046724}, {"byte_start": 3140, "byte_end": 3147, "display": {"text": " search", "kind": "normal"}, "is_word": true, "word_id": 531, "word_key": " search", "bytes_hex": "20 73 65 61 72 63 68", "compression": {"rwkv": "1.88% 1.88% 1.88% 1.88% 1.88% 1.88% 1.88%", "qwen": "3.91% 3.91% 3.91% 3.91% 3.91% 3.91% 3.91%"}, "model_tokens": {"rwkv": [[47202, " search", "normal", 0.4831279218196869]], "qwen": [[2711, " search", "normal", 0.21910656988620758]]}, "loss": {"rwkv": 1.881863648481, "qwen": 3.9112417303970552}, "topk": {"rwkv": [47202, 1, 0.4831279218196869, [[47202, 0.483128, " search", false], [22590, 0.181751, " the", false], [52195, 0.070888, " massive", false], [56537, 0.045163, " learning", false], [21265, 0.040137, " and", false], [51832, 0.025596, " general", false], [332, 0.021506, " a", false], [63370, 0.015284, " computation", false], [31458, 0.005894, " more", false], [37920, 0.005595, " brute", false]]], "qwen": [2711, 2, 0.21910656988620758, [[279, 0.224037, " the", false], [2711, 0.219107, " search", false], [34447, 0.139735, " computation", false], [10951, 0.126667, " massive", false], [4586, 0.039499, " general", false], [64098, 0.023071, " brute", false], [54480, 0.015243, " computational", false], [264, 0.015111, " a", false], [6832, 0.013645, " learning", false], [3460, 0.010581, " large", false]]]}, "raw_delta": -0.1125326156616211, "tuned_delta": -0.10519547714791835}, {"byte_start": 3147, "byte_end": 3151, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 532, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"rwkv": "7.33% 7.33% 7.33% 7.33%", "qwen": "7.99% 7.99% 7.99% 7.99%"}, "model_tokens": {"rwkv": [[21265, " and", "normal", 0.1965981274843216]], "qwen": [[323, " and", "normal", 0.17001445591449738]]}, "loss": {"rwkv": 7.326185754514267, "qwen": 7.988345832625277}, "topk": {"rwkv": [21265, 2, 0.1965981274843216, [[47, 0.420886, ".", false], [21265, 0.196598, " and", false], [4423, 0.091405, " as", false], [45, 0.049085, ",", false], [275, 0.046199, " (", false], [4596, 0.016105, " in", false], [46, 0.015989, "-", false], [32487, 0.013734, " with", false], [31458, 0.010294, " more", false], [4811, 0.010245, " to", false]]], "qwen": [323, 3, 0.17001445591449738, [[13, 0.275088, ".", false], [382, 0.179275, ".\n\n", false], [323, 0.170014, " and", false], [11, 0.060514, ",", false], [320, 0.046399, " (", false], [438, 0.042173, " as", false], [518, 0.029792, " at", false], [304, 0.025262, " in", false], [5980, 0.019391, "-based", false], [311, 0.009923, " to", false]]]}, "raw_delta": -0.03671795129776001, "tuned_delta": -0.029380812784057273}, {"byte_start": 3151, "byte_end": 3160, "display": {"text": " learning", "kind": "normal"}, "is_word": true, "word_id": 533, "word_key": " learning", "bytes_hex": "20 6c 65 61 72 6e 69 6e 67", "compression": {"rwkv": "0.73% 0.73% 0.73% 0.73% 0.73% 0.73% 0.73% 0.73% 0.73%", "qwen": "0.85% 0.85% 0.85% 0.85% 0.85% 0.85% 0.85% 0.85% 0.85%"}, "model_tokens": {"rwkv": [[56537, " learning", "normal", 0.6964988708496094]], "qwen": [[6832, " learning", "normal", 0.6542668342590332]]}, "loss": {"rwkv": 0.7279223025318663, "qwen": 0.8500679044303276}, "topk": {"rwkv": [56537, 1, 0.6964988708496094, [[56537, 0.696499, " learning", false], [31978, 0.052996, " self", false], [38888, 0.037265, " lever", false], [22590, 0.024436, " the", false], [21902, 0.01879, " its", false], [45, 0.009798, ",", false], [4450, 0.009575, " by", false], [40085, 0.007089, " using", false], [52195, 0.00683, " massive", false], [51832, 0.005054, " general", false]]], "qwen": [6832, 1, 0.6542668342590332, [[6832, 0.654267, " learning", false], [656, 0.038117, " self", false], [76482, 0.036463, " leveraging", false], [11, 0.035101, ",", false], [553, 0.017691, " by", false], [1181, 0.015146, " its", false], [1221, 0.013366, " then", false], [279, 0.013133, " the", false], [34447, 0.009518, " computation", false], [1008, 0.007302, " other", false]]]}, "raw_delta": -0.006773190365897283, "tuned_delta": 0.0005639481478054535}, {"byte_start": 3160, "byte_end": 3162, "display": {"text": ".\n", "kind": "control"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e 0a", "compression": {"rwkv": "6.73% 4.21%", "qwen": "7.92% 7.92%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.6872859001159668], [261, "\n\n", "control", 0.6307504773139954]], "qwen": [[382, ".\n\n", "control", 0.2678096890449524]]}, "loss": {"rwkv": 5.468222780713172, "qwen": 7.919666352489161}, "topk": {"rwkv": [47, 1, 0.6872859001159668, [[47, 0.687286, ".", false], [4423, 0.058165, " as", false], [45, 0.041269, ",", false], [4450, 0.040108, " by", false], [275, 0.023795, " (", false], [4596, 0.018244, " in", false], [21265, 0.011694, " and", false], [4811, 0.010193, " to", false], [31458, 0.007948, " more", false], [52028, 0.007272, " instead", false]]], "qwen": [382, 2, 0.2678096890449524, [[13, 0.349543, ".", false], [382, 0.26781, ".\n\n", false], [438, 0.062033, " as", false], [11, 0.042986, ",", false], [320, 0.03386, " (", false], [518, 0.031675, " at", false], [304, 0.026401, " in", false], [553, 0.026048, " by", false], [624, 0.014623, ".\n", false], [311, 0.014055, " to", false]]]}, "raw_delta": -0.1359368960062663, "tuned_delta": -0.12859975749256355}, {"byte_start": 3162, "byte_end": 3163, "display": {"text": "\n", "kind": "control"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "0a", "compression": {"rwkv": "4.21%", "qwen": "7.92%"}, "model_tokens": {"rwkv": [[261, "\n\n", "control", 0.6307504773139954]], "qwen": [[382, ".\n\n", "control", 0.2678096890449524]]}, "loss": {"rwkv": 4.209034604156033, "qwen": 7.919666352489161}, "topk": {"rwkv": [261, 1, 0.6307504773139954, [[261, 0.63075, "\n\n", false], [20996, 0.044753, " The", false], [267, 0.039294, "  ", false], [29894, 0.019569, " This", false], [3913, 0.018587, " In", false], [3918, 0.014513, " It", false], [3336, 0.012605, " \n\n", false], [19417, 0.011705, " And", false], [19555, 0.01022, " But", false], [0, 0.009259, "[0]", false]]], "qwen": [382, 2, 0.2678096890449524, [[13, 0.349543, ".", false], [382, 0.26781, ".\n\n", false], [438, 0.062033, " as", false], [11, 0.042986, ",", false], [320, 0.03386, " (", false], [518, 0.031675, " at", false], [304, 0.026401, " in", false], [553, 0.026048, " by", false], [624, 0.014623, ".\n", false], [311, 0.014055, " to", false]]]}, "raw_delta": -0.2057611147562663, "tuned_delta": -0.19842397624256355}, {"byte_start": 3163, "byte_end": 3165, "display": {"text": "In", "kind": "normal"}, "is_word": true, "word_id": 534, "word_key": "in", "bytes_hex": "49 6e", "compression": {"rwkv": "16.41% 16.41%", "qwen": "14.30% 14.30%"}, "model_tokens": {"rwkv": [[1136, "In", "normal", 0.16085301339626312]], "qwen": [[641, "In", "normal", 0.20481045544147491]]}, "loss": {"rwkv": 16.413473853863692, "qwen": 14.297742208057853}, "topk": {"rwkv": [1136, 2, 0.16085301339626312, [[6699, 0.161621, "The", false], [1136, 0.160853, "In", false], [66, 0.093996, "A", false], [48358, 0.057582, "Another", false], [33504, 0.042712, "There", false], [1141, 0.024949, "It", false], [24242, 0.016711, "This", false], [33505, 0.015496, "These", false], [6393, 0.014343, "One", false], [849, 0.011995, "An", false]]], "qwen": [641, 1, 0.20481045544147491, [[641, 0.20481, "In", false], [785, 0.130888, "The", false], [32, 0.057549, "A", false], [14037, 0.046997, "Another", false], [3862, 0.033794, "There", false], [37332, 0.019945, "Computer", false], [1986, 0.018975, "This", false], [2132, 0.016819, "It", false], [9485, 0.014706, "These", false], [3966, 0.013877, "One", false]]]}, "raw_delta": 0.11732107400894165, "tuned_delta": 0.12465821252264439}, {"byte_start": 3165, "byte_end": 3172, "display": {"text": " speech", "kind": "normal"}, "is_word": true, "word_id": 535, "word_key": " speech", "bytes_hex": "20 73 70 65 65 63 68", "compression": {"rwkv": "12.64% 12.64% 12.64% 12.64% 12.64% 12.64% 12.64%", "qwen": "13.46% 13.46% 13.46% 13.46% 13.46% 13.46% 13.46%"}, "model_tokens": {"rwkv": [[47350, " speech", "normal", 0.007453210651874542]], "qwen": [[8806, " speech", "normal", 0.0053747124038636684]]}, "loss": {"rwkv": 12.639683114931204, "qwen": 13.46356600388949}, "topk": {"rwkv": [47350, 20, 0.007453210651874542, [[55809, 0.295079, " computer", false], [22590, 0.130867, " the", false], [52299, 0.045557, " natural", false], [52766, 0.045393, " robotic", false], [3492, 0.035421, " 19", false], [52167, 0.026084, " machine", false], [3609, 0.021454, " AI", false], [51832, 0.01953, " general", false], [3493, 0.017224, " 20", false], [332, 0.01613, " a", false]]], "qwen": [8806, 20, 0.0053747124038636684, [[279, 0.194954, " the", false], [6366, 0.167436, " computer", false], [73606, 0.065926, " robotics", false], [71278, 0.027959, " reinforcement", false], [5662, 0.025601, " machine", false], [1657, 0.023437, " many", false], [220, 0.021513, " ", false], [264, 0.018057, " a", false], [678, 0.017338, " all", false], [2176, 0.016811, " both", false]]]}, "raw_delta": -0.045685768127441406, "tuned_delta": -0.038348629613738666}, {"byte_start": 3172, "byte_end": 3184, "display": {"text": " recognition", "kind": "normal"}, "is_word": true, "word_id": 536, "word_key": " recognition", "bytes_hex": "20 72 65 63 6f 67 6e 69 74 69 6f 6e", "compression": {"rwkv": "0.21% 0.21% 0.21% 0.21% 0.21% 0.21% 0.21% 0.21% 0.21% 0.21% 0.21% 0.21%", "qwen": "0.45% 0.45% 0.45% 0.45% 0.45% 0.45% 0.45% 0.45% 0.45% 0.45% 0.45% 0.45%"}, "model_tokens": {"rwkv": [[63821, " recognition", "normal", 0.869993269443512]], "qwen": [[17843, " recognition", "normal", 0.7405100464820862]]}, "loss": {"rwkv": 0.20839711080549397, "qwen": 0.45146749157513333}, "topk": {"rwkv": [63821, 1, 0.869993269443512, [[63821, 0.869993, " recognition", false], [21265, 0.025087, " and", false], [45, 0.023497, ",", false], [62378, 0.020885, " processing", false], [46, 0.017787, "-", false], [60615, 0.012659, " synthesis", false], [65034, 0.010875, " understanding", false], [62035, 0.002806, " generation", false], [63944, 0.00247, " translation", false], [62634, 0.001285, " technology", false]]], "qwen": [17843, 1, 0.7405100464820862, [[17843, 0.74051, " recognition", false], [323, 0.073654, " and", false], [38875, 0.037246, " synthesis", false], [11, 0.032458, ",", false], [8692, 0.024103, " processing", false], [8660, 0.015766, " understanding", false], [5440, 0.013933, " technology", false], [3412, 0.010654, " research", false], [59172, 0.008406, "-rec", false], [4686, 0.002944, "-to", false]]]}, "raw_delta": -0.01347868392864863, "tuned_delta": -0.006141545414945894}, {"byte_start": 3184, "byte_end": 3185, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "2.75%", "qwen": "3.65%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.8576618432998657]], "qwen": [[11, ",", "normal", 0.8166376948356628]]}, "loss": {"rwkv": 2.74731965794285, "qwen": 3.6528986056272403}, "topk": {"rwkv": [45, 1, 0.8576618432998657, [[45, 0.857662, ",", false], [21265, 0.070864, " and", false], [275, 0.010603, " (", false], [22590, 0.008603, " the", false], [57103, 0.007125, " research", false], [39934, 0.006761, " there", false], [4601, 0.003311, " it", false], [4596, 0.00319, " in", false], [53087, 0.003036, " systems", false], [332, 0.002254, " a", false]]], "qwen": [11, 1, 0.8166376948356628, [[11, 0.816638, ",", false], [323, 0.053789, " and", false], [3412, 0.044563, " research", false], [320, 0.024043, " (", false], [304, 0.010581, " in", false], [5942, 0.007971, " systems", false], [1052, 0.004169, " there", false], [279, 0.003158, " the", false], [518, 0.002123, " at", false], [369, 0.002005, " for", false]]]}, "raw_delta": -0.050215959548950195, "tuned_delta": -0.042878821035247455}, {"byte_start": 3185, "byte_end": 3191, "display": {"text": " there", "kind": "normal"}, "is_word": true, "word_id": 537, "word_key": " there", "bytes_hex": "20 74 68 65 72 65", "compression": {"rwkv": "9.02% 9.02% 9.02% 9.02% 9.02% 9.02%", "qwen": "9.39% 9.39% 9.39% 9.39% 9.39% 9.39%"}, "model_tokens": {"rwkv": [[39934, " there", "normal", 0.04968200996518135]], "qwen": [[1052, " there", "normal", 0.0440269410610199]]}, "loss": {"rwkv": 9.01684400555602, "qwen": 9.386394592974995}, "topk": {"rwkv": [39934, 4, 0.04968200996518135, [[22590, 0.361769, " the", false], [63843, 0.064621, " researchers", false], [332, 0.05362, " a", false], [39934, 0.049682, " there", false], [4601, 0.024821, " it", false], [50919, 0.016915, " another", false], [4423, 0.0138, " as", false], [38328, 0.013607, " early", false], [40186, 0.013353, " which", false], [22226, 0.012676, " one", false]]], "qwen": [1052, 5, 0.0440269410610199, [[279, 0.276267, " the", false], [264, 0.065506, " a", false], [4124, 0.049636, " early", false], [11811, 0.047668, " researchers", false], [1052, 0.044027, " there", false], [458, 0.01796, " an", false], [432, 0.01707, " it", false], [304, 0.016023, " in", false], [3412, 0.015395, " research", false], [3738, 0.015389, " human", false]]]}, "raw_delta": -0.02049223581949866, "tuned_delta": -0.013155097305795924}, {"byte_start": 3191, "byte_end": 3195, "display": {"text": " was", "kind": "normal"}, "is_word": true, "word_id": 538, "word_key": " was", "bytes_hex": "20 77 61 73", "compression": {"rwkv": "4.02% 4.02% 4.02% 4.02%", "qwen": "3.51% 3.51% 3.51% 3.51%"}, "model_tokens": {"rwkv": [[22748, " was", "normal", 0.4065247178077698]], "qwen": [[572, " was", "normal", 0.4586254358291626]]}, "loss": {"rwkv": 4.015313346224166, "qwen": 3.5144114570802074}, "topk": {"rwkv": [22748, 1, 0.4065247178077698, [[22748, 0.406525, " was", false], [32462, 0.209496, " were", false], [21800, 0.11806, " has", false], [4600, 0.105197, " is", false], [31059, 0.060903, " have", false], [21286, 0.054464, " are", false], [21795, 0.016866, " had", false], [30135, 0.002793, " also", false], [39620, 0.002221, " seems", false], [22614, 0.002031, " too", false]]], "qwen": [572, 1, 0.4586254358291626, [[572, 0.458625, " was", false], [1033, 0.19218, " were", false], [702, 0.119229, " has", false], [374, 0.079648, " is", false], [614, 0.058493, " have", false], [525, 0.046995, " are", false], [1030, 0.015486, " had", false], [1083, 0.003227, " also", false], [1483, 0.002581, " used", false], [15102, 0.002502, " initially", false]]]}, "raw_delta": 0.027775898575782776, "tuned_delta": 0.035113037089485516}, {"byte_start": 3195, "byte_end": 3198, "display": {"text": " an", "kind": "normal"}, "is_word": true, "word_id": 539, "word_key": " an", "bytes_hex": "20 61 6e", "compression": {"rwkv": "13.71% 13.71% 13.71%", "qwen": "11.65% 11.65% 11.65%"}, "model_tokens": {"rwkv": [[4419, " an", "normal", 0.10250672698020935]], "qwen": [[458, " an", "normal", 0.14387594163417816]]}, "loss": {"rwkv": 13.713116925116447, "qwen": 11.654594949822933}, "topk": {"rwkv": [4419, 2, 0.10250672698020935, [[332, 0.492511, " a", false], [4419, 0.102507, " an", false], [30135, 0.052332, " also", false], [50919, 0.031499, " another", false], [22590, 0.029227, " the", false], [59868, 0.028268, " initially", false], [30788, 0.020943, " even", false], [31466, 0.020601, " much", false], [52906, 0.019971, " similar", false], [4692, 0.015494, " no", false]]], "qwen": [458, 2, 0.14387594163417816, [[264, 0.44822, " a", false], [458, 0.143876, " an", false], [1083, 0.063595, " also", false], [15102, 0.039345, " initially", false], [1753, 0.020871, " much", false], [2441, 0.018998, " another", false], [279, 0.015884, " the", false], [1045, 0.013977, " some", false], [2856, 0.013189, " initial", false], [902, 0.012129, " no", false]]]}, "raw_delta": 0.11414869626363111, "tuned_delta": 0.12148583477733385}, {"byte_start": 3198, "byte_end": 3204, "display": {"text": " early", "kind": "normal"}, "is_word": true, "word_id": 540, "word_key": " early", "bytes_hex": "20 65 61 72 6c 79", "compression": {"rwkv": "4.70% 4.70% 4.70% 4.70% 4.70% 4.70%", "qwen": "5.60% 5.60% 5.60% 5.60% 5.60% 5.60%"}, "model_tokens": {"rwkv": [[38328, " early", "normal", 0.2094777375459671]], "qwen": [[4124, " early", "normal", 0.15495134890079498]]}, "loss": {"rwkv": 4.696272919560427, "qwen": 5.604401510043859}, "topk": {"rwkv": [38328, 2, 0.2094777375459671, [[52013, 0.246023, " initial", false], [38328, 0.209478, " early", false], [30788, 0.114105, " even", false], [51639, 0.03958, " equally", false], [51551, 0.031508, " earlier", false], [59134, 0.029321, " analogous", false], [45829, 0.02225, " effort", false], [59829, 0.018665, " important", false], [56125, 0.015692, " enormous", false], [50976, 0.013045, " attempt", false]]], "qwen": [4124, 2, 0.15495134890079498, [[2856, 0.439237, " initial", false], [4124, 0.154951, " early", false], [6788, 0.037533, " earlier", false], [1496, 0.026808, " even", false], [2989, 0.023843, " important", false], [5041, 0.02224, " effort", false], [7040, 0.019334, " interesting", false], [18308, 0.018332, " equally", false], [4774, 0.01645, " attempt", false], [22399, 0.014664, " enormous", false]]]}, "raw_delta": -0.05035734176635742, "tuned_delta": -0.04302020325265468}, {"byte_start": 3204, "byte_end": 3216, "display": {"text": " competition", "kind": "normal"}, "is_word": true, "word_id": 541, "word_key": " competition", "bytes_hex": "20 63 6f 6d 70 65 74 69 74 69 6f 6e", "compression": {"rwkv": "8.69% 8.69% 8.69% 8.69% 8.69% 8.69% 8.69% 8.69% 8.69% 8.69% 8.69% 8.69%", "qwen": "12.69% 12.69% 12.69% 12.69% 12.69% 12.69% 12.69% 12.69% 12.69% 12.69% 12.69% 12.69%"}, "model_tokens": {"rwkv": [[63361, " competition", "normal", 0.0030500220600515604]], "qwen": [[10707, " competition", "normal", 0.00021447411563713104]]}, "loss": {"rwkv": 8.688104901186788, "qwen": 12.694697293823454}, "topk": {"rwkv": [63361, 46, 0.0030500220600515604, [[45829, 0.133821, " effort", false], [45, 0.055527, ",", false], [21265, 0.046709, " and", false], [50976, 0.045306, " attempt", false], [46790, 0.043001, " period", false], [56103, 0.039262, " emphasis", false], [55532, 0.029303, " approach", false], [31813, 0.024648, " race", false], [38530, 0.021498, " focus", false], [57404, 0.021349, " tendency", false]]], "qwen": [10707, 293, 0.00021447411563713104, [[5041, 0.176581, " effort", false], [4168, 0.084525, " period", false], [4774, 0.084485, " attempt", false], [11, 0.035262, ",", false], [16396, 0.030165, " belief", false], [12060, 0.025291, " wave", false], [323, 0.02347, " and", false], [3738, 0.020796, " human", false], [7901, 0.020668, " failure", false], [30854, 0.020547, " tendency", false]]]}, "raw_delta": -0.22217265764872232, "tuned_delta": -0.21483551913501958}, {"byte_start": 3216, "byte_end": 3217, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "73.26%", "qwen": "64.79%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.01735544018447399]], "qwen": [[11, ",", "normal", 0.027518654242157936]]}, "loss": {"rwkv": 73.26185754514266, "qwen": 64.7930792522237}, "topk": {"rwkv": [45, 6, 0.01735544018447399, [[51035, 0.786486, " between", false], [37694, 0.037059, " among", false], [4811, 0.036301, " to", false], [4596, 0.022975, " in", false], [21700, 0.019223, " for", false], [45, 0.017355, ",", false], [32487, 0.012995, " with", false], [4706, 0.012028, " of", false], [32227, 0.008012, " that", false], [31601, 0.004825, " over", false]]], "qwen": [11, 8, 0.027518654242157936, [[304, 0.250155, " in", false], [1948, 0.178994, " between", false], [429, 0.107616, " that", false], [311, 0.068565, " to", false], [369, 0.033285, " for", false], [448, 0.030391, " with", false], [2598, 0.029603, " called", false], [11, 0.027519, ",", false], [320, 0.026758, " (", false], [518, 0.023081, " at", false]]]}, "raw_delta": 0.46960878372192383, "tuned_delta": 0.47694592223562654}, {"byte_start": 3217, "byte_end": 3227, "display": {"text": " sponsored", "kind": "normal"}, "is_word": true, "word_id": 542, "word_key": " sponsored", "bytes_hex": "20 73 70 6f 6e 73 6f 72 65 64", "compression": {"rwkv": "11.16% 11.16% 11.16% 11.16% 11.16% 11.16% 11.16% 11.16% 11.16% 11.16%", "qwen": "6.79% 6.79% 6.79% 6.79% 6.79% 6.79% 6.79% 6.79% 6.79% 6.79%"}, "model_tokens": {"rwkv": [[60543, " sponsored", "normal", 0.0020650378428399563]], "qwen": [[29538, " sponsored", "normal", 0.02318495884537697]]}, "loss": {"rwkv": 11.158344456875577, "qwen": 6.7883340915119526}, "topk": {"rwkv": [60543, 66, 0.0020650378428399563, [[4596, 0.17074, " in", false], [51035, 0.097569, " between", false], [32487, 0.041486, " with", false], [30917, 0.034307, " from", false], [22590, 0.032027, " the", false], [40186, 0.02955, " which", false], [21265, 0.023895, " and", false], [3492, 0.022808, " 19", false], [57295, 0.018323, " starting", false], [30135, 0.017424, " also", false]]], "qwen": [29538, 7, 0.02318495884537697, [[304, 0.261176, " in", false], [279, 0.133815, " the", false], [2598, 0.048218, " called", false], [323, 0.034305, " and", false], [5644, 0.030072, " held", false], [892, 0.023604, " which", false], [29538, 0.023185, " sponsored", false], [3881, 0.020487, " known", false], [448, 0.019819, " with", false], [96127, 0.017136, " DAR", false]]]}, "raw_delta": 0.2423248291015625, "tuned_delta": 0.24966196761526524}, {"byte_start": 3227, "byte_end": 3230, "display": {"text": " by", "kind": "normal"}, "is_word": true, "word_id": 543, "word_key": " by", "bytes_hex": "20 62 79", "compression": {"rwkv": "0.47% 0.47% 0.47%", "qwen": "0.17% 0.17% 0.17%"}, "model_tokens": {"rwkv": [[4450, " by", "normal", 0.9243119359016418]], "qwen": [[553, " by", "normal", 0.972740650177002]]}, "loss": {"rwkv": 0.472562462530768, "qwen": 0.16613700982584528}, "topk": {"rwkv": [4450, 1, 0.9243119359016418, [[4450, 0.924312, " by", false], [4596, 0.036904, " in", false], [52063, 0.005999, " jointly", false], [21265, 0.004591, " and", false], [21700, 0.003129, " for", false], [4424, 0.00282, " at", false], [59868, 0.002301, " initially", false], [4423, 0.001899, " as", false], [46768, 0.001823, " partly", false], [45, 0.00126, ",", false]]], "qwen": [553, 1, 0.972740650177002, [[553, 0.972741, " by", false], [304, 0.010446, " in", false], [52158, 0.003276, " jointly", false], [323, 0.003095, " and", false], [518, 0.001075, " at", false], [27037, 0.000755, " partly", false], [438, 0.000746, " as", false], [11, 0.00068, ",", false], [15102, 0.000552, " initially", false], [369, 0.00038, " for", false]]]}, "raw_delta": 0.016991835087537766, "tuned_delta": 0.024328973601240502}, {"byte_start": 3230, "byte_end": 3234, "display": {"text": " DAR", "kind": "normal"}, "is_word": true, "word_id": 544, "word_key": " dar", "bytes_hex": "20 44 41 52", "compression": {"rwkv": "5.53% 5.53% 5.53% 5.53%", "qwen": "12.82% 12.82% 12.82% 12.82%"}, "model_tokens": {"rwkv": [[19678, " DAR", "normal", 0.2904881536960602]], "qwen": [[96127, " DAR", "normal", 0.05827023833990097]]}, "loss": {"rwkv": 5.529861362782403, "qwen": 12.815927864416649}, "topk": {"rwkv": [19678, 1, 0.2904881536960602, [[19678, 0.290488, " DAR", false], [22590, 0.19669, " the", false], [28484, 0.173245, " Bell", false], [3620, 0.087891, " AT", false], [20077, 0.087414, " IBM", false], [54894, 0.020458, " Carnegie", false], [323, 0.019903, " X", false], [332, 0.013674, " a", false], [62041, 0.006271, " government", false], [36292, 0.004806, " Apple", false]]], "qwen": [96127, 4, 0.05827023833990097, [[27922, 0.30154, " IBM", false], [17884, 0.282074, " Bell", false], [279, 0.10406, " the", false], [96127, 0.05827, " DAR", false], [7369, 0.046139, " AT", false], [1599, 0.022942, " X", false], [264, 0.017722, " a", false], [5085, 0.01045, " Google", false], [5100, 0.009302, " Microsoft", false], [15611, 0.0087, " Intel", false]]]}, "raw_delta": -0.4040253162384033, "tuned_delta": -0.3966881777247006}, {"byte_start": 3234, "byte_end": 3236, "display": {"text": "PA", "kind": "normal"}, "is_word": true, "word_id": 545, "word_key": "pa", "bytes_hex": "50 41", "compression": {"rwkv": "0.00% 0.00%", "qwen": "0.00% 0.00%"}, "model_tokens": {"rwkv": [[1342, "PA", "normal", 0.9995243549346924]], "qwen": [[8041, "PA", "normal", 0.9999293088912964]]}, "loss": {"rwkv": 0.004265169741397653, "qwen": 0.0006373881968423287}, "topk": {"rwkv": [1342, 1, 0.9995243549346924, [[1342, 0.999524, "PA", false], [6405, 9.1e-05, "PAN", false], [81, 8.3e-05, "P", false], [66, 7.6e-05, "A", false], [85, 3.5e-05, "T", false], [6408, 2.2e-05, "PAT", false], [2111, 2.1e-05, "pa", false], [1470, 1.9e-05, "TA", false], [6407, 9e-06, "PAS", false], [1364, 8e-06, "Pa", false]]], "qwen": [8041, 1, 0.9999293088912964, [[8041, 0.999929, "PA", false], [20291, 2.7e-05, "Pa", false], [6595, 6e-06, "pa", false], [47, 6e-06, "P", false], [12878, 3e-06, " PA", false], [4872, 3e-06, "PC", false], [23304, 3e-06, "WIN", false], [54, 2e-06, "W", false], [4406, 2e-06, "PP", false], [81450, 2e-06, "PCA", false]]]}, "raw_delta": 0.0002011669239436742, "tuned_delta": 0.007538305437646411}, {"byte_start": 3236, "byte_end": 3237, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "3.84%", "qwen": "2.21%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.8095117807388306]], "qwen": [[11, ",", "normal", 0.8846657872200012]]}, "loss": {"rwkv": 3.839203111740649, "qwen": 2.209944548117162}, "topk": {"rwkv": [45, 1, 0.8095117807388306, [[45, 0.809512, ",", false], [4596, 0.079858, " in", false], [21265, 0.056325, " and", false], [275, 0.024089, " (", false], [51035, 0.003069, " between", false], [21700, 0.00292, " for", false], [4811, 0.002409, " to", false], [4423, 0.002059, " as", false], [460, 0.001803, "'s", false], [45805, 0.001527, " during", false]]], "qwen": [11, 1, 0.8846657872200012, [[11, 0.884666, ",", false], [304, 0.040663, " in", false], [323, 0.027295, " and", false], [320, 0.020129, " (", false], [13, 0.005623, ".", false], [429, 0.002827, " that", false], [311, 0.001975, " to", false], [594, 0.001838, "'s", false], [518, 0.001258, " at", false], [369, 0.001099, " for", false]]]}, "raw_delta": 0.09034527838230133, "tuned_delta": 0.09768241689600407}, {"byte_start": 3237, "byte_end": 3240, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 546, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "16.91% 16.91% 16.91%", "qwen": "8.62% 8.62% 8.62%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.06080134958028793]], "qwen": [[304, " in", "normal", 0.23855070769786835]]}, "loss": {"rwkv": 16.90658251041754, "qwen": 8.615134095614458}, "topk": {"rwkv": [4596, 3, 0.06080134958028793, [[51035, 0.659432, " between", false], [4811, 0.116876, " to", false], [4596, 0.060801, " in", false], [32227, 0.043481, " that", false], [21700, 0.027144, " for", false], [32487, 0.012696, " with", false], [37694, 0.011658, " among", false], [40186, 0.011542, " which", false], [40185, 0.004859, " where", false], [4706, 0.004323, " of", false]]], "qwen": [304, 2, 0.23855070769786835, [[311, 0.238995, " to", false], [304, 0.238551, " in", false], [429, 0.175627, " that", false], [369, 0.05571, " for", false], [1948, 0.040542, " between", false], [892, 0.031381, " which", false], [1380, 0.031349, " where", false], [448, 0.028236, " with", false], [2598, 0.025995, " called", false], [323, 0.01324, " and", false]]]}, "raw_delta": 0.45977552731831867, "tuned_delta": 0.4671126658320214}, {"byte_start": 3240, "byte_end": 3244, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 547, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "12.05% 12.05% 12.05% 12.05%", "qwen": "8.54% 8.54% 8.54% 8.54%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.06973370164632797]], "qwen": [[279, " the", "normal", 0.1504439413547516]]}, "loss": {"rwkv": 12.045940038672496, "qwen": 8.539694264110675}, "topk": {"rwkv": [22590, 2, 0.06973370164632797, [[40186, 0.671123, " which", false], [22590, 0.069734, " the", false], [3492, 0.065469, " 19", false], [53342, 0.013871, " whether", false], [52224, 0.008915, " methods", false], [40085, 0.008102, " using", false], [22638, 0.007519, " two", false], [61857, 0.006108, " developing", false], [21835, 0.005579, " how", false], [332, 0.005348, " a", false]]], "qwen": [279, 3, 0.1504439413547516, [[892, 0.647437, " which", false], [220, 0.170432, " ", false], [279, 0.150444, " the", false], [9902, 0.001091, " ``", false], [48083, 0.001075, " recognizing", false], [8806, 0.001071, " speech", false], [1246, 0.001006, " how", false], [264, 0.000975, " a", false], [1667, 0.000938, " using", false], [3309, 0.000766, " late", false]]]}, "raw_delta": 0.19442754983901978, "tuned_delta": 0.20176468835272252}, {"byte_start": 3244, "byte_end": 3247, "display": {"text": " 19", "kind": "normal"}, "is_word": true, "word_id": 548, "word_key": " 19", "bytes_hex": "20 31 39", "compression": {"rwkv": "6.53% 6.53% 6.53%", "qwen": "12.98% 0.19% 0.00%"}, "model_tokens": {"rwkv": [[3492, " 19", "normal", 0.3362497389316559]], "qwen": [[220, " ", "normal", 0.4868954122066498], [16, "1", "normal", 0.9896891117095947], [24, "9", "normal", 0.9997244477272034]]}, "loss": {"rwkv": 6.527819358188994, "qwen": 4.390276775293654}, "topk": {"rwkv": [3492, 1, 0.3362497389316559, [[3492, 0.33625, " 19", false], [31255, 0.136928, " late", false], [38328, 0.090815, " early", false], [22681, 0.04909, " use", false], [22089, 0.046513, " mid", false], [63469, 0.021941, " development", false], [30899, 0.015111, " form", false], [38478, 0.009958, " field", false], [47202, 0.009082, " search", false], [45010, 0.006893, " United", false]]], "qwen": [220, 1, 0.4868954122066498, [[220, 0.486895, " ", false], [3309, 0.207656, " late", false], [4124, 0.125531, " early", false], [5099, 0.097892, " mid", false], [990, 0.004568, " use", false], [3639, 0.004485, " United", false], [9902, 0.003857, " ``", false], [2274, 0.003569, " US", false], [4401, 0.003243, " development", false], [1042, 0.002953, " year", false]]]}, "raw_delta": 0.11853052917285824, "tuned_delta": 0.12586766768656096}, {"byte_start": 3247, "byte_end": 3249, "display": {"text": "70", "kind": "normal"}, "is_word": true, "word_id": 549, "word_key": "70", "bytes_hex": "37 30", "compression": {"rwkv": "7.89% 7.89%", "qwen": "25.38% 0.02%"}, "model_tokens": {"rwkv": [[690, "70", "normal", 0.41649606823921204]], "qwen": [[22, "7", "normal", 0.24479924142360687], [15, "0", "normal", 0.9991158843040466]]}, "loss": {"rwkv": 7.889738504861517, "qwen": 12.697532554416602}, "topk": {"rwkv": [690, 1, 0.41649606823921204, [[690, 0.416496, "70", false], [700, 0.215445, "80", false], [680, 0.183971, "60", false], [710, 0.136324, "90", false], [670, 0.019079, "50", false], [686, 0.002596, "66", false], [689, 0.002368, "69", false], [711, 0.001828, "91", false], [691, 0.001571, "71", false], [706, 0.001231, "86", false]]], "qwen": [22, 3, 0.24479924142360687, [[24, 0.345654, "9", false], [23, 0.263998, "8", false], [22, 0.244799, "7", false], [21, 0.126102, "6", false], [20, 0.016886, "5", false], [19, 0.001879, "4", false], [18, 0.000354, "3", false], [15, 0.000186, "0", false], [17, 6.5e-05, "2", false], [16, 1.6e-05, "1", false]]]}, "raw_delta": -0.26660071121295914, "tuned_delta": -0.25926357269925643}, {"byte_start": 3249, "byte_end": 3250, "display": {"text": "s", "kind": "normal"}, "is_word": true, "word_id": 550, "word_key": "s", "bytes_hex": "73", "compression": {"rwkv": "2.34%", "qwen": "1.25%"}, "model_tokens": {"rwkv": [[116, "s", "normal", 0.8776984214782715]], "qwen": [[82, "s", "normal", 0.9332221746444702]]}, "loss": {"rwkv": 2.342266118630763, "qwen": 1.2463441628509455}, "topk": {"rwkv": [116, 1, 0.8776984214782715, [[116, 0.877698, "s", false], [460, 0.119184, "'s", false], [21265, 0.000561, " and", false], [46, 0.000474, "-", false], [28309, 0.000411, "’s", false], [97, 0.000213, "`", false], [40, 0.000143, "'", false], [350, 0.000129, " s", false], [9835, 0.000117, "′", false], [439, 8.8e-05, "''", false]]], "qwen": [82, 1, 0.9332221746444702, [[82, 0.933222, "s", false], [594, 0.0611, "'s", false], [748, 0.001087, "’s", false], [274, 0.001046, " s", false], [38515, 0.00053, "′", false], [12, 0.000401, "-", false], [550, 0.000263, "ies", false], [11, 0.000204, ",", false], [323, 0.000146, " and", false], [429, 0.000109, " that", false]]]}, "raw_delta": 0.06077081710100174, "tuned_delta": 0.06810795561470448}, {"byte_start": 3250, "byte_end": 3251, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "70.73%", "qwen": "44.10%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.019462158903479576]], "qwen": [[13, ".", "normal", 0.08669820427894592]]}, "loss": {"rwkv": 70.72587016858003, "qwen": 44.09817469732327}, "topk": {"rwkv": [47, 6, 0.019462158903479576, [[51035, 0.423203, " between", false], [45, 0.196741, ",", false], [21265, 0.170018, " and", false], [4811, 0.082737, " to", false], [32227, 0.031006, " that", false], [47, 0.019462, ".", false], [21700, 0.013546, " for", false], [4596, 0.011457, " in", false], [37694, 0.007653, " among", false], [275, 0.00455, " (", false]]], "qwen": [13, 4, 0.08669820427894592, [[11, 0.429518, ",", false], [429, 0.095464, " that", false], [311, 0.095161, " to", false], [13, 0.086698, ".", false], [323, 0.082738, " and", false], [304, 0.04481, " in", false], [1948, 0.027085, " between", false], [2598, 0.020796, " called", false], [369, 0.017049, " for", false], [320, 0.014453, " (", false]]]}, "raw_delta": 1.476552963256836, "tuned_delta": 1.4838901017705386}, {"byte_start": 3251, "byte_end": 3260, "display": {"text": " Entrants", "kind": "normal"}, "is_word": true, "word_id": 551, "word_key": " entrants", "bytes_hex": "20 45 6e 74 72 61 6e 74 73", "compression": {"rwkv": "38.32% 38.32% 38.32% 38.32% 4.02% 4.02% 4.02% 4.02% 0.24%", "qwen": "40.55% 40.55% 40.55% 40.55% 40.55% 0.06% 0.06% 0.06% 0.06%"}, "model_tokens": {"rwkv": [[19830, " Ent", "normal", 0.0002028000890277326], [26809, "rant", "normal", 0.40987658500671387], [116, "s", "normal", 0.9869351387023926]], "qwen": [[47141, " Entr", "normal", 1.311307914875215e-05], [1783, "ants", "normal", 0.9865424633026123]]}, "loss": {"rwkv": 18.84281669954464, "qwen": 22.55302913193068}, "topk": {"rwkv": [19830, 170, 0.0002028000890277326, [[20996, 0.335367, " The", false], [20556, 0.146693, " One", false], [3918, 0.057483, " It", false], [3913, 0.040059, " In", false], [29894, 0.03953, " This", false], [37451, 0.028343, " There", false], [63222, 0.024464, " Researchers", false], [300, 0.023244, " A", false], [19678, 0.021406, " DAR", false], [21042, 0.014849, " Two", false]]], "qwen": [47141, 1259, 1.311307914875215e-05, [[576, 0.293552, " The", false], [1084, 0.109592, " It", false], [1096, 0.083515, " This", false], [758, 0.048719, " In", false], [362, 0.029816, " A", false], [2619, 0.027854, " There", false], [11445, 0.01968, " Its", false], [3776, 0.019046, " One", false], [2411, 0.01553, " At", false], [58150, 0.015228, " Researchers", false]]]}, "raw_delta": -0.20573786294294724, "tuned_delta": -0.1984007244292445}, {"byte_start": 3260, "byte_end": 3269, "display": {"text": " included", "kind": "normal"}, "is_word": true, "word_id": 552, "word_key": " included", "bytes_hex": "20 69 6e 63 6c 75 64 65 64", "compression": {"rwkv": "5.98% 5.98% 5.98% 5.98% 5.98% 5.98% 5.98% 5.98% 5.98%", "qwen": "8.71% 8.71% 8.71% 8.71% 8.71% 8.71% 8.71% 8.71% 8.71%"}, "model_tokens": {"rwkv": [[56427, " included", "normal", 0.05059453845024109]], "qwen": [[5230, " included", "normal", 0.012943398207426071]]}, "loss": {"rwkv": 5.979920850906945, "qwen": 8.710610741970532}, "topk": {"rwkv": [56427, 4, 0.05059453845024109, [[32462, 0.33962, " were", false], [32354, 0.066441, " used", false], [4811, 0.055416, " to", false], [56427, 0.050595, " included", false], [21795, 0.035736, " had", false], [4596, 0.028691, " in", false], [55796, 0.027294, " competed", false], [59506, 0.017861, " developed", false], [22762, 0.017562, " who", false], [40013, 0.013596, " tried", false]]], "qwen": [5230, 13, 0.012943398207426071, [[1033, 0.298909, " were", false], [1483, 0.085028, " used", false], [304, 0.082163, " in", false], [1030, 0.052615, " had", false], [311, 0.051618, " to", false], [14634, 0.024043, " submitted", false], [2765, 0.022824, " won", false], [6, 0.015722, "'", false], [429, 0.014798, " that", false], [6679, 0.01377, " tried", false]]]}, "raw_delta": -0.1514215999179416, "tuned_delta": -0.14408446140423886}, {"byte_start": 3269, "byte_end": 3271, "display": {"text": " a", "kind": "normal"}, "is_word": true, "word_id": 553, "word_key": " a", "bytes_hex": "20 61", "compression": {"rwkv": "22.68% 22.68%", "qwen": "21.65% 21.65%"}, "model_tokens": {"rwkv": [[332, " a", "normal", 0.07994856685400009]], "qwen": [[264, " a", "normal", 0.09066668152809143]]}, "loss": {"rwkv": 22.682998201476863, "qwen": 21.645521459279514}, "topk": {"rwkv": [332, 3, 0.07994856685400009, [[63843, 0.099336, " researchers", false], [22590, 0.098679, " the", false], [332, 0.079949, " a", false], [30322, 0.0466, " both", false], [32074, 0.02686, " some", false], [22638, 0.025302, " two", false], [31370, 0.024941, " many", false], [46787, 0.015896, " people", false], [52869, 0.015874, " several", false], [45929, 0.012826, " expert", false]]], "qwen": [264, 2, 0.09066668152809143, [[27922, 0.149647, " IBM", false], [264, 0.090667, " a", false], [11811, 0.083081, " researchers", false], [279, 0.074898, " the", false], [17884, 0.065079, " Bell", false], [14865, 0.02785, " MIT", false], [1657, 0.025836, " many", false], [1378, 0.018612, " two", false], [1045, 0.017207, " some", false], [3807, 0.016664, " several", false]]]}, "raw_delta": 0.05752992630004883, "tuned_delta": 0.06486706481375157}, {"byte_start": 3271, "byte_end": 3276, "display": {"text": " host", "kind": "normal"}, "is_word": true, "word_id": 554, "word_key": " host", "bytes_hex": "20 68 6f 73 74", "compression": {"rwkv": "25.36% 25.36% 25.36% 25.36% 25.36%", "qwen": "29.84% 29.84% 29.84% 29.84% 29.84%"}, "model_tokens": {"rwkv": [[31112, " host", "normal", 0.0008912928169593215]], "qwen": [[3468, " host", "normal", 0.00025549010024406016]]}, "loss": {"rwkv": 25.359873765626308, "qwen": 29.83611437477487}, "topk": {"rwkv": [31112, 86, 0.0008912928169593215, [[32207, 0.176035, " team", false], [46685, 0.105956, " number", false], [38640, 0.104108, " group", false], [53264, 0.046625, " variety", false], [38864, 0.037277, " large", false], [38720, 0.033431, " human", false], [47350, 0.027334, " speech", false], [21674, 0.023676, " few", false], [57103, 0.020523, " research", false], [47202, 0.018582, " search", false]]], "qwen": [3468, 250, 0.00025549010024406016, [[1372, 0.132876, " number", false], [1874, 0.058637, " group", false], [2421, 0.054193, " few", false], [2083, 0.043321, " team", false], [8806, 0.039168, " speech", false], [1714, 0.039105, " method", false], [2813, 0.03677, " company", false], [3738, 0.035784, " human", false], [8045, 0.028896, " variety", false], [3460, 0.026857, " large", false]]]}, "raw_delta": -0.24821548461914067, "tuned_delta": -0.24087834610543793}, {"byte_start": 3276, "byte_end": 3279, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 555, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "0.04% 0.04% 0.04%", "qwen": "0.01% 0.01% 0.01%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.9939544796943665]], "qwen": [[315, " of", "normal", 0.9980087876319885]]}, "loss": {"rwkv": 0.0365061840231455, "qwen": 0.011981691743041081}, "topk": {"rwkv": [4706, 1, 0.9939544796943665, [[4706, 0.993954, " of", false], [22762, 0.000653, " who", false], [32227, 0.000414, " that", false], [45, 0.000319, ",", false], [46, 0.000254, "-", false], [37747, 0.00021, " array", false], [1851, 0.000179, "el", false], [52580, 0.000177, " program", false], [275, 0.000171, " (", false], [21265, 0.00015, " and", false]]], "qwen": [315, 1, 0.9980087876319885, [[315, 0.998009, " of", false], [433, 0.000175, "ess", false], [11, 0.000174, ",", false], [320, 0.000116, " (", false], [879, 8.6e-05, " who", false], [198, 8.4e-05, "\n", false], [1372, 7.1e-05, " number", false], [476, 6.8e-05, " or", false], [429, 5.9e-05, " that", false], [264, 5.5e-05, " a", false]]]}, "raw_delta": 0.0013599266142894821, "tuned_delta": 0.008697065127992218}, {"byte_start": 3279, "byte_end": 3287, "display": {"text": " special", "kind": "normal"}, "is_word": true, "word_id": 556, "word_key": " special", "bytes_hex": "20 73 70 65 63 69 61 6c", "compression": {"rwkv": "13.17% 13.17% 13.17% 13.17% 13.17% 13.17% 13.17% 13.17%", "qwen": "14.77% 14.77% 14.77% 14.77% 14.77% 14.77% 14.77% 14.77%"}, "model_tokens": {"rwkv": [[52964, " special", "normal", 0.002928188070654869]], "qwen": [[3281, " special", "normal", 0.0014242958277463913]]}, "loss": {"rwkv": 13.173045539367, "qwen": 14.77427388685166}, "topk": {"rwkv": [52964, 54, 0.002928188070654869, [[63843, 0.21061, " researchers", false], [38720, 0.079886, " human", false], [57103, 0.045391, " research", false], [52224, 0.03026, " methods", false], [46787, 0.022223, " people", false], [55809, 0.020022, " computer", false], [3609, 0.019999, " AI", false], [47350, 0.018077, " speech", false], [59513, 0.016659, " different", false], [61590, 0.014807, " approaches", false]]], "qwen": [3281, 82, 0.0014242958277463913, [[11811, 0.180827, " researchers", false], [3738, 0.056594, " human", false], [5413, 0.053861, " methods", false], [5110, 0.031301, " companies", false], [2155, 0.028066, " different", false], [3412, 0.027185, " research", false], [8806, 0.024624, " speech", false], [5942, 0.018314, " systems", false], [19827, 0.01823, " approaches", false], [1602, 0.017551, " very", false]]]}, "raw_delta": -0.08879095315933228, "tuned_delta": -0.08145381464562954}, {"byte_start": 3287, "byte_end": 3295, "display": {"text": " methods", "kind": "normal"}, "is_word": true, "word_id": 557, "word_key": " methods", "bytes_hex": "20 6d 65 74 68 6f 64 73", "compression": {"rwkv": "6.66% 6.66% 6.66% 6.66% 6.66% 6.66% 6.66% 6.66%", "qwen": "8.12% 8.12% 8.12% 8.12% 8.12% 8.12% 8.12% 8.12%"}, "model_tokens": {"rwkv": [[52224, " methods", "normal", 0.052433159202337265]], "qwen": [[5413, " methods", "normal", 0.027293074876070023]]}, "loss": {"rwkv": 6.656966863476906, "qwen": 8.117689684772923}, "topk": {"rwkv": [52224, 3, 0.052433159202337265, [[46, 0.671003, "-", false], [52610, 0.059391, " purpose", false], [52224, 0.052433, " methods", false], [62633, 0.027381, " techniques", false], [61590, 0.025084, " approaches", false], [25971, 0.007201, "ists", false], [38720, 0.007115, " human", false], [27161, 0.006636, "ties", false], [45, 0.006075, ",", false], [53087, 0.004418, " systems", false]]], "qwen": [5413, 3, 0.027293074876070023, [[58238, 0.773182, "-purpose", false], [7428, 0.037158, " purpose", false], [5413, 0.027293, " methods", false], [12538, 0.0171, " techniques", false], [25185, 0.007393, " algorithms", false], [38485, 0.006867, "-case", false], [19827, 0.005876, " approaches", false], [11, 0.005599, ",", false], [12, 0.005488, "-", false], [11647, 0.004813, " experts", false]]]}, "raw_delta": -0.08099967241287231, "tuned_delta": -0.07366253389916957}, {"byte_start": 3295, "byte_end": 3300, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 558, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"rwkv": "7.19% 7.19% 7.19% 7.19% 7.19%", "qwen": "4.54% 4.54% 4.54% 4.54% 4.54%"}, "model_tokens": {"rwkv": [[32227, " that", "normal", 0.1361222118139267]], "qwen": [[429, " that", "normal", 0.28388261795043945]]}, "loss": {"rwkv": 7.185297566927454, "qwen": 4.541584127474004}, "topk": {"rwkv": [32227, 3, 0.1361222118139267, [[45, 0.2063, ",", false], [21700, 0.137234, " for", false], [32227, 0.136122, " that", false], [37810, 0.135346, " based", false], [55966, 0.035103, " designed", false], [21265, 0.031658, " and", false], [38888, 0.020458, " lever", false], [47, 0.016944, ".", false], [4811, 0.016641, " to", false], [32139, 0.016002, " such", false]]], "qwen": [429, 1, 0.28388261795043945, [[429, 0.283883, " that", false], [3118, 0.205155, " based", false], [11, 0.141055, ",", false], [369, 0.076992, " for", false], [6188, 0.028651, " designed", false], [320, 0.023569, " (", false], [70601, 0.020602, " exploiting", false], [323, 0.016581, " and", false], [311, 0.012588, " to", false], [40791, 0.011173, " tailored", false]]]}, "raw_delta": 0.14659860134124758, "tuned_delta": 0.15393573985495032}, {"byte_start": 3300, "byte_end": 3305, "display": {"text": " took", "kind": "normal"}, "is_word": true, "word_id": 559, "word_key": " took", "bytes_hex": "20 74 6f 6f 6b", "compression": {"rwkv": "8.00% 8.00% 8.00% 8.00% 8.00%", "qwen": "6.42% 6.42% 6.42% 6.42% 6.42%"}, "model_tokens": {"rwkv": [[32272, " took", "normal", 0.10863658785820007]], "qwen": [[3867, " took", "normal", 0.16853733360767365]]}, "loss": {"rwkv": 8.002449054930967, "qwen": 6.422149921164743}, "topk": {"rwkv": [32272, 2, 0.10863658785820007, [[32462, 0.139313, " were", false], [32272, 0.108637, " took", false], [56540, 0.105411, " leverage", false], [59685, 0.067186, " exploited", false], [31351, 0.054689, " made", false], [40013, 0.038893, " tried", false], [32354, 0.03802, " used", false], [57510, 0.033259, " utilized", false], [21795, 0.029704, " had", false], [59189, 0.02192, " attempted", false]]], "qwen": [3867, 1, 0.16853733360767365, [[3867, 0.168537, " took", false], [1033, 0.148943, " were", false], [27505, 0.138017, " lever", false], [50663, 0.068061, " exploited", false], [1865, 0.036492, " made", false], [39913, 0.027299, " relied", false], [1030, 0.02667, " had", false], [1483, 0.023096, " used", false], [1521, 0.016878, " did", false], [33616, 0.016635, " utilized", false]]]}, "raw_delta": 0.08763039112091064, "tuned_delta": 0.09496752963461338}, {"byte_start": 3305, "byte_end": 3315, "display": {"text": " advantage", "kind": "normal"}, "is_word": true, "word_id": 560, "word_key": " advantage", "bytes_hex": "20 61 64 76 61 6e 74 61 67 65", "compression": {"rwkv": "0.16% 0.16% 0.16% 0.16% 0.16% 0.16% 0.16% 0.16% 0.16% 0.16%", "qwen": "0.17% 0.17% 0.17% 0.17% 0.17% 0.17% 0.17% 0.17% 0.17% 0.17%"}, "model_tokens": {"rwkv": [[59093, " advantage", "normal", 0.9134929180145264]], "qwen": [[9423, " advantage", "normal", 0.91209876537323]]}, "loss": {"rwkv": 0.1629019668972523, "qwen": 0.1659225331283318}, "topk": {"rwkv": [59093, 1, 0.9134929180145264, [[59093, 0.913493, " advantage", false], [38720, 0.019798, " human", false], [30923, 0.008447, " full", false], [31162, 0.007946, " into", false], [332, 0.004059, " a", false], [61544, 0.004055, " advantages", false], [22590, 0.003319, " the", false], [38629, 0.003119, " great", false], [50845, 0.002409, " account", false], [56540, 0.00157, " leverage", false]]], "qwen": [9423, 1, 0.91209876537323, [[9423, 0.912099, " advantage", false], [3738, 0.019265, " human", false], [2480, 0.009981, " full", false], [2244, 0.006812, " great", false], [22146, 0.004719, " advantages", false], [264, 0.003321, " a", false], [279, 0.002832, " the", false], [3281, 0.002583, " special", false], [1119, 0.001649, " into", false], [5257, 0.001598, " various", false]]]}, "raw_delta": -0.0001674957573413842, "tuned_delta": 0.007169642756361352}, {"byte_start": 3315, "byte_end": 3318, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 561, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "0.03% 0.03% 0.03%", "qwen": "0.02% 0.02% 0.02%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.9953218102455139]], "qwen": [[315, " of", "normal", 0.9974083304405212]]}, "loss": {"rwkv": 0.028067568620810366, "qwen": 0.01559934988305673}, "topk": {"rwkv": [4706, 1, 0.9953218102455139, [[4706, 0.995322, " of", false], [45, 0.001156, ",", false], [4596, 0.000763, " in", false], [38720, 0.000596, " human", false], [275, 0.00022, " (", false], [45833, 0.000201, " either", false], [22590, 0.000155, " the", false], [22187, 0.000143, " not", false], [4715, 0.000132, " or", false], [30322, 9.2e-05, " both", false]]], "qwen": [315, 1, 0.9974083304405212, [[315, 0.997408, " of", false], [11, 0.000401, ",", false], [2987, 0.000314, " either", false], [537, 0.000232, " not", false], [3738, 0.000214, " human", false], [320, 0.000182, " (", false], [2176, 0.000108, " both", false], [304, 7.5e-05, " in", false], [311, 6.1e-05, " to", false], [279, 5.1e-05, " the", false]]]}, "raw_delta": 0.0006913848531742891, "tuned_delta": 0.008028523366877026}, {"byte_start": 3318, "byte_end": 3324, "display": {"text": " human", "kind": "normal"}, "is_word": true, "word_id": 562, "word_key": " human", "bytes_hex": "20 68 75 6d 61 6e", "compression": {"rwkv": "3.71% 3.71% 3.71% 3.71% 3.71% 3.71%", "qwen": "2.80% 2.80% 2.80% 2.80% 2.80% 2.80%"}, "model_tokens": {"rwkv": [[38720, " human", "normal", 0.29380398988723755]], "qwen": [[3738, " human", "normal", 0.3939196765422821]]}, "loss": {"rwkv": 3.7100556064527375, "qwen": 2.800055271452416}, "topk": {"rwkv": [38720, 1, 0.29380398988723755, [[38720, 0.293804, " human", false], [22590, 0.263014, " the", false], [59943, 0.061471, " knowledge", false], [62182, 0.028709, " linguistic", false], [45775, 0.017382, " domain", false], [332, 0.014888, " a", false], [52964, 0.011897, " special", false], [62293, 0.011503, " particular", false], [56215, 0.011367, " features", false], [53265, 0.009472, " various", false]]], "qwen": [3738, 1, 0.3939196765422821, [[3738, 0.39392, " human", false], [279, 0.212672, " the", false], [3281, 0.052552, " special", false], [6540, 0.026586, " knowledge", false], [264, 0.012291, " a", false], [7947, 0.01182, " domain", false], [8806, 0.010677, " speech", false], [5257, 0.010535, " various", false], [862, 0.010528, " their", false], [3953, 0.009571, " particular", false]]]}, "raw_delta": 0.050461133321126284, "tuned_delta": 0.057798271834829024}, {"byte_start": 3324, "byte_end": 3334, "display": {"text": " knowledge", "kind": "normal"}, "is_word": true, "word_id": 563, "word_key": " knowledge", "bytes_hex": "20 6b 6e 6f 77 6c 65 64 67 65", "compression": {"rwkv": "0.78% 0.78% 0.78% 0.78% 0.78% 0.78% 0.78% 0.78% 0.78% 0.78%", "qwen": "0.94% 0.94% 0.94% 0.94% 0.94% 0.94% 0.94% 0.94% 0.94% 0.94%"}, "model_tokens": {"rwkv": [[59943, " knowledge", "normal", 0.6488920450210571]], "qwen": [[6540, " knowledge", "normal", 0.592913031578064]]}, "loss": {"rwkv": 0.7784072364171407, "qwen": 0.9426344371284479}, "topk": {"rwkv": [59943, 1, 0.6488920450210571, [[59943, 0.648892, " knowledge", false], [65034, 0.168842, " understanding", false], [62182, 0.029598, " linguistic", false], [46, 0.025337, "-", false], [38786, 0.019423, " input", false], [59683, 0.018229, " expertise", false], [47350, 0.011887, " speech", false], [56529, 0.010498, " language", false], [61979, 0.003283, " experience", false], [59917, 0.003175, " intuition", false]]], "qwen": [6540, 1, 0.592913031578064, [[6540, 0.592913, " knowledge", false], [8660, 0.140599, " understanding", false], [18726, 0.080196, " expertise", false], [64667, 0.02676, " linguistic", false], [1946, 0.02544, " input", false], [12646, 0.021762, "-k", false], [4128, 0.007777, " language", false], [71107, 0.006643, "-under", false], [8806, 0.005197, " speech", false], [7947, 0.003196, " domain", false]]]}, "raw_delta": -0.009106689691543574, "tuned_delta": -0.001769551177840837}, {"byte_start": 3334, "byte_end": 3337, "display": {"text": "---", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2d 2d 2d", "compression": {"rwkv": "48.47% 48.47% 48.47%", "qwen": "44.71% 44.71% 44.71%"}, "model_tokens": {"rwkv": [[5346, "---", "normal", 0.00032309035304933786]], "qwen": [[4421, "---", "normal", 0.0005885124555788934]]}, "loss": {"rwkv": 48.46553652986361, "qwen": 44.71099761076521}, "topk": {"rwkv": [5346, 39, 0.00032309035304933786, [[45, 0.262073, ",", false], [4706, 0.261997, " of", false], [47, 0.119919, ".", false], [37598, 0.087124, " about", false], [21265, 0.085614, " and", false], [275, 0.051029, " (", false], [4596, 0.03618, " in", false], [59, 0.018191, ":", false], [4811, 0.01088, " to", false], [32139, 0.007084, " such", false]]], "qwen": [4421, 31, 0.0005885124555788934, [[315, 0.28056, " of", false], [11, 0.207789, ",", false], [13, 0.10953, ".", false], [911, 0.10866, " about", false], [323, 0.065017, " and", false], [320, 0.057745, " (", false], [311, 0.040508, " to", false], [304, 0.033645, " in", false], [476, 0.015063, " or", false], [25, 0.011465, ":", false]]]}, "raw_delta": 0.20819584528605128, "tuned_delta": 0.21553298379975402}, {"byte_start": 3337, "byte_end": 3346, "display": {"text": "knowledge", "kind": "normal"}, "is_word": true, "word_id": 564, "word_key": "knowledge", "bytes_hex": "6b 6e 6f 77 6c 65 64 67 65", "compression": {"rwkv": "7.33% 7.33% 7.33% 7.33% 7.33% 7.33% 7.33% 7.33% 7.33%", "qwen": "10.00% 10.00% 10.00% 10.00% 10.00% 10.00% 10.00% 10.00% 10.00%"}, "model_tokens": {"rwkv": [[58313, "knowledge", "normal", 0.02556772716343403]], "qwen": [[89053, "knowledge", "normal", 0.006804365664720535]]}, "loss": {"rwkv": 7.326185754514267, "qwen": 9.999060811112807}, "topk": {"rwkv": [58313, 6, 0.02556772716343403, [[35381, 0.083752, "phone", false], [7579, 0.048503, "for", false], [27095, 0.045231, "such", false], [58282, 0.038122, "including", false], [1950, 0.026021, "in", false], [58313, 0.025568, "knowledge", false], [8801, 0.023042, "the", false], [2090, 0.022923, "of", false], [49411, 0.014458, "methods", false], [98, 0.013598, "a", false]]], "qwen": [89053, 19, 0.006804365664720535, [[1958, 0.113174, "for", false], [1782, 0.039278, "the", false], [20805, 0.035593, "such", false], [51701, 0.034481, "phon", false], [258, 0.027204, "in", false], [16169, 0.025303, "including", false], [64, 0.023208, "a", false], [68, 0.022413, "e", false], [35742, 0.017526, "methods", false], [437, 0.014828, "and", false]]]}, "raw_delta": -0.1482156647576226, "tuned_delta": -0.14087852624391986}, {"byte_start": 3346, "byte_end": 3349, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 565, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "1.56% 1.56% 1.56%", "qwen": "4.17% 4.17% 4.17%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.7729128003120422]], "qwen": [[315, " of", "normal", 0.5000578165054321]]}, "loss": {"rwkv": 1.5615107457538422, "qwen": 4.165971939865932}, "topk": {"rwkv": [4706, 1, 0.7729128003120422, [[4706, 0.772913, " of", false], [37598, 0.08798, " about", false], [32227, 0.056066, " that", false], [46, 0.005782, "-", false], [37810, 0.00523, " based", false], [32139, 0.004868, " such", false], [4596, 0.004641, " in", false], [30917, 0.003258, " from", false], [22187, 0.003252, " not", false], [55442, 0.003005, " acquired", false]]], "qwen": [315, 1, 0.5000578165054321, [[315, 0.500058, " of", false], [911, 0.244429, " about", false], [429, 0.108862, " that", false], [1741, 0.013823, " such", false], [11, 0.012711, ",", false], [504, 0.008878, " from", false], [304, 0.004599, " in", false], [5980, 0.003731, "-based", false], [3118, 0.003642, " based", false], [18163, 0.003563, " gained", false]]]}, "raw_delta": -0.1444219946861267, "tuned_delta": -0.13708485617242397}, {"byte_start": 3349, "byte_end": 3355, "display": {"text": " words", "kind": "normal"}, "is_word": true, "word_id": 566, "word_key": " words", "bytes_hex": "20 77 6f 72 64 73", "compression": {"rwkv": "12.12% 12.12% 12.12% 12.12% 12.12% 12.12%", "qwen": "15.78% 15.78% 15.78% 15.78% 15.78% 15.78%"}, "model_tokens": {"rwkv": [[40210, " words", "normal", 0.017510516569018364]], "qwen": [[4244, " words", "normal", 0.005253321025520563]]}, "loss": {"rwkv": 12.116384132465903, "qwen": 15.77615487818387}, "topk": {"rwkv": [40210, 11, 0.017510516569018364, [[22590, 0.210966, " the", false], [39273, 0.123534, " phone", false], [47350, 0.084013, " speech", false], [56529, 0.062707, " language", false], [21835, 0.041831, " how", false], [55440, 0.040199, " acoustic", false], [51860, 0.038633, " grammar", false], [62182, 0.034551, " linguistic", false], [59946, 0.021189, " languages", false], [64996, 0.018818, " pronunciation", false]]], "qwen": [4244, 17, 0.005253321025520563, [[279, 0.353914, " the", false], [50823, 0.253003, " phon", false], [1246, 0.058093, " how", false], [4128, 0.035753, " language", false], [8806, 0.03563, " speech", false], [31428, 0.015489, " grammar", false], [1128, 0.013788, " what", false], [3281, 0.013287, " special", false], [6364, 0.010292, " English", false], [70622, 0.010262, " pronunciation", false]]]}, "raw_delta": -0.20294078191121426, "tuned_delta": -0.19560364339751152}, {"byte_start": 3355, "byte_end": 3356, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "6.09%", "qwen": "7.27%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.7119166851043701]], "qwen": [[11, ",", "normal", 0.6681299209594727]]}, "loss": {"rwkv": 6.093414113129654, "qwen": 7.272493308360682}, "topk": {"rwkv": [45, 1, 0.7119166851043701, [[45, 0.711917, ",", false], [21265, 0.19248, " and", false], [4596, 0.025162, " in", false], [275, 0.016054, " (", false], [32227, 0.009218, " that", false], [4715, 0.009197, " or", false], [4423, 0.004116, " as", false], [5346, 0.003781, "---", false], [40, 0.002749, "'", false], [4811, 0.001323, " to", false]]], "qwen": [11, 1, 0.6681299209594727, [[11, 0.66813, ",", false], [323, 0.21026, " and", false], [304, 0.026596, " in", false], [320, 0.019248, " (", false], [476, 0.016288, " or", false], [429, 0.011097, " that", false], [438, 0.007941, " as", false], [1660, 0.003235, " being", false], [1075, 0.002041, " like", false], [1741, 0.001965, " such", false]]]}, "raw_delta": -0.06538203358650208, "tuned_delta": -0.058044895072799335}, {"byte_start": 3356, "byte_end": 3359, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 567, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "10.57% 10.57% 10.57%", "qwen": "10.98% 10.98% 10.98%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.17037168145179749]], "qwen": [[315, " of", "normal", 0.16089268028736115]]}, "loss": {"rwkv": 10.566614069010962, "qwen": 10.982622186588632}, "topk": {"rwkv": [4706, 2, 0.17037168145179749, [[59943, 0.431444, " knowledge", false], [4706, 0.170372, " of", false], [51860, 0.050202, " grammar", false], [39273, 0.029664, " phone", false], [21265, 0.015132, " and", false], [32497, 0.013971, " word", false], [47486, 0.013711, " syntax", false], [64996, 0.011936, " pronunciation", false], [47341, 0.011697, " sounds", false], [52464, 0.011382, " phrases", false]]], "qwen": [315, 1, 0.16089268028736115, [[315, 0.160893, " of", false], [50823, 0.158093, " phon", false], [6540, 0.15273, " knowledge", false], [31428, 0.073357, " grammar", false], [323, 0.032645, " and", false], [862, 0.026638, " their", false], [70622, 0.02638, " pronunciation", false], [279, 0.025346, " the", false], [476, 0.017606, " or", false], [4128, 0.014281, " language", false]]]}, "raw_delta": -0.023068388303120968, "tuned_delta": -0.01573124978941823}, {"byte_start": 3359, "byte_end": 3368, "display": {"text": " phonemes", "kind": "normal"}, "is_word": true, "word_id": 568, "word_key": " phonemes", "bytes_hex": "20 70 68 6f 6e 65 6d 65 73", "compression": {"rwkv": "7.65% 7.65% 7.65% 7.65% 7.65% 7.65% 2.88% 2.88% 2.88%", "qwen": "5.17% 5.17% 5.17% 5.17% 5.17% 4.32% 4.32% 4.32% 4.32%"}, "model_tokens": {"rwkv": [[39273, " phone", "normal", 0.0778711661696434], [8164, "mes", "normal", 0.620806872844696]], "qwen": [[50823, " phon", "normal", 0.23876725137233734], [15660, "emes", "normal", 0.383487343788147]]}, "loss": {"rwkv": 6.062105626999252, "qwen": 4.79037800427587}, "topk": {"rwkv": [39273, 2, 0.0778711661696434, [[51860, 0.179947, " grammar", false], [39273, 0.077871, " phone", false], [22590, 0.073666, " the", false], [47350, 0.047755, " speech", false], [56529, 0.043487, " language", false], [47486, 0.035144, " syntax", false], [64996, 0.024657, " pronunciation", false], [57192, 0.024372, " sentence", false], [51310, 0.023476, " context", false], [60476, 0.022758, " sentences", false]]], "qwen": [50823, 1, 0.23876725137233734, [[50823, 0.238767, " phon", false], [279, 0.117382, " the", false], [70622, 0.049761, " pronunciation", false], [8806, 0.049463, " speech", false], [4128, 0.040122, " language", false], [31428, 0.030796, " grammar", false], [1246, 0.026751, " how", false], [3409, 0.026679, " word", false], [862, 0.02647, " their", false], [15459, 0.019261, " languages", false]]]}, "raw_delta": 0.0705195532904731, "tuned_delta": 0.07785669180417584}, {"byte_start": 3368, "byte_end": 3369, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "2.29%", "qwen": "2.14%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.8807870745658875]], "qwen": [[11, ",", "normal", 0.8879333138465881]]}, "loss": {"rwkv": 2.289433048285708, "qwen": 2.1434594143297496}, "topk": {"rwkv": [45, 1, 0.8807870745658875, [[45, 0.880787, ",", false], [21265, 0.046662, " and", false], [275, 0.034836, " (", false], [4596, 0.010483, " in", false], [4715, 0.005838, " or", false], [5346, 0.003906, "---", false], [4706, 0.003214, " of", false], [47, 0.003036, ".", false], [4423, 0.001426, " as", false], [32227, 0.001153, " that", false]]], "qwen": [11, 1, 0.8879333138465881, [[11, 0.887933, ",", false], [323, 0.048608, " and", false], [320, 0.039137, " (", false], [476, 0.005605, " or", false], [304, 0.004284, " in", false], [429, 0.001585, " that", false], [13, 0.001211, ".", false], [438, 0.001177, " as", false], [4421, 0.001061, "---", false], [3489, 0.000585, " (\"", false]]]}, "raw_delta": 0.00809449702501297, "tuned_delta": 0.015431635538715707}, {"byte_start": 3369, "byte_end": 3372, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 569, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "1.37% 1.37% 1.37%", "qwen": "2.01% 2.01% 2.01%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.7971240878105164]], "qwen": [[315, " of", "normal", 0.7161024808883667]]}, "loss": {"rwkv": 1.3677894878219745, "qwen": 2.0073415507340955}, "topk": {"rwkv": [4706, 1, 0.7971240878105164, [[4706, 0.797124, " of", false], [21265, 0.113438, " and", false], [21643, 0.02585, " etc", false], [4715, 0.009571, " or", false], [30788, 0.006602, " even", false], [59943, 0.006489, " knowledge", false], [22590, 0.002197, " the", false], [39273, 0.001862, " phone", false], [55440, 0.001429, " acoustic", false], [51860, 0.001424, " grammar", false]]], "qwen": [315, 1, 0.7161024808883667, [[315, 0.716102, " of", false], [323, 0.192834, " and", false], [476, 0.024667, " or", false], [4992, 0.023788, " etc", false], [6540, 0.009226, " knowledge", false], [1496, 0.00469, " even", false], [50823, 0.004016, " phon", false], [279, 0.001684, " the", false], [5601, 0.000789, " rules", false], [31428, 0.000649, " grammar", false]]]}, "raw_delta": -0.03546429673830667, "tuned_delta": -0.028127158224603935}, {"byte_start": 3372, "byte_end": 3376, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 570, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "11.20% 11.20% 11.20% 11.20%", "qwen": "8.30% 8.30% 8.30% 8.30%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.08411436527967453]], "qwen": [[279, " the", "normal", 0.1585163027048111]]}, "loss": {"rwkv": 11.20061091315162, "qwen": 8.304052772476783}, "topk": {"rwkv": [22590, 2, 0.08411436527967453, [[51860, 0.137388, " grammar", false], [22590, 0.084114, " the", false], [55440, 0.053842, " acoustic", false], [56529, 0.037841, " language", false], [51310, 0.035892, " context", false], [47350, 0.035343, " speech", false], [62182, 0.028634, " linguistic", false], [39273, 0.028403, " phone", false], [47486, 0.022636, " syntax", false], [21835, 0.021268, " how", false]]], "qwen": [279, 1, 0.1585163027048111, [[279, 0.158516, " the", false], [4128, 0.06611, " language", false], [50823, 0.065517, " phon", false], [8806, 0.064626, " speech", false], [31428, 0.045814, " grammar", false], [8709, 0.02981, " pros", false], [1246, 0.027838, " how", false], [3409, 0.027465, " word", false], [70622, 0.024873, " pronunciation", false], [15459, 0.024133, " languages", false]]]}, "raw_delta": 0.16061928868293762, "tuned_delta": 0.16795642719664036}, {"byte_start": 3376, "byte_end": 3382, "display": {"text": " human", "kind": "normal"}, "is_word": true, "word_id": 571, "word_key": " human", "bytes_hex": "20 68 75 6d 61 6e", "compression": {"rwkv": "15.22% 15.22% 15.22% 15.22% 15.22% 15.22%", "qwen": "16.97% 16.97% 16.97% 16.97% 16.97% 16.97%"}, "model_tokens": {"rwkv": [[38720, " human", "normal", 0.006282585673034191]], "qwen": [[3738, " human", "normal", 0.0035279719159007072]]}, "loss": {"rwkv": 15.215924259375784, "qwen": 16.97280156375475}, "topk": {"rwkv": [38720, 28, 0.006282585673034191, [[60572, 0.123306, " structure", false], [55440, 0.073841, " acoustic", false], [51860, 0.063286, " grammar", false], [22752, 0.030879, " way", false], [39273, 0.024935, " phone", false], [47341, 0.021408, " sounds", false], [51310, 0.021384, " context", false], [47350, 0.020398, " speech", false], [56529, 0.019784, " language", false], [39747, 0.018825, " sound", false]]], "qwen": [3738, 35, 0.0035279719159007072, [[5944, 0.196786, " structure", false], [3281, 0.084411, " special", false], [50823, 0.04054, " phon", false], [44066, 0.039506, " acoustic", false], [1616, 0.033336, " way", false], [8806, 0.03235, " speech", false], [4128, 0.024568, " language", false], [5112, 0.020068, " sound", false], [31428, 0.014308, " grammar", false], [2266, 0.013803, " context", false]]]}, "raw_delta": -0.0974219640096029, "tuned_delta": -0.09008482549590016}, {"byte_start": 3382, "byte_end": 3388, "display": {"text": " vocal", "kind": "normal"}, "is_word": true, "word_id": 572, "word_key": " vocal", "bytes_hex": "20 76 6f 63 61 6c", "compression": {"rwkv": "7.09% 7.09% 7.09% 7.09% 7.09% 7.09%", "qwen": "5.47% 5.47% 5.47% 5.47% 5.47% 5.47%"}, "model_tokens": {"rwkv": [[40136, " vocal", "normal", 0.09253990650177002]], "qwen": [[25407, " vocal", "normal", 0.1618843823671341]]}, "loss": {"rwkv": 7.0913721085362456, "qwen": 5.472842306374786}, "topk": {"rwkv": [40136, 2, 0.09253990650177002, [[40139, 0.422688, " voice", false], [40136, 0.09254, " vocal", false], [47350, 0.064301, " speech", false], [56529, 0.04479, " language", false], [50905, 0.031893, " anatomy", false], [55579, 0.031252, " auditory", false], [52963, 0.030694, " speaker", false], [21590, 0.022464, " ear", false], [62321, 0.017937, " physiology", false], [39070, 0.01777, " mouth", false]]], "qwen": [25407, 1, 0.1618843823671341, [[25407, 0.161884, " vocal", false], [7743, 0.124555, " voice", false], [8806, 0.082691, " speech", false], [4128, 0.069859, " language", false], [82529, 0.066939, " auditory", false], [2430, 0.040684, " ear", false], [8109, 0.039357, " brain", false], [50823, 0.034274, " phon", false], [10778, 0.031447, " hearing", false], [27564, 0.023384, " artic", false]]]}, "raw_delta": 0.08975034952163696, "tuned_delta": 0.0970874880353397}, {"byte_start": 3388, "byte_end": 3394, "display": {"text": " tract", "kind": "normal"}, "is_word": true, "word_id": 573, "word_key": " tract", "bytes_hex": "20 74 72 61 63 74", "compression": {"rwkv": "1.10% 1.10% 1.10% 1.10% 1.10% 1.10%", "qwen": "0.08% 0.08% 0.08% 0.08% 0.08% 0.08%"}, "model_tokens": {"rwkv": [[39996, " tract", "normal", 0.695245623588562]], "qwen": [[41829, " tract", "normal", 0.9751889109611511]]}, "loss": {"rwkv": 1.09775379494725, "qwen": 0.07551333841152351}, "topk": {"rwkv": [39996, 1, 0.695245623588562, [[39996, 0.695246, " tract", false], [59153, 0.12353, " apparatus", false], [47487, 0.065208, " system", false], [50905, 0.040905, " anatomy", false], [38115, 0.009449, " cords", false], [46719, 0.009121, " organs", false], [59994, 0.008012, " mechanism", false], [38024, 0.004497, " chord", false], [62382, 0.00436, " production", false], [39191, 0.003789, " organ", false]]], "qwen": [41829, 1, 0.9751889109611511, [[41829, 0.975189, " tract", false], [40605, 0.007592, " apparatus", false], [1849, 0.002449, " system", false], [16953, 0.002247, " mechanism", false], [2872, 0.00137, " organ", false], [79617, 0.001342, " cords", false], [35753, 0.001225, " organs", false], [489, 0.001167, " tr", false], [61590, 0.00104, " anatomy", false], [3754, 0.000617, " track", false]]]}, "raw_delta": 0.05668504722416401, "tuned_delta": 0.06402218573786675}, {"byte_start": 3394, "byte_end": 3395, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "9.16%", "qwen": "3.67%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.6020835041999817]], "qwen": [[11, ",", "normal", 0.8159487247467041]]}, "loss": {"rwkv": 9.157732193142833, "qwen": 3.6681201451201666}, "topk": {"rwkv": [45, 1, 0.6020835041999817, [[45, 0.602084, ",", false], [47, 0.158145, ".", false], [5346, 0.107527, "---", false], [21265, 0.08151, " and", false], [275, 0.008191, " (", false], [568, 0.004627, "--", false], [21643, 0.003592, " etc", false], [60, 0.003487, ";", false], [50905, 0.002659, " anatomy", false], [116, 0.002186, "s", false]]], "qwen": [11, 1, 0.8159487247467041, [[11, 0.815949, ",", false], [13, 0.073331, ".", false], [323, 0.039013, " and", false], [4421, 0.033701, "---", false], [320, 0.010362, " (", false], [4992, 0.002894, " etc", false], [26, 0.002181, ";", false], [5944, 0.002157, " structure", false], [476, 0.002121, " or", false], [438, 0.001473, " as", false]]]}, "raw_delta": 0.3044087290763855, "tuned_delta": 0.3117458675900882}, {"byte_start": 3395, "byte_end": 3399, "display": {"text": " etc", "kind": "normal"}, "is_word": true, "word_id": 574, "word_key": " etc", "bytes_hex": "20 65 74 63", "compression": {"rwkv": "9.93% 9.93% 9.93% 9.93%", "qwen": "8.02% 8.02% 8.02% 8.02%"}, "model_tokens": {"rwkv": [[21643, " etc", "normal", 0.11122097074985504]], "qwen": [[4992, " etc", "normal", 0.16893409192562103]]}, "loss": {"rwkv": 9.932617224870304, "qwen": 8.017086283367588}, "topk": {"rwkv": [21643, 3, 0.11122097074985504, [[4706, 0.511816, " of", false], [21265, 0.29685, " and", false], [21643, 0.111221, " etc", false], [59943, 0.017757, " knowledge", false], [4715, 0.008257, " or", false], [30788, 0.007334, " even", false], [22590, 0.005926, " the", false], [55440, 0.001916, " acoustic", false], [4522, 0.001897, " et", false], [4423, 0.001601, " as", false]]], "qwen": [4992, 3, 0.16893409192562103, [[315, 0.404679, " of", false], [323, 0.344859, " and", false], [4992, 0.168934, " etc", false], [6540, 0.021371, " knowledge", false], [476, 0.011289, " or", false], [279, 0.005028, " the", false], [1496, 0.004895, " even", false], [678, 0.003127, " all", false], [50823, 0.002071, " phon", false], [1842, 0.002019, " et", false]]]}, "raw_delta": 0.1062195897102356, "tuned_delta": 0.11355672822393834}, {"byte_start": 3399, "byte_end": 3400, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "4.54%", "qwen": "1.88%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.7773990631103516]], "qwen": [[13, ".", "normal", 0.9009494781494141]]}, "loss": {"rwkv": 4.543644049674714, "qwen": 1.8810239662215529}, "topk": {"rwkv": [47, 1, 0.7773990631103516, [[47, 0.777399, ".", false], [5361, 0.092753, ".--", false], [583, 0.057147, ".,", false], [5346, 0.038118, "---", false], [584, 0.006711, ".-", false], [45, 0.004824, ",", false], [23326, 0.004311, ".—", false], [25358, 0.003669, "eter", false], [585, 0.002989, "..", false], [568, 0.00243, "--", false]]], "qwen": [13, 1, 0.9009494781494141, [[13, 0.900949, ".", false], [4421, 0.032714, "---", false], [2572, 0.032237, ".,", false], [11, 0.006014, ",", false], [1404, 0.005206, "eter", false], [32401, 0.005182, ".--", false], [382, 0.004326, ".\n\n", false], [7110, 0.00181, ".\\", false], [496, 0.001474, "..", false], [15642, 0.00098, ".;", false]]]}, "raw_delta": 0.14764700829982758, "tuned_delta": 0.15498414681353032}, {"byte_start": 3400, "byte_end": 3403, "display": {"text": " On", "kind": "normal"}, "is_word": true, "word_id": 575, "word_key": " on", "bytes_hex": "20 4f 6e", "compression": {"rwkv": "39.64% 39.64% 39.64%", "qwen": "40.04% 40.04% 40.04%"}, "model_tokens": {"rwkv": [[4095, " On", "normal", 0.0013493710430338979]], "qwen": [[1913, " On", "normal", 0.0012803024146705866]]}, "loss": {"rwkv": 39.636543441090005, "qwen": 40.0387478011528}, "topk": {"rwkv": [4095, 73, 0.0013493710430338979, [[20996, 0.182047, " The", false], [37453, 0.104859, " These", false], [19555, 0.06217, " But", false], [3913, 0.038369, " In", false], [19407, 0.031001, " All", false], [29894, 0.030291, " This", false], [37451, 0.027659, " There", false], [29804, 0.027328, " Some", false], [20556, 0.025084, " One", false], [29425, 0.02314, " Most", false]]], "qwen": [1913, 69, 0.0012803024146705866, [[4220, 0.13774, " These", false], [576, 0.116353, " The", false], [1988, 0.048123, " But", false], [1096, 0.045986, " This", false], [4421, 0.042403, "---", false], [2009, 0.032058, " All", false], [758, 0.031777, " In", false], [2619, 0.024885, " There", false], [1084, 0.022443, " It", false], [2240, 0.019998, " None", false]]]}, "raw_delta": -0.022302945454915513, "tuned_delta": -0.014965806941212776}, {"byte_start": 3403, "byte_end": 3407, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 576, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "2.69% 2.69% 2.69% 2.69%", "qwen": "3.02% 3.02% 3.02% 3.02%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.5485147833824158]], "qwen": [[279, " the", "normal", 0.5120087265968323]]}, "loss": {"rwkv": 2.6944865875977952, "qwen": 3.0179988525695527}, "topk": {"rwkv": [22590, 1, 0.5485147833824158, [[22590, 0.548515, " the", false], [332, 0.072087, " a", false], [22615, 0.047236, " top", false], [50987, 0.04597, " average", false], [32234, 0.039006, " this", false], [22226, 0.034711, " one", false], [34514, 0.011914, "going", false], [39227, 0.011598, " paper", false], [39931, 0.011246, " their", false], [32227, 0.011073, " that", false]]], "qwen": [279, 1, 0.5120087265968323, [[279, 0.512009, " the", false], [825, 0.077259, " one", false], [264, 0.065043, " a", false], [419, 0.062111, " this", false], [5567, 0.028102, " paper", false], [5461, 0.020084, " average", false], [1493, 0.013356, " these", false], [10778, 0.012195, " hearing", false], [429, 0.010967, " that", false], [1181, 0.010632, " its", false]]]}, "raw_delta": -0.017939329147338867, "tuned_delta": -0.01060219063363613}, {"byte_start": 3407, "byte_end": 3413, "display": {"text": " other", "kind": "normal"}, "is_word": true, "word_id": 577, "word_key": " other", "bytes_hex": "20 6f 74 68 65 72", "compression": {"rwkv": "2.35% 2.35% 2.35% 2.35% 2.35% 2.35%", "qwen": "3.91% 3.91% 3.91% 3.91% 3.91% 3.91%"}, "model_tokens": {"rwkv": [[39193, " other", "normal", 0.4540320932865143]], "qwen": [[1008, " other", "normal", 0.2723727226257324]]}, "loss": {"rwkv": 2.3481364597802137, "qwen": 3.909053865388579}, "topk": {"rwkv": [39193, 1, 0.4540320932865143, [[39193, 0.454032, " other", false], [40190, 0.139123, " whole", false], [37815, 0.070571, " basis", false], [22226, 0.039272, " one", false], [30807, 0.027172, " face", false], [53064, 0.01248, " surface", false], [38499, 0.009485, " first", false], [19678, 0.007714, " DAR", false], [30218, 0.006248, " back", false], [22752, 0.004875, " way", false]]], "qwen": [1008, 1, 0.2723727226257324, [[1008, 0.272373, " other", false], [825, 0.128202, " one", false], [8037, 0.101598, " basis", false], [4361, 0.084979, " whole", false], [7329, 0.062224, " surface", false], [1156, 0.035604, " first", false], [1899, 0.020541, " day", false], [3579, 0.019704, " face", false], [8170, 0.016435, " strength", false], [24335, 0.007199, " assumption", false]]]}, "raw_delta": -0.08655563990275063, "tuned_delta": -0.07921850138904789}, {"byte_start": 3413, "byte_end": 3418, "display": {"text": " side", "kind": "normal"}, "is_word": true, "word_id": 578, "word_key": " side", "bytes_hex": "20 73 69 64 65", "compression": {"rwkv": "3.00% 3.00% 3.00% 3.00% 3.00%", "qwen": "13.41% 13.41% 13.41% 13.41% 13.41%"}, "model_tokens": {"rwkv": [[32011, " side", "normal", 0.43465369939804077]], "qwen": [[3108, " side", "normal", 0.024280866608023643]]}, "loss": {"rwkv": 3.000918395599113, "qwen": 13.410090946877716}, "topk": {"rwkv": [32011, 2, 0.43465369939804077, [[31044, 0.541748, " hand", false], [32011, 0.434654, " side", false], [21616, 0.015571, " end", false], [32207, 0.001555, " team", false], [45, 0.001225, ",", false], [51699, 0.000939, " extreme", false], [38559, 0.000278, " front", false], [32462, 0.00024, " were", false], [38660, 0.000145, " hands", false], [57274, 0.000126, " spectrum", false]]], "qwen": [3108, 2, 0.024280866608023643, [[1424, 0.966155, " hand", false], [3108, 0.024281, " side", false], [835, 0.005734, " end", false], [14226, 0.000471, " extreme", false], [6078, 0.000411, " hands", false], [1616, 0.000195, " way", false], [11, 0.000186, ",", false], [3579, 0.000149, " face", false], [24413, 8.5e-05, "-hand", false], [1030, 7.4e-05, " had", false]]]}, "raw_delta": -0.577207088470459, "tuned_delta": -0.5698699499567562}, {"byte_start": 3418, "byte_end": 3423, "display": {"text": " were", "kind": "normal"}, "is_word": true, "word_id": 579, "word_key": " were", "bytes_hex": "20 77 65 72 65", "compression": {"rwkv": "4.62% 4.62% 4.62% 4.62% 4.62%", "qwen": "5.26% 5.26% 5.26% 5.26% 5.26%"}, "model_tokens": {"rwkv": [[32462, " were", "normal", 0.27824515104293823]], "qwen": [[1033, " were", "normal", 0.23232492804527283]]}, "loss": {"rwkv": 4.62113255284746, "qwen": 5.26446031571068}, "topk": {"rwkv": [32462, 2, 0.27824515104293823, [[45, 0.332613, ",", false], [32462, 0.278245, " were", false], [22748, 0.193529, " was", false], [4706, 0.157525, " of", false], [39934, 0.019791, " there", false], [39826, 0.004007, " stood", false], [22590, 0.001946, " the", false], [275, 0.001543, " (", false], [4858, 0.001369, " we", false], [5346, 0.001042, "---", false]]], "qwen": [1033, 2, 0.23232492804527283, [[315, 0.490659, " of", false], [1033, 0.232325, " were", false], [11, 0.166032, ",", false], [572, 0.082803, " was", false], [1052, 0.011907, " there", false], [14638, 0.003368, " stood", false], [320, 0.001514, " (", false], [7578, 0.001177, " sat", false], [582, 0.001015, " we", false], [279, 0.000952, " the", false]]]}, "raw_delta": -0.035673666000366255, "tuned_delta": -0.02833652748666352}, {"byte_start": 3423, "byte_end": 3429, "display": {"text": " newer", "kind": "normal"}, "is_word": true, "word_id": 580, "word_key": " newer", "bytes_hex": "20 6e 65 77 65 72", "compression": {"rwkv": "26.67% 26.67% 26.67% 26.67% 26.67% 26.67%", "qwen": "26.07% 26.07% 26.07% 26.07% 26.07% 26.07%"}, "model_tokens": {"rwkv": [[39116, " newer", "normal", 0.00014249391097109765]], "qwen": [[25546, " newer", "normal", 0.00017089667380787432]]}, "loss": {"rwkv": 26.67483018310323, "qwen": 26.072059655604225}, "topk": {"rwkv": [39116, 286, 0.00014249391097109765, [[52224, 0.220191, " methods", false], [63843, 0.15007, " researchers", false], [22590, 0.12913, " the", false], [332, 0.042049, " a", false], [39944, 0.020052, " those", false], [61590, 0.019922, " approaches", false], [39904, 0.018776, " teams", false], [62633, 0.015403, " techniques", false], [51566, 0.014795, " efforts", false], [38328, 0.01268, " early", false]]], "qwen": [25546, 334, 0.00017089667380787432, [[5413, 0.14978, " methods", false], [279, 0.096848, " the", false], [264, 0.049531, " a", false], [29728, 0.035675, " neural", false], [1378, 0.033291, " two", false], [11811, 0.032846, " researchers", false], [5942, 0.031073, " systems", false], [4586, 0.021922, " general", false], [7468, 0.021892, " programs", false], [1657, 0.021721, " many", false]]]}, "raw_delta": 0.0334246953328452, "tuned_delta": 0.04076183384654794}, {"byte_start": 3429, "byte_end": 3437, "display": {"text": " methods", "kind": "normal"}, "is_word": true, "word_id": 581, "word_key": " methods", "bytes_hex": "20 6d 65 74 68 6f 64 73", "compression": {"rwkv": "1.65% 1.65% 1.65% 1.65% 1.65% 1.65% 1.65% 1.65%", "qwen": "1.34% 1.34% 1.34% 1.34% 1.34% 1.34% 1.34% 1.34%"}, "model_tokens": {"rwkv": [[52224, " methods", "normal", 0.4750566780567169]], "qwen": [[5413, " methods", "normal", 0.5520504713058472]]}, "loss": {"rwkv": 1.646630692420875, "qwen": 1.3392624926301873}, "topk": {"rwkv": [52224, 1, 0.4750566780567169, [[52224, 0.475057, " methods", false], [45, 0.132048, ",", false], [61590, 0.132043, " approaches", false], [62633, 0.062625, " techniques", false], [38378, 0.036777, " entra", false], [21265, 0.023924, " and", false], [63843, 0.01749, " researchers", false], [57103, 0.010006, " research", false], [63363, 0.00721, " competitors", false], [4404, 0.005998, " ``", false]]], "qwen": [5413, 1, 0.5520504713058472, [[5413, 0.55205, " methods", false], [11, 0.132193, ",", false], [19827, 0.082683, " approaches", false], [12538, 0.043585, " techniques", false], [5942, 0.030773, " systems", false], [323, 0.017067, " and", false], [4586, 0.011913, " general", false], [7468, 0.010526, " programs", false], [9902, 0.006363, " ``", false], [11811, 0.005818, " researchers", false]]]}, "raw_delta": 0.01704411208629608, "tuned_delta": 0.024381250599998818}, {"byte_start": 3437, "byte_end": 3442, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 582, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"rwkv": "3.13% 3.13% 3.13% 3.13% 3.13%", "qwen": "2.18% 2.18% 2.18% 2.18% 2.18%"}, "model_tokens": {"rwkv": [[32227, " that", "normal", 0.42222630977630615]], "qwen": [[429, " that", "normal", 0.5460522174835205]]}, "loss": {"rwkv": 3.1277177644272443, "qwen": 2.182222718369164}, "topk": {"rwkv": [32227, 1, 0.42222630977630615, [[32227, 0.422226, " that", false], [37810, 0.231703, " based", false], [45, 0.104707, ",", false], [4706, 0.03518, " of", false], [40085, 0.022135, " using", false], [5346, 0.02004, "---", false], [32139, 0.014706, " such", false], [21700, 0.011623, " for", false], [275, 0.009671, " (", false], [38888, 0.008659, " lever", false]]], "qwen": [429, 1, 0.5460522174835205, [[429, 0.546052, " that", false], [3118, 0.155059, " based", false], [11, 0.141318, ",", false], [4421, 0.023036, "---", false], [320, 0.012567, " (", false], [315, 0.011942, " of", false], [1667, 0.009367, " using", false], [1741, 0.009027, " such", false], [1075, 0.008867, " like", false], [892, 0.007434, " which", false]]]}, "raw_delta": 0.052429378032684326, "tuned_delta": 0.059766516546387066}, {"byte_start": 3442, "byte_end": 3447, "display": {"text": " were", "kind": "normal"}, "is_word": true, "word_id": 583, "word_key": " were", "bytes_hex": "20 77 65 72 65", "compression": {"rwkv": "7.95% 7.95% 7.95% 7.95% 7.95%", "qwen": "7.93% 7.93% 7.93% 7.93% 7.93%"}, "model_tokens": {"rwkv": [[32462, " were", "normal", 0.11201926320791245]], "qwen": [[1033, " were", "normal", 0.1108400747179985]]}, "loss": {"rwkv": 7.946093779896243, "qwen": 7.933621598055672}, "topk": {"rwkv": [32462, 3, 0.11201926320791245, [[32354, 0.161455, " used", false], [32272, 0.132327, " took", false], [32462, 0.112019, " were", false], [21532, 0.051007, " did", false], [56540, 0.050717, " leverage", false], [57510, 0.038327, " utilized", false], [31351, 0.037906, " made", false], [47054, 0.026644, " relied", false], [21795, 0.020182, " had", false], [50937, 0.015936, " applied", false]]], "qwen": [1033, 2, 0.1108400747179985, [[1483, 0.118791, " used", false], [1033, 0.11084, " were", false], [3867, 0.110069, " took", false], [1521, 0.06304, " did", false], [27505, 0.052365, " lever", false], [39913, 0.052317, " relied", false], [1865, 0.034872, " made", false], [33616, 0.033021, " utilized", false], [9251, 0.020661, " applied", false], [50663, 0.019668, " exploited", false]]]}, "raw_delta": 0.0006916046142578236, "tuned_delta": 0.00802874312796056}, {"byte_start": 3447, "byte_end": 3452, "display": {"text": " more", "kind": "normal"}, "is_word": true, "word_id": 584, "word_key": " more", "bytes_hex": "20 6d 6f 72 65", "compression": {"rwkv": "10.59% 10.59% 10.59% 10.59% 10.59%", "qwen": "10.64% 10.64% 10.64% 10.64% 10.64%"}, "model_tokens": {"rwkv": [[31458, " more", "normal", 0.05285457521677017]], "qwen": [[803, " more", "normal", 0.052396297454833984]]}, "loss": {"rwkv": 10.594791706528325, "qwen": 10.635978111756948}, "topk": {"rwkv": [31458, 2, 0.05285457521677017, [[37810, 0.291151, " based", false], [31458, 0.052855, " more", false], [22187, 0.051126, " not", false], [63541, 0.019233, " essentially", false], [46957, 0.017331, " purely", false], [31466, 0.016338, " much", false], [47202, 0.016037, " search", false], [51832, 0.012933, " general", false], [45, 0.009769, ",", false], [52094, 0.009434, " largely", false]]], "qwen": [803, 3, 0.052396297454833984, [[3118, 0.30488, " based", false], [537, 0.055778, " not", false], [803, 0.052396, " more", false], [2686, 0.026301, " less", false], [1753, 0.025835, " much", false], [15791, 0.021092, " essentially", false], [4586, 0.016136, " general", false], [2711, 0.015008, " search", false], [13771, 0.01305, " largely", false], [1602, 0.011742, " very", false]]]}, "raw_delta": -0.002283859252929621, "tuned_delta": 0.005053279260773116}, {"byte_start": 3452, "byte_end": 3464, "display": {"text": " statistical", "kind": "normal"}, "is_word": true, "word_id": 585, "word_key": " statistical", "bytes_hex": "20 73 74 61 74 69 73 74 69 63 61 6c", "compression": {"rwkv": "7.56% 7.56% 7.56% 7.56% 7.56% 7.56% 7.56% 7.56% 7.56% 7.56% 7.56% 7.56%", "qwen": "9.61% 9.61% 9.61% 9.61% 9.61% 9.61% 9.61% 9.61% 9.61% 9.61% 9.61% 9.61%"}, "model_tokens": {"rwkv": [[63885, " statistical", "normal", 0.006669470574706793]], "qwen": [[28464, " statistical", "normal", 0.0016723305452615023]]}, "loss": {"rwkv": 7.560999400492288, "qwen": 9.608254362371156}, "topk": {"rwkv": [63885, 20, 0.006669470574706793, [[51832, 0.385186, " general", false], [31296, 0.069652, " like", false], [30579, 0.026033, " data", false], [59593, 0.024663, " effective", false], [59758, 0.023369, " generally", false], [4715, 0.019216, " or", false], [4596, 0.018707, " in", false], [64862, 0.014551, " computational", false], [37810, 0.013754, " based", false], [51216, 0.011926, " closely", false]]], "qwen": [28464, 55, 0.0016723305452615023, [[4586, 0.515447, " general", false], [1075, 0.03594, " like", false], [2711, 0.024862, " search", false], [3716, 0.018841, " comput", false], [476, 0.016976, " or", false], [7373, 0.016174, " effective", false], [54480, 0.015547, " computational", false], [13954, 0.014393, " generic", false], [3118, 0.013251, " based", false], [31499, 0.012603, " suited", false]]]}, "raw_delta": -0.11352392037709548, "tuned_delta": -0.10618678186339274}, {"byte_start": 3464, "byte_end": 3467, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 586, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "7.47% 7.47% 7.47%", "qwen": "7.96% 7.96% 7.96%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.2928273677825928]], "qwen": [[304, " in", "normal", 0.26591023802757263]]}, "loss": {"rwkv": 7.467073942101079, "qwen": 7.962453486240692}, "topk": {"rwkv": [4596, 2, 0.2928273677825928, [[45, 0.33551, ",", false], [4596, 0.292827, " in", false], [21265, 0.179348, " and", false], [47, 0.073304, ".", false], [5346, 0.027321, "---", false], [275, 0.025163, " (", false], [4715, 0.012488, " or", false], [32226, 0.006861, " than", false], [59, 0.005239, ":", false], [46, 0.004868, "-", false]]], "qwen": [304, 1, 0.26591023802757263, [[304, 0.26591, " in", false], [11, 0.261915, ",", false], [323, 0.217155, " and", false], [4421, 0.069411, "---", false], [13, 0.061853, ".", false], [320, 0.038152, " (", false], [714, 0.021823, " but", false], [476, 0.011689, " or", false], [25, 0.009083, ":", false], [26, 0.005756, ";", false]]]}, "raw_delta": -0.027469674746195494, "tuned_delta": -0.020132536232492757}, {"byte_start": 3467, "byte_end": 3474, "display": {"text": " nature", "kind": "normal"}, "is_word": true, "word_id": 587, "word_key": " nature", "bytes_hex": "20 6e 61 74 75 72 65", "compression": {"rwkv": "0.74% 0.74% 0.74% 0.74% 0.74% 0.74% 0.74%", "qwen": "0.58% 0.58% 0.58% 0.58% 0.58% 0.58% 0.58%"}, "model_tokens": {"rwkv": [[46642, " nature", "normal", 0.7467482089996338]], "qwen": [[6993, " nature", "normal", 0.7982470989227295]]}, "loss": {"rwkv": 0.7446947058160106, "qwen": 0.5805226393643393}, "topk": {"rwkv": [46642, 1, 0.7467482089996338, [[46642, 0.746748, " nature", false], [55532, 0.071425, " approach", false], [59284, 0.053146, " character", false], [39931, 0.046491, " their", false], [46004, 0.022895, " flavor", false], [22590, 0.010958, " the", false], [47362, 0.010222, " spirit", false], [63735, 0.005132, " orientation", false], [46723, 0.002439, " origin", false], [30899, 0.002177, " form", false]]], "qwen": [6993, 1, 0.7982470989227295, [[6993, 0.798247, " nature", false], [3668, 0.055633, " character", false], [17172, 0.04214, " flavor", false], [5486, 0.025221, " approach", false], [862, 0.024129, " their", false], [8913, 0.007035, " spirit", false], [279, 0.005846, " the", false], [16725, 0.004318, " orientation", false], [1352, 0.003448, " form", false], [5244, 0.003247, " focus", false]]]}, "raw_delta": 0.009103632399014064, "tuned_delta": 0.0164407709127168}, {"byte_start": 3474, "byte_end": 3478, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 588, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"rwkv": "7.82% 7.82% 7.82% 7.82%", "qwen": "7.11% 7.11% 7.11% 7.11%"}, "model_tokens": {"rwkv": [[21265, " and", "normal", 0.178047314286232]], "qwen": [[323, " and", "normal", 0.20663084089756012]]}, "loss": {"rwkv": 7.819294411068111, "qwen": 7.108976503486595}, "topk": {"rwkv": [21265, 3, 0.178047314286232, [[45, 0.451097, ",", false], [47, 0.234303, ".", false], [21265, 0.178047, " and", false], [5346, 0.0492, "---", false], [275, 0.045993, " (", false], [59, 0.011368, ":", false], [21400, 0.010095, " but", false], [60, 0.006038, ";", false], [4715, 0.002039, " or", false], [32227, 0.001723, " that", false]]], "qwen": [323, 3, 0.20663084089756012, [[11, 0.348995, ",", false], [13, 0.261467, ".", false], [323, 0.206631, " and", false], [4421, 0.067034, "---", false], [320, 0.041091, " (", false], [714, 0.02972, " but", false], [25, 0.015691, ":", false], [26, 0.008932, ";", false], [429, 0.004058, " that", false], [313, 0.001818, "--", false]]]}, "raw_delta": 0.03938838839530945, "tuned_delta": 0.04672552690901219}, {"byte_start": 3478, "byte_end": 3482, "display": {"text": " did", "kind": "normal"}, "is_word": true, "word_id": 589, "word_key": " did", "bytes_hex": "20 64 69 64", "compression": {"rwkv": "11.76% 11.76% 11.76% 11.76%", "qwen": "12.47% 12.47% 12.47% 12.47%"}, "model_tokens": {"rwkv": [[21532, " did", "normal", 0.07366282492876053]], "qwen": [[1521, " did", "normal", 0.06296456605195999]]}, "loss": {"rwkv": 11.76416366349887, "qwen": 12.466612827357629}, "topk": {"rwkv": [21532, 3, 0.07366282492876053, [[32227, 0.155326, " that", false], [32354, 0.075692, " used", false], [21532, 0.073663, " did", false], [37810, 0.064063, " based", false], [32462, 0.050208, " were", false], [31458, 0.046267, " more", false], [32272, 0.025165, " took", false], [31351, 0.02509, " made", false], [21795, 0.02413, " had", false], [45, 0.021957, ",", false]]], "qwen": [1521, 2, 0.06296456605195999, [[429, 0.120831, " that", false], [1521, 0.062965, " did", false], [1033, 0.058103, " were", false], [3867, 0.057854, " took", false], [11, 0.035677, ",", false], [1483, 0.033562, " used", false], [1865, 0.031942, " made", false], [39913, 0.028828, " relied", false], [892, 0.023499, " which", false], [1030, 0.023368, " had", false]]]}, "raw_delta": -0.0389520525932312, "tuned_delta": -0.03161491407952846}, {"byte_start": 3482, "byte_end": 3487, "display": {"text": " much", "kind": "normal"}, "is_word": true, "word_id": 590, "word_key": " much", "bytes_hex": "20 6d 75 63 68", "compression": {"rwkv": "22.99% 22.99% 22.99% 22.99% 22.99%", "qwen": "20.84% 20.84% 20.84% 20.84% 20.84%"}, "model_tokens": {"rwkv": [[31466, " much", "normal", 0.0016968126874417067]], "qwen": [[1753, " much", "normal", 0.0030921902507543564]]}, "loss": {"rwkv": 22.99295221416785, "qwen": 20.84288874666184}, "topk": {"rwkv": [31466, 4, 0.0016968126874417067, [[22187, 0.976157, " not", false], [30211, 0.004169, " away", false], [4692, 0.002717, " no", false], [31466, 0.001697, " much", false], [31277, 0.001413, " less", false], [31458, 0.001256, " more", false], [46454, 0.001184, " little", false], [332, 0.001044, " a", false], [45301, 0.00079, " better", false], [31856, 0.000556, " rely", false]]], "qwen": [1753, 4, 0.0030921902507543564, [[537, 0.949856, " not", false], [264, 0.004543, " a", false], [2664, 0.00393, " better", false], [1753, 0.003092, " much", false], [2686, 0.00274, " less", false], [1632, 0.002697, " well", false], [1373, 0.002249, " require", false], [2632, 0.001887, " little", false], [803, 0.001702, " more", false], [1602, 0.001505, " very", false]]]}, "raw_delta": 0.1192248344421385, "tuned_delta": 0.12656197295584123}, {"byte_start": 3487, "byte_end": 3492, "display": {"text": " more", "kind": "normal"}, "is_word": true, "word_id": 591, "word_key": " more", "bytes_hex": "20 6d 6f 72 65", "compression": {"rwkv": "8.74% 8.74% 8.74% 8.74% 8.74%", "qwen": "5.78% 5.78% 5.78% 5.78% 5.78%"}, "model_tokens": {"rwkv": [[31458, " more", "normal", 0.08817194402217865]], "qwen": [[803, " more", "normal", 0.20147407054901123]]}, "loss": {"rwkv": 8.735067630382394, "qwen": 5.778335017442954}, "topk": {"rwkv": [31458, 3, 0.08817194402217865, [[45301, 0.483806, " better", false], [31277, 0.297442, " less", false], [31458, 0.088172, " more", false], [4706, 0.045373, " of", false], [32487, 0.014982, " with", false], [22590, 0.013964, " the", false], [4811, 0.009794, " to", false], [45, 0.005089, ",", false], [4715, 0.004059, " or", false], [38475, 0.002839, " fewer", false]]], "qwen": [803, 3, 0.20147407054901123, [[2686, 0.413826, " less", false], [2664, 0.293949, " better", false], [803, 0.201474, " more", false], [315, 0.03732, " of", false], [10960, 0.006383, " worse", false], [448, 0.00482, " with", false], [311, 0.004143, " to", false], [11, 0.003658, ",", false], [6832, 0.003465, " learning", false], [279, 0.003133, " the", false]]]}, "raw_delta": 0.16395606994628908, "tuned_delta": 0.17129320845999182}, {"byte_start": 3492, "byte_end": 3504, "display": {"text": " computation", "kind": "normal"}, "is_word": true, "word_id": 592, "word_key": " computation", "bytes_hex": "20 63 6f 6d 70 75 74 61 74 69 6f 6e", "compression": {"rwkv": "3.55% 3.55% 3.55% 3.55% 3.55% 3.55% 3.55% 3.55% 3.55% 3.55% 3.55% 3.55%", "qwen": "1.86% 1.86% 1.86% 1.86% 1.86% 1.86% 1.86% 1.86% 1.86% 1.86% 1.86% 1.86%"}, "model_tokens": {"rwkv": [[63370, " computation", "normal", 0.09333442896604538]], "qwen": [[34447, " computation", "normal", 0.2901773154735565]]}, "loss": {"rwkv": 3.5456860542681228, "qwen": 1.8593682153775188}, "topk": {"rwkv": [63370, 2, 0.09333442896604538, [[32487, 0.243192, " with", false], [63370, 0.093334, " computation", false], [4811, 0.060867, " to", false], [51832, 0.049822, " general", false], [4706, 0.049729, " of", false], [56537, 0.037455, " learning", false], [32499, 0.026303, " work", false], [47202, 0.013376, " search", false], [60463, 0.013091, " searching", false], [4450, 0.012975, " by", false]]], "qwen": [34447, 1, 0.2901773154735565, [[34447, 0.290177, " computation", false], [15039, 0.145217, " searching", false], [2711, 0.081705, " search", false], [315, 0.0751, " of", false], [448, 0.05351, " with", false], [24231, 0.031271, " computing", false], [6832, 0.022954, " learning", false], [4586, 0.018643, " general", false], [975, 0.017757, " work", false], [311, 0.01145, " to", false]]]}, "raw_delta": 0.09350931644439699, "tuned_delta": 0.10084645495809973}, {"byte_start": 3504, "byte_end": 3505, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "33.95%", "qwen": "45.12%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.15157459676265717]], "qwen": [[11, ",", "normal", 0.08190564066171646]]}, "loss": {"rwkv": 33.95405320842189, "qwen": 45.12366854832176}, "topk": {"rwkv": [45, 2, 0.15157459676265717, [[47, 0.502508, ".", false], [45, 0.151575, ",", false], [5346, 0.04709, "---", false], [275, 0.046031, " (", false], [4596, 0.028801, " in", false], [4811, 0.024974, " to", false], [22278, 0.023767, " per", false], [32226, 0.021044, " than", false], [21265, 0.019436, " and", false], [4712, 0.019351, " on", false]]], "qwen": [11, 2, 0.08190564066171646, [[13, 0.583414, ".", false], [11, 0.081906, ",", false], [1091, 0.070011, " than", false], [4421, 0.039688, "---", false], [320, 0.033191, " (", false], [304, 0.031476, " in", false], [817, 0.024267, " per", false], [389, 0.023708, " on", false], [311, 0.02129, " to", false], [323, 0.013687, " and", false]]]}, "raw_delta": -0.6193749904632568, "tuned_delta": -0.6120378519495541}, {"byte_start": 3505, "byte_end": 3511, "display": {"text": " based", "kind": "normal"}, "is_word": true, "word_id": 593, "word_key": " based", "bytes_hex": "20 62 61 73 65 64", "compression": {"rwkv": "12.59% 12.59% 12.59% 12.59% 12.59% 12.59%", "qwen": "13.62% 13.62% 13.62% 13.62% 13.62% 13.62%"}, "model_tokens": {"rwkv": [[37810, " based", "normal", 0.015353722497820854]], "qwen": [[3118, " based", "normal", 0.01076422818005085]]}, "loss": {"rwkv": 12.586011424421944, "qwen": 13.620024149393167}, "topk": {"rwkv": [37810, 12, 0.015353722497820854, [[21400, 0.221215, " but", false], [21265, 0.110455, " and", false], [59841, 0.060392, " including", false], [40085, 0.037876, " using", false], [4596, 0.026567, " in", false], [40186, 0.02271, " which", false], [32487, 0.020916, " with", false], [38888, 0.01793, " lever", false], [32139, 0.016625, " such", false], [61953, 0.015793, " especially", false]]], "qwen": [3118, 12, 0.01076422818005085, [[714, 0.261164, " but", false], [323, 0.184254, " and", false], [2670, 0.10632, " including", false], [1741, 0.029872, " such", false], [5310, 0.020441, " especially", false], [448, 0.019934, " with", false], [892, 0.018584, " which", false], [304, 0.01769, " in", false], [7892, 0.014641, " although", false], [1667, 0.014108, " using", false]]]}, "raw_delta": -0.057337840398152706, "tuned_delta": -0.050000701884449966}, {"byte_start": 3511, "byte_end": 3514, "display": {"text": " on", "kind": "normal"}, "is_word": true, "word_id": 594, "word_key": " on", "bytes_hex": "20 6f 6e", "compression": {"rwkv": "0.55% 0.55% 0.55%", "qwen": "0.84% 0.84% 0.84%"}, "model_tokens": {"rwkv": [[4712, " on", "normal", 0.9132784008979797]], "qwen": [[389, " on", "normal", 0.8698983192443848]]}, "loss": {"rwkv": 0.5459417268988996, "qwen": 0.8378387436300176}, "topk": {"rwkv": [4712, 1, 0.9132784008979797, [[4712, 0.913278, " on", false], [4596, 0.011472, " in", false], [32350, 0.010601, " upon", false], [52094, 0.009688, " largely", false], [46495, 0.00741, " mainly", false], [45, 0.006157, ",", false], [60247, 0.00568, " primarily", false], [46602, 0.004512, " mostly", false], [45202, 0.002892, " around", false], [31581, 0.002202, " only", false]]], "qwen": [389, 1, 0.8698983192443848, [[389, 0.869898, " on", false], [304, 0.021619, " in", false], [11, 0.011789, ",", false], [13771, 0.010429, " largely", false], [438, 0.008155, " as", false], [10008, 0.005441, " mostly", false], [537, 0.005329, " not", false], [2987, 0.005026, " either", false], [15503, 0.004967, " primarily", false], [5193, 0.004075, " upon", false]]]}, "raw_delta": -0.01618620753288269, "tuned_delta": -0.008849069019179954}, {"byte_start": 3514, "byte_end": 3521, "display": {"text": " hidden", "kind": "normal"}, "is_word": true, "word_id": 595, "word_key": " hidden", "bytes_hex": "20 68 69 64 64 65 6e", "compression": {"rwkv": "9.10% 9.10% 9.10% 9.10% 9.10% 9.10% 9.10%", "qwen": "10.98% 10.98% 10.98% 10.98% 10.98% 10.98% 10.98%"}, "model_tokens": {"rwkv": [[46196, " hidden", "normal", 0.02935795672237873]], "qwen": [[8177, " hidden", "normal", 0.014072589576244354]]}, "loss": {"rwkv": 9.097351541319913, "qwen": 10.983872234296777}, "topk": {"rwkv": [46196, 6, 0.02935795672237873, [[22590, 0.16603, " the", false], [56537, 0.068296, " learning", false], [332, 0.050552, " a", false], [38864, 0.048553, " large", false], [52195, 0.035344, " massive", false], [46196, 0.029358, " hidden", false], [63885, 0.023525, " statistical", false], [52224, 0.022249, " methods", false], [62633, 0.016554, " techniques", false], [51832, 0.01353, " general", false]]], "qwen": [8177, 7, 0.014072589576244354, [[279, 0.121637, " the", false], [264, 0.052986, " a", false], [6832, 0.03322, " learning", false], [3460, 0.029745, " large", false], [4862, 0.026799, " training", false], [29728, 0.015595, " neural", false], [8177, 0.014073, " hidden", false], [12538, 0.012574, " techniques", false], [5662, 0.012055, " machine", false], [5413, 0.010144, " methods", false]]]}, "raw_delta": -0.10461091995239258, "tuned_delta": -0.09727378143868984}, {"byte_start": 3521, "byte_end": 3528, "display": {"text": " Markov", "kind": "normal"}, "is_word": true, "word_id": 596, "word_key": " markov", "bytes_hex": "20 4d 61 72 6b 6f 76", "compression": {"rwkv": "0.12% 0.12% 0.12% 0.12% 0.12% 0.12% 0.12%", "qwen": "0.37% 0.37% 0.37% 0.37% 0.37% 0.01% 0.01%"}, "model_tokens": {"rwkv": [[44557, " Markov", "normal", 0.9540068507194519]], "qwen": [[4389, " Mark", "normal", 0.9030137658119202], [859, "ov", "normal", 0.9992189407348633]]}, "loss": {"rwkv": 0.12201923389215041, "qwen": 0.2648345104151857}, "topk": {"rwkv": [44557, 1, 0.9540068507194519, [[44557, 0.954007, " Markov", false], [46, 0.020269, "-", false], [31376, 0.011954, " mark", false], [60725, 0.002068, " variables", false], [47398, 0.001243, " states", false], [40069, 0.000929, " units", false], [39802, 0.000761, " state", false], [57518, 0.000566, " variable", false], [275, 0.000435, " (", false], [46587, 0.000362, " models", false]]], "qwen": [4389, 1, 0.9030137658119202, [[4389, 0.903014, " Mark", false], [1868, 0.035682, " mark", false], [5251, 0.009038, "-M", false], [28904, 0.007059, "-mark", false], [12, 0.006278, "-", false], [1448, 0.004914, "-m", false], [20733, 0.004111, "-state", false], [1584, 0.002487, " state", false], [8949, 0.001597, "Mark", false], [64096, 0.001461, "-memory", false]]]}, "raw_delta": -0.007919360501026469, "tuned_delta": -0.0005822219873237323}, {"byte_start": 3528, "byte_end": 3535, "display": {"text": " models", "kind": "normal"}, "is_word": true, "word_id": 597, "word_key": " models", "bytes_hex": "20 6d 6f 64 65 6c 73", "compression": {"rwkv": "0.15% 0.15% 0.15% 0.15% 0.15% 0.15% 0.15%", "qwen": "0.08% 0.08% 0.08% 0.08% 0.08% 0.08% 0.08%"}, "model_tokens": {"rwkv": [[46587, " models", "normal", 0.9433397054672241]], "qwen": [[4119, " models", "normal", 0.9691730737686157]]}, "loss": {"rwkv": 0.15095162955729943, "qwen": 0.08066737789838634}, "topk": {"rwkv": [46587, 1, 0.9433397054672241, [[46587, 0.94334, " models", false], [39043, 0.014399, " model", false], [46, 0.00997, "-", false], [56658, 0.006732, " modeling", false], [21265, 0.004177, " and", false], [45447, 0.00323, " chains", false], [4715, 0.002825, " or", false], [44592, 0.002445, " Models", false], [60261, 0.002042, " processes", false], [60020, 0.00104, " modelling", false]]], "qwen": [4119, 1, 0.9691730737686157, [[4119, 0.969173, " models", false], [1614, 0.012049, " model", false], [26874, 0.00448, " Models", false], [33479, 0.003152, " modeling", false], [476, 0.002071, " or", false], [26179, 0.001405, " chains", false], [28244, 0.001231, "-model", false], [323, 0.00104, " and", false], [11364, 0.000769, " processes", false], [4194, 0.000413, " random", false]]]}, "raw_delta": 0.003897386470011303, "tuned_delta": 0.01123452498371404}, {"byte_start": 3535, "byte_end": 3537, "display": {"text": " (", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "20 28", "compression": {"rwkv": "17.75% 17.75%", "qwen": "16.60% 16.60%"}, "model_tokens": {"rwkv": [[275, " (", "normal", 0.1397610902786255]], "qwen": [[320, " (", "normal", 0.15871939063072205]]}, "loss": {"rwkv": 17.751911635938416, "qwen": 16.59656013462283}, "topk": {"rwkv": [275, 4, 0.1397610902786255, [[21265, 0.28346, " and", false], [47, 0.248766, ".", false], [45, 0.217286, ",", false], [275, 0.139761, " (", false], [4715, 0.038466, " or", false], [4706, 0.013079, " of", false], [32227, 0.011295, " that", false], [5346, 0.010262, "---", false], [21700, 0.006187, " for", false], [32487, 0.004908, " with", false]]], "qwen": [320, 4, 0.15871939063072205, [[323, 0.328073, " and", false], [11, 0.233007, ",", false], [13, 0.175975, ".", false], [320, 0.158719, " (", false], [476, 0.035767, " or", false], [448, 0.013998, " with", false], [429, 0.010125, " that", false], [4421, 0.006499, "---", false], [315, 0.006206, " of", false], [369, 0.003851, " for", false]]]}, "raw_delta": 0.06406629085540771, "tuned_delta": 0.07140342936911045}, {"byte_start": 3537, "byte_end": 3541, "display": {"text": "HMMs", "kind": "normal"}, "is_word": true, "word_id": 598, "word_key": "hmms", "bytes_hex": "48 4d 4d 73", "compression": {"rwkv": "2.73% 2.73% 0.77% 0.77%", "qwen": "6.68% 0.03% 0.03% 2.60%"}, "model_tokens": {"rwkv": [[1082, "HM", "normal", 0.7383397817611694], [1261, "Ms", "normal", 0.9185234308242798]], "qwen": [[39, "H", "normal", 0.6906211972236633], [8035, "MM", "normal", 0.9962831139564514], [82, "s", "normal", 0.8658856153488159]]}, "loss": {"rwkv": 1.7478940772488964, "qwen": 2.334867245282211}, "topk": {"rwkv": [1082, 1, 0.7383397817611694, [[1082, 0.73834, "HM", false], [36003, 0.023064, "which", false], [98, 0.021445, "a", false], [7005, 0.019508, "and", false], [2101, 0.014814, "or", false], [8695, 0.012056, "see", false], [8801, 0.009963, "the", false], [1926, 0.008514, "hm", false], [27142, 0.007538, "that", false], [1746, 0.00457, "an", false]]], "qwen": [39, 1, 0.6906211972236633, [[39, 0.690621, "H", false], [8206, 0.047421, "which", false], [437, 0.039519, "and", false], [64, 0.024801, "a", false], [269, 0.016491, "or", false], [1782, 0.01081, "the", false], [258, 0.009388, "in", false], [71, 0.008746, "h", false], [300, 0.006994, "as", false], [4197, 0.006513, "with", false]]]}, "raw_delta": -0.03254870371893048, "tuned_delta": -0.025211565205227746}, {"byte_start": 3541, "byte_end": 3543, "display": {"text": ").", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "29 2e", "compression": {"rwkv": "8.35% 8.35%", "qwen": "9.13% 9.13%"}, "model_tokens": {"rwkv": [[499, ").", "normal", 0.40225595235824585]], "qwen": [[568, ").", "normal", 0.3631744682788849]]}, "loss": {"rwkv": 8.34762511451866, "qwen": 9.132908647273922}, "topk": {"rwkv": [499, 1, 0.40225595235824585, [[499, 0.402256, ").", false], [42, 0.346846, ")", false], [497, 0.22338, "),", false], [5308, 0.009404, ")--", false], [45, 0.007429, ",", false], [502, 0.002648, ");", false], [60, 0.001694, ";", false], [21700, 0.001291, " for", false], [5346, 0.000594, "---", false], [501, 0.000583, "):", false]]], "qwen": [568, 2, 0.3631744682788849, [[8, 0.385691, ")", false], [568, 0.363174, ").", false], [701, 0.229154, "),", false], [11, 0.006967, ",", false], [3593, 0.002974, ").\n\n", false], [1215, 0.002065, ");", false], [29621, 0.001574, ")--", false], [26, 0.001246, ";", false], [323, 0.001242, " and", false], [4421, 0.000941, "---", false]]]}, "raw_delta": -0.04354536533355713, "tuned_delta": -0.03620822681985439}, {"byte_start": 3543, "byte_end": 3549, "display": {"text": " Again", "kind": "normal"}, "is_word": true, "word_id": 599, "word_key": " again", "bytes_hex": "20 41 67 61 69 6e", "compression": {"rwkv": "16.91% 16.91% 16.91% 16.91% 16.91% 16.91%", "qwen": "15.64% 15.64% 15.64% 15.64% 15.64% 15.64%"}, "model_tokens": {"rwkv": [[36251, " Again", "normal", 0.003622871357947588]], "qwen": [[13759, " Again", "normal", 0.005494527984410524]]}, "loss": {"rwkv": 16.90658251041754, "qwen": 15.641225889449453}, "topk": {"rwkv": [36251, 33, 0.003622871357947588, [[20996, 0.332668, " The", false], [37453, 0.084506, " These", false], [3866, 0.082378, " HM", false], [3913, 0.055594, " In", false], [3918, 0.027155, " It", false], [29894, 0.021691, " This", false], [3642, 0.017901, " At", false], [54829, 0.016464, " Although", false], [37451, 0.014719, " There", false], [300, 0.012615, " A", false]]], "qwen": [13759, 31, 0.005494527984410524, [[576, 0.262557, " The", false], [4220, 0.073662, " These", false], [472, 0.071914, " H", false], [758, 0.057428, " In", false], [1096, 0.038843, " This", false], [1084, 0.028376, " It", false], [2411, 0.020486, " At", false], [2619, 0.016192, " There", false], [3197, 0.015853, " When", false], [3216, 0.014445, " By", false]]]}, "raw_delta": 0.070166269938151, "tuned_delta": 0.07750340845185374}, {"byte_start": 3549, "byte_end": 3550, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "2.52%", "qwen": "3.05%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.8688128590583801]], "qwen": [[11, ",", "normal", 0.8445719480514526]]}, "loss": {"rwkv": 2.518376353114279, "qwen": 3.0463466991666914}, "topk": {"rwkv": [45, 1, 0.8688128590583801, [[45, 0.868813, ",", false], [22590, 0.050942, " the", false], [39934, 0.014278, " there", false], [4601, 0.009728, " it", false], [21265, 0.006724, " and", false], [4596, 0.004612, " in", false], [39936, 0.004391, " these", false], [3866, 0.004211, " HM", false], [32234, 0.003468, " this", false], [47202, 0.002786, " search", false]]], "qwen": [11, 1, 0.8445719480514526, [[11, 0.844572, ",", false], [279, 0.053969, " the", false], [1052, 0.015605, " there", false], [432, 0.015465, " it", false], [304, 0.009116, " in", false], [419, 0.005411, " this", false], [1493, 0.005168, " these", false], [323, 0.0044, " and", false], [264, 0.003203, " a", false], [11811, 0.002799, " researchers", false]]]}, "raw_delta": -0.02927689254283905, "tuned_delta": -0.021939754029136314}, {"byte_start": 3550, "byte_end": 3554, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 600, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "3.35% 3.35% 3.35% 3.35%", "qwen": "4.65% 4.65% 4.65% 4.65%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.4818570017814636]], "qwen": [[279, " the", "normal", 0.356892853975296]]}, "loss": {"rwkv": 3.3460944551868046, "qwen": 4.645115963466906}, "topk": {"rwkv": [22590, 1, 0.4818570017814636, [[22590, 0.481857, " the", false], [39934, 0.046257, " there", false], [3866, 0.044986, " HM", false], [38720, 0.038439, " human", false], [4601, 0.037738, " it", false], [39936, 0.036352, " these", false], [32234, 0.019397, " this", false], [4596, 0.018527, " in", false], [63843, 0.017521, " researchers", false], [332, 0.014608, " a", false]]], "qwen": [279, 1, 0.356892853975296, [[279, 0.356893, " the", false], [432, 0.05677, " it", false], [3738, 0.041688, " human", false], [1052, 0.038032, " there", false], [304, 0.035916, " in", false], [472, 0.034717, " H", false], [1493, 0.033768, " these", false], [419, 0.021128, " this", false], [4124, 0.020707, " early", false], [438, 0.017895, " as", false]]]}, "raw_delta": -0.07203304767608643, "tuned_delta": -0.06469590916238369}, {"byte_start": 3554, "byte_end": 3566, "display": {"text": " statistical", "kind": "normal"}, "is_word": true, "word_id": 601, "word_key": " statistical", "bytes_hex": "20 73 74 61 74 69 73 74 69 63 61 6c", "compression": {"rwkv": "5.00% 5.00% 5.00% 5.00% 5.00% 5.00% 5.00% 5.00% 5.00% 5.00% 5.00% 5.00%", "qwen": "4.40% 4.40% 4.40% 4.40% 4.40% 4.40% 4.40% 4.40% 4.40% 4.40% 4.40% 4.40%"}, "model_tokens": {"rwkv": [[63885, " statistical", "normal", 0.0360807366669178]], "qwen": [[28464, " statistical", "normal", 0.05349557474255562]]}, "loss": {"rwkv": 5.001530659331855, "qwen": 4.400454877538232}, "topk": {"rwkv": [63885, 5, 0.0360807366669178, [[3866, 0.176467, " HM", false], [38720, 0.161868, " human", false], [38328, 0.043819, " early", false], [52013, 0.038266, " initial", false], [63885, 0.036081, " statistical", false], [52224, 0.034973, " methods", false], [47798, 0.030421, " winner", false], [47202, 0.024926, " search", false], [63843, 0.022676, " researchers", false], [39116, 0.021246, " newer", false]]], "qwen": [28464, 4, 0.05349557474255562, [[3738, 0.136382, " human", false], [472, 0.068326, " H", false], [4124, 0.056395, " early", false], [28464, 0.053496, " statistical", false], [2856, 0.047444, " initial", false], [5413, 0.042712, " methods", false], [25546, 0.032433, " newer", false], [15271, 0.031915, " latter", false], [13632, 0.028531, " winner", false], [3281, 0.025215, " special", false]]]}, "raw_delta": 0.03333071867624917, "tuned_delta": 0.0406678571899519}, {"byte_start": 3566, "byte_end": 3574, "display": {"text": " methods", "kind": "normal"}, "is_word": true, "word_id": 602, "word_key": " methods", "bytes_hex": "20 6d 65 74 68 6f 64 73", "compression": {"rwkv": "0.69% 0.69% 0.69% 0.69% 0.69% 0.69% 0.69% 0.69%", "qwen": "0.92% 0.92% 0.92% 0.92% 0.92% 0.92% 0.92% 0.92%"}, "model_tokens": {"rwkv": [[52224, " methods", "normal", 0.7370352745056152]], "qwen": [[5413, " methods", "normal", 0.664587140083313]]}, "loss": {"rwkv": 0.6868299144857125, "qwen": 0.9210465029849182}, "topk": {"rwkv": [52224, 1, 0.7370352745056152, [[52224, 0.737035, " methods", false], [55532, 0.064678, " approach", false], [61590, 0.050447, " approaches", false], [46561, 0.034801, " method", false], [3866, 0.014024, " HM", false], [45, 0.013648, ",", false], [46, 0.013308, "-", false], [46587, 0.013301, " models", false], [62633, 0.009662, " techniques", false], [39043, 0.004374, " model", false]]], "qwen": [5413, 1, 0.664587140083313, [[5413, 0.664587, " methods", false], [5486, 0.064661, " approach", false], [19827, 0.043287, " approaches", false], [1714, 0.034178, " method", false], [11, 0.026638, ",", false], [323, 0.014655, " and", false], [472, 0.014598, " H", false], [320, 0.013281, " (", false], [5980, 0.012254, "-based", false], [4119, 0.010203, " models", false]]]}, "raw_delta": -0.01298772543668747, "tuned_delta": -0.005650586922984733}, {"byte_start": 3574, "byte_end": 3578, "display": {"text": " won", "kind": "normal"}, "is_word": true, "word_id": 603, "word_key": " won", "bytes_hex": "20 77 6f 6e", "compression": {"rwkv": "3.61% 3.61% 3.61% 3.61%", "qwen": "8.76% 8.76% 8.76% 8.76%"}, "model_tokens": {"rwkv": [[22777, " won", "normal", 0.4478346109390259]], "qwen": [[2765, " won", "normal", 0.1433647722005844]]}, "loss": {"rwkv": 3.6102598069120786, "qwen": 8.7569921936927}, "topk": {"rwkv": [22777, 1, 0.4478346109390259, [[22777, 0.447835, " won", false], [32462, 0.152142, " were", false], [46936, 0.05452, " proved", false], [45, 0.035339, ",", false], [61959, 0.03008, " eventually", false], [21795, 0.018855, " had", false], [60244, 0.018358, " prevailed", false], [21532, 0.012738, " did", false], [30256, 0.01257, " beat", false], [47211, 0.012053, " seemed", false]]], "qwen": [2765, 1, 0.1433647722005844, [[2765, 0.143365, " won", false], [1033, 0.120753, " were", false], [18651, 0.109853, " proved", false], [11, 0.049774, ",", false], [29701, 0.047198, " dominated", false], [9583, 0.046813, " eventually", false], [13653, 0.027808, " ultimately", false], [9382, 0.026061, " beat", false], [3118, 0.025765, " based", false], [1521, 0.018119, " did", false]]]}, "raw_delta": -0.28539544343948364, "tuned_delta": -0.27805830492578093}, {"byte_start": 3578, "byte_end": 3582, "display": {"text": " out", "kind": "normal"}, "is_word": true, "word_id": 604, "word_key": " out", "bytes_hex": "20 6f 75 74", "compression": {"rwkv": "10.28% 10.28% 10.28% 10.28%", "qwen": "13.68% 13.68% 13.68% 13.68%"}, "model_tokens": {"rwkv": [[22249, " out", "normal", 0.10188664495944977]], "qwen": [[700, " out", "normal", 0.048153363168239594]]}, "loss": {"rwkv": 10.284837693837336, "qwen": 13.675686334344915}, "topk": {"rwkv": [22249, 4, 0.10188664495944977, [[45, 0.25158, ",", false], [47, 0.207819, ".", false], [22590, 0.130728, " the", false], [22249, 0.101887, " out", false], [4450, 0.05439, " by", false], [4596, 0.045629, " in", false], [5346, 0.026396, "---", false], [21265, 0.024958, " and", false], [32234, 0.011585, " this", false], [21357, 0.008733, " big", false]]], "qwen": [700, 4, 0.048153363168239594, [[11, 0.257229, ",", false], [13, 0.197844, ".", false], [279, 0.160048, " the", false], [700, 0.048153, " out", false], [323, 0.043212, " and", false], [304, 0.038485, " in", false], [553, 0.02944, " by", false], [382, 0.023635, ".\n\n", false], [4421, 0.02173, "---", false], [419, 0.013421, " this", false]]]}, "raw_delta": -0.18802857398986816, "tuned_delta": -0.18069143547616542}, {"byte_start": 3582, "byte_end": 3587, "display": {"text": " over", "kind": "normal"}, "is_word": true, "word_id": 605, "word_key": " over", "bytes_hex": "20 6f 76 65 72", "compression": {"rwkv": "12.79% 12.79% 12.79% 12.79% 12.79%", "qwen": "13.65% 13.65% 13.65% 13.65% 13.65%"}, "model_tokens": {"rwkv": [[31601, " over", "normal", 0.02874206006526947]], "qwen": [[916, " over", "normal", 0.022708440199494362]]}, "loss": {"rwkv": 12.792647432882603, "qwen": 13.651568347301168}, "topk": {"rwkv": [31601, 6, 0.02874206006526947, [[45, 0.314263, ",", false], [47, 0.247405, ".", false], [4596, 0.139049, " in", false], [21265, 0.054942, " and", false], [4450, 0.029217, " by", false], [31601, 0.028742, " over", false], [61959, 0.025724, " eventually", false], [5346, 0.018976, "---", false], [51018, 0.009563, " because", false], [32465, 0.008537, " when", false]]], "qwen": [916, 6, 0.022708440199494362, [[11, 0.350947, ",", false], [13, 0.276182, ".", false], [304, 0.087414, " in", false], [323, 0.057563, " and", false], [382, 0.034446, ".\n\n", false], [916, 0.022708, " over", false], [4421, 0.021969, "---", false], [33022, 0.014341, " decis", false], [553, 0.013826, " by", false], [320, 0.01148, " (", false]]]}, "raw_delta": -0.047628688812255904, "tuned_delta": -0.040291550298553164}, {"byte_start": 3587, "byte_end": 3591, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 606, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "1.84% 1.84% 1.84% 1.84%", "qwen": "1.04% 1.04% 1.04% 1.04%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.6652633547782898]], "qwen": [[279, " the", "normal", 0.7941256165504456]]}, "loss": {"rwkv": 1.8403519503527423, "qwen": 1.0392525974289544}, "topk": {"rwkv": [22590, 1, 0.6652633547782898, [[22590, 0.665263, " the", false], [32251, 0.118401, " time", false], [332, 0.032858, " a", false], [52224, 0.030236, " methods", false], [38720, 0.02103, " human", false], [39944, 0.0206, " those", false], [31370, 0.01212, " many", false], [31323, 0.010386, " long", false], [3866, 0.003985, " HM", false], [31458, 0.003871, " more", false]]], "qwen": [279, 1, 0.7941256165504456, [[279, 0.794126, " the", false], [678, 0.024315, " all", false], [882, 0.023916, " time", false], [264, 0.023365, " a", false], [3738, 0.019839, " human", false], [3281, 0.012307, " special", false], [1657, 0.00971, " many", false], [1846, 0.008672, " those", false], [5413, 0.006965, " methods", false], [803, 0.005373, " more", false]]]}, "raw_delta": 0.04442238062620163, "tuned_delta": 0.05175951913990437}, {"byte_start": 3591, "byte_end": 3597, "display": {"text": " human", "kind": "normal"}, "is_word": true, "word_id": 607, "word_key": " human", "bytes_hex": "20 68 75 6d 61 6e", "compression": {"rwkv": "2.57% 2.57% 2.57% 2.57% 2.57% 2.57%", "qwen": "4.50% 4.50% 4.50% 4.50% 4.50% 4.50%"}, "model_tokens": {"rwkv": [[38720, " human", "normal", 0.42568930983543396]], "qwen": [[3738, " human", "normal", 0.22361716628074646]]}, "loss": {"rwkv": 2.571209423459334, "qwen": 4.501869105482948}, "topk": {"rwkv": [38720, 1, 0.42568930983543396, [[38720, 0.425689, " human", false], [52224, 0.114839, " methods", false], [31458, 0.066146, " more", false], [52964, 0.0334, " special", false], [63875, 0.027954, " specialized", false], [59943, 0.021395, " knowledge", false], [31580, 0.018533, " ones", false], [47202, 0.01766, " search", false], [3866, 0.015203, " HM", false], [39174, 0.012063, " older", false]]], "qwen": [3738, 2, 0.22361716628074646, [[3281, 0.358286, " special", false], [3738, 0.223617, " human", false], [5413, 0.075183, " methods", false], [6540, 0.072806, " knowledge", false], [803, 0.040975, " more", false], [3800, 0.022162, " others", false], [27076, 0.0214, " specialized", false], [6788, 0.014749, " earlier", false], [1008, 0.01418, " other", false], [4124, 0.010068, " early", false]]]}, "raw_delta": -0.10705850521723427, "tuned_delta": -0.09972136670353153}, {"byte_start": 3597, "byte_end": 3607, "display": {"text": "-knowledge", "kind": "normal"}, "is_word": true, "word_id": 608, "word_key": "-knowledge", "bytes_hex": "2d 6b 6e 6f 77 6c 65 64 67 65", "compression": {"rwkv": "4.72% 0.10% 0.10% 0.10% 0.10% 0.10% 0.10% 0.10% 0.10% 0.10%", "qwen": "2.63% 2.63% 0.00% 0.00% 0.00% 0.00% 0.00% 0.00% 0.00% 0.00%"}, "model_tokens": {"rwkv": [[46, "-", "normal", 0.7706761360168457], [58313, "knowledge", "normal", 0.9511051774024963]], "qwen": [[12646, "-k", "normal", 0.7466897964477539], [51186, "nowledge", "normal", 0.998958945274353]]}, "loss": {"rwkv": 0.5622319235886251, "qwen": 0.5286522461362759}, "topk": {"rwkv": [46, 1, 0.7706761360168457, [[46, 0.770676, "-", false], [59943, 0.14104, " knowledge", false], [52224, 0.050024, " methods", false], [61590, 0.005555, " approaches", false], [34864, 0.005049, "istic", false], [7919, 0.002393, "ist", false], [46561, 0.001773, " method", false], [65034, 0.00171, " understanding", false], [56529, 0.001659, " language", false], [46587, 0.001259, " models", false]]], "qwen": [12646, 1, 0.7466897964477539, [[12646, 0.74669, "-k", false], [6540, 0.156835, " knowledge", false], [12, 0.014235, "-", false], [5980, 0.012712, "-based", false], [8660, 0.010945, " understanding", false], [71107, 0.010203, "-under", false], [5413, 0.004288, " methods", false], [35085, 0.002812, "-oriented", false], [50297, 0.002317, "-method", false], [3419, 0.00195, "-in", false]]]}, "raw_delta": 0.001862052700016649, "tuned_delta": 0.009199191213719385}, {"byte_start": 3607, "byte_end": 3613, "display": {"text": "-based", "kind": "normal"}, "is_word": true, "word_id": 609, "word_key": "-based", "bytes_hex": "2d 62 61 73 65 64", "compression": {"rwkv": "30.71% 0.43% 0.43% 0.43% 0.43% 0.43%", "qwen": "3.14% 3.14% 3.14% 3.14% 3.14% 3.14%"}, "model_tokens": {"rwkv": [[46, "-", "normal", 0.18402493000030518], [34011, "based", "normal", 0.8871493935585022]], "qwen": [[5980, "-based", "normal", 0.35163143277168274]]}, "loss": {"rwkv": 5.479963463012072, "qwen": 3.141383505864803}, "topk": {"rwkv": [46, 2, 0.18402493000030518, [[52224, 0.674843, " methods", false], [46, 0.184025, "-", false], [61590, 0.07031, " approaches", false], [37810, 0.019254, " based", false], [55532, 0.009998, " approach", false], [31580, 0.009678, " ones", false], [46561, 0.003909, " method", false], [45, 0.003035, ",", false], [62633, 0.001727, " techniques", false], [46587, 0.001712, " models", false]]], "qwen": [5980, 2, 0.35163143277168274, [[5413, 0.454863, " methods", false], [5980, 0.351631, "-based", false], [19827, 0.061546, " approaches", false], [3118, 0.04312, " based", false], [6174, 0.026549, " ones", false], [5486, 0.006416, " approach", false], [31405, 0.005861, "-driven", false], [12538, 0.002516, " techniques", false], [2331, 0.002066, " base", false], [35085, 0.002062, "-oriented", false]]]}, "raw_delta": 0.12967840830485022, "tuned_delta": 0.13701554681855296}, {"byte_start": 3613, "byte_end": 3621, "display": {"text": " methods", "kind": "normal"}, "is_word": true, "word_id": 610, "word_key": " methods", "bytes_hex": "20 6d 65 74 68 6f 64 73", "compression": {"rwkv": "0.63% 0.63% 0.63% 0.63% 0.63% 0.63% 0.63% 0.63%", "qwen": "0.44% 0.44% 0.44% 0.44% 0.44% 0.44% 0.44% 0.44%"}, "model_tokens": {"rwkv": [[52224, " methods", "normal", 0.7575957179069519]], "qwen": [[5413, " methods", "normal", 0.8244560956954956]]}, "loss": {"rwkv": 0.6251913324164818, "qwen": 0.4351335400805226}, "topk": {"rwkv": [52224, 1, 0.7575957179069519, [[52224, 0.757596, " methods", false], [61590, 0.093073, " approaches", false], [31580, 0.088058, " ones", false], [55532, 0.010249, " approach", false], [45, 0.0048, ",", false], [51566, 0.004354, " efforts", false], [63363, 0.003156, " competitors", false], [46561, 0.003021, " method", false], [47, 0.002962, ".", false], [62633, 0.002343, " techniques", false]]], "qwen": [5413, 1, 0.8244560956954956, [[5413, 0.824456, " methods", false], [19827, 0.067382, " approaches", false], [6174, 0.052365, " ones", false], [5942, 0.006073, " systems", false], [5486, 0.005619, " approach", false], [8869, 0.00496, " efforts", false], [12538, 0.003728, " techniques", false], [3281, 0.003131, " special", false], [1714, 0.002541, " method", false], [11, 0.002202, ",", false]]]}, "raw_delta": 0.010539041832089424, "tuned_delta": 0.01787618034579216}, {"byte_start": 3621, "byte_end": 3622, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "14.23%", "qwen": "17.17%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.45019814372062683]], "qwen": [[13, ".", "normal", 0.38593173027038574]]}, "loss": {"rwkv": 14.229706946268095, "qwen": 17.169780459731708}, "topk": {"rwkv": [47, 1, 0.45019814372062683, [[47, 0.450198, ".", false], [45, 0.313204, ",", false], [4596, 0.061323, " in", false], [21265, 0.040128, " and", false], [4450, 0.025523, " by", false], [5346, 0.013629, "---", false], [275, 0.011248, " (", false], [51018, 0.008309, " because", false], [32227, 0.007864, " that", false], [37634, 0.004738, " after", false]]], "qwen": [13, 1, 0.38593173027038574, [[13, 0.385932, ".", false], [11, 0.298631, ",", false], [382, 0.07573, ".\n\n", false], [304, 0.050795, " in", false], [323, 0.034481, " and", false], [553, 0.020631, " by", false], [4421, 0.019415, "---", false], [320, 0.015519, " (", false], [26, 0.007749, ";", false], [518, 0.005623, " at", false]]]}, "raw_delta": -0.16303229331970215, "tuned_delta": -0.1556951548059994}, {"byte_start": 3622, "byte_end": 3627, "display": {"text": " This", "kind": "normal"}, "is_word": true, "word_id": 611, "word_key": " this", "bytes_hex": "20 54 68 69 73", "compression": {"rwkv": "9.97% 9.97% 9.97% 9.97% 9.97%", "qwen": "8.12% 8.12% 8.12% 8.12% 8.12%"}, "model_tokens": {"rwkv": [[29894, " This", "normal", 0.06181350722908974]], "qwen": [[1096, " This", "normal", 0.10536638647317886]]}, "loss": {"rwkv": 9.974883681146347, "qwen": 8.116282651710552}, "topk": {"rwkv": [29894, 4, 0.06181350722908974, [[261, 0.19928, "\n\n", false], [20996, 0.134942, " The", false], [3913, 0.068706, " In", false], [29894, 0.061814, " This", false], [19555, 0.031297, " But", false], [3918, 0.030459, " It", false], [19417, 0.023346, " And", false], [267, 0.02152, "  ", false], [300, 0.01969, " A", false], [37451, 0.018511, " There", false]]], "qwen": [1096, 2, 0.10536638647317886, [[576, 0.147242, " The", false], [1096, 0.105366, " This", false], [758, 0.077956, " In", false], [1084, 0.038441, " It", false], [2619, 0.034625, " There", false], [362, 0.023556, " A", false], [220, 0.023178, " ", false], [65694, 0.022903, " Statistical", false], [472, 0.021494, " H", false], [4220, 0.019384, " These", false]]]}, "raw_delta": 0.10306272506713865, "tuned_delta": 0.11039986358084139}, {"byte_start": 3627, "byte_end": 3631, "display": {"text": " led", "kind": "normal"}, "is_word": true, "word_id": 612, "word_key": " led", "bytes_hex": "20 6c 65 64", "compression": {"rwkv": "22.26% 22.26% 22.26% 22.26%", "qwen": "20.00% 20.00% 20.00% 20.00%"}, "model_tokens": {"rwkv": [[21994, " led", "normal", 0.007286480627954006]], "qwen": [[6069, " led", "normal", 0.01184548158198595]]}, "loss": {"rwkv": 22.260333638716425, "qwen": 19.99849735654479}, "topk": {"rwkv": [21994, 10, 0.007286480627954006, [[22748, 0.333104, " was", false], [32251, 0.12415, " time", false], [4600, 0.087577, " is", false], [63361, 0.066463, " competition", false], [52427, 0.046169, " pattern", false], [56348, 0.012124, " happened", false], [38328, 0.010554, " early", false], [22074, 0.008978, " may", false], [53283, 0.008389, " victory", false], [21994, 0.007286, " led", false]]], "qwen": [6069, 8, 0.01184548158198595, [[572, 0.290054, " was", false], [374, 0.138482, " is", false], [5383, 0.073053, " pattern", false], [882, 0.046901, " time", false], [9149, 0.018298, " trend", false], [10707, 0.012723, " competition", false], [6932, 0.011943, " happened", false], [6069, 0.011845, " led", false], [12560, 0.010531, " victory", false], [4124, 0.010371, " early", false]]]}, "raw_delta": 0.12542283535003662, "tuned_delta": 0.13275997386373936}, {"byte_start": 3631, "byte_end": 3634, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 613, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "2.10% 2.10% 2.10%", "qwen": "1.64% 1.64% 1.64%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.7004135847091675]], "qwen": [[311, " to", "normal", 0.7614275813102722]]}, "loss": {"rwkv": 2.101582131503291, "qwen": 1.638421924665474}, "topk": {"rwkv": [4811, 1, 0.7004135847091675, [[4811, 0.700414, " to", false], [32074, 0.053727, " some", false], [31370, 0.04605, " many", false], [22590, 0.043138, " the", false], [63843, 0.021715, " researchers", false], [332, 0.018023, " a", false], [46787, 0.011171, " people", false], [22226, 0.010695, " one", false], [19678, 0.009744, " DAR", false], [45, 0.007678, ",", false]]], "qwen": [311, 1, 0.7614275813102722, [[311, 0.761428, " to", false], [1045, 0.048317, " some", false], [1657, 0.041988, " many", false], [279, 0.02385, " the", false], [264, 0.018831, " a", false], [11811, 0.016607, " researchers", false], [11, 0.008645, ",", false], [825, 0.007132, " one", false], [304, 0.005231, " in", false], [1251, 0.003191, " people", false]]]}, "raw_delta": 0.02568305532137552, "tuned_delta": 0.03302019383507826}, {"byte_start": 3634, "byte_end": 3636, "display": {"text": " a", "kind": "normal"}, "is_word": true, "word_id": 614, "word_key": " a", "bytes_hex": "20 61", "compression": {"rwkv": "10.21% 10.21%", "qwen": "8.44% 8.44%"}, "model_tokens": {"rwkv": [[332, " a", "normal", 0.32252037525177]], "qwen": [[264, " a", "normal", 0.3922613263130188]]}, "loss": {"rwkv": 10.214393600043929, "qwen": 8.438206226944965}, "topk": {"rwkv": [332, 1, 0.32252037525177, [[332, 0.32252, " a", false], [22590, 0.251223, " the", false], [4419, 0.047326, " an", false], [31466, 0.028287, " much", false], [32074, 0.025382, " some", false], [31370, 0.018584, " many", false], [51816, 0.014073, " further", false], [50919, 0.0129, " another", false], [31458, 0.009086, " more", false], [65126, 0.007995, " disappointment", false]]], "qwen": [264, 1, 0.3922613263130188, [[264, 0.392261, " a", false], [279, 0.185976, " the", false], [458, 0.075346, " an", false], [1657, 0.02746, " many", false], [1045, 0.025467, " some", false], [1753, 0.018786, " much", false], [2441, 0.014868, " another", false], [4623, 0.009604, " further", false], [1128, 0.007172, " what", false], [803, 0.005978, " more", false]]]}, "raw_delta": 0.09849274158477783, "tuned_delta": 0.10582988009848057}, {"byte_start": 3636, "byte_end": 3642, "display": {"text": " major", "kind": "normal"}, "is_word": true, "word_id": 615, "word_key": " major", "bytes_hex": "20 6d 61 6a 6f 72", "compression": {"rwkv": "12.30% 12.30% 12.30% 12.30% 12.30% 12.30%", "qwen": "12.44% 12.44% 12.44% 12.44% 12.44% 12.44%"}, "model_tokens": {"rwkv": [[38961, " major", "normal", 0.01673424057662487]], "qwen": [[3598, " major", "normal", 0.015963859856128693]]}, "loss": {"rwkv": 12.30423504924832, "qwen": 12.43551513940693}, "topk": {"rwkv": [38961, 12, 0.01673424057662487, [[31323, 0.058031, " long", false], [46790, 0.057754, " period", false], [45315, 0.031353, " bitter", false], [39664, 0.022748, " shift", false], [45674, 0.020854, " decade", false], [55591, 0.020549, " backlash", false], [38629, 0.020227, " great", false], [45450, 0.02011, " change", false], [51816, 0.019981, " further", false], [22168, 0.018154, " new", false]]], "qwen": [3598, 10, 0.015963859856128693, [[1293, 0.075389, " long", false], [25180, 0.037527, " bitter", false], [4168, 0.029762, " period", false], [4586, 0.023005, " general", false], [2696, 0.019431, " lot", false], [501, 0.019248, " new", false], [2244, 0.017001, " great", false], [3460, 0.016283, " large", false], [1372, 0.016052, " number", false], [3598, 0.015964, " major", false]]]}, "raw_delta": -0.007279713948567745, "tuned_delta": 5.742456513499125e-05}, {"byte_start": 3642, "byte_end": 3649, "display": {"text": " change", "kind": "normal"}, "is_word": true, "word_id": 616, "word_key": " change", "bytes_hex": "20 63 68 61 6e 67 65", "compression": {"rwkv": "4.95% 4.95% 4.95% 4.95% 4.95% 4.95% 4.95%", "qwen": "6.66% 6.66% 6.66% 6.66% 6.66% 6.66% 6.66%"}, "model_tokens": {"rwkv": [[45450, " change", "normal", 0.1471361517906189]], "qwen": [[2297, " change", "normal", 0.07551056891679764]]}, "loss": {"rwkv": 4.951213449479423, "qwen": 6.6556739224766694}, "topk": {"rwkv": [45450, 2, 0.1471361517906189, [[39664, 0.186555, " shift", false], [45450, 0.147136, " change", false], [4757, 0.043828, " re", false], [56810, 0.03804, " paradigm", false], [57103, 0.036608, " research", false], [45829, 0.033344, " effort", false], [22378, 0.029203, " ret", false], [57138, 0.018445, " revision", false], [31872, 0.0159, " retr", false], [45, 0.010901, ",", false]]], "qwen": [2297, 2, 0.07551056891679764, [[6407, 0.115522, " shift", false], [2297, 0.075511, " change", false], [48240, 0.05293, " paradigm", false], [312, 0.050844, " re", false], [11004, 0.035189, " debate", false], [3412, 0.020011, " research", false], [47056, 0.018988, " backlash", false], [40598, 0.018954, " disappointment", false], [25573, 0.018221, " controversy", false], [5041, 0.011259, " effort", false]]]}, "raw_delta": -0.094515357698713, "tuned_delta": -0.08717821918501026}, {"byte_start": 3649, "byte_end": 3652, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 617, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "0.62% 0.62% 0.62%", "qwen": "0.75% 0.75% 0.75%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.9015942811965942]], "qwen": [[304, " in", "normal", 0.882537305355072]]}, "loss": {"rwkv": 0.6163858206923061, "qwen": 0.7511284501011392}, "topk": {"rwkv": [4596, 1, 0.9015942811965942, [[4596, 0.901594, " in", false], [4706, 0.04797, " of", false], [45, 0.01582, ",", false], [59, 0.006379, ":", false], [47, 0.004074, ".", false], [4811, 0.00191, " to", false], [30917, 0.001698, " from", false], [4424, 0.001578, " at", false], [32227, 0.001508, " that", false], [37694, 0.001328, " among", false]]], "qwen": [304, 1, 0.882537305355072, [[304, 0.882537, " in", false], [315, 0.081219, " of", false], [11, 0.007828, ",", false], [504, 0.00465, " from", false], [25, 0.002838, ":", false], [4421, 0.002085, "---", false], [311, 0.001744, " to", false], [916, 0.001621, " over", false], [429, 0.001302, " that", false], [369, 0.001157, " for", false]]]}, "raw_delta": -0.007471717894077301, "tuned_delta": -0.00013457938037456443}, {"byte_start": 3652, "byte_end": 3656, "display": {"text": " all", "kind": "normal"}, "is_word": true, "word_id": 618, "word_key": " all", "bytes_hex": "20 61 6c 6c", "compression": {"rwkv": "35.36% 35.36% 35.36% 35.36%", "qwen": "32.00% 32.00% 32.00% 32.00%"}, "model_tokens": {"rwkv": [[21256, " all", "normal", 0.00039231861592270434]], "qwen": [[678, " all", "normal", 0.0008276173612102866]]}, "loss": {"rwkv": 35.362935084290015, "qwen": 31.99608877249348}, "topk": {"rwkv": [21256, 88, 0.00039231861592270434, [[22590, 0.446433, " the", false], [57103, 0.072957, " research", false], [47350, 0.072481, " speech", false], [3609, 0.06861, " AI", false], [59526, 0.061201, " direction", false], [56103, 0.03624, " emphasis", false], [38530, 0.023152, " focus", false], [57419, 0.014304, " thinking", false], [21835, 0.012684, " how", false], [55574, 0.009881, " attitude", false]]], "qwen": [678, 54, 0.0008276173612102866, [[279, 0.515891, " the", false], [3412, 0.07072, " research", false], [8806, 0.070528, " speech", false], [1246, 0.067919, " how", false], [15235, 0.028624, " AI", false], [7274, 0.019499, " thinking", false], [5244, 0.016435, " focus", false], [24654, 0.012447, " emphasis", false], [5106, 0.011719, " direction", false], [6366, 0.011553, " computer", false]]]}, "raw_delta": 0.1866976022720337, "tuned_delta": 0.19403474078573643}, {"byte_start": 3656, "byte_end": 3659, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 619, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "12.49% 12.49% 12.49%", "qwen": "13.25% 13.25% 13.25%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.12452349066734314]], "qwen": [[315, " of", "normal", 0.11038658767938614]]}, "loss": {"rwkv": 12.492085966030738, "qwen": 13.247346344106003}, "topk": {"rwkv": [4706, 2, 0.12452349066734314, [[47350, 0.427561, " speech", false], [4706, 0.124523, " of", false], [22590, 0.071701, " the", false], [3609, 0.070759, " AI", false], [62597, 0.053462, " subsequent", false], [57103, 0.042275, " research", false], [37738, 0.027115, " areas", false], [50964, 0.017114, " aspects", false], [46064, 0.015662, " future", false], [55809, 0.008446, " computer", false]]], "qwen": [315, 3, 0.11038658767938614, [[8806, 0.358103, " speech", false], [17420, 0.151202, " subsequent", false], [315, 0.110387, " of", false], [279, 0.08224, " the", false], [3412, 0.050408, " research", false], [15235, 0.029133, " AI", false], [5671, 0.024269, " areas", false], [3853, 0.014411, " future", false], [19827, 0.012652, " approaches", false], [13566, 0.011898, " aspects", false]]]}, "raw_delta": -0.04188052813212073, "tuned_delta": -0.03454338961841799}, {"byte_start": 3659, "byte_end": 3667, "display": {"text": " natural", "kind": "normal"}, "is_word": true, "word_id": 620, "word_key": " natural", "bytes_hex": "20 6e 61 74 75 72 61 6c", "compression": {"rwkv": "14.37% 14.37% 14.37% 14.37% 14.37% 14.37% 14.37% 14.37%", "qwen": "10.22% 10.22% 10.22% 10.22% 10.22% 10.22% 10.22% 10.22%"}, "model_tokens": {"rwkv": [[52299, " natural", "normal", 0.0017308343667536974]], "qwen": [[5810, " natural", "normal", 0.010747061111032963]]}, "loss": {"rwkv": 14.370595133854907, "qwen": 10.218615774122611}, "topk": {"rwkv": [52299, 14, 0.0017308343667536974, [[47350, 0.751391, " speech", false], [3609, 0.077539, " AI", false], [22590, 0.062142, " the", false], [55809, 0.02974, " computer", false], [57103, 0.011595, " research", false], [19678, 0.008637, " DAR", false], [64862, 0.005269, " computational", false], [52167, 0.002919, " machine", false], [62182, 0.002388, " linguistic", false], [47368, 0.001867, " spoken", false]]], "qwen": [5810, 6, 0.010747061111032963, [[8806, 0.68847, " speech", false], [279, 0.089251, " the", false], [15235, 0.083967, " AI", false], [6366, 0.029443, " computer", false], [451, 0.013061, " N", false], [5810, 0.010747, " natural", false], [5662, 0.006164, " machine", false], [3412, 0.006111, " research", false], [3738, 0.005999, " human", false], [4128, 0.004576, " language", false]]]}, "raw_delta": 0.23023462295532227, "tuned_delta": 0.237571761469025}, {"byte_start": 3667, "byte_end": 3676, "display": {"text": " language", "kind": "normal"}, "is_word": true, "word_id": 621, "word_key": " language", "bytes_hex": "20 6c 61 6e 67 75 61 67 65", "compression": {"rwkv": "0.42% 0.42% 0.42% 0.42% 0.42% 0.42% 0.42% 0.42% 0.42%", "qwen": "0.89% 0.89% 0.89% 0.89% 0.89% 0.89% 0.89% 0.89% 0.89%"}, "model_tokens": {"rwkv": [[56529, " language", "normal", 0.8103179931640625]], "qwen": [[4128, " language", "normal", 0.6401944160461426]]}, "loss": {"rwkv": 0.42266456276043846, "qwen": 0.8936361857707253}, "topk": {"rwkv": [56529, 1, 0.8103179931640625, [[56529, 0.810318, " language", false], [46, 0.182737, "-", false], [59946, 0.002568, " languages", false], [47350, 0.002081, " speech", false], [21265, 0.000325, " and", false], [34864, 0.000208, "istic", false], [275, 0.000156, " (", false], [52814, 0.000133, " science", false], [48, 0.000106, "/", false], [57167, 9e-05, " sciences", false]]], "qwen": [4128, 1, 0.6401944160461426, [[4128, 0.640194, " language", false], [43558, 0.341647, "-language", false], [8806, 0.003305, " speech", false], [1331, 0.002551, "-s", false], [11476, 0.001883, "-com", false], [323, 0.001119, " and", false], [15459, 0.001004, " languages", false], [12, 0.000899, "-", false], [8038, 0.000572, " science", false], [24231, 0.000527, " computing", false]]]}, "raw_delta": -0.02611621220906576, "tuned_delta": -0.018779073695363024}, {"byte_start": 3676, "byte_end": 3687, "display": {"text": " processing", "kind": "normal"}, "is_word": true, "word_id": 622, "word_key": " processing", "bytes_hex": "20 70 72 6f 63 65 73 73 69 6e 67", "compression": {"rwkv": "0.13% 0.13% 0.13% 0.13% 0.13% 0.13% 0.13% 0.13% 0.13% 0.13% 0.13%", "qwen": "0.16% 0.16% 0.16% 0.16% 0.16% 0.16% 0.16% 0.16% 0.16% 0.16% 0.16%"}, "model_tokens": {"rwkv": [[62378, " processing", "normal", 0.9209213256835938]], "qwen": [[8692, " processing", "normal", 0.9070752859115601]]}, "loss": {"rwkv": 0.13448417906013957, "qwen": 0.15989290567035236}, "topk": {"rwkv": [62378, 1, 0.9209213256835938, [[62378, 0.920921, " processing", false], [57103, 0.040272, " research", false], [65034, 0.018016, " understanding", false], [45, 0.002965, ",", false], [21265, 0.00207, " and", false], [46, 0.001574, "-", false], [63821, 0.001511, " recognition", false], [275, 0.001287, " (", false], [47, 0.001233, ".", false], [62634, 0.000768, " technology", false]]], "qwen": [8692, 1, 0.9070752859115601, [[8692, 0.907075, " processing", false], [3412, 0.032684, " research", false], [8660, 0.014011, " understanding", false], [69193, 0.007294, "-processing", false], [323, 0.005977, " and", false], [8806, 0.003086, " speech", false], [320, 0.002747, " (", false], [15235, 0.002486, " AI", false], [11, 0.002392, ",", false], [24231, 0.001239, " computing", false]]]}, "raw_delta": -0.0014089589769190006, "tuned_delta": 0.005928179536783736}, {"byte_start": 3687, "byte_end": 3688, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "21.84%", "qwen": "22.27%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.296637624502182]], "qwen": [[11, ",", "normal", 0.29089972376823425]]}, "loss": {"rwkv": 21.837669075955986, "qwen": 22.26757840788402}, "topk": {"rwkv": [45, 1, 0.296637624502182, [[45, 0.296638, ",", false], [275, 0.242434, " (", false], [47, 0.148456, ".", false], [57103, 0.094094, " research", false], [59, 0.045315, ":", false], [5346, 0.040139, "---", false], [21265, 0.038469, " and", false], [4596, 0.017757, " in", false], [32227, 0.010802, " that", false], [60, 0.005535, ";", false]]], "qwen": [11, 1, 0.29089972376823425, [[11, 0.2909, ",", false], [320, 0.28355, " (", false], [13, 0.098036, ".", false], [3412, 0.078873, " research", false], [323, 0.062554, " and", false], [4421, 0.032666, "---", false], [25, 0.021578, ":", false], [304, 0.018883, " in", false], [382, 0.015774, ".\n\n", false], [369, 0.014402, " for", false]]]}, "raw_delta": -0.023839235305786133, "tuned_delta": -0.016502096792083396}, {"byte_start": 3688, "byte_end": 3698, "display": {"text": " gradually", "kind": "normal"}, "is_word": true, "word_id": 623, "word_key": " gradually", "bytes_hex": "20 67 72 61 64 75 61 6c 6c 79", "compression": {"rwkv": "14.99% 14.99% 14.99% 14.99% 14.99% 14.99% 14.99% 14.99% 14.99% 14.99%", "qwen": "17.05% 17.05% 17.05% 17.05% 17.05% 17.05% 17.05% 17.05% 17.05% 17.05%"}, "model_tokens": {"rwkv": [[59771, " gradually", "normal", 0.0002471302286721766]], "qwen": [[26024, " gradually", "normal", 7.828678644727916e-05]]}, "loss": {"rwkv": 14.990503159236885, "qwen": 17.051089212978507}, "topk": {"rwkv": [59771, 131, 0.0002471302286721766, [[40186, 0.160915, " which", false], [21265, 0.118876, " and", false], [30917, 0.096462, " from", false], [32487, 0.068092, " with", false], [40185, 0.06117, " where", false], [4423, 0.054776, " as", false], [4811, 0.053476, " to", false], [4596, 0.041837, " in", false], [30211, 0.022891, " away", false], [59841, 0.021538, " including", false]]], "qwen": [26024, 308, 7.828678644727916e-05, [[323, 0.155709, " and", false], [892, 0.104721, " which", false], [438, 0.092851, " as", false], [448, 0.086681, " with", false], [2670, 0.081711, " including", false], [1380, 0.071378, " where", false], [304, 0.038294, " in", false], [504, 0.033125, " from", false], [264, 0.019029, " a", false], [1576, 0.013909, " because", false]]]}, "raw_delta": -0.11426315307617188, "tuned_delta": -0.10692601456246914}, {"byte_start": 3698, "byte_end": 3703, "display": {"text": " over", "kind": "normal"}, "is_word": true, "word_id": 624, "word_key": " over", "bytes_hex": "20 6f 76 65 72", "compression": {"rwkv": "17.70% 17.70% 17.70% 17.70% 17.70%", "qwen": "12.23% 12.23% 12.23% 12.23% 12.23%"}, "model_tokens": {"rwkv": [[31601, " over", "normal", 0.007393436972051859]], "qwen": [[916, " over", "normal", 0.0336746983230114]]}, "loss": {"rwkv": 17.69555636090369, "qwen": 12.230478282961545}, "topk": {"rwkv": [31601, 20, 0.007393436972051859, [[60385, 0.163246, " replacing", false], [46612, 0.134314, " moving", false], [57209, 0.129, " shifting", false], [52107, 0.033227, " leading", false], [50834, 0.025755, " abandon", false], [45, 0.02146, ",", false], [55660, 0.021212, " bringing", false], [46500, 0.015996, " making", false], [39856, 0.015836, " suppl", false], [38269, 0.014704, " displ", false]]], "qwen": [916, 7, 0.0336746983230114, [[24891, 0.07919, " replacing", false], [7218, 0.063611, " moving", false], [11, 0.043552, ",", false], [714, 0.037893, " but", false], [6388, 0.037171, " leading", false], [31831, 0.036395, " shifting", false], [916, 0.033675, " over", false], [10018, 0.027561, " changing", false], [3259, 0.023925, " making", false], [2714, 0.02245, " er", false]]]}, "raw_delta": 0.30304827690124503, "tuned_delta": 0.31038541541494774}, {"byte_start": 3703, "byte_end": 3711, "display": {"text": " decades", "kind": "normal"}, "is_word": true, "word_id": 625, "word_key": " decades", "bytes_hex": "20 64 65 63 61 64 65 73", "compression": {"rwkv": "8.74% 8.74% 8.74% 8.74% 8.74% 8.74% 8.74% 8.74%", "qwen": "10.19% 10.19% 10.19% 10.19% 10.19% 10.19% 10.19% 10.19%"}, "model_tokens": {"rwkv": [[51396, " decades", "normal", 0.020421912893652916]], "qwen": [[10793, " decades", "normal", 0.010877071879804134]]}, "loss": {"rwkv": 8.735067630382394, "qwen": 10.191509158563496}, "topk": {"rwkv": [51396, 6, 0.020421912893652916, [[22590, 0.512357, " the", false], [332, 0.168796, " a", false], [32251, 0.092415, " time", false], [31370, 0.06089, " many", false], [52869, 0.042431, " several", false], [51396, 0.020422, " decades", false], [3493, 0.014304, " 20", false], [37598, 0.013776, " about", false], [22638, 0.008066, " two", false], [3483, 0.005897, " 10", false]]], "qwen": [10793, 9, 0.010877071879804134, [[279, 0.336972, " the", false], [264, 0.297456, " a", false], [1657, 0.081974, " many", false], [220, 0.055959, " ", false], [882, 0.054568, " time", false], [3807, 0.053385, " several", false], [458, 0.01625, " an", false], [803, 0.011744, " more", false], [10793, 0.010877, " decades", false], [7009, 0.00856, " nearly", false]]]}, "raw_delta": -0.08076226711273193, "tuned_delta": -0.0734251285990292}, {"byte_start": 3711, "byte_end": 3712, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "13.45%", "qwen": "11.64%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.4762890636920929]], "qwen": [[11, ",", "normal", 0.5245233774185181]]}, "loss": {"rwkv": 13.454821914540624, "qwen": 11.636512765570654}, "topk": {"rwkv": [45, 1, 0.4762890636920929, [[45, 0.476289, ",", false], [47, 0.368633, ".", false], [4706, 0.01905, " of", false], [21265, 0.018091, " and", false], [4423, 0.015984, " as", false], [59, 0.011355, ":", false], [4811, 0.00906, " to", false], [5346, 0.007765, "---", false], [275, 0.007652, " (", false], [21400, 0.007622, " but", false]]], "qwen": [11, 1, 0.5245233774185181, [[11, 0.524523, ",", false], [13, 0.264647, ".", false], [382, 0.065992, ".\n\n", false], [315, 0.032031, " of", false], [323, 0.017668, " and", false], [320, 0.01125, " (", false], [25, 0.009036, ":", false], [4421, 0.008871, "---", false], [438, 0.007894, " as", false], [311, 0.005143, " to", false]]]}, "raw_delta": 0.10082846879959106, "tuned_delta": 0.1081656073132938}, {"byte_start": 3712, "byte_end": 3718, "display": {"text": " where", "kind": "normal"}, "is_word": true, "word_id": 626, "word_key": " where", "bytes_hex": "20 77 68 65 72 65", "compression": {"rwkv": "10.99% 10.99% 10.99% 10.99% 10.99% 10.99%", "qwen": "13.11% 13.11% 13.11% 13.11% 13.11% 13.11%"}, "model_tokens": {"rwkv": [[40185, " where", "normal", 0.025591030716896057]], "qwen": [[1380, " where", "normal", 0.012734335847198963]]}, "loss": {"rwkv": 10.9892786317714, "qwen": 13.114859509013838}, "topk": {"rwkv": [40185, 11, 0.025591030716896057, [[30917, 0.173788, " from", false], [4423, 0.135837, " as", false], [32487, 0.086839, " with", false], [4811, 0.079786, " to", false], [21265, 0.073762, " and", false], [30211, 0.058252, " away", false], [4596, 0.054631, " in", false], [21400, 0.03817, " but", false], [53169, 0.037893, " towards", false], [40186, 0.027583, " which", false]]], "qwen": [1380, 16, 0.012734335847198963, [[438, 0.176274, " as", false], [323, 0.137214, " and", false], [504, 0.105461, " from", false], [311, 0.068331, " to", false], [448, 0.06198, " with", false], [304, 0.041964, " in", false], [3123, 0.027893, " away", false], [714, 0.027693, " but", false], [773, 0.025551, " so", false], [2670, 0.023168, " including", false]]]}, "raw_delta": -0.11786723136901855, "tuned_delta": -0.11053009285531581}, {"byte_start": 3718, "byte_end": 3729, "display": {"text": " statistics", "kind": "normal"}, "is_word": true, "word_id": 627, "word_key": " statistics", "bytes_hex": "20 73 74 61 74 69 73 74 69 63 73", "compression": {"rwkv": "9.84% 9.84% 9.84% 9.84% 9.84% 9.84% 9.84% 9.84% 9.84% 9.84% 9.84%", "qwen": "10.25% 10.25% 10.25% 10.25% 10.25% 10.25% 10.25% 10.25% 10.25% 10.25% 10.25%"}, "model_tokens": {"rwkv": [[62577, " statistics", "normal", 0.002479551825672388]], "qwen": [[13142, " statistics", "normal", 0.0019320999272167683]]}, "loss": {"rwkv": 9.836557096970202, "qwen": 10.245016674508697}, "topk": {"rwkv": [62577, 38, 0.002479551825672388, [[63885, 0.215971, " statistical", false], [22590, 0.197879, " the", false], [3866, 0.080888, " HM", false], [52224, 0.042858, " methods", false], [38720, 0.039723, " human", false], [31458, 0.023158, " more", false], [21256, 0.016193, " all", false], [4601, 0.016116, " it", false], [31466, 0.014971, " much", false], [31461, 0.013793, " most", false]]], "qwen": [13142, 61, 0.0019320999272167683, [[279, 0.191419, " the", false], [28464, 0.104236, " statistical", false], [3738, 0.073572, " human", false], [472, 0.053897, " H", false], [5413, 0.042883, " methods", false], [264, 0.030919, " a", false], [803, 0.021692, " more", false], [6788, 0.020739, " earlier", false], [11811, 0.020264, " researchers", false], [678, 0.020051, " all", false]]]}, "raw_delta": -0.022649808363481072, "tuned_delta": -0.015312669849778335}, {"byte_start": 3729, "byte_end": 3733, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 628, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"rwkv": "11.13% 11.13% 11.13% 11.13%", "qwen": "9.20% 9.20% 9.20% 9.20%"}, "model_tokens": {"rwkv": [[21265, " and", "normal", 0.08548733592033386]], "qwen": [[323, " and", "normal", 0.129806786775589]]}, "loss": {"rwkv": 11.130166819358212, "qwen": 9.20488231176844}, "topk": {"rwkv": [21265, 2, 0.08548733592033386, [[45283, 0.111597, " became", false], [21265, 0.085487, " and", false], [30383, 0.069941, " came", false], [46, 0.061414, "-", false], [32272, 0.053912, " took", false], [31059, 0.047672, " have", false], [57094, 0.044577, " replaced", false], [22777, 0.043409, " won", false], [32462, 0.037508, " were", false], [37828, 0.0351, " began", false]]], "qwen": [323, 1, 0.129806786775589, [[323, 0.129807, " and", false], [6116, 0.110121, " became", false], [702, 0.052799, " has", false], [5980, 0.051573, "-based", false], [4421, 0.050791, "---", false], [11, 0.048703, ",", false], [572, 0.041111, " was", false], [3867, 0.034376, " took", false], [320, 0.031195, " (", false], [12575, 0.023812, " replaced", false]]]}, "raw_delta": 0.10676044225692749, "tuned_delta": 0.11409758077063023}, {"byte_start": 3733, "byte_end": 3745, "display": {"text": " computation", "kind": "normal"}, "is_word": true, "word_id": 629, "word_key": " computation", "bytes_hex": "20 63 6f 6d 70 75 74 61 74 69 6f 6e", "compression": {"rwkv": "2.85% 2.85% 2.85% 2.85% 2.85% 2.85% 2.85% 2.85% 2.85% 2.85% 2.85% 2.85%", "qwen": "1.57% 1.57% 1.57% 1.57% 1.57% 1.57% 1.57% 1.57% 1.57% 1.57% 1.57% 1.57%"}, "model_tokens": {"rwkv": [[63370, " computation", "normal", 0.14767977595329285]], "qwen": [[34447, " computation", "normal", 0.3509063720703125]]}, "loss": {"rwkv": 2.8529857986329596, "qwen": 1.5737937108487454}, "topk": {"rwkv": [63370, 2, 0.14767977595329285, [[3866, 0.188009, " HM", false], [63370, 0.14768, " computation", false], [56537, 0.135112, " learning", false], [47202, 0.074025, " search", false], [63885, 0.065686, " statistical", false], [52167, 0.051393, " machine", false], [56935, 0.025322, " probabil", false], [52195, 0.018793, " massive", false], [63787, 0.01825, " probability", false], [30597, 0.017254, " deep", false]]], "qwen": [34447, 1, 0.3509063720703125, [[34447, 0.350906, " computation", false], [5662, 0.09078, " machine", false], [6832, 0.047997, " learning", false], [472, 0.044146, " H", false], [2711, 0.035162, " search", false], [28464, 0.026352, " statistical", false], [54480, 0.021034, " computational", false], [10951, 0.019022, " massive", false], [24231, 0.016781, " computing", false], [279, 0.016624, " the", false]]]}, "raw_delta": 0.07093347112337747, "tuned_delta": 0.07827060963708021}, {"byte_start": 3745, "byte_end": 3750, "display": {"text": " came", "kind": "normal"}, "is_word": true, "word_id": 630, "word_key": " came", "bytes_hex": "20 63 61 6d 65", "compression": {"rwkv": "8.12% 8.12% 8.12% 8.12% 8.12%", "qwen": "11.08% 11.08% 11.08% 11.08% 11.08%"}, "model_tokens": {"rwkv": [[30383, " came", "normal", 0.10573261976242065]], "qwen": [[3697, " came", "normal", 0.04633750766515732]]}, "loss": {"rwkv": 8.115159605000418, "qwen": 11.079189441815968}, "topk": {"rwkv": [30383, 2, 0.10573261976242065, [[45283, 0.112943, " became", false], [30383, 0.105733, " came", false], [31059, 0.100427, " have", false], [32272, 0.077267, " took", false], [57094, 0.051581, " replaced", false], [22777, 0.049661, " won", false], [32462, 0.048631, " were", false], [61959, 0.032544, " eventually", false], [22190, 0.030329, " now", false], [59771, 0.027151, " gradually", false]]], "qwen": [3697, 6, 0.04633750766515732, [[6116, 0.155787, " became", false], [614, 0.143535, " have", false], [1033, 0.084004, " were", false], [3867, 0.052117, " took", false], [29701, 0.04924, " dominated", false], [3697, 0.046338, " came", false], [11, 0.026066, ",", false], [525, 0.022455, " are", false], [1431, 0.021502, " now", false], [916, 0.018227, " over", false]]]}, "raw_delta": -0.16436071395874025, "tuned_delta": -0.1570235754450375}, {"byte_start": 3750, "byte_end": 3753, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 631, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "0.23% 0.23% 0.23%", "qwen": "0.19% 0.19% 0.19%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.961857259273529]], "qwen": [[311, " to", "normal", 0.9691116213798523]]}, "loss": {"rwkv": 0.23334606069065872, "qwen": 0.18860515475946268}, "topk": {"rwkv": [4811, 1, 0.961857259273529, [[4811, 0.961857, " to", false], [38499, 0.009005, " first", false], [31162, 0.007166, " into", false], [4596, 0.004989, " in", false], [22249, 0.00257, " out", false], [57435, 0.002282, " together", false], [64430, 0.001797, " increasingly", false], [31458, 0.000594, " more", false], [4712, 0.000503, " on", false], [45285, 0.000502, " before", false]]], "qwen": [311, 1, 0.9691116213798523, [[311, 0.969112, " to", false], [1119, 0.006749, " into", false], [14756, 0.005994, " increasingly", false], [304, 0.002393, " in", false], [700, 0.002006, " out", false], [518, 0.00129, " at", false], [1156, 0.000882, " first", false], [315, 0.000805, " of", false], [803, 0.000767, " more", false], [1182, 0.000627, " back", false]]]}, "raw_delta": 0.002480962624152502, "tuned_delta": 0.009818101137855239}, {"byte_start": 3753, "byte_end": 3762, "display": {"text": " dominate", "kind": "normal"}, "is_word": true, "word_id": 632, "word_key": " dominate", "bytes_hex": "20 64 6f 6d 69 6e 61 74 65", "compression": {"rwkv": "1.41% 1.41% 1.41% 1.41% 1.41% 1.41% 1.41% 1.41% 1.41%", "qwen": "0.88% 0.88% 0.88% 0.88% 0.88% 0.88% 0.88% 0.88% 0.88%"}, "model_tokens": {"rwkv": [[56041, " dominate", "normal", 0.49143069982528687]], "qwen": [[40736, " dominate", "normal", 0.6446137428283691]]}, "loss": {"rwkv": 1.4088818758681283, "qwen": 0.8798515971554768}, "topk": {"rwkv": [56041, 1, 0.49143069982528687, [[56041, 0.491431, " dominate", false], [4435, 0.190064, " be", false], [31907, 0.047701, " rule", false], [31702, 0.044779, " play", false], [56906, 0.039218, " predomin", false], [52716, 0.025981, " replace", false], [32187, 0.021349, " take", false], [22590, 0.019725, " the", false], [52550, 0.01178, " prevail", false], [31059, 0.006532, " have", false]]], "qwen": [40736, 1, 0.6446137428283691, [[40736, 0.644614, " dominate", false], [1486, 0.059636, " play", false], [279, 0.044036, " the", false], [387, 0.039062, " be", false], [1896, 0.037964, " take", false], [4162, 0.030339, " pred", false], [8290, 0.025675, " replace", false], [1026, 0.009732, " sup", false], [65728, 0.008506, " prevail", false], [5912, 0.008304, " rule", false]]]}, "raw_delta": 0.029335667689641323, "tuned_delta": 0.03667280620334406}, {"byte_start": 3762, "byte_end": 3766, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 633, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "12.40% 12.40% 12.40% 12.40%", "qwen": "9.96% 9.96% 9.96% 9.96%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.0644843801856041]], "qwen": [[279, " the", "normal", 0.10979695618152618]]}, "loss": {"rwkv": 12.398160507639528, "qwen": 9.959656122260641}, "topk": {"rwkv": [22590, 3, 0.0644843801856041, [[47, 0.56717, ".", false], [45, 0.139449, ",", false], [22590, 0.064484, " the", false], [31601, 0.052863, " over", false], [21265, 0.043779, " and", false], [275, 0.0128, " (", false], [57103, 0.009494, " research", false], [4596, 0.009205, " in", false], [21256, 0.006977, " all", false], [52224, 0.006482, " methods", false]]], "qwen": [279, 3, 0.10979695618152618, [[13, 0.282776, ".", false], [382, 0.179756, ".\n\n", false], [279, 0.109797, " the", false], [916, 0.090845, " over", false], [11, 0.083813, ",", false], [323, 0.025576, " and", false], [3738, 0.023952, " human", false], [678, 0.019848, " all", false], [320, 0.015324, " (", false], [5413, 0.012913, " methods", false]]]}, "raw_delta": 0.13521939516067505, "tuned_delta": 0.1425565336743778}, {"byte_start": 3766, "byte_end": 3772, "display": {"text": " field", "kind": "normal"}, "is_word": true, "word_id": 634, "word_key": " field", "bytes_hex": "20 66 69 65 6c 64", "compression": {"rwkv": "3.12% 3.12% 3.12% 3.12% 3.12% 3.12%", "qwen": "0.73% 0.73% 0.73% 0.73% 0.73% 0.73%"}, "model_tokens": {"rwkv": [[38478, " field", "normal", 0.35379740595817566]], "qwen": [[2070, " field", "normal", 0.7843818068504333]]}, "loss": {"rwkv": 3.1230214915076844, "qwen": 0.7299417550650444}, "topk": {"rwkv": [38478, 1, 0.35379740595817566, [[38478, 0.353797, " field", false], [57103, 0.191892, " research", false], [52224, 0.065537, " methods", false], [39597, 0.03235, " scene", false], [39802, 0.026105, " state", false], [55532, 0.024694, " approach", false], [61590, 0.019269, " approaches", false], [45829, 0.012504, " effort", false], [59945, 0.01114, " landscape", false], [45775, 0.00977, " domain", false]]], "qwen": [2070, 1, 0.7843818068504333, [[2070, 0.784382, " field", false], [5413, 0.030536, " methods", false], [3412, 0.025925, " research", false], [3082, 0.015, " area", false], [5486, 0.009158, " approach", false], [25364, 0.007416, " discipline", false], [7947, 0.007026, " domain", false], [3738, 0.006482, " human", false], [1616, 0.005541, " way", false], [990, 0.004777, " use", false]]]}, "raw_delta": 0.13270051777362823, "tuned_delta": 0.14003765628733097}, {"byte_start": 3772, "byte_end": 3773, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "5.95%", "qwen": "13.96%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.7178393006324768]], "qwen": [[13, ".", "normal", 0.46101492643356323]]}, "loss": {"rwkv": 5.952525925542842, "qwen": 13.963933556757253}, "topk": {"rwkv": [47, 1, 0.7178393006324768, [[47, 0.717839, ".", false], [45, 0.138475, ",", false], [21265, 0.040682, " and", false], [275, 0.013805, " (", false], [4706, 0.013097, " of", false], [31601, 0.011133, " over", false], [5346, 0.006648, "---", false], [40187, 0.006268, " while", false], [4596, 0.006095, " in", false], [4423, 0.005339, " as", false]]], "qwen": [13, 1, 0.46101492643356323, [[13, 0.461015, ".", false], [382, 0.256917, ".\n\n", false], [11, 0.13449, ",", false], [323, 0.027926, " and", false], [320, 0.020551, " (", false], [4421, 0.01885, "---", false], [304, 0.007144, " in", false], [916, 0.007141, " over", false], [624, 0.005872, ".\n", false], [315, 0.00569, " of", false]]]}, "raw_delta": -0.444246768951416, "tuned_delta": -0.4369096304377133}, {"byte_start": 3773, "byte_end": 3777, "display": {"text": " The", "kind": "normal"}, "is_word": true, "word_id": 635, "word_key": " the", "bytes_hex": "20 54 68 65", "compression": {"rwkv": "10.78% 10.78% 10.78% 10.78%", "qwen": "9.02% 9.02% 9.02% 9.02%"}, "model_tokens": {"rwkv": [[20996, " The", "normal", 0.09076663851737976]], "qwen": [[576, " The", "normal", 0.13527105748653412]]}, "loss": {"rwkv": 10.777946350391181, "qwen": 9.018984114667694}, "topk": {"rwkv": [20996, 2, 0.09076663851737976, [[261, 0.407122, "\n\n", false], [20996, 0.090767, " The", false], [29894, 0.039778, " This", false], [3913, 0.031061, " In", false], [3918, 0.029376, " It", false], [267, 0.025666, "  ", false], [37451, 0.019155, " There", false], [36251, 0.015516, " Again", false], [275, 0.015023, " (", false], [19555, 0.012959, " But", false]]], "qwen": [576, 1, 0.13527105748653412, [[576, 0.135271, " The", false], [1096, 0.087521, " This", false], [758, 0.070972, " In", false], [1084, 0.059122, " It", false], [220, 0.042533, " ", false], [2619, 0.033782, " There", false], [320, 0.031058, " (", false], [362, 0.024504, " A", false], [65694, 0.018292, " Statistical", false], [3776, 0.01478, " One", false]]]}, "raw_delta": 0.0975375771522522, "tuned_delta": 0.10487471566595494}, {"byte_start": 3777, "byte_end": 3784, "display": {"text": " recent", "kind": "normal"}, "is_word": true, "word_id": 636, "word_key": " recent", "bytes_hex": "20 72 65 63 65 6e 74", "compression": {"rwkv": "16.02% 16.02% 16.02% 16.02% 16.02% 16.02% 16.02%", "qwen": "16.84% 16.84% 16.84% 16.84% 16.84% 16.84% 16.84%"}, "model_tokens": {"rwkv": [[47014, " recent", "normal", 0.001985829556360841]], "qwen": [[3213, " recent", "normal", 0.001448009512387216]]}, "loss": {"rwkv": 16.020999617014713, "qwen": 16.842344533425265}, "topk": {"rwkv": [47014, 81, 0.001985829556360841, [[38720, 0.094761, " human", false], [63885, 0.086314, " statistical", false], [38328, 0.032011, " early", false], [52224, 0.02248, " methods", false], [52013, 0.019574, " initial", false], [19678, 0.016059, " DAR", false], [62577, 0.015992, " statistics", false], [46430, 0.015889, " lesson", false], [31937, 0.014073, " same", false], [31461, 0.012226, " most", false]]], "qwen": [3213, 106, 0.001448009512387216, [[3738, 0.08607, " human", false], [17755, 0.057509, " lesson", false], [1852, 0.039748, " same", false], [2297, 0.033862, " change", false], [2874, 0.025564, " reason", false], [4124, 0.023552, " early", false], [28464, 0.022176, " statistical", false], [2070, 0.021218, " field", false], [18366, 0.013596, " lessons", false], [2856, 0.012939, " initial", false]]]}, "raw_delta": -0.04554503304617752, "tuned_delta": -0.03820789453247478}, {"byte_start": 3784, "byte_end": 3789, "display": {"text": " rise", "kind": "normal"}, "is_word": true, "word_id": 637, "word_key": " rise", "bytes_hex": "20 72 69 73 65", "compression": {"rwkv": "13.36% 13.36% 13.36% 13.36% 13.36%", "qwen": "11.77% 11.77% 11.77% 11.77% 11.77%"}, "model_tokens": {"rwkv": [[31886, " rise", "normal", 0.024365076795220375]], "qwen": [[10000, " rise", "normal", 0.03823969513177872]]}, "loss": {"rwkv": 13.356200183229856, "qwen": 11.7719630767155}, "topk": {"rwkv": [31886, 5, 0.024365076795220375, [[53052, 0.163783, " success", false], [59687, 0.05859, " explosion", false], [60587, 0.051036, " successes", false], [22377, 0.029686, " res", false], [31886, 0.024365, " rise", false], [55465, 0.021762, " advances", false], [32499, 0.021367, " work", false], [56950, 0.020205, " progress", false], [63469, 0.020036, " development", false], [40009, 0.01923, " trend", false]]], "qwen": [10000, 4, 0.03823969513177872, [[2393, 0.155085, " success", false], [90490, 0.075235, " resurgence", false], [9902, 0.065232, " ``", false], [10000, 0.03824, " rise", false], [48079, 0.031369, " emergence", false], [4401, 0.023977, " development", false], [975, 0.023407, " work", false], [47088, 0.022941, " successes", false], [24199, 0.016634, " explosion", false], [12560, 0.010869, " victory", false]]]}, "raw_delta": 0.08784875869750974, "tuned_delta": 0.09518589721121248}, {"byte_start": 3789, "byte_end": 3792, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 638, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "0.87% 0.87% 0.87%", "qwen": "0.88% 0.88% 0.88%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.864526629447937]], "qwen": [[315, " of", "normal", 0.8635035753250122]]}, "loss": {"rwkv": 0.8746808312681296, "qwen": 0.8821916360987787}, "topk": {"rwkv": [4706, 1, 0.864526629447937, [[4706, 0.864527, " of", false], [4596, 0.099814, " in", false], [4811, 0.020594, " to", false], [21265, 0.00879, " and", false], [45, 0.002744, ",", false], [275, 0.001305, " (", false], [37635, 0.000326, " again", false], [30917, 0.000194, " from", false], [4600, 0.000111, " is", false], [30218, 9.4e-05, " back", false]]], "qwen": [315, 1, 0.8635035753250122, [[315, 0.863504, " of", false], [304, 0.106901, " in", false], [311, 0.014329, " to", false], [323, 0.010539, " and", false], [11, 0.001082, ",", false], [320, 0.000833, " (", false], [1549, 0.000326, " again", false], [702, 0.000226, " has", false], [504, 0.000149, " from", false], [8841, 0.000125, " toward", false]]]}, "raw_delta": -0.000416487455368042, "tuned_delta": 0.006920651058334695}, {"byte_start": 3792, "byte_end": 3797, "display": {"text": " deep", "kind": "normal"}, "is_word": true, "word_id": 639, "word_key": " deep", "bytes_hex": "20 64 65 65 70", "compression": {"rwkv": "1.85% 1.85% 1.85% 1.85% 1.85%", "qwen": "2.71% 2.71% 2.71% 2.71% 2.71%"}, "model_tokens": {"rwkv": [[30597, " deep", "normal", 0.6035642623901367]], "qwen": [[5538, " deep", "normal", 0.47233864665031433]]}, "loss": {"rwkv": 1.8456352573872479, "qwen": 2.7052662451755625}, "topk": {"rwkv": [30597, 1, 0.6035642623901367, [[30597, 0.603564, " deep", false], [46658, 0.118085, " neural", false], [22590, 0.021521, " the", false], [60342, 0.02145, " recurrent", false], [59193, 0.019629, " attention", false], [52167, 0.018761, " machine", false], [4404, 0.013704, " ``", false], [32497, 0.009341, " word", false], [64597, 0.00796, " transformers", false], [38864, 0.006483, " large", false]]], "qwen": [5538, 1, 0.47233864665031433, [[5538, 0.472339, " deep", false], [29728, 0.166442, " neural", false], [5662, 0.030954, " machine", false], [279, 0.029208, " the", false], [3460, 0.017315, " large", false], [9902, 0.017042, " ``", false], [6529, 0.013668, " attention", false], [1766, 0.011558, " gener", false], [15235, 0.010287, " AI", false], [28464, 0.010208, " statistical", false]]]}, "raw_delta": -0.04766806364059449, "tuned_delta": -0.04033092512689175}, {"byte_start": 3797, "byte_end": 3806, "display": {"text": " learning", "kind": "normal"}, "is_word": true, "word_id": 640, "word_key": " learning", "bytes_hex": "20 6c 65 61 72 6e 69 6e 67", "compression": {"rwkv": "0.49% 0.49% 0.49% 0.49% 0.49% 0.49% 0.49% 0.49% 0.49%", "qwen": "0.45% 0.45% 0.45% 0.45% 0.45% 0.45% 0.45% 0.45% 0.45%"}, "model_tokens": {"rwkv": [[56537, " learning", "normal", 0.7834071516990662]], "qwen": [[6832, " learning", "normal", 0.7984076142311096]]}, "loss": {"rwkv": 0.4872383154043943, "qwen": 0.4511146733470222}, "topk": {"rwkv": [56537, 1, 0.7834071516990662, [[56537, 0.783407, " learning", false], [46658, 0.172457, " neural", false], [46, 0.016549, "-", false], [56705, 0.004807, " networks", false], [31510, 0.002512, " nets", false], [47350, 0.0021, " speech", false], [56529, 0.001311, " language", false], [46086, 0.001261, " genera", false], [65003, 0.001036, " reinforcement", false], [45, 0.001033, ",", false]]], "qwen": [6832, 1, 0.7984076142311096, [[6832, 0.798408, " learning", false], [29728, 0.147366, " neural", false], [70756, 0.025295, "-learning", false], [14155, 0.00426, " networks", false], [71278, 0.00325, " reinforcement", false], [52457, 0.002188, " nets", false], [55712, 0.00194, " convolution", false], [11, 0.001538, ",", false], [1766, 0.001425, " gener", false], [320, 0.001152, " (", false]]]}, "raw_delta": 0.002003120051489938, "tuned_delta": 0.009340258565192675}, {"byte_start": 3806, "byte_end": 3809, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 641, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "10.43% 10.43% 10.43%", "qwen": "10.72% 10.72% 10.72%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.17703208327293396]], "qwen": [[304, " in", "normal", 0.16819624602794647]]}, "loss": {"rwkv": 10.425725881424148, "qwen": 10.715761006811082}, "topk": {"rwkv": [4596, 1, 0.17703208327293396, [[4596, 0.177032, " in", false], [45, 0.139878, ",", false], [21800, 0.119042, " has", false], [4600, 0.090814, " is", false], [52224, 0.076817, " methods", false], [21265, 0.038514, " and", false], [275, 0.036194, " (", false], [21700, 0.024612, " for", false], [22748, 0.024106, " was", false], [62633, 0.021755, " techniques", false]]], "qwen": [304, 2, 0.16819624602794647, [[702, 0.183061, " has", false], [304, 0.168196, " in", false], [374, 0.121965, " is", false], [11, 0.09634, ",", false], [572, 0.051172, " was", false], [323, 0.048385, " and", false], [5413, 0.047639, " methods", false], [320, 0.035923, " (", false], [1083, 0.016303, " also", false], [646, 0.015431, " can", false]]]}, "raw_delta": -0.01608296235402429, "tuned_delta": -0.008745823840321552}, {"byte_start": 3809, "byte_end": 3816, "display": {"text": " speech", "kind": "normal"}, "is_word": true, "word_id": 642, "word_key": " speech", "bytes_hex": "20 73 70 65 65 63 68", "compression": {"rwkv": "3.10% 3.10% 3.10% 3.10% 3.10% 3.10% 3.10%", "qwen": "3.08% 3.08% 3.08% 3.08% 3.08% 3.08% 3.08%"}, "model_tokens": {"rwkv": [[47350, " speech", "normal", 0.30205366015434265]], "qwen": [[8806, " speech", "normal", 0.30251842737197876]]}, "loss": {"rwkv": 3.099540126909882, "qwen": 3.0801874720096674}, "topk": {"rwkv": [47350, 1, 0.30205366015434265, [[47350, 0.302054, " speech", false], [4047, 0.273531, " NL", false], [52299, 0.163085, " natural", false], [55809, 0.066247, " computer", false], [22590, 0.029283, " the", false], [32234, 0.02686, " this", false], [3609, 0.012598, " AI", false], [62293, 0.010452, " particular", false], [38744, 0.009046, " image", false], [52167, 0.008979, " machine", false]]], "qwen": [8806, 1, 0.30251842737197876, [[8806, 0.302518, " speech", false], [5810, 0.227938, " natural", false], [451, 0.12571, " N", false], [6366, 0.050058, " computer", false], [279, 0.045199, " the", false], [419, 0.039475, " this", false], [5662, 0.023615, " machine", false], [4128, 0.021623, " language", false], [678, 0.016251, " all", false], [29728, 0.015388, " neural", false]]]}, "raw_delta": 0.001073139054434652, "tuned_delta": 0.008410277568137389}, {"byte_start": 3816, "byte_end": 3828, "display": {"text": " recognition", "kind": "normal"}, "is_word": true, "word_id": 643, "word_key": " recognition", "bytes_hex": "20 72 65 63 6f 67 6e 69 74 69 6f 6e", "compression": {"rwkv": "0.39% 0.39% 0.39% 0.39% 0.39% 0.39% 0.39% 0.39% 0.39% 0.39% 0.39% 0.39%", "qwen": "0.25% 0.25% 0.25% 0.25% 0.25% 0.25% 0.25% 0.25% 0.25% 0.25% 0.25% 0.25%"}, "model_tokens": {"rwkv": [[63821, " recognition", "normal", 0.7711982727050781]], "qwen": [[17843, " recognition", "normal", 0.845000684261322]]}, "loss": {"rwkv": 0.3933128570131859, "qwen": 0.25309961175671214}, "topk": {"rwkv": [63821, 1, 0.7711982727050781, [[63821, 0.771198, " recognition", false], [21265, 0.072232, " and", false], [62378, 0.047176, " processing", false], [21800, 0.021838, " has", false], [45, 0.016241, ",", false], [4600, 0.013337, " is", false], [275, 0.005199, " (", false], [46, 0.004189, "-", false], [65034, 0.004142, " understanding", false], [22748, 0.003535, " was", false]]], "qwen": [17843, 1, 0.845000684261322, [[17843, 0.845001, " recognition", false], [323, 0.051257, " and", false], [8692, 0.02725, " processing", false], [702, 0.014117, " has", false], [59172, 0.012267, "-rec", false], [11, 0.009875, ",", false], [374, 0.007562, " is", false], [572, 0.002541, " was", false], [3412, 0.00192, " research", false], [320, 0.00178, " (", false]]]}, "raw_delta": 0.007775073250134782, "tuned_delta": 0.015112211763837518}, {"byte_start": 3828, "byte_end": 3831, "display": {"text": " is", "kind": "normal"}, "is_word": true, "word_id": 644, "word_key": " is", "bytes_hex": "20 69 73", "compression": {"rwkv": "7.98% 7.98% 7.98%", "qwen": "7.52% 7.52% 7.52%"}, "model_tokens": {"rwkv": [[4600, " is", "normal", 0.26714470982551575]], "qwen": [[374, " is", "normal", 0.2861829102039337]]}, "loss": {"rwkv": 7.983663963252726, "qwen": 7.520794156286835}, "topk": {"rwkv": [4600, 1, 0.26714470982551575, [[4600, 0.267145, " is", false], [21800, 0.201374, " has", false], [21265, 0.106443, " and", false], [45, 0.101852, ",", false], [22748, 0.078315, " was", false], [275, 0.022908, " (", false], [21413, 0.021348, " can", false], [39680, 0.007938, " shows", false], [5346, 0.007829, "---", false], [30135, 0.007423, " also", false]]], "qwen": [374, 1, 0.2861829102039337, [[374, 0.286183, " is", false], [702, 0.119782, " has", false], [11, 0.093267, ",", false], [572, 0.083613, " was", false], [323, 0.074318, " and", false], [646, 0.039305, " can", false], [320, 0.032056, " (", false], [1083, 0.024595, " also", false], [4933, 0.013609, " shows", false], [1231, 0.009235, " may", false]]]}, "raw_delta": 0.02566695213317871, "tuned_delta": 0.03300409064688145}, {"byte_start": 3831, "byte_end": 3835, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 645, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "11.20% 11.20% 11.20% 11.20%", "qwen": "11.99% 11.99% 11.99% 11.99%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.08310132473707199]], "qwen": [[279, " the", "normal", 0.0699431374669075]]}, "loss": {"rwkv": 11.20061091315162, "qwen": 11.992730756278679}, "topk": {"rwkv": [22590, 3, 0.08310132473707199, [[332, 0.2584, " a", false], [4419, 0.088994, " an", false], [22590, 0.083101, " the", false], [50919, 0.042525, " another", false], [31198, 0.032695, " just", false], [22797, 0.027438, " yet", false], [4596, 0.023097, " in", false], [47285, 0.022295, " simply", false], [52906, 0.01897, " similar", false], [52094, 0.01859, " largely", false]]], "qwen": [279, 4, 0.0699431374669075, [[264, 0.234943, " a", false], [2441, 0.142371, " another", false], [458, 0.090994, " an", false], [279, 0.069943, " the", false], [3602, 0.038998, " yet", false], [1101, 0.03188, " just", false], [1083, 0.027514, " also", false], [304, 0.021343, " in", false], [537, 0.01635, " not", false], [8365, 0.014277, " perhaps", false]]]}, "raw_delta": -0.04392445087432861, "tuned_delta": -0.03658731236062587}, {"byte_start": 3835, "byte_end": 3840, "display": {"text": " most", "kind": "normal"}, "is_word": true, "word_id": 646, "word_key": " most", "bytes_hex": "20 6d 6f 73 74", "compression": {"rwkv": "7.83% 7.83% 7.83% 7.83% 7.83%", "qwen": "5.85% 5.85% 5.85% 5.85% 5.85%"}, "model_tokens": {"rwkv": [[31461, " most", "normal", 0.1123746931552887]], "qwen": [[1429, " most", "normal", 0.1974916160106659]]}, "loss": {"rwkv": 7.833383229826793, "qwen": 5.850342003576077}, "topk": {"rwkv": [31461, 3, 0.1123746931552887, [[46404, 0.353577, " latest", false], [45635, 0.132747, " culmin", false], [31461, 0.112375, " most", false], [52299, 0.04461, " natural", false], [64328, 0.040321, " continuation", false], [47092, 0.034982, " result", false], [52154, 0.030636, " logical", false], [31515, 0.027731, " next", false], [38491, 0.01717, " final", false], [31937, 0.014912, " same", false]]], "qwen": [1429, 2, 0.1974916160106659, [[5535, 0.307636, " latest", false], [1429, 0.197492, " most", false], [92201, 0.057313, " culmination", false], [1102, 0.04321, " result", false], [16724, 0.030106, " ultimate", false], [1590, 0.026096, " final", false], [5810, 0.019535, " natural", false], [1790, 0.018574, " next", false], [6481, 0.016573, " modern", false], [1850, 0.013925, " best", false]]]}, "raw_delta": 0.10996315479278569, "tuned_delta": 0.11730029330648843}, {"byte_start": 3840, "byte_end": 3847, "display": {"text": " recent", "kind": "normal"}, "is_word": true, "word_id": 647, "word_key": " recent", "bytes_hex": "20 72 65 63 65 6e 74", "compression": {"rwkv": "1.13% 1.13% 1.13% 1.13% 1.13% 1.13% 1.13%", "qwen": "1.77% 1.77% 1.77% 1.77% 1.77% 1.77% 1.77%"}, "model_tokens": {"rwkv": [[47014, " recent", "normal", 0.6433455348014832]], "qwen": [[3213, " recent", "normal", 0.5033757090568542]]}, "loss": {"rwkv": 1.1271055006945025, "qwen": 1.7683793607497929}, "topk": {"rwkv": [47014, 1, 0.6433455348014832, [[47014, 0.643346, " recent", false], [56056, 0.100219, " dramatic", false], [52346, 0.051646, " obvious", false], [63878, 0.020879, " spectacular", false], [60273, 0.019068, " prominent", false], [53296, 0.016331, " visible", false], [57323, 0.015055, " striking", false], [51699, 0.013196, " extreme", false], [59829, 0.011178, " important", false], [45752, 0.010152, " direct", false]]], "qwen": [3213, 1, 0.5033757090568542, [[3213, 0.503376, " recent", false], [21771, 0.087077, " dramatic", false], [20469, 0.041847, " prominent", false], [8036, 0.041745, " obvious", false], [14226, 0.036954, " extreme", false], [27709, 0.034373, " spectacular", false], [9434, 0.032216, " visible", false], [2989, 0.022292, " important", false], [5089, 0.018553, " significant", false], [27190, 0.017109, " notable", false]]]}, "raw_delta": -0.035559773445129395, "tuned_delta": -0.028222634931426658}, {"byte_start": 3847, "byte_end": 3852, "display": {"text": " step", "kind": "normal"}, "is_word": true, "word_id": 648, "word_key": " step", "bytes_hex": "20 73 74 65 70", "compression": {"rwkv": "18.82% 18.82% 18.82% 18.82% 18.82%", "qwen": "19.09% 19.09% 19.09% 19.09% 19.09%"}, "model_tokens": {"rwkv": [[32115, " step", "normal", 0.005469643510878086]], "qwen": [[3019, " step", "normal", 0.005021218676120043]]}, "loss": {"rwkv": 18.822661861598192, "qwen": 19.094366932737294}, "topk": {"rwkv": [32115, 21, 0.005469643510878086, [[51668, 0.367254, " example", false], [64955, 0.094885, " manifestation", false], [21265, 0.051247, " and", false], [53275, 0.033853, " version", false], [45, 0.027628, ",", false], [56467, 0.025702, " instance", false], [59932, 0.021061, " iteration", false], [4706, 0.02084, " of", false], [59695, 0.017466, " extension", false], [63469, 0.017059, " development", false]]], "qwen": [3019, 20, 0.005021218676120043, [[3110, 0.454865, " example", false], [62950, 0.143977, " manifestation", false], [323, 0.034289, " and", false], [2867, 0.031439, " instance", false], [315, 0.018749, " of", false], [7493, 0.01635, " expression", false], [3598, 0.014601, " major", false], [39034, 0.014404, " illustration", false], [11, 0.013451, ",", false], [2319, 0.011413, " version", false]]]}, "raw_delta": -0.015066528320312633, "tuned_delta": -0.007729389806609897}, {"byte_start": 3852, "byte_end": 3855, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 649, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "1.54% 1.54% 1.54%", "qwen": "1.46% 1.46% 1.46%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.7726312279701233]], "qwen": [[304, " in", "normal", 0.7840771675109863]]}, "loss": {"rwkv": 1.53802938115604, "qwen": 1.4622185329127406}, "topk": {"rwkv": [4596, 1, 0.7726312279701233, [[4596, 0.772631, " in", false], [37678, 0.087611, " along", false], [4706, 0.051711, " of", false], [4712, 0.012874, " on", false], [45, 0.010604, ",", false], [53169, 0.009763, " towards", false], [47, 0.007186, ".", false], [30678, 0.006968, " down", false], [47585, 0.006806, " toward", false], [30211, 0.005082, " away", false]]], "qwen": [304, 1, 0.7840771675109863, [[304, 0.784077, " in", false], [6974, 0.047984, " towards", false], [3156, 0.033861, " along", false], [315, 0.021732, " of", false], [11, 0.021365, ",", false], [389, 0.013445, " on", false], [4637, 0.011178, " forward", false], [8841, 0.00769, " toward", false], [311, 0.007191, " to", false], [13, 0.006736, ".", false]]]}, "raw_delta": 0.004203846057256058, "tuned_delta": 0.011540984570958795}, {"byte_start": 3855, "byte_end": 3860, "display": {"text": " this", "kind": "normal"}, "is_word": true, "word_id": 650, "word_key": " this", "bytes_hex": "20 74 68 69 73", "compression": {"rwkv": "1.66% 1.66% 1.66% 1.66% 1.66%", "qwen": "1.39% 1.39% 1.39% 1.39% 1.39%"}, "model_tokens": {"rwkv": [[32234, " this", "normal", 0.6323899626731873]], "qwen": [[419, " this", "normal", 0.6810057759284973]]}, "loss": {"rwkv": 1.6554362041450505, "qwen": 1.3856527166618726}, "topk": {"rwkv": [32234, 1, 0.6323899626731873, [[32234, 0.63239, " this", false], [32227, 0.168583, " that", false], [22590, 0.121055, " the", false], [332, 0.052014, " a", false], [4419, 0.005062, " an", false], [39936, 0.003167, " these", false], [32464, 0.002529, " what", false], [61774, 0.001128, " continuing", false], [59725, 0.000641, " following", false], [55531, 0.000513, " applying", false]]], "qwen": [419, 1, 0.6810057759284973, [[419, 0.681006, " this", false], [429, 0.131548, " that", false], [279, 0.095718, " the", false], [264, 0.054598, " a", false], [458, 0.004845, " an", false], [1128, 0.003424, " what", false], [1493, 0.001981, " these", false], [1741, 0.001159, " such", false], [14354, 0.001105, " continuing", false], [5810, 0.000941, " natural", false]]]}, "raw_delta": 0.014959973096847531, "tuned_delta": 0.022297111610550268}, {"byte_start": 3860, "byte_end": 3871, "display": {"text": " consistent", "kind": "normal"}, "is_word": true, "word_id": 651, "word_key": " consistent", "bytes_hex": "20 63 6f 6e 73 69 73 74 65 6e 74", "compression": {"rwkv": "18.24% 18.24% 18.24% 18.24% 18.24% 18.24% 18.24% 18.24% 18.24% 18.24% 18.24%", "qwen": "15.36% 15.36% 15.36% 15.36% 15.36% 15.36% 15.36% 15.36% 15.36% 15.36% 15.36%"}, "model_tokens": {"rwkv": [[61756, " consistent", "normal", 1.4924115930625703e-05]], "qwen": [[12966, " consistent", "normal", 8.523379074176773e-05]]}, "loss": {"rwkv": 18.238616283965587, "qwen": 15.361607635964383}, "topk": {"rwkv": [61756, 981, 1.4924115930625703e-05, [[52571, 0.160754, " process", false], [31323, 0.135206, " long", false], [59657, 0.072277, " evolution", false], [40009, 0.069912, " trend", false], [59526, 0.042668, " direction", false], [51832, 0.039862, " general", false], [64386, 0.029652, " evolutionary", false], [31937, 0.027266, " same", false], [63797, 0.025852, " progression", false], [45450, 0.024995, " change", false]]], "qwen": [12966, 291, 8.523379074176773e-05, [[1882, 0.186448, " process", false], [9149, 0.135534, " trend", false], [1293, 0.100552, " long", false], [15379, 0.066108, " evolution", false], [5106, 0.0499, " direction", false], [2297, 0.042591, " change", false], [4586, 0.030231, " general", false], [9142, 0.027419, " transition", false], [32724, 0.022523, " progression", false], [5383, 0.02007, " pattern", false]]]}, "raw_delta": 0.15953523462468935, "tuned_delta": 0.1668723731383921}, {"byte_start": 3871, "byte_end": 3881, "display": {"text": " direction", "kind": "normal"}, "is_word": true, "word_id": 652, "word_key": " direction", "bytes_hex": "20 64 69 72 65 63 74 69 6f 6e", "compression": {"rwkv": "8.62% 8.62% 8.62% 8.62% 8.62% 8.62% 8.62% 8.62% 8.62% 8.62%", "qwen": "6.56% 6.56% 6.56% 6.56% 6.56% 6.56% 6.56% 6.56% 6.56% 6.56%"}, "model_tokens": {"rwkv": [[59526, " direction", "normal", 0.008413325995206833]], "qwen": [[5106, " direction", "normal", 0.02627510018646717]]}, "loss": {"rwkv": 8.622357080312945, "qwen": 6.5626997328859815}, "topk": {"rwkv": [59526, 18, 0.008413325995206833, [[52427, 0.245605, " pattern", false], [40009, 0.199254, " trend", false], [45, 0.058403, ",", false], [63797, 0.038376, " progression", false], [56950, 0.033512, " progress", false], [59657, 0.029808, " evolution", false], [21265, 0.02918, " and", false], [52571, 0.025617, " process", false], [45450, 0.019801, " change", false], [38974, 0.019312, " march", false]]], "qwen": [5106, 9, 0.02627510018646717, [[9149, 0.299869, " trend", false], [5383, 0.093218, " pattern", false], [2297, 0.054152, " change", false], [6407, 0.051961, " shift", false], [15379, 0.044662, " evolution", false], [1882, 0.03035, " process", false], [11, 0.029086, ",", false], [323, 0.026876, " and", false], [5106, 0.026275, " direction", false], [3271, 0.022239, " move", false]]]}, "raw_delta": 0.114211654663086, "tuned_delta": 0.12154879317678874}, {"byte_start": 3881, "byte_end": 3882, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "5.57%", "qwen": "22.29%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.7336514592170715]], "qwen": [[13, ".", "normal", 0.29059064388275146]]}, "loss": {"rwkv": 5.565083409679106, "qwen": 22.286748024105815}, "topk": {"rwkv": [47, 1, 0.7336514592170715, [[47, 0.733651, ".", false], [45, 0.116863, ",", false], [4706, 0.076788, " of", false], [5346, 0.008548, "---", false], [21265, 0.008427, " and", false], [53169, 0.006414, " towards", false], [275, 0.005262, " (", false], [4596, 0.005249, " in", false], [32227, 0.004438, " that", false], [47585, 0.004208, " toward", false]]], "qwen": [13, 2, 0.29059064388275146, [[382, 0.405737, ".\n\n", false], [13, 0.290591, ".", false], [11, 0.135025, ",", false], [315, 0.061821, " of", false], [4421, 0.019762, "---", false], [320, 0.011173, " (", false], [624, 0.010594, ".\n", false], [323, 0.009096, " and", false], [26, 0.006324, ";", false], [304, 0.005766, " in", false]]]}, "raw_delta": -0.9272459745407104, "tuned_delta": -0.9199088360270077}, {"byte_start": 3882, "byte_end": 3887, "display": {"text": " Deep", "kind": "normal"}, "is_word": true, "word_id": 653, "word_key": " deep", "bytes_hex": "20 44 65 65 70", "compression": {"rwkv": "14.31% 14.31% 14.31% 14.31% 14.31%", "qwen": "11.75% 11.75% 11.75% 11.75% 11.75%"}, "model_tokens": {"rwkv": [[28753, " Deep", "normal", 0.018543995916843414]], "qwen": [[18183, " Deep", "normal", 0.03847718983888626]]}, "loss": {"rwkv": 14.314239858820182, "qwen": 11.749631989414219}, "topk": {"rwkv": [28753, 5, 0.018543995916843414, [[261, 0.646703, "\n\n", false], [20996, 0.043666, " The", false], [3918, 0.029743, " It", false], [267, 0.023415, "  ", false], [28753, 0.018544, " Deep", false], [3913, 0.017913, " In", false], [37451, 0.009992, " There", false], [29894, 0.009243, " This", false], [36251, 0.008297, " Again", false], [44900, 0.007287, " Speech", false]]], "qwen": [18183, 6, 0.03847718983888626, [[576, 0.116875, " The", false], [220, 0.098938, " ", false], [758, 0.08166, " In", false], [1084, 0.064057, " It", false], [1096, 0.03989, " This", false], [18183, 0.038477, " Deep", false], [2619, 0.035076, " There", false], [320, 0.027231, " (", false], [362, 0.017175, " A", false], [1634, 0.014003, " As", false]]]}, "raw_delta": 0.14221205711364737, "tuned_delta": 0.1495491956273501}, {"byte_start": 3887, "byte_end": 3896, "display": {"text": " learning", "kind": "normal"}, "is_word": true, "word_id": 654, "word_key": " learning", "bytes_hex": "20 6c 65 61 72 6e 69 6e 67", "compression": {"rwkv": "0.13% 0.13% 0.13% 0.13% 0.13% 0.13% 0.13% 0.13% 0.13%", "qwen": "0.13% 0.13% 0.13% 0.13% 0.13% 0.13% 0.13% 0.13% 0.13%"}, "model_tokens": {"rwkv": [[56537, " learning", "normal", 0.9391831159591675]], "qwen": [[6832, " learning", "normal", 0.9382525086402893]]}, "loss": {"rwkv": 0.1262123347131865, "qwen": 0.12771088284932422}, "topk": {"rwkv": [56537, 1, 0.9391831159591675, [[56537, 0.939183, " learning", false], [46658, 0.020539, " neural", false], [46, 0.015048, "-", false], [56705, 0.002709, " networks", false], [31510, 0.002476, " nets", false], [52224, 0.002123, " methods", false], [47350, 0.001741, " speech", false], [46587, 0.00146, " models", false], [1857, 0.001356, "er", false], [55122, 0.001304, " Learning", false]]], "qwen": [6832, 1, 0.9382525086402893, [[6832, 0.938253, " learning", false], [29728, 0.024987, " neural", false], [70756, 0.01787, "-learning", false], [14155, 0.00314, " networks", false], [52457, 0.00118, " nets", false], [4119, 0.000807, " models", false], [20909, 0.000775, " Learning", false], [5413, 0.000722, " methods", false], [11, 0.000584, ",", false], [71278, 0.000508, " reinforcement", false]]]}, "raw_delta": -8.30971532397801e-05, "tuned_delta": 0.0072540413604629565}, {"byte_start": 3896, "byte_end": 3904, "display": {"text": " methods", "kind": "normal"}, "is_word": true, "word_id": 655, "word_key": " methods", "bytes_hex": "20 6d 65 74 68 6f 64 73", "compression": {"rwkv": "4.12% 4.12% 4.12% 4.12% 4.12% 4.12% 4.12% 4.12%", "qwen": "6.29% 6.29% 6.29% 6.29% 6.29% 6.29% 6.29% 6.29%"}, "model_tokens": {"rwkv": [[52224, " methods", "normal", 0.15847846865653992]], "qwen": [[5413, " methods", "normal", 0.061479464173316956]]}, "loss": {"rwkv": 4.120979486914275, "qwen": 6.287111723447028}, "topk": {"rwkv": [52224, 2, 0.15847846865653992, [[4600, 0.208106, " is", false], [52224, 0.158478, " methods", false], [45, 0.086777, ",", false], [21800, 0.077345, " has", false], [30659, 0.025664, " does", false], [32356, 0.025328, " uses", false], [21413, 0.024652, " can", false], [62633, 0.018495, " techniques", false], [22748, 0.017224, " was", false], [21265, 0.01381, " and", false]]], "qwen": [5413, 4, 0.061479464173316956, [[374, 0.355186, " is", false], [702, 0.088279, " has", false], [11, 0.080589, ",", false], [5413, 0.061479, " methods", false], [304, 0.034315, " in", false], [572, 0.032036, " was", false], [323, 0.024567, " and", false], [646, 0.016037, " can", false], [1558, 0.012097, " does", false], [320, 0.010785, " (", false]]]}, "raw_delta": -0.12011587619781494, "tuned_delta": -0.1127787376841122}, {"byte_start": 3904, "byte_end": 3909, "display": {"text": " rely", "kind": "normal"}, "is_word": true, "word_id": 656, "word_key": " rely", "bytes_hex": "20 72 65 6c 79", "compression": {"rwkv": "16.23% 16.23% 16.23% 16.23% 16.23%", "qwen": "19.16% 19.16% 19.16% 19.16% 19.16%"}, "model_tokens": {"rwkv": [[31856, " rely", "normal", 0.011062804609537125]], "qwen": [[17188, " rely", "normal", 0.0049310470931231976]]}, "loss": {"rwkv": 16.230319210000836, "qwen": 19.159725499544685}, "topk": {"rwkv": [31856, 14, 0.011062804609537125, [[21286, 0.252335, " are", false], [45, 0.118289, ",", false], [31059, 0.107488, " have", false], [4491, 0.045172, " do", false], [21413, 0.030991, " can", false], [22681, 0.023271, " use", false], [56540, 0.022842, " leverage", false], [32187, 0.017824, " take", false], [32462, 0.014604, " were", false], [31358, 0.012051, " make", false]]], "qwen": [17188, 23, 0.0049310470931231976, [[525, 0.272963, " are", false], [614, 0.124843, " have", false], [11, 0.080843, ",", false], [1033, 0.030006, " were", false], [646, 0.027957, " can", false], [429, 0.027579, " that", false], [653, 0.021692, " do", false], [369, 0.017541, " for", false], [304, 0.015921, " in", false], [320, 0.012085, " (", false]]]}, "raw_delta": -0.16244077682495106, "tuned_delta": -0.15510363831124832}, {"byte_start": 3909, "byte_end": 3914, "display": {"text": " even", "kind": "normal"}, "is_word": true, "word_id": 657, "word_key": " even", "bytes_hex": "20 65 76 65 6e", "compression": {"rwkv": "22.32% 22.32% 22.32% 22.32% 22.32%", "qwen": "14.45% 14.45% 14.45% 14.45% 14.45%"}, "model_tokens": {"rwkv": [[30788, " even", "normal", 0.0020208877976983786]], "qwen": [[1496, " even", "normal", 0.01821867562830448]]}, "loss": {"rwkv": 22.31668891375115, "qwen": 14.44609551758368}, "topk": {"rwkv": [30788, 30, 0.0020208877976983786, [[4712, 0.681747, " on", false], [51919, 0.136546, " heavily", false], [31458, 0.013708, " more", false], [32350, 0.012332, " upon", false], [45, 0.01095, ",", false], [4596, 0.010938, " in", false], [32386, 0.009323, " very", false], [31466, 0.009204, " much", false], [45145, 0.009088, " almost", false], [22187, 0.006041, " not", false]]], "qwen": [1496, 5, 0.01821867562830448, [[389, 0.546781, " on", false], [16916, 0.192428, " heavily", false], [803, 0.041072, " more", false], [1753, 0.027618, " much", false], [1496, 0.018219, " even", false], [2686, 0.014777, " less", false], [4558, 0.014529, " almost", false], [5193, 0.008048, " upon", false], [1602, 0.006943, " very", false], [15503, 0.006629, " primarily", false]]]}, "raw_delta": 0.43643836975097655, "tuned_delta": 0.44377550826467926}, {"byte_start": 3914, "byte_end": 3919, "display": {"text": " less", "kind": "normal"}, "is_word": true, "word_id": 658, "word_key": " less", "bytes_hex": "20 6c 65 73 73", "compression": {"rwkv": "11.55% 11.55% 11.55% 11.55% 11.55%", "qwen": "11.69% 11.69% 11.69% 11.69% 11.69%"}, "model_tokens": {"rwkv": [[31277, " less", "normal", 0.039583150297403336]], "qwen": [[2686, " less", "normal", 0.039091095328330994]]}, "loss": {"rwkv": 11.55283138211865, "qwen": 11.692540628633799}, "topk": {"rwkv": [31277, 2, 0.039583150297403336, [[31458, 0.95006, " more", false], [31277, 0.039583, " less", false], [51816, 0.004917, " further", false], [4712, 0.001683, " on", false], [31466, 0.000427, " much", false], [51918, 0.000408, " heavier", false], [45501, 0.000404, " closer", false], [51919, 0.000279, " heavily", false], [57326, 0.000274, " stronger", false], [4811, 0.000272, " to", false]]], "qwen": [2686, 2, 0.039091095328330994, [[803, 0.941949, " more", false], [2686, 0.039091, " less", false], [4623, 0.007461, " further", false], [1753, 0.002388, " much", false], [15750, 0.001907, " harder", false], [16245, 0.001344, " stronger", false], [16916, 0.000838, " heavily", false], [7046, 0.000763, " greater", false], [43822, 0.00046, " heavier", false], [389, 0.000449, " on", false]]]}, "raw_delta": -0.007747125625610307, "tuned_delta": -0.00040998711190757056}, {"byte_start": 3919, "byte_end": 3922, "display": {"text": " on", "kind": "normal"}, "is_word": true, "word_id": 659, "word_key": " on", "bytes_hex": "20 6f 6e", "compression": {"rwkv": "0.61% 0.61% 0.61%", "qwen": "0.46% 0.46% 0.46%"}, "model_tokens": {"rwkv": [[4712, " on", "normal", 0.9029704332351685]], "qwen": [[389, " on", "normal", 0.9263618588447571]]}, "loss": {"rwkv": 0.6134506501175808, "qwen": 0.45980081239096365}, "topk": {"rwkv": [4712, 1, 0.9029704332351685, [[4712, 0.90297, " on", false], [32226, 0.059543, " than", false], [32350, 0.017674, " upon", false], [56003, 0.006608, " directly", false], [45, 0.002621, ",", false], [51919, 0.002262, " heavily", false], [275, 0.00211, " (", false], [61983, 0.001594, " explicitly", false], [4596, 0.000422, " in", false], [4706, 0.000366, " of", false]]], "qwen": [389, 1, 0.9263618588447571, [[389, 0.926362, " on", false], [1091, 0.018097, " than", false], [16916, 0.015518, " heavily", false], [5193, 0.011774, " upon", false], [5961, 0.005576, " directly", false], [11, 0.004045, ",", false], [320, 0.002729, " (", false], [20975, 0.002665, " explicitly", false], [16510, 0.001793, " strongly", false], [3738, 0.001346, " human", false]]]}, "raw_delta": 0.008520156145095829, "tuned_delta": 0.015857294658798565}, {"byte_start": 3922, "byte_end": 3928, "display": {"text": " human", "kind": "normal"}, "is_word": true, "word_id": 660, "word_key": " human", "bytes_hex": "20 68 75 6d 61 6e", "compression": {"rwkv": "1.03% 1.03% 1.03% 1.03% 1.03% 1.03%", "qwen": "0.68% 0.68% 0.68% 0.68% 0.68% 0.68%"}, "model_tokens": {"rwkv": [[38720, " human", "normal", 0.7104966640472412]], "qwen": [[3738, " human", "normal", 0.7977262735366821]]}, "loss": {"rwkv": 1.0273097011538435, "qwen": 0.6792380897031334}, "topk": {"rwkv": [38720, 1, 0.7104966640472412, [[38720, 0.710497, " human", false], [59943, 0.049574, " knowledge", false], [22590, 0.039722, " the", false], [45775, 0.021586, " domain", false], [21273, 0.015534, " any", false], [52964, 0.013597, " special", false], [39356, 0.011022, " prior", false], [65034, 0.010673, " understanding", false], [63875, 0.010271, " specialized", false], [56179, 0.009066, " explicit", false]]], "qwen": [3738, 1, 0.7977262735366821, [[3738, 0.797726, " human", false], [279, 0.021198, " the", false], [3281, 0.020519, " special", false], [11464, 0.01508, " explicit", false], [894, 0.014222, " any", false], [6540, 0.0102, " knowledge", false], [28464, 0.009826, " statistical", false], [4867, 0.007139, " prior", false], [27076, 0.004095, " specialized", false], [70601, 0.003108, " exploiting", false]]]}, "raw_delta": 0.019301188488801326, "tuned_delta": 0.026638327002504063}, {"byte_start": 3928, "byte_end": 3938, "display": {"text": " knowledge", "kind": "normal"}, "is_word": true, "word_id": 661, "word_key": " knowledge", "bytes_hex": "20 6b 6e 6f 77 6c 65 64 67 65", "compression": {"rwkv": "0.43% 0.43% 0.43% 0.43% 0.43% 0.43% 0.43% 0.43% 0.43% 0.43%", "qwen": "0.48% 0.48% 0.48% 0.48% 0.48% 0.48% 0.48% 0.48% 0.48% 0.48%"}, "model_tokens": {"rwkv": [[59943, " knowledge", "normal", 0.7867221236228943]], "qwen": [[6540, " knowledge", "normal", 0.7678873538970947]]}, "loss": {"rwkv": 0.4314700744846143, "qwen": 0.4762917629958522}, "topk": {"rwkv": [59943, 1, 0.7867221236228943, [[59943, 0.786722, " knowledge", false], [46, 0.079664, "-", false], [65034, 0.070141, " understanding", false], [38786, 0.032533, " input", false], [59683, 0.005825, " expertise", false], [45775, 0.002413, " domain", false], [46297, 0.001813, " inputs", false], [63637, 0.001588, " information", false], [52022, 0.001151, " insight", false], [62182, 0.00099, " linguistic", false]]], "qwen": [6540, 1, 0.7678873538970947, [[6540, 0.767887, " knowledge", false], [12646, 0.131365, "-k", false], [8660, 0.05767, " understanding", false], [1946, 0.018732, " input", false], [18726, 0.002581, " expertise", false], [71107, 0.001571, "-under", false], [1995, 0.000701, " information", false], [7947, 0.000522, " domain", false], [56251, 0.000467, " intuition", false], [12, 0.000397, "-", false]]]}, "raw_delta": -0.002485442161560058, "tuned_delta": 0.004851696352142679}, {"byte_start": 3938, "byte_end": 3939, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "37.48%", "qwen": "43.23%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.1257818043231964]], "qwen": [[11, ",", "normal", 0.09096557646989822]]}, "loss": {"rwkv": 37.47625789809221, "qwen": 43.23169600531254}, "topk": {"rwkv": [45, 3, 0.1257818043231964, [[32226, 0.446972, " than", false], [21265, 0.161712, " and", false], [45, 0.125782, ",", false], [4706, 0.058024, " of", false], [47, 0.0563, ".", false], [5346, 0.035247, "---", false], [275, 0.02457, " (", false], [37598, 0.018296, " about", false], [4596, 0.013911, " in", false], [60, 0.006601, ";", false]]], "qwen": [11, 3, 0.09096557646989822, [[1091, 0.532951, " than", false], [323, 0.195286, " and", false], [11, 0.090966, ",", false], [315, 0.045367, " of", false], [13, 0.018696, ".", false], [382, 0.016803, ".\n\n", false], [320, 0.015955, " (", false], [911, 0.011983, " about", false], [4421, 0.009853, "---", false], [311, 0.009667, " to", false]]]}, "raw_delta": -0.3191492557525635, "tuned_delta": -0.31181211723886076}, {"byte_start": 3939, "byte_end": 3943, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 662, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"rwkv": "4.00% 4.00% 4.00% 4.00%", "qwen": "3.32% 3.32% 3.32% 3.32%"}, "model_tokens": {"rwkv": [[21265, " and", "normal", 0.40972328186035156]], "qwen": [[323, " and", "normal", 0.4790298044681549]]}, "loss": {"rwkv": 3.997702322775814, "qwen": 3.3181647414095763}, "topk": {"rwkv": [21265, 1, 0.40972328186035156, [[21265, 0.409723, " and", false], [21400, 0.127221, " but", false], [55495, 0.046636, " although", false], [39690, 0.030423, " since", false], [4423, 0.025623, " as", false], [40186, 0.022763, " which", false], [52700, 0.021096, " relying", false], [4788, 0.01828, " so", false], [30788, 0.01597, " even", false], [4596, 0.015598, " in", false]]], "qwen": [323, 1, 0.4790298044681549, [[323, 0.47903, " and", false], [714, 0.071377, " but", false], [476, 0.027249, " or", false], [892, 0.022689, " which", false], [304, 0.019728, " in", false], [1496, 0.017436, " even", false], [438, 0.01599, " as", false], [38561, 0.014133, " relying", false], [7892, 0.013545, " although", false], [525, 0.013027, " are", false]]]}, "raw_delta": 0.037681564688682556, "tuned_delta": 0.045018703202385296}, {"byte_start": 3943, "byte_end": 3947, "display": {"text": " use", "kind": "normal"}, "is_word": true, "word_id": 663, "word_key": " use", "bytes_hex": "20 75 73 65", "compression": {"rwkv": "21.27% 21.27% 21.27% 21.27%", "qwen": "18.30% 18.30% 18.30% 18.30%"}, "model_tokens": {"rwkv": [[22681, " use", "normal", 0.008943989872932434]], "qwen": [[990, " use", "normal", 0.017263662070035934]]}, "loss": {"rwkv": 21.274116325608734, "qwen": 18.300368609106183}, "topk": {"rwkv": [22681, 22, 0.008943989872932434, [[31458, 0.195224, " more", false], [21286, 0.112577, " are", false], [32232, 0.059744, " they", false], [30788, 0.043741, " even", false], [52028, 0.036818, " instead", false], [31059, 0.035388, " have", false], [22590, 0.026307, " the", false], [4596, 0.023552, " in", false], [31856, 0.020585, " rely", false], [4788, 0.019945, " so", false]]], "qwen": [990, 13, 0.017263662070035934, [[803, 0.107137, " more", false], [525, 0.079429, " are", false], [1496, 0.055057, " even", false], [1373, 0.044111, " require", false], [807, 0.043144, " they", false], [4518, 0.037029, " instead", false], [1753, 0.035006, " much", false], [304, 0.031479, " in", false], [614, 0.031112, " have", false], [279, 0.024103, " the", false]]]}, "raw_delta": 0.16489958763122559, "tuned_delta": 0.17223672614492833}, {"byte_start": 3947, "byte_end": 3952, "display": {"text": " even", "kind": "normal"}, "is_word": true, "word_id": 664, "word_key": " even", "bytes_hex": "20 65 76 65 6e", "compression": {"rwkv": "10.09% 10.09% 10.09% 10.09% 10.09%", "qwen": "5.53% 5.53% 5.53% 5.53% 5.53%"}, "model_tokens": {"rwkv": [[30788, " even", "normal", 0.061103008687496185]], "qwen": [[1496, " even", "normal", 0.2160256952047348]]}, "loss": {"rwkv": 10.087594231215798, "qwen": 5.52681297029586}, "topk": {"rwkv": [30788, 5, 0.061103008687496185, [[52195, 0.319995, " massive", false], [31466, 0.069509, " much", false], [31458, 0.068267, " more", false], [63370, 0.063059, " computation", false], [30788, 0.061103, " even", false], [21660, 0.032965, " far", false], [332, 0.028429, " a", false], [22590, 0.02719, " the", false], [31581, 0.023844, " only", false], [59988, 0.020461, " massively", false]]], "qwen": [1496, 1, 0.2160256952047348, [[1496, 0.216026, " even", false], [803, 0.132534, " more", false], [3041, 0.118427, " far", false], [1753, 0.10704, " much", false], [34447, 0.06405, " computation", false], [10951, 0.027769, " massive", false], [264, 0.02091, " a", false], [279, 0.015844, " the", false], [2058, 0.013601, " still", false], [1657, 0.013031, " many", false]]]}, "raw_delta": 0.25290341377258296, "tuned_delta": 0.2602405522862857}, {"byte_start": 3952, "byte_end": 3957, "display": {"text": " more", "kind": "normal"}, "is_word": true, "word_id": 665, "word_key": " more", "bytes_hex": "20 6d 6f 72 65", "compression": {"rwkv": "1.15% 1.15% 1.15% 1.15% 1.15%", "qwen": "0.44% 0.44% 0.44% 0.44% 0.44%"}, "model_tokens": {"rwkv": [[31458, " more", "normal", 0.7271632552146912]], "qwen": [[803, " more", "normal", 0.8862769603729248]]}, "loss": {"rwkv": 1.1482387288325244, "qwen": 0.4354261591556644}, "topk": {"rwkv": [31458, 1, 0.7271632552146912, [[31458, 0.727163, " more", false], [31277, 0.176446, " less", false], [46397, 0.021372, " larger", false], [38475, 0.020194, " fewer", false], [51867, 0.016147, " greater", false], [52195, 0.006165, " massive", false], [45305, 0.004498, " bigger", false], [31466, 0.00359, " much", false], [52932, 0.00272, " smaller", false], [51918, 0.002416, " heavier", false]]], "qwen": [803, 1, 0.8862769603729248, [[803, 0.886277, " more", false], [7046, 0.069768, " greater", false], [8131, 0.011515, " larger", false], [1753, 0.009957, " much", false], [2686, 0.005961, " less", false], [5080, 0.002148, " higher", false], [11243, 0.002051, " bigger", false], [19117, 0.001932, " deeper", false], [16745, 0.000835, " fewer", false], [3041, 0.000817, " far", false]]]}, "raw_delta": 0.03952672183513642, "tuned_delta": 0.04686386034883916}, {"byte_start": 3957, "byte_end": 3969, "display": {"text": " computation", "kind": "normal"}, "is_word": true, "word_id": 666, "word_key": " computation", "bytes_hex": "20 63 6f 6d 70 75 74 61 74 69 6f 6e", "compression": {"rwkv": "0.37% 0.37% 0.37% 0.37% 0.37% 0.37% 0.37% 0.37% 0.37% 0.37% 0.37% 0.37%", "qwen": "0.28% 0.28% 0.28% 0.28% 0.28% 0.28% 0.28% 0.28% 0.28% 0.28% 0.28% 0.28%"}, "model_tokens": {"rwkv": [[63370, " computation", "normal", 0.7805874347686768]], "qwen": [[34447, " computation", "normal", 0.8317679166793823]]}, "loss": {"rwkv": 0.37129907770274634, "qwen": 0.2768198933990527}, "topk": {"rwkv": [63370, 1, 0.7805874347686768, [[63370, 0.780587, " computation", false], [52195, 0.13006, " massive", false], [47202, 0.012025, " search", false], [4706, 0.010596, " of", false], [64862, 0.006968, " computational", false], [59346, 0.00659, " computing", false], [62577, 0.003879, " statistics", false], [51266, 0.00357, " compute", false], [64298, 0.003214, " computations", false], [63885, 0.003109, " statistical", false]]], "qwen": [34447, 1, 0.8317679166793823, [[34447, 0.831768, " computation", false], [10951, 0.075317, " massive", false], [54480, 0.013324, " computational", false], [315, 0.012591, " of", false], [24231, 0.011308, " computing", false], [7988, 0.004662, " powerful", false], [6366, 0.003931, " computer", false], [63707, 0.00252, " massively", false], [82599, 0.002164, " computations", false], [320, 0.001896, " (", false]]]}, "raw_delta": 0.005239038417736688, "tuned_delta": 0.012576176931439424}, {"byte_start": 3969, "byte_end": 3970, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "15.08%", "qwen": "14.02%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.43417292833328247]], "qwen": [[11, ",", "normal", 0.4596511125564575]]}, "loss": {"rwkv": 15.075036071788972, "qwen": 14.017361042139353}, "topk": {"rwkv": [45, 1, 0.43417292833328247, [[45, 0.434173, ",", false], [47, 0.295492, ".", false], [32226, 0.170528, " than", false], [275, 0.021811, " (", false], [4811, 0.01946, " to", false], [5346, 0.01261, "---", false], [21265, 0.00815, " and", false], [22278, 0.006299, " per", false], [4596, 0.005896, " in", false], [21700, 0.00346, " for", false]]], "qwen": [11, 1, 0.4596511125564575, [[11, 0.459651, ",", false], [13, 0.147939, ".", false], [382, 0.145457, ".\n\n", false], [1091, 0.121472, " than", false], [311, 0.033275, " to", false], [320, 0.017124, " (", false], [4421, 0.013298, "---", false], [323, 0.01034, " and", false], [817, 0.00947, " per", false], [304, 0.007553, " in", false]]]}, "raw_delta": 0.05864995718002319, "tuned_delta": 0.06598709569372593}, {"byte_start": 3970, "byte_end": 3979, "display": {"text": " together", "kind": "normal"}, "is_word": true, "word_id": 667, "word_key": " together", "bytes_hex": "20 74 6f 67 65 74 68 65 72", "compression": {"rwkv": "22.17% 22.17% 22.17% 22.17% 22.17% 22.17% 22.17% 22.17% 22.17%", "qwen": "21.58% 21.58% 21.58% 21.58% 21.58% 21.58% 21.58% 21.58% 21.58%"}, "model_tokens": {"rwkv": [[57435, " together", "normal", 1.5857367543503642e-05]], "qwen": [[3786, " together", "normal", 2.100588972098194e-05]]}, "loss": {"rwkv": 22.166408180325217, "qwen": 21.581732138615322}, "topk": {"rwkv": [57435, 296, 1.5857367543503642e-05, [[32226, 0.474321, " than", false], [21265, 0.16578, " and", false], [21400, 0.109608, " but", false], [4788, 0.056407, " so", false], [4811, 0.045508, " to", false], [40186, 0.022539, " which", false], [4596, 0.013858, " in", false], [22797, 0.009187, " yet", false], [46500, 0.008861, " making", false], [4423, 0.007222, " as", false]]], "qwen": [3786, 322, 2.100588972098194e-05, [[1091, 0.619293, " than", false], [323, 0.154646, " and", false], [311, 0.065051, " to", false], [714, 0.024441, " but", false], [304, 0.014371, " in", false], [773, 0.010733, " so", false], [7707, 0.007883, " compared", false], [892, 0.007188, " which", false], [438, 0.007071, " as", false], [369, 0.004787, " for", false]]]}, "raw_delta": 0.03242132398817277, "tuned_delta": 0.03975846250187551}, {"byte_start": 3979, "byte_end": 3984, "display": {"text": " with", "kind": "normal"}, "is_word": true, "word_id": 668, "word_key": " with", "bytes_hex": "20 77 69 74 68", "compression": {"rwkv": "0.66% 0.66% 0.66% 0.66% 0.66%", "qwen": "0.70% 0.70% 0.70% 0.70% 0.70%"}, "model_tokens": {"rwkv": [[32487, " with", "normal", 0.830287516117096]], "qwen": [[448, " with", "normal", 0.8225528001785278]]}, "loss": {"rwkv": 0.6621744816580203, "qwen": 0.7045495557269997}, "topk": {"rwkv": [32487, 1, 0.830287516117096, [[32487, 0.830288, " with", false], [47, 0.026157, ".", false], [4811, 0.01418, " to", false], [57581, 0.010707, " yielding", false], [45, 0.009215, ",", false], [38888, 0.007972, " lever", false], [4596, 0.007314, " in", false], [46500, 0.006793, " making", false], [56109, 0.006192, " enabling", false], [52107, 0.005627, " leading", false]]], "qwen": [448, 1, 0.8225528001785278, [[448, 0.822553, " with", false], [311, 0.044499, " to", false], [11, 0.017739, ",", false], [13, 0.012832, ".", false], [382, 0.012299, ".\n\n", false], [27362, 0.008633, " enabling", false], [304, 0.007544, " in", false], [3259, 0.00511, " making", false], [1091, 0.004741, " than", false], [6388, 0.00336, " leading", false]]]}, "raw_delta": -0.0023497730493545546, "tuned_delta": 0.004987365464348182}, {"byte_start": 3984, "byte_end": 3993, "display": {"text": " learning", "kind": "normal"}, "is_word": true, "word_id": 669, "word_key": " learning", "bytes_hex": "20 6c 65 61 72 6e 69 6e 67", "compression": {"rwkv": "7.39% 7.39% 7.39% 7.39% 7.39% 7.39% 7.39% 7.39% 7.39%", "qwen": "7.55% 7.55% 7.55% 7.55% 7.55% 7.55% 7.55% 7.55% 7.55%"}, "model_tokens": {"rwkv": [[56537, " learning", "normal", 0.025194142013788223]], "qwen": [[6832, " learning", "normal", 0.02309095859527588]]}, "loss": {"rwkv": 7.388802726775073, "qwen": 7.550733469424535}, "topk": {"rwkv": [56537, 5, 0.025194142013788223, [[52195, 0.27652, " massive", false], [22590, 0.073703, " the", false], [332, 0.062368, " a", false], [38864, 0.025759, " large", false], [56537, 0.025194, " learning", false], [39193, 0.023206, " other", false], [63885, 0.020234, " statistical", false], [31458, 0.020036, " more", false], [31466, 0.017728, " much", false], [31370, 0.014724, " many", false]]], "qwen": [6832, 7, 0.02309095859527588, [[264, 0.073963, " a", false], [803, 0.049149, " more", false], [279, 0.046292, " the", false], [1753, 0.030189, " much", false], [28464, 0.029183, " statistical", false], [1008, 0.024636, " other", false], [6832, 0.023091, " learning", false], [7988, 0.022235, " powerful", false], [5413, 0.020202, " methods", false], [1602, 0.01773, " very", false]]]}, "raw_delta": -0.008979347017076311, "tuned_delta": -0.0016422085033735746}, {"byte_start": 3993, "byte_end": 3996, "display": {"text": " on", "kind": "normal"}, "is_word": true, "word_id": 670, "word_key": " on", "bytes_hex": "20 6f 6e", "compression": {"rwkv": "33.81% 33.81% 33.81%", "qwen": "37.45% 37.45% 37.45%"}, "model_tokens": {"rwkv": [[4712, " on", "normal", 0.003603593911975622]], "qwen": [[389, " on", "normal", 0.001969738397747278]]}, "loss": {"rwkv": 33.81316502083508, "qwen": 37.44908463925589}, "topk": {"rwkv": [4712, 19, 0.003603593911975622, [[47, 0.31283, ".", false], [4450, 0.168776, " by", false], [45, 0.142332, ",", false], [30917, 0.071529, " from", false], [4811, 0.036992, " to", false], [4596, 0.035516, " in", false], [61559, 0.02911, " algorithms", false], [21265, 0.021435, " and", false], [52224, 0.020844, " methods", false], [62633, 0.019162, " techniques", false]]], "qwen": [389, 23, 0.001969738397747278, [[553, 0.332966, " by", false], [11, 0.146714, ",", false], [13, 0.082028, ".", false], [382, 0.066914, ".\n\n", false], [311, 0.0633, " to", false], [504, 0.056364, " from", false], [323, 0.042003, " and", false], [5413, 0.028665, " methods", false], [12538, 0.026802, " techniques", false], [304, 0.026564, " in", false]]]}, "raw_delta": -0.20161819458007812, "tuned_delta": -0.19428105606637538}, {"byte_start": 3996, "byte_end": 4001, "display": {"text": " huge", "kind": "normal"}, "is_word": true, "word_id": 671, "word_key": " huge", "bytes_hex": "20 68 75 67 65", "compression": {"rwkv": "12.34% 12.34% 12.34% 12.34% 12.34%", "qwen": "13.87% 13.87% 13.87% 13.87% 13.87%"}, "model_tokens": {"rwkv": [[31118, " huge", "normal", 0.03267655894160271]], "qwen": [[6765, " huge", "normal", 0.021390043199062347]]}, "loss": {"rwkv": 12.341805232604802, "qwen": 13.867291345757915}, "topk": {"rwkv": [31118, 5, 0.03267655894160271, [[52195, 0.54953, " massive", false], [22590, 0.080077, " the", false], [38864, 0.071143, " large", false], [332, 0.064951, " a", false], [31118, 0.032677, " huge", false], [31466, 0.020884, " much", false], [30579, 0.020855, " data", false], [32386, 0.020072, " very", false], [32373, 0.010383, " vast", false], [4419, 0.009547, " an", false]]], "qwen": [6765, 7, 0.021390043199062347, [[264, 0.206652, " a", false], [656, 0.19224, " self", false], [3460, 0.116152, " large", false], [10951, 0.100546, " massive", false], [279, 0.081583, " the", false], [821, 0.028143, " data", false], [6765, 0.02139, " huge", false], [1753, 0.014829, " much", false], [458, 0.013544, " an", false], [1602, 0.013479, " very", false]]]}, "raw_delta": -0.08459091186523438, "tuned_delta": -0.07725377335153163}, {"byte_start": 4001, "byte_end": 4010, "display": {"text": " training", "kind": "normal"}, "is_word": true, "word_id": 672, "word_key": " training", "bytes_hex": "20 74 72 61 69 6e 69 6e 67", "compression": {"rwkv": "8.95% 8.95% 8.95% 8.95% 8.95% 8.95% 8.95% 8.95% 8.95%", "qwen": "7.17% 7.17% 7.17% 7.17% 7.17% 7.17% 7.17% 7.17% 7.17%"}, "model_tokens": {"rwkv": [[57453, " training", "normal", 0.011415001004934311]], "qwen": [[4862, " training", "normal", 0.027948863804340363]]}, "loss": {"rwkv": 8.954227033295215, "qwen": 7.1681480302589184}, "topk": {"rwkv": [57453, 10, 0.011415001004934311, [[50897, 0.59368, " amounts", false], [55913, 0.090359, " datasets", false], [30579, 0.08765, " data", false], [59442, 0.031579, " databases", false], [45588, 0.026997, " corpor", false], [62426, 0.02394, " quantities", false], [45, 0.019075, ",", false], [53304, 0.0151, " volumes", false], [63344, 0.014619, " collections", false], [57453, 0.011415, " training", false]]], "qwen": [4862, 5, 0.027948863804340363, [[14713, 0.489025, " amounts", false], [29425, 0.179325, " datasets", false], [821, 0.127879, " data", false], [32676, 0.028737, " quantities", false], [4862, 0.027949, " training", false], [8368, 0.022283, " corpor", false], [31806, 0.017646, " databases", false], [11, 0.011832, ",", false], [26282, 0.008516, " volumes", false], [7289, 0.007055, " sets", false]]]}, "raw_delta": 0.09904125001695424, "tuned_delta": 0.10637838853065698}, {"byte_start": 4010, "byte_end": 4015, "display": {"text": " sets", "kind": "normal"}, "is_word": true, "word_id": 673, "word_key": " sets", "bytes_hex": "20 73 65 74 73", "compression": {"rwkv": "2.17% 2.17% 2.17% 2.17% 2.17%", "qwen": "1.70% 1.70% 1.70% 1.70% 1.70%"}, "model_tokens": {"rwkv": [[31989, " sets", "normal", 0.5484493970870972]], "qwen": [[7289, " sets", "normal", 0.6247401833534241]]}, "loss": {"rwkv": 2.1696780888369176, "qwen": 1.6966794711376174}, "topk": {"rwkv": [31989, 1, 0.5484493970870972, [[31989, 0.548449, " sets", false], [30579, 0.221441, " data", false], [55913, 0.135755, " datasets", false], [45588, 0.058894, " corpor", false], [59442, 0.01394, " databases", false], [63344, 0.00508, " collections", false], [52800, 0.004136, " samples", false], [56162, 0.001475, " examples", false], [45590, 0.001072, " corpus", false], [21265, 0.001021, " and", false]]], "qwen": [7289, 1, 0.6247401833534241, [[7289, 0.62474, " sets", false], [821, 0.205242, " data", false], [29425, 0.120632, " datasets", false], [8368, 0.01474, " corpor", false], [31806, 0.006376, " databases", false], [10469, 0.004582, " samples", false], [10295, 0.003663, " examples", false], [323, 0.003389, " and", false], [738, 0.002761, " set", false], [15302, 0.001929, " collections", false]]]}, "raw_delta": 0.0262286126613617, "tuned_delta": 0.03356575117506444}, {"byte_start": 4015, "byte_end": 4016, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "36.63%", "qwen": "25.69%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.1308417171239853]], "qwen": [[11, ",", "normal", 0.24055695533752441]]}, "loss": {"rwkv": 36.63092877257133, "qwen": 25.694371422421927}, "topk": {"rwkv": [45, 2, 0.1308417171239853, [[47, 0.591865, ".", false], [45, 0.130842, ",", false], [4706, 0.130779, " of", false], [32227, 0.02692, " that", false], [275, 0.018613, " (", false], [21265, 0.013443, " and", false], [4811, 0.012805, " to", false], [5346, 0.011624, "---", false], [30917, 0.008141, " from", false], [4596, 0.004446, " in", false]]], "qwen": [11, 2, 0.24055695533752441, [[13, 0.279001, ".", false], [11, 0.240557, ",", false], [382, 0.232527, ".\n\n", false], [311, 0.071379, " to", false], [315, 0.041802, " of", false], [320, 0.027236, " (", false], [323, 0.025563, " and", false], [429, 0.01288, " that", false], [304, 0.007643, " in", false], [4421, 0.006589, "---", false]]]}, "raw_delta": 0.6064515113830566, "tuned_delta": 0.6137886498967594}, {"byte_start": 4016, "byte_end": 4019, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 674, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "5.49% 5.49% 5.49%", "qwen": "5.31% 5.31% 5.31%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.40008628368377686]], "qwen": [[311, " to", "normal", 0.4131651222705841]]}, "loss": {"rwkv": 5.4946393158857, "qwen": 5.313373543145382}, "topk": {"rwkv": [4811, 1, 0.40008628368377686, [[4811, 0.400086, " to", false], [21265, 0.171663, " and", false], [32226, 0.068177, " than", false], [4788, 0.049148, " so", false], [40186, 0.042888, " which", false], [21400, 0.034776, " but", false], [4596, 0.024463, " in", false], [4423, 0.01694, " as", false], [21700, 0.014047, " for", false], [30322, 0.007939, " both", false]]], "qwen": [311, 1, 0.4131651222705841, [[311, 0.413165, " to", false], [1091, 0.289355, " than", false], [323, 0.077884, " and", false], [304, 0.044376, " in", false], [892, 0.016596, " which", false], [773, 0.008746, " so", false], [429, 0.00852, " that", false], [438, 0.008271, " as", false], [369, 0.007668, " for", false], [714, 0.007464, " but", false]]]}, "raw_delta": 0.01005150874455768, "tuned_delta": 0.017388647258260417}, {"byte_start": 4019, "byte_end": 4027, "display": {"text": " produce", "kind": "normal"}, "is_word": true, "word_id": 675, "word_key": " produce", "bytes_hex": "20 70 72 6f 64 75 63 65", "compression": {"rwkv": "7.15% 7.15% 7.15% 7.15% 7.15% 7.15% 7.15% 7.15%", "qwen": "6.17% 6.17% 6.17% 6.17% 6.17% 6.17% 6.17% 6.17%"}, "model_tokens": {"rwkv": [[52573, " produce", "normal", 0.04165380820631981]], "qwen": [[8193, " produce", "normal", 0.06479889154434204]]}, "loss": {"rwkv": 7.15007552003075, "qwen": 6.168573756231406}, "topk": {"rwkv": [52573, 4, 0.04165380820631981, [[50848, 0.167405, " achieve", false], [31358, 0.064706, " make", false], [51982, 0.042387, " improve", false], [52573, 0.041654, " produce", false], [22249, 0.03531, " out", false], [4491, 0.026123, " do", false], [45851, 0.022029, " enable", false], [30256, 0.021662, " beat", false], [39740, 0.021614, " solve", false], [52446, 0.017599, " perform", false]]], "qwen": [8193, 2, 0.06479889154434204, [[11075, 0.208723, " achieve", false], [8193, 0.064799, " produce", false], [1281, 0.043523, " make", false], [700, 0.042999, " out", false], [9382, 0.038458, " beat", false], [7269, 0.036169, " improve", false], [653, 0.031651, " do", false], [2736, 0.031527, " perform", false], [11625, 0.023982, " solve", false], [3960, 0.021608, " learn", false]]]}, "raw_delta": 0.05442601442337036, "tuned_delta": 0.0617631529370731}, {"byte_start": 4027, "byte_end": 4040, "display": {"text": " dramatically", "kind": "normal"}, "is_word": true, "word_id": 676, "word_key": " dramatically", "bytes_hex": "20 64 72 61 6d 61 74 69 63 61 6c 6c 79", "compression": {"rwkv": "7.63% 7.63% 7.63% 7.63% 7.63% 7.63% 7.63% 7.63% 7.63% 7.63% 7.63% 7.63% 7.63%", "qwen": "6.95% 6.95% 6.95% 6.95% 6.95% 6.95% 6.95% 6.95% 6.95% 6.95% 6.95% 6.95% 6.95%"}, "model_tokens": {"rwkv": [[64374, " dramatically", "normal", 0.004101419355720282]], "qwen": [[27957, " dramatically", "normal", 0.006656334735453129]]}, "loss": {"rwkv": 7.6296372354704785, "qwen": 6.952938422064054}, "topk": {"rwkv": [64374, 46, 0.004101419355720282, [[62084, 0.066708, " impressive", false], [45301, 0.066277, " better", false], [22590, 0.055195, " the", false], [52738, 0.054471, " results", false], [39802, 0.047672, " state", false], [32386, 0.043973, " very", false], [30992, 0.039737, " good", false], [31466, 0.029783, " much", false], [30789, 0.024371, " ever", false], [62477, 0.021786, " remarkable", false]]], "qwen": [27957, 33, 0.006656334735453129, [[1584, 0.126618, " state", false], [2664, 0.055133, " better", false], [15978, 0.047918, " impressive", false], [3059, 0.047126, " results", false], [279, 0.040378, " the", false], [1602, 0.028198, " very", false], [9073, 0.027886, " excellent", false], [22804, 0.027785, " remarkable", false], [264, 0.025321, " a", false], [5942, 0.022768, " systems", false]]]}, "raw_delta": 0.037524149968073905, "tuned_delta": 0.044861288481776646}, {"byte_start": 4040, "byte_end": 4047, "display": {"text": " better", "kind": "normal"}, "is_word": true, "word_id": 677, "word_key": " better", "bytes_hex": "20 62 65 74 74 65 72", "compression": {"rwkv": "1.43% 1.43% 1.43% 1.43% 1.43% 1.43% 1.43%", "qwen": "1.41% 1.41% 1.41% 1.41% 1.41% 1.41% 1.41%"}, "model_tokens": {"rwkv": [[45301, " better", "normal", 0.5748533010482788]], "qwen": [[2664, " better", "normal", 0.5791397094726562]]}, "loss": {"rwkv": 1.429008759809101, "qwen": 1.4071724911633026}, "topk": {"rwkv": [45301, 1, 0.5748533010482788, [[45301, 0.574853, " better", false], [56418, 0.2252, " improved", false], [31458, 0.080288, " more", false], [57350, 0.043212, " superior", false], [46198, 0.018633, " higher", false], [51867, 0.008587, " greater", false], [62603, 0.00544, " successful", false], [59593, 0.004992, " effective", false], [30992, 0.004073, " good", false], [57326, 0.003806, " stronger", false]]], "qwen": [2664, 1, 0.5791397094726562, [[2664, 0.57914, " better", false], [12944, 0.182639, " improved", false], [803, 0.081216, " more", false], [16353, 0.067956, " superior", false], [5080, 0.019567, " higher", false], [7046, 0.011218, " greater", false], [7172, 0.005289, " increased", false], [700, 0.005247, " out", false], [4722, 0.005004, " lower", false], [6849, 0.004503, " successful", false]]]}, "raw_delta": 0.001210859843662801, "tuned_delta": 0.008547998357365538}, {"byte_start": 4047, "byte_end": 4054, "display": {"text": " speech", "kind": "normal"}, "is_word": true, "word_id": 678, "word_key": " speech", "bytes_hex": "20 73 70 65 65 63 68", "compression": {"rwkv": "6.76% 6.76% 6.76% 6.76% 6.76% 6.76% 6.76%", "qwen": "6.50% 6.50% 6.50% 6.50% 6.50% 6.50% 6.50%"}, "model_tokens": {"rwkv": [[47350, " speech", "normal", 0.07323822379112244]], "qwen": [[8806, " speech", "normal", 0.08017592877149582]]}, "loss": {"rwkv": 6.762633004167015, "qwen": 6.501226745540583}, "topk": {"rwkv": [47350, 3, 0.07323822379112244, [[52738, 0.441623, " results", false], [63750, 0.364011, " performance", false], [47350, 0.073238, " speech", false], [53087, 0.032595, " systems", false], [63821, 0.013132, " recognition", false], [52224, 0.006591, " methods", false], [55434, 0.005165, " accuracy", false], [32497, 0.00488, " word", false], [46587, 0.004404, " models", false], [56529, 0.003663, " language", false]]], "qwen": [8806, 3, 0.08017592877149582, [[3059, 0.494967, " results", false], [5068, 0.302497, " performance", false], [8806, 0.080176, " speech", false], [17843, 0.031126, " recognition", false], [5942, 0.018468, " systems", false], [4119, 0.010573, " models", false], [23675, 0.008674, " performances", false], [13403, 0.006383, " accuracy", false], [8084, 0.002414, " overall", false], [12205, 0.002009, " scores", false]]]}, "raw_delta": 0.014495440891810818, "tuned_delta": 0.021832579405513555}, {"byte_start": 4054, "byte_end": 4066, "display": {"text": " recognition", "kind": "normal"}, "is_word": true, "word_id": 679, "word_key": " recognition", "bytes_hex": "20 72 65 63 6f 67 6e 69 74 69 6f 6e", "compression": {"rwkv": "0.23% 0.23% 0.23% 0.23% 0.23% 0.23% 0.23% 0.23% 0.23% 0.23% 0.23% 0.23%", "qwen": "0.31% 0.31% 0.31% 0.31% 0.31% 0.31% 0.31% 0.31% 0.31% 0.31% 0.31% 0.31%"}, "model_tokens": {"rwkv": [[63821, " recognition", "normal", 0.8591951131820679]], "qwen": [[17843, " recognition", "normal", 0.8116647601127625]]}, "loss": {"rwkv": 0.22747571954120818, "qwen": 0.3135876343703854}, "topk": {"rwkv": [63821, 1, 0.8591951131820679, [[63821, 0.859195, " recognition", false], [46, 0.073035, "-", false], [65034, 0.016651, " understanding", false], [60335, 0.014778, " recognize", false], [53087, 0.010334, " systems", false], [62378, 0.005226, " processing", false], [21265, 0.003966, " and", false], [46587, 0.002291, " models", false], [64591, 0.001432, " technologies", false], [62634, 0.001033, " technology", false]]], "qwen": [17843, 1, 0.8116647601127625, [[17843, 0.811665, " recognition", false], [59172, 0.117195, "-rec", false], [5829, 0.02908, " recogn", false], [12, 0.015159, "-", false], [323, 0.003871, " and", false], [4686, 0.00245, "-to", false], [5504, 0.001691, "-re", false], [45840, 0.001459, " transcription", false], [8660, 0.001436, " understanding", false], [93159, 0.001286, " recognizer", false]]]}, "raw_delta": -0.00477505847811699, "tuned_delta": 0.0025620800355857466}, {"byte_start": 4066, "byte_end": 4074, "display": {"text": " systems", "kind": "normal"}, "is_word": true, "word_id": 680, "word_key": " systems", "bytes_hex": "20 73 79 73 74 65 6d 73", "compression": {"rwkv": "2.38% 2.38% 2.38% 2.38% 2.38% 2.38% 2.38% 2.38%", "qwen": "2.70% 2.70% 2.70% 2.70% 2.70% 2.70% 2.70% 2.70%"}, "model_tokens": {"rwkv": [[53087, " systems", "normal", 0.35357731580734253]], "qwen": [[5942, " systems", "normal", 0.3021843433380127]]}, "loss": {"rwkv": 2.3774881655274664, "qwen": 2.6976548304941583}, "topk": {"rwkv": [53087, 1, 0.35357731580734253, [[53087, 0.353577, " systems", false], [47, 0.223317, ".", false], [63750, 0.130777, " performance", false], [52738, 0.077695, " results", false], [32226, 0.076461, " than", false], [45, 0.017904, ",", false], [21265, 0.017826, " and", false], [55434, 0.014072, " accuracy", false], [51616, 0.012537, " engines", false], [46587, 0.007277, " models", false]]], "qwen": [5942, 1, 0.3021843433380127, [[5942, 0.302184, " systems", false], [1091, 0.180007, " than", false], [5068, 0.14868, " performance", false], [3059, 0.097481, " results", false], [13, 0.070357, ".", false], [382, 0.070091, ".\n\n", false], [13403, 0.015708, " accuracy", false], [11, 0.015176, ",", false], [323, 0.009859, " and", false], [12205, 0.008681, " scores", false]]]}, "raw_delta": -0.017753809690475464, "tuned_delta": -0.010416671176772727}, {"byte_start": 4074, "byte_end": 4075, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "5.99%", "qwen": "24.80%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.7156290411949158]], "qwen": [[13, ".", "normal", 0.25276753306388855]]}, "loss": {"rwkv": 5.987747972439545, "qwen": 24.80146114675672}, "topk": {"rwkv": [47, 1, 0.7156290411949158, [[47, 0.715629, ".", false], [32226, 0.194009, " than", false], [45, 0.027391, ",", false], [275, 0.00763, " (", false], [32227, 0.007084, " that", false], [5346, 0.00673, "---", false], [21265, 0.0064, " and", false], [4596, 0.005224, " in", false], [21700, 0.004296, " for", false], [39971, 0.002936, " today", false]]], "qwen": [13, 3, 0.25276753306388855, [[1091, 0.349262, " than", false], [382, 0.288776, ".\n\n", false], [13, 0.252768, ".", false], [11, 0.031671, ",", false], [320, 0.011297, " (", false], [304, 0.010227, " in", false], [624, 0.006941, ".\n", false], [429, 0.005702, " that", false], [4421, 0.005591, "---", false], [3351, 0.003167, " today", false]]]}, "raw_delta": -1.043253779411316, "tuned_delta": -1.0359166408976133}, {"byte_start": 4075, "byte_end": 4078, "display": {"text": " As", "kind": "normal"}, "is_word": true, "word_id": 681, "word_key": " as", "bytes_hex": "20 41 73", "compression": {"rwkv": "31.37% 31.37% 31.37%", "qwen": "25.03% 25.03% 25.03%"}, "model_tokens": {"rwkv": [[3641, " As", "normal", 0.005346032790839672]], "qwen": [[1634, " As", "normal", 0.015550422482192516]]}, "loss": {"rwkv": 31.371103102663653, "qwen": 25.028761300675168}, "topk": {"rwkv": [3641, 14, 0.005346032790839672, [[261, 0.673398, "\n\n", false], [20996, 0.042097, " The", false], [267, 0.026973, "  ", false], [29894, 0.017037, " This", false], [3913, 0.01496, " In", false], [3918, 0.013152, " It", false], [36251, 0.010115, " Again", false], [37453, 0.010021, " These", false], [275, 0.009955, " (", false], [3336, 0.008028, " \n\n", false]]], "qwen": [1634, 11, 0.015550422482192516, [[576, 0.121241, " The", false], [220, 0.096089, " ", false], [1096, 0.088579, " This", false], [758, 0.065973, " In", false], [1084, 0.043178, " It", false], [18183, 0.032035, " Deep", false], [4220, 0.031349, " These", false], [2619, 0.029938, " There", false], [320, 0.023987, " (", false], [362, 0.016137, " A", false]]]}, "raw_delta": 0.35169410705566406, "tuned_delta": 0.3590312455693668}, {"byte_start": 4078, "byte_end": 4081, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 682, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "7.94% 7.94% 7.94%", "qwen": "7.85% 7.85% 7.85%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.2690526247024536]], "qwen": [[304, " in", "normal", 0.27106383442878723]]}, "loss": {"rwkv": 7.936701234057122, "qwen": 7.847064593021805}, "topk": {"rwkv": [4596, 1, 0.2690526247024536, [[4596, 0.269053, " in", false], [32487, 0.263461, " with", false], [332, 0.055132, " a", false], [22590, 0.037816, " the", false], [45150, 0.025136, " always", false], [45285, 0.016494, " before", false], [47350, 0.015808, " speech", false], [21700, 0.015373, " for", false], [31458, 0.014574, " more", false], [4858, 0.013873, " we", false]]], "qwen": [304, 1, 0.27106383442878723, [[304, 0.271064, " in", false], [448, 0.141271, " with", false], [264, 0.106352, " a", false], [279, 0.039938, " the", false], [582, 0.020754, " we", false], [315, 0.019944, " of", false], [374, 0.018514, " is", false], [369, 0.016189, " for", false], [419, 0.014837, " this", false], [458, 0.012199, " an", false]]]}, "raw_delta": 0.004970510800679562, "tuned_delta": 0.012307649314382298}, {"byte_start": 4081, "byte_end": 4085, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 683, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "7.71% 7.71% 7.71% 7.71%", "qwen": "8.97% 8.97% 8.97% 8.97%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.17879702150821686]], "qwen": [[279, " the", "normal", 0.13674281537532806]]}, "loss": {"rwkv": 7.713628270378002, "qwen": 8.970197473629971}, "topk": {"rwkv": [22590, 3, 0.17879702150821686, [[55809, 0.350383, " computer", false], [38013, 0.20892, " chess", false], [22590, 0.178797, " the", false], [3851, 0.050429, " Go", false], [39193, 0.050043, " other", false], [31370, 0.022637, " many", false], [21256, 0.020314, " all", false], [30322, 0.011292, " both", false], [47202, 0.010976, " search", false], [47350, 0.00983, " speech", false]]], "qwen": [279, 3, 0.13674281537532806, [[6366, 0.37974, " computer", false], [5994, 0.182268, " Go", false], [279, 0.136743, " the", false], [32719, 0.101986, " chess", false], [1008, 0.060014, " other", false], [678, 0.031429, " all", false], [1657, 0.026397, " many", false], [8806, 0.014696, " speech", false], [5810, 0.004728, " natural", false], [773, 0.004164, " so", false]]]}, "raw_delta": -0.06967899203300476, "tuned_delta": -0.06234185351930202}, {"byte_start": 4085, "byte_end": 4091, "display": {"text": " games", "kind": "normal"}, "is_word": true, "word_id": 684, "word_key": " games", "bytes_hex": "20 67 61 6d 65 73", "compression": {"rwkv": "15.59% 15.59% 15.59% 15.59% 15.59% 15.59%", "qwen": "18.95% 18.95% 18.95% 18.95% 18.95% 18.95%"}, "model_tokens": {"rwkv": [[38576, " games", "normal", 0.005593450274318457]], "qwen": [[3868, " games", "normal", 0.0018289807485416532]]}, "loss": {"rwkv": 15.591626092940619, "qwen": 18.947384539917156}, "topk": {"rwkv": [38576, 17, 0.005593450274318457, [[39193, 0.339949, " other", false], [51551, 0.095615, " earlier", false], [38013, 0.090456, " chess", false], [30405, 0.089105, " case", false], [56926, 0.064375, " previous", false], [22638, 0.046427, " two", false], [55809, 0.041956, " computer", false], [37970, 0.033242, " cases", false], [3851, 0.014962, " Go", false], [56162, 0.012521, " examples", false]]], "qwen": [3868, 27, 0.0018289807485416532, [[1142, 0.338963, " case", false], [1008, 0.280844, " other", false], [6788, 0.07526, " earlier", false], [5994, 0.053692, " Go", false], [5048, 0.035354, " cases", false], [3681, 0.027521, " previous", false], [6366, 0.026768, " computer", false], [32719, 0.01479, " chess", false], [2070, 0.011252, " field", false], [4124, 0.01084, " early", false]]]}, "raw_delta": -0.18608276049296057, "tuned_delta": -0.17874562197925783}, {"byte_start": 4091, "byte_end": 4092, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "13.38%", "qwen": "13.51%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.47374916076660156]], "qwen": [[11, ",", "normal", 0.472660630941391]]}, "loss": {"rwkv": 13.384377820747218, "qwen": 13.514041990582097}, "topk": {"rwkv": [45, 1, 0.47374916076660156, [[45, 0.473749, ",", false], [4706, 0.155646, " of", false], [37599, 0.070401, " above", false], [21265, 0.054118, " and", false], [60003, 0.05406, " mentioned", false], [59546, 0.022803, " discussed", false], [56162, 0.019851, " examples", false], [31198, 0.014238, " just", false], [37970, 0.012037, " cases", false], [59488, 0.009612, " described", false]]], "qwen": [11, 1, 0.472660630941391, [[11, 0.472661, ",", false], [323, 0.207851, " and", false], [315, 0.160039, " of", false], [9733, 0.033301, " mentioned", false], [3403, 0.018764, " above", false], [14078, 0.015981, " discussed", false], [7947, 0.012767, " domain", false], [2070, 0.006106, " field", false], [7481, 0.005491, " described", false], [3110, 0.005347, " example", false]]]}, "raw_delta": -0.007190108299255371, "tuned_delta": 0.0001470302144473655}, {"byte_start": 4092, "byte_end": 4104, "display": {"text": " researchers", "kind": "normal"}, "is_word": true, "word_id": 685, "word_key": " researchers", "bytes_hex": "20 72 65 73 65 61 72 63 68 65 72 73", "compression": {"rwkv": "5.80% 5.80% 5.80% 5.80% 5.80% 5.80% 5.80% 5.80% 5.80% 5.80% 5.80% 5.80%", "qwen": "6.37% 6.37% 6.37% 6.37% 6.37% 6.37% 6.37% 6.37% 6.37% 6.37% 6.37% 6.37%"}, "model_tokens": {"rwkv": [[63843, " researchers", "normal", 0.020761338993906975]], "qwen": [[11811, " researchers", "normal", 0.014395827427506447]]}, "loss": {"rwkv": 5.799897055657128, "qwen": 6.3731309960591975}, "topk": {"rwkv": [63843, 9, 0.020761338993906975, [[22590, 0.324049, " the", false], [39934, 0.057332, " there", false], [4601, 0.055698, " it", false], [32234, 0.04643, " this", false], [39936, 0.046105, " these", false], [38720, 0.040781, " human", false], [30597, 0.034473, " deep", false], [56537, 0.030556, " learning", false], [63843, 0.020761, " researchers", false], [47202, 0.01898, " search", false]]], "qwen": [11811, 14, 0.014395827427506447, [[279, 0.297215, " the", false], [1052, 0.067666, " there", false], [419, 0.066505, " this", false], [432, 0.041822, " it", false], [304, 0.040851, " in", false], [3738, 0.033822, " human", false], [323, 0.022787, " and", false], [2711, 0.02126, " search", false], [264, 0.019594, " a", false], [6832, 0.018681, " learning", false]]]}, "raw_delta": -0.03178683916727704, "tuned_delta": -0.0244497006535743}, {"byte_start": 4104, "byte_end": 4111, "display": {"text": " always", "kind": "normal"}, "is_word": true, "word_id": 686, "word_key": " always", "bytes_hex": "20 61 6c 77 61 79 73", "compression": {"rwkv": "22.86% 22.86% 22.86% 22.86% 22.86% 22.86% 22.86%", "qwen": "22.92% 22.92% 22.92% 22.92% 22.92% 22.92% 22.92%"}, "model_tokens": {"rwkv": [[45150, " always", "normal", 0.00014360311615746468]], "qwen": [[2677, " always", "normal", 0.0001365811040159315]]}, "loss": {"rwkv": 22.864140156945616, "qwen": 22.924918825760535}, "topk": {"rwkv": [45150, 271, 0.00014360311615746468, [[22762, 0.231798, " who", false], [40, 0.215984, "'", false], [32462, 0.046399, " were", false], [4596, 0.037299, " in", false], [59868, 0.035655, " initially", false], [31059, 0.028743, " have", false], [21286, 0.027631, " are", false], [32487, 0.024042, " with", false], [4424, 0.018055, " at", false], [21795, 0.014186, " had", false]]], "qwen": [2677, 263, 0.0001365811040159315, [[6, 0.21676, "'", false], [879, 0.110363, " who", false], [15102, 0.091388, " initially", false], [304, 0.081451, " in", false], [1033, 0.065001, " were", false], [1030, 0.022644, " had", false], [614, 0.022178, " have", false], [525, 0.016846, " are", false], [9498, 0.013413, " learned", false], [6009, 0.011756, " began", false]]]}, "raw_delta": -0.0033702850341796875, "tuned_delta": 0.003966853479523049}, {"byte_start": 4111, "byte_end": 4117, "display": {"text": " tried", "kind": "normal"}, "is_word": true, "word_id": 687, "word_key": " tried", "bytes_hex": "20 74 72 69 65 64", "compression": {"rwkv": "13.99% 13.99% 13.99% 13.99% 13.99% 13.99%", "qwen": "9.37% 9.37% 9.37% 9.37% 9.37% 9.37%"}, "model_tokens": {"rwkv": [[40013, " tried", "normal", 0.009544571861624718]], "qwen": [[6679, " tried", "normal", 0.04428163915872574]]}, "loss": {"rwkv": 13.994893300290073, "qwen": 9.369057308579267}, "topk": {"rwkv": [40013, 19, 0.009544571861624718, [[21795, 0.049614, " had", false], [31059, 0.048313, " have", false], [47763, 0.038581, " wanted", false], [31967, 0.031986, " seem", false], [32216, 0.02642, " tend", false], [32435, 0.026115, " want", false], [55800, 0.024827, " complain", false], [47211, 0.024019, " seemed", false], [22441, 0.020016, " say", false], [38709, 0.016603, " hoped", false]]], "qwen": [6679, 4, 0.04428163915872574, [[4829, 0.168017, " wanted", false], [1030, 0.070548, " had", false], [3381, 0.049538, " thought", false], [6679, 0.044282, " tried", false], [6966, 0.036923, " looked", false], [9324, 0.036395, " seemed", false], [11585, 0.032255, " believed", false], [2803, 0.022574, " seem", false], [14890, 0.019978, " preferred", false], [3855, 0.018211, " started", false]]]}, "raw_delta": 0.2565108140309651, "tuned_delta": 0.2638479525446678}, {"byte_start": 4117, "byte_end": 4120, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 688, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "1.38% 1.38% 1.38%", "qwen": "1.01% 1.01% 1.01%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.7926995158195496]], "qwen": [[311, " to", "normal", 0.8456106185913086]]}, "loss": {"rwkv": 1.3795301701208755, "qwen": 1.0080607221046183}, "topk": {"rwkv": [4811, 1, 0.7926995158195496, [[4811, 0.7927, " to", false], [22590, 0.032338, " the", false], [52224, 0.022774, " methods", false], [38720, 0.015733, " human", false], [39931, 0.012373, " their", false], [22249, 0.01072, " out", false], [46162, 0.007815, " harder", false], [21700, 0.007753, " for", false], [45, 0.007359, ",", false], [31048, 0.007181, " hard", false]]], "qwen": [311, 1, 0.8456106185913086, [[311, 0.845611, " to", false], [1156, 0.02425, " first", false], [3738, 0.017506, " human", false], [369, 0.011429, " for", false], [5413, 0.009274, " methods", false], [2588, 0.007665, " hard", false], [279, 0.006218, " the", false], [862, 0.005177, " their", false], [11, 0.004996, ",", false], [15750, 0.004074, " harder", false]]]}, "raw_delta": 0.020598640044530228, "tuned_delta": 0.027935778558232965}, {"byte_start": 4120, "byte_end": 4125, "display": {"text": " make", "kind": "normal"}, "is_word": true, "word_id": 689, "word_key": " make", "bytes_hex": "20 6d 61 6b 65", "compression": {"rwkv": "13.36% 13.36% 13.36% 13.36% 13.36%", "qwen": "12.03% 12.03% 12.03% 12.03% 12.03%"}, "model_tokens": {"rwkv": [[31358, " make", "normal", 0.024724485352635384]], "qwen": [[1281, " make", "normal", 0.035619549453258514]]}, "loss": {"rwkv": 13.356200183229856, "qwen": 12.027967851657332}, "topk": {"rwkv": [31358, 10, 0.024724485352635384, [[22681, 0.070932, " use", false], [30858, 0.060071, " find", false], [32187, 0.036052, " take", false], [56540, 0.033684, " leverage", false], [51982, 0.032439, " improve", false], [37786, 0.030173, " avoid", false], [21751, 0.029647, " get", false], [37730, 0.026848, " apply", false], [63623, 0.025887, " incorporate", false], [31358, 0.024724, " make", false]]], "qwen": [1281, 5, 0.035619549453258514, [[5648, 0.15674, " avoid", false], [32064, 0.111753, " leverage", false], [990, 0.087157, " use", false], [1896, 0.074023, " take", false], [1281, 0.03562, " make", false], [653, 0.034822, " do", false], [1477, 0.031611, " find", false], [32194, 0.024721, " exploit", false], [3164, 0.023025, " win", false], [633, 0.018305, " get", false]]]}, "raw_delta": 0.07365283966064451, "tuned_delta": 0.08098997817434725}, {"byte_start": 4125, "byte_end": 4133, "display": {"text": " systems", "kind": "normal"}, "is_word": true, "word_id": 690, "word_key": " systems", "bytes_hex": "20 73 79 73 74 65 6d 73", "compression": {"rwkv": "12.82% 12.82% 12.82% 12.82% 12.82% 12.82% 12.82% 12.82%", "qwen": "12.37% 12.37% 12.37% 12.37% 12.37% 12.37% 12.37% 12.37%"}, "model_tokens": {"rwkv": [[53087, " systems", "normal", 0.0033729735296219587]], "qwen": [[5942, " systems", "normal", 0.00414033979177475]]}, "loss": {"rwkv": 12.820825070399966, "qwen": 12.368805218920382}, "topk": {"rwkv": [53087, 27, 0.0033729735296219587, [[39931, 0.301869, " their", false], [22590, 0.167614, " the", false], [22681, 0.092129, " use", false], [38720, 0.046806, " human", false], [332, 0.04457, " a", false], [32157, 0.023781, " sure", false], [39631, 0.023422, " sense", false], [56950, 0.020668, " progress", false], [4601, 0.018862, " it", false], [52224, 0.018507, " methods", false]]], "qwen": [5942, 23, 0.00414033979177475, [[279, 0.224454, " the", false], [862, 0.147851, " their", false], [990, 0.093358, " use", false], [8806, 0.070922, " speech", false], [264, 0.043604, " a", false], [5098, 0.03824, " progress", false], [2664, 0.030784, " better", false], [5413, 0.026733, " methods", false], [653, 0.021345, " do", false], [3738, 0.020873, " human", false]]]}, "raw_delta": 0.025065302848815918, "tuned_delta": 0.03240244136251866}, {"byte_start": 4133, "byte_end": 4138, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 691, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"rwkv": "1.96% 1.96% 1.96% 1.96% 1.96%", "qwen": "2.36% 2.36% 2.36% 2.36% 2.36%"}, "model_tokens": {"rwkv": [[32227, " that", "normal", 0.5841537714004517]], "qwen": [[429, " that", "normal", 0.5194821357727051]]}, "loss": {"rwkv": 1.9583458074566982, "qwen": 2.3621350593066297}, "topk": {"rwkv": [32227, 1, 0.5841537714004517, [[32227, 0.584154, " that", false], [37810, 0.09359, " based", false], [32499, 0.04095, " work", false], [32487, 0.028981, " with", false], [45301, 0.027356, " better", false], [31458, 0.027223, " more", false], [40085, 0.017473, " using", false], [21700, 0.014944, " for", false], [4491, 0.008561, " do", false], [4423, 0.008094, " as", false]]], "qwen": [429, 1, 0.5194821357727051, [[429, 0.519482, " that", false], [3118, 0.150236, " based", false], [2664, 0.058277, " better", false], [803, 0.051618, " more", false], [448, 0.026351, " with", false], [975, 0.020437, " work", false], [9902, 0.015163, " ``", false], [1667, 0.007924, " using", false], [438, 0.006488, " as", false], [369, 0.006078, " for", false]]]}, "raw_delta": -0.02239083051681519, "tuned_delta": -0.015053692003112452}, {"byte_start": 4138, "byte_end": 4145, "display": {"text": " worked", "kind": "normal"}, "is_word": true, "word_id": 692, "word_key": " worked", "bytes_hex": "20 77 6f 72 6b 65 64", "compression": {"rwkv": "7.57% 7.57% 7.57% 7.57% 7.57% 7.57% 7.57%", "qwen": "8.39% 8.39% 8.39% 8.39% 8.39% 8.39% 8.39%"}, "model_tokens": {"rwkv": [[47812, " worked", "normal", 0.05263246223330498]], "qwen": [[6439, " worked", "normal", 0.03847305104136467]]}, "loss": {"rwkv": 7.567708361805946, "qwen": 8.392871293065653}, "topk": {"rwkv": [47812, 6, 0.05263246223330498, [[32462, 0.132947, " were", false], [32354, 0.102237, " used", false], [40219, 0.082876, " would", false], [38128, 0.079171, " could", false], [21532, 0.070121, " did", false], [47812, 0.052632, " worked", false], [47054, 0.040616, " relied", false], [32272, 0.033577, " took", false], [56540, 0.024957, " leverage", false], [31351, 0.020888, " made", false]]], "qwen": [6439, 8, 0.03847305104136467, [[1033, 0.177715, " were", false], [1035, 0.086483, " would", false], [3867, 0.082084, " took", false], [1483, 0.047169, " used", false], [39913, 0.046838, " relied", false], [1410, 0.041457, " could", false], [27505, 0.03997, " lever", false], [6439, 0.038473, " worked", false], [1521, 0.032498, " did", false], [50663, 0.028108, " exploited", false]]]}, "raw_delta": -0.04575674874441965, "tuned_delta": -0.03841961023071691}, {"byte_start": 4145, "byte_end": 4149, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 693, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "19.58% 19.58% 19.58% 19.58%", "qwen": "25.85% 25.85% 25.85% 25.85%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.013219756074249744]], "qwen": [[279, " the", "normal", 0.0032348092645406723]]}, "loss": {"rwkv": 19.58345807456698, "qwen": 25.850323140441187}, "topk": {"rwkv": [22590, 13, 0.013219756074249744, [[32458, 0.281611, " well", false], [32487, 0.123935, " with", false], [4596, 0.089131, " in", false], [4450, 0.06794, " by", false], [45301, 0.066695, " better", false], [4712, 0.058427, " on", false], [53356, 0.037894, " without", false], [21700, 0.035453, " for", false], [4423, 0.028863, " as", false], [37810, 0.028259, " based", false]]], "qwen": [279, 28, 0.0032348092645406723, [[1632, 0.210527, " well", false], [553, 0.183147, " by", false], [2664, 0.122462, " better", false], [448, 0.090211, " with", false], [389, 0.036326, " on", false], [1850, 0.034978, " best", false], [2041, 0.032927, " without", false], [304, 0.030127, " in", false], [3118, 0.029257, " based", false], [1667, 0.022388, " using", false]]]}, "raw_delta": -0.3475087881088257, "tuned_delta": -0.34017164959512297}, {"byte_start": 4149, "byte_end": 4153, "display": {"text": " way", "kind": "normal"}, "is_word": true, "word_id": 694, "word_key": " way", "bytes_hex": "20 77 61 79", "compression": {"rwkv": "1.11% 1.11% 1.11% 1.11%", "qwen": "1.80% 1.80% 1.80% 1.80%"}, "model_tokens": {"rwkv": [[22752, " way", "normal", 0.7833326458930969]], "qwen": [[1616, " way", "normal", 0.6703117489814758]]}, "loss": {"rwkv": 1.105091721384063, "qwen": 1.8034244536221318}, "topk": {"rwkv": [22752, 1, 0.7833326458930969, [[22752, 0.783333, " way", false], [30273, 0.075162, " best", false], [31937, 0.030507, " same", false], [39523, 0.020113, " right", false], [4404, 0.019646, " ``", false], [38720, 0.016765, " human", false], [38499, 0.013407, " first", false], [31461, 0.008686, " most", false], [22221, 0.003472, " old", false], [30724, 0.002815, " easy", false]]], "qwen": [1616, 1, 0.6703117489814758, [[1616, 0.670312, " way", false], [1850, 0.105118, " best", false], [1852, 0.093585, " same", false], [3738, 0.023929, " human", false], [2310, 0.02321, " old", false], [9902, 0.017485, " ``", false], [1156, 0.013976, " first", false], [2588, 0.005618, " hard", false], [8606, 0.004595, " traditional", false], [1008, 0.002564, " other", false]]]}, "raw_delta": -0.038723789155483246, "tuned_delta": -0.031386650641780506}, {"byte_start": 4153, "byte_end": 4157, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 695, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "16.84% 16.84% 16.84% 16.84%", "qwen": "16.31% 16.31% 16.31% 16.31%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.02356562949717045]], "qwen": [[279, " the", "normal", 0.026834776625037193]]}, "loss": {"rwkv": 16.83613841662413, "qwen": 16.311725692938552}, "topk": {"rwkv": [22590, 6, 0.02356562949717045, [[32232, 0.427483, " they", false], [46227, 0.21276, " humans", false], [46787, 0.138171, " people", false], [38720, 0.06241, " human", false], [32227, 0.059323, " that", false], [22590, 0.023566, " the", false], [51685, 0.013171, " experts", false], [332, 0.010389, " a", false], [39931, 0.009824, " their", false], [4404, 0.006745, " ``", false]]], "qwen": [279, 6, 0.026834776625037193, [[1251, 0.338643, " people", false], [12677, 0.333696, " humans", false], [807, 0.124633, " they", false], [429, 0.074541, " that", false], [3738, 0.036561, " human", false], [279, 0.026835, " the", false], [264, 0.011034, " a", false], [862, 0.008604, " their", false], [582, 0.008014, " we", false], [1429, 0.00515, " most", false]]]}, "raw_delta": 0.0290796160697937, "tuned_delta": 0.03641675458349644}, {"byte_start": 4157, "byte_end": 4169, "display": {"text": " researchers", "kind": "normal"}, "is_word": true, "word_id": 696, "word_key": " researchers", "bytes_hex": "20 72 65 73 65 61 72 63 68 65 72 73", "compression": {"rwkv": "8.92% 8.92% 8.92% 8.92% 8.92% 8.92% 8.92% 8.92% 8.92% 8.92% 8.92% 8.92%", "qwen": "9.76% 9.76% 9.76% 9.76% 9.76% 9.76% 9.76% 9.76% 9.76% 9.76% 9.76% 9.76%"}, "model_tokens": {"rwkv": [[63843, " researchers", "normal", 0.00260747317224741]], "qwen": [[11811, " researchers", "normal", 0.0015071507077664137]]}, "loss": {"rwkv": 8.922918547164814, "qwen": 9.764542163153973}, "topk": {"rwkv": [63843, 21, 0.00260747317224741, [[38720, 0.542834, " human", false], [51685, 0.124336, " experts", false], [46227, 0.071135, " humans", false], [40213, 0.040672, " world", false], [45775, 0.017635, " domain", false], [53087, 0.012043, " systems", false], [4404, 0.010215, " ``", false], [47487, 0.009846, " system", false], [30273, 0.009263, " best", false], [45929, 0.008288, " expert", false]]], "qwen": [11811, 28, 0.0015071507077664137, [[3738, 0.503164, " human", false], [12677, 0.108089, " humans", false], [1879, 0.094028, " world", false], [11647, 0.063805, " experts", false], [1850, 0.047976, " best", false], [1251, 0.022485, " people", false], [6203, 0.01531, " expert", false], [5461, 0.011294, " average", false], [8686, 0.006228, " majority", false], [33738, 0.00596, " champions", false]]]}, "raw_delta": -0.04666952292124432, "tuned_delta": -0.03933238440754158}, {"byte_start": 4169, "byte_end": 4177, "display": {"text": " thought", "kind": "normal"}, "is_word": true, "word_id": 697, "word_key": " thought", "bytes_hex": "20 74 68 6f 75 67 68 74", "compression": {"rwkv": "2.64% 2.64% 2.64% 2.64% 2.64% 2.64% 2.64% 2.64%", "qwen": "3.65% 3.65% 3.65% 3.65% 3.65% 3.65% 3.65% 3.65%"}, "model_tokens": {"rwkv": [[53137, " thought", "normal", 0.311259001493454]], "qwen": [[3381, " thought", "normal", 0.19764433801174164]]}, "loss": {"rwkv": 2.6416535172527404, "qwen": 3.654721084280602}, "topk": {"rwkv": [53137, 1, 0.311259001493454, [[53137, 0.311259, " thought", false], [47763, 0.203698, " wanted", false], [31220, 0.141786, " knew", false], [62684, 0.057305, " understood", false], [55616, 0.048067, " believed", false], [62643, 0.039959, " themselves", false], [21532, 0.026153, " did", false], [56175, 0.017921, " expected", false], [40, 0.015885, "'", false], [40219, 0.014364, " would", false]]], "qwen": [3381, 2, 0.19764433801174164, [[4829, 0.216252, " wanted", false], [3381, 0.197644, " thought", false], [5577, 0.095206, " themselves", false], [6876, 0.091078, " knew", false], [6342, 0.039408, " played", false], [3601, 0.039298, " expected", false], [1521, 0.038354, " did", false], [15985, 0.033178, " understood", false], [1035, 0.025781, " would", false], [11585, 0.016411, " believed", false]]]}, "raw_delta": -0.05617639422416687, "tuned_delta": -0.04883925571046413}, {"byte_start": 4177, "byte_end": 4183, "display": {"text": " their", "kind": "normal"}, "is_word": true, "word_id": 698, "word_key": " their", "bytes_hex": "20 74 68 65 69 72", "compression": {"rwkv": "14.09% 14.09% 14.09% 14.09% 14.09% 14.09%", "qwen": "15.82% 15.82% 15.82% 15.82% 15.82% 15.82%"}, "model_tokens": {"rwkv": [[39931, " their", "normal", 0.009134320542216301]], "qwen": [[862, " their", "normal", 0.005176984239369631]]}, "loss": {"rwkv": 14.088818758681281, "qwen": 15.82015090665209}, "topk": {"rwkv": [39931, 18, 0.009134320542216301, [[22590, 0.170129, " the", false], [46227, 0.150865, " humans", false], [32232, 0.104958, " they", false], [46787, 0.104245, " people", false], [38720, 0.089898, " human", false], [47350, 0.070972, " speech", false], [22748, 0.034997, " was", false], [4601, 0.025599, " it", false], [30273, 0.023953, " best", false], [332, 0.019538, " a", false]]], "qwen": [862, 20, 0.005176984239369631, [[1251, 0.166699, " people", false], [807, 0.156441, " they", false], [279, 0.124674, " the", false], [12677, 0.096171, " humans", false], [572, 0.055338, " was", false], [11, 0.052921, ",", false], [1035, 0.051776, " would", false], [3738, 0.037222, " human", false], [429, 0.036515, " that", false], [264, 0.028396, " a", false]]]}, "raw_delta": -0.09600543975830078, "tuned_delta": -0.08866830124459804}, {"byte_start": 4183, "byte_end": 4187, "display": {"text": " own", "kind": "normal"}, "is_word": true, "word_id": 699, "word_key": " own", "bytes_hex": "20 6f 77 6e", "compression": {"rwkv": "17.47% 17.47% 17.47% 17.47%", "qwen": "9.08% 9.08% 9.08% 9.08%"}, "model_tokens": {"rwkv": [[22251, " own", "normal", 0.020515209063887596]], "qwen": [[1828, " own", "normal", 0.1334380805492401]]}, "loss": {"rwkv": 17.47013526076479, "qwen": 9.08049263485721}, "topk": {"rwkv": [22251, 7, 0.020515209063887596, [[53087, 0.367229, " systems", false], [38720, 0.156334, " human", false], [59943, 0.061903, " knowledge", false], [47487, 0.060584, " system", false], [52224, 0.057431, " methods", false], [45775, 0.053032, " domain", false], [22251, 0.020515, " own", false], [65034, 0.009593, " understanding", false], [47350, 0.008543, " speech", false], [38478, 0.008091, " field", false]]], "qwen": [1828, 3, 0.1334380805492401, [[3738, 0.201269, " human", false], [5942, 0.165008, " systems", false], [1828, 0.133438, " own", false], [61440, 0.070908, " predecessors", false], [7947, 0.044888, " domain", false], [1849, 0.024061, " system", false], [3281, 0.019679, " special", false], [5413, 0.016345, " methods", false], [6540, 0.016087, " knowledge", false], [34102, 0.012111, " brains", false]]]}, "raw_delta": 0.46522057056427, "tuned_delta": 0.47255770907797273}, {"byte_start": 4187, "byte_end": 4193, "display": {"text": " minds", "kind": "normal"}, "is_word": true, "word_id": 700, "word_key": " minds", "bytes_hex": "20 6d 69 6e 64 73", "compression": {"rwkv": "14.93% 14.93% 14.93% 14.93% 14.93% 14.93%", "qwen": "9.01% 9.01% 9.01% 9.01% 9.01% 9.01%"}, "model_tokens": {"rwkv": [[39026, " minds", "normal", 0.007010555826127529]], "qwen": [[20062, " minds", "normal", 0.0499066598713398]]}, "loss": {"rwkv": 14.934147884202158, "qwen": 9.009633632918597}, "topk": {"rwkv": [39026, 14, 0.007010555826127529, [[53087, 0.217054, " systems", false], [38720, 0.169272, " human", false], [52224, 0.129596, " methods", false], [59943, 0.123852, " knowledge", false], [47487, 0.053842, " system", false], [65034, 0.01888, " understanding", false], [47350, 0.018018, " speech", false], [45775, 0.015038, " domain", false], [59683, 0.014585, " expertise", false], [52964, 0.01196, " special", false]]], "qwen": [20062, 5, 0.0499066598713398, [[3738, 0.156074, " human", false], [5942, 0.091684, " systems", false], [7947, 0.073352, " domain", false], [34102, 0.062548, " brains", false], [20062, 0.049907, " minds", false], [6540, 0.04608, " knowledge", false], [5413, 0.044033, " methods", false], [12677, 0.035771, " humans", false], [1616, 0.034793, " way", false], [3281, 0.025066, " special", false]]]}, "raw_delta": 0.3285248279571533, "tuned_delta": 0.33586196647085603}, {"byte_start": 4193, "byte_end": 4200, "display": {"text": " worked", "kind": "normal"}, "is_word": true, "word_id": 701, "word_key": " worked", "bytes_hex": "20 77 6f 72 6b 65 64", "compression": {"rwkv": "1.06% 1.06% 1.06% 1.06% 1.06% 1.06% 1.06%", "qwen": "0.70% 0.70% 0.70% 0.70% 0.70% 0.70% 0.70%"}, "model_tokens": {"rwkv": [[47812, " worked", "normal", 0.6602880954742432]], "qwen": [[6439, " worked", "normal", 0.7613739371299744]]}, "loss": {"rwkv": 1.0616931278863395, "qwen": 0.7023623279756674}, "topk": {"rwkv": [47812, 1, 0.6602880954742432, [[47812, 0.660288, " worked", false], [21532, 0.144207, " did", false], [40219, 0.079185, " would", false], [47266, 0.031704, " should", false], [53137, 0.011982, " thought", false], [32499, 0.011801, " work", false], [39021, 0.009072, " might", false], [32462, 0.008832, " were", false], [56760, 0.008103, " operated", false], [39196, 0.004973, " ought", false]]], "qwen": [6439, 1, 0.7613739371299744, [[6439, 0.761374, " worked", false], [1035, 0.091885, " would", false], [1521, 0.045518, " did", false], [1265, 0.037856, " should", false], [975, 0.008386, " work", false], [1030, 0.007429, " had", false], [21776, 0.005342, " ought", false], [1969, 0.004679, " must", false], [323, 0.004666, " and", false], [1033, 0.004177, " were", false]]]}, "raw_delta": 0.019925530467714583, "tuned_delta": 0.02726266898141732}, {"byte_start": 4200, "byte_end": 4203, "display": {"text": "---", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2d 2d 2d", "compression": {"rwkv": "15.22% 15.22% 15.22%", "qwen": "14.36% 14.36% 14.36%"}, "model_tokens": {"rwkv": [[5346, "---", "normal", 0.07951655983924866]], "qwen": [[4421, "---", "normal", 0.0916820615530014]]}, "loss": {"rwkv": 15.215924259375784, "qwen": 14.363403392671328}, "topk": {"rwkv": [5346, 3, 0.07951655983924866, [[45, 0.516939, ",", false], [47, 0.2601, ".", false], [5346, 0.079517, "---", false], [275, 0.027224, " (", false], [30273, 0.024461, " best", false], [60, 0.022171, ";", false], [21265, 0.018616, " and", false], [32465, 0.005795, " when", false], [21400, 0.005746, " but", false], [4596, 0.005666, " in", false]]], "qwen": [4421, 3, 0.0916820615530014, [[11, 0.463088, ",", false], [13, 0.217557, ".", false], [4421, 0.091682, "---", false], [320, 0.047334, " (", false], [323, 0.041853, " and", false], [382, 0.035104, ".\n\n", false], [26, 0.016768, ";", false], [304, 0.009855, " in", false], [979, 0.007711, " when", false], [714, 0.007509, " but", false]]]}, "raw_delta": 0.04727379480997718, "tuned_delta": 0.05461093332367992}, {"byte_start": 4203, "byte_end": 4207, "display": {"text": "they", "kind": "normal"}, "is_word": true, "word_id": 702, "word_key": "they", "bytes_hex": "74 68 65 79", "compression": {"rwkv": "17.54% 17.54% 17.54% 17.54%", "qwen": "16.97% 16.97% 16.97% 16.97%"}, "model_tokens": {"rwkv": [[27148, "they", "normal", 0.020454436540603638]], "qwen": [[20069, "they", "normal", 0.023210639134049416]]}, "loss": {"rwkv": 17.540579354558197, "qwen": 16.96584343233859}, "topk": {"rwkv": [27148, 13, 0.020454436540603638, [[1950, 0.098391, "in", false], [27142, 0.081169, "that", false], [7005, 0.066014, "and", false], [7195, 0.055251, "but", false], [1782, 0.041094, "by", false], [27493, 0.038416, "with", false], [8801, 0.037234, "the", false], [36003, 0.034565, "which", false], [98, 0.032994, "a", false], [34011, 0.02543, "based", false]]], "qwen": [20069, 12, 0.023210639134049416, [[9033, 0.113276, "that", false], [29939, 0.078263, "based", false], [437, 0.058803, "and", false], [970, 0.053, "using", false], [4197, 0.042315, "with", false], [1782, 0.039568, "the", false], [1694, 0.037741, "by", false], [258, 0.035452, "in", false], [64, 0.030492, "a", false], [8088, 0.027657, "but", false]]]}, "raw_delta": 0.031870126724243164, "tuned_delta": 0.039207265237945904}, {"byte_start": 4207, "byte_end": 4213, "display": {"text": " tried", "kind": "normal"}, "is_word": true, "word_id": 703, "word_key": " tried", "bytes_hex": "20 74 72 69 65 64", "compression": {"rwkv": "6.62% 6.62% 6.62% 6.62% 6.62% 6.62%", "qwen": "7.13% 7.13% 7.13% 7.13% 7.13% 7.13%"}, "model_tokens": {"rwkv": [[40013, " tried", "normal", 0.11053095757961273]], "qwen": [[6679, " tried", "normal", 0.09341413527727127]]}, "loss": {"rwkv": 6.621744816580202, "qwen": 7.125449037615954}, "topk": {"rwkv": [40013, 1, 0.11053095757961273, [[40013, 0.110531, " tried", false], [47763, 0.090578, " wanted", false], [32462, 0.086448, " were", false], [21532, 0.08045, " did", false], [32354, 0.048448, " used", false], [53137, 0.039334, " thought", false], [45150, 0.038113, " always", false], [21795, 0.024735, " had", false], [47812, 0.019215, " worked", false], [40219, 0.019005, " would", false]]], "qwen": [6679, 3, 0.09341413527727127, [[4829, 0.184392, " wanted", false], [1521, 0.118051, " did", false], [6679, 0.093414, " tried", false], [1033, 0.086483, " were", false], [3381, 0.045878, " thought", false], [1483, 0.0269, " used", false], [11585, 0.02205, " believed", false], [1030, 0.020286, " had", false], [2581, 0.018875, " never", false], [3867, 0.015135, " took", false]]]}, "raw_delta": -0.027931292851765932, "tuned_delta": -0.020594154338063195}, {"byte_start": 4213, "byte_end": 4216, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 704, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "0.67% 0.67% 0.67%", "qwen": "0.75% 0.75% 0.75%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.8942117691040039]], "qwen": [[311, " to", "normal", 0.8823504447937012]]}, "loss": {"rwkv": 0.6721540616120861, "qwen": 0.7524013456532673}, "topk": {"rwkv": [4811, 1, 0.8942117691040039, [[4811, 0.894212, " to", false], [52224, 0.009516, " methods", false], [31048, 0.007488, " hard", false], [38720, 0.006636, " human", false], [38499, 0.00488, " first", false], [22590, 0.004681, " the", false], [45, 0.004397, ",", false], [21700, 0.004052, " for", false], [22249, 0.004007, " out", false], [22187, 0.003321, " not", false]]], "qwen": [311, 1, 0.8823504447937012, [[311, 0.88235, " to", false], [3738, 0.023664, " human", false], [5413, 0.015564, " methods", false], [3281, 0.005675, " special", false], [2588, 0.004839, " hard", false], [537, 0.004669, " not", false], [369, 0.004409, " for", false], [1667, 0.004191, " using", false], [279, 0.003089, " the", false], [11, 0.003054, ",", false]]]}, "raw_delta": -0.00444985429445903, "tuned_delta": 0.002887284219243707}, {"byte_start": 4216, "byte_end": 4220, "display": {"text": " put", "kind": "normal"}, "is_word": true, "word_id": 705, "word_key": " put", "bytes_hex": "20 70 75 74", "compression": {"rwkv": "20.29% 20.29% 20.29% 20.29%", "qwen": "23.32% 23.32% 23.32% 23.32%"}, "model_tokens": {"rwkv": [[22339, " put", "normal", 0.010945071466267109]], "qwen": [[2182, " put", "normal", 0.005670353304594755]]}, "loss": {"rwkv": 20.287899012501047, "qwen": 23.31983060957362}, "topk": {"rwkv": [22339, 25, 0.010945071466267109, [[31358, 0.072357, " make", false], [22681, 0.072267, " use", false], [37923, 0.059927, " build", false], [39025, 0.052012, " mimic", false], [39043, 0.029844, " model", false], [32187, 0.029264, " take", false], [4516, 0.024517, " em", false], [4404, 0.01917, " ``", false], [45616, 0.018871, " create", false], [45854, 0.018251, " encode", false]]], "qwen": [2182, 32, 0.005670353304594755, [[1281, 0.136003, " make", false], [990, 0.085992, " use", false], [32064, 0.0754, " leverage", false], [1896, 0.066793, " take", false], [1936, 0.041364, " build", false], [32194, 0.029387, " exploit", false], [5648, 0.025347, " avoid", false], [653, 0.020886, " do", false], [9902, 0.019416, " ``", false], [65485, 0.019378, " emulate", false]]]}, "raw_delta": -0.16812598705291748, "tuned_delta": -0.16078884853921474}, {"byte_start": 4220, "byte_end": 4225, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 706, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"rwkv": "26.26% 26.26% 26.26% 26.26% 26.26%", "qwen": "23.14% 23.14% 23.14% 23.14% 23.14%"}, "model_tokens": {"rwkv": [[32227, " that", "normal", 0.0006982529885135591]], "qwen": [[429, " that", "normal", 0.001635799533687532]]}, "loss": {"rwkv": 26.26155816618191, "qwen": 23.139471113743912}, "topk": {"rwkv": [32227, 67, 0.0006982529885135591, [[4596, 0.18583, " in", false], [39931, 0.175639, " their", false], [22590, 0.110214, " the", false], [57435, 0.072513, " together", false], [38720, 0.072448, " human", false], [21256, 0.031125, " all", false], [40210, 0.027239, " words", false], [4404, 0.027186, " ``", false], [59943, 0.024152, " knowledge", false], [332, 0.02238, " a", false]]], "qwen": [429, 38, 0.001635799533687532, [[862, 0.155009, " their", false], [304, 0.148532, " in", false], [3738, 0.101256, " human", false], [279, 0.100274, " the", false], [5577, 0.09738, " themselves", false], [264, 0.042682, " a", false], [3786, 0.026835, " together", false], [6540, 0.024458, " knowledge", false], [12677, 0.021355, " humans", false], [1119, 0.015779, " into", false]]]}, "raw_delta": 0.1731252670288086, "tuned_delta": 0.18046240554251133}, {"byte_start": 4225, "byte_end": 4235, "display": {"text": " knowledge", "kind": "normal"}, "is_word": true, "word_id": 707, "word_key": " knowledge", "bytes_hex": "20 6b 6e 6f 77 6c 65 64 67 65", "compression": {"rwkv": "2.62% 2.62% 2.62% 2.62% 2.62% 2.62% 2.62% 2.62% 2.62% 2.62%", "qwen": "3.29% 3.29% 3.29% 3.29% 3.29% 3.29% 3.29% 3.29% 3.29% 3.29%"}, "model_tokens": {"rwkv": [[59943, " knowledge", "normal", 0.23440676927566528]], "qwen": [[6540, " knowledge", "normal", 0.16167356073856354]]}, "loss": {"rwkv": 2.620520289114718, "qwen": 3.286055311770598}, "topk": {"rwkv": [59943, 1, 0.23440676927566528, [[59943, 0.234407, " knowledge", false], [38720, 0.227343, " human", false], [31162, 0.052358, " into", false], [4404, 0.041637, " ``", false], [52964, 0.041579, " special", false], [4596, 0.024248, " in", false], [65034, 0.019214, " understanding", false], [31427, 0.018013, " mind", false], [47487, 0.016275, " system", false], [62293, 0.015182, " particular", false]]], "qwen": [6540, 2, 0.16167356073856354, [[3738, 0.232212, " human", false], [6540, 0.161674, " knowledge", false], [1119, 0.066522, " into", false], [8660, 0.053874, " understanding", false], [304, 0.053395, " in", false], [3093, 0.047307, " kind", false], [3281, 0.028993, " special", false], [1616, 0.027035, " way", false], [3381, 0.025701, " thought", false], [9902, 0.025343, " ``", false]]]}, "raw_delta": -0.03690509796142577, "tuned_delta": -0.029567959447723034}, {"byte_start": 4235, "byte_end": 4238, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 708, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "10.38% 10.38% 10.38%", "qwen": "17.62% 17.62% 17.62%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.17817959189414978]], "qwen": [[304, " in", "normal", 0.053343866020441055]]}, "loss": {"rwkv": 10.378763152228546, "qwen": 17.618891654628577}, "topk": {"rwkv": [4596, 2, 0.17817959189414978, [[31162, 0.511717, " into", false], [4596, 0.17818, " in", false], [4811, 0.112676, " to", false], [4706, 0.052709, " of", false], [32232, 0.031239, " they", false], [45, 0.014237, ",", false], [56003, 0.009874, " directly", false], [21265, 0.009751, " and", false], [32227, 0.009624, " that", false], [46301, 0.004959, " inside", false]]], "qwen": [304, 3, 0.053343866020441055, [[1119, 0.64124, " into", false], [311, 0.188813, " to", false], [304, 0.053344, " in", false], [5961, 0.017141, " directly", false], [315, 0.013351, " of", false], [518, 0.012458, " at", false], [11, 0.010536, ",", false], [389, 0.009964, " on", false], [4766, 0.00838, " inside", false], [323, 0.008258, " and", false]]]}, "raw_delta": -0.40147797266642254, "tuned_delta": -0.39414083415271983}, {"byte_start": 4238, "byte_end": 4244, "display": {"text": " their", "kind": "normal"}, "is_word": true, "word_id": 709, "word_key": " their", "bytes_hex": "20 74 68 65 69 72", "compression": {"rwkv": "6.48% 6.48% 6.48% 6.48% 6.48% 6.48%", "qwen": "5.88% 5.88% 5.88% 5.88% 5.88% 5.88%"}, "model_tokens": {"rwkv": [[39931, " their", "normal", 0.11641982197761536]], "qwen": [[862, " their", "normal", 0.14135323464870453]]}, "loss": {"rwkv": 6.48085662899339, "qwen": 5.8804651948313245}, "topk": {"rwkv": [39931, 2, 0.11641982197761536, [[22590, 0.604659, " the", false], [39931, 0.11642, " their", false], [45, 0.051243, ",", false], [332, 0.031932, " a", false], [47, 0.031755, ".", false], [21265, 0.014703, " and", false], [4423, 0.012111, " as", false], [4811, 0.008928, " to", false], [53087, 0.008047, " systems", false], [56567, 0.007377, " machines", false]]], "qwen": [862, 2, 0.14135323464870453, [[279, 0.568154, " the", false], [862, 0.141353, " their", false], [264, 0.072226, " a", false], [311, 0.030093, " to", false], [5942, 0.012445, " systems", false], [12645, 0.011967, " machines", false], [1992, 0.011912, " place", false], [11, 0.011863, ",", false], [6366, 0.010402, " computer", false], [13, 0.008414, ".", false]]]}, "raw_delta": 0.03329277038574219, "tuned_delta": 0.04062990889944493}, {"byte_start": 4244, "byte_end": 4252, "display": {"text": " systems", "kind": "normal"}, "is_word": true, "word_id": 710, "word_key": " systems", "bytes_hex": "20 73 79 73 74 65 6d 73", "compression": {"rwkv": "1.83% 1.83% 1.83% 1.83% 1.83% 1.83% 1.83% 1.83%", "qwen": "1.52% 1.52% 1.52% 1.52% 1.52% 1.52% 1.52% 1.52%"}, "model_tokens": {"rwkv": [[53087, " systems", "normal", 0.44626832008361816]], "qwen": [[5942, " systems", "normal", 0.5105169415473938]]}, "loss": {"rwkv": 1.8315464386285667, "qwen": 1.5155768221501569}, "topk": {"rwkv": [53087, 1, 0.44626832008361816, [[53087, 0.446268, " systems", false], [46587, 0.122536, " models", false], [52224, 0.100688, " methods", false], [47487, 0.068409, " system", false], [61559, 0.052856, " algorithms", false], [56949, 0.025103, " programs", false], [47350, 0.017767, " speech", false], [56567, 0.017541, " machines", false], [30469, 0.012174, " code", false], [22251, 0.010278, " own", false]]], "qwen": [5942, 1, 0.5105169415473938, [[5942, 0.510517, " systems", false], [7468, 0.084851, " programs", false], [12645, 0.07608, " machines", false], [4119, 0.03891, " models", false], [8806, 0.036206, " speech", false], [1849, 0.034784, " system", false], [18495, 0.024004, " computers", false], [5413, 0.020255, " methods", false], [25185, 0.019073, " algorithms", false], [6366, 0.018461, " computer", false]]]}, "raw_delta": 0.017521075904369354, "tuned_delta": 0.02485821441807209}, {"byte_start": 4252, "byte_end": 4255, "display": {"text": "---", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2d 2d 2d", "compression": {"rwkv": "9.02% 9.02% 9.02%", "qwen": "8.18% 8.18% 8.18%"}, "model_tokens": {"rwkv": [[5346, "---", "normal", 0.22581958770751953]], "qwen": [[4421, "---", "normal", 0.2565803825855255]]}, "loss": {"rwkv": 9.01684400555602, "qwen": 8.177155194389064}, "topk": {"rwkv": [5346, 3, 0.22581958770751953, [[47, 0.334076, ".", false], [45, 0.231652, ",", false], [5346, 0.22582, "---", false], [21265, 0.051831, " and", false], [4596, 0.017953, " in", false], [4423, 0.013668, " as", false], [47001, 0.012154, " rather", false], [4450, 0.010664, " by", false], [4811, 0.009726, " to", false], [52028, 0.008561, " instead", false]]], "qwen": [4421, 2, 0.2565803825855255, [[13, 0.326225, ".", false], [4421, 0.25658, "---", false], [11, 0.202918, ",", false], [323, 0.047183, " and", false], [382, 0.031108, ".\n\n", false], [4518, 0.01422, " instead", false], [311, 0.013798, " to", false], [304, 0.01277, " in", false], [320, 0.010513, " (", false], [773, 0.010385, " so", false]]]}, "raw_delta": 0.04656223456064862, "tuned_delta": 0.05389937307435136}, {"byte_start": 4255, "byte_end": 4258, "display": {"text": "but", "kind": "normal"}, "is_word": true, "word_id": 711, "word_key": "but", "bytes_hex": "62 75 74", "compression": {"rwkv": "2.54% 2.54% 2.54%", "qwen": "4.04% 4.04% 4.04%"}, "model_tokens": {"rwkv": [[7195, "but", "normal", 0.6542940139770508]], "qwen": [[8088, "but", "normal", 0.5108304619789124]]}, "loss": {"rwkv": 2.535987376562631, "qwen": 4.037848089647843}, "topk": {"rwkv": [7195, 1, 0.6542940139770508, [[7195, 0.654294, "but", false], [7005, 0.239623, "and", false], [35898, 0.015545, "until", false], [36003, 0.00952, "which", false], [26476, 0.007127, "only", false], [36004, 0.005696, "while", false], [2190, 0.005338, "so", false], [36002, 0.004527, "where", false], [42135, 0.004409, "rather", false], [27493, 0.003749, "with", false]]], "qwen": [8088, 1, 0.5108304619789124, [[8088, 0.51083, "but", false], [437, 0.291467, "and", false], [3243, 0.029564, "only", false], [38730, 0.02406, "until", false], [73203, 0.021517, "rather", false], [64837, 0.0121, "instead", false], [28996, 0.006618, "without", false], [14801, 0.006535, "before", false], [704, 0.006166, "so", false], [3472, 0.005263, "while", false]]]}, "raw_delta": -0.08328084150950113, "tuned_delta": -0.07594370299579839}, {"byte_start": 4258, "byte_end": 4261, "display": {"text": " it", "kind": "normal"}, "is_word": true, "word_id": 712, "word_key": " it", "bytes_hex": "20 69 74", "compression": {"rwkv": "16.91% 16.91% 16.91%", "qwen": "16.16% 16.16% 16.16%"}, "model_tokens": {"rwkv": [[4601, " it", "normal", 0.05985134467482567]], "qwen": [[432, " it", "normal", 0.06796281039714813]]}, "loss": {"rwkv": 16.90658251041754, "qwen": 16.162961058239414}, "topk": {"rwkv": [4601, 5, 0.05985134467482567, [[22590, 0.154223, " the", false], [32232, 0.110256, " they", false], [4596, 0.077104, " in", false], [32234, 0.065715, " this", false], [4601, 0.059851, " it", false], [32227, 0.044131, " that", false], [30597, 0.041909, " deep", false], [61959, 0.035259, " eventually", false], [45, 0.033356, ",", false], [4423, 0.026939, " as", false]]], "qwen": [432, 4, 0.06796281039714813, [[279, 0.138948, " the", false], [807, 0.087394, " they", false], [304, 0.079733, " in", false], [432, 0.067963, " it", false], [419, 0.061158, " this", false], [11, 0.044456, ",", false], [429, 0.039143, " that", false], [1172, 0.028256, " only", false], [979, 0.026061, " when", false], [438, 0.025101, " as", false]]]}, "raw_delta": 0.0412351290384928, "tuned_delta": 0.04857226755219554}, {"byte_start": 4261, "byte_end": 4268, "display": {"text": " proved", "kind": "normal"}, "is_word": true, "word_id": 713, "word_key": " proved", "bytes_hex": "20 70 72 6f 76 65 64", "compression": {"rwkv": "8.53% 8.53% 8.53% 8.53% 8.53% 8.53% 8.53%", "qwen": "8.43% 8.43% 8.43% 8.43% 8.43% 8.43% 8.43%"}, "model_tokens": {"rwkv": [[46936, " proved", "normal", 0.03679249435663223]], "qwen": [[18651, " proved", "normal", 0.037908583879470825]]}, "loss": {"rwkv": 8.53379879097266, "qwen": 8.430949480414185}, "topk": {"rwkv": [46936, 6, 0.03679249435663223, [[22748, 0.334355, " was", false], [4600, 0.094463, " is", false], [47638, 0.094123, " turned", false], [21532, 0.07026, " did", false], [40040, 0.043167, " turns", false], [46936, 0.036792, " proved", false], [39115, 0.031296, " never", false], [30633, 0.025171, " didn", false], [21800, 0.018181, " has", false], [45150, 0.015661, " always", false]]], "qwen": [18651, 5, 0.037908583879470825, [[572, 0.403749, " was", false], [6519, 0.079842, " turned", false], [1521, 0.075345, " did", false], [374, 0.066288, " is", false], [18651, 0.037909, " proved", false], [3867, 0.037231, " took", false], [2581, 0.036642, " never", false], [10577, 0.016711, " turns", false], [3207, 0.015634, " didn", false], [6116, 0.015539, " became", false]]]}, "raw_delta": 0.005703176770891438, "tuned_delta": 0.013040315284594175}, {"byte_start": 4268, "byte_end": 4279, "display": {"text": " ultimately", "kind": "normal"}, "is_word": true, "word_id": 714, "word_key": " ultimately", "bytes_hex": "20 75 6c 74 69 6d 61 74 65 6c 79", "compression": {"rwkv": "6.38% 6.38% 6.38% 6.38% 6.38% 6.38% 6.38% 6.38% 6.38% 6.38% 6.38%", "qwen": "7.08% 7.08% 7.08% 7.08% 7.08% 7.08% 7.08% 7.08% 7.08% 7.08% 7.08%"}, "model_tokens": {"rwkv": [[62676, " ultimately", "normal", 0.020496545359492302]], "qwen": [[13653, " ultimately", "normal", 0.013284618966281414]]}, "loss": {"rwkv": 6.378392492566615, "qwen": 7.08420381953233}, "topk": {"rwkv": [62676, 12, 0.020496545359492302, [[4811, 0.213013, " to", false], [22187, 0.066712, " not", false], [62082, 0.056201, " impossible", false], [332, 0.051529, " a", false], [62161, 0.049208, " irrelevant", false], [31466, 0.038657, " much", false], [21719, 0.03778, " fut", false], [31277, 0.0342, " less", false], [32227, 0.031324, " that", false], [31458, 0.028027, " more", false]]], "qwen": [13653, 17, 0.013284618966281414, [[311, 0.178685, " to", false], [11997, 0.07576, " impossible", false], [39715, 0.058243, " irrelevant", false], [537, 0.045833, " not", false], [264, 0.045779, " a", false], [54188, 0.043133, " ineffective", false], [429, 0.038112, " that", false], [84527, 0.025843, " futile", false], [1753, 0.025481, " much", false], [5000, 0.020392, " difficult", false]]]}, "raw_delta": -0.03913849050348456, "tuned_delta": -0.03180135198978182}, {"byte_start": 4279, "byte_end": 4287, "display": {"text": " counter", "kind": "normal"}, "is_word": true, "word_id": 715, "word_key": " counter", "bytes_hex": "20 63 6f 75 6e 74 65 72", "compression": {"rwkv": "10.14% 10.14% 10.14% 10.14% 10.14% 10.14% 10.14% 10.14%", "qwen": "8.72% 8.72% 8.72% 8.72% 8.72% 8.72% 8.72% 8.72%"}, "model_tokens": {"rwkv": [[51336, " counter", "normal", 0.011058651842176914]], "qwen": [[5546, " counter", "normal", 0.020920855924487114]]}, "loss": {"rwkv": 10.143949506250523, "qwen": 8.717053522596084}, "topk": {"rwkv": [51336, 16, 0.011058651842176914, [[4811, 0.211264, " to", false], [21719, 0.116278, " fut", false], [62161, 0.091068, " irrelevant", false], [22187, 0.083035, " not", false], [31458, 0.061769, " more", false], [31277, 0.041357, " less", false], [62082, 0.034509, " impossible", false], [4832, 0.030704, " un", false], [332, 0.027697, " a", false], [31466, 0.023797, " much", false]]], "qwen": [5546, 12, 0.020920855924487114, [[39715, 0.214401, " irrelevant", false], [311, 0.13551, " to", false], [11997, 0.082176, " impossible", false], [54188, 0.055731, " ineffective", false], [84527, 0.043993, " futile", false], [650, 0.040503, " un", false], [264, 0.037476, " a", false], [537, 0.035118, " not", false], [28848, 0.030893, " useless", false], [2686, 0.029788, " less", false]]]}, "raw_delta": 0.07912391424179077, "tuned_delta": 0.08646105275549351}, {"byte_start": 4287, "byte_end": 4297, "display": {"text": "productive", "kind": "normal"}, "is_word": true, "word_id": 716, "word_key": "productive", "bytes_hex": "70 72 6f 64 75 63 74 69 76 65", "compression": {"rwkv": "0.23% 0.23% 0.23% 0.23% 0.23% 0.23% 0.23% 0.23% 0.23% 0.23%", "qwen": "0.29% 0.29% 0.29% 0.29% 0.29% 0.29% 0.29% 0.29% 0.29% 0.29%"}, "model_tokens": {"rwkv": [[61076, "productive", "normal", 0.8825404644012451]], "qwen": [[33270, "productive", "normal", 0.8513615727424622]]}, "loss": {"rwkv": 0.2254211001389005, "qwen": 0.29019508716709524}, "topk": {"rwkv": [61076, 1, 0.8825404644012451, [[61076, 0.88254, "productive", false], [46, 0.096918, "-", false], [62383, 0.016075, " productive", false], [4811, 0.002644, " to", false], [49587, 0.000289, "product", false], [59593, 0.00025, " effective", false], [47687, 0.000148, " useful", false], [59918, 0.000125, " intuitive", false], [7865, 0.000106, "int", false], [25390, 9.4e-05, "fact", false]]], "qwen": [33270, 1, 0.8513615727424622, [[33270, 0.851362, "productive", false], [28645, 0.090052, "-product", false], [26236, 0.045962, " productive", false], [311, 0.007526, " to", false], [69, 0.001049, "f", false], [3031, 0.000766, "product", false], [52321, 0.00068, "-effective", false], [396, 0.000502, "int", false], [20052, 0.000213, "-int", false], [1985, 0.000205, " product", false]]]}, "raw_delta": -0.0035918325185775755, "tuned_delta": 0.003745305995125161}, {"byte_start": 4297, "byte_end": 4298, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "48.75%", "qwen": "32.14%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.06738156825304031]], "qwen": [[11, ",", "normal", 0.16827599704265594]]}, "loss": {"rwkv": 48.747312905037234, "qwen": 32.13873548268536}, "topk": {"rwkv": [45, 2, 0.06738156825304031, [[47, 0.778545, ".", false], [45, 0.067382, ",", false], [4811, 0.059409, " to", false], [21265, 0.027568, " and", false], [4596, 0.017055, " in", false], [21700, 0.007759, " for", false], [4423, 0.00757, " as", false], [51018, 0.005475, " because", false], [275, 0.004051, " (", false], [32465, 0.003217, " when", false]]], "qwen": [11, 3, 0.16827599704265594, [[13, 0.353762, ".", false], [382, 0.180349, ".\n\n", false], [11, 0.168276, ",", false], [311, 0.077022, " to", false], [304, 0.039872, " in", false], [323, 0.038458, " and", false], [1576, 0.023677, " because", false], [979, 0.021899, " when", false], [438, 0.017857, " as", false], [25, 0.017265, ":", false]]]}, "raw_delta": 0.9209750890731812, "tuned_delta": 0.9283122275868839}, {"byte_start": 4298, "byte_end": 4302, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 717, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"rwkv": "4.54% 4.54% 4.54% 4.54%", "qwen": "5.12% 5.12% 5.12% 5.12%"}, "model_tokens": {"rwkv": [[21265, " and", "normal", 0.36137905716896057]], "qwen": [[323, " and", "normal", 0.3214159905910492]]}, "loss": {"rwkv": 4.543644049674714, "qwen": 5.117144921482811}, "topk": {"rwkv": [21265, 1, 0.36137905716896057, [[21265, 0.361379, " and", false], [4423, 0.131722, " as", false], [51018, 0.050769, " because", false], [4596, 0.028883, " in", false], [30788, 0.02306, " even", false], [39690, 0.022747, " since", false], [22187, 0.018869, " not", false], [61953, 0.01851, " especially", false], [31198, 0.017124, " just", false], [4424, 0.016268, " at", false]]], "qwen": [323, 1, 0.3214159905910492, [[323, 0.321416, " and", false], [438, 0.148337, " as", false], [1576, 0.10391, " because", false], [304, 0.049118, " in", false], [2474, 0.042246, " since", false], [6388, 0.035436, " leading", false], [448, 0.014209, " with", false], [2176, 0.013179, " both", false], [5310, 0.012899, " especially", false], [537, 0.011847, " not", false]]]}, "raw_delta": -0.03180164098739624, "tuned_delta": -0.024464502473693504}, {"byte_start": 4302, "byte_end": 4304, "display": {"text": " a", "kind": "normal"}, "is_word": true, "word_id": 718, "word_key": " a", "bytes_hex": "20 61", "compression": {"rwkv": "34.38% 34.38%", "qwen": "41.39% 41.39%"}, "model_tokens": {"rwkv": [[332, " a", "normal", 0.022072935476899147]], "qwen": [[264, " a", "normal", 0.010144878178834915]]}, "loss": {"rwkv": 34.37671777118233, "qwen": 41.39440534614516}, "topk": {"rwkv": [332, 8, 0.022072935476899147, [[22590, 0.141657, " the", false], [32232, 0.123529, " they", false], [4596, 0.035881, " in", false], [4601, 0.03577, " it", false], [22748, 0.026896, " was", false], [61959, 0.0263, " eventually", false], [22190, 0.023376, " now", false], [332, 0.022073, " a", false], [39931, 0.021755, " their", false], [31581, 0.019333, " only", false]]], "qwen": [264, 15, 0.010144878178834915, [[279, 0.161362, " the", false], [807, 0.086711, " they", false], [304, 0.066773, " in", false], [432, 0.041896, " it", false], [1172, 0.023338, " only", false], [862, 0.021538, " their", false], [5538, 0.020492, " deep", false], [6069, 0.020044, " led", false], [2711, 0.016448, " search", false], [572, 0.01333, " was", false]]]}, "raw_delta": -0.3891432285308838, "tuned_delta": -0.3818060900171811}, {"byte_start": 4304, "byte_end": 4313, "display": {"text": " colossal", "kind": "normal"}, "is_word": true, "word_id": 719, "word_key": " colossal", "bytes_hex": "20 63 6f 6c 6f 73 73 61 6c", "compression": {"rwkv": "41.42% 41.42% 41.42% 41.42% 0.02% 0.02% 0.02% 0.02% 1.14%", "qwen": "18.90% 18.90% 18.90% 18.90% 18.90% 18.90% 18.90% 18.90% 18.90%"}, "model_tokens": {"rwkv": [[21454, " col", "normal", 0.00010250632476527244], [26568, "ossa", "normal", 0.9957947731018066], [109, "l", "normal", 0.9380108714103699]], "qwen": [[96837, " colossal", "normal", 8.025064744288102e-05]]}, "loss": {"rwkv": 18.544958035597, "qwen": 18.896010933456505}, "topk": {"rwkv": [21454, 782, 0.00010250632476527244, [[38961, 0.058253, " major", false], [31466, 0.033761, " much", false], [22168, 0.033425, " new", false], [45301, 0.033387, " better", false], [40166, 0.020443, " waste", false], [31458, 0.020397, " more", false], [52245, 0.016786, " mistake", false], [59513, 0.016167, " different", false], [30585, 0.015082, " dead", false], [32386, 0.015059, " very", false]]], "qwen": [96837, 808, 8.025064744288102e-05, [[3598, 0.053847, " major", false], [2711, 0.046389, " search", false], [501, 0.041305, " new", false], [803, 0.038808, " more", false], [1753, 0.032122, " much", false], [2155, 0.027745, " different", false], [17755, 0.02686, " lesson", false], [2244, 0.026337, " great", false], [4586, 0.024132, " general", false], [5538, 0.017797, " deep", false]]]}, "raw_delta": -0.01946650611029721, "tuned_delta": -0.012129367596594474}, {"byte_start": 4313, "byte_end": 4319, "display": {"text": " waste", "kind": "normal"}, "is_word": true, "word_id": 720, "word_key": " waste", "bytes_hex": "20 77 61 73 74 65", "compression": {"rwkv": "0.59% 0.59% 0.59% 0.59% 0.59% 0.59%", "qwen": "2.68% 2.68% 2.68% 2.68% 2.68% 2.68%"}, "model_tokens": {"rwkv": [[40166, " waste", "normal", 0.8192620277404785]], "qwen": [[12291, " waste", "normal", 0.4097566604614258]]}, "loss": {"rwkv": 0.5929044560945039, "qwen": 2.6815848432569753}, "topk": {"rwkv": [40166, 1, 0.8192620277404785, [[40166, 0.819262, " waste", false], [52245, 0.072656, " mistake", false], [31333, 0.014194, " loss", false], [38392, 0.008758, " error", false], [32251, 0.007332, " time", false], [51708, 0.007299, " failure", false], [45157, 0.005651, " amount", false], [62157, 0.00319, " investment", false], [45829, 0.003172, " effort", false], [65126, 0.002416, " disappointment", false]]], "qwen": [12291, 1, 0.4097566604614258, [[12291, 0.409757, " waste", false], [16523, 0.093011, " mistake", false], [7901, 0.071587, " failure", false], [2393, 0.051838, " success", false], [54480, 0.019745, " computational", false], [4709, 0.019731, " loss", false], [1465, 0.015853, " error", false], [9162, 0.015468, " investment", false], [5041, 0.014599, " effort", false], [3311, 0.013996, " amount", false]]]}, "raw_delta": -0.11582103371620178, "tuned_delta": -0.10848389520249904}, {"byte_start": 4319, "byte_end": 4322, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 721, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "0.10% 0.10% 0.10%", "qwen": "0.21% 0.21% 0.21%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.9837121367454529]], "qwen": [[315, " of", "normal", 0.9657832384109497]]}, "loss": {"rwkv": 0.09906200689697776, "qwen": 0.20928595655784377}, "topk": {"rwkv": [4706, 1, 0.9837121367454529, [[4706, 0.983712, " of", false], [47, 0.007265, ".", false], [4596, 0.002473, " in", false], [45, 0.002413, ",", false], [4811, 0.000841, " to", false], [21700, 0.000329, " for", false], [4588, 0.000212, " if", false], [30322, 0.000204, " both", false], [115, 0.000185, "r", false], [32465, 0.000175, " when", false]]], "qwen": [315, 1, 0.9657832384109497, [[315, 0.965783, " of", false], [13, 0.009533, ".", false], [382, 0.00845, ".\n\n", false], [11, 0.006116, ",", false], [304, 0.002787, " in", false], [311, 0.000845, " to", false], [979, 0.000714, " when", false], [369, 0.00057, " for", false], [421, 0.000532, " if", false], [429, 0.000438, " that", false]]]}, "raw_delta": -0.00611211359500885, "tuned_delta": 0.0012250249186938865}, {"byte_start": 4322, "byte_end": 4333, "display": {"text": " researcher", "kind": "normal"}, "is_word": true, "word_id": 722, "word_key": " researcher", "bytes_hex": "20 72 65 73 65 61 72 63 68 65 72", "compression": {"rwkv": "11.37% 11.37% 11.37% 11.37% 11.37% 11.37% 11.37% 11.37% 11.37% 11.37% 11.37%", "qwen": "8.72% 8.72% 8.72% 8.72% 8.72% 8.72% 8.72% 8.72% 8.72% 8.72% 8.72%"}, "model_tokens": {"rwkv": [[62496, " researcher", "normal", 0.0009707725839689374]], "qwen": [[31085, " researcher", "normal", 0.004892498254776001]]}, "loss": {"rwkv": 11.3735191433718, "qwen": 8.721832783659178}, "topk": {"rwkv": [62496, 26, 0.0009707725839689374, [[32251, 0.42288, " time", false], [45829, 0.213963, " effort", false], [57103, 0.093224, " research", false], [60406, 0.082355, " resources", false], [38720, 0.045661, " human", false], [59346, 0.023217, " computing", false], [63370, 0.012824, " computation", false], [64862, 0.011861, " computational", false], [22590, 0.008835, " the", false], [39052, 0.006712, " money", false]]], "qwen": [31085, 16, 0.004892498254776001, [[882, 0.407485, " time", false], [5041, 0.179142, " effort", false], [3412, 0.074444, " research", false], [4963, 0.057635, " resources", false], [3738, 0.038905, " human", false], [54480, 0.034954, " computational", false], [24231, 0.02493, " computing", false], [34447, 0.024742, " computation", false], [279, 0.013204, " the", false], [862, 0.012156, " their", false]]]}, "raw_delta": 0.14704071391712545, "tuned_delta": 0.1543778524308282}, {"byte_start": 4333, "byte_end": 4335, "display": {"text": "'s", "kind": "normal"}, "is_word": true, "word_id": 723, "word_key": "'s", "bytes_hex": "27 73", "compression": {"rwkv": "26.21% 26.21%", "qwen": "24.62% 24.62%"}, "model_tokens": {"rwkv": [[460, "'s", "normal", 0.054352376610040665]], "qwen": [[594, "'s", "normal", 0.06518886238336563]]}, "loss": {"rwkv": 26.205202891147184, "qwen": 24.62019143274732}, "topk": {"rwkv": [460, 3, 0.054352376610040665, [[32251, 0.667085, " time", false], [45829, 0.165443, " effort", false], [460, 0.054352, "'s", false], [21265, 0.040722, " and", false], [45860, 0.016168, " energy", false], [46, 0.00989, "-", false], [60406, 0.009343, " resources", false], [51566, 0.004385, " efforts", false], [59193, 0.002752, " attention", false], [38853, 0.002407, " labor", false]]], "qwen": [594, 3, 0.06518886238336563, [[882, 0.681477, " time", false], [5041, 0.188081, " effort", false], [594, 0.065189, "'s", false], [4963, 0.014736, " resources", false], [4802, 0.01146, " energy", false], [323, 0.006305, " and", false], [8869, 0.004525, " efforts", false], [6529, 0.004199, " attention", false], [10772, 0.002837, " talent", false], [9327, 0.001501, " labor", false]]]}, "raw_delta": 0.08789169788360596, "tuned_delta": 0.0952288363973087}, {"byte_start": 4335, "byte_end": 4340, "display": {"text": " time", "kind": "normal"}, "is_word": true, "word_id": 724, "word_key": " time", "bytes_hex": "20 74 69 6d 65", "compression": {"rwkv": "0.50% 0.50% 0.50% 0.50% 0.50%", "qwen": "1.10% 1.10% 1.10% 1.10% 1.10%"}, "model_tokens": {"rwkv": [[32251, " time", "normal", 0.8708484768867493]], "qwen": [[882, " time", "normal", 0.7375895977020264]]}, "loss": {"rwkv": 0.5001530659331854, "qwen": 1.0977745045247913}, "topk": {"rwkv": [32251, 1, 0.8708484768867493, [[32251, 0.870848, " time", false], [45829, 0.039119, " effort", false], [21265, 0.020374, " and", false], [51566, 0.016816, " efforts", false], [45860, 0.00624, " energy", false], [38720, 0.003476, " human", false], [60406, 0.00275, " resources", false], [56903, 0.002628, " precious", false], [57516, 0.002365, " valuable", false], [59193, 0.001914, " attention", false]]], "qwen": [882, 1, 0.7375895977020264, [[882, 0.73759, " time", false], [5041, 0.128003, " effort", false], [8869, 0.025919, " efforts", false], [4802, 0.008823, " energy", false], [4963, 0.006566, " resources", false], [26400, 0.00652, " precious", false], [3738, 0.006044, " human", false], [6529, 0.005272, " attention", false], [323, 0.004589, " and", false], [15172, 0.004549, " valuable", false]]]}, "raw_delta": -0.033139169216156006, "tuned_delta": -0.02580203070245327}, {"byte_start": 4340, "byte_end": 4341, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "40.01%", "qwen": "40.43%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.11087194830179214]], "qwen": [[11, ",", "normal", 0.10624746233224869]]}, "loss": {"rwkv": 40.01224527465484, "qwen": 40.4312466069519}, "topk": {"rwkv": [45, 3, 0.11087194830179214, [[47, 0.640336, ".", false], [21265, 0.155578, " and", false], [45, 0.110872, ",", false], [4811, 0.025902, " to", false], [4596, 0.010639, " in", false], [275, 0.007843, " (", false], [32227, 0.006554, " that", false], [5346, 0.003996, "---", false], [4423, 0.003494, " as", false], [32465, 0.002765, " when", false]]], "qwen": [11, 4, 0.10624746233224869, [[323, 0.304828, " and", false], [13, 0.26084, ".", false], [382, 0.254418, ".\n\n", false], [11, 0.106247, ",", false], [304, 0.010195, " in", false], [311, 0.009514, " to", false], [320, 0.00708, " (", false], [624, 0.005238, ".\n", false], [4421, 0.004562, "---", false], [979, 0.004306, " when", false]]]}, "raw_delta": -0.02323436737060547, "tuned_delta": -0.015897228856902732}, {"byte_start": 4341, "byte_end": 4346, "display": {"text": " when", "kind": "normal"}, "is_word": true, "word_id": 725, "word_key": " when", "bytes_hex": "20 77 68 65 6e", "compression": {"rwkv": "12.68% 12.68% 12.68% 12.68% 12.68%", "qwen": "12.28% 12.28% 12.28% 12.28% 12.28%"}, "model_tokens": {"rwkv": [[32465, " when", "normal", 0.02941037155687809]], "qwen": [[979, " when", "normal", 0.03321311995387077]]}, "loss": {"rwkv": 12.679936882813154, "qwen": 12.280257801340529}, "topk": {"rwkv": [32465, 7, 0.02941037155687809, [[4811, 0.48583, " to", false], [51018, 0.054155, " because", false], [4423, 0.047252, " as", false], [4596, 0.036581, " in", false], [21265, 0.033216, " and", false], [45860, 0.031874, " energy", false], [32465, 0.02941, " when", false], [21700, 0.026097, " for", false], [22187, 0.025224, " not", false], [45829, 0.024754, " effort", false]]], "qwen": [979, 9, 0.03321311995387077, [[5041, 0.246581, " effort", false], [4802, 0.103955, " energy", false], [1576, 0.079911, " because", false], [438, 0.069456, " as", false], [323, 0.051911, " and", false], [3220, 0.050327, " money", false], [304, 0.041387, " in", false], [311, 0.035333, " to", false], [979, 0.033213, " when", false], [4963, 0.023515, " resources", false]]]}, "raw_delta": 0.022162914276123047, "tuned_delta": 0.029500052789825783}, {"byte_start": 4346, "byte_end": 4347, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "97.49%", "qwen": "80.84%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.004442139528691769]], "qwen": [[11, ",", "normal", 0.01130516454577446]]}, "loss": {"rwkv": 97.49462581007447, "qwen": 80.8359218943455}, "topk": {"rwkv": [45, 33, 0.004442139528691769, [[22590, 0.239071, " the", false], [32232, 0.097042, " they", false], [4601, 0.089803, " it", false], [30597, 0.038017, " deep", false], [32227, 0.03587, " that", false], [332, 0.025754, " a", false], [4596, 0.023079, " in", false], [39931, 0.018014, " their", false], [45301, 0.017185, " better", false], [32464, 0.01594, " what", false]]], "qwen": [11, 14, 0.01130516454577446, [[279, 0.162434, " the", false], [7707, 0.108965, " compared", false], [432, 0.107384, " it", false], [807, 0.078017, " they", false], [2711, 0.070108, " search", false], [264, 0.035017, " a", false], [10951, 0.027206, " massive", false], [803, 0.022081, " more", false], [304, 0.018598, " in", false], [5538, 0.014809, " deep", false]]]}, "raw_delta": 0.9237546920776367, "tuned_delta": 0.9310918305913395}, {"byte_start": 4347, "byte_end": 4355, "display": {"text": " through", "kind": "normal"}, "is_word": true, "word_id": 726, "word_key": " through", "bytes_hex": "20 74 68 72 6f 75 67 68", "compression": {"rwkv": "13.60% 13.60% 13.60% 13.60% 13.60% 13.60% 13.60% 13.60%", "qwen": "15.75% 15.75% 15.75% 15.75% 15.75% 15.75% 15.75% 15.75%"}, "model_tokens": {"rwkv": [[53140, " through", "normal", 0.002387400483712554]], "qwen": [[1526, " through", "normal", 0.0009252128074876964]]}, "loss": {"rwkv": 13.595710102127438, "qwen": 15.746761609962658}, "topk": {"rwkv": [53140, 36, 0.002387400483712554, [[4596, 0.245013, " in", false], [52028, 0.179985, " instead", false], [4423, 0.086962, " as", false], [4450, 0.03763, " by", false], [31578, 0.036127, " once", false], [32487, 0.034816, " with", false], [61959, 0.030538, " eventually", false], [31601, 0.024619, " over", false], [4424, 0.018281, " at", false], [37634, 0.016861, " after", false]]], "qwen": [1526, 62, 0.0009252128074876964, [[304, 0.329289, " in", false], [438, 0.123083, " as", false], [4518, 0.066681, " instead", false], [518, 0.054587, " at", false], [448, 0.034583, " with", false], [916, 0.0274, " over", false], [1283, 0.022602, " after", false], [553, 0.021075, " by", false], [389, 0.020413, " on", false], [3055, 0.018127, " once", false]]]}, "raw_delta": -0.11927962303161621, "tuned_delta": -0.11194248451791347}, {"byte_start": 4355, "byte_end": 4361, "display": {"text": " Moore", "kind": "normal"}, "is_word": true, "word_id": 727, "word_key": " moore", "bytes_hex": "20 4d 6f 6f 72 65", "compression": {"rwkv": "14.18% 14.18% 14.18% 14.18% 14.18% 14.18%", "qwen": "16.54% 16.54% 16.54% 16.54% 16.54% 16.54%"}, "model_tokens": {"rwkv": [[37045, " Moore", "normal", 0.00889422744512558]], "qwen": [[20219, " Moore", "normal", 0.0040683140978217125]]}, "loss": {"rwkv": 14.182744217072491, "qwen": 16.54448593772471}, "topk": {"rwkv": [37045, 18, 0.00889422744512558, [[22590, 0.179379, " the", false], [52195, 0.143146, " massive", false], [56537, 0.083228, " learning", false], [63370, 0.053932, " computation", false], [30597, 0.048259, " deep", false], [63885, 0.024335, " statistical", false], [332, 0.021216, " a", false], [51832, 0.018297, " general", false], [47202, 0.016792, " search", false], [57103, 0.016413, " research", false]]], "qwen": [20219, 27, 0.0040683140978217125, [[279, 0.237795, " the", false], [10951, 0.09182, " massive", false], [6832, 0.059796, " learning", false], [32538, 0.048165, " sheer", false], [2711, 0.044429, " search", false], [34447, 0.035206, " computation", false], [5538, 0.024726, " deep", false], [264, 0.02464, " a", false], [1753, 0.015854, " much", false], [990, 0.013902, " use", false]]]}, "raw_delta": -0.13096276919047034, "tuned_delta": -0.1236256306767676}, {"byte_start": 4361, "byte_end": 4363, "display": {"text": "'s", "kind": "normal"}, "is_word": true, "word_id": 728, "word_key": "'s", "bytes_hex": "27 73", "compression": {"rwkv": "0.03% 0.03%", "qwen": "0.03% 0.03%"}, "model_tokens": {"rwkv": [[460, "'s", "normal", 0.996393620967865]], "qwen": [[594, "'s", "normal", 0.9965344667434692]]}, "loss": {"rwkv": 0.032607910603588516, "qwen": 0.03130233932751536}, "topk": {"rwkv": [460, 1, 0.996393620967865, [[460, 0.996394, "'s", false], [116, 0.001818, "s", false], [28309, 0.000497, "’s", false], [40, 0.000227, "'", false], [21265, 0.000219, " and", false], [45, 0.000163, ",", false], [46, 0.000161, "-", false], [439, 3e-05, "''", false], [21988, 2.8e-05, " law", false], [4522, 2.7e-05, " et", false]]], "qwen": [594, 1, 0.9965344667434692, [[594, 0.996534, "'s", false], [748, 0.000975, "’s", false], [11, 0.000548, ",", false], [2329, 0.000432, " law", false], [6, 0.000262, "'", false], [12681, 0.000169, "-like", false], [323, 0.000102, " and", false], [4605, 9.1e-05, "''", false], [11297, 6.5e-05, "-style", false], [364, 4.8e-05, " '", false]]]}, "raw_delta": 7.23962439224124e-05, "tuned_delta": 0.007409534757625149}, {"byte_start": 4363, "byte_end": 4367, "display": {"text": " law", "kind": "normal"}, "is_word": true, "word_id": 729, "word_key": " law", "bytes_hex": "20 6c 61 77", "compression": {"rwkv": "0.31% 0.31% 0.31% 0.31%", "qwen": "0.30% 0.30% 0.30% 0.30%"}, "model_tokens": {"rwkv": [[21988, " law", "normal", 0.9330040812492371]], "qwen": [[2329, " law", "normal", 0.9363114237785339]]}, "loss": {"rwkv": 0.3125956662082409, "qwen": 0.29668629688294773}, "topk": {"rwkv": [21988, 1, 0.9330040812492371, [[21988, 0.933004, " law", false], [20267, 0.065092, " Law", false], [21265, 0.000218, " and", false], [31259, 0.000199, " laws", false], [45828, 0.000153, " effect", false], [46, 0.00011, "-", false], [45, 0.0001, ",", false], [53127, 9.9e-05, " theorem", false], [31907, 6.7e-05, " rule", false], [4715, 5.4e-05, " or", false]]], "qwen": [2329, 1, 0.9363114237785339, [[2329, 0.936311, " law", false], [7506, 0.050916, " Law", false], [6872, 0.003729, " laws", false], [220, 0.000412, " ", false], [5912, 0.000322, " rule", false], [323, 0.000269, " and", false], [5098, 0.000241, " progress", false], [320, 0.000219, " (", false], [30312, 0.000192, "-law", false], [10963, 0.000187, " magic", false]]]}, "raw_delta": 0.000882202759385109, "tuned_delta": 0.008219341273087846}, {"byte_start": 4367, "byte_end": 4368, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "2.52%", "qwen": "2.48%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.8703024983406067]], "qwen": [[11, ",", "normal", 0.8713169097900391]]}, "loss": {"rwkv": 2.518376353114279, "qwen": 2.4841316513756824}, "topk": {"rwkv": [45, 1, 0.8703024983406067, [[45, 0.870302, ",", false], [21265, 0.093706, " and", false], [4706, 0.009449, " of", false], [4715, 0.007448, " or", false], [46, 0.003969, "-", false], [275, 0.003592, " (", false], [460, 0.001074, "'s", false], [22590, 0.00074, " the", false], [37677, 0.000631, " alone", false], [4596, 0.000505, " in", false]]], "qwen": [11, 1, 0.8713169097900391, [[11, 0.871317, ",", false], [323, 0.097784, " and", false], [320, 0.006191, " (", false], [476, 0.002729, " or", false], [31405, 0.002712, "-driven", false], [315, 0.001506, " of", false], [594, 0.001459, "'s", false], [304, 0.001161, " in", false], [10856, 0.00105, " combined", false], [12681, 0.001013, "-like", false]]]}, "raw_delta": 0.001898929476737976, "tuned_delta": 0.009236067990440713}, {"byte_start": 4368, "byte_end": 4376, "display": {"text": " massive", "kind": "normal"}, "is_word": true, "word_id": 730, "word_key": " massive", "bytes_hex": "20 6d 61 73 73 69 76 65", "compression": {"rwkv": "6.76% 6.76% 6.76% 6.76% 6.76% 6.76% 6.76% 6.76%", "qwen": "6.46% 6.46% 6.46% 6.46% 6.46% 6.46% 6.46% 6.46%"}, "model_tokens": {"rwkv": [[52195, " massive", "normal", 0.049958325922489166]], "qwen": [[10951, " massive", "normal", 0.057061079889535904]]}, "loss": {"rwkv": 6.762633004167015, "qwen": 6.455233363797967}, "topk": {"rwkv": [52195, 5, 0.049958325922489166, [[22590, 0.244659, " the", false], [63370, 0.125539, " computation", false], [32232, 0.068254, " they", false], [31458, 0.051521, " more", false], [52195, 0.049958, " massive", false], [4601, 0.036433, " it", false], [32227, 0.024094, " that", false], [332, 0.023815, " a", false], [45301, 0.022837, " better", false], [39931, 0.022699, " their", false]]], "qwen": [10951, 5, 0.057061079889535904, [[279, 0.17426, " the", false], [807, 0.081228, " they", false], [803, 0.074922, " more", false], [34447, 0.072744, " computation", false], [10951, 0.057061, " massive", false], [1753, 0.047729, " much", false], [432, 0.04672, " it", false], [264, 0.032111, " a", false], [862, 0.018677, " their", false], [1052, 0.016162, " there", false]]]}, "raw_delta": 0.01704585552215576, "tuned_delta": 0.0243829940358585}, {"byte_start": 4376, "byte_end": 4388, "display": {"text": " computation", "kind": "normal"}, "is_word": true, "word_id": 731, "word_key": " computation", "bytes_hex": "20 63 6f 6d 70 75 74 61 74 69 6f 6e", "compression": {"rwkv": "2.09% 2.09% 2.09% 2.09% 2.09% 2.09% 2.09% 2.09% 2.09% 2.09% 2.09% 2.09%", "qwen": "1.84% 1.84% 1.84% 1.84% 1.84% 1.84% 1.84% 1.84% 1.84% 1.84% 1.84% 1.84%"}, "model_tokens": {"rwkv": [[63370, " computation", "normal", 0.24998295307159424]], "qwen": [[34447, " computation", "normal", 0.2932566702365875]]}, "loss": {"rwkv": 2.0898414492043904, "qwen": 1.8435042490241822}, "topk": {"rwkv": [63370, 2, 0.24998295307159424, [[50897, 0.396696, " amounts", false], [63370, 0.249983, " computation", false], [64423, 0.036658, " improvements", false], [22168, 0.031495, " new", false], [64862, 0.021716, " computational", false], [45, 0.020498, ",", false], [31458, 0.019133, " more", false], [59847, 0.019125, " increases", false], [63621, 0.015993, " improvement", false], [61535, 0.015844, " additional", false]]], "qwen": [34447, 2, 0.2932566702365875, [[14713, 0.427977, " amounts", false], [34447, 0.293257, " computation", false], [54480, 0.049017, " computational", false], [24231, 0.022304, " computing", false], [11, 0.02115, ",", false], [5107, 0.014191, " additional", false], [32676, 0.012414, " quantities", false], [12703, 0.01168, " increases", false], [803, 0.011543, " more", false], [501, 0.009909, " new", false]]]}, "raw_delta": 0.013659834861755371, "tuned_delta": 0.020996973375458108}, {"byte_start": 4388, "byte_end": 4395, "display": {"text": " became", "kind": "normal"}, "is_word": true, "word_id": 732, "word_key": " became", "bytes_hex": "20 62 65 63 61 6d 65", "compression": {"rwkv": "2.51% 2.51% 2.51% 2.51% 2.51% 2.51% 2.51%", "qwen": "2.41% 2.41% 2.41% 2.41% 2.41% 2.41% 2.41%"}, "model_tokens": {"rwkv": [[45283, " became", "normal", 0.37947309017181396]], "qwen": [[6116, " became", "normal", 0.39302074909210205]]}, "loss": {"rwkv": 2.50579705065117, "qwen": 2.405933328200484}, "topk": {"rwkv": [45283, 1, 0.37947309017181396, [[45283, 0.379473, " became", false], [22748, 0.227648, " was", false], [38128, 0.056042, " could", false], [21265, 0.053189, " and", false], [30383, 0.047735, " came", false], [51744, 0.021061, " finally", false], [4600, 0.014273, " is", false], [21795, 0.01327, " had", false], [45, 0.011303, ",", false], [61959, 0.009236, " eventually", false]]], "qwen": [6116, 1, 0.39302074909210205, [[6116, 0.393021, " became", false], [572, 0.194667, " was", false], [1410, 0.040672, " could", false], [3697, 0.03836, " came", false], [9583, 0.036963, " eventually", false], [323, 0.022499, " and", false], [9044, 0.021965, " becomes", false], [374, 0.019237, " is", false], [1035, 0.015391, " would", false], [5499, 0.014598, " finally", false]]]}, "raw_delta": 0.005537620612553168, "tuned_delta": 0.012874759126255905}, {"byte_start": 4395, "byte_end": 4405, "display": {"text": " available", "kind": "normal"}, "is_word": true, "word_id": 733, "word_key": " available", "bytes_hex": "20 61 76 61 69 6c 61 62 6c 65", "compression": {"rwkv": "0.85% 0.85% 0.85% 0.85% 0.85% 0.85% 0.85% 0.85% 0.85% 0.85%", "qwen": "0.83% 0.83% 0.83% 0.83% 0.83% 0.83% 0.83% 0.83% 0.83% 0.83%"}, "model_tokens": {"rwkv": [[59206, " available", "normal", 0.6286380887031555]], "qwen": [[2500, " available", "normal", 0.6327334046363831]]}, "loss": {"rwkv": 0.8488513302105472, "qwen": 0.8254128896160231}, "topk": {"rwkv": [59206, 1, 0.6286380887031555, [[59206, 0.628638, " available", false], [22590, 0.100742, " the", false], [31458, 0.035837, " more", false], [332, 0.026808, " a", false], [56895, 0.014868, " possible", false], [52648, 0.01374, " readily", false], [46042, 0.010703, " freely", false], [59758, 0.010176, " generally", false], [64430, 0.010156, " increasingly", false], [31466, 0.009551, " much", false]]], "qwen": [2500, 1, 0.6327334046363831, [[2500, 0.632733, " available", false], [30268, 0.039508, " readily", false], [279, 0.037552, " the", false], [803, 0.032959, " more", false], [3204, 0.02564, " possible", false], [1753, 0.019598, " much", false], [773, 0.017614, " so", false], [13570, 0.013775, " widely", false], [14756, 0.01292, " increasingly", false], [264, 0.01292, " a", false]]]}, "raw_delta": 0.0012997031211853041, "tuned_delta": 0.00863684163488804}, {"byte_start": 4405, "byte_end": 4409, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 734, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"rwkv": "12.82% 12.82% 12.82% 12.82%", "qwen": "11.87% 11.87% 11.87% 11.87%"}, "model_tokens": {"rwkv": [[21265, " and", "normal", 0.058458633720874786]], "qwen": [[323, " and", "normal", 0.07190161198377609]]}, "loss": {"rwkv": 12.820825070399966, "qwen": 11.868226065969685}, "topk": {"rwkv": [21265, 4, 0.058458633720874786, [[47, 0.342059, ".", false], [4811, 0.220399, " to", false], [4424, 0.083048, " at", false], [21265, 0.058459, " and", false], [45, 0.050706, ",", false], [52028, 0.044586, " instead", false], [21700, 0.040296, " for", false], [4596, 0.038313, " in", false], [32227, 0.030314, " that", false], [4423, 0.010007, " as", false]]], "qwen": [323, 5, 0.07190161198377609, [[382, 0.23149, ".\n\n", false], [13, 0.215409, ".", false], [311, 0.10388, " to", false], [429, 0.0986, " that", false], [323, 0.071902, " and", false], [11, 0.058201, ",", false], [304, 0.038352, " in", false], [518, 0.032441, " at", false], [369, 0.027997, " for", false], [4518, 0.015276, " instead", false]]]}, "raw_delta": 0.05282330513000488, "tuned_delta": 0.06016044364370762}, {"byte_start": 4409, "byte_end": 4411, "display": {"text": " a", "kind": "normal"}, "is_word": true, "word_id": 735, "word_key": " a", "bytes_hex": "20 61", "compression": {"rwkv": "43.68% 43.68%", "qwen": "37.09% 37.09%"}, "model_tokens": {"rwkv": [[332, " a", "normal", 0.00783795490860939]], "qwen": [[264, " a", "normal", 0.01634964533150196]]}, "loss": {"rwkv": 43.67533815191197, "qwen": 37.0912317384731}, "topk": {"rwkv": [332, 21, 0.00783795490860939, [[22590, 0.133592, " the", false], [38128, 0.093366, " could", false], [22748, 0.075814, " was", false], [4601, 0.041198, " it", false], [31351, 0.038126, " made", false], [50887, 0.02054, " allowed", false], [51596, 0.019992, " enabled", false], [22249, 0.017649, " out", false], [45, 0.015424, ",", false], [32227, 0.014165, " that", false]]], "qwen": [264, 10, 0.01634964533150196, [[279, 0.120917, " the", false], [1410, 0.117716, " could", false], [572, 0.067555, " was", false], [432, 0.034898, " it", false], [4362, 0.022412, " needed", false], [2711, 0.020414, " search", false], [429, 0.019385, " that", false], [803, 0.017654, " more", false], [5538, 0.017278, " deep", false], [264, 0.01635, " a", false]]]}, "raw_delta": 0.3651003837585449, "tuned_delta": 0.37243752227224763}, {"byte_start": 4411, "byte_end": 4417, "display": {"text": " means", "kind": "normal"}, "is_word": true, "word_id": 736, "word_key": " means", "bytes_hex": "20 6d 65 61 6e 73", "compression": {"rwkv": "28.74% 28.74% 28.74% 28.74% 28.74% 28.74%", "qwen": "27.04% 27.04% 27.04% 27.04% 27.04% 27.04%"}, "model_tokens": {"rwkv": [[38989, " means", "normal", 7.061094947857782e-05]], "qwen": [[3363, " means", "normal", 0.0001237821561517194]]}, "loss": {"rwkv": 28.741190267709815, "qwen": 27.041477130100134}, "topk": {"rwkv": [38989, 516, 7.061094947857782e-05, [[59513, 0.136203, " different", false], [45301, 0.124051, " better", false], [22168, 0.085293, " new", false], [63885, 0.061226, " statistical", false], [31458, 0.059176, " more", false], [31466, 0.05785, " much", false], [47202, 0.023225, " search", false], [51832, 0.021933, " general", false], [47708, 0.020311, " vastly", false], [52907, 0.019731, " simpler", false]]], "qwen": [3363, 346, 0.0001237821561517194, [[2711, 0.096738, " search", false], [2155, 0.089491, " different", false], [501, 0.086501, " new", false], [1753, 0.050604, " much", false], [2664, 0.050082, " better", false], [803, 0.047499, " more", false], [4285, 0.04206, " simple", false], [4586, 0.039017, " general", false], [28464, 0.035356, " statistical", false], [1714, 0.027322, " method", false]]]}, "raw_delta": 0.09425210952758789, "tuned_delta": 0.10158924804129063}, {"byte_start": 4417, "byte_end": 4421, "display": {"text": " was", "kind": "normal"}, "is_word": true, "word_id": 737, "word_key": " was", "bytes_hex": "20 77 61 73", "compression": {"rwkv": "11.20% 11.20% 11.20% 11.20%", "qwen": "10.58% 10.58% 10.58% 10.58%"}, "model_tokens": {"rwkv": [[22748, " was", "normal", 0.08328719437122345]], "qwen": [[572, " was", "normal", 0.09576229751110077]]}, "loss": {"rwkv": 11.20061091315162, "qwen": 10.576245097459278}, "topk": {"rwkv": [22748, 3, 0.08328719437122345, [[4706, 0.54081, " of", false], [4811, 0.243293, " to", false], [22748, 0.083287, " was", false], [21700, 0.075617, " for", false], [38128, 0.011226, " could", false], [4450, 0.011117, " by", false], [51680, 0.005272, " existed", false], [32227, 0.002828, " that", false], [21795, 0.002679, " had", false], [38547, 0.002312, " found", false]]], "qwen": [572, 4, 0.09576229751110077, [[315, 0.379491, " of", false], [311, 0.286611, " to", false], [369, 0.135096, " for", false], [572, 0.095762, " was", false], [1410, 0.023275, " could", false], [429, 0.01598, " that", false], [1030, 0.009299, " had", false], [553, 0.00645, " by", false], [803, 0.003219, " more", false], [2664, 0.002605, " better", false]]]}, "raw_delta": 0.0346221923828125, "tuned_delta": 0.04195933089651524}, {"byte_start": 4421, "byte_end": 4427, "display": {"text": " found", "kind": "normal"}, "is_word": true, "word_id": 738, "word_key": " found", "bytes_hex": "20 66 6f 75 6e 64", "compression": {"rwkv": "0.48% 0.48% 0.48% 0.48% 0.48% 0.48%", "qwen": "1.24% 1.24% 1.24% 1.24% 1.24% 1.24%"}, "model_tokens": {"rwkv": [[38547, " found", "normal", 0.8536377549171448]], "qwen": [[1730, " found", "normal", 0.6622791886329651]]}, "loss": {"rwkv": 0.47549763310549326, "qwen": 1.2385177429836738}, "topk": {"rwkv": [38547, 1, 0.8536377549171448, [[38547, 0.853638, " found", false], [61885, 0.041881, " discovered", false], [59506, 0.016462, " developed", false], [56976, 0.015115, " provided", false], [51744, 0.014668, " finally", false], [51458, 0.010308, " devised", false], [59206, 0.005845, " available", false], [56492, 0.004009, " invented", false], [4424, 0.003829, " at", false], [61959, 0.003535, " eventually", false]]], "qwen": [1730, 1, 0.6622791886329651, [[1730, 0.662279, " found", false], [11105, 0.070285, " discovered", false], [3897, 0.054142, " provided", false], [4362, 0.043026, " needed", false], [5499, 0.015155, " finally", false], [3465, 0.011804, " created", false], [2500, 0.00995, " available", false], [518, 0.009313, " at", false], [9555, 0.008666, " established", false], [7881, 0.008553, " developed", false]]]}, "raw_delta": -0.042310819029808044, "tuned_delta": -0.034973680516105304}, {"byte_start": 4427, "byte_end": 4430, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 739, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "1.29% 1.29% 1.29%", "qwen": "0.98% 0.98% 0.98%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.8052122592926025]], "qwen": [[311, " to", "normal", 0.8500741124153137]]}, "loss": {"rwkv": 1.285604711729667, "qwen": 0.976414391582807}, "topk": {"rwkv": [4811, 1, 0.8052122592926025, [[4811, 0.805212, " to", false], [4706, 0.090304, " of", false], [21700, 0.046858, " for", false], [275, 0.013616, " (", false], [45, 0.011119, ",", false], [32227, 0.010141, " that", false], [4450, 0.007618, " by", false], [5346, 0.002955, "---", false], [22187, 0.001397, " not", false], [4596, 0.001298, " in", false]]], "qwen": [311, 1, 0.8500741124153137, [[311, 0.850074, " to", false], [369, 0.070927, " for", false], [315, 0.019311, " of", false], [429, 0.013787, " that", false], [11, 0.006648, ",", false], [553, 0.005246, " by", false], [304, 0.004791, " in", false], [320, 0.002589, " (", false], [537, 0.002422, " not", false], [1526, 0.002282, " through", false]]]}, "raw_delta": 0.01714515189329783, "tuned_delta": 0.024482290407000565}, {"byte_start": 4430, "byte_end": 4434, "display": {"text": " put", "kind": "normal"}, "is_word": true, "word_id": 740, "word_key": " put", "bytes_hex": "20 70 75 74", "compression": {"rwkv": "13.60% 13.60% 13.60% 13.60%", "qwen": "10.10% 10.10% 10.10% 10.10%"}, "model_tokens": {"rwkv": [[22339, " put", "normal", 0.04838074371218681]], "qwen": [[2182, " put", "normal", 0.10636377334594727]]}, "loss": {"rwkv": 13.595710102127438, "qwen": 10.102878974332917}, "topk": {"rwkv": [22339, 7, 0.04838074371218681, [[22681, 0.135285, " use", false], [31358, 0.106162, " make", false], [56540, 0.099469, " leverage", false], [32187, 0.087481, " take", false], [53251, 0.064182, " utilize", false], [37911, 0.048908, " bring", false], [22339, 0.048381, " put", false], [37730, 0.037731, " apply", false], [51690, 0.025215, " exploit", false], [21751, 0.020758, " get", false]]], "qwen": [2182, 1, 0.10636377334594727, [[2182, 0.106364, " put", false], [32064, 0.095979, " leverage", false], [1896, 0.090858, " take", false], [1281, 0.090596, " make", false], [990, 0.085173, " use", false], [32408, 0.044063, " harness", false], [32194, 0.036651, " exploit", false], [4446, 0.033395, " bring", false], [3796, 0.030367, " apply", false], [28066, 0.025767, " utilize", false]]]}, "raw_delta": 0.1936836838722229, "tuned_delta": 0.20102082238592564}, {"byte_start": 4434, "byte_end": 4437, "display": {"text": " it", "kind": "normal"}, "is_word": true, "word_id": 741, "word_key": " it", "bytes_hex": "20 69 74", "compression": {"rwkv": "5.66% 5.66% 5.66%", "qwen": "3.44% 3.44% 3.44%"}, "model_tokens": {"rwkv": [[4601, " it", "normal", 0.390901118516922]], "qwen": [[432, " it", "normal", 0.5642081499099731]]}, "loss": {"rwkv": 5.659008868070314, "qwen": 3.44041941494408}, "topk": {"rwkv": [4601, 2, 0.390901118516922, [[32227, 0.402083, " that", false], [4601, 0.390901, " it", false], [22590, 0.049291, " the", false], [52195, 0.02749, " massive", false], [21256, 0.014536, " all", false], [63370, 0.012006, " computation", false], [32234, 0.011407, " this", false], [31466, 0.010069, " much", false], [332, 0.009875, " a", false], [32139, 0.008208, " such", false]]], "qwen": [432, 1, 0.5642081499099731, [[432, 0.564208, " it", false], [429, 0.290662, " that", false], [419, 0.021829, " this", false], [279, 0.014798, " the", false], [678, 0.013609, " all", false], [803, 0.010546, " more", false], [10951, 0.010346, " massive", false], [34447, 0.009711, " computation", false], [1496, 0.005578, " even", false], [264, 0.005563, " a", false]]]}, "raw_delta": 0.12302472194035846, "tuned_delta": 0.1303618604540612}, {"byte_start": 4437, "byte_end": 4440, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 742, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "2.13% 2.13% 2.13%", "qwen": "0.97% 0.97% 0.97%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.7025048732757568]], "qwen": [[311, " to", "normal", 0.8510703444480896]]}, "loss": {"rwkv": 2.1250634961010935, "qwen": 0.9693738518131108}, "topk": {"rwkv": [4811, 1, 0.7025048732757568, [[4811, 0.702505, " to", false], [4596, 0.098626, " in", false], [21256, 0.058248, " all", false], [31162, 0.054111, " into", false], [39934, 0.031923, " there", false], [4424, 0.016333, " at", false], [40185, 0.005146, " where", false], [46301, 0.005099, " inside", false], [63507, 0.003761, " effectively", false], [56003, 0.002716, " directly", false]]], "qwen": [311, 1, 0.8510703444480896, [[311, 0.85107, " to", false], [304, 0.050348, " in", false], [1119, 0.038508, " into", false], [13444, 0.021227, " effectively", false], [5961, 0.009136, " directly", false], [990, 0.002848, " use", false], [518, 0.002263, " at", false], [29720, 0.002102, " efficiently", false], [678, 0.001641, " all", false], [7225, 0.001396, " fully", false]]]}, "raw_delta": 0.06408504148324332, "tuned_delta": 0.07142217999694606}, {"byte_start": 4440, "byte_end": 4445, "display": {"text": " good", "kind": "normal"}, "is_word": true, "word_id": 743, "word_key": " good", "bytes_hex": "20 67 6f 6f 64", "compression": {"rwkv": "7.95% 7.95% 7.95% 7.95% 7.95%", "qwen": "8.16% 8.16% 8.16% 8.16% 8.16%"}, "model_tokens": {"rwkv": [[30992, " good", "normal", 0.10982763022184372]], "qwen": [[1661, " good", "normal", 0.10399079322814941]]}, "loss": {"rwkv": 7.946093779896243, "qwen": 8.163681070288343}, "topk": {"rwkv": [30992, 3, 0.10982763022184372, [[22681, 0.307719, " use", false], [32499, 0.243348, " work", false], [30992, 0.109828, " good", false], [45301, 0.085858, " better", false], [59593, 0.079113, " effective", false], [22590, 0.020739, " the", false], [31466, 0.020497, " much", false], [62383, 0.017599, " productive", false], [30273, 0.011012, " best", false], [31458, 0.007308, " more", false]]], "qwen": [1661, 3, 0.10399079322814941, [[990, 0.247732, " use", false], [975, 0.241505, " work", false], [1661, 0.103991, " good", false], [2664, 0.088417, " better", false], [7373, 0.053809, " effective", false], [279, 0.039391, " the", false], [1850, 0.03241, " best", false], [1753, 0.018473, " much", false], [803, 0.014827, " more", false], [26236, 0.01261, " productive", false]]]}, "raw_delta": -0.012065601348876964, "tuned_delta": -0.004728462835174228}, {"byte_start": 4445, "byte_end": 4449, "display": {"text": " use", "kind": "normal"}, "is_word": true, "word_id": 744, "word_key": " use", "bytes_hex": "20 75 73 65", "compression": {"rwkv": "0.17% 0.17% 0.17% 0.17%", "qwen": "0.16% 0.16% 0.16% 0.16%"}, "model_tokens": {"rwkv": [[22681, " use", "normal", 0.9618926644325256]], "qwen": [[990, " use", "normal", 0.9658353328704834]]}, "loss": {"rwkv": 0.17390885655247207, "qwen": 0.15672154192403911}, "topk": {"rwkv": [22681, 1, 0.9618926644325256, [[22681, 0.961893, " use", false], [45828, 0.008224, " effect", false], [45, 0.005287, ",", false], [59093, 0.004005, " advantage", false], [32499, 0.001997, " work", false], [21265, 0.001875, " and", false], [51832, 0.001627, " general", false], [50845, 0.001018, " account", false], [60212, 0.000923, " practical", false], [275, 0.00086, " (", false]]], "qwen": [990, 1, 0.9658353328704834, [[990, 0.965835, " use", false], [2456, 0.0087, " effect", false], [975, 0.007098, " work", false], [2692, 0.002582, " account", false], [9423, 0.001591, " advantage", false], [323, 0.001557, " and", false], [11, 0.001498, ",", false], [5711, 0.00129, " uses", false], [7428, 0.001177, " purpose", false], [320, 0.001028, " (", false]]]}, "raw_delta": 0.0009530670940876007, "tuned_delta": 0.008290205607790337}, {"byte_start": 4449, "byte_end": 4451, "display": {"text": ".\n", "kind": "control"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e 0a", "compression": {"rwkv": "3.56% 1.98%", "qwen": "4.00% 4.00%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.8192779421806335], [261, "\n\n", "control", 0.8037527203559875]], "qwen": [[382, ".\n\n", "control", 0.5144608616828918]]}, "loss": {"rwkv": 2.7693334372532896, "qwen": 3.9952780839930266}, "topk": {"rwkv": [47, 1, 0.8192779421806335, [[47, 0.819278, ".", false], [4596, 0.050958, " in", false], [45, 0.028298, ",", false], [5346, 0.017326, "---", false], [53356, 0.017253, " without", false], [52028, 0.01038, " instead", false], [275, 0.005676, " (", false], [4450, 0.005481, " by", false], [21265, 0.003156, " and", false], [21700, 0.003109, " for", false]]], "qwen": [382, 1, 0.5144608616828918, [[382, 0.514461, ".\n\n", false], [13, 0.244287, ".", false], [304, 0.056674, " in", false], [11, 0.029495, ",", false], [624, 0.01973, ".\n", false], [553, 0.017578, " by", false], [2041, 0.017143, " without", false], [4192, 0.014547, ".\n\n\n", false], [4421, 0.014191, "---", false], [1526, 0.009009, " through", false]]]}, "raw_delta": -0.06798080603281656, "tuned_delta": -0.06064366751911382}, {"byte_start": 4451, "byte_end": 4452, "display": {"text": "\n", "kind": "control"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "0a", "compression": {"rwkv": "1.98%", "qwen": "4.00%"}, "model_tokens": {"rwkv": [[261, "\n\n", "control", 0.8037527203559875]], "qwen": [[382, ".\n\n", "control", 0.5144608616828918]]}, "loss": {"rwkv": 1.9812401379395552, "qwen": 3.9952780839930266}, "topk": {"rwkv": [261, 1, 0.8037527203559875, [[261, 0.803753, "\n\n", false], [267, 0.021645, "  ", false], [20996, 0.019981, " The", false], [0, 0.013356, "[0]", false], [3913, 0.009986, " In", false], [3918, 0.008428, " It", false], [3336, 0.008236, " \n\n", false], [3328, 0.007841, "\n\n\n", false], [11, 0.007355, "\n", false], [29894, 0.005757, " This", false]]], "qwen": [382, 1, 0.5144608616828918, [[382, 0.514461, ".\n\n", false], [13, 0.244287, ".", false], [304, 0.056674, " in", false], [11, 0.029495, ",", false], [624, 0.01973, ".\n", false], [553, 0.017578, " by", false], [2041, 0.017143, " without", false], [4192, 0.014547, ".\n\n\n", false], [4421, 0.014191, "---", false], [1526, 0.009009, " through", false]]]}, "raw_delta": -0.11168197790781656, "tuned_delta": -0.10434483939411382}, {"byte_start": 4452, "byte_end": 4454, "display": {"text": "In", "kind": "normal"}, "is_word": true, "word_id": 745, "word_key": "in", "bytes_hex": "49 6e", "compression": {"rwkv": "11.34% 11.34%", "qwen": "11.56% 11.56%"}, "model_tokens": {"rwkv": [[1136, "In", "normal", 0.28118252754211426]], "qwen": [[641, "In", "normal", 0.2775447964668274]]}, "loss": {"rwkv": 11.341499100738432, "qwen": 11.557545856535429}, "topk": {"rwkv": [1136, 1, 0.28118252754211426, [[1136, 0.281183, "In", false], [6699, 0.127372, "The", false], [66, 0.062465, "A", false], [33504, 0.062036, "There", false], [33505, 0.032893, "These", false], [48358, 0.030664, "Another", false], [1141, 0.024833, "It", false], [24242, 0.015986, "This", false], [6393, 0.012421, "One", false], [5559, 0.011385, "All", false]]], "qwen": [641, 1, 0.2775447964668274, [[641, 0.277545, "In", false], [785, 0.116033, "The", false], [32, 0.040546, "A", false], [3862, 0.038229, "There", false], [9485, 0.028259, "These", false], [14037, 0.017428, "Another", false], [67691, 0.016609, "Similarly", false], [1986, 0.015898, "This", false], [2132, 0.014444, "It", false], [33464, 0.012972, "Deep", false]]]}, "raw_delta": -0.011980175971984863, "tuned_delta": -0.004643037458282127}, {"byte_start": 4454, "byte_end": 4463, "display": {"text": " computer", "kind": "normal"}, "is_word": true, "word_id": 746, "word_key": " computer", "bytes_hex": "20 63 6f 6d 70 75 74 65 72", "compression": {"rwkv": "3.26% 3.26% 3.26% 3.26% 3.26% 3.26% 3.26% 3.26% 3.26%", "qwen": "3.91% 3.91% 3.91% 3.91% 3.91% 3.91% 3.91% 3.91% 3.91%"}, "model_tokens": {"rwkv": [[55809, " computer", "normal", 0.19519005715847015]], "qwen": [[6366, " computer", "normal", 0.1419302076101303]]}, "loss": {"rwkv": 3.2560825575618964, "qwen": 3.9121478810505597}, "topk": {"rwkv": [55809, 1, 0.19519005715847015, [[55809, 0.19519, " computer", false], [52766, 0.159425, " robotic", false], [22590, 0.091206, " the", false], [52299, 0.050789, " natural", false], [21256, 0.023348, " all", false], [52209, 0.021798, " medical", false], [38744, 0.021718, " image", false], [52167, 0.020798, " machine", false], [332, 0.016605, " a", false], [31370, 0.016007, " many", false]]], "qwen": [6366, 1, 0.1419302076101303, [[6366, 0.14193, " computer", false], [279, 0.130395, " the", false], [73606, 0.125936, " robotics", false], [5662, 0.046521, " machine", false], [678, 0.036918, " all", false], [71278, 0.034866, " reinforcement", false], [11129, 0.030967, " vision", false], [12305, 0.027495, " robot", false], [5810, 0.025839, " natural", false], [2168, 0.024849, " image", false]]]}, "raw_delta": -0.03637998633914524, "tuned_delta": -0.029042847825442506}, {"byte_start": 4463, "byte_end": 4470, "display": {"text": " vision", "kind": "normal"}, "is_word": true, "word_id": 747, "word_key": " vision", "bytes_hex": "20 76 69 73 69 6f 6e", "compression": {"rwkv": "0.12% 0.12% 0.12% 0.12% 0.12% 0.12% 0.12%", "qwen": "0.56% 0.56% 0.56% 0.56% 0.56% 0.56% 0.56%"}, "model_tokens": {"rwkv": [[47732, " vision", "normal", 0.9545140266418457]], "qwen": [[11129, " vision", "normal", 0.8056734204292297]]}, "loss": {"rwkv": 0.121390268768995, "qwen": 0.5566659584607483}, "topk": {"rwkv": [47732, 1, 0.9545140266418457, [[47732, 0.954514, " vision", false], [52814, 0.006095, " science", false], [63944, 0.004191, " translation", false], [46, 0.003382, "-", false], [56329, 0.002974, " graphics", false], [52766, 0.002701, " robotic", false], [56529, 0.002574, " language", false], [31044, 0.002107, " hand", false], [38744, 0.001634, " image", false], [45032, 0.001131, " Vision", false]]], "qwen": [11129, 1, 0.8056734204292297, [[11129, 0.805673, " vision", false], [5994, 0.035949, " Go", false], [3868, 0.02343, " games", false], [1809, 0.018173, " game", false], [8038, 0.007636, " science", false], [73606, 0.006905, " robotics", false], [8273, 0.006662, "-v", false], [14181, 0.006551, " graphics", false], [20814, 0.005766, " poker", false], [2766, 0.005482, " video", false]]]}, "raw_delta": -0.024136809366089956, "tuned_delta": -0.01679967085238722}, {"byte_start": 4470, "byte_end": 4471, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "1.43%", "qwen": "1.78%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.9239686727523804]], "qwen": [[11, ",", "normal", 0.9061692357063293]]}, "loss": {"rwkv": 1.4264928993164798, "qwen": 1.7768446692927307}, "topk": {"rwkv": [45, 1, 0.9239686727523804, [[45, 0.923969, ",", false], [21265, 0.031889, " and", false], [275, 0.009167, " (", false], [39934, 0.006789, " there", false], [5346, 0.003794, "---", false], [57103, 0.003464, " research", false], [22590, 0.003072, " the", false], [22614, 0.002319, " too", false], [53087, 0.001331, " systems", false], [4423, 0.00107, " as", false]]], "qwen": [11, 1, 0.9061692357063293, [[11, 0.906169, ",", false], [323, 0.034152, " and", false], [1052, 0.011199, " there", false], [320, 0.011075, " (", false], [3412, 0.004476, " research", false], [279, 0.00315, " the", false], [4421, 0.002759, "---", false], [438, 0.002543, " as", false], [304, 0.002428, " in", false], [11811, 0.002211, " researchers", false]]]}, "raw_delta": -0.019427627325057983, "tuned_delta": -0.012090488811355247}, {"byte_start": 4471, "byte_end": 4477, "display": {"text": " there", "kind": "normal"}, "is_word": true, "word_id": 748, "word_key": " there", "bytes_hex": "20 74 68 65 72 65", "compression": {"rwkv": "6.11% 6.11% 6.11% 6.11% 6.11% 6.11%", "qwen": "5.20% 5.20% 5.20% 5.20% 5.20% 5.20%"}, "model_tokens": {"rwkv": [[39934, " there", "normal", 0.12875375151634216]], "qwen": [[1052, " there", "normal", 0.1774648129940033]]}, "loss": {"rwkv": 6.105154795428556, "qwen": 5.19665644224577}, "topk": {"rwkv": [39934, 2, 0.12875375151634216, [[22590, 0.334547, " the", false], [39934, 0.128754, " there", false], [332, 0.065088, " a", false], [63843, 0.03896, " researchers", false], [4601, 0.022968, " it", false], [50919, 0.022073, " another", false], [37635, 0.015774, " again", false], [52224, 0.015081, " methods", false], [4596, 0.013767, " in", false], [22226, 0.012005, " one", false]]], "qwen": [1052, 2, 0.1774648129940033, [[279, 0.208848, " the", false], [1052, 0.177465, " there", false], [11811, 0.082833, " researchers", false], [264, 0.054324, " a", false], [4124, 0.053299, " early", false], [304, 0.021776, " in", false], [5413, 0.016807, " methods", false], [3738, 0.015499, " human", false], [432, 0.01524, " it", false], [458, 0.013534, " an", false]]]}, "raw_delta": 0.050377845764160156, "tuned_delta": 0.057714984277862896}, {"byte_start": 4477, "byte_end": 4481, "display": {"text": " has", "kind": "normal"}, "is_word": true, "word_id": 749, "word_key": " has", "bytes_hex": "20 68 61 73", "compression": {"rwkv": "9.02% 9.02% 9.02% 9.02%", "qwen": "10.06% 10.06% 10.06% 10.06%"}, "model_tokens": {"rwkv": [[21800, " has", "normal", 0.1361512839794159]], "qwen": [[702, " has", "normal", 0.10737162828445435]]}, "loss": {"rwkv": 9.01684400555602, "qwen": 10.06035948858179}, "topk": {"rwkv": [21800, 3, 0.1361512839794159, [[22748, 0.388868, " was", false], [32462, 0.231123, " were", false], [21800, 0.136151, " has", false], [31059, 0.104382, " have", false], [4600, 0.070452, " is", false], [21286, 0.041788, " are", false], [21795, 0.004284, " had", false], [22614, 0.002806, " too", false], [37635, 0.0028, " again", false], [30135, 0.002444, " also", false]]], "qwen": [702, 3, 0.10737162828445435, [[572, 0.514358, " was", false], [1033, 0.172868, " were", false], [702, 0.107372, " has", false], [374, 0.077177, " is", false], [614, 0.052585, " have", false], [525, 0.039749, " are", false], [1030, 0.007536, " had", false], [1083, 0.006672, " also", false], [1549, 0.003572, " again", false], [2238, 0.002997, " too", false]]]}, "raw_delta": -0.05786478519439697, "tuned_delta": -0.05052764668069423}, {"byte_start": 4481, "byte_end": 4486, "display": {"text": " been", "kind": "normal"}, "is_word": true, "word_id": 750, "word_key": " been", "bytes_hex": "20 62 65 65 6e", "compression": {"rwkv": "0.99% 0.99% 0.99% 0.99% 0.99%", "qwen": "0.81% 0.81% 0.81% 0.81% 0.81%"}, "model_tokens": {"rwkv": [[30259, " been", "normal", 0.7596845626831055]], "qwen": [[1012, " been", "normal", 0.7988281846046448]]}, "loss": {"rwkv": 0.9932617224870304, "qwen": 0.8101072398579089}, "topk": {"rwkv": [30259, 1, 0.7596845626831055, [[30259, 0.759685, " been", false], [30135, 0.147549, " also", false], [45150, 0.018458, " always", false], [22187, 0.011578, " not", false], [31323, 0.011249, " long", false], [56548, 0.005827, " likewise", false], [57036, 0.005646, " recently", false], [37635, 0.005386, " again", false], [45, 0.004018, ",", false], [60505, 0.003546, " similarly", false]]], "qwen": [1012, 1, 0.7988281846046448, [[1012, 0.798828, " been", false], [1083, 0.083231, " also", false], [2677, 0.046376, " always", false], [1293, 0.017368, " long", false], [2581, 0.007312, " never", false], [537, 0.00695, " not", false], [34801, 0.003097, " historically", false], [1549, 0.00252, " again", false], [35242, 0.002296, " traditionally", false], [5926, 0.001962, " recently", false]]]}, "raw_delta": 0.010156241059303281, "tuned_delta": 0.017493379573006018}, {"byte_start": 4486, "byte_end": 4488, "display": {"text": " a", "kind": "normal"}, "is_word": true, "word_id": 751, "word_key": " a", "bytes_hex": "20 61", "compression": {"rwkv": "3.93% 3.93%", "qwen": "4.90% 4.90%"}, "model_tokens": {"rwkv": [[332, " a", "normal", 0.6447088718414307]], "qwen": [[264, " a", "normal", 0.5807908177375793]]}, "loss": {"rwkv": 3.9272582289824074, "qwen": 4.899434233538717}, "topk": {"rwkv": [332, 1, 0.6447088718414307, [[332, 0.644709, " a", false], [4419, 0.127724, " an", false], [52906, 0.023164, " similar", false], [31466, 0.017394, " much", false], [50919, 0.017038, " another", false], [22590, 0.016972, " the", false], [30788, 0.012795, " even", false], [45, 0.012188, ",", false], [4692, 0.007633, " no", false], [31458, 0.006029, " more", false]]], "qwen": [264, 1, 0.5807908177375793, [[264, 0.580791, " a", false], [458, 0.147467, " an", false], [1753, 0.035839, " much", false], [4428, 0.027938, " similar", false], [1045, 0.012506, " some", false], [29193, 0.009416, " similarly", false], [902, 0.008481, " no", false], [279, 0.007541, " the", false], [23839, 0.00746, " considerable", false], [803, 0.007214, " more", false]]]}, "raw_delta": -0.05390888452529907, "tuned_delta": -0.04657174601159633}, {"byte_start": 4488, "byte_end": 4496, "display": {"text": " similar", "kind": "normal"}, "is_word": true, "word_id": 752, "word_key": " similar", "bytes_hex": "20 73 69 6d 69 6c 61 72", "compression": {"rwkv": "1.80% 1.80% 1.80% 1.80% 1.80% 1.80% 1.80% 1.80%", "qwen": "2.80% 2.80% 2.80% 2.80% 2.80% 2.80% 2.80% 2.80%"}, "model_tokens": {"rwkv": [[52906, " similar", "normal", 0.45146411657333374]], "qwen": [[4428, " similar", "normal", 0.28896403312683105]]}, "loss": {"rwkv": 1.7963243917318634, "qwen": 2.7984971265504583}, "topk": {"rwkv": [52906, 1, 0.45146411657333374, [[52906, 0.451464, " similar", false], [31323, 0.116185, " long", false], [32386, 0.021845, " very", false], [47405, 0.017261, " steady", false], [52427, 0.016859, " pattern", false], [60505, 0.015364, " similarly", false], [61774, 0.012958, " continuing", false], [38961, 0.011791, " major", false], [61756, 0.011347, " consistent", false], [31466, 0.008692, " much", false]]], "qwen": [4428, 1, 0.28896403312683105, [[4428, 0.288964, " similar", false], [1293, 0.235387, " long", false], [29193, 0.019415, " similarly", false], [3598, 0.018889, " major", false], [2244, 0.017125, " great", false], [1602, 0.016404, " very", false], [12966, 0.013811, " consistent", false], [2696, 0.012967, " lot", false], [5383, 0.012706, " pattern", false], [24020, 0.011707, " steady", false]]]}, "raw_delta": -0.055572256445884705, "tuned_delta": -0.048235117932181965}, {"byte_start": 4496, "byte_end": 4504, "display": {"text": " pattern", "kind": "normal"}, "is_word": true, "word_id": 753, "word_key": " pattern", "bytes_hex": "20 70 61 74 74 65 72 6e", "compression": {"rwkv": "1.90% 1.90% 1.90% 1.90% 1.90% 1.90% 1.90% 1.90%", "qwen": "2.23% 2.23% 2.23% 2.23% 2.23% 2.23% 2.23% 2.23%"}, "model_tokens": {"rwkv": [[52427, " pattern", "normal", 0.4310145974159241]], "qwen": [[5383, " pattern", "normal", 0.3711734712123871]]}, "loss": {"rwkv": 1.901990532421973, "qwen": 2.234116440973038}, "topk": {"rwkv": [52427, 1, 0.4310145974159241, [[52427, 0.431015, " pattern", false], [39831, 0.085086, " story", false], [51929, 0.065488, " history", false], [45, 0.049178, ",", false], [63797, 0.019521, " progression", false], [39664, 0.016128, " shift", false], [59657, 0.013782, " evolution", false], [62660, 0.013765, " transition", false], [63361, 0.013583, " competition", false], [57328, 0.012598, " struggle", false]]], "qwen": [5383, 1, 0.3711734712123871, [[5383, 0.371173, " pattern", false], [9149, 0.085054, " trend", false], [3364, 0.058034, " story", false], [6407, 0.041732, " shift", false], [32724, 0.033134, " progression", false], [2297, 0.022624, " change", false], [1293, 0.02091, " long", false], [9142, 0.01898, " transition", false], [3840, 0.017896, " history", false], [11, 0.013164, ",", false]]]}, "raw_delta": -0.01841697096824646, "tuned_delta": -0.011079832454543723}, {"byte_start": 4504, "byte_end": 4505, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "15.92%", "qwen": "22.93%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.41580042243003845]], "qwen": [[13, ".", "normal", 0.2804797291755676]]}, "loss": {"rwkv": 15.920365197309849, "qwen": 22.925394849169177}, "topk": {"rwkv": [47, 1, 0.41580042243003845, [[47, 0.4158, ".", false], [4706, 0.321526, " of", false], [45, 0.145444, ",", false], [31601, 0.021284, " over", false], [4596, 0.01585, " in", false], [59, 0.015535, ":", false], [5346, 0.006903, "---", false], [39690, 0.006146, " since", false], [32487, 0.005998, " with", false], [21700, 0.004646, " for", false]]], "qwen": [13, 2, 0.2804797291755676, [[315, 0.466759, " of", false], [13, 0.28048, ".", false], [11, 0.082198, ",", false], [311, 0.037578, " to", false], [304, 0.027072, " in", false], [916, 0.01584, " over", false], [25, 0.013909, ":", false], [4421, 0.010026, "---", false], [504, 0.00752, " from", false], [369, 0.007465, " for", false]]]}, "raw_delta": -0.3884413242340088, "tuned_delta": -0.3811041857203061}, {"byte_start": 4505, "byte_end": 4511, "display": {"text": " Early", "kind": "normal"}, "is_word": true, "word_id": 754, "word_key": " early", "bytes_hex": "20 45 61 72 6c 79", "compression": {"rwkv": "5.52% 5.52% 5.52% 5.52% 5.52% 5.52%", "qwen": "5.03% 5.03% 5.03% 5.03% 5.03% 5.03%"}, "model_tokens": {"rwkv": [[36607, " Early", "normal", 0.15879465639591217]], "qwen": [[22752, " Early", "normal", 0.18737633526325226]]}, "loss": {"rwkv": 5.518120680483502, "qwen": 5.033310903428166}, "topk": {"rwkv": [36607, 2, 0.15879465639591217, [[20996, 0.164847, " The", false], [36607, 0.158795, " Early", false], [3913, 0.085369, " In", false], [37451, 0.045746, " There", false], [63222, 0.036884, " Researchers", false], [19907, 0.030073, " For", false], [50438, 0.022487, " Methods", false], [58864, 0.019879, " Initially", false], [3642, 0.017827, " At", false], [36809, 0.016896, " Human", false]]], "qwen": [22752, 1, 0.18737633526325226, [[22752, 0.187376, " Early", false], [758, 0.112628, " In", false], [576, 0.098623, " The", false], [2619, 0.094991, " There", false], [58150, 0.057391, " Researchers", false], [58556, 0.028442, " Initially", false], [1752, 0.025186, " For", false], [362, 0.024925, " A", false], [2411, 0.017526, " At", false], [11097, 0.01484, " Human", false]]]}, "raw_delta": 0.026883562405904116, "tuned_delta": 0.034220700919606856}, {"byte_start": 4511, "byte_end": 4519, "display": {"text": " methods", "kind": "normal"}, "is_word": true, "word_id": 755, "word_key": " methods", "bytes_hex": "20 6d 65 74 68 6f 64 73", "compression": {"rwkv": "3.17% 3.17% 3.17% 3.17% 3.17% 3.17% 3.17% 3.17%", "qwen": "4.38% 4.38% 4.38% 4.38% 4.38% 4.38% 4.38% 4.38%"}, "model_tokens": {"rwkv": [[52224, " methods", "normal", 0.24330653250217438]], "qwen": [[5413, " methods", "normal", 0.1432800143957138]]}, "loss": {"rwkv": 3.1699842207032884, "qwen": 4.379829231113428}, "topk": {"rwkv": [52224, 1, 0.24330653250217438, [[52224, 0.243307, " methods", false], [55809, 0.105895, " computer", false], [51566, 0.1031, " efforts", false], [57103, 0.101409, " research", false], [32499, 0.060694, " work", false], [61590, 0.049565, " approaches", false], [63843, 0.044451, " researchers", false], [55572, 0.031297, " attempts", false], [4596, 0.029802, " in", false], [4712, 0.029164, " on", false]]], "qwen": [5413, 1, 0.1432800143957138, [[5413, 0.14328, " methods", false], [304, 0.120413, " in", false], [975, 0.118516, " work", false], [8869, 0.092872, " efforts", false], [6366, 0.087719, " computer", false], [11811, 0.059996, " researchers", false], [3412, 0.051687, " research", false], [11129, 0.049252, " vision", false], [19827, 0.043755, " approaches", false], [389, 0.037572, " on", false]]]}, "raw_delta": -0.0670880526304245, "tuned_delta": -0.05975091411672176}, {"byte_start": 4519, "byte_end": 4529, "display": {"text": " conceived", "kind": "normal"}, "is_word": true, "word_id": 756, "word_key": " conceived", "bytes_hex": "20 63 6f 6e 63 65 69 76 65 64", "compression": {"rwkv": "19.16% 19.16% 19.16% 19.16% 19.16% 19.16% 19.16% 19.16% 19.16% 19.16%", "qwen": "18.27% 18.27% 18.27% 18.27% 18.27% 18.27% 18.27% 18.27% 18.27% 18.27%"}, "model_tokens": {"rwkv": [[59348, " conceived", "normal", 2.4193588615162298e-05]], "qwen": [[49078, " conceived", "normal", 3.9800819649826735e-05]]}, "loss": {"rwkv": 19.160793511806542, "qwen": 18.27105330635336}, "topk": {"rwkv": [59348, 511, 2.4193588615162298e-05, [[32462, 0.183883, " were", false], [47054, 0.115783, " relied", false], [45, 0.085555, ",", false], [4596, 0.079098, " in", false], [32354, 0.072028, " used", false], [21700, 0.049279, " for", false], [32227, 0.035982, " that", false], [40013, 0.035713, " tried", false], [4706, 0.025794, " of", false], [56427, 0.02504, " included", false]]], "qwen": [49078, 410, 3.9800819649826735e-05, [[1033, 0.22463, " were", false], [39913, 0.084109, " relied", false], [304, 0.066021, " in", false], [369, 0.064234, " for", false], [3867, 0.063007, " took", false], [11, 0.057171, ",", false], [429, 0.040702, " that", false], [3118, 0.038395, " based", false], [10735, 0.038008, " focused", false], [315, 0.026742, " of", false]]]}, "raw_delta": 0.049337673187255904, "tuned_delta": 0.056674811700958644}, {"byte_start": 4529, "byte_end": 4532, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 757, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "5.49% 5.49% 5.49%", "qwen": "9.18% 9.18% 9.18%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.4019838273525238]], "qwen": [[315, " of", "normal", 0.21719248592853546]]}, "loss": {"rwkv": 5.4946393158857, "qwen": 9.178974916901904}, "topk": {"rwkv": [4706, 1, 0.4019838273525238, [[4706, 0.401984, " of", false], [4450, 0.194099, " by", false], [4596, 0.084948, " in", false], [4811, 0.050233, " to", false], [21265, 0.031357, " and", false], [4423, 0.023332, " as", false], [30917, 0.017399, " from", false], [4712, 0.012904, " on", false], [332, 0.012485, " a", false], [32487, 0.011141, " with", false]]], "qwen": [315, 1, 0.21719248592853546, [[315, 0.217192, " of", false], [304, 0.155638, " in", false], [438, 0.152512, " as", false], [323, 0.076464, " and", false], [553, 0.074736, " by", false], [311, 0.05731, " to", false], [389, 0.032373, " on", false], [448, 0.032037, " with", false], [279, 0.015105, " the", false], [3118, 0.014067, " based", false]]]}, "raw_delta": -0.20430294672648108, "tuned_delta": -0.19696580821277834}, {"byte_start": 4532, "byte_end": 4539, "display": {"text": " vision", "kind": "normal"}, "is_word": true, "word_id": 758, "word_key": " vision", "bytes_hex": "20 76 69 73 69 6f 6e", "compression": {"rwkv": "8.29% 8.29% 8.29% 8.29% 8.29% 8.29% 8.29%", "qwen": "6.55% 6.55% 6.55% 6.55% 6.55% 6.55% 6.55%"}, "model_tokens": {"rwkv": [[47732, " vision", "normal", 0.04020076245069504]], "qwen": [[11129, " vision", "normal", 0.07862947881221771]]}, "loss": {"rwkv": 8.29227618368098, "qwen": 6.551403298153559}, "topk": {"rwkv": [47732, 7, 0.04020076245069504, [[4423, 0.19262, " as", false], [4450, 0.09907, " by", false], [22590, 0.09261, " the", false], [332, 0.086428, " a", false], [55809, 0.05502, " computer", false], [4596, 0.042157, " in", false], [47732, 0.040201, " vision", false], [47734, 0.021169, " visual", false], [38744, 0.017686, " image", false], [46249, 0.017642, " images", false]]], "qwen": [11129, 3, 0.07862947881221771, [[438, 0.122214, " as", false], [279, 0.107035, " the", false], [11129, 0.078629, " vision", false], [264, 0.064636, " a", false], [6366, 0.062212, " computer", false], [1667, 0.031913, " using", false], [4633, 0.028064, " taking", false], [304, 0.024232, " in", false], [3738, 0.023334, " human", false], [9902, 0.018649, " ``", false]]]}, "raw_delta": 0.09653449058532715, "tuned_delta": 0.10387162909902989}, {"byte_start": 4539, "byte_end": 4542, "display": {"text": " as", "kind": "normal"}, "is_word": true, "word_id": 759, "word_key": " as", "bytes_hex": "20 61 73", "compression": {"rwkv": "2.52% 2.52% 2.52%", "qwen": "1.65% 1.65% 1.65%"}, "model_tokens": {"rwkv": [[4423, " as", "normal", 0.6589464545249939]], "qwen": [[438, " as", "normal", 0.7599860429763794]]}, "loss": {"rwkv": 2.52424669426373, "qwen": 1.64981326720481}, "topk": {"rwkv": [4423, 1, 0.6589464545249939, [[4423, 0.658946, " as", false], [4596, 0.136082, " in", false], [53087, 0.041884, " systems", false], [39898, 0.025654, " tasks", false], [56939, 0.023246, " problems", false], [30917, 0.009735, " from", false], [4450, 0.009104, " by", false], [62378, 0.006085, " processing", false], [45, 0.006038, ",", false], [21265, 0.005476, " and", false]]], "qwen": [438, 1, 0.7599860429763794, [[438, 0.759986, " as", false], [304, 0.108452, " in", false], [5942, 0.014882, " systems", false], [5322, 0.009305, " problems", false], [11, 0.006321, ",", false], [25185, 0.005025, " algorithms", false], [553, 0.005003, " by", false], [9079, 0.004906, " tasks", false], [3118, 0.003904, " based", false], [323, 0.003779, " and", false]]]}, "raw_delta": 0.048488885164260885, "tuned_delta": 0.05582602367796362}, {"byte_start": 4542, "byte_end": 4552, "display": {"text": " searching", "kind": "normal"}, "is_word": true, "word_id": 760, "word_key": " searching", "bytes_hex": "20 73 65 61 72 63 68 69 6e 67", "compression": {"rwkv": "14.88% 14.88% 14.88% 14.88% 14.88% 14.88% 14.88% 14.88% 14.88% 14.88%", "qwen": "12.93% 12.93% 12.93% 12.93% 12.93% 12.93% 12.93% 12.93% 12.93% 12.93%"}, "model_tokens": {"rwkv": [[60463, " searching", "normal", 0.00026852163136936724]], "qwen": [[15039, " searching", "normal", 0.0007701599388383329]]}, "loss": {"rwkv": 14.877792609167432, "qwen": 12.928192979420364}, "topk": {"rwkv": [60463, 145, 0.00026852163136936724, [[332, 0.474991, " a", false], [37832, 0.088455, " being", false], [4419, 0.065871, " an", false], [22590, 0.036053, " the", false], [60522, 0.026704, " something", false], [63541, 0.019683, " essentially", false], [52906, 0.014641, " similar", false], [59134, 0.012084, " analogous", false], [59927, 0.011414, " involving", false], [4404, 0.010145, " ``", false]]], "qwen": [15039, 85, 0.0007701599388383329, [[264, 0.487278, " a", false], [458, 0.071254, " an", false], [279, 0.06089, " the", false], [1660, 0.035027, " being", false], [2494, 0.020415, " something", false], [15860, 0.01772, " involving", false], [9902, 0.01342, " ``", false], [3432, 0.012937, " having", false], [4633, 0.01076, " taking", false], [15791, 0.007221, " essentially", false]]]}, "raw_delta": 0.1081087589263916, "tuned_delta": 0.11544589744009434}, {"byte_start": 4552, "byte_end": 4556, "display": {"text": " for", "kind": "normal"}, "is_word": true, "word_id": 761, "word_key": " for", "bytes_hex": "20 66 6f 72", "compression": {"rwkv": "3.52% 3.52% 3.52% 3.52%", "qwen": "3.44% 3.44% 3.44% 3.44%"}, "model_tokens": {"rwkv": [[21700, " for", "normal", 0.45727473497390747]], "qwen": [[369, " for", "normal", 0.46674421429634094]]}, "loss": {"rwkv": 3.5222046896703203, "qwen": 3.4352999751290993}, "topk": {"rwkv": [21700, 1, 0.45727473497390747, [[21700, 0.457275, " for", false], [53140, 0.13504, " through", false], [332, 0.087673, " a", false], [22590, 0.051937, " the", false], [4596, 0.045779, " in", false], [31601, 0.034268, " over", false], [45, 0.02859, ",", false], [5346, 0.014722, "---", false], [4419, 0.013284, " an", false], [21265, 0.009861, " and", false]]], "qwen": [369, 1, 0.46674421429634094, [[369, 0.466744, " for", false], [1526, 0.183925, " through", false], [11, 0.047437, ",", false], [304, 0.046804, " in", false], [264, 0.044039, " a", false], [323, 0.028121, " and", false], [279, 0.024204, " the", false], [916, 0.021524, " over", false], [553, 0.009388, " by", false], [13, 0.008407, ".", false]]]}, "raw_delta": 0.004819020628929138, "tuned_delta": 0.012156159142631875}, {"byte_start": 4556, "byte_end": 4562, "display": {"text": " edges", "kind": "normal"}, "is_word": true, "word_id": 762, "word_key": " edges", "bytes_hex": "20 65 64 67 65 73", "compression": {"rwkv": "11.60% 11.60% 11.60% 11.60% 11.60% 11.60%", "qwen": "16.52% 16.52% 16.52% 16.52% 16.52% 16.52%"}, "model_tokens": {"rwkv": [[38332, " edges", "normal", 0.02123800478875637]], "qwen": [[12822, " edges", "normal", 0.004106951877474785]]}, "loss": {"rwkv": 11.599794111314255, "qwen": 16.516075836990932}, "topk": {"rwkv": [38332, 8, 0.02123800478875637, [[52342, 0.235149, " objects", false], [56832, 0.074266, " patterns", false], [56215, 0.063349, " features", false], [332, 0.037032, " a", false], [57271, 0.031113, " specific", false], [47734, 0.027918, " visual", false], [22590, 0.021916, " the", false], [38332, 0.021238, " edges", false], [4404, 0.020875, " ``", false], [46691, 0.018113, " object", false]]], "qwen": [12822, 35, 0.004106951877474785, [[12624, 0.108482, " patterns", false], [4419, 0.107189, " features", false], [6171, 0.101189, " objects", false], [264, 0.056917, " a", false], [279, 0.037417, " the", false], [3151, 0.02735, " specific", false], [4274, 0.01985, " sal", false], [3281, 0.017533, " special", false], [9124, 0.016381, " visual", false], [3738, 0.01627, " human", false]]]}, "raw_delta": -0.2726165453592937, "tuned_delta": -0.265279406845591}, {"byte_start": 4562, "byte_end": 4563, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "21.84%", "qwen": "14.23%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.29853132367134094]], "qwen": [[11, ",", "normal", 0.45429813861846924]]}, "loss": {"rwkv": 21.837669075955986, "qwen": 14.228608407085709}, "topk": {"rwkv": [45, 1, 0.29853132367134094, [[45, 0.298531, ",", false], [21265, 0.28695, " and", false], [4596, 0.150493, " in", false], [4715, 0.112244, " or", false], [47, 0.033974, ".", false], [275, 0.023878, " (", false], [5346, 0.023817, "---", false], [4706, 0.011243, " of", false], [4811, 0.010022, " to", false], [32227, 0.006516, " that", false]]], "qwen": [11, 1, 0.45429813861846924, [[11, 0.454298, ",", false], [323, 0.403713, " and", false], [476, 0.040795, " or", false], [304, 0.040111, " in", false], [320, 0.015853, " (", false], [13, 0.01289, ".", false], [4421, 0.003669, "---", false], [26, 0.002524, ";", false], [389, 0.002163, " on", false], [315, 0.002136, " of", false]]]}, "raw_delta": 0.42193591594696045, "tuned_delta": 0.42927305446066316}, {"byte_start": 4563, "byte_end": 4566, "display": {"text": " or", "kind": "normal"}, "is_word": true, "word_id": 763, "word_key": " or", "bytes_hex": "20 6f 72", "compression": {"rwkv": "8.22% 8.22% 8.22%", "qwen": "12.30% 12.30% 12.30%"}, "model_tokens": {"rwkv": [[4715, " or", "normal", 0.254032701253891]], "qwen": [[476, " or", "normal", 0.12923438847064972]]}, "loss": {"rwkv": 8.218477609230748, "qwen": 12.299742002494527}, "topk": {"rwkv": [4715, 1, 0.254032701253891, [[4715, 0.254033, " or", false], [21265, 0.185121, " and", false], [51327, 0.067708, " corners", false], [32230, 0.038666, " then", false], [21700, 0.029028, " for", false], [40186, 0.027936, " which", false], [38905, 0.026207, " lines", false], [47253, 0.02212, " shapes", false], [40085, 0.017819, " using", false], [4423, 0.014222, " as", false]]], "qwen": [476, 2, 0.12923438847064972, [[323, 0.188974, " and", false], [476, 0.129234, " or", false], [23462, 0.072278, " corners", false], [1221, 0.052065, " then", false], [20816, 0.035317, " shapes", false], [49031, 0.032121, " contours", false], [5128, 0.031306, " lines", false], [76899, 0.028993, " blobs", false], [369, 0.026087, " for", false], [4419, 0.025871, " features", false]]]}, "raw_delta": -0.22631335258483878, "tuned_delta": -0.21897621407113604}, {"byte_start": 4566, "byte_end": 4578, "display": {"text": " generalized", "kind": "normal"}, "is_word": true, "word_id": 764, "word_key": " generalized", "bytes_hex": "20 67 65 6e 65 72 61 6c 69 7a 65 64", "compression": {"rwkv": "14.65% 14.65% 14.65% 14.65% 14.65% 14.65% 14.65% 14.65% 14.65% 14.65% 14.65% 14.65%", "qwen": "14.96% 14.96% 14.96% 14.96% 14.96% 14.96% 14.96% 14.96% 14.96% 14.96% 14.96% 14.96%"}, "model_tokens": {"rwkv": [[63594, " generalized", "normal", 5.800587314297445e-05]], "qwen": [[66117, " generalized", "normal", 4.747543061967008e-05]]}, "loss": {"rwkv": 14.652371509028534, "qwen": 14.960895485977597}, "topk": {"rwkv": [63594, 656, 5.800587314297445e-05, [[21700, 0.242455, " for", false], [39193, 0.085076, " other", false], [47253, 0.037796, " shapes", false], [38905, 0.03318, " lines", false], [4423, 0.024121, " as", false], [51327, 0.023492, " corners", false], [57413, 0.023159, " textures", false], [55852, 0.021868, " contours", false], [31458, 0.021622, " more", false], [56215, 0.018841, " features", false]]], "qwen": [66117, 800, 4.747543061967008e-05, [[315, 0.154972, " of", false], [438, 0.084378, " as", false], [76899, 0.062551, " blobs", false], [369, 0.050894, " for", false], [23462, 0.042371, " corners", false], [20816, 0.039494, " shapes", false], [1008, 0.028485, " other", false], [4419, 0.025384, " features", false], [49031, 0.022003, " contours", false], [29853, 0.020409, " textures", false]]]}, "raw_delta": -0.01710820198059082, "tuned_delta": -0.009771063466888084}, {"byte_start": 4578, "byte_end": 4588, "display": {"text": " cylinders", "kind": "normal"}, "is_word": true, "word_id": 765, "word_key": " cylinders", "bytes_hex": "20 63 79 6c 69 6e 64 65 72 73", "compression": {"rwkv": "19.84% 19.84% 19.84% 19.84% 19.84% 19.84% 19.84% 19.84% 19.84% 19.84%", "qwen": "14.63% 14.63% 14.63% 14.63% 14.63% 14.63% 14.63% 14.63% 14.63% 14.63%"}, "model_tokens": {"rwkv": [[59439, " cylinders", "normal", 1.673819679126609e-05]], "qwen": [[74321, " cylinders", "normal", 0.00029981572879478335]]}, "loss": {"rwkv": 19.837056812223242, "qwen": 14.629545971606023}, "topk": {"rwkv": [59439, 1134, 1.673819679126609e-05, [[38332, 0.334704, " edges", false], [47253, 0.062111, " shapes", false], [30729, 0.052971, " edge", false], [32229, 0.029605, " them", false], [57527, 0.028095, " versions", false], [22590, 0.025775, " the", false], [4811, 0.025238, " to", false], [56215, 0.023479, " features", false], [32227, 0.02088, " that", false], [39936, 0.019165, " these", false]]], "qwen": [74321, 155, 0.00029981572879478335, [[12822, 0.516086, " edges", false], [4419, 0.114138, " features", false], [20816, 0.039735, " shapes", false], [10795, 0.018152, " versions", false], [311, 0.013885, " to", false], [12624, 0.011384, " patterns", false], [7586, 0.010593, " forms", false], [5335, 0.008431, " images", false], [76899, 0.00804, " blobs", false], [49031, 0.007564, " contours", false]]]}, "raw_delta": 0.28876571655273436, "tuned_delta": 0.2961028550664371}, {"byte_start": 4588, "byte_end": 4589, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "11.98%", "qwen": "8.56%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.5138809680938721]], "qwen": [[11, ",", "normal", 0.6220842599868774]]}, "loss": {"rwkv": 11.97549594487909, "qwen": 8.560225767948992}, "topk": {"rwkv": [45, 1, 0.5138809680938721, [[45, 0.513881, ",", false], [47, 0.081153, ".", false], [4715, 0.06944, " or", false], [21265, 0.059133, " and", false], [275, 0.058501, " (", false], [4596, 0.047148, " in", false], [4706, 0.028019, " of", false], [32227, 0.02138, " that", false], [5346, 0.018775, "---", false], [21700, 0.010862, " for", false]]], "qwen": [11, 1, 0.6220842599868774, [[11, 0.622084, ",", false], [476, 0.072416, " or", false], [13, 0.071301, ".", false], [320, 0.061127, " (", false], [323, 0.044242, " and", false], [304, 0.04152, " in", false], [315, 0.022199, " of", false], [429, 0.008502, " that", false], [4421, 0.007446, "---", false], [26, 0.005209, ";", false]]]}, "raw_delta": 0.18938279151916504, "tuned_delta": 0.19671993003286778}, {"byte_start": 4589, "byte_end": 4592, "display": {"text": " or", "kind": "normal"}, "is_word": true, "word_id": 766, "word_key": " or", "bytes_hex": "20 6f 72", "compression": {"rwkv": "4.32% 4.32% 4.32%", "qwen": "2.07% 2.07% 2.07%"}, "model_tokens": {"rwkv": [[4715, " or", "normal", 0.48613473773002625]], "qwen": [[476, " or", "normal", 0.7081467509269714]]}, "loss": {"rwkv": 4.320571085995593, "qwen": 2.0744988052614812}, "topk": {"rwkv": [4715, 1, 0.48613473773002625, [[4715, 0.486135, " or", false], [21265, 0.119562, " and", false], [4596, 0.109432, " in", false], [21643, 0.066589, " etc", false], [40186, 0.017898, " which", false], [32227, 0.017812, " that", false], [4811, 0.016877, " to", false], [4423, 0.011352, " as", false], [32487, 0.007511, " with", false], [40085, 0.006297, " using", false]]], "qwen": [476, 1, 0.7081467509269714, [[476, 0.708147, " or", false], [323, 0.091256, " and", false], [304, 0.034837, " in", false], [4992, 0.033548, " etc", false], [892, 0.009402, " which", false], [429, 0.006675, " that", false], [3118, 0.005765, " based", false], [448, 0.005734, " with", false], [1667, 0.005297, " using", false], [438, 0.004923, " as", false]]]}, "raw_delta": 0.12454869349797566, "tuned_delta": 0.1318858320116784}, {"byte_start": 4592, "byte_end": 4595, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 767, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "33.06% 33.06% 33.06%", "qwen": "29.69% 29.69% 29.69%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.004047906957566738]], "qwen": [[304, " in", "normal", 0.007163698319345713]]}, "loss": {"rwkv": 33.06176135370541, "qwen": 29.687831506476456}, "topk": {"rwkv": [4596, 36, 0.004047906957566738, [[39193, 0.16138, " other", false], [63594, 0.107968, " generalized", false], [32074, 0.064557, " some", false], [38905, 0.026316, " lines", false], [22590, 0.018553, " the", false], [31458, 0.017928, " more", false], [30788, 0.017164, " even", false], [57564, 0.014803, " whatever", false], [37865, 0.014077, " blobs", false], [52906, 0.012295, " similar", false]]], "qwen": [304, 23, 0.007163698319345713, [[1008, 0.095454, " other", false], [76899, 0.049573, " blobs", false], [315, 0.041197, " of", false], [1045, 0.028895, " some", false], [2494, 0.028273, " something", false], [66117, 0.027925, " generalized", false], [20816, 0.020533, " shapes", false], [8820, 0.020296, " whatever", false], [438, 0.018271, " as", false], [12300, 0.016067, " faces", false]]]}, "raw_delta": 0.18709039688110352, "tuned_delta": 0.19442753539480626}, {"byte_start": 4595, "byte_end": 4601, "display": {"text": " terms", "kind": "normal"}, "is_word": true, "word_id": 768, "word_key": " terms", "bytes_hex": "20 74 65 72 6d 73", "compression": {"rwkv": "10.24% 10.24% 10.24% 10.24% 10.24% 10.24%", "qwen": "10.86% 10.86% 10.86% 10.86% 10.86% 10.86%"}, "model_tokens": {"rwkv": [[39920, " terms", "normal", 0.03327147290110588]], "qwen": [[3793, " terms", "normal", 0.02695387974381447]]}, "loss": {"rwkv": 10.237874964641732, "qwen": 10.861173054709965}, "topk": {"rwkv": [39920, 6, 0.03327147290110588, [[32074, 0.26078, " some", false], [39193, 0.216625, " other", false], [22590, 0.091082, " the", false], [51832, 0.06529, " general", false], [332, 0.052945, " a", false], [39920, 0.033271, " terms", false], [31458, 0.03, " more", false], [22226, 0.018805, " one", false], [31370, 0.016635, " many", false], [53265, 0.012637, " various", false]]], "qwen": [3793, 7, 0.02695387974381447, [[1045, 0.208606, " some", false], [279, 0.132075, " the", false], [1008, 0.123278, " other", false], [264, 0.050137, " a", false], [4586, 0.029927, " general", false], [220, 0.028146, " ", false], [3793, 0.026954, " terms", false], [54611, 0.019275, "variants", false], [947, 0.018864, "var", false], [803, 0.013371, " more", false]]]}, "raw_delta": -0.034562985102335575, "tuned_delta": -0.02722584658863284}, {"byte_start": 4601, "byte_end": 4604, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 769, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "0.10% 0.10% 0.10%", "qwen": "0.05% 0.05% 0.05%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.9841862320899963]], "qwen": [[315, " of", "normal", 0.9919356107711792]]}, "loss": {"rwkv": 0.0961268363222525, "qwen": 0.04867343032269244}, "topk": {"rwkv": [4706, 1, 0.9841862320899963, [[4706, 0.984186, " of", false], [32227, 0.00356, " that", false], [31458, 0.002669, " more", false], [39193, 0.001337, " other", false], [52906, 0.000982, " similar", false], [31296, 0.000493, " like", false], [52693, 0.000321, " related", false], [56205, 0.000225, " familiar", false], [32139, 0.000189, " such", false], [45, 0.000166, ",", false]]], "qwen": [315, 1, 0.9919356107711792, [[315, 0.991936, " of", false], [429, 0.002911, " that", false], [3118, 0.000341, " based", false], [4428, 0.000316, " similar", false], [803, 0.000269, " more", false], [5435, 0.000265, " related", false], [1075, 0.000195, " like", false], [15860, 0.000164, " involving", false], [1008, 0.000144, " other", false], [1602, 8.6e-05, " very", false]]]}, "raw_delta": 0.0026313755661249156, "tuned_delta": 0.009968514079827653}, {"byte_start": 4604, "byte_end": 4609, "display": {"text": " SIFT", "kind": "normal"}, "is_word": true, "word_id": 770, "word_key": " sift", "bytes_hex": "20 53 49 46 54", "compression": {"rwkv": "47.71% 47.71% 47.71% 0.01% 0.01%", "qwen": "73.93% 73.93% 0.86% 0.86% 0.86%"}, "model_tokens": {"rwkv": [[4191, " SI", "normal", 0.00036058356636203825], [1023, "FT", "normal", 0.9992585778236389]], "qwen": [[328, " S", "normal", 0.00027484563179314137], [14292, "IFT", "normal", 0.8664654493331909]]}, "loss": {"rwkv": 28.631176405605892, "qwen": 30.089691130898576}, "topk": {"rwkv": [4191, 322, 0.00036058356636203825, [[332, 0.088068, " a", false], [22590, 0.062393, " the", false], [31044, 0.031961, " hand", false], [39193, 0.03179, " other", false], [38720, 0.031264, " human", false], [32074, 0.021521, " some", false], [63885, 0.014549, " statistical", false], [59767, 0.013869, " geometric", false], [51725, 0.013863, " feature", false], [47734, 0.012416, " visual", false]]], "qwen": [328, 446, 0.00027484563179314137, [[279, 0.059039, " the", false], [3738, 0.05651, " human", false], [264, 0.042507, " a", false], [4419, 0.025916, " features", false], [4565, 0.022914, " feature", false], [2205, 0.020055, " local", false], [1045, 0.016433, " some", false], [1008, 0.014731, " other", false], [1894, 0.014299, " color", false], [4285, 0.014204, " simple", false]]]}, "raw_delta": -0.0808772295713424, "tuned_delta": -0.07354009105763966}, {"byte_start": 4609, "byte_end": 4618, "display": {"text": " features", "kind": "normal"}, "is_word": true, "word_id": 771, "word_key": " features", "bytes_hex": "20 66 65 61 74 75 72 65 73", "compression": {"rwkv": "2.88% 2.88% 2.88% 2.88% 2.88% 2.88% 2.88% 2.88% 2.88%", "qwen": "1.16% 1.16% 1.16% 1.16% 1.16% 1.16% 1.16% 1.16% 1.16%"}, "model_tokens": {"rwkv": [[56215, " features", "normal", 0.23963482677936554]], "qwen": [[4419, " features", "normal", 0.5602641105651855]]}, "loss": {"rwkv": 2.880380723997062, "qwen": 1.1608624703841681}, "topk": {"rwkv": [56215, 1, 0.23963482677936554, [[56215, 0.239635, " features", false], [45, 0.149875, ",", false], [275, 0.107762, " (", false], [63458, 0.101873, " descriptors", false], [4715, 0.074171, " or", false], [21265, 0.073086, " and", false], [47, 0.043812, ".", false], [46, 0.019654, "-", false], [59940, 0.018834, " keypoints", false], [51725, 0.016694, " feature", false]]], "qwen": [4419, 1, 0.5602641105651855, [[4419, 0.560264, " features", false], [47517, 0.058171, " descriptors", false], [320, 0.049761, " (", false], [82, 0.040318, "s", false], [11, 0.039659, ",", false], [476, 0.036471, " or", false], [12681, 0.031961, "-like", false], [323, 0.01962, " and", false], [13, 0.019555, ".", false], [3501, 0.009528, " points", false]]]}, "raw_delta": 0.09535033835305107, "tuned_delta": 0.10268747686675381}, {"byte_start": 4618, "byte_end": 4619, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "20.43%", "qwen": "17.12%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.321269690990448]], "qwen": [[13, ".", "normal", 0.3871019184589386]]}, "loss": {"rwkv": 20.428787200087857, "qwen": 17.115182417432173}, "topk": {"rwkv": [47, 2, 0.321269690990448, [[45, 0.365727, ",", false], [47, 0.32127, ".", false], [275, 0.073412, " (", false], [21265, 0.05867, " and", false], [4715, 0.046256, " or", false], [5346, 0.045515, "---", false], [32227, 0.0243, " that", false], [60, 0.007191, ";", false], [4596, 0.005972, " in", false], [4706, 0.004912, " of", false]]], "qwen": [13, 1, 0.3871019184589386, [[13, 0.387102, ".", false], [11, 0.377043, ",", false], [320, 0.066533, " (", false], [323, 0.048637, " and", false], [476, 0.046631, " or", false], [4421, 0.016091, "---", false], [429, 0.010928, " that", false], [26, 0.009214, ";", false], [304, 0.005007, " in", false], [508, 0.002577, " [", false]]]}, "raw_delta": 0.18374526500701904, "tuned_delta": 0.19108240352072178}, {"byte_start": 4619, "byte_end": 4623, "display": {"text": " But", "kind": "normal"}, "is_word": true, "word_id": 772, "word_key": " but", "bytes_hex": "20 42 75 74", "compression": {"rwkv": "15.92% 15.92% 15.92% 15.92%", "qwen": "17.70% 17.70% 17.70% 17.70%"}, "model_tokens": {"rwkv": [[19555, " But", "normal", 0.029402634128928185]], "qwen": [[1988, " But", "normal", 0.019717730581760406]]}, "loss": {"rwkv": 15.920365197309849, "qwen": 17.701133758271173}, "topk": {"rwkv": [19555, 8, 0.029402634128928185, [[37453, 0.247464, " These", false], [20996, 0.06455, " The", false], [36918, 0.060455, " Later", false], [29890, 0.042129, " Then", false], [29894, 0.036013, " This", false], [3913, 0.030065, " In", false], [19407, 0.029628, " All", false], [19555, 0.029403, " But", false], [37451, 0.020613, " There", false], [29421, 0.019811, " More", false]]], "qwen": [1988, 10, 0.019717730581760406, [[4220, 0.179589, " These", false], [24885, 0.126057, " Later", false], [576, 0.057926, " The", false], [2619, 0.040932, " There", false], [2009, 0.036093, " All", false], [758, 0.033983, " In", false], [4398, 0.030353, " More", false], [5005, 0.028521, " Then", false], [1096, 0.026708, " This", false], [1988, 0.019718, " But", false]]]}, "raw_delta": -0.09874677658081055, "tuned_delta": -0.0914096380671078}, {"byte_start": 4623, "byte_end": 4629, "display": {"text": " today", "kind": "normal"}, "is_word": true, "word_id": 773, "word_key": " today", "bytes_hex": "20 74 6f 64 61 79", "compression": {"rwkv": "21.51% 21.51% 21.51% 21.51% 21.51% 21.51%", "qwen": "19.59% 19.59% 19.59% 19.59% 19.59% 19.59%"}, "model_tokens": {"rwkv": [[39971, " today", "normal", 0.0007729920325800776]], "qwen": [[3351, " today", "normal", 0.0014754984294995666]]}, "loss": {"rwkv": 21.508929971586756, "qwen": 19.592878424267994}, "topk": {"rwkv": [39971, 94, 0.0007729920325800776, [[22590, 0.11425, " the", false], [39936, 0.103286, " these", false], [45, 0.082828, ",", false], [4423, 0.060182, " as", false], [4596, 0.0519, " in", false], [32487, 0.034152, " with", false], [4601, 0.028276, " it", false], [32465, 0.024882, " when", false], [4450, 0.024469, " by", false], [32230, 0.022105, " then", false]]], "qwen": [3351, 61, 0.0014754984294995666, [[1493, 0.162007, " these", false], [279, 0.083008, " the", false], [11, 0.069522, ",", false], [678, 0.054504, " all", false], [1846, 0.04808, " those", false], [432, 0.040395, " it", false], [438, 0.032433, " as", false], [419, 0.031545, " this", false], [2711, 0.028393, " search", false], [304, 0.027728, " in", false]]]}, "raw_delta": 0.10624845822652174, "tuned_delta": 0.11358559674022448}, {"byte_start": 4629, "byte_end": 4633, "display": {"text": " all", "kind": "normal"}, "is_word": true, "word_id": 774, "word_key": " all", "bytes_hex": "20 61 6c 6c", "compression": {"rwkv": "23.39% 23.39% 23.39% 23.39%", "qwen": "24.88% 24.88% 24.88% 24.88%"}, "model_tokens": {"rwkv": [[21256, " all", "normal", 0.005701408721506596]], "qwen": [[678, " all", "normal", 0.004013643134385347]]}, "loss": {"rwkv": 23.38743913941093, "qwen": 24.877724703498696}, "topk": {"rwkv": [21256, 12, 0.005701408721506596, [[45, 0.485835, ",", false], [460, 0.268263, "'s", false], [22590, 0.05835, " the", false], [4601, 0.02094, " it", false], [4858, 0.019523, " we", false], [39934, 0.01744, " there", false], [39936, 0.012281, " these", false], [31461, 0.011599, " most", false], [30597, 0.010872, " deep", false], [47732, 0.008456, " vision", false]]], "qwen": [678, 13, 0.004013643134385347, [[11, 0.467636, ",", false], [594, 0.310312, "'s", false], [279, 0.045603, " the", false], [582, 0.021165, " we", false], [432, 0.014184, " it", false], [1052, 0.013138, " there", false], [5538, 0.010651, " deep", false], [1429, 0.01032, " most", false], [6366, 0.009914, " computer", false], [11129, 0.007534, " vision", false]]]}, "raw_delta": -0.08263897895812988, "tuned_delta": -0.07530184044442714}, {"byte_start": 4633, "byte_end": 4638, "display": {"text": " this", "kind": "normal"}, "is_word": true, "word_id": 775, "word_key": " this", "bytes_hex": "20 74 68 69 73", "compression": {"rwkv": "15.33% 15.33% 15.33% 15.33% 15.33%", "qwen": "12.47% 12.47% 12.47% 12.47% 12.47%"}, "model_tokens": {"rwkv": [[32234, " this", "normal", 0.01418666634708643]], "qwen": [[419, " this", "normal", 0.031515933573246]]}, "loss": {"rwkv": 15.328634809445234, "qwen": 12.469436997463111}, "topk": {"rwkv": [32234, 13, 0.01418666634708643, [[22590, 0.193788, " the", false], [4706, 0.167345, " of", false], [52224, 0.093043, " methods", false], [39936, 0.064851, " these", false], [55809, 0.044669, " computer", false], [62603, 0.035451, " successful", false], [32227, 0.032771, " that", false], [38961, 0.030105, " major", false], [47732, 0.027119, " vision", false], [39944, 0.022601, " those", false]]], "qwen": [419, 9, 0.031515933573246, [[315, 0.226157, " of", false], [279, 0.127321, " the", false], [6366, 0.115761, " computer", false], [429, 0.090816, " that", false], [1846, 0.039523, " those", false], [5413, 0.036473, " methods", false], [3598, 0.035435, " major", false], [1493, 0.033718, " these", false], [419, 0.031516, " this", false], [11129, 0.028523, " vision", false]]]}, "raw_delta": 0.1585475921630859, "tuned_delta": 0.16588473067678863}, {"byte_start": 4638, "byte_end": 4641, "display": {"text": " is", "kind": "normal"}, "is_word": true, "word_id": 776, "word_key": " is", "bytes_hex": "20 69 73", "compression": {"rwkv": "5.47% 5.47% 5.47%", "qwen": "7.06% 7.06% 7.06%"}, "model_tokens": {"rwkv": [[4600, " is", "normal", 0.40344658493995667]], "qwen": [[374, " is", "normal", 0.3087458312511444]]}, "loss": {"rwkv": 5.471157951287898, "qwen": 7.064618774005778}, "topk": {"rwkv": [4600, 1, 0.40344658493995667, [[4600, 0.403447, " is", false], [21800, 0.214287, " has", false], [39620, 0.059117, " seems", false], [32499, 0.046133, " work", false], [57103, 0.037863, " research", false], [38720, 0.029858, " human", false], [45829, 0.011572, " effort", false], [31615, 0.010571, " pale", false], [59943, 0.01019, " knowledge", false], [38932, 0.009214, " looks", false]]], "qwen": [374, 1, 0.3087458312511444, [[374, 0.308746, " is", false], [702, 0.20507, " has", false], [6540, 0.059443, " knowledge", false], [3738, 0.055794, " human", false], [975, 0.049138, " work", false], [3412, 0.038615, " research", false], [5041, 0.020935, " effort", false], [2711, 0.015505, " search", false], [11129, 0.013739, " vision", false], [15039, 0.007819, " searching", false]]]}, "raw_delta": -0.08836023012797034, "tuned_delta": -0.0810230916142676}, {"byte_start": 4641, "byte_end": 4651, "display": {"text": " discarded", "kind": "normal"}, "is_word": true, "word_id": 777, "word_key": " discarded", "bytes_hex": "20 64 69 73 63 61 72 64 65 64", "compression": {"rwkv": "11.33% 11.33% 11.33% 11.33% 11.33% 11.33% 11.33% 11.33% 11.33% 11.33%", "qwen": "11.54% 11.54% 11.54% 11.54% 11.54% 11.54% 11.54% 11.54% 11.54% 11.54%"}, "model_tokens": {"rwkv": [[59536, " discarded", "normal", 0.001868218183517456]], "qwen": [[43210, " discarded", "normal", 0.0016657938249409199]]}, "loss": {"rwkv": 11.32741028197975, "qwen": 11.536967702403063}, "topk": {"rwkv": [59536, 91, 0.001868218183517456, [[45290, 0.058442, " behind", false], [332, 0.048873, " a", false], [30666, 0.041508, " done", false], [62161, 0.039846, " irrelevant", false], [31968, 0.028814, " seen", false], [4596, 0.023389, " in", false], [56738, 0.022544, " obsolete", false], [38319, 0.022342, " dwarf", false], [31323, 0.020387, " long", false], [52094, 0.020231, " largely", false]]], "qwen": [43210, 93, 0.0016657938249409199, [[2814, 0.106711, " done", false], [46066, 0.081737, " obsolete", false], [264, 0.044212, " a", false], [39715, 0.026981, " irrelevant", false], [13771, 0.026165, " largely", false], [3884, 0.024434, " seen", false], [1660, 0.023346, " being", false], [12575, 0.021129, " replaced", false], [1632, 0.015291, " well", false], [6509, 0.014365, " considered", false]]]}, "raw_delta": -0.011620330810546808, "tuned_delta": -0.004283192296844072}, {"byte_start": 4651, "byte_end": 4652, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "39.73%", "qwen": "45.59%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.10939408838748932]], "qwen": [[13, ".", "normal", 0.07983085513114929]]}, "loss": {"rwkv": 39.73046889948122, "qwen": 45.58637497176933}, "topk": {"rwkv": [47, 3, 0.10939408838748932, [[4596, 0.377946, " in", false], [45, 0.212011, ",", false], [47, 0.109394, ".", false], [21265, 0.099395, " and", false], [4423, 0.080303, " as", false], [21700, 0.024619, " for", false], [5346, 0.017108, "---", false], [60, 0.01628, ";", false], [51018, 0.013047, " because", false], [4450, 0.010296, " by", false]]], "qwen": [13, 4, 0.07983085513114929, [[304, 0.359606, " in", false], [11, 0.254916, ",", false], [323, 0.151327, " and", false], [13, 0.079831, ".", false], [438, 0.028933, " as", false], [4421, 0.024645, "---", false], [369, 0.020899, " for", false], [26, 0.015377, ";", false], [553, 0.012128, " by", false], [25, 0.007039, ":", false]]]}, "raw_delta": -0.3247203826904297, "tuned_delta": -0.317383244176727}, {"byte_start": 4652, "byte_end": 4659, "display": {"text": " Modern", "kind": "normal"}, "is_word": true, "word_id": 778, "word_key": " modern", "bytes_hex": "20 4d 6f 64 65 72 6e", "compression": {"rwkv": "10.87% 10.87% 10.87% 10.87% 10.87% 10.87% 10.87%", "qwen": "10.06% 10.06% 10.06% 10.06% 10.06% 10.06% 10.06%"}, "model_tokens": {"rwkv": [[44593, " Modern", "normal", 0.014880804345011711]], "qwen": [[18265, " Modern", "normal", 0.020121648907661438]]}, "loss": {"rwkv": 10.868517328125558, "qwen": 10.062692617507867}, "topk": {"rwkv": [44593, 13, 0.014880804345011711, [[50342, 0.220086, " Instead", false], [20996, 0.172074, " The", false], [28753, 0.043012, " Deep", false], [45032, 0.038653, " Vision", false], [36607, 0.030426, " Early", false], [3918, 0.027801, " It", false], [3913, 0.026701, " In", false], [37451, 0.020537, " There", false], [20530, 0.019407, " Now", false], [37468, 0.017588, " Today", false]]], "qwen": [18265, 8, 0.020121648907661438, [[12090, 0.211263, " Instead", false], [576, 0.121408, " The", false], [30441, 0.099468, " Vision", false], [2619, 0.037192, " There", false], [758, 0.035085, " In", false], [18183, 0.031522, " Deep", false], [1084, 0.020505, " It", false], [18265, 0.020122, " Modern", false], [17407, 0.018563, " Computer", false], [18801, 0.015824, " Methods", false]]]}, "raw_delta": 0.044684410095214844, "tuned_delta": 0.052021548608917584}, {"byte_start": 4659, "byte_end": 4664, "display": {"text": " deep", "kind": "normal"}, "is_word": true, "word_id": 779, "word_key": " deep", "bytes_hex": "20 64 65 65 70", "compression": {"rwkv": "13.47% 13.47% 13.47% 13.47% 13.47%", "qwen": "11.38% 11.38% 11.38% 11.38% 11.38%"}, "model_tokens": {"rwkv": [[30597, " deep", "normal", 0.024302441626787186]], "qwen": [[5538, " deep", "normal", 0.042633719742298126]]}, "loss": {"rwkv": 13.468910733299305, "qwen": 11.379653451832345}, "topk": {"rwkv": [30597, 7, 0.024302441626787186, [[52224, 0.401406, " methods", false], [55809, 0.194085, " computer", false], [47732, 0.103251, " vision", false], [53087, 0.057184, " systems", false], [61590, 0.056237, " approaches", false], [57103, 0.028473, " research", false], [30597, 0.024302, " deep", false], [38744, 0.010719, " image", false], [45, 0.010126, ",", false], [62633, 0.009858, " techniques", false]]], "qwen": [5538, 6, 0.042633719742298126, [[5413, 0.268403, " methods", false], [6366, 0.264064, " computer", false], [11129, 0.13221, " vision", false], [5942, 0.080928, " systems", false], [19827, 0.067449, " approaches", false], [5538, 0.042634, " deep", false], [12538, 0.016512, " techniques", false], [975, 0.010687, " work", false], [3412, 0.010184, " research", false], [25185, 0.006606, " algorithms", false]]]}, "raw_delta": 0.11585302352905269, "tuned_delta": 0.12319016204275543}, {"byte_start": 4664, "byte_end": 4673, "display": {"text": "-learning", "kind": "normal"}, "is_word": true, "word_id": 780, "word_key": "-learning", "bytes_hex": "2d 6c 65 61 72 6e 69 6e 67", "compression": {"rwkv": "43.39% 0.10% 0.10% 0.10% 0.10% 0.10% 0.10% 0.10% 0.10%", "qwen": "3.60% 3.60% 3.60% 3.60% 3.60% 3.60% 3.60% 3.60% 3.60%"}, "model_tokens": {"rwkv": [[46, "-", "normal", 0.08955054730176926], [54126, "learning", "normal", 0.9568225741386414]], "qwen": [[70756, "-learning", "normal", 0.16620495915412903]]}, "loss": {"rwkv": 4.9105403715153715, "qwen": 3.5957841227348726}, "topk": {"rwkv": [46, 3, 0.08955054730176926, [[56537, 0.59346, " learning", false], [63421, 0.090627, " convolution", false], [46, 0.089551, "-", false], [46658, 0.074553, " neural", false], [47732, 0.033544, " vision", false], [56705, 0.031519, " networks", false], [19593, 0.020196, " CNN", false], [52224, 0.012348, " methods", false], [47734, 0.008373, " visual", false], [52307, 0.007996, " network", false]]], "qwen": [70756, 2, 0.16620495915412903, [[6832, 0.627562, " learning", false], [70756, 0.166205, "-learning", false], [29728, 0.074835, " neural", false], [14155, 0.035269, " networks", false], [55712, 0.022559, " convolution", false], [11129, 0.014643, " vision", false], [5413, 0.007685, " methods", false], [12, 0.005075, "-", false], [3922, 0.004662, " network", false], [52457, 0.004097, " nets", false]]]}, "raw_delta": 0.07290556695726187, "tuned_delta": 0.08024270547096461}, {"byte_start": 4673, "byte_end": 4680, "display": {"text": " neural", "kind": "normal"}, "is_word": true, "word_id": 781, "word_key": " neural", "bytes_hex": "20 6e 65 75 72 61 6c", "compression": {"rwkv": "15.54% 15.54% 15.54% 15.54% 15.54% 15.54% 15.54%", "qwen": "16.49% 16.49% 16.49% 16.49% 16.49% 16.49% 16.49%"}, "model_tokens": {"rwkv": [[46658, " neural", "normal", 0.0023668629582971334]], "qwen": [[29728, " neural", "normal", 0.0016614794731140137]]}, "loss": {"rwkv": 15.53795440243136, "qwen": 16.488063957990402}, "topk": {"rwkv": [46658, 19, 0.0023668629582971334, [[52224, 0.447215, " methods", false], [46, 0.160199, "-", false], [47732, 0.085994, " vision", false], [61590, 0.081943, " approaches", false], [53087, 0.06972, " systems", false], [55809, 0.048041, " computer", false], [62633, 0.017063, " techniques", false], [46587, 0.009323, " models", false], [37810, 0.009198, " based", false], [56705, 0.008946, " networks", false]]], "qwen": [29728, 21, 0.0016614794731140137, [[5413, 0.297083, " methods", false], [5980, 0.277579, "-based", false], [5942, 0.09559, " systems", false], [19827, 0.068918, " approaches", false], [11129, 0.056684, " vision", false], [6366, 0.050089, " computer", false], [12538, 0.027737, " techniques", false], [3118, 0.026534, " based", false], [4119, 0.01504, " models", false], [77235, 0.009815, " architectures", false]]]}, "raw_delta": -0.05268526077270508, "tuned_delta": -0.04534812225900234}, {"byte_start": 4680, "byte_end": 4689, "display": {"text": " networks", "kind": "normal"}, "is_word": true, "word_id": 782, "word_key": " networks", "bytes_hex": "20 6e 65 74 77 6f 72 6b 73", "compression": {"rwkv": "1.12% 1.12% 1.12% 1.12% 1.12% 1.12% 1.12% 1.12% 1.12%", "qwen": "1.12% 1.12% 1.12% 1.12% 1.12% 1.12% 1.12% 1.12% 1.12%"}, "model_tokens": {"rwkv": [[56705, " networks", "normal", 0.5715659260749817]], "qwen": [[14155, " networks", "normal", 0.5725714564323425]]}, "loss": {"rwkv": 1.1192783791619019, "qwen": 1.1173226736703195}, "topk": {"rwkv": [56705, 1, 0.5715659260749817, [[56705, 0.571566, " networks", false], [46, 0.154449, "-", false], [52307, 0.12299, " network", false], [31510, 0.101298, " nets", false], [22166, 0.019699, " net", false], [53087, 0.006581, " systems", false], [47732, 0.005446, " vision", false], [61590, 0.003862, " approaches", false], [64833, 0.002991, " architectures", false], [52224, 0.002481, " methods", false]]], "qwen": [14155, 1, 0.5725714564323425, [[14155, 0.572571, " networks", false], [3922, 0.180329, " network", false], [56732, 0.095167, "-network", false], [52457, 0.089963, " nets", false], [4179, 0.025765, " net", false], [66496, 0.019738, "-net", false], [77235, 0.002377, " architectures", false], [5413, 0.001393, " methods", false], [4119, 0.001261, " models", false], [11129, 0.000954, " vision", false]]]}, "raw_delta": 0.00010844733979967214, "tuned_delta": 0.007445585853502409}, {"byte_start": 4689, "byte_end": 4693, "display": {"text": " use", "kind": "normal"}, "is_word": true, "word_id": 783, "word_key": " use", "bytes_hex": "20 75 73 65", "compression": {"rwkv": "15.99% 15.99% 15.99% 15.99%", "qwen": "20.07% 20.07% 20.07% 20.07%"}, "model_tokens": {"rwkv": [[22681, " use", "normal", 0.02884654514491558]], "qwen": [[990, " use", "normal", 0.011658454313874245]]}, "loss": {"rwkv": 15.990809291103256, "qwen": 20.070248518484753}, "topk": {"rwkv": [22681, 7, 0.02884654514491558, [[21286, 0.136724, " are", false], [45, 0.124585, ",", false], [31059, 0.10362, " have", false], [38877, 0.054649, " learn", false], [21413, 0.046477, " can", false], [4491, 0.032078, " do", false], [22681, 0.028847, " use", false], [32227, 0.02758, " that", false], [32499, 0.023484, " work", false], [32187, 0.019237, " take", false]]], "qwen": [990, 16, 0.011658454313874245, [[525, 0.195085, " are", false], [614, 0.08028, " have", false], [11, 0.079562, ",", false], [369, 0.045916, " for", false], [653, 0.037626, " do", false], [429, 0.036058, " that", false], [646, 0.035558, " can", false], [3960, 0.028118, " learn", false], [8193, 0.024127, " produce", false], [975, 0.020111, " work", false]]]}, "raw_delta": -0.22621214389801025, "tuned_delta": -0.2188750053843075}, {"byte_start": 4693, "byte_end": 4698, "display": {"text": " only", "kind": "normal"}, "is_word": true, "word_id": 784, "word_key": " only", "bytes_hex": "20 6f 6e 6c 79", "compression": {"rwkv": "14.99% 14.99% 14.99% 14.99% 14.99%", "qwen": "14.56% 14.56% 14.56% 14.56% 14.56%"}, "model_tokens": {"rwkv": [[31581, " only", "normal", 0.015558638609945774]], "qwen": [[1172, " only", "normal", 0.01767251081764698]]}, "loss": {"rwkv": 14.990503159236885, "qwen": 14.555872043629412}, "topk": {"rwkv": [31581, 9, 0.015558638609945774, [[52195, 0.370678, " massive", false], [332, 0.061566, " a", false], [63421, 0.041803, " convolution", false], [59988, 0.026155, " massively", false], [31118, 0.024404, " huge", false], [22590, 0.021634, " the", false], [56640, 0.019286, " millions", false], [56125, 0.016516, " enormous", false], [31581, 0.015559, " only", false], [31370, 0.015388, " many", false]]], "qwen": [1172, 14, 0.01767251081764698, [[10951, 0.12976, " massive", false], [264, 0.099447, " a", false], [34447, 0.044404, " computation", false], [1657, 0.032764, " many", false], [1753, 0.030882, " much", false], [1602, 0.027839, " very", false], [6765, 0.023795, " huge", false], [3460, 0.022523, " large", false], [902, 0.02079, " no", false], [279, 0.020385, " the", false]]]}, "raw_delta": 0.024101066589355513, "tuned_delta": 0.03143820510305825}, {"byte_start": 4698, "byte_end": 4702, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 785, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "11.41% 11.41% 11.41% 11.41%", "qwen": "13.86% 13.86% 13.86% 13.86%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.0793071836233139]], "qwen": [[279, " the", "normal", 0.04623117297887802]]}, "loss": {"rwkv": 11.411943194531839, "qwen": 13.859344457418173}, "topk": {"rwkv": [22590, 2, 0.0793071836233139, [[332, 0.237086, " a", false], [22590, 0.079307, " the", false], [52195, 0.051499, " massive", false], [63421, 0.040005, " convolution", false], [32386, 0.038209, " very", false], [22363, 0.023653, " raw", false], [62577, 0.019747, " statistics", false], [22226, 0.019642, " one", false], [63885, 0.018678, " statistical", false], [63370, 0.018408, " computation", false]]], "qwen": [279, 4, 0.04623117297887802, [[34447, 0.191654, " computation", false], [264, 0.084767, " a", false], [10951, 0.058609, " massive", false], [279, 0.046231, " the", false], [825, 0.040496, " one", false], [2205, 0.032466, " local", false], [15751, 0.027486, " pixels", false], [1602, 0.020954, " very", false], [4285, 0.019496, " simple", false], [1378, 0.018379, " two", false]]]}, "raw_delta": -0.13571274280548096, "tuned_delta": -0.12837560429177822}, {"byte_start": 4702, "byte_end": 4710, "display": {"text": " notions", "kind": "normal"}, "is_word": true, "word_id": 786, "word_key": " notions", "bytes_hex": "20 6e 6f 74 69 6f 6e 73", "compression": {"rwkv": "19.58% 19.58% 19.58% 19.58% 19.58% 19.58% 19.58% 19.58%", "qwen": "21.11% 21.11% 21.11% 21.11% 21.11% 21.11% 21.11% 21.11%"}, "model_tokens": {"rwkv": [[52326, " notions", "normal", 0.00016343005700036883]], "qwen": [[58582, " notions", "normal", 8.57186532812193e-05]]}, "loss": {"rwkv": 19.58345807456698, "qwen": 21.109423589359373}, "topk": {"rwkv": [52326, 485, 0.00016343005700036883, [[22363, 0.126863, " raw", false], [63370, 0.066808, " computation", false], [30579, 0.03725, " data", false], [52195, 0.030614, " massive", false], [63885, 0.028778, " statistical", false], [62577, 0.026821, " statistics", false], [37812, 0.026719, " basic", false], [31461, 0.026612, " most", false], [46826, 0.018222, " pixels", false], [32386, 0.015264, " very", false]]], "qwen": [58582, 710, 8.57186532812193e-05, [[7112, 0.240242, " raw", false], [1946, 0.050263, " input", false], [1429, 0.04968, " most", false], [34447, 0.040505, " computation", false], [821, 0.030689, " data", false], [15751, 0.021541, " pixels", false], [44548, 0.013875, " simplest", false], [54480, 0.01277, " computational", false], [2550, 0.012747, " output", false], [1995, 0.011851, " information", false]]]}, "raw_delta": -0.0846174955368042, "tuned_delta": -0.07728035702310146}, {"byte_start": 4710, "byte_end": 4713, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 787, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "0.66% 0.66% 0.66%", "qwen": "0.50% 0.50% 0.50%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.8951891660690308]], "qwen": [[315, " of", "normal", 0.9205737113952637]]}, "loss": {"rwkv": 0.6633485498879104, "qwen": 0.4974787177974093}, "topk": {"rwkv": [4706, 1, 0.8951891660690308, [[4706, 0.895189, " of", false], [32227, 0.057953, " that", false], [4404, 0.003865, " ``", false], [21265, 0.003735, " and", false], [30917, 0.003566, " from", false], [52112, 0.002556, " learned", false], [38547, 0.001787, " found", false], [45, 0.001555, ",", false], [56412, 0.001531, " implicit", false], [4858, 0.001274, " we", false]]], "qwen": [315, 1, 0.9205737113952637, [[315, 0.920574, " of", false], [429, 0.042324, " that", false], [9902, 0.005987, " ``", false], [323, 0.004754, " and", false], [11, 0.001434, ",", false], [504, 0.001303, " from", false], [304, 0.001071, " in", false], [2500, 0.000902, " available", false], [1730, 0.000823, " found", false], [3897, 0.000765, " provided", false]]]}, "raw_delta": 0.009197776516278584, "tuned_delta": 0.01653491502998132}, {"byte_start": 4713, "byte_end": 4725, "display": {"text": " convolution", "kind": "normal"}, "is_word": true, "word_id": 788, "word_key": " convolution", "bytes_hex": "20 63 6f 6e 76 6f 6c 75 74 69 6f 6e", "compression": {"rwkv": "2.61% 2.61% 2.61% 2.61% 2.61% 2.61% 2.61% 2.61% 2.61% 2.61% 2.61% 2.61%", "qwen": "7.81% 7.81% 7.81% 7.81% 7.81% 7.81% 7.81% 7.81% 7.81% 7.81% 7.81% 7.81%"}, "model_tokens": {"rwkv": [[63421, " convolution", "normal", 0.17733125388622284]], "qwen": [[55712, " convolution", "normal", 0.005531262140721083]]}, "loss": {"rwkv": 2.606431470356037, "qwen": 7.810599254878239}, "topk": {"rwkv": [63421, 1, 0.17733125388622284, [[63421, 0.177331, " convolution", false], [4404, 0.106805, " ``", false], [56324, 0.041178, " gradient", false], [332, 0.037921, " a", false], [46826, 0.036745, " pixels", false], [38332, 0.019386, " edges", false], [38924, 0.018816, " local", false], [59770, 0.018247, " gradients", false], [46442, 0.017509, " linear", false], [52962, 0.017368, " spatial", false]]], "qwen": [55712, 21, 0.005531262140721083, [[15751, 0.210336, " pixels", false], [9902, 0.163015, " ``", false], [1946, 0.080249, " input", false], [12955, 0.049233, " pixel", false], [11127, 0.038684, " inputs", false], [821, 0.02286, " data", false], [264, 0.022442, " a", false], [2168, 0.017997, " image", false], [5335, 0.01565, " images", false], [13617, 0.014336, " layers", false]]]}, "raw_delta": -0.2885803381601969, "tuned_delta": -0.2812431996464942}, {"byte_start": 4725, "byte_end": 4729, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 789, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"rwkv": "2.80% 2.80% 2.80% 2.80%", "qwen": "2.59% 2.59% 2.59% 2.59%"}, "model_tokens": {"rwkv": [[21265, " and", "normal", 0.5361390113830566]], "qwen": [[323, " and", "normal", 0.563117504119873]]}, "loss": {"rwkv": 2.800152728287905, "qwen": 2.5890375750044}, "topk": {"rwkv": [21265, 1, 0.5361390113830566, [[21265, 0.536139, " and", false], [116, 0.181518, "s", false], [45, 0.137792, ",", false], [1744, 0.063431, "al", false], [275, 0.018762, " (", false], [4706, 0.006669, " of", false], [32487, 0.006669, " with", false], [4596, 0.004927, " in", false], [5346, 0.004713, "---", false], [4715, 0.003461, " or", false]]], "qwen": [323, 1, 0.563117504119873, [[323, 0.563118, " and", false], [11, 0.249865, ",", false], [278, 0.088523, "al", false], [320, 0.033634, " (", false], [448, 0.007711, " with", false], [304, 0.007127, " in", false], [315, 0.006006, " of", false], [4421, 0.005023, "---", false], [311, 0.003296, " to", false], [476, 0.002801, " or", false]]]}, "raw_delta": 0.011706709861755371, "tuned_delta": 0.019043848375458108}, {"byte_start": 4729, "byte_end": 4737, "display": {"text": " certain", "kind": "normal"}, "is_word": true, "word_id": 790, "word_key": " certain", "bytes_hex": "20 63 65 72 74 61 69 6e", "compression": {"rwkv": "19.72% 19.72% 19.72% 19.72% 19.72% 19.72% 19.72% 19.72%", "qwen": "22.03% 22.03% 22.03% 22.03% 22.03% 22.03% 22.03% 22.03%"}, "model_tokens": {"rwkv": [[51161, " certain", "normal", 0.00015648182306904346]], "qwen": [[3654, " certain", "normal", 5.696467269444838e-05]]}, "loss": {"rwkv": 19.724346262153794, "qwen": 22.0305820154288}, "topk": {"rwkv": [51161, 286, 0.00015648182306904346, [[52513, 0.543823, " pooling", false], [56324, 0.027326, " gradient", false], [30218, 0.020537, " back", false], [22073, 0.017305, " max", false], [61531, 0.01611, " activation", false], [46442, 0.014691, " linear", false], [22590, 0.01465, " the", false], [46528, 0.014556, " matrix", false], [332, 0.013659, " a", false], [4706, 0.010378, " of", false]]], "qwen": [3654, 512, 5.696467269444838e-05, [[74410, 0.323474, " pooling", false], [1182, 0.152139, " back", false], [15099, 0.053239, " activation", false], [1932, 0.031181, " max", false], [7608, 0.024382, " rect", false], [315, 0.020933, " of", false], [20169, 0.020894, " gradient", false], [279, 0.015892, " the", false], [2205, 0.01021, " local", false], [2477, 0.009828, " non", false]]]}, "raw_delta": -0.1278848648071289, "tuned_delta": -0.12054772629342617}, {"byte_start": 4737, "byte_end": 4743, "display": {"text": " kinds", "kind": "normal"}, "is_word": true, "word_id": 791, "word_key": " kinds", "bytes_hex": "20 6b 69 6e 64 73", "compression": {"rwkv": "8.08% 8.08% 8.08% 8.08% 8.08% 8.08%", "qwen": "7.10% 7.10% 7.10% 7.10% 7.10% 7.10%"}, "model_tokens": {"rwkv": [[38841, " kinds", "normal", 0.06867994368076324]], "qwen": [[12829, " kinds", "normal", 0.09435734152793884]]}, "loss": {"rwkv": 8.077589421643935, "qwen": 7.095252467096338}, "topk": {"rwkv": [38841, 3, 0.06867994368076324, [[39193, 0.123027, " other", false], [40050, 0.081706, " types", false], [38841, 0.06868, " kinds", false], [38541, 0.049131, " forms", false], [57520, 0.041154, " variants", false], [47284, 0.029614, " simple", false], [37812, 0.026488, " basic", false], [65135, 0.023629, " generalization", false], [64284, 0.018458, " combinations", false], [62404, 0.015493, " properties", false]]], "qwen": [12829, 2, 0.09435734152793884, [[1008, 0.125553, " other", false], [12829, 0.094357, " kinds", false], [4494, 0.07733, " types", false], [15099, 0.043503, " activation", false], [4285, 0.025572, " simple", false], [13482, 0.019895, " linear", false], [7525, 0.018981, " operations", false], [13617, 0.018745, " layers", false], [2477, 0.016965, " non", false], [6770, 0.016653, " basic", false]]]}, "raw_delta": 0.05447232723236084, "tuned_delta": 0.06180946574606358}, {"byte_start": 4743, "byte_end": 4746, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 792, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "0.01% 0.01% 0.01%", "qwen": "0.01% 0.01% 0.01%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.9987673759460449]], "qwen": [[315, " of", "normal", 0.99803227186203]]}, "loss": {"rwkv": 0.00738378847704325, "qwen": 0.011840085975758403}, "topk": {"rwkv": [4706, 1, 0.9987673759460449, [[4706, 0.998767, " of", false], [21265, 0.000226, " and", false], [275, 0.00015, " (", false], [4715, 4.1e-05, " or", false], [45, 3.6e-05, ",", false], [46442, 2.4e-05, " linear", false], [11, 1.7e-05, "\n", false], [4588, 1.7e-05, " if", false], [63421, 1.6e-05, " convolution", false], [56324, 1.6e-05, " gradient", false]]], "qwen": [315, 1, 0.99803227186203, [[315, 0.998032, " of", false], [323, 0.000492, " and", false], [320, 0.000466, " (", false], [476, 0.000258, " or", false], [11, 0.000107, ",", false], [198, 5.8e-05, "\n", false], [220, 2.7e-05, " ", false], [4421, 1.4e-05, "---", false], [369, 1.3e-05, " for", false], [389, 1.2e-05, " on", false]]]}, "raw_delta": -0.0002471096037576596, "tuned_delta": 0.007090028909945077}, {"byte_start": 4746, "byte_end": 4758, "display": {"text": " invariances", "kind": "normal"}, "is_word": true, "word_id": 793, "word_key": " invariances", "bytes_hex": "20 69 6e 76 61 72 69 61 6e 63 65 73", "compression": {"rwkv": "13.61% 13.61% 13.61% 13.61% 13.61% 13.61% 13.61% 9.24% 9.24% 9.24% 9.24% 9.24%", "qwen": "45.30% 45.30% 45.30% 0.94% 0.94% 0.94% 5.83% 5.83% 5.83% 5.83% 5.83% 5.83%"}, "model_tokens": {"rwkv": [[46326, " invari", "normal", 0.005143760237842798], [33764, "ances", "normal", 0.0770193487405777]], "qwen": [[304, " in", "normal", 0.0005338663468137383], [947, "var", "normal", 0.855250895023346], [21813, "iances", "normal", 0.14363746345043182]]}, "loss": {"rwkv": 11.787645028096673, "qwen": 14.475323252503442}, "topk": {"rwkv": [46326, 29, 0.005143760237842798, [[52513, 0.178475, " pooling", false], [61531, 0.069835, " activation", false], [31333, 0.033657, " loss", false], [60060, 0.028398, " nonlinear", false], [22184, 0.026391, " non", false], [51743, 0.0202, " filters", false], [51725, 0.019865, " feature", false], [46528, 0.018293, " matrix", false], [46442, 0.017346, " linear", false], [62577, 0.017181, " statistics", false]]], "qwen": [304, 149, 0.0005338663468137383, [[74410, 0.326134, " pooling", false], [15099, 0.094545, " activation", false], [2477, 0.030159, " non", false], [13617, 0.025877, " layers", false], [73998, 0.020388, " nonlinear", false], [1182, 0.019519, " back", false], [2205, 0.01408, " local", false], [6193, 0.014002, " layer", false], [13482, 0.013913, " linear", false], [20169, 0.012127, " gradient", false]]]}, "raw_delta": -0.14903652667999265, "tuned_delta": -0.1416993881662899}, {"byte_start": 4758, "byte_end": 4759, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "24.37%", "qwen": "22.09%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.261186420917511]], "qwen": [[11, ",", "normal", 0.29383400082588196]]}, "loss": {"rwkv": 24.373656452518617, "qwen": 22.086583866116}, "topk": {"rwkv": [45, 1, 0.261186420917511, [[45, 0.261186, ",", false], [4811, 0.160037, " to", false], [47, 0.130583, ".", false], [32227, 0.113643, " that", false], [275, 0.08087, " (", false], [5346, 0.037794, "---", false], [21265, 0.037569, " and", false], [4596, 0.01976, " in", false], [4706, 0.016602, " of", false], [4423, 0.010592, " as", false]]], "qwen": [11, 1, 0.29383400082588196, [[11, 0.293834, ",", false], [311, 0.188356, " to", false], [13, 0.157803, ".", false], [320, 0.106901, " (", false], [4421, 0.052737, "---", false], [323, 0.043261, " and", false], [304, 0.021859, " in", false], [315, 0.020711, " of", false], [429, 0.014442, " that", false], [369, 0.013225, " for", false]]]}, "raw_delta": 0.12682223320007324, "tuned_delta": 0.13415937171377598}, {"byte_start": 4759, "byte_end": 4763, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 794, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"rwkv": "4.31% 4.31% 4.31% 4.31%", "qwen": "3.81% 3.81% 3.81% 3.81%"}, "model_tokens": {"rwkv": [[21265, " and", "normal", 0.38373133540153503]], "qwen": [[323, " and", "normal", 0.4295869469642639]]}, "loss": {"rwkv": 4.314700744846142, "qwen": 3.8093060776712857}, "topk": {"rwkv": [21265, 1, 0.38373133540153503, [[21265, 0.383731, " and", false], [21400, 0.177311, " but", false], [32139, 0.048395, " such", false], [40186, 0.045829, " which", false], [32487, 0.024805, " with", false], [53356, 0.022609, " without", false], [22797, 0.016715, " yet", false], [4423, 0.014895, " as", false], [22187, 0.014755, " not", false], [31296, 0.012972, " like", false]]], "qwen": [323, 1, 0.4295869469642639, [[323, 0.429587, " and", false], [892, 0.107556, " which", false], [2041, 0.049767, " without", false], [448, 0.047513, " with", false], [1741, 0.036292, " such", false], [714, 0.035953, " but", false], [438, 0.015502, " as", false], [3156, 0.012447, " along", false], [304, 0.011674, " in", false], [311, 0.011388, " to", false]]]}, "raw_delta": 0.028025031089782715, "tuned_delta": 0.035362169603485455}, {"byte_start": 4763, "byte_end": 4771, "display": {"text": " perform", "kind": "normal"}, "is_word": true, "word_id": 795, "word_key": " perform", "bytes_hex": "20 70 65 72 66 6f 72 6d", "compression": {"rwkv": "12.26% 12.26% 12.26% 12.26% 12.26% 12.26% 12.26% 12.26%", "qwen": "10.87% 10.87% 10.87% 10.87% 10.87% 10.87% 10.87% 10.87%"}, "model_tokens": {"rwkv": [[52446, " perform", "normal", 0.0044083259999752045]], "qwen": [[2736, " perform", "normal", 0.008039688691496849]]}, "loss": {"rwkv": 12.257272320052715, "qwen": 10.872882923450586}, "topk": {"rwkv": [52446, 40, 0.0044083259999752045, [[32232, 0.149306, " they", false], [39936, 0.088249, " these", false], [22590, 0.058522, " the", false], [21286, 0.037877, " are", false], [22797, 0.037041, " yet", false], [4491, 0.031112, " do", false], [38877, 0.027517, " learn", false], [31059, 0.026217, " have", false], [39944, 0.022162, " those", false], [21413, 0.017172, " can", false]]], "qwen": [2736, 27, 0.008039688691496849, [[807, 0.101894, " they", false], [1493, 0.078591, " these", false], [525, 0.053959, " are", false], [279, 0.049706, " the", false], [653, 0.038032, " do", false], [614, 0.034809, " have", false], [3960, 0.026716, " learn", false], [678, 0.021493, " all", false], [990, 0.018424, " use", false], [304, 0.014912, " in", false]]]}, "raw_delta": 0.07676684856414795, "tuned_delta": 0.08410398707785069}, {"byte_start": 4771, "byte_end": 4776, "display": {"text": " much", "kind": "normal"}, "is_word": true, "word_id": 796, "word_key": " much", "bytes_hex": "20 6d 75 63 68", "compression": {"rwkv": "12.17% 12.17% 12.17% 12.17% 12.17%", "qwen": "12.78% 12.78% 12.78% 12.78% 12.78%"}, "model_tokens": {"rwkv": [[31466, " much", "normal", 0.03440967574715614]], "qwen": [[1753, " much", "normal", 0.02893921546638012]]}, "loss": {"rwkv": 12.172739407500629, "qwen": 12.777076123673485}, "topk": {"rwkv": [31466, 7, 0.03440967574715614, [[22590, 0.084036, " the", false], [39931, 0.078139, " their", false], [32386, 0.049471, " very", false], [32458, 0.049296, " well", false], [50892, 0.048225, " amazing", false], [332, 0.035266, " a", false], [31466, 0.03441, " much", false], [59699, 0.031383, " extremely", false], [62478, 0.029861, " remarkably", false], [52195, 0.022524, " massive", false]]], "qwen": [1753, 6, 0.02893921546638012, [[10951, 0.108828, " massive", false], [264, 0.058312, " a", false], [34447, 0.051205, " computation", false], [279, 0.036593, " the", false], [82599, 0.032326, " computations", false], [1753, 0.028939, " much", false], [678, 0.028153, " all", false], [1172, 0.024633, " only", false], [63707, 0.023228, " massively", false], [3041, 0.022704, " far", false]]]}, "raw_delta": -0.03351154327392569, "tuned_delta": -0.026174404760222956}, {"byte_start": 4776, "byte_end": 4783, "display": {"text": " better", "kind": "normal"}, "is_word": true, "word_id": 797, "word_key": " better", "bytes_hex": "20 62 65 74 74 65 72", "compression": {"rwkv": "0.58% 0.58% 0.58% 0.58% 0.58% 0.58% 0.58%", "qwen": "13.20% 13.20% 13.20% 13.20% 13.20% 13.20% 13.20%"}, "model_tokens": {"rwkv": [[45301, " better", "normal", 0.7996662855148315]], "qwen": [[2664, " better", "normal", 0.005944317672401667]]}, "loss": {"rwkv": 0.5761320528103596, "qwen": 13.204058925107585}, "topk": {"rwkv": [45301, 1, 0.7996662855148315, [[45301, 0.799666, " better", false], [31458, 0.128529, " more", false], [45, 0.02104, ",", false], [4706, 0.009358, " of", false], [31466, 0.009335, " much", false], [22590, 0.006114, " the", false], [31277, 0.002411, " less", false], [46198, 0.002362, " higher", false], [4715, 0.002083, " or", false], [45961, 0.001914, " faster", false]]], "qwen": [2664, 10, 0.005944317672401667, [[803, 0.738744, " more", false], [11, 0.077369, ",", false], [7046, 0.036871, " greater", false], [34447, 0.032189, " computation", false], [8131, 0.022939, " larger", false], [1753, 0.014226, " much", false], [315, 0.012348, " of", false], [2686, 0.009427, " less", false], [19117, 0.007091, " deeper", false], [2664, 0.005944, " better", false]]]}, "raw_delta": -0.7002409526279995, "tuned_delta": -0.6929038141142967}, {"byte_start": 4783, "byte_end": 4785, "display": {"text": ".\n", "kind": "control"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e 0a", "compression": {"rwkv": "17.26% 23.95%", "qwen": "23.55% 23.55%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.3856501579284668], [261, "\n\n", "control", 0.07093143463134766]], "qwen": [[382, ".\n\n", "control", 0.019882136955857277]]}, "loss": {"rwkv": 20.604897434571374, "qwen": 23.551598012848235}, "topk": {"rwkv": [47, 1, 0.3856501579284668, [[47, 0.38565, ".", false], [32226, 0.230287, " than", false], [4712, 0.07341, " on", false], [45, 0.065638, ",", false], [4596, 0.045313, " in", false], [4424, 0.030211, " at", false], [5346, 0.027638, "---", false], [32487, 0.021216, " with", false], [21265, 0.013025, " and", false], [52394, 0.012075, " overall", false]]], "qwen": [382, 8, 0.019882136955857277, [[1091, 0.471128, " than", false], [13, 0.246018, ".", false], [11, 0.053335, ",", false], [304, 0.03831, " in", false], [389, 0.03272, " on", false], [518, 0.025199, " at", false], [323, 0.020144, " and", false], [382, 0.019882, ".\n\n", false], [320, 0.01196, " (", false], [4421, 0.011649, "---", false]]]}, "raw_delta": -0.16339977582295728, "tuned_delta": -0.15606263730925454}, {"byte_start": 4785, "byte_end": 4786, "display": {"text": "\n", "kind": "control"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "0a", "compression": {"rwkv": "23.95%", "qwen": "23.55%"}, "model_tokens": {"rwkv": [[261, "\n\n", "control", 0.07093143463134766]], "qwen": [[382, ".\n\n", "control", 0.019882136955857277]]}, "loss": {"rwkv": 23.95099188975818, "qwen": 23.551598012848235}, "topk": {"rwkv": [261, 3, 0.07093143463134766, [[20996, 0.139227, " The", false], [29894, 0.084779, " This", false], [261, 0.070931, "\n\n", false], [36251, 0.054598, " Again", false], [3913, 0.0422, " In", false], [3918, 0.034769, " It", false], [37451, 0.033163, " There", false], [29893, 0.029306, " They", false], [37453, 0.024945, " These", false], [3641, 0.023642, " As", false]]], "qwen": [382, 8, 0.019882136955857277, [[1091, 0.471128, " than", false], [13, 0.246018, ".", false], [11, 0.053335, ",", false], [304, 0.03831, " in", false], [389, 0.03272, " on", false], [518, 0.025199, " at", false], [323, 0.020144, " and", false], [382, 0.019882, ".\n\n", false], [320, 0.01196, " (", false], [4421, 0.011649, "---", false]]]}, "raw_delta": 0.022147099177042717, "tuned_delta": 0.029484237690745454}, {"byte_start": 4786, "byte_end": 4790, "display": {"text": "This", "kind": "normal"}, "is_word": true, "word_id": 798, "word_key": "this", "bytes_hex": "54 68 69 73", "compression": {"rwkv": "17.26% 17.26% 17.26% 17.26%", "qwen": "18.53% 18.53% 18.53% 18.53%"}, "model_tokens": {"rwkv": [[24242, "This", "normal", 0.021429626271128654]], "qwen": [[1986, "This", "normal", 0.016417063772678375]]}, "loss": {"rwkv": 17.25880297938457, "qwen": 18.527063240774723}, "topk": {"rwkv": [24242, 8, 0.021429626271128654, [[1136, 0.222311, "In", false], [6699, 0.12427, "The", false], [33504, 0.074473, "There", false], [33505, 0.044885, "These", false], [66, 0.039411, "A", false], [1141, 0.035129, "It", false], [5559, 0.024486, "All", false], [24242, 0.02143, "This", false], [1461, 0.017723, "So", false], [48358, 0.013405, "Another", false]]], "qwen": [1986, 8, 0.016417063772678375, [[641, 0.367578, "In", false], [785, 0.092108, "The", false], [3862, 0.037181, "There", false], [9485, 0.026937, "These", false], [32, 0.026351, "A", false], [2403, 0.01976, "All", false], [2132, 0.018167, "It", false], [1986, 0.016417, "This", false], [67691, 0.016169, "Similarly", false], [23949, 0.012105, "Finally", false]]]}, "raw_delta": -0.0703272819519043, "tuned_delta": -0.06299014343820156}, {"byte_start": 4790, "byte_end": 4793, "display": {"text": " is", "kind": "normal"}, "is_word": true, "word_id": 799, "word_key": " is", "bytes_hex": "20 69 73", "compression": {"rwkv": "8.41% 8.41% 8.41%", "qwen": "11.80% 11.80% 11.80%"}, "model_tokens": {"rwkv": [[4600, " is", "normal", 0.24497567117214203]], "qwen": [[374, " is", "normal", 0.14036953449249268]]}, "loss": {"rwkv": 8.406328526013164, "qwen": 11.802909204955125}, "topk": {"rwkv": [4600, 1, 0.24497567117214203, [[4600, 0.244976, " is", false], [52427, 0.212361, " pattern", false], [51832, 0.0199, " general", false], [46430, 0.019366, " lesson", false], [30659, 0.015755, " does", false], [21800, 0.015613, " has", false], [31254, 0.014605, " last", false], [31307, 0.014389, " list", false], [51929, 0.013441, " history", false], [31937, 0.011913, " same", false]]], "qwen": [374, 2, 0.14036953449249268, [[5383, 0.312502, " pattern", false], [374, 0.14037, " is", false], [25180, 0.084028, " bitter", false], [9149, 0.038647, " trend", false], [1852, 0.025313, " same", false], [17755, 0.017518, " lesson", false], [572, 0.015478, " was", false], [702, 0.013894, " has", false], [4586, 0.013448, " general", false], [78996, 0.009663, " bitterness", false]]]}, "raw_delta": -0.1883464256922404, "tuned_delta": -0.18100928717853765}, {"byte_start": 4793, "byte_end": 4795, "display": {"text": " a", "kind": "normal"}, "is_word": true, "word_id": 800, "word_key": " a", "bytes_hex": "20 61", "compression": {"rwkv": "19.30% 19.30%", "qwen": "16.10% 16.10%"}, "model_tokens": {"rwkv": [[332, " a", "normal", 0.11890353262424469]], "qwen": [[264, " a", "normal", 0.16762448847293854]]}, "loss": {"rwkv": 19.301681699393356, "qwen": 16.104344712961908}, "topk": {"rwkv": [332, 2, 0.11890353262424469, [[22187, 0.445208, " not", false], [332, 0.118904, " a", false], [22590, 0.073161, " the", false], [31198, 0.041686, " just", false], [21256, 0.033997, " all", false], [4419, 0.026031, " an", false], [31581, 0.017321, " only", false], [4450, 0.01663, " by", false], [45, 0.013334, ",", false], [32313, 0.01291, " true", false]]], "qwen": [264, 2, 0.16762448847293854, [[537, 0.305703, " not", false], [264, 0.167624, " a", false], [279, 0.080188, " the", false], [830, 0.049772, " true", false], [458, 0.044748, " an", false], [1101, 0.033786, " just", false], [1083, 0.030415, " also", false], [678, 0.026734, " all", false], [1172, 0.017125, " only", false], [825, 0.015389, " one", false]]]}, "raw_delta": 0.17729800939559937, "tuned_delta": 0.1846351479093021}, {"byte_start": 4795, "byte_end": 4799, "display": {"text": " big", "kind": "normal"}, "is_word": true, "word_id": 801, "word_key": " big", "bytes_hex": "20 62 69 67", "compression": {"rwkv": "23.39% 23.39% 23.39% 23.39%", "qwen": "18.40% 18.40% 18.40% 18.40%"}, "model_tokens": {"rwkv": [[21357, " big", "normal", 0.005515968427062035]], "qwen": [[2409, " big", "normal", 0.016895288601517677]]}, "loss": {"rwkv": 23.38743913941093, "qwen": 18.397609749687152}, "topk": {"rwkv": [21357, 26, 0.005515968427062035, [[52427, 0.181375, " pattern", false], [51832, 0.125756, " general", false], [32386, 0.072142, " very", false], [46430, 0.04662, " lesson", false], [45534, 0.026455, " common", false], [31323, 0.025387, " long", false], [30992, 0.017076, " good", false], [21365, 0.014698, " bit", false], [38049, 0.011901, " clear", false], [61756, 0.011838, " consistent", false]]], "qwen": [2409, 6, 0.016895288601517677, [[5383, 0.145758, " pattern", false], [25180, 0.106271, " bitter", false], [4586, 0.053672, " general", false], [1602, 0.04959, " very", false], [1293, 0.028695, " long", false], [2409, 0.016895, " big", false], [1661, 0.01616, " good", false], [45250, 0.014066, " recurring", false], [4185, 0.013676, " common", false], [12126, 0.013605, " summary", false]]]}, "raw_delta": 0.2766948938369751, "tuned_delta": 0.2840320323506778}, {"byte_start": 4799, "byte_end": 4806, "display": {"text": " lesson", "kind": "normal"}, "is_word": true, "word_id": 802, "word_key": " lesson", "bytes_hex": "20 6c 65 73 73 6f 6e", "compression": {"rwkv": "2.23% 2.23% 2.23% 2.23% 2.23% 2.23% 2.23%", "qwen": "2.75% 2.75% 2.75% 2.75% 2.75% 2.75% 2.75%"}, "model_tokens": {"rwkv": [[46430, " lesson", "normal", 0.4200761318206787]], "qwen": [[17755, " lesson", "normal", 0.34429696202278137]]}, "loss": {"rwkv": 2.2340841174480324, "qwen": 2.746919184055841}, "topk": {"rwkv": [46430, 1, 0.4200761318206787, [[46430, 0.420076, " lesson", false], [45450, 0.053707, " change", false], [39932, 0.039814, " theme", false], [45, 0.034435, ",", false], [31633, 0.029327, " part", false], [52427, 0.029313, " pattern", false], [30587, 0.027557, " deal", false], [39831, 0.026095, " story", false], [39981, 0.023803, " topic", false], [21265, 0.018201, " and", false]]], "qwen": [17755, 1, 0.34429696202278137, [[17755, 0.344297, " lesson", false], [5383, 0.15431, " pattern", false], [6802, 0.054268, " picture", false], [2297, 0.05139, " change", false], [6912, 0.033931, " theme", false], [3364, 0.032475, " story", false], [4586, 0.019287, " general", false], [11, 0.018384, ",", false], [323, 0.018098, " and", false], [3491, 0.016748, " problem", false]]]}, "raw_delta": -0.02843761444091797, "tuned_delta": -0.021100475927215232}, {"byte_start": 4806, "byte_end": 4807, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "30.85%", "qwen": "24.30%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.1833907961845398]], "qwen": [[13, ".", "normal", 0.25993290543556213]]}, "loss": {"rwkv": 30.854513081512007, "qwen": 24.297360649029603}, "topk": {"rwkv": [47, 1, 0.1833907961845398, [[47, 0.183391, ".", false], [45, 0.178725, ",", false], [21700, 0.157706, " for", false], [32227, 0.089478, " that", false], [4811, 0.080403, " to", false], [4596, 0.074429, " in", false], [59, 0.057147, ":", false], [37598, 0.034574, " about", false], [4706, 0.026641, " of", false], [30917, 0.025756, " from", false]]], "qwen": [13, 1, 0.25993290543556213, [[13, 0.259933, ".", false], [369, 0.230987, " for", false], [11, 0.149982, ",", false], [25, 0.080439, ":", false], [311, 0.076702, " to", false], [429, 0.042925, " that", false], [304, 0.033457, " in", false], [911, 0.020299, " about", false], [315, 0.013647, " of", false], [4421, 0.013556, "---", false]]]}, "raw_delta": 0.3636057376861572, "tuned_delta": 0.37094287619985994}, {"byte_start": 4807, "byte_end": 4810, "display": {"text": " As", "kind": "normal"}, "is_word": true, "word_id": 803, "word_key": " as", "bytes_hex": "20 41 73", "compression": {"rwkv": "25.92% 25.92% 25.92%", "qwen": "25.48% 25.48% 25.48%"}, "model_tokens": {"rwkv": [[3641, " As", "normal", 0.013478651642799377]], "qwen": [[1634, " As", "normal", 0.014417086727917194]]}, "loss": {"rwkv": 25.92342651597356, "qwen": 25.483652545829788}, "topk": {"rwkv": [3641, 10, 0.013478651642799377, [[3918, 0.183529, " It", false], [20996, 0.158965, " The", false], [3913, 0.041122, " In", false], [3908, 0.037581, " If", false], [37451, 0.02967, " There", false], [30032, 0.025331, " When", false], [4331, 0.022433, " We", false], [300, 0.014315, " A", false], [63222, 0.013839, " Researchers", false], [3641, 0.013479, " As", false]]], "qwen": [1634, 10, 0.014417086727917194, [[1084, 0.165845, " It", false], [576, 0.106745, " The", false], [758, 0.058878, " In", false], [1416, 0.035811, " If", false], [2619, 0.029166, " There", false], [1205, 0.024241, " We", false], [3197, 0.022053, " When", false], [58150, 0.018399, " Researchers", false], [11097, 0.01658, " Human", false], [1634, 0.014417, " As", false]]]}, "raw_delta": 0.024386246999104744, "tuned_delta": 0.031723385512807484}, {"byte_start": 4810, "byte_end": 4812, "display": {"text": " a", "kind": "normal"}, "is_word": true, "word_id": 804, "word_key": " a", "bytes_hex": "20 61", "compression": {"rwkv": "22.12% 22.12%", "qwen": "25.17% 25.17%"}, "model_tokens": {"rwkv": [[332, " a", "normal", 0.08656177669763565]], "qwen": [[264, " a", "normal", 0.06133865565061569]]}, "loss": {"rwkv": 22.11944545112961, "qwen": 25.169123507988093}, "topk": {"rwkv": [332, 1, 0.08656177669763565, [[332, 0.086562, " a", false], [22590, 0.072838, " the", false], [3609, 0.072246, " AI", false], [31323, 0.070802, " long", false], [4858, 0.054491, " we", false], [308, 0.033668, " I", false], [4596, 0.033306, " in", false], [63843, 0.025308, " researchers", false], [32487, 0.021755, " with", false], [21660, 0.020132, " far", false]]], "qwen": [264, 3, 0.06133865565061569, [[20219, 0.109935, " Moore", false], [304, 0.062056, " in", false], [264, 0.061339, " a", false], [279, 0.060003, " the", false], [582, 0.052603, " we", false], [1293, 0.04475, " long", false], [358, 0.031471, " I", false], [448, 0.024315, " with", false], [15235, 0.023857, " AI", false], [11811, 0.020073, " researchers", false]]]}, "raw_delta": -0.16911005973815918, "tuned_delta": -0.16177292122445644}, {"byte_start": 4812, "byte_end": 4818, "display": {"text": " field", "kind": "normal"}, "is_word": true, "word_id": 805, "word_key": " field", "bytes_hex": "20 66 69 65 6c 64", "compression": {"rwkv": "13.06% 13.06% 13.06% 13.06% 13.06% 13.06%", "qwen": "9.42% 9.42% 9.42% 9.42% 9.42% 9.42%"}, "model_tokens": {"rwkv": [[38478, " field", "normal", 0.013176703825592995]], "qwen": [[2070, " field", "normal", 0.043501608073711395]]}, "loss": {"rwkv": 13.055638716377988, "qwen": 9.422473686748498}, "topk": {"rwkv": [38478, 12, 0.013176703825592995, [[51832, 0.22231, " general", false], [47092, 0.071139, " result", false], [62496, 0.055206, " researcher", false], [31907, 0.03513, " rule", false], [46530, 0.033079, " matter", false], [21458, 0.022386, " cor", false], [60212, 0.021507, " practical", false], [52942, 0.020524, " society", false], [57103, 0.018925, " research", false], [63388, 0.014534, " consequence", false]]], "qwen": [2070, 5, 0.043501608073711395, [[1102, 0.13028, " result", false], [4586, 0.081515, " general", false], [5912, 0.055403, " rule", false], [28674, 0.047317, " consequence", false], [2070, 0.043502, " field", false], [31085, 0.04242, " researcher", false], [1829, 0.032466, " cor", false], [6366, 0.02916, " computer", false], [3108, 0.020903, " side", false], [14976, 0.020808, " practical", false]]]}, "raw_delta": 0.2014654477437338, "tuned_delta": 0.20880258625743653}, {"byte_start": 4818, "byte_end": 4819, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "9.51%", "qwen": "4.97%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.5906977653503418]], "qwen": [[11, ",", "normal", 0.7591410279273987]]}, "loss": {"rwkv": 9.509952662109866, "qwen": 4.969501577837577}, "topk": {"rwkv": [45, 1, 0.5906977653503418, [[45, 0.590698, ",", false], [4706, 0.125174, " of", false], [4858, 0.052579, " we", false], [46531, 0.032355, " mature", false], [38642, 0.030502, " grows", false], [32227, 0.021599, " that", false], [55981, 0.016008, " develops", false], [39072, 0.011669, " moves", false], [62394, 0.010946, " progresses", false], [55465, 0.005835, " advances", false]]], "qwen": [11, 1, 0.7591410279273987, [[11, 0.759141, ",", false], [315, 0.071774, " of", false], [88626, 0.035103, " matures", false], [429, 0.014541, " that", false], [582, 0.013315, " we", false], [27715, 0.009727, " grows", false], [702, 0.005493, " has", false], [91954, 0.005326, " evolves", false], [432, 0.004382, " it", false], [9044, 0.003944, " becomes", false]]]}, "raw_delta": 0.2517760694026947, "tuned_delta": 0.2591132079163974}, {"byte_start": 4819, "byte_end": 4822, "display": {"text": " we", "kind": "normal"}, "is_word": true, "word_id": 806, "word_key": " we", "bytes_hex": "20 77 65", "compression": {"rwkv": "7.65% 7.65% 7.65%", "qwen": "11.50% 11.50% 11.50%"}, "model_tokens": {"rwkv": [[4858, " we", "normal", 0.2786005139350891]], "qwen": [[582, " we", "normal", 0.14750812947750092]]}, "loss": {"rwkv": 7.654924858883497, "qwen": 11.504723535106052}, "topk": {"rwkv": [4858, 2, 0.2786005139350891, [[3609, 0.380155, " AI", false], [4858, 0.278601, " we", false], [55809, 0.109435, " computer", false], [4601, 0.039931, " it", false], [61594, 0.021039, " artificial", false], [22590, 0.020418, " the", false], [52167, 0.017241, " machine", false], [22248, 0.009357, " our", false], [21265, 0.008529, " and", false], [39934, 0.006458, " there", false]]], "qwen": [582, 2, 0.14750812947750092, [[15235, 0.45968, " AI", false], [582, 0.147508, " we", false], [6366, 0.123506, " computer", false], [279, 0.039406, " the", false], [5662, 0.032863, " machine", false], [432, 0.026634, " it", false], [20443, 0.018288, " artificial", false], [11129, 0.007375, " vision", false], [5538, 0.006872, " deep", false], [323, 0.006621, " and", false]]]}, "raw_delta": -0.21347816785176596, "tuned_delta": -0.20614102933806322}, {"byte_start": 4822, "byte_end": 4828, "display": {"text": " still", "kind": "normal"}, "is_word": true, "word_id": 807, "word_key": " still", "bytes_hex": "20 73 74 69 6c 6c", "compression": {"rwkv": "17.47% 17.47% 17.47% 17.47% 17.47% 17.47%", "qwen": "16.40% 16.40% 16.40% 16.40% 16.40% 16.40%"}, "model_tokens": {"rwkv": [[39820, " still", "normal", 0.0030168043449521065]], "qwen": [[2058, " still", "normal", 0.00426615821197629]]}, "loss": {"rwkv": 17.47013526076479, "qwen": 16.40176470171745}, "topk": {"rwkv": [39820, 28, 0.0030168043449521065, [[31059, 0.23295, " have", false], [31506, 0.166021, " need", false], [47266, 0.161248, " should", false], [21286, 0.09285, " are", false], [31475, 0.042236, " must", false], [21413, 0.027307, " can", false], [32216, 0.022985, " tend", false], [4491, 0.014091, " do", false], [39196, 0.010811, " ought", false], [5231, 0.00911, "'ve", false]]], "qwen": [2058, 25, 0.00426615821197629, [[614, 0.341647, " have", false], [1184, 0.100251, " need", false], [525, 0.09699, " are", false], [1265, 0.090401, " should", false], [1969, 0.046019, " must", false], [646, 0.017051, " can", false], [3003, 0.014424, "'ve", false], [1033, 0.014299, " were", false], [8376, 0.013918, " tend", false], [1431, 0.012259, " now", false]]]}, "raw_delta": 0.05924304326375329, "tuned_delta": 0.06658018177745603}, {"byte_start": 4828, "byte_end": 4833, "display": {"text": " have", "kind": "normal"}, "is_word": true, "word_id": 808, "word_key": " have", "bytes_hex": "20 68 61 76 65", "compression": {"rwkv": "4.79% 4.79% 4.79% 4.79% 4.79%", "qwen": "3.75% 3.75% 3.75% 3.75% 3.75%"}, "model_tokens": {"rwkv": [[31059, " have", "normal", 0.26425880193710327]], "qwen": [[614, " have", "normal", 0.35401177406311035]]}, "loss": {"rwkv": 4.7901983779516355, "qwen": 3.745326811723812}, "topk": {"rwkv": [31059, 1, 0.26425880193710327, [[31059, 0.264259, " have", false], [32216, 0.087031, " tend", false], [31506, 0.059979, " need", false], [4491, 0.045321, " do", false], [39942, 0.029483, " think", false], [31967, 0.021492, " seem", false], [57328, 0.020021, " struggle", false], [39761, 0.018796, " spend", false], [39171, 0.014437, " often", false], [38054, 0.01403, " cling", false]]], "qwen": [614, 1, 0.35401177406311035, [[614, 0.354012, " have", false], [1184, 0.089251, " need", false], [653, 0.062919, " do", false], [8376, 0.039788, " tend", false], [1744, 0.02565, " think", false], [4411, 0.025608, " believe", false], [2803, 0.02214, " seem", false], [1513, 0.015161, " don", false], [8990, 0.014136, " haven", false], [1430, 0.012707, " try", false]]]}, "raw_delta": 0.057939982414245604, "tuned_delta": 0.06527712092794834}, {"byte_start": 4833, "byte_end": 4837, "display": {"text": " not", "kind": "normal"}, "is_word": true, "word_id": 809, "word_key": " not", "bytes_hex": "20 6e 6f 74", "compression": {"rwkv": "8.49% 8.49% 8.49% 8.49%", "qwen": "11.42% 11.42% 11.42% 11.42%"}, "model_tokens": {"rwkv": [[22187, " not", "normal", 0.15509766340255737]], "qwen": [[537, " not", "normal", 0.07942873239517212]]}, "loss": {"rwkv": 8.488513302105472, "qwen": 11.419359946350298}, "topk": {"rwkv": [22187, 2, 0.15509766340255737, [[332, 0.319166, " a", false], [22187, 0.155098, " not", false], [31466, 0.082523, " much", false], [4811, 0.067771, " to", false], [31370, 0.051793, " many", false], [32074, 0.038341, " some", false], [22590, 0.02952, " the", false], [4419, 0.017555, " an", false], [22614, 0.012038, " too", false], [31335, 0.011072, " lots", false]]], "qwen": [537, 3, 0.07942873239517212, [[264, 0.426092, " a", false], [1753, 0.093368, " much", false], [537, 0.079429, " not", false], [311, 0.049156, " to", false], [1657, 0.03934, " many", false], [1045, 0.03253, " some", false], [458, 0.023293, " an", false], [279, 0.021844, " the", false], [2238, 0.01847, " too", false], [975, 0.009718, " work", false]]]}, "raw_delta": -0.1625206470489502, "tuned_delta": -0.15518350853524746}, {"byte_start": 4837, "byte_end": 4848, "display": {"text": " thoroughly", "kind": "normal"}, "is_word": true, "word_id": 810, "word_key": " thoroughly", "bytes_hex": "20 74 68 6f 72 6f 75 67 68 6c 79", "compression": {"rwkv": "11.32% 11.32% 11.32% 11.32% 11.32% 11.32% 11.32% 11.32% 11.32% 11.32% 11.32%", "qwen": "11.96% 11.96% 11.96% 11.96% 11.96% 11.96% 11.96% 11.96% 11.96% 11.96% 11.96%"}, "model_tokens": {"rwkv": [[62646, " thoroughly", "normal", 0.0009956888388842344]], "qwen": [[26364, " thoroughly", "normal", 0.0006773083587177098]]}, "loss": {"rwkv": 11.322287075158412, "qwen": 11.963522043682426}, "topk": {"rwkv": [62646, 80, 0.0009956888388842344, [[38566, 0.236948, " fully", false], [52112, 0.194135, " learned", false], [22797, 0.037408, " yet", false], [56098, 0.033574, " embraced", false], [39423, 0.028742, " quite", false], [56480, 0.024553, " internal", false], [30482, 0.023188, " come", false], [46112, 0.021099, " gotten", false], [46526, 0.01832, " master", false], [31351, 0.018203, " made", false]]], "qwen": [26364, 96, 0.0006773083587177098, [[9498, 0.296307, " learned", false], [7225, 0.056839, " fully", false], [3602, 0.054157, " yet", false], [17019, 0.035025, " gotten", false], [2167, 0.029621, " really", false], [24692, 0.027863, " figured", false], [2525, 0.026812, " come", false], [5008, 0.024497, " quite", false], [70225, 0.022509, " mastered", false], [42503, 0.020379, " embraced", false]]]}, "raw_delta": -0.03555761684070935, "tuned_delta": -0.028220478327006613}, {"byte_start": 4848, "byte_end": 4856, "display": {"text": " learned", "kind": "normal"}, "is_word": true, "word_id": 811, "word_key": " learned", "bytes_hex": "20 6c 65 61 72 6e 65 64", "compression": {"rwkv": "4.61% 4.61% 4.61% 4.61% 4.61% 4.61% 4.61% 4.61%", "qwen": "3.39% 3.39% 3.39% 3.39% 3.39% 3.39% 3.39% 3.39%"}, "model_tokens": {"rwkv": [[52112, " learned", "normal", 0.1295609474182129]], "qwen": [[9498, " learned", "normal", 0.22197359800338745]]}, "loss": {"rwkv": 4.61408814346812, "qwen": 3.393031207836185}, "topk": {"rwkv": [52112, 3, 0.1295609474182129, [[56480, 0.179516, " internal", false], [56098, 0.133741, " embraced", false], [52112, 0.129561, " learned", false], [62684, 0.074953, " understood", false], [55423, 0.063622, " absorbed", false], [45746, 0.033065, " digest", false], [37761, 0.031603, " assim", false], [38625, 0.028013, " grasp", false], [62141, 0.026715, " integrated", false], [63289, 0.018744, " appreciated", false]]], "qwen": [9498, 1, 0.22197359800338745, [[9498, 0.221974, " learned", false], [42503, 0.174885, " embraced", false], [5306, 0.10591, " internal", false], [15985, 0.089439, " understood", false], [70225, 0.066635, " mastered", false], [41001, 0.047362, " absorbed", false], [48987, 0.040584, " gras", false], [35031, 0.013365, " explored", false], [24692, 0.012867, " figured", false], [11666, 0.010591, " accepted", false]]]}, "raw_delta": 0.0677097737789154, "tuned_delta": 0.07504691229261815}, {"byte_start": 4856, "byte_end": 4859, "display": {"text": " it", "kind": "normal"}, "is_word": true, "word_id": 812, "word_key": " it", "bytes_hex": "20 69 74", "compression": {"rwkv": "2.32% 2.32% 2.32%", "qwen": "5.48% 5.48% 5.48%"}, "model_tokens": {"rwkv": [[4601, " it", "normal", 0.677315890789032]], "qwen": [[432, " it", "normal", 0.4015727937221527]]}, "loss": {"rwkv": 2.3246550951824116, "qwen": 5.484444327661428}, "topk": {"rwkv": [4601, 1, 0.677315890789032, [[4601, 0.677316, " it", false], [32234, 0.127661, " this", false], [22590, 0.048948, " the", false], [32227, 0.030953, " that", false], [4811, 0.02485, " to", false], [30917, 0.02267, " from", false], [21835, 0.016222, " how", false], [32464, 0.010287, " what", false], [21265, 0.007678, " and", false], [21256, 0.005091, " all", false]]], "qwen": [432, 1, 0.4015727937221527, [[432, 0.401573, " it", false], [1246, 0.116987, " how", false], [279, 0.11032, " the", false], [419, 0.089393, " this", false], [504, 0.053228, " from", false], [429, 0.047667, " that", false], [311, 0.042615, " to", false], [1128, 0.022051, " what", false], [911, 0.019256, " about", false], [1039, 0.015275, " our", false]]]}, "raw_delta": -0.17521591981252035, "tuned_delta": -0.16787878129881761}, {"byte_start": 4859, "byte_end": 4860, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "26.35%", "qwen": "22.17%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.234673410654068]], "qwen": [[11, ",", "normal", 0.2925507724285126]]}, "loss": {"rwkv": 26.346091078734, "qwen": 22.16551530372949}, "topk": {"rwkv": [45, 2, 0.234673410654068, [[47, 0.671303, ".", false], [45, 0.234673, ",", false], [21265, 0.017176, " and", false], [22797, 0.015439, " yet", false], [5346, 0.012264, "---", false], [60, 0.005795, ";", false], [4715, 0.005395, " or", false], [59, 0.005108, ":", false], [275, 0.004428, " (", false], [4596, 0.004321, " in", false]]], "qwen": [11, 2, 0.2925507724285126, [[13, 0.547799, ".", false], [11, 0.292551, ",", false], [382, 0.042821, ".\n\n", false], [323, 0.01752, " and", false], [3602, 0.014398, " yet", false], [624, 0.0134, ".\n", false], [4421, 0.011376, "---", false], [25, 0.011239, ":", false], [26, 0.00771, ";", false], [320, 0.005204, " (", false]]]}, "raw_delta": 0.23182034492492676, "tuned_delta": 0.2391574834386295}, {"byte_start": 4860, "byte_end": 4863, "display": {"text": " as", "kind": "normal"}, "is_word": true, "word_id": 813, "word_key": " as", "bytes_hex": "20 61 73", "compression": {"rwkv": "25.74% 25.74% 25.74%", "qwen": "26.90% 26.90% 26.90%"}, "model_tokens": {"rwkv": [[4423, " as", "normal", 0.013639004901051521]], "qwen": [[438, " as", "normal", 0.011395213194191456]]}, "loss": {"rwkv": 25.73557559919114, "qwen": 26.89761650903091}, "topk": {"rwkv": [4423, 9, 0.013639004901051521, [[21400, 0.354138, " but", false], [21265, 0.327752, " and", false], [55495, 0.045524, " although", false], [4715, 0.037441, " or", false], [30788, 0.021989, " even", false], [51018, 0.020665, " because", false], [47544, 0.015749, " though", false], [22185, 0.015352, " nor", false], [4423, 0.013639, " as", false], [51450, 0.013533, " despite", false]]], "qwen": [438, 11, 0.011395213194191456, [[323, 0.414459, " and", false], [714, 0.295449, " but", false], [7892, 0.052773, " although", false], [476, 0.032967, " or", false], [6329, 0.023723, " nor", false], [1496, 0.020777, " even", false], [3498, 0.014762, " though", false], [8818, 0.01382, " despite", false], [1576, 0.012854, " because", false], [773, 0.012796, " so", false]]]}, "raw_delta": -0.06443723042806004, "tuned_delta": -0.057100091914357304}, {"byte_start": 4863, "byte_end": 4866, "display": {"text": " we", "kind": "normal"}, "is_word": true, "word_id": 814, "word_key": " we", "bytes_hex": "20 77 65", "compression": {"rwkv": "11.98% 11.98% 11.98%", "qwen": "8.57% 8.57% 8.57%"}, "model_tokens": {"rwkv": [[4858, " we", "normal", 0.13870051503181458]], "qwen": [[582, " we", "normal", 0.24048909544944763]]}, "loss": {"rwkv": 11.97549594487909, "qwen": 8.566485936440397}, "topk": {"rwkv": [4858, 2, 0.13870051503181458, [[4601, 0.153214, " it", false], [4858, 0.138701, " we", false], [59655, 0.108903, " evidenced", false], [39934, 0.049631, " there", false], [332, 0.049428, " a", false], [22590, 0.040278, " the", false], [4600, 0.030862, " is", false], [31370, 0.025904, " many", false], [3609, 0.019452, " AI", false], [31466, 0.016128, " much", false]]], "qwen": [582, 1, 0.24048909544944763, [[582, 0.240489, " we", false], [68357, 0.109104, " evidenced", false], [1052, 0.062233, " there", false], [279, 0.055876, " the", false], [432, 0.052813, " it", false], [264, 0.03345, " a", false], [1657, 0.022085, " many", false], [3602, 0.020279, " yet", false], [374, 0.018945, " is", false], [1039, 0.01833, " our", false]]]}, "raw_delta": 0.18903565406799316, "tuned_delta": 0.1963727925816959}, {"byte_start": 4866, "byte_end": 4870, "display": {"text": " are", "kind": "normal"}, "is_word": true, "word_id": 815, "word_key": " are", "bytes_hex": "20 61 72 65", "compression": {"rwkv": "11.91% 11.91% 11.91% 11.91%", "qwen": "12.75% 12.75% 12.75% 12.75%"}, "model_tokens": {"rwkv": [[21286, " are", "normal", 0.0700310617685318]], "qwen": [[525, " are", "normal", 0.05910564213991165]]}, "loss": {"rwkv": 11.905051851085684, "qwen": 12.751750388464055}, "topk": {"rwkv": [21286, 4, 0.0700310617685318, [[31059, 0.248931, " have", false], [39820, 0.09733, " still", false], [47266, 0.084461, " should", false], [21286, 0.070031, " are", false], [55851, 0.039031, " continue", false], [22449, 0.023473, " see", false], [21413, 0.021868, " can", false], [21532, 0.020472, " did", false], [32475, 0.017965, " will", false], [31967, 0.016802, " seem", false]]], "qwen": [525, 3, 0.05910564213991165, [[614, 0.339705, " have", false], [2058, 0.161847, " still", false], [525, 0.059106, " are", false], [3060, 0.03749, " continue", false], [1521, 0.033827, " did", false], [1265, 0.032813, " should", false], [686, 0.015527, " will", false], [653, 0.014244, " do", false], [1033, 0.010461, " were", false], [1030, 0.009776, " had", false]]]}, "raw_delta": -0.04695093631744385, "tuned_delta": -0.03961379780374111}, {"byte_start": 4870, "byte_end": 4881, "display": {"text": " continuing", "kind": "normal"}, "is_word": true, "word_id": 816, "word_key": " continuing", "bytes_hex": "20 63 6f 6e 74 69 6e 75 69 6e 67", "compression": {"rwkv": "8.81% 8.81% 8.81% 8.81% 8.81% 8.81% 8.81% 8.81% 8.81% 8.81% 8.81%", "qwen": "8.10% 8.10% 8.10% 8.10% 8.10% 8.10% 8.10% 8.10% 8.10% 8.10% 8.10%"}, "model_tokens": {"rwkv": [[61774, " continuing", "normal", 0.004558044485747814]], "qwen": [[14354, " continuing", "normal", 0.007154079619795084]]}, "loss": {"rwkv": 8.811915732702476, "qwen": 8.098884261357814}, "topk": {"rwkv": [61774, 16, 0.004558044485747814, [[39820, 0.602885, " still", false], [21256, 0.025086, " all", false], [22187, 0.02216, " not", false], [4788, 0.01717, " so", false], [4596, 0.015944, " in", false], [39364, 0.01348, " prone", false], [22614, 0.013024, " too", false], [22190, 0.012886, " now", false], [45150, 0.009485, " always", false], [61760, 0.009481, " constantly", false]]], "qwen": [14354, 20, 0.007154079619795084, [[2058, 0.387489, " still", false], [537, 0.032653, " not", false], [304, 0.030534, " in", false], [1431, 0.029945, " now", false], [1172, 0.025649, " only", false], [3545, 0.024299, " often", false], [1101, 0.019831, " just", false], [2238, 0.019285, " too", false], [6301, 0.01608, " slow", false], [3602, 0.013849, " yet", false]]]}, "raw_delta": 0.03953886032104492, "tuned_delta": 0.04687599883474766}, {"byte_start": 4881, "byte_end": 4884, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 817, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "0.48% 0.48% 0.48%", "qwen": "0.67% 0.67% 0.67%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.9239760041236877]], "qwen": [[311, " to", "normal", 0.8951485753059387]]}, "loss": {"rwkv": 0.47549763310549326, "qwen": 0.6658374165262169}, "topk": {"rwkv": [4811, 1, 0.9239760041236877, [[4811, 0.923976, " to", false], [45, 0.012376, ",", false], [22590, 0.011565, " the", false], [4596, 0.006194, " in", false], [22248, 0.005699, " our", false], [32487, 0.005426, " with", false], [332, 0.004097, " a", false], [4712, 0.002737, " on", false], [51566, 0.002228, " efforts", false], [275, 0.001635, " (", false]]], "qwen": [311, 1, 0.8951485753059387, [[311, 0.895149, " to", false], [448, 0.020321, " with", false], [1039, 0.013346, " our", false], [1495, 0.010645, " down", false], [304, 0.009115, " in", false], [389, 0.006475, " on", false], [279, 0.005177, " the", false], [11, 0.003922, ",", false], [3412, 0.003907, " research", false], [264, 0.002929, " a", false]]]}, "raw_delta": -0.010554678738117218, "tuned_delta": -0.0032175402244144814}, {"byte_start": 4884, "byte_end": 4889, "display": {"text": " make", "kind": "normal"}, "is_word": true, "word_id": 818, "word_key": " make", "bytes_hex": "20 6d 61 6b 65", "compression": {"rwkv": "13.02% 13.02% 13.02% 13.02% 13.02%", "qwen": "9.57% 9.57% 9.57% 9.57% 9.57%"}, "model_tokens": {"rwkv": [[31358, " make", "normal", 0.0270343329757452]], "qwen": [[1281, " make", "normal", 0.07037892192602158]]}, "loss": {"rwkv": 13.018068533021506, "qwen": 9.5717812850083}, "topk": {"rwkv": [31358, 6, 0.0270343329757452, [[46330, 0.085807, " invest", false], [22626, 0.055761, " try", false], [46960, 0.039613, " pursue", false], [22339, 0.031029, " put", false], [39761, 0.027857, " spend", false], [31358, 0.027034, " make", false], [40166, 0.025084, " waste", false], [4435, 0.021336, " be", false], [38530, 0.020374, " focus", false], [4491, 0.019953, " do", false]]], "qwen": [1281, 3, 0.07037892192602158, [[22729, 0.090621, " pursue", false], [1430, 0.080991, " try", false], [1281, 0.070379, " make", false], [2725, 0.056145, " invest", false], [8329, 0.031418, " spend", false], [387, 0.031217, " be", false], [12291, 0.02088, " waste", false], [2225, 0.020268, " develop", false], [990, 0.020147, " use", false], [653, 0.019984, " do", false]]]}, "raw_delta": 0.1911027431488037, "tuned_delta": 0.19843988166250645}, {"byte_start": 4889, "byte_end": 4893, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 819, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "11.62% 11.62% 11.62% 11.62%", "qwen": "11.47% 11.47% 11.47% 11.47%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.07610104233026505]], "qwen": [[279, " the", "normal", 0.07849346101284027]]}, "loss": {"rwkv": 11.623275475912058, "qwen": 11.472761634334766}, "topk": {"rwkv": [22590, 2, 0.07610104233026505, [[51566, 0.082087, " efforts", false], [22590, 0.076101, " the", false], [56950, 0.058132, " progress", false], [52224, 0.057749, " methods", false], [56652, 0.034247, " mistakes", false], [57103, 0.027605, " research", false], [22681, 0.024852, " use", false], [332, 0.021168, " a", false], [63678, 0.018611, " investments", false], [38720, 0.017191, " human", false]]], "qwen": [279, 3, 0.07849346101284027, [[5098, 0.106727, " progress", false], [20643, 0.085339, " mistakes", false], [279, 0.078493, " the", false], [2244, 0.032022, " great", false], [8869, 0.02644, " efforts", false], [5413, 0.024356, " methods", false], [264, 0.020544, " a", false], [5089, 0.018895, " significant", false], [1657, 0.018697, " many", false], [2989, 0.015426, " important", false]]]}, "raw_delta": 0.008346259593963623, "tuned_delta": 0.01568339810766636}, {"byte_start": 4893, "byte_end": 4898, "display": {"text": " same", "kind": "normal"}, "is_word": true, "word_id": 820, "word_key": " same", "bytes_hex": "20 73 61 6d 65", "compression": {"rwkv": "3.45% 3.45% 3.45% 3.45% 3.45%", "qwen": "3.22% 3.22% 3.22% 3.22% 3.22%"}, "model_tokens": {"rwkv": [[31937, " same", "normal", 0.38624903559684753]], "qwen": [[1852, " same", "normal", 0.40971702337265015]]}, "loss": {"rwkv": 3.451760595876914, "qwen": 3.218250506732995}, "topk": {"rwkv": [31937, 1, 0.38624903559684753, [[31937, 0.386249, " same", false], [52245, 0.230787, " mistake", false], [56652, 0.050547, " mistakes", false], [38720, 0.02366, " human", false], [22221, 0.013462, " old", false], [62660, 0.011953, " transition", false], [45315, 0.011876, " bitter", false], [45829, 0.01138, " effort", false], [38392, 0.011158, " error", false], [45597, 0.008004, " costly", false]]], "qwen": [1852, 1, 0.40971702337265015, [[1852, 0.409717, " same", false], [16523, 0.186574, " mistake", false], [20643, 0.049671, " mistakes", false], [3738, 0.044813, " human", false], [4969, 0.020748, " wrong", false], [1465, 0.012287, " error", false], [2310, 0.011683, " old", false], [1429, 0.011365, " most", false], [9142, 0.009277, " transition", false], [1850, 0.008689, " best", false]]]}, "raw_delta": 0.01294854879379273, "tuned_delta": 0.020285687307495467}, {"byte_start": 4898, "byte_end": 4903, "display": {"text": " kind", "kind": "normal"}, "is_word": true, "word_id": 821, "word_key": " kind", "bytes_hex": "20 6b 69 6e 64", "compression": {"rwkv": "18.94% 18.94% 18.94% 18.94% 18.94%", "qwen": "18.33% 18.33% 18.33% 18.33% 18.33%"}, "model_tokens": {"rwkv": [[31214, " kind", "normal", 0.005167159251868725]], "qwen": [[3093, " kind", "normal", 0.006207973230630159]]}, "loss": {"rwkv": 18.935372411667643, "qwen": 18.329154205294348}, "topk": {"rwkv": [31214, 6, 0.005167159251868725, [[56652, 0.734502, " mistakes", false], [52245, 0.13136, " mistake", false], [38841, 0.014189, " kinds", false], [45888, 0.013428, " errors", false], [22221, 0.007576, " old", false], [31214, 0.005167, " kind", false], [39745, 0.004648, " sorts", false], [38392, 0.004572, " error", false], [21325, 0.004458, " bad", false], [37812, 0.004414, " basic", false]]], "qwen": [3093, 10, 0.006207973230630159, [[20643, 0.750139, " mistakes", false], [5975, 0.035275, " errors", false], [12829, 0.023533, " kinds", false], [16523, 0.016307, " mistake", false], [2310, 0.010712, " old", false], [20853, 0.010077, " sorts", false], [4124, 0.008521, " early", false], [3738, 0.008324, " human", false], [2856, 0.008138, " initial", false], [3093, 0.006208, " kind", false]]]}, "raw_delta": 0.03361587524414067, "tuned_delta": 0.04095301375784341}, {"byte_start": 4903, "byte_end": 4906, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 822, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "0.03% 0.03% 0.03%", "qwen": "0.01% 0.01% 0.01%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.9947977066040039]], "qwen": [[315, " of", "normal", 0.9986101388931274]]}, "loss": {"rwkv": 0.031186187356455963, "qwen": 0.008360422639164542}, "topk": {"rwkv": [4706, 1, 0.9947977066040039, [[4706, 0.994798, " of", false], [56652, 0.002573, " mistakes", false], [45888, 0.000566, " errors", false], [46, 0.000324, "-", false], [45, 0.000165, ",", false], [275, 0.000103, " (", false], [21265, 0.0001, " and", false], [51566, 8.8e-05, " efforts", false], [4715, 8.1e-05, " or", false], [52245, 7.1e-05, " mistake", false]]], "qwen": [315, 1, 0.9986101388931274, [[315, 0.99861, " of", false], [323, 0.000309, " and", false], [20643, 0.000172, " mistakes", false], [476, 0.000135, " or", false], [320, 0.000128, " (", false], [11, 0.000117, ",", false], [5975, 7.1e-05, " errors", false], [8869, 3.4e-05, " efforts", false], [220, 2.5e-05, " ", false], [198, 2.4e-05, "\n", false]]]}, "raw_delta": 0.001265729156633218, "tuned_delta": 0.008602867670335955}, {"byte_start": 4906, "byte_end": 4915, "display": {"text": " mistakes", "kind": "normal"}, "is_word": true, "word_id": 823, "word_key": " mistakes", "bytes_hex": "20 6d 69 73 74 61 6b 65 73", "compression": {"rwkv": "1.17% 1.17% 1.17% 1.17% 1.17% 1.17% 1.17% 1.17% 1.17%", "qwen": "1.49% 1.49% 1.49% 1.49% 1.49% 1.49% 1.49% 1.49% 1.49%"}, "model_tokens": {"rwkv": [[56652, " mistakes", "normal", 0.5563517212867737]], "qwen": [[20643, " mistakes", "normal", 0.4746242165565491]]}, "loss": {"rwkv": 1.1662411083575062, "qwen": 1.4932533397067185}, "topk": {"rwkv": [56652, 1, 0.5563517212867737, [[56652, 0.556352, " mistakes", false], [52245, 0.06039, " mistake", false], [57103, 0.024885, " research", false], [45888, 0.023903, " errors", false], [51566, 0.021613, " efforts", false], [45829, 0.020253, " effort", false], [63678, 0.017723, " investments", false], [52224, 0.017154, " methods", false], [38392, 0.011943, " error", false], [62157, 0.011459, " investment", false]]], "qwen": [20643, 1, 0.4746242165565491, [[20643, 0.474624, " mistakes", false], [16523, 0.065973, " mistake", false], [5975, 0.056037, " errors", false], [3738, 0.039857, " human", false], [4124, 0.029794, " early", false], [1465, 0.026912, " error", false], [9162, 0.021732, " investment", false], [21786, 0.017071, " investments", false], [5098, 0.014993, " progress", false], [2856, 0.01144, " initial", false]]]}, "raw_delta": -0.01813340849346584, "tuned_delta": -0.010796269979763105}, {"byte_start": 4915, "byte_end": 4916, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "32.69%", "qwen": "28.04%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.1626049280166626]], "qwen": [[13, ".", "normal", 0.21126553416252136]]}, "loss": {"rwkv": 32.686059520140574, "qwen": 28.03588296717203}, "topk": {"rwkv": [47, 3, 0.1626049280166626, [[4596, 0.199967, " in", false], [31601, 0.166794, " over", false], [47, 0.162605, ".", false], [32227, 0.104893, " that", false], [45, 0.086867, ",", false], [4423, 0.045163, " as", false], [37635, 0.029134, " again", false], [4858, 0.028167, " we", false], [32487, 0.021361, " with", false], [62482, 0.012338, " repeatedly", false]]], "qwen": [13, 1, 0.21126553416252136, [[13, 0.211266, ".", false], [916, 0.195751, " over", false], [11, 0.095069, ",", false], [429, 0.074492, " that", false], [304, 0.072692, " in", false], [438, 0.048917, " as", false], [4421, 0.042336, "---", false], [582, 0.035252, " we", false], [1549, 0.028672, " again", false], [323, 0.021516, " and", false]]]}, "raw_delta": 0.25786054134368896, "tuned_delta": 0.2651976798573917}, {"byte_start": 4916, "byte_end": 4919, "display": {"text": " To", "kind": "normal"}, "is_word": true, "word_id": 824, "word_key": " to", "bytes_hex": "20 54 6f", "compression": {"rwkv": "31.00% 31.00% 31.00%", "qwen": "28.46% 28.46% 28.46%"}, "model_tokens": {"rwkv": [[4255, " To", "normal", 0.005856001283973455]], "qwen": [[2014, " To", "normal", 0.008780253119766712]]}, "loss": {"rwkv": 30.99540126909882, "qwen": 28.464673695275074}, "topk": {"rwkv": [4255, 27, 0.005856001283973455, [[4331, 0.127753, " We", false], [20996, 0.089293, " The", false], [261, 0.073154, "\n\n", false], [19555, 0.06108, " But", false], [3913, 0.054125, " In", false], [3918, 0.045495, " It", false], [37451, 0.044387, " There", false], [29894, 0.023144, " This", false], [19907, 0.020668, " For", false], [19417, 0.020113, " And", false]]], "qwen": [2014, 18, 0.008780253119766712, [[1205, 0.111953, " We", false], [1988, 0.093285, " But", false], [576, 0.089017, " The", false], [1084, 0.063892, " It", false], [758, 0.048323, " In", false], [2619, 0.039947, " There", false], [1096, 0.032974, " This", false], [1597, 0.031907, " And", false], [358, 0.026578, " I", false], [1752, 0.022181, " For", false]]]}, "raw_delta": 0.14033333460489916, "tuned_delta": 0.1476704731186019}, {"byte_start": 4919, "byte_end": 4923, "display": {"text": " see", "kind": "normal"}, "is_word": true, "word_id": 825, "word_key": " see", "bytes_hex": "20 73 65 65", "compression": {"rwkv": "17.68% 17.68% 17.68% 17.68%", "qwen": "19.52% 19.52% 19.52% 19.52%"}, "model_tokens": {"rwkv": [[22449, " see", "normal", 0.01999257318675518]], "qwen": [[1490, " see", "normal", 0.013163922354578972]]}, "loss": {"rwkv": 17.681467542145008, "qwen": 19.522709502715966}, "topk": {"rwkv": [22449, 14, 0.01999257318675518, [[4435, 0.098472, " be", false], [31358, 0.061808, " make", false], [22590, 0.043571, " the", false], [32187, 0.04145, " take", false], [21751, 0.029618, " get", false], [4491, 0.028056, " do", false], [32074, 0.027429, " some", false], [37786, 0.027001, " avoid", false], [39232, 0.024763, " parap", false], [38877, 0.023829, " learn", false]]], "qwen": [1490, 17, 0.013163922354578972, [[387, 0.110351, " be", false], [3960, 0.067301, " learn", false], [5648, 0.063263, " avoid", false], [1281, 0.062849, " make", false], [3535, 0.030926, " understand", false], [653, 0.02404, " do", false], [279, 0.02172, " the", false], [633, 0.021199, " get", false], [1896, 0.020937, " take", false], [13153, 0.020529, " repeat", false]]]}, "raw_delta": -0.10210013389587402, "tuned_delta": -0.09476299538217128}, {"byte_start": 4923, "byte_end": 4928, "display": {"text": " this", "kind": "normal"}, "is_word": true, "word_id": 826, "word_key": " this", "bytes_hex": "20 74 68 69 73", "compression": {"rwkv": "7.83% 7.83% 7.83% 7.83% 7.83%", "qwen": "6.74% 6.74% 6.74% 6.74% 6.74%"}, "model_tokens": {"rwkv": [[32234, " this", "normal", 0.11412829905748367]], "qwen": [[419, " this", "normal", 0.15444213151931763]]}, "loss": {"rwkv": 7.833383229826793, "qwen": 6.737154634354944}, "topk": {"rwkv": [32234, 4, 0.11412829905748367, [[22590, 0.166783, " the", false], [22763, 0.163255, " why", false], [21835, 0.128892, " how", false], [32234, 0.114128, " this", false], [4601, 0.076323, " it", false], [32464, 0.057113, " what", false], [32227, 0.049695, " that", false], [332, 0.036571, " a", false], [4419, 0.018708, " an", false], [31458, 0.012861, " more", false]]], "qwen": [419, 1, 0.15444213151931763, [[419, 0.154442, " this", false], [3170, 0.139609, " why", false], [279, 0.133873, " the", false], [1246, 0.12847, " how", false], [1128, 0.07713, " what", false], [429, 0.055649, " that", false], [264, 0.035625, " a", false], [1045, 0.034062, " some", false], [432, 0.033593, " it", false], [1380, 0.028605, " where", false]]]}, "raw_delta": 0.06078782081604006, "tuned_delta": 0.0681249593297428}, {"byte_start": 4928, "byte_end": 4929, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "12.82%", "qwen": "8.79%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.4983038306236267]], "qwen": [[11, ",", "normal", 0.6143350005149841]]}, "loss": {"rwkv": 12.820825070399966, "qwen": 8.786281376580419}, "topk": {"rwkv": [45, 1, 0.4983038306236267, [[45, 0.498304, ",", false], [46430, 0.131626, " lesson", false], [31458, 0.056448, " more", false], [4596, 0.04666, " in", false], [51208, 0.038711, " clearly", false], [52427, 0.038168, " pattern", false], [4423, 0.015632, " as", false], [4600, 0.010752, " is", false], [31461, 0.008782, " most", false], [4858, 0.007303, " we", false]]], "qwen": [11, 1, 0.6143350005149841, [[11, 0.614335, ",", false], [304, 0.049511, " in", false], [9355, 0.0491, " clearly", false], [17755, 0.031125, " lesson", false], [5383, 0.025883, " pattern", false], [803, 0.020151, " more", false], [374, 0.012446, " is", false], [2664, 0.011206, " better", false], [1459, 0.007334, " point", false], [369, 0.007332, " for", false]]]}, "raw_delta": 0.22372260689735413, "tuned_delta": 0.23105974541105687}, {"byte_start": 4929, "byte_end": 4933, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 827, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"rwkv": "24.23% 24.23% 24.23% 24.23%", "qwen": "25.09% 25.09% 25.09% 25.09%"}, "model_tokens": {"rwkv": [[21265, " and", "normal", 0.0046770707704126835]], "qwen": [[323, " and", "normal", 0.0038293139077723026]]}, "loss": {"rwkv": 24.232768264931806, "qwen": 25.089682571771426}, "topk": {"rwkv": [21265, 20, 0.0046770707704126835, [[4858, 0.168919, " we", false], [4601, 0.1655, " it", false], [55832, 0.161495, " consider", false], [22226, 0.080563, " one", false], [31324, 0.058651, " look", false], [22001, 0.052639, " let", false], [31198, 0.049465, " just", false], [51250, 0.038824, " compare", false], [32187, 0.022361, " take", false], [39942, 0.017122, " think", false]]], "qwen": [323, 26, 0.0038293139077723026, [[2908, 0.195418, " consider", false], [1401, 0.155159, " look", false], [432, 0.101601, " it", false], [582, 0.080695, " we", false], [825, 0.057995, " one", false], [1077, 0.041057, " let", false], [5185, 0.036375, " note", false], [1101, 0.03611, " just", false], [1896, 0.025511, " take", false], [9429, 0.025018, " compare", false]]]}, "raw_delta": -0.04751741886138916, "tuned_delta": -0.04018028034768642}, {"byte_start": 4933, "byte_end": 4936, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 828, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "3.33% 3.33% 3.33%", "qwen": "3.45% 3.45% 3.45%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.5745233297348022]], "qwen": [[311, " to", "normal", 0.5629984140396118]]}, "loss": {"rwkv": 3.3343537728879036, "qwen": 3.4533216967306837}, "topk": {"rwkv": [4811, 1, 0.5745233297348022, [[4811, 0.574523, " to", false], [22590, 0.053062, " the", false], [38877, 0.026317, " learn", false], [21835, 0.018352, " how", false], [22763, 0.018079, " why", false], [30135, 0.016449, " also", false], [22449, 0.0135, " see", false], [62683, 0.012929, " understand", false], [21902, 0.01124, " its", false], [52448, 0.010942, " perhaps", false]]], "qwen": [311, 1, 0.5629984140396118, [[311, 0.562998, " to", false], [279, 0.091902, " the", false], [1246, 0.030864, " how", false], [1083, 0.022423, " also", false], [1008, 0.021903, " other", false], [3170, 0.021149, " why", false], [264, 0.017367, " a", false], [1128, 0.014932, " what", false], [369, 0.01095, " for", false], [1045, 0.010928, " some", false]]]}, "raw_delta": -0.006596982479095459, "tuned_delta": 0.0007401560346072776}, {"byte_start": 4936, "byte_end": 4948, "display": {"text": " effectively", "kind": "normal"}, "is_word": true, "word_id": 829, "word_key": " effectively", "bytes_hex": "20 65 66 66 65 63 74 69 76 65 6c 79", "compression": {"rwkv": "13.62% 13.62% 13.62% 13.62% 13.62% 13.62% 13.62% 13.62% 13.62% 13.62% 13.62% 13.62%", "qwen": "13.85% 13.85% 13.85% 13.85% 13.85% 13.85% 13.85% 13.85% 13.85% 13.85% 13.85% 13.85%"}, "model_tokens": {"rwkv": [[63507, " effectively", "normal", 0.00011875177006004378]], "qwen": [[13444, " effectively", "normal", 9.947544458555058e-05]]}, "loss": {"rwkv": 13.61919146672524, "qwen": 13.849271290238262}, "topk": {"rwkv": [63507, 340, 0.00011875177006004378, [[22449, 0.213074, " see", false], [62683, 0.147705, " understand", false], [38877, 0.091134, " learn", false], [37786, 0.051707, " avoid", false], [61588, 0.04702, " appreciate", false], [4435, 0.032467, " be", false], [21751, 0.031398, " get", false], [31358, 0.026367, " make", false], [31059, 0.01573, " have", false], [52653, 0.013743, " realize", false]]], "qwen": [13444, 431, 9.947544458555058e-05, [[3535, 0.19748, " understand", false], [1490, 0.11596, " see", false], [3960, 0.075994, " learn", false], [387, 0.03856, " be", false], [5648, 0.03285, " avoid", false], [15401, 0.029415, " appreciate", false], [1281, 0.024992, " make", false], [633, 0.023834, " get", false], [614, 0.021632, " have", false], [15282, 0.016598, " recognize", false]]]}, "raw_delta": -0.012758334477742439, "tuned_delta": -0.005421195964039702}, {"byte_start": 4948, "byte_end": 4955, "display": {"text": " resist", "kind": "normal"}, "is_word": true, "word_id": 830, "word_key": " resist", "bytes_hex": "20 72 65 73 69 73 74", "compression": {"rwkv": "14.01% 14.01% 14.01% 14.01% 14.01% 14.01% 14.01%", "qwen": "19.98% 19.98% 19.98% 19.98% 19.98% 19.98% 19.98%"}, "model_tokens": {"rwkv": [[47087, " resist", "normal", 0.0043001724407076836]], "qwen": [[22106, " resist", "normal", 0.00042875210056081414]]}, "loss": {"rwkv": 14.008311222917389, "qwen": 19.97780200852034}, "topk": {"rwkv": [47087, 33, 0.0043001724407076836, [[38877, 0.127212, " learn", false], [37730, 0.100338, " apply", false], [37786, 0.084858, " avoid", false], [22681, 0.056154, " use", false], [50855, 0.032481, " address", false], [56540, 0.032393, " leverage", false], [51336, 0.031593, " counter", false], [45522, 0.024684, " combat", false], [32187, 0.023693, " take", false], [53251, 0.021767, " utilize", false]]], "qwen": [22106, 164, 0.00042875210056081414, [[3960, 0.262567, " learn", false], [5648, 0.123221, " avoid", false], [3796, 0.078308, " apply", false], [32064, 0.030248, " leverage", false], [3271, 0.028553, " move", false], [990, 0.022574, " use", false], [1896, 0.020608, " take", false], [1281, 0.020517, " make", false], [4538, 0.017982, " teach", false], [4211, 0.017053, " implement", false]]]}, "raw_delta": -0.33101885659354074, "tuned_delta": -0.32368171807983803}, {"byte_start": 4955, "byte_end": 4958, "display": {"text": " it", "kind": "normal"}, "is_word": true, "word_id": 831, "word_key": " it", "bytes_hex": "20 69 74", "compression": {"rwkv": "13.62% 13.62% 13.62%", "qwen": "12.15% 12.15% 12.15%"}, "model_tokens": {"rwkv": [[4601, " it", "normal", 0.10201247781515121]], "qwen": [[432, " it", "normal", 0.1325092613697052]]}, "loss": {"rwkv": 13.61919146672524, "qwen": 12.1493130773511}, "topk": {"rwkv": [4601, 2, 0.10201247781515121, [[22590, 0.435221, " the", false], [4601, 0.102012, " it", false], [32234, 0.092436, " this", false], [39936, 0.050432, " these", false], [46500, 0.048664, " making", false], [60384, 0.022109, " repeating", false], [32229, 0.01595, " them", false], [39944, 0.015753, " those", false], [32227, 0.01449, " that", false], [32139, 0.014353, " such", false]]], "qwen": [432, 2, 0.1325092613697052, [[279, 0.322693, " the", false], [432, 0.132509, " it", false], [1493, 0.083273, " these", false], [419, 0.069625, " this", false], [1105, 0.037731, " them", false], [1741, 0.032003, " such", false], [1181, 0.025679, " its", false], [15679, 0.018607, " falling", false], [3259, 0.018244, " making", false], [1846, 0.017832, " those", false]]]}, "raw_delta": 0.08150736490885424, "tuned_delta": 0.08884450342255698}, {"byte_start": 4958, "byte_end": 4959, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "0.88%", "qwen": "1.24%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.9527425765991211]], "qwen": [[11, ",", "normal", 0.9333043098449707]]}, "loss": {"rwkv": 0.8761484165554922, "qwen": 1.2447570854509522}, "topk": {"rwkv": [45, 1, 0.9527425765991211, [[45, 0.952743, ",", false], [4596, 0.014393, " in", false], [275, 0.003893, " (", false], [4423, 0.003174, " as", false], [32465, 0.002617, " when", false], [4600, 0.002336, " is", false], [5346, 0.001509, "---", false], [57102, 0.001441, " requires", false], [21265, 0.001323, " and", false], [38606, 0.000961, " going", false]]], "qwen": [11, 1, 0.9333043098449707, [[11, 0.933304, ",", false], [304, 0.029313, " in", false], [979, 0.003033, " when", false], [320, 0.002939, " (", false], [323, 0.002854, " and", false], [504, 0.002625, " from", false], [2087, 0.002564, " going", false], [369, 0.002483, " for", false], [438, 0.00187, " as", false], [518, 0.001153, " at", false]]]}, "raw_delta": -0.020440004765987396, "tuned_delta": -0.01310286625228466}, {"byte_start": 4959, "byte_end": 4962, "display": {"text": " we", "kind": "normal"}, "is_word": true, "word_id": 832, "word_key": " we", "bytes_hex": "20 77 65", "compression": {"rwkv": "5.00% 5.00% 5.00%", "qwen": "6.28% 6.28% 6.28%"}, "model_tokens": {"rwkv": [[4858, " we", "normal", 0.43613144755363464]], "qwen": [[582, " we", "normal", 0.35177427530288696]]}, "loss": {"rwkv": 5.001530659331855, "qwen": 6.280325574681734}, "topk": {"rwkv": [4858, 1, 0.43613144755363464, [[4858, 0.436131, " we", false], [4601, 0.18133, " it", false], [22226, 0.103628, " one", false], [57102, 0.045983, " requires", false], [4600, 0.044275, " is", false], [22590, 0.024659, " the", false], [22799, 0.018464, " you", false], [308, 0.015876, " I", false], [332, 0.013112, " a", false], [22001, 0.009273, " let", false]]], "qwen": [582, 1, 0.35177427530288696, [[582, 0.351774, " we", false], [432, 0.128463, " it", false], [825, 0.091517, " one", false], [7460, 0.063632, " requires", false], [498, 0.041468, " you", false], [279, 0.033669, " the", false], [374, 0.031293, " is", false], [11811, 0.021768, " researchers", false], [264, 0.020178, " a", false], [2908, 0.017095, " consider", false]]]}, "raw_delta": -0.070911447207133, "tuned_delta": -0.06357430869343025}, {"byte_start": 4962, "byte_end": 4967, "display": {"text": " have", "kind": "normal"}, "is_word": true, "word_id": 833, "word_key": " have", "bytes_hex": "20 68 61 76 65", "compression": {"rwkv": "9.97% 9.97% 9.97% 9.97% 9.97%", "qwen": "11.52% 11.52% 11.52% 11.52% 11.52%"}, "model_tokens": {"rwkv": [[31059, " have", "normal", 0.06227442994713783]], "qwen": [[614, " have", "normal", 0.04098060354590416]]}, "loss": {"rwkv": 9.974883681146347, "qwen": 11.522287263325417}, "topk": {"rwkv": [31059, 3, 0.06227442994713783, [[31506, 0.592669, " need", false], [31475, 0.164638, " must", false], [31059, 0.062274, " have", false], [47266, 0.062249, " should", false], [21413, 0.030785, " can", false], [32475, 0.014895, " will", false], [38499, 0.010103, " first", false], [40219, 0.007856, " would", false], [39021, 0.006721, " might", false], [22074, 0.006175, " may", false]]], "qwen": [614, 3, 0.04098060354590416, [[1184, 0.608809, " need", false], [1969, 0.254305, " must", false], [614, 0.040981, " have", false], [686, 0.027231, " will", false], [1265, 0.024201, " should", false], [646, 0.009551, " can", false], [1035, 0.003053, " would", false], [1156, 0.003053, " first", false], [525, 0.002076, " are", false], [1083, 0.001956, " also", false]]]}, "raw_delta": -0.08580627441406252, "tuned_delta": -0.07846913590035978}, {"byte_start": 4967, "byte_end": 4970, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 834, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "0.39% 0.39% 0.39%", "qwen": "0.25% 0.25% 0.25%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.9367923140525818]], "qwen": [[311, " to", "normal", 0.9586803913116455]]}, "loss": {"rwkv": 0.39331285701318575, "qwen": 0.25365889127563124}, "topk": {"rwkv": [4811, 1, 0.9367923140525818, [[4811, 0.936792, " to", false], [31581, 0.014162, " only", false], [332, 0.008546, " a", false], [22638, 0.003803, " two", false], [4419, 0.001415, " an", false], [32074, 0.001409, " some", false], [30259, 0.001353, " been", false], [39946, 0.001241, " three", false], [22590, 0.001135, " the", false], [38499, 0.000998, " first", false]]], "qwen": [311, 1, 0.9586803913116455, [[311, 0.95868, " to", false], [264, 0.005949, " a", false], [1378, 0.005568, " two", false], [1172, 0.002125, " only", false], [3807, 0.00138, " several", false], [2326, 0.001378, " three", false], [279, 0.001253, " the", false], [518, 0.00111, " at", false], [537, 0.001098, " not", false], [1045, 0.001079, " some", false]]]}, "raw_delta": 0.007744060208400089, "tuned_delta": 0.015081198722102826}, {"byte_start": 4970, "byte_end": 4981, "display": {"text": " understand", "kind": "normal"}, "is_word": true, "word_id": 835, "word_key": " understand", "bytes_hex": "20 75 6e 64 65 72 73 74 61 6e 64", "compression": {"rwkv": "2.91% 2.91% 2.91% 2.91% 2.91% 2.91% 2.91% 2.91% 2.91% 2.91% 2.91%", "qwen": "3.93% 3.93% 3.93% 3.93% 3.93% 3.93% 3.93% 3.93% 3.93% 3.93% 3.93%"}, "model_tokens": {"rwkv": [[62683, " understand", "normal", 0.1684887558221817]], "qwen": [[3535, " understand", "normal", 0.09098818153142929]]}, "loss": {"rwkv": 2.907419871109682, "qwen": 3.9297465052446636}, "topk": {"rwkv": [62683, 1, 0.1684887558221817, [[62683, 0.168489, " understand", false], [4435, 0.068354, " be", false], [31324, 0.053897, " look", false], [60335, 0.038017, " recognize", false], [38877, 0.033313, " learn", false], [31059, 0.032782, " have", false], [21295, 0.026324, " ask", false], [39942, 0.025995, " think", false], [22449, 0.025844, " see", false], [31205, 0.023131, " keep", false]]], "qwen": [3535, 2, 0.09098818153142929, [[387, 0.107454, " be", false], [3535, 0.090988, " understand", false], [1401, 0.068165, " look", false], [15282, 0.044598, " recognize", false], [3960, 0.037387, " learn", false], [1744, 0.029901, " think", false], [614, 0.027115, " have", false], [1490, 0.025923, " see", false], [1281, 0.021878, " make", false], [728, 0.021751, " go", false]]]}, "raw_delta": -0.05668982592496007, "tuned_delta": -0.04935268741125734}, {"byte_start": 4981, "byte_end": 4985, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 836, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "5.18% 5.18% 5.18% 5.18%", "qwen": "6.04% 6.04% 6.04% 6.04%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.3172062933444977]], "qwen": [[279, " the", "normal", 0.26193827390670776]]}, "loss": {"rwkv": 5.177640893815371, "qwen": 6.039691032566385}, "topk": {"rwkv": [22590, 1, 0.3172062933444977, [[22590, 0.317206, " the", false], [32464, 0.149506, " what", false], [22763, 0.11575, " why", false], [21835, 0.093685, " how", false], [4601, 0.067098, " it", false], [32227, 0.030138, " that", false], [21265, 0.016573, " and", false], [332, 0.014402, " a", false], [21902, 0.013513, " its", false], [32234, 0.013232, " this", false]]], "qwen": [279, 1, 0.26193827390670776, [[279, 0.261938, " the", false], [1128, 0.127375, " what", false], [3170, 0.11478, " why", false], [432, 0.090524, " it", false], [1246, 0.058081, " how", false], [429, 0.055388, " that", false], [1181, 0.033889, " its", false], [1378, 0.019473, " two", false], [419, 0.016042, " this", false], [1045, 0.014734, " some", false]]]}, "raw_delta": -0.04780220985412598, "tuned_delta": -0.040465071340423237}, {"byte_start": 4985, "byte_end": 4992, "display": {"text": " appeal", "kind": "normal"}, "is_word": true, "word_id": 837, "word_key": " appeal", "bytes_hex": "20 61 70 70 65 61 6c", "compression": {"rwkv": "21.09% 21.09% 21.09% 21.09% 21.09% 21.09% 21.09%", "qwen": "25.58% 25.58% 25.58% 25.58% 25.58% 25.58% 25.58%"}, "model_tokens": {"rwkv": [[45184, " appeal", "normal", 0.0002793184539768845]], "qwen": [[14303, " appeal", "normal", 4.866080416832119e-05]]}, "loss": {"rwkv": 21.09297437013998, "qwen": 25.583714099514278}, "topk": {"rwkv": [45184, 323, 0.0002793184539768845, [[46642, 0.095019, " nature", false], [46430, 0.041999, " lesson", false], [52127, 0.031222, " lessons", false], [52654, 0.029743, " reasons", false], [51929, 0.02848, " history", false], [51832, 0.027725, " general", false], [52427, 0.023978, " pattern", false], [62418, 0.023442, " psychology", false], [37812, 0.022552, " basic", false], [62680, 0.021761, " underlying", false]]], "qwen": [14303, 1067, 4.866080416832119e-05, [[7966, 0.083915, " reasons", false], [6993, 0.045704, " nature", false], [6672, 0.027063, " difference", false], [3840, 0.025021, " history", false], [25180, 0.023007, " bitter", false], [16533, 0.021936, " underlying", false], [15811, 0.020883, " fundamental", false], [1378, 0.020182, " two", false], [29918, 0.013321, " psychology", false], [3491, 0.011962, " problem", false]]]}, "raw_delta": -0.24901948656354622, "tuned_delta": -0.24168234804984348}, {"byte_start": 4992, "byte_end": 4995, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 838, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "0.93% 0.93% 0.93%", "qwen": "0.62% 0.62% 0.62%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.8553966283798218]], "qwen": [[315, " of", "normal", 0.9012525081634521]]}, "loss": {"rwkv": 0.9275139016131844, "qwen": 0.624986207275609}, "topk": {"rwkv": [4706, 1, 0.8553966283798218, [[4706, 0.855397, " of", false], [4811, 0.052603, " to", false], [21265, 0.032766, " and", false], [32227, 0.014694, " that", false], [45, 0.014322, ",", false], [47, 0.005158, ".", false], [21700, 0.004663, " for", false], [5346, 0.003219, "---", false], [275, 0.001464, " (", false], [4715, 0.001392, " or", false]]], "qwen": [315, 1, 0.9012525081634521, [[315, 0.901253, " of", false], [323, 0.02613, " and", false], [429, 0.023416, " that", false], [311, 0.021789, " to", false], [11, 0.010386, ",", false], [369, 0.002979, " for", false], [304, 0.00221, " in", false], [320, 0.001709, " (", false], [4421, 0.001039, "---", false], [13, 0.000806, ".", false]]]}, "raw_delta": 0.016775697469711304, "tuned_delta": 0.02411283598341404}, {"byte_start": 4995, "byte_end": 5001, "display": {"text": " these", "kind": "normal"}, "is_word": true, "word_id": 839, "word_key": " these", "bytes_hex": "20 74 68 65 73 65", "compression": {"rwkv": "9.91% 9.91% 9.91% 9.91% 9.91% 9.91%", "qwen": "11.26% 11.26% 11.26% 11.26% 11.26% 11.26%"}, "model_tokens": {"rwkv": [[39936, " these", "normal", 0.03730778023600578]], "qwen": [[1493, " these", "normal", 0.023618167266249657]]}, "loss": {"rwkv": 9.909135860272501, "qwen": 11.258248032210776}, "topk": {"rwkv": [39936, 4, 0.03730778023600578, [[22590, 0.310407, " the", false], [38720, 0.228839, " human", false], [52224, 0.081649, " methods", false], [39936, 0.037308, " these", false], [47629, 0.015671, " trying", false], [22248, 0.014101, " our", false], [57103, 0.013565, " research", false], [332, 0.012564, " a", false], [61590, 0.010515, " approaches", false], [32234, 0.010258, " this", false]]], "qwen": [1493, 5, 0.023618167266249657, [[279, 0.309243, " the", false], [3738, 0.306688, " human", false], [3281, 0.033718, " special", false], [5413, 0.030899, " methods", false], [1493, 0.023618, " these", false], [1039, 0.012996, " our", false], [1045, 0.012859, " some", false], [264, 0.009896, " a", false], [1817, 0.009332, " each", false], [3654, 0.00927, " certain", false]]]}, "raw_delta": -0.07481066385904955, "tuned_delta": -0.06747352534534681}, {"byte_start": 5001, "byte_end": 5010, "display": {"text": " mistakes", "kind": "normal"}, "is_word": true, "word_id": 840, "word_key": " mistakes", "bytes_hex": "20 6d 69 73 74 61 6b 65 73", "compression": {"rwkv": "12.77% 12.77% 12.77% 12.77% 12.77% 12.77% 12.77% 12.77% 12.77%", "qwen": "10.98% 10.98% 10.98% 10.98% 10.98% 10.98% 10.98% 10.98% 10.98%"}, "model_tokens": {"rwkv": [[56652, " mistakes", "normal", 0.0017073815688490868]], "qwen": [[20643, " mistakes", "normal", 0.004172160755842924]]}, "loss": {"rwkv": 12.77386234120436, "qwen": 10.979152675472264}, "topk": {"rwkv": [56652, 44, 0.0017073815688490868, [[38720, 0.188876, " human", false], [39193, 0.103693, " other", false], [52224, 0.075963, " methods", false], [51551, 0.073696, " earlier", false], [22221, 0.067461, " old", false], [39174, 0.040157, " older", false], [63277, 0.037434, " alternative", false], [61590, 0.032868, " approaches", false], [22638, 0.024174, " two", false], [52964, 0.022903, " special", false]]], "qwen": [20643, 20, 0.004172160755842924, [[3738, 0.209033, " human", false], [3281, 0.137328, " special", false], [4124, 0.075919, " early", false], [6788, 0.071177, " earlier", false], [5413, 0.063224, " methods", false], [1008, 0.050898, " other", false], [19827, 0.048362, " approaches", false], [2310, 0.043633, " old", false], [9014, 0.036111, " older", false], [10555, 0.017361, " alternative", false]]]}, "raw_delta": 0.09951983557807076, "tuned_delta": 0.1068569740917735}, {"byte_start": 5010, "byte_end": 5011, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "11.20%", "qwen": "18.89%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.5372385382652283]], "qwen": [[13, ".", "normal", 0.3507641553878784]]}, "loss": {"rwkv": 11.20061091315162, "qwen": 18.892835942629745}, "topk": {"rwkv": [47, 1, 0.5372385382652283, [[47, 0.537239, ".", false], [45, 0.243176, ",", false], [21265, 0.121293, " and", false], [4811, 0.016634, " to", false], [4596, 0.015898, " in", false], [5346, 0.014652, "---", false], [59, 0.005927, ":", false], [4423, 0.005376, " as", false], [21700, 0.005123, " for", false], [275, 0.004102, " (", false]]], "qwen": [13, 1, 0.3507641553878784, [[13, 0.350764, ".", false], [11, 0.283279, ",", false], [323, 0.138152, " and", false], [382, 0.08834, ".\n\n", false], [304, 0.02879, " in", false], [4421, 0.028449, "---", false], [438, 0.00939, " as", false], [624, 0.007296, ".\n", false], [25, 0.005875, ":", false], [311, 0.005231, " to", false]]]}, "raw_delta": -0.4265475273132324, "tuned_delta": -0.4192103887995297}, {"byte_start": 5011, "byte_end": 5014, "display": {"text": " We", "kind": "normal"}, "is_word": true, "word_id": 841, "word_key": " we", "bytes_hex": "20 57 65", "compression": {"rwkv": "17.85% 17.85% 17.85%", "qwen": "14.90% 14.90% 14.90%"}, "model_tokens": {"rwkv": [[4331, " We", "normal", 0.05075846612453461]], "qwen": [[1205, " We", "normal", 0.08380118012428284]]}, "loss": {"rwkv": 17.845837094329625, "qwen": 14.903689756734355}, "topk": {"rwkv": [4331, 3, 0.05075846612453461, [[261, 0.362258, "\n\n", false], [20996, 0.098708, " The", false], [4331, 0.050758, " We", false], [29893, 0.030129, " They", false], [3913, 0.027799, " In", false], [37451, 0.027401, " There", false], [3918, 0.027116, " It", false], [20556, 0.02523, " One", false], [21152, 0.01897, " Why", false], [19417, 0.018232, " And", false]]], "qwen": [1205, 2, 0.08380118012428284, [[576, 0.111714, " The", false], [1205, 0.083801, " We", false], [8429, 0.070663, " Why", false], [1084, 0.06605, " It", false], [220, 0.059405, " ", false], [758, 0.046129, " In", false], [2619, 0.037961, " There", false], [3776, 0.036161, " One", false], [2379, 0.033422, " They", false], [1096, 0.033081, " This", false]]]}, "raw_delta": 0.16314729054768884, "tuned_delta": 0.17048442906139158}, {"byte_start": 5014, "byte_end": 5019, "display": {"text": " have", "kind": "normal"}, "is_word": true, "word_id": 842, "word_key": " have", "bytes_hex": "20 68 61 76 65", "compression": {"rwkv": "3.80% 3.80% 3.80% 3.80% 3.80%", "qwen": "3.33% 3.33% 3.33% 3.33% 3.33%"}, "model_tokens": {"rwkv": [[31059, " have", "normal", 0.3446548581123352]], "qwen": [[614, " have", "normal", 0.397343248128891]]}, "loss": {"rwkv": 3.803981064843946, "qwen": 3.328855774177571}, "topk": {"rwkv": [31059, 1, 0.3446548581123352, [[31059, 0.344655, " have", false], [31506, 0.100633, " need", false], [21413, 0.097477, " can", false], [32475, 0.057146, " will", false], [31475, 0.056031, " must", false], [21286, 0.044783, " are", false], [47266, 0.027422, " should", false], [30135, 0.01646, " also", false], [4491, 0.015651, " do", false], [31223, 0.012878, " know", false]]], "qwen": [614, 1, 0.397343248128891, [[614, 0.397343, " have", false], [1184, 0.100606, " need", false], [1969, 0.078978, " must", false], [686, 0.051475, " will", false], [646, 0.046523, " can", false], [1083, 0.042537, " also", false], [1265, 0.024587, " should", false], [525, 0.022719, " are", false], [678, 0.017195, " all", false], [653, 0.017034, " do", false]]]}, "raw_delta": 0.02634654045104981, "tuned_delta": 0.03368367896475255}, {"byte_start": 5019, "byte_end": 5022, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 843, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "0.93% 0.93% 0.93%", "qwen": "1.06% 1.06% 1.06%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.8564462065696716]], "qwen": [[311, " to", "normal", 0.8381847143173218]]}, "loss": {"rwkv": 0.9333842427626349, "qwen": 1.0610827942170276}, "topk": {"rwkv": [4811, 1, 0.8564462065696716, [[4811, 0.856446, " to", false], [332, 0.018809, " a", false], [31968, 0.011241, " seen", false], [50888, 0.009003, " already", false], [30259, 0.005421, " been", false], [22590, 0.005262, " the", false], [30135, 0.004905, " also", false], [22638, 0.004245, " two", false], [4419, 0.003432, " an", false], [21256, 0.003004, " all", false]]], "qwen": [311, 1, 0.8381847143173218, [[311, 0.838185, " to", false], [264, 0.017542, " a", false], [3884, 0.015281, " seen", false], [1012, 0.010706, " been", false], [1083, 0.007613, " also", false], [537, 0.006748, " not", false], [2669, 0.005927, " already", false], [11, 0.005638, ",", false], [458, 0.004663, " an", false], [678, 0.003852, " all", false]]]}, "raw_delta": -0.007081111272176109, "tuned_delta": 0.0002560272415266275}, {"byte_start": 5022, "byte_end": 5028, "display": {"text": " learn", "kind": "normal"}, "is_word": true, "word_id": 844, "word_key": " learn", "bytes_hex": "20 6c 65 61 72 6e", "compression": {"rwkv": "12.30% 12.30% 12.30% 12.30% 12.30% 12.30%", "qwen": "13.20% 13.20% 13.20% 13.20% 13.20% 13.20%"}, "model_tokens": {"rwkv": [[38877, " learn", "normal", 0.016794519498944283]], "qwen": [[3960, " learn", "normal", 0.012385758571326733]]}, "loss": {"rwkv": 12.30423504924832, "qwen": 13.198279693814845}, "topk": {"rwkv": [38877, 6, 0.016794519498944283, [[62683, 0.67829, " understand", false], [22449, 0.055469, " see", false], [4435, 0.018533, " be", false], [31223, 0.017751, " know", false], [21295, 0.016892, " ask", false], [38877, 0.016795, " learn", false], [60335, 0.016263, " recognize", false], [31324, 0.012621, " look", false], [52653, 0.009315, " realize", false], [61588, 0.00849, " appreciate", false]]], "qwen": [3960, 8, 0.012385758571326733, [[3535, 0.416839, " understand", false], [1490, 0.093795, " see", false], [387, 0.080511, " be", false], [15282, 0.071187, " recognize", false], [1414, 0.048619, " know", false], [13083, 0.024323, " realize", false], [15401, 0.014749, " appreciate", false], [3960, 0.012386, " learn", false], [614, 0.011074, " have", false], [22106, 0.009968, " resist", false]]]}, "raw_delta": -0.04957636197408044, "tuned_delta": -0.0422392234603777}, {"byte_start": 5028, "byte_end": 5032, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 845, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "10.21% 10.21% 10.21% 10.21%", "qwen": "9.99% 9.99% 9.99% 9.99%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.10271470993757248]], "qwen": [[279, " the", "normal", 0.10899939388036728]]}, "loss": {"rwkv": 10.214393600043929, "qwen": 9.992525231515227}, "topk": {"rwkv": [22590, 3, 0.10271470993757248, [[4811, 0.259473, " to", false], [22763, 0.141509, " why", false], [22590, 0.102715, " the", false], [21835, 0.096533, " how", false], [32464, 0.078261, " what", false], [30917, 0.058117, " from", false], [32227, 0.049593, " that", false], [37598, 0.047045, " about", false], [22187, 0.017682, " not", false], [45, 0.015331, ",", false]]], "qwen": [279, 2, 0.10899939388036728, [[311, 0.280491, " to", false], [279, 0.108999, " the", false], [3170, 0.097243, " why", false], [504, 0.096747, " from", false], [1246, 0.095497, " how", false], [1128, 0.084064, " what", false], [429, 0.062275, " that", false], [911, 0.026732, " about", false], [537, 0.024654, " not", false], [862, 0.012204, " their", false]]]}, "raw_delta": 0.012302994728088379, "tuned_delta": 0.019640133241791115}, {"byte_start": 5032, "byte_end": 5039, "display": {"text": " bitter", "kind": "normal"}, "is_word": true, "word_id": 846, "word_key": " bitter", "bytes_hex": "20 62 69 74 74 65 72", "compression": {"rwkv": "5.39% 5.39% 5.39% 5.39% 5.39% 5.39% 5.39%", "qwen": "6.93% 6.93% 6.93% 6.93% 6.93% 6.93% 6.93%"}, "model_tokens": {"rwkv": [[45315, " bitter", "normal", 0.12403124570846558]], "qwen": [[25180, " bitter", "normal", 0.06782101839780807]]}, "loss": {"rwkv": 5.394004896180833, "qwen": 6.932363910751027}, "topk": {"rwkv": [45315, 2, 0.12403124570846558, [[46430, 0.128609, " lesson", false], [45315, 0.124031, " bitter", false], [52127, 0.106013, " lessons", false], [52654, 0.045998, " reasons", false], [62418, 0.020434, " psychology", false], [51929, 0.018021, " history", false], [51832, 0.017524, " general", false], [47009, 0.015276, " reason", false], [64997, 0.013482, " psychological", false], [46642, 0.011549, " nature", false]]], "qwen": [25180, 2, 0.06782101839780807, [[18366, 0.074521, " lessons", false], [25180, 0.067821, " bitter", false], [29918, 0.056861, " psychology", false], [7966, 0.049741, " reasons", false], [17755, 0.045587, " lesson", false], [3840, 0.026809, " history", false], [23187, 0.019314, " psychological", false], [6672, 0.015804, " difference", false], [5510, 0.014425, " ways", false], [3738, 0.012123, " human", false]]]}, "raw_delta": -0.08530473709106445, "tuned_delta": -0.07796759857736171}, {"byte_start": 5039, "byte_end": 5046, "display": {"text": " lesson", "kind": "normal"}, "is_word": true, "word_id": 847, "word_key": " lesson", "bytes_hex": "20 6c 65 73 73 6f 6e", "compression": {"rwkv": "1.21% 1.21% 1.21% 1.21% 1.21% 1.21% 1.21%", "qwen": "0.83% 0.83% 0.83% 0.83% 0.83% 0.83% 0.83%"}, "model_tokens": {"rwkv": [[46430, " lesson", "normal", 0.6264867782592773]], "qwen": [[17755, " lesson", "normal", 0.7237542867660522]]}, "loss": {"rwkv": 1.2126447574436392, "qwen": 0.8329073714504341}, "topk": {"rwkv": [46430, 1, 0.6264867782592773, [[46430, 0.626487, " lesson", false], [52127, 0.307981, " lessons", false], [45, 0.013322, ",", false], [7513, 0.008584, "est", false], [40029, 0.007881, " truth", false], [21265, 0.004332, " and", false], [39899, 0.002758, " taste", false], [61979, 0.001223, " experience", false], [39831, 0.001204, " story", false], [51929, 0.001177, " history", false]]], "qwen": [17755, 1, 0.7237542867660522, [[17755, 0.723754, " lesson", false], [18366, 0.11963, " lessons", false], [8046, 0.027578, " truth", false], [11, 0.016569, ",", false], [12656, 0.015943, " taste", false], [3139, 0.009252, " experience", false], [3840, 0.007859, " history", false], [323, 0.005836, " and", false], [8729, 0.002913, " reality", false], [512, 0.002361, " le", false]]]}, "raw_delta": 0.02105711187635149, "tuned_delta": 0.028394250390054228}, {"byte_start": 5046, "byte_end": 5051, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 848, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"rwkv": "7.89% 7.89% 7.89% 7.89% 7.89%", "qwen": "7.36% 7.36% 7.36% 7.36% 7.36%"}, "model_tokens": {"rwkv": [[32227, " that", "normal", 0.11291148513555527]], "qwen": [[429, " that", "normal", 0.1298098862171173]]}, "loss": {"rwkv": 7.889738504861517, "qwen": 7.363818998176066}, "topk": {"rwkv": [32227, 4, 0.11291148513555527, [[47, 0.286718, ".", false], [4706, 0.179901, " of", false], [45, 0.113558, ",", false], [32227, 0.112911, " that", false], [21265, 0.068962, " and", false], [59, 0.035873, ":", false], [37598, 0.023158, " about", false], [30917, 0.017132, " from", false], [5346, 0.016787, "---", false], [4596, 0.014065, " in", false]]], "qwen": [429, 2, 0.1298098862171173, [[382, 0.154984, ".\n\n", false], [429, 0.12981, " that", false], [13, 0.129599, ".", false], [315, 0.094392, " of", false], [11, 0.087151, ",", false], [323, 0.042616, " and", false], [1632, 0.037236, " well", false], [624, 0.026237, ".\n", false], [504, 0.025933, " from", false], [304, 0.024922, " in", false]]]}, "raw_delta": 0.029163169860839833, "tuned_delta": 0.03650030837454257}, {"byte_start": 5051, "byte_end": 5060, "display": {"text": " building", "kind": "normal"}, "is_word": true, "word_id": 849, "word_key": " building", "bytes_hex": "20 62 75 69 6c 64 69 6e 67", "compression": {"rwkv": "19.54% 19.54% 19.54% 19.54% 19.54% 19.54% 19.54% 19.54% 19.54%", "qwen": "14.69% 14.69% 14.69% 14.69% 14.69% 14.69% 14.69% 14.69% 14.69%"}, "model_tokens": {"rwkv": [[55666, " building", "normal", 5.916264854022302e-05]], "qwen": [[4752, " building", "normal", 0.0006548331002704799]]}, "loss": {"rwkv": 19.536495345371375, "qwen": 14.68970129885748}, "topk": {"rwkv": [55666, 591, 5.916264854022302e-05, [[22590, 0.10253, " the", false], [4858, 0.086312, " we", false], [51832, 0.064781, " general", false], [63370, 0.061776, " computation", false], [52195, 0.058306, " massive", false], [47202, 0.044315, " search", false], [45, 0.040041, ",", false], [37045, 0.039804, " Moore", false], [4601, 0.030606, " it", false], [39936, 0.018842, " these", false]]], "qwen": [4752, 142, 0.0006548331002704799, [[279, 0.103325, " the", false], [4586, 0.063643, " general", false], [432, 0.060562, " it", false], [582, 0.052497, " we", false], [11, 0.051867, ",", false], [3738, 0.037563, " human", false], [1052, 0.022888, " there", false], [374, 0.02135, " is", false], [1493, 0.018889, " these", false], [304, 0.016522, " in", false]]]}, "raw_delta": 0.2687633302476671, "tuned_delta": 0.2761004687613698}, {"byte_start": 5060, "byte_end": 5063, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 850, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "28.74% 28.74% 28.74%", "qwen": "33.67% 33.67% 33.67%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.008519421331584454]], "qwen": [[304, " in", "normal", 0.0036908648908138275]]}, "loss": {"rwkv": 28.741190267709815, "qwen": 33.674271831998276}, "topk": {"rwkv": [4596, 16, 0.008519421331584454, [[52224, 0.183673, " methods", false], [53087, 0.128683, " systems", false], [332, 0.109494, " a", false], [51832, 0.04904, " general", false], [4712, 0.046849, " on", false], [38720, 0.04122, " human", false], [22248, 0.040754, " our", false], [3609, 0.033288, " AI", false], [22590, 0.022746, " the", false], [4419, 0.015574, " an", false]]], "qwen": [304, 37, 0.0036908648908138275, [[5942, 0.208604, " systems", false], [264, 0.125894, " a", false], [5413, 0.058349, " methods", false], [15235, 0.057395, " AI", false], [458, 0.03022, " an", false], [4119, 0.025556, " models", false], [24514, 0.022974, " intelligent", false], [389, 0.022105, " on", false], [4586, 0.02147, " general", false], [2664, 0.017385, " better", false]]]}, "raw_delta": -0.2735481262207031, "tuned_delta": -0.2662109877070004}, {"byte_start": 5063, "byte_end": 5067, "display": {"text": " how", "kind": "normal"}, "is_word": true, "word_id": 851, "word_key": " how", "bytes_hex": "20 68 6f 77", "compression": {"rwkv": "43.39% 43.39% 43.39% 43.39%", "qwen": "38.38% 38.38% 38.38% 38.38%"}, "model_tokens": {"rwkv": [[21835, " how", "normal", 6.638034392381087e-05]], "qwen": [[1246, " how", "normal", 0.00020085007417947054]]}, "loss": {"rwkv": 43.393561776738345, "qwen": 38.379979433147284}, "topk": {"rwkv": [21835, 346, 6.638034392381087e-05, [[38720, 0.419402, " human", false], [52195, 0.067899, " massive", false], [51832, 0.058733, " general", false], [22590, 0.044872, " the", false], [22248, 0.041722, " our", false], [332, 0.031358, " a", false], [59943, 0.027854, " knowledge", false], [31458, 0.020615, " more", false], [47202, 0.017742, " search", false], [63370, 0.012766, " computation", false]]], "qwen": [1246, 180, 0.00020085007417947054, [[3738, 0.52517, " human", false], [279, 0.077771, " the", false], [1039, 0.054292, " our", false], [6540, 0.04219, " knowledge", false], [264, 0.02268, " a", false], [7947, 0.015423, " domain", false], [25312, 0.015209, "human", false], [3281, 0.012182, " special", false], [4867, 0.008671, " prior", false], [323, 0.007345, " and", false]]]}, "raw_delta": 0.2780120372772217, "tuned_delta": 0.2853491757909244}, {"byte_start": 5067, "byte_end": 5070, "display": {"text": " we", "kind": "normal"}, "is_word": true, "word_id": 852, "word_key": " we", "bytes_hex": "20 77 65", "compression": {"rwkv": "7.23% 7.23% 7.23%", "qwen": "9.51% 9.51% 9.51%"}, "model_tokens": {"rwkv": [[4858, " we", "normal", 0.3014606833457947]], "qwen": [[582, " we", "normal", 0.2055639922618866]]}, "loss": {"rwkv": 7.232260296123059, "qwen": 9.50975201568386}, "topk": {"rwkv": [4858, 1, 0.3014606833457947, [[4858, 0.301461, " we", false], [46227, 0.175537, " humans", false], [46787, 0.109064, " people", false], [22248, 0.061251, " our", false], [38720, 0.060643, " human", false], [22590, 0.05762, " the", false], [4811, 0.047691, " to", false], [332, 0.034245, " a", false], [22226, 0.02992, " one", false], [22799, 0.018622, " you", false]]], "qwen": [582, 2, 0.2055639922618866, [[279, 0.246858, " the", false], [582, 0.205564, " we", false], [12677, 0.134287, " humans", false], [1039, 0.085343, " our", false], [1251, 0.076924, " people", false], [264, 0.066651, " a", false], [311, 0.043537, " to", false], [3738, 0.032875, " human", false], [825, 0.014076, " one", false], [2513, 0.009328, " things", false]]]}, "raw_delta": -0.12629095713297528, "tuned_delta": -0.11895381861927254}, {"byte_start": 5070, "byte_end": 5076, "display": {"text": " think", "kind": "normal"}, "is_word": true, "word_id": 853, "word_key": " think", "bytes_hex": "20 74 68 69 6e 6b", "compression": {"rwkv": "2.18% 2.18% 2.18% 2.18% 2.18% 2.18%", "qwen": "1.44% 1.44% 1.44% 1.44% 1.44% 1.44%"}, "model_tokens": {"rwkv": [[39942, " think", "normal", 0.47932887077331543]], "qwen": [[1744, " think", "normal", 0.6184293031692505]]}, "loss": {"rwkv": 2.1837669075955985, "qwen": 1.444415283022331}, "topk": {"rwkv": [39942, 1, 0.47932887077331543, [[39942, 0.479329, " think", false], [62683, 0.1095, " understand", false], [31223, 0.074185, " know", false], [32435, 0.035106, " want", false], [45, 0.024176, ",", false], [60112, 0.023504, " ourselves", false], [22449, 0.018546, " see", false], [46227, 0.015112, " humans", false], [22681, 0.012186, " use", false], [51968, 0.011565, " imagine", false]]], "qwen": [1744, 1, 0.6184293031692505, [[1744, 0.618429, " think", false], [3535, 0.038989, " understand", false], [4411, 0.034441, " believe", false], [1720, 0.032975, " expect", false], [975, 0.025085, " work", false], [12677, 0.01914, " humans", false], [1366, 0.017792, " want", false], [1414, 0.01713, " know", false], [653, 0.014336, " do", false], [525, 0.009446, " are", false]]]}, "raw_delta": 0.04099835952123005, "tuned_delta": 0.04833549803493278}, {"byte_start": 5076, "byte_end": 5079, "display": {"text": " we", "kind": "normal"}, "is_word": true, "word_id": 854, "word_key": " we", "bytes_hex": "20 77 65", "compression": {"rwkv": "10.28% 10.28% 10.28%", "qwen": "17.15% 17.15% 17.15%"}, "model_tokens": {"rwkv": [[4858, " we", "normal", 0.17868481576442719]], "qwen": [[582, " we", "normal", 0.057669106870889664]]}, "loss": {"rwkv": 10.284837693837336, "qwen": 17.150238931027424}, "topk": {"rwkv": [4858, 2, 0.17868481576442719, [[37598, 0.188417, " about", false], [4858, 0.178685, " we", false], [4600, 0.171299, " is", false], [22248, 0.10836, " our", false], [45, 0.070836, ",", false], [21265, 0.028537, " and", false], [22590, 0.027367, " the", false], [5346, 0.021703, "---", false], [4706, 0.015264, " of", false], [47001, 0.011805, " rather", false]]], "qwen": [582, 5, 0.057669106870889664, [[374, 0.197221, " is", false], [1039, 0.178334, " our", false], [911, 0.084625, " about", false], [11, 0.061796, ",", false], [582, 0.057669, " we", false], [279, 0.050208, " the", false], [323, 0.028571, " and", false], [12677, 0.026298, " humans", false], [686, 0.023324, " will", false], [4421, 0.019348, "---", false]]]}, "raw_delta": -0.38069868087768555, "tuned_delta": -0.37336154236398283}, {"byte_start": 5079, "byte_end": 5085, "display": {"text": " think", "kind": "normal"}, "is_word": true, "word_id": 855, "word_key": " think", "bytes_hex": "20 74 68 69 6e 6b", "compression": {"rwkv": "2.29% 2.29% 2.29% 2.29% 2.29% 2.29%", "qwen": "1.35% 1.35% 1.35% 1.35% 1.35% 1.35%"}, "model_tokens": {"rwkv": [[39942, " think", "normal", 0.46850523352622986]], "qwen": [[1744, " think", "normal", 0.6386187672615051]]}, "loss": {"rwkv": 2.289433048285708, "qwen": 1.3478607294303546}, "topk": {"rwkv": [39942, 1, 0.46850523352622986, [[39942, 0.468505, " think", false], [21286, 0.140268, " are", false], [47266, 0.062504, " should", false], [32475, 0.046204, " will", false], [31223, 0.032944, " know", false], [21413, 0.027356, " can", false], [62683, 0.026002, " understand", false], [4491, 0.017026, " do", false], [5230, 0.016507, "'re", false], [22449, 0.014994, " see", false]]], "qwen": [1744, 1, 0.6386187672615051, [[1744, 0.638619, " think", false], [1414, 0.071785, " know", false], [3535, 0.049039, " understand", false], [975, 0.045229, " work", false], [1265, 0.035646, " should", false], [653, 0.0287, " do", false], [525, 0.015335, " are", false], [12677, 0.012244, " humans", false], [646, 0.010578, " can", false], [21776, 0.007312, " ought", false]]]}, "raw_delta": 0.05221185584863026, "tuned_delta": 0.05954899436233299}, {"byte_start": 5085, "byte_end": 5090, "display": {"text": " does", "kind": "normal"}, "is_word": true, "word_id": 856, "word_key": " does", "bytes_hex": "20 64 6f 65 73", "compression": {"rwkv": "17.36% 17.36% 17.36% 17.36% 17.36%", "qwen": "17.11% 17.11% 17.11% 17.11% 17.11%"}, "model_tokens": {"rwkv": [[30659, " does", "normal", 0.008288503624498844]], "qwen": [[1558, " does", "normal", 0.008711479604244232]]}, "loss": {"rwkv": 17.35742471069534, "qwen": 17.10716587611883}, "topk": {"rwkv": [30659, 14, 0.008288503624498844, [[4600, 0.387533, " is", false], [45, 0.156047, ",", false], [5346, 0.045216, "---", false], [38964, 0.032437, " makes", false], [32475, 0.030613, " will", false], [38686, 0.029348, " helps", false], [37598, 0.024242, " about", false], [21265, 0.022825, " and", false], [275, 0.015988, " (", false], [4811, 0.015685, " to", false]]], "qwen": [1558, 16, 0.008711479604244232, [[374, 0.427321, " is", false], [11, 0.107602, ",", false], [4421, 0.075485, "---", false], [686, 0.042633, " will", false], [320, 0.034348, " (", false], [323, 0.020956, " and", false], [11508, 0.017248, " leads", false], [646, 0.016237, " can", false], [1119, 0.015159, " into", false], [911, 0.014814, " about", false]]]}, "raw_delta": 0.013877296447753928, "tuned_delta": 0.021214434961456665}, {"byte_start": 5090, "byte_end": 5094, "display": {"text": " not", "kind": "normal"}, "is_word": true, "word_id": 857, "word_key": " not", "bytes_hex": "20 6e 6f 74", "compression": {"rwkv": "0.25% 0.25% 0.25% 0.25%", "qwen": "0.58% 0.58% 0.58% 0.58%"}, "model_tokens": {"rwkv": [[22187, " not", "normal", 0.9461037516593933]], "qwen": [[537, " not", "normal", 0.8796513676643372]]}, "loss": {"rwkv": 0.24985639517348837, "qwen": 0.5781132315259238}, "topk": {"rwkv": [22187, 1, 0.9461037516593933, [[22187, 0.946104, " not", false], [4835, 0.011891, " us", false], [31458, 0.007093, " more", false], [31466, 0.002963, " much", false], [4692, 0.002855, " no", false], [332, 0.001869, " a", false], [45, 0.00176, ",", false], [21660, 0.001728, " far", false], [4788, 0.001447, " so", false], [31277, 0.001225, " less", false]]], "qwen": [537, 1, 0.8796513676643372, [[537, 0.879651, " not", false], [601, 0.026351, " us", false], [803, 0.015866, " more", false], [902, 0.011103, " no", false], [2632, 0.010846, " little", false], [4302, 0.009943, " nothing", false], [279, 0.004964, " the", false], [2686, 0.003646, " less", false], [264, 0.002525, " a", false], [1602, 0.002124, " very", false]]]}, "raw_delta": -0.01820242404937744, "tuned_delta": -0.010865285535674705}, {"byte_start": 5094, "byte_end": 5099, "display": {"text": " work", "kind": "normal"}, "is_word": true, "word_id": 858, "word_key": " work", "bytes_hex": "20 77 6f 72 6b", "compression": {"rwkv": "4.28% 4.28% 4.28% 4.28% 4.28%", "qwen": "4.62% 4.62% 4.62% 4.62% 4.62%"}, "model_tokens": {"rwkv": [[32499, " work", "normal", 0.30783069133758545]], "qwen": [[975, " work", "normal", 0.27795347571372986]]}, "loss": {"rwkv": 4.28300090263911, "qwen": 4.6177118179217995}, "topk": {"rwkv": [32499, 1, 0.30783069133758545, [[32499, 0.307831, " work", false], [31073, 0.14276, " help", false], [31358, 0.105909, " make", false], [31262, 0.054585, " lead", false], [22269, 0.045895, " pay", false], [51982, 0.020489, " improve", false], [40239, 0.017633, " yield", false], [63717, 0.01687, " necessarily", false], [45150, 0.015902, " always", false], [45851, 0.013907, " enable", false]]], "qwen": [975, 1, 0.27795347571372986, [[975, 0.277953, " work", false], [1492, 0.141885, " help", false], [1281, 0.130175, " make", false], [14312, 0.047249, " necessarily", false], [2677, 0.039702, " always", false], [2990, 0.034625, " lead", false], [2291, 0.028309, " pay", false], [7269, 0.019406, " improve", false], [5452, 0.01876, " scale", false], [8193, 0.016406, " produce", false]]]}, "raw_delta": -0.01856031417846682, "tuned_delta": -0.011223175664764082}, {"byte_start": 5099, "byte_end": 5102, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 859, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "23.29% 23.29% 23.29%", "qwen": "14.61% 14.61% 14.61%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.021186070516705513]], "qwen": [[304, " in", "normal", 0.08799804002046585]]}, "loss": {"rwkv": 23.29351368101972, "qwen": 14.609937656305648}, "topk": {"rwkv": [4596, 6, 0.021186070516705513, [[47, 0.567902, ".", false], [45, 0.174106, ",", false], [4423, 0.044469, " as", false], [21265, 0.03729, " and", false], [32458, 0.029235, " well", false], [4596, 0.021186, " in", false], [32386, 0.015328, " very", false], [21700, 0.01503, " for", false], [5346, 0.014628, "---", false], [60, 0.009324, ";", false]]], "qwen": [304, 4, 0.08799804002046585, [[11, 0.228025, ",", false], [13, 0.186119, ".", false], [1632, 0.11878, " well", false], [304, 0.087998, " in", false], [382, 0.056287, ".\n\n", false], [979, 0.046167, " when", false], [369, 0.033962, " for", false], [4421, 0.032596, "---", false], [323, 0.027918, " and", false], [1602, 0.02747, " very", false]]]}, "raw_delta": 0.48151969909667985, "tuned_delta": 0.48885683761038257}, {"byte_start": 5102, "byte_end": 5106, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 860, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "7.26% 7.26% 7.26% 7.26%", "qwen": "5.12% 5.12% 5.12% 5.12%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.19965291023254395]], "qwen": [[279, " the", "normal", 0.3210839331150055]]}, "loss": {"rwkv": 7.25574166072086, "qwen": 5.121805113875409}, "topk": {"rwkv": [22590, 3, 0.19965291023254395, [[51832, 0.28306, " general", false], [3609, 0.205247, " AI", false], [22590, 0.199653, " the", false], [56901, 0.051394, " practice", false], [332, 0.042558, " a", false], [32234, 0.029728, " this", false], [31461, 0.020025, " most", false], [55809, 0.013791, " computer", false], [52167, 0.010014, " machine", false], [4419, 0.007569, " an", false]]], "qwen": [279, 1, 0.3210839331150055, [[279, 0.321084, " the", false], [15235, 0.237011, " AI", false], [4586, 0.070292, " general", false], [264, 0.049939, " a", false], [419, 0.04585, " this", false], [6588, 0.034317, " practice", false], [458, 0.020227, " an", false], [6366, 0.019437, " computer", false], [1657, 0.015189, " many", false], [1429, 0.014388, " most", false]]]}, "raw_delta": 0.11833056807518005, "tuned_delta": 0.1256677065888828}, {"byte_start": 5106, "byte_end": 5111, "display": {"text": " long", "kind": "normal"}, "is_word": true, "word_id": 861, "word_key": " long", "bytes_hex": "20 6c 6f 6e 67", "compression": {"rwkv": "1.51% 1.51% 1.51% 1.51% 1.51%", "qwen": "2.14% 2.14% 2.14% 2.14% 2.14%"}, "model_tokens": {"rwkv": [[31323, " long", "normal", 0.6603017449378967]], "qwen": [[1293, " long", "normal", 0.5521554946899414]]}, "loss": {"rwkv": 1.514548016558238, "qwen": 2.1421337774313574}, "topk": {"rwkv": [31323, 1, 0.6603017449378967, [[31323, 0.660302, " long", false], [51832, 0.045995, " general", false], [21616, 0.03908, " end", false], [30807, 0.02882, " face", false], [31835, 0.027348, " real", false], [46470, 0.021761, " longer", false], [31937, 0.012985, " same", false], [22752, 0.010201, " way", false], [51310, 0.009492, " context", false], [56916, 0.008975, " presence", false]]], "qwen": [1293, 1, 0.5521554946899414, [[1293, 0.552155, " long", false], [3579, 0.056277, " face", false], [1852, 0.040254, " same", false], [1616, 0.039427, " way", false], [2266, 0.035569, " context", false], [835, 0.029098, " end", false], [1879, 0.022416, " world", false], [4586, 0.020575, " general", false], [4231, 0.017114, " age", false], [1931, 0.016012, " real", false]]]}, "raw_delta": -0.034800744056701666, "tuned_delta": -0.02746360554299893}, {"byte_start": 5111, "byte_end": 5115, "display": {"text": " run", "kind": "normal"}, "is_word": true, "word_id": 862, "word_key": " run", "bytes_hex": "20 72 75 6e", "compression": {"rwkv": "0.56% 0.56% 0.56% 0.56%", "qwen": "0.81% 0.81% 0.81% 0.81%"}, "model_tokens": {"rwkv": [[22418, " run", "normal", 0.8830591440200806]], "qwen": [[1598, " run", "normal", 0.8350721001625061]]}, "loss": {"rwkv": 0.5591499944851633, "qwen": 0.812585509856842}, "topk": {"rwkv": [22418, 1, 0.8830591440200806, [[22418, 0.883059, " run", false], [32219, 0.104951, " term", false], [46, 0.006562, "-", false], [31057, 0.002566, " haul", false], [45, 0.000418, ",", false], [21265, 0.000291, " and", false], [4715, 0.000291, " or", false], [39438, 0.00022, " range", false], [8661, 0.000135, "run", false], [27132, 8.5e-05, "term", false]]], "qwen": [1598, 1, 0.8350721001625061, [[1598, 0.835072, " run", false], [4647, 0.149661, " term", false], [22973, 0.006208, "-run", false], [9663, 0.00508, "-term", false], [1809, 0.000577, " game", false], [37868, 0.000539, " haul", false], [11, 0.00049, ",", false], [1651, 0.000252, " view", false], [835, 0.000126, " end", false], [1424, 0.000122, " hand", false]]]}, "raw_delta": -0.014053449034690857, "tuned_delta": -0.00671631052098812}, {"byte_start": 5115, "byte_end": 5116, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "6.13%", "qwen": "17.50%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.7120217084884644]], "qwen": [[13, ".", "normal", 0.3790284991264343]]}, "loss": {"rwkv": 6.128636160026358, "qwen": 17.495271600079956}, "topk": {"rwkv": [47, 1, 0.7120217084884644, [[47, 0.712022, ".", false], [45, 0.181633, ",", false], [21265, 0.044661, " and", false], [5346, 0.01102, "---", false], [60, 0.009917, ";", false], [4423, 0.004019, " as", false], [275, 0.003542, " (", false], [4588, 0.003463, " if", false], [51018, 0.003014, " because", false], [4596, 0.002918, " in", false]]], "qwen": [13, 1, 0.3790284991264343, [[13, 0.379028, ".", false], [11, 0.312495, ",", false], [382, 0.143711, ".\n\n", false], [323, 0.029924, " and", false], [4421, 0.02744, "---", false], [26, 0.020779, ";", false], [979, 0.016691, " when", false], [624, 0.013268, ".\n", false], [320, 0.006766, " (", false], [369, 0.006157, " for", false]]]}, "raw_delta": -0.6303001046180725, "tuned_delta": -0.6229629661043697}, {"byte_start": 5116, "byte_end": 5120, "display": {"text": " The", "kind": "normal"}, "is_word": true, "word_id": 863, "word_key": " the", "bytes_hex": "20 54 68 65", "compression": {"rwkv": "11.83% 11.83% 11.83% 11.83%", "qwen": "11.54% 11.54% 11.54% 11.54%"}, "model_tokens": {"rwkv": [[20996, " The", "normal", 0.07224582135677338]], "qwen": [[576, " The", "normal", 0.07735802233219147]]}, "loss": {"rwkv": 11.834607757292277, "qwen": 11.53845363250652}, "topk": {"rwkv": [20996, 3, 0.07224582135677338, [[261, 0.327795, "\n\n", false], [4331, 0.112431, " We", false], [20996, 0.072246, " The", false], [3918, 0.048057, " It", false], [29894, 0.031316, " This", false], [19417, 0.028893, " And", false], [3913, 0.021697, " In", false], [0, 0.021505, "[0]", false], [267, 0.019773, "  ", false], [19555, 0.017811, " But", false]]], "qwen": [576, 3, 0.07735802233219147, [[1205, 0.201504, " We", false], [1084, 0.085766, " It", false], [576, 0.077358, " The", false], [220, 0.049018, " ", false], [1597, 0.043184, " And", false], [758, 0.04095, " In", false], [12090, 0.036267, " Instead", false], [1096, 0.031497, " This", false], [2014, 0.020006, " To", false], [1416, 0.018401, " If", false]]]}, "raw_delta": 0.016422271728515625, "tuned_delta": 0.02375941024221836}, {"byte_start": 5120, "byte_end": 5127, "display": {"text": " bitter", "kind": "normal"}, "is_word": true, "word_id": 864, "word_key": " bitter", "bytes_hex": "20 62 69 74 74 65 72", "compression": {"rwkv": "8.05% 8.05% 8.05% 8.05% 8.05% 8.05% 8.05%", "qwen": "11.57% 11.57% 11.57% 11.57% 11.57% 11.57% 11.57%"}, "model_tokens": {"rwkv": [[45315, " bitter", "normal", 0.04410020262002945]], "qwen": [[25180, " bitter", "normal", 0.011190979741513729]]}, "loss": {"rwkv": 8.050753576389305, "qwen": 11.574142489455566}, "topk": {"rwkv": [45315, 3, 0.04410020262002945, [[46430, 0.073397, " lesson", false], [45184, 0.056872, " appeal", false], [45315, 0.0441, " bitter", false], [31461, 0.028038, " most", false], [47009, 0.025697, " reason", false], [31581, 0.025483, " only", false], [38720, 0.022675, " human", false], [21357, 0.017279, " big", false], [30273, 0.015737, " best", false], [52127, 0.014465, " lessons", false]]], "qwen": [25180, 12, 0.011190979741513729, [[1172, 0.059374, " only", false], [3738, 0.059229, " human", false], [17755, 0.042784, " lesson", false], [1850, 0.034479, " best", false], [1429, 0.026778, " most", false], [2070, 0.024099, " field", false], [2874, 0.019449, " reason", false], [1616, 0.018545, " way", false], [803, 0.015485, " more", false], [1376, 0.012972, " key", false]]]}, "raw_delta": -0.1953781672886439, "tuned_delta": -0.18804102877494117}, {"byte_start": 5127, "byte_end": 5134, "display": {"text": " lesson", "kind": "normal"}, "is_word": true, "word_id": 865, "word_key": " lesson", "bytes_hex": "20 6c 65 73 73 6f 6e", "compression": {"rwkv": "0.42% 0.42% 0.42% 0.42% 0.42% 0.42% 0.42%", "qwen": "0.27% 0.27% 0.27% 0.27% 0.27% 0.27% 0.27%"}, "model_tokens": {"rwkv": [[46430, " lesson", "normal", 0.8506177663803101]], "qwen": [[17755, " lesson", "normal", 0.9021850824356079]]}, "loss": {"rwkv": 0.41511698128257357, "qwen": 0.2651869017991099}, "topk": {"rwkv": [46430, 1, 0.8506177663803101, [[46430, 0.850618, " lesson", false], [52127, 0.046337, " lessons", false], [7513, 0.037166, "est", false], [31633, 0.009384, " part", false], [39899, 0.005847, " taste", false], [40029, 0.005836, " truth", false], [46, 0.002441, "-", false], [45, 0.002172, ",", false], [47009, 0.001968, " reason", false], [39941, 0.001618, " thing", false]]], "qwen": [17755, 1, 0.9021850824356079, [[17755, 0.902185, " lesson", false], [18366, 0.020929, " lessons", false], [8046, 0.011496, " truth", false], [11, 0.004877, ",", false], [477, 0.004274, "est", false], [12656, 0.003808, " taste", false], [3139, 0.003217, " experience", false], [949, 0.00215, " part", false], [374, 0.001937, " is", false], [323, 0.001742, " and", false]]]}, "raw_delta": 0.008313888950007302, "tuned_delta": 0.01565102746371004}, {"byte_start": 5134, "byte_end": 5137, "display": {"text": " is", "kind": "normal"}, "is_word": true, "word_id": 866, "word_key": " is", "bytes_hex": "20 69 73", "compression": {"rwkv": "2.85% 2.85% 2.85%", "qwen": "4.62% 4.62% 4.62%"}, "model_tokens": {"rwkv": [[4600, " is", "normal", 0.6231439709663391]], "qwen": [[374, " is", "normal", 0.4638510048389435]]}, "loss": {"rwkv": 2.8529857986329596, "qwen": 4.617777529626316}, "topk": {"rwkv": [4600, 1, 0.6231439709663391, [[4600, 0.623144, " is", false], [4706, 0.048335, " of", false], [32227, 0.039654, " that", false], [45, 0.033217, ",", false], [21800, 0.026234, " has", false], [30135, 0.019497, " also", false], [21413, 0.016248, " can", false], [4596, 0.009189, " in", false], [22748, 0.008408, " was", false], [50938, 0.007678, " applies", false]]], "qwen": [374, 1, 0.4638510048389435, [[374, 0.463851, " is", false], [429, 0.060347, " that", false], [315, 0.045223, " of", false], [702, 0.037756, " has", false], [11, 0.030756, ",", false], [1231, 0.021503, " may", false], [646, 0.019577, " can", false], [1083, 0.01896, " also", false], [686, 0.015643, " will", false], [572, 0.013588, " was", false]]]}, "raw_delta": -0.09786083300908405, "tuned_delta": -0.09052369449538131}, {"byte_start": 5137, "byte_end": 5143, "display": {"text": " based", "kind": "normal"}, "is_word": true, "word_id": 867, "word_key": " based", "bytes_hex": "20 62 61 73 65 64", "compression": {"rwkv": "19.07% 19.07% 19.07% 19.07% 19.07% 19.07%", "qwen": "21.48% 21.48% 21.48% 21.48% 21.48% 21.48%"}, "model_tokens": {"rwkv": [[37810, " based", "normal", 0.0017648711800575256]], "qwen": [[3118, " based", "normal", 0.0007878189207985997]]}, "loss": {"rwkv": 19.066868053415337, "qwen": 21.47885020595085}, "topk": {"rwkv": [37810, 40, 0.0017648711800575256, [[32227, 0.495382, " that", false], [22590, 0.055937, " the", false], [22187, 0.053349, " not", false], [30135, 0.034935, " also", false], [32234, 0.030311, " this", false], [332, 0.025008, " a", false], [4811, 0.019687, " to", false], [59, 0.017647, ":", false], [37598, 0.015264, " about", false], [45, 0.01513, ",", false]]], "qwen": [3118, 87, 0.0007878189207985997, [[429, 0.420396, " that", false], [537, 0.060272, " not", false], [264, 0.042158, " a", false], [1083, 0.040813, " also", false], [279, 0.035126, " the", false], [25180, 0.026915, " bitter", false], [419, 0.024569, " this", false], [825, 0.021177, " one", false], [11, 0.015526, ",", false], [25, 0.013466, ":", false]]]}, "raw_delta": -0.133748690287272, "tuned_delta": -0.12641155177356925}, {"byte_start": 5143, "byte_end": 5146, "display": {"text": " on", "kind": "normal"}, "is_word": true, "word_id": 868, "word_key": " on", "bytes_hex": "20 6f 6e", "compression": {"rwkv": "0.58% 0.58% 0.58%", "qwen": "0.63% 0.63% 0.63%"}, "model_tokens": {"rwkv": [[4712, " on", "normal", 0.9087560176849365]], "qwen": [[389, " on", "normal", 0.9003555178642273]]}, "loss": {"rwkv": 0.5752934326461523, "qwen": 0.6309720544814594}, "topk": {"rwkv": [4712, 1, 0.9087560176849365, [[4712, 0.908756, " on", false], [4596, 0.038599, " in", false], [22187, 0.013849, " not", false], [32350, 0.008711, " upon", false], [45, 0.007148, ",", false], [46768, 0.001741, " partly", false], [45202, 0.00167, " around", false], [30322, 0.001248, " both", false], [31458, 0.001054, " more", false], [52094, 0.000948, " largely", false]]], "qwen": [389, 1, 0.9003555178642273, [[389, 0.900356, " on", false], [304, 0.02386, " in", false], [537, 0.01802, " not", false], [11, 0.010356, ",", false], [5193, 0.009928, " upon", false], [1172, 0.00229, " only", false], [11368, 0.002201, " entirely", false], [803, 0.002024, " more", false], [13771, 0.001939, " largely", false], [2163, 0.001594, " around", false]]]}, "raw_delta": -0.003087478379408523, "tuned_delta": 0.0042496601342942135}, {"byte_start": 5146, "byte_end": 5150, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 869, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "4.31% 4.31% 4.31% 4.31%", "qwen": "5.10% 5.10% 5.10% 5.10%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.38150322437286377]], "qwen": [[279, " the", "normal", 0.32240262627601624]]}, "loss": {"rwkv": 4.314700744846142, "qwen": 5.103327190377551}, "topk": {"rwkv": [22590, 1, 0.38150322437286377, [[22590, 0.381503, " the", false], [332, 0.142719, " a", false], [37045, 0.079788, " Moore", false], [22638, 0.04746, " two", false], [4419, 0.029692, " an", false], [32234, 0.017501, " this", false], [32464, 0.017017, " what", false], [39946, 0.012842, " three", false], [56537, 0.012076, " learning", false], [21835, 0.011674, " how", false]]], "qwen": [279, 1, 0.32240262627601624, [[279, 0.322403, " the", false], [264, 0.118365, " a", false], [1378, 0.048474, " two", false], [20219, 0.045589, " Moore", false], [458, 0.021637, " an", false], [1128, 0.020198, " what", false], [3139, 0.017951, " experience", false], [2326, 0.017125, " three", false], [1039, 0.012978, " our", false], [3738, 0.00938, " human", false]]]}, "raw_delta": -0.043730735778808594, "tuned_delta": -0.036393597265105854}, {"byte_start": 5150, "byte_end": 5161, "display": {"text": " historical", "kind": "normal"}, "is_word": true, "word_id": 870, "word_key": " historical", "bytes_hex": "20 68 69 73 74 6f 72 69 63 61 6c", "compression": {"rwkv": "11.01% 11.01% 11.01% 11.01% 11.01% 11.01% 11.01% 11.01% 11.01% 11.01% 11.01%", "qwen": "9.95% 9.95% 9.95% 9.95% 9.95% 9.95% 9.95% 9.95% 9.95% 9.95% 9.95%"}, "model_tokens": {"rwkv": [[62061, " historical", "normal", 0.0011994049418717623]], "qwen": [[13656, " historical", "normal", 0.002314023906365037]]}, "loss": {"rwkv": 11.014894665878096, "qwen": 9.949296415046708}, "topk": {"rwkv": [62061, 120, 0.0011994049418717623, [[30808, 0.115395, " fact", false], [63729, 0.059906, " observation", false], [59725, 0.056062, " following", false], [51832, 0.029873, " general", false], [61979, 0.019888, " experience", false], [31135, 0.019271, " idea", false], [60250, 0.017974, " principle", false], [47284, 0.015415, " simple", false], [46681, 0.014006, " notion", false], [31461, 0.013368, " most", false]]], "qwen": [13656, 51, 0.002314023906365037, [[2097, 0.133914, " fact", false], [21930, 0.114291, " observation", false], [2701, 0.046345, " following", false], [4285, 0.033885, " simple", false], [4522, 0.023517, " idea", false], [24335, 0.022318, " assumption", false], [17508, 0.021572, " principle", false], [15811, 0.016477, " fundamental", false], [48703, 0.015829, " realization", false], [17843, 0.012666, " recognition", false]]]}, "raw_delta": 0.05908931385387073, "tuned_delta": 0.06642645236757347}, {"byte_start": 5161, "byte_end": 5174, "display": {"text": " observations", "kind": "normal"}, "is_word": true, "word_id": 871, "word_key": " observations", "bytes_hex": "20 6f 62 73 65 72 76 61 74 69 6f 6e 73", "compression": {"rwkv": "6.68% 6.68% 6.68% 6.68% 6.68% 6.68% 6.68% 6.68% 6.68% 6.68% 6.68% 6.68% 6.68%", "qwen": "8.09% 8.09% 8.09% 8.09% 8.09% 8.09% 8.09% 8.09% 8.09% 8.09% 8.09% 8.09% 8.09%"}, "model_tokens": {"rwkv": [[64495, " observations", "normal", 0.008211234584450722]], "qwen": [[23722, " observations", "normal", 0.002941312501206994]]}, "loss": {"rwkv": 6.675932581036667, "qwen": 8.085888687000958}, "topk": {"rwkv": [64495, 16, 0.008211234584450722, [[52427, 0.176921, " pattern", false], [47024, 0.105113, " record", false], [30808, 0.086222, " fact", false], [61979, 0.069026, " experience", false], [56157, 0.065697, " evidence", false], [56162, 0.061462, " examples", false], [51668, 0.032822, " example", false], [52127, 0.02079, " lessons", false], [38440, 0.02055, " facts", false], [46430, 0.018407, " lesson", false]]], "qwen": [23722, 34, 0.002941312501206994, [[2097, 0.276674, " fact", false], [3255, 0.119615, " record", false], [3139, 0.067845, " experience", false], [5904, 0.037318, " evidence", false], [5383, 0.035484, " pattern", false], [8729, 0.034271, " reality", false], [21930, 0.024844, " observation", false], [2393, 0.017481, " success", false], [4401, 0.016759, " development", false], [323, 0.014835, " and", false]]]}, "raw_delta": -0.07818456796499396, "tuned_delta": -0.07084742945129122}, {"byte_start": 5174, "byte_end": 5179, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 872, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"rwkv": "3.48% 3.48% 3.48% 3.48% 3.48%", "qwen": "3.07% 3.07% 3.07% 3.07% 3.07%"}, "model_tokens": {"rwkv": [[32227, " that", "normal", 0.3825936019420624]], "qwen": [[429, " that", "normal", 0.42726224660873413]]}, "loss": {"rwkv": 3.4799382333942765, "qwen": 3.067015627891962}, "topk": {"rwkv": [32227, 1, 0.3825936019420624, [[32227, 0.382594, " that", false], [4706, 0.156848, " of", false], [45, 0.047983, ",", false], [37599, 0.042741, " above", false], [47, 0.036173, ".", false], [59488, 0.032056, " described", false], [4596, 0.026299, " in", false], [21265, 0.025754, " and", false], [37598, 0.02535, " about", false], [31351, 0.01995, " made", false]]], "qwen": [429, 1, 0.42726224660873413, [[429, 0.427262, " that", false], [315, 0.291769, " of", false], [323, 0.027302, " and", false], [1865, 0.027231, " made", false], [11, 0.024236, ",", false], [3403, 0.020542, " above", false], [304, 0.019367, " in", false], [911, 0.018508, " about", false], [7481, 0.010782, " described", false], [68629, 0.008892, " summarized", false]]]}, "raw_delta": 0.02289729118347167, "tuned_delta": 0.030234429697174405}, {"byte_start": 5179, "byte_end": 5181, "display": {"text": " 1", "kind": "normal"}, "is_word": true, "word_id": 873, "word_key": " 1", "bytes_hex": "20 31", "compression": {"rwkv": "44.52% 44.52%", "qwen": "89.94% 5.89%"}, "model_tokens": {"rwkv": [[284, " 1", "normal", 0.007249108981341124]], "qwen": [[220, " ", "normal", 0.006822048686444759], [16, "1", "normal", 0.7212427258491516]]}, "loss": {"rwkv": 44.52066727743285, "qwen": 47.918891555156414}, "topk": {"rwkv": [284, 24, 0.007249108981341124, [[22590, 0.102599, " the", false], [4858, 0.067912, " we", false], [59, 0.063488, ":", false], [45, 0.056471, ",", false], [47202, 0.03507, " search", false], [63370, 0.027385, " computation", false], [38720, 0.024776, " human", false], [52195, 0.024278, " massive", false], [275, 0.02388, " (", false], [39934, 0.022923, " there", false]]], "qwen": [220, 31, 0.006822048686444759, [[279, 0.114873, " the", false], [11, 0.074743, ",", false], [582, 0.039058, " we", false], [3738, 0.037648, " human", false], [1052, 0.032026, " there", false], [11811, 0.025722, " researchers", false], [304, 0.022724, " in", false], [614, 0.018306, " have", false], [1429, 0.018006, " most", false], [1447, 0.01739, ":\n\n", false]]]}, "raw_delta": -0.1884375661611557, "tuned_delta": -0.18110042764745296}, {"byte_start": 5181, "byte_end": 5182, "display": {"text": ")", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "29", "compression": {"rwkv": "1.52%", "qwen": "2.71%"}, "model_tokens": {"rwkv": [[42, ")", "normal", 0.9202452898025513]], "qwen": [[8, ")", "normal", 0.8606036901473999]]}, "loss": {"rwkv": 1.5233535282824135, "qwen": 2.7072382949905966}, "topk": {"rwkv": [42, 1, 0.9202452898025513, [[42, 0.920245, ")", false], [47, 0.054865, ".", false], [580, 0.007832, ".)", false], [48, 0.004129, "/", false], [45, 0.004127, ",", false], [46, 0.001542, "-", false], [499, 0.001016, ").", false], [59, 0.000905, ":", false], [276, 0.000405, " )", false], [98, 0.000376, "a", false]]], "qwen": [8, 1, 0.8606036901473999, [[8, 0.860604, ")", false], [13, 0.071884, ".", false], [24, 0.027879, "9", false], [15, 0.009732, "0", false], [6138, 0.005238, ".)", false], [11, 0.001529, ",", false], [25, 0.001528, ":", false], [279, 0.001499, " the", false], [14, 0.001431, "/", false], [12, 0.001183, "-", false]]]}, "raw_delta": -0.06564851105213165, "tuned_delta": -0.05831137253842891}, {"byte_start": 5182, "byte_end": 5185, "display": {"text": " AI", "kind": "normal"}, "is_word": true, "word_id": 874, "word_key": " ai", "bytes_hex": "20 41 49", "compression": {"rwkv": "29.68% 29.68% 29.68%", "qwen": "35.42% 35.42% 35.42%"}, "model_tokens": {"rwkv": [[3609, " AI", "normal", 0.007122568320482969]], "qwen": [[15235, " AI", "normal", 0.002759526250883937]]}, "loss": {"rwkv": 29.6804448516219, "qwen": 35.42234935740809}, "topk": {"rwkv": [3609, 24, 0.007122568320482969, [[22590, 0.114343, " the", false], [52195, 0.11373, " massive", false], [47202, 0.065668, " search", false], [63370, 0.050382, " computation", false], [52224, 0.036514, " methods", false], [38720, 0.034624, " human", false], [51832, 0.024076, " general", false], [39934, 0.023342, " there", false], [37045, 0.021751, " Moore", false], [4596, 0.019502, " in", false]]], "qwen": [15235, 51, 0.002759526250883937, [[279, 0.12742, " the", false], [3738, 0.091542, " human", false], [1052, 0.030641, " there", false], [1429, 0.029236, " most", false], [304, 0.026788, " in", false], [582, 0.026313, " we", false], [4586, 0.024561, " general", false], [5413, 0.022817, " methods", false], [432, 0.017832, " it", false], [979, 0.016287, " when", false]]]}, "raw_delta": -0.3183987935384116, "tuned_delta": -0.3110616550247089}, {"byte_start": 5185, "byte_end": 5197, "display": {"text": " researchers", "kind": "normal"}, "is_word": true, "word_id": 875, "word_key": " researchers", "bytes_hex": "20 72 65 73 65 61 72 63 68 65 72 73", "compression": {"rwkv": "2.68% 2.68% 2.68% 2.68% 2.68% 2.68% 2.68% 2.68% 2.68% 2.68% 2.68% 2.68%", "qwen": "1.30% 1.30% 1.30% 1.30% 1.30% 1.30% 1.30% 1.30% 1.30% 1.30% 1.30% 1.30%"}, "model_tokens": {"rwkv": [[63843, " researchers", "normal", 0.16714787483215332]], "qwen": [[11811, " researchers", "normal", 0.4211137890815735]]}, "loss": {"rwkv": 2.6768755641494435, "qwen": 1.2997062142088494}, "topk": {"rwkv": [63843, 2, 0.16714787483215332, [[57103, 0.34561, " research", false], [63843, 0.167148, " researchers", false], [52224, 0.109417, " methods", false], [53087, 0.050079, " systems", false], [4600, 0.041654, " is", false], [21800, 0.023598, " has", false], [56950, 0.019934, " progress", false], [56949, 0.015875, " programs", false], [62633, 0.012455, " techniques", false], [22748, 0.008354, " was", false]]], "qwen": [11811, 1, 0.4211137890815735, [[11811, 0.421114, " researchers", false], [3412, 0.241596, " research", false], [702, 0.051568, " has", false], [374, 0.045421, " is", false], [5413, 0.030513, " methods", false], [572, 0.024486, " was", false], [5942, 0.016856, " systems", false], [594, 0.005651, "'s", false], [646, 0.004245, " can", false], [304, 0.004208, " in", false]]]}, "raw_delta": 0.07636648416519165, "tuned_delta": 0.08370362267889439}, {"byte_start": 5197, "byte_end": 5202, "display": {"text": " have", "kind": "normal"}, "is_word": true, "word_id": 876, "word_key": " have", "bytes_hex": "20 68 61 76 65", "compression": {"rwkv": "6.40% 6.40% 6.40% 6.40% 6.40%", "qwen": "6.84% 6.84% 6.84% 6.84% 6.84%"}, "model_tokens": {"rwkv": [[31059, " have", "normal", 0.1673399657011032]], "qwen": [[614, " have", "normal", 0.15027377009391785]]}, "loss": {"rwkv": 6.396323716441302, "qwen": 6.835836989550142}, "topk": {"rwkv": [31059, 1, 0.1673399657011032, [[31059, 0.16734, " have", false], [40, 0.148581, "'", false], [21286, 0.098521, " are", false], [32216, 0.049265, " tend", false], [45, 0.031928, ",", false], [22762, 0.026523, " who", false], [4491, 0.022749, " do", false], [39171, 0.018627, " often", false], [45150, 0.014321, " always", false], [4596, 0.013971, " in", false]]], "qwen": [614, 1, 0.15027377009391785, [[614, 0.150274, " have", false], [525, 0.076383, " are", false], [6, 0.065294, "'", false], [8376, 0.048428, " tend", false], [879, 0.039182, " who", false], [1033, 0.037454, " were", false], [2677, 0.02672, " always", false], [653, 0.024378, " do", false], [11, 0.023063, ",", false], [3545, 0.021426, " often", false]]]}, "raw_delta": -0.024371790885925282, "tuned_delta": -0.017034652372222545}, {"byte_start": 5202, "byte_end": 5208, "display": {"text": " often", "kind": "normal"}, "is_word": true, "word_id": 877, "word_key": " often", "bytes_hex": "20 6f 66 74 65 6e", "compression": {"rwkv": "12.30% 12.30% 12.30% 12.30% 12.30% 12.30%", "qwen": "10.20% 10.20% 10.20% 10.20% 10.20% 10.20%"}, "model_tokens": {"rwkv": [[39171, " often", "normal", 0.016883186995983124]], "qwen": [[3545, " often", "normal", 0.033567722886800766]]}, "loss": {"rwkv": 12.30423504924832, "qwen": 10.201628187783637}, "topk": {"rwkv": [39171, 9, 0.016883186995983124, [[30259, 0.156254, " been", false], [22187, 0.081422, " not", false], [332, 0.072726, " a", false], [45150, 0.064169, " always", false], [47518, 0.029517, " tended", false], [21795, 0.024821, " had", false], [56495, 0.018679, " invested", false], [31351, 0.017605, " made", false], [39171, 0.016883, " often", false], [39762, 0.016444, " spent", false]]], "qwen": [3545, 6, 0.033567722886800766, [[1012, 0.116053, " been", false], [2677, 0.102586, " always", false], [537, 0.060681, " not", false], [48790, 0.050558, " tended", false], [264, 0.035441, " a", false], [3545, 0.033568, " often", false], [1865, 0.03193, " made", false], [8789, 0.03124, " generally", false], [6679, 0.025189, " tried", false], [7391, 0.021125, " spent", false]]]}, "raw_delta": 0.11659328142801917, "tuned_delta": 0.12393041994172191}, {"byte_start": 5208, "byte_end": 5214, "display": {"text": " tried", "kind": "normal"}, "is_word": true, "word_id": 878, "word_key": " tried", "bytes_hex": "20 74 72 69 65 64", "compression": {"rwkv": "8.69% 8.69% 8.69% 8.69% 8.69% 8.69%", "qwen": "7.22% 7.22% 7.22% 7.22% 7.22% 7.22%"}, "model_tokens": {"rwkv": [[40013, " tried", "normal", 0.055753011256456375]], "qwen": [[6679, " tried", "normal", 0.09043993800878525]]}, "loss": {"rwkv": 8.68810490118679, "qwen": 7.2227009271126}, "topk": {"rwkv": [40013, 3, 0.055753011256456375, [[30259, 0.184421, " been", false], [31351, 0.055819, " made", false], [40013, 0.055753, " tried", false], [21795, 0.038271, " had", false], [22187, 0.034231, " not", false], [45953, 0.028199, " failed", false], [53137, 0.025431, " thought", false], [37924, 0.023763, " built", false], [56495, 0.023123, " invested", false], [47340, 0.021271, " sought", false]]], "qwen": [6679, 2, 0.09043993800878525, [[1012, 0.204918, " been", false], [6679, 0.09044, " tried", false], [1865, 0.062135, " made", false], [7391, 0.025583, " spent", false], [11585, 0.020182, " believed", false], [1030, 0.019235, " had", false], [3381, 0.019098, " thought", false], [4641, 0.018346, " failed", false], [45431, 0.016739, " pursued", false], [10735, 0.016659, " focused", false]]]}, "raw_delta": 0.08125925064086914, "tuned_delta": 0.08859638915457188}, {"byte_start": 5214, "byte_end": 5217, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 879, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "1.58% 1.58% 1.58%", "qwen": "0.87% 0.87% 0.87%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.7676928043365479]], "qwen": [[311, " to", "normal", 0.8649898171424866]]}, "loss": {"rwkv": 1.5849921103516442, "qwen": 0.8718540455931668}, "topk": {"rwkv": [4811, 1, 0.7676928043365479, [[4811, 0.767693, " to", false], [52224, 0.081842, " methods", false], [39931, 0.014052, " their", false], [45, 0.010307, ",", false], [22590, 0.009398, " the", false], [61590, 0.006137, " approaches", false], [38720, 0.005013, " human", false], [32448, 0.004145, " ways", false], [21700, 0.003663, " for", false], [22249, 0.003621, " out", false]]], "qwen": [311, 1, 0.8649898171424866, [[311, 0.86499, " to", false], [5413, 0.01351, " methods", false], [11, 0.010121, ",", false], [3738, 0.007356, " human", false], [323, 0.006901, " and", false], [304, 0.004482, " in", false], [2588, 0.004469, " hard", false], [279, 0.004439, " the", false], [2238, 0.004154, " too", false], [1602, 0.004112, " very", false]]]}, "raw_delta": 0.039544771114985146, "tuned_delta": 0.04688190962868788}, {"byte_start": 5217, "byte_end": 5223, "display": {"text": " build", "kind": "normal"}, "is_word": true, "word_id": 880, "word_key": " build", "bytes_hex": "20 62 75 69 6c 64", "compression": {"rwkv": "5.96% 5.96% 5.96% 5.96% 5.96% 5.96%", "qwen": "4.01% 4.01% 4.01% 4.01% 4.01% 4.01%"}, "model_tokens": {"rwkv": [[37923, " build", "normal", 0.1381034106016159]], "qwen": [[1936, " build", "normal", 0.2630777955055237]]}, "loss": {"rwkv": 5.964266607841743, "qwen": 4.013413654526509}, "topk": {"rwkv": [37923, 1, 0.1381034106016159, [[37923, 0.138103, " build", false], [31358, 0.070516, " make", false], [22339, 0.067137, " put", false], [32187, 0.048363, " take", false], [22681, 0.048263, " use", false], [56540, 0.047405, " leverage", false], [51982, 0.028113, " improve", false], [4491, 0.0262, " do", false], [37730, 0.026041, " apply", false], [39740, 0.02448, " solve", false]]], "qwen": [1936, 1, 0.2630777955055237, [[1936, 0.263078, " build", false], [1281, 0.147193, " make", false], [32064, 0.035578, " leverage", false], [2182, 0.035405, " put", false], [990, 0.032568, " use", false], [65485, 0.025452, " emulate", false], [11625, 0.02464, " solve", false], [653, 0.023266, " do", false], [55359, 0.016776, " mimic", false], [3796, 0.016032, " apply", false]]]}, "raw_delta": 0.10817825794219972, "tuned_delta": 0.11551539645590246}, {"byte_start": 5223, "byte_end": 5233, "display": {"text": " knowledge", "kind": "normal"}, "is_word": true, "word_id": 881, "word_key": " knowledge", "bytes_hex": "20 6b 6e 6f 77 6c 65 64 67 65", "compression": {"rwkv": "8.74% 8.74% 8.74% 8.74% 8.74% 8.74% 8.74% 8.74% 8.74% 8.74%", "qwen": "11.44% 11.44% 11.44% 11.44% 11.44% 11.44% 11.44% 11.44% 11.44% 11.44%"}, "model_tokens": {"rwkv": [[59943, " knowledge", "normal", 0.007902293466031551]], "qwen": [[6540, " knowledge", "normal", 0.001757561694830656]]}, "loss": {"rwkv": 8.735067630382394, "qwen": 11.440260997909652}, "topk": {"rwkv": [59943, 13, 0.007902293466031551, [[4596, 0.166932, " in", false], [53087, 0.149469, " systems", false], [3609, 0.144871, " AI", false], [52224, 0.132661, " methods", false], [39931, 0.12251, " their", false], [332, 0.024452, " a", false], [64452, 0.022689, " intelligence", false], [22590, 0.018053, " the", false], [63659, 0.015378, " intelligent", false], [51832, 0.011774, " general", false]]], "qwen": [6540, 38, 0.001757561694830656, [[5942, 0.383208, " systems", false], [304, 0.147803, " in", false], [5413, 0.048333, " methods", false], [15235, 0.036416, " AI", false], [264, 0.036301, " a", false], [12645, 0.028511, " machines", false], [4119, 0.023244, " models", false], [862, 0.022203, " their", false], [24514, 0.020137, " intelligent", false], [279, 0.015744, " the", false]]]}, "raw_delta": -0.15000777244567876, "tuned_delta": -0.14267063393197602}, {"byte_start": 5233, "byte_end": 5238, "display": {"text": " into", "kind": "normal"}, "is_word": true, "word_id": 882, "word_key": " into", "bytes_hex": "20 69 6e 74 6f", "compression": {"rwkv": "3.37% 3.37% 3.37% 3.37% 3.37%", "qwen": "2.58% 2.58% 2.58% 2.58% 2.58%"}, "model_tokens": {"rwkv": [[31162, " into", "normal", 0.39185187220573425]], "qwen": [[1119, " into", "normal", 0.4887540638446808]]}, "loss": {"rwkv": 3.3672276833248262, "qwen": 2.5820486300299623}, "topk": {"rwkv": [31162, 1, 0.39185187220573425, [[31162, 0.391852, " into", false], [46, 0.32774, "-", false], [4706, 0.045519, " of", false], [53087, 0.031801, " systems", false], [21265, 0.030831, " and", false], [4596, 0.029904, " in", false], [37598, 0.017989, " about", false], [56003, 0.016015, " directly", false], [4715, 0.012068, " or", false], [45, 0.011356, ",", false]]], "qwen": [1119, 1, 0.4887540638446808, [[1119, 0.488754, " into", false], [5980, 0.177835, "-based", false], [5961, 0.056711, " directly", false], [304, 0.044363, " in", false], [23092, 0.020867, " bases", false], [12, 0.017732, "-", false], [11, 0.013609, ",", false], [13042, 0.011556, " representation", false], [43613, 0.011007, " representations", false], [323, 0.010619, " and", false]]]}, "raw_delta": 0.04353957176208495, "tuned_delta": 0.05087671027578769}, {"byte_start": 5238, "byte_end": 5244, "display": {"text": " their", "kind": "normal"}, "is_word": true, "word_id": 883, "word_key": " their", "bytes_hex": "20 74 68 65 69 72", "compression": {"rwkv": "1.64% 1.64% 1.64% 1.64% 1.64% 1.64%", "qwen": "2.35% 2.35% 2.35% 2.35% 2.35% 2.35%"}, "model_tokens": {"rwkv": [[39931, " their", "normal", 0.5748592019081116]], "qwen": [[862, " their", "normal", 0.45808759331703186]]}, "loss": {"rwkv": 1.6436955218461495, "qwen": 2.3464680489182497}, "topk": {"rwkv": [39931, 1, 0.5748592019081116, [[39931, 0.574859, " their", false], [3609, 0.130469, " AI", false], [22590, 0.069994, " the", false], [53087, 0.069991, " systems", false], [52224, 0.058335, " methods", false], [56949, 0.00896, " programs", false], [332, 0.008902, " a", false], [56567, 0.006214, " machines", false], [61559, 0.005006, " algorithms", false], [4419, 0.004201, " an", false]]], "qwen": [862, 1, 0.45808759331703186, [[862, 0.458088, " their", false], [5942, 0.145753, " systems", false], [15235, 0.106452, " AI", false], [279, 0.098164, " the", false], [5413, 0.032825, " methods", false], [264, 0.022574, " a", false], [12645, 0.013158, " machines", false], [25185, 0.011579, " algorithms", false], [458, 0.009804, " an", false], [13009, 0.009332, " agents", false]]]}, "raw_delta": -0.03896998365720112, "tuned_delta": -0.031632845143498386}, {"byte_start": 5244, "byte_end": 5251, "display": {"text": " agents", "kind": "normal"}, "is_word": true, "word_id": 884, "word_key": " agents", "bytes_hex": "20 61 67 65 6e 74 73", "compression": {"rwkv": "12.72% 12.72% 12.72% 12.72% 12.72% 12.72% 12.72%", "qwen": "9.16% 9.16% 9.16% 9.16% 9.16% 9.16% 9.16%"}, "model_tokens": {"rwkv": [[45124, " agents", "normal", 0.007117672823369503]], "qwen": [[13009, " agents", "normal", 0.02860068529844284]]}, "loss": {"rwkv": 12.720190650695104, "qwen": 9.156797344590643}, "topk": {"rwkv": [45124, 11, 0.007117672823369503, [[53087, 0.385491, " systems", false], [52224, 0.307616, " methods", false], [3609, 0.086523, " AI", false], [56949, 0.04742, " programs", false], [61590, 0.022919, " approaches", false], [61559, 0.020063, " algorithms", false], [57103, 0.017808, " research", false], [46587, 0.013733, " models", false], [32499, 0.01145, " work", false], [56567, 0.007419, " machines", false]]], "qwen": [13009, 5, 0.02860068529844284, [[5942, 0.584944, " systems", false], [5413, 0.162817, " methods", false], [15235, 0.040642, " AI", false], [25185, 0.035244, " algorithms", false], [13009, 0.028601, " agents", false], [7468, 0.026119, " programs", false], [4119, 0.013486, " models", false], [12645, 0.012212, " machines", false], [19827, 0.011931, " approaches", false], [1849, 0.00816, " system", false]]]}, "raw_delta": 0.197596481868199, "tuned_delta": 0.20493362038190174}, {"byte_start": 5251, "byte_end": 5252, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "14.23%", "qwen": "16.14%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.45620986819267273]], "qwen": [[11, ",", "normal", 0.4085323214530945]]}, "loss": {"rwkv": 14.229706946268095, "qwen": 16.1434739907079}, "topk": {"rwkv": [45, 1, 0.45620986819267273, [[45, 0.45621, ",", false], [21265, 0.133005, " and", false], [4596, 0.056448, " in", false], [4811, 0.047219, " to", false], [60, 0.046517, ";", false], [275, 0.03733, " (", false], [45285, 0.016459, " before", false], [5346, 0.016432, "---", false], [32227, 0.016094, " that", false], [21400, 0.015033, " but", false]]], "qwen": [11, 1, 0.4085323214530945, [[11, 0.408532, ",", false], [323, 0.095241, " and", false], [304, 0.061851, " in", false], [26, 0.057017, ";", false], [320, 0.038999, " (", false], [438, 0.028618, " as", false], [429, 0.028383, " that", false], [2041, 0.024179, " without", false], [553, 0.023365, " by", false], [4421, 0.022919, "---", false]]]}, "raw_delta": -0.10612177848815918, "tuned_delta": -0.09878463997445644}, {"byte_start": 5252, "byte_end": 5254, "display": {"text": " 2", "kind": "normal"}, "is_word": true, "word_id": 885, "word_key": " 2", "bytes_hex": "20 32", "compression": {"rwkv": "19.30% 19.30%", "qwen": "37.18% 0.11%"}, "model_tokens": {"rwkv": [[285, " 2", "normal", 0.1168658658862114]], "qwen": [[220, " ", "normal", 0.1272447109222412], [17, "2", "normal", 0.994102418422699]]}, "loss": {"rwkv": 19.301681699393356, "qwen": 18.642849443588588}, "topk": {"rwkv": [285, 2, 0.1168658658862114, [[21265, 0.427637, " and", false], [285, 0.116866, " 2", false], [21400, 0.063451, " but", false], [4596, 0.034, " in", false], [30788, 0.024756, " even", false], [4423, 0.024077, " as", false], [4715, 0.022186, " or", false], [40186, 0.017953, " which", false], [4811, 0.014842, " to", false], [32487, 0.013596, " with", false]]], "qwen": [220, 2, 0.1272447109222412, [[323, 0.393957, " and", false], [220, 0.127245, " ", false], [714, 0.073304, " but", false], [4751, 0.029262, " rather", false], [304, 0.024752, " in", false], [438, 0.022122, " as", false], [448, 0.020125, " with", false], [2987, 0.01689, " either", false], [1496, 0.014024, " even", false], [892, 0.012988, " which", false]]]}, "raw_delta": 0.03653341764584184, "tuned_delta": 0.04387055615954458}, {"byte_start": 5254, "byte_end": 5255, "display": {"text": ")", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "29", "compression": {"rwkv": "0.03%", "qwen": "0.02%"}, "model_tokens": {"rwkv": [[42, ")", "normal", 0.9985468983650208]], "qwen": [[8, ")", "normal", 0.9990455508232117]]}, "loss": {"rwkv": 0.02655412129321765, "qwen": 0.017220137660109158}, "topk": {"rwkv": [42, 1, 0.9985468983650208, [[42, 0.998547, ")", false], [497, 0.000725, "),", false], [276, 0.000125, " )", false], [499, 9.8e-05, ").", false], [98, 9.2e-05, "a", false], [580, 7.2e-05, ".)", false], [47, 5.7e-05, ".", false], [48, 2.6e-05, "/", false], [45, 2.2e-05, ",", false], [46, 1.7e-05, "-", false]]], "qwen": [8, 1, 0.9990455508232117, [[8, 0.999046, ")", false], [701, 0.00022, "),", false], [64, 0.000148, "a", false], [873, 0.000108, " )", false], [13, 4.8e-05, ".", false], [6138, 3.7e-05, ".)", false], [11, 3.5e-05, ",", false], [15, 3.4e-05, "0", false], [323, 2.6e-05, " and", false], [429, 1.9e-05, " that", false]]]}, "raw_delta": 0.0005175859550945461, "tuned_delta": 0.007854724468797283}, {"byte_start": 5255, "byte_end": 5260, "display": {"text": " this", "kind": "normal"}, "is_word": true, "word_id": 886, "word_key": " this", "bytes_hex": "20 74 68 69 73", "compression": {"rwkv": "8.17% 8.17% 8.17% 8.17% 8.17%", "qwen": "9.24% 9.24% 9.24% 9.24% 9.24%"}, "model_tokens": {"rwkv": [[32234, " this", "normal", 0.10269071161746979]], "qwen": [[419, " this", "normal", 0.07725539803504944]]}, "loss": {"rwkv": 8.171514880035144, "qwen": 9.235550903005239}, "topk": {"rwkv": [32234, 2, 0.10269071161746979, [[32227, 0.188006, " that", false], [32234, 0.102691, " this", false], [22590, 0.092824, " the", false], [39936, 0.051265, " these", false], [32465, 0.043506, " when", false], [32232, 0.037963, " they", false], [59943, 0.031643, " knowledge", false], [32139, 0.030755, " such", false], [4596, 0.026504, " in", false], [21400, 0.019491, " but", false]]], "qwen": [419, 3, 0.07725539803504944, [[279, 0.106956, " the", false], [807, 0.088234, " they", false], [419, 0.077255, " this", false], [429, 0.070534, " that", false], [6540, 0.044582, " knowledge", false], [1493, 0.042293, " these", false], [1846, 0.035526, " those", false], [304, 0.034022, " in", false], [862, 0.026684, " their", false], [15235, 0.026366, " AI", false]]]}, "raw_delta": -0.059002685546875044, "tuned_delta": -0.051665547033172304}, {"byte_start": 5260, "byte_end": 5267, "display": {"text": " always", "kind": "normal"}, "is_word": true, "word_id": 887, "word_key": " always", "bytes_hex": "20 61 6c 77 61 79 73", "compression": {"rwkv": "11.75% 11.75% 11.75% 11.75% 11.75% 11.75% 11.75%", "qwen": "16.09% 16.09% 16.09% 16.09% 16.09% 16.09% 16.09%"}, "model_tokens": {"rwkv": [[45150, " always", "normal", 0.010438967496156693]], "qwen": [[2677, " always", "normal", 0.0019399260636419058]]}, "loss": {"rwkv": 11.754100221528384, "qwen": 16.088897139127845}, "topk": {"rwkv": [45150, 12, 0.010438967496156693, [[59943, 0.301007, " knowledge", false], [21800, 0.134708, " has", false], [4600, 0.079003, " is", false], [55532, 0.052734, " approach", false], [45829, 0.036793, " effort", false], [39171, 0.036092, " often", false], [30659, 0.024951, " does", false], [22748, 0.024325, " was", false], [38964, 0.017015, " makes", false], [38720, 0.014612, " human", false]]], "qwen": [2677, 40, 0.0019399260636419058, [[702, 0.303916, " has", false], [6540, 0.21361, " knowledge", false], [374, 0.076746, " is", false], [5486, 0.04863, " approach", false], [3545, 0.043218, " often", false], [572, 0.026249, " was", false], [5041, 0.01478, " effort", false], [3093, 0.013744, " kind", false], [1558, 0.012532, " does", false], [27236, 0.009465, " tends", false]]]}, "raw_delta": -0.2403721809387207, "tuned_delta": -0.23303504242501796}, {"byte_start": 5267, "byte_end": 5273, "display": {"text": " helps", "kind": "normal"}, "is_word": true, "word_id": 888, "word_key": " helps", "bytes_hex": "20 68 65 6c 70 73", "compression": {"rwkv": "21.42% 21.42% 21.42% 21.42% 21.42% 21.42%", "qwen": "17.04% 17.04% 17.04% 17.04% 17.04% 17.04%"}, "model_tokens": {"rwkv": [[38686, " helps", "normal", 0.0008085271110758185]], "qwen": [[8609, " helps", "normal", 0.0034472723491489887]]}, "loss": {"rwkv": 21.415004513195548, "qwen": 17.04235134776367}, "topk": {"rwkv": [38686, 106, 0.0008085271110758185, [[21800, 0.06052, " has", false], [38964, 0.059587, " makes", false], [38442, 0.057248, " fails", false], [40040, 0.056637, " turns", false], [46936, 0.050407, " proved", false], [38875, 0.049011, " leads", false], [39620, 0.035868, " seems", false], [39888, 0.035568, " takes", false], [40212, 0.032863, " works", false], [46938, 0.029812, " proves", false]]], "qwen": [8609, 48, 0.0034472723491489887, [[11508, 0.082167, " leads", false], [702, 0.055408, " has", false], [4977, 0.051891, " seems", false], [14525, 0.044846, " fails", false], [4041, 0.041755, " comes", false], [6069, 0.035197, " led", false], [18651, 0.033772, " proved", false], [3643, 0.030163, " makes", false], [4641, 0.028432, " failed", false], [10335, 0.025981, " ends", false]]]}, "raw_delta": 0.2424713770548502, "tuned_delta": 0.24980851556855294}, {"byte_start": 5273, "byte_end": 5276, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 889, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "8.59% 8.59% 8.59%", "qwen": "6.63% 6.63% 6.63%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.2412131279706955]], "qwen": [[304, " in", "normal", 0.3321073055267334]]}, "loss": {"rwkv": 8.594179442795582, "qwen": 6.626161187735484}, "topk": {"rwkv": [4596, 1, 0.2412131279706955, [[4596, 0.241213, " in", false], [32229, 0.084564, " them", false], [31581, 0.074659, " only", false], [45, 0.061364, ",", false], [332, 0.056458, " a", false], [4424, 0.045805, " at", false], [4811, 0.043645, " to", false], [22590, 0.042088, " the", false], [21700, 0.03969, " for", false], [31277, 0.025214, " less", false]]], "qwen": [304, 1, 0.3321073055267334, [[304, 0.332107, " in", false], [279, 0.083113, " the", false], [1105, 0.073144, " them", false], [264, 0.042835, " a", false], [11, 0.033876, ",", false], [311, 0.032151, " to", false], [979, 0.02858, " when", false], [369, 0.026255, " for", false], [15102, 0.02395, " initially", false], [4124, 0.019933, " early", false]]]}, "raw_delta": 0.10913010438283283, "tuned_delta": 0.11646724289653557}, {"byte_start": 5276, "byte_end": 5280, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 890, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "1.27% 1.27% 1.27% 1.27%", "qwen": "0.72% 0.72% 0.72% 0.72%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.7545849084854126]], "qwen": [[279, " the", "normal", 0.8523589968681335]]}, "loss": {"rwkv": 1.2679936882813154, "qwen": 0.7202089926085409}, "topk": {"rwkv": [22590, 1, 0.7545849084854126, [[22590, 0.754585, " the", false], [32074, 0.082781, " some", false], [39675, 0.026782, " short", false], [332, 0.013353, " a", false], [46639, 0.004812, " narrow", false], [39720, 0.004137, " small", false], [52964, 0.003061, " special", false], [22226, 0.003026, " one", false], [63875, 0.002966, " specialized", false], [38328, 0.002863, " early", false]]], "qwen": [279, 1, 0.8523589968681335, [[279, 0.852359, " the", false], [2805, 0.01926, " short", false], [1045, 0.019121, " some", false], [264, 0.010473, " a", false], [6588, 0.00565, " practice", false], [4862, 0.004612, " training", false], [2613, 0.004378, " small", false], [3793, 0.004265, " terms", false], [3259, 0.003964, " making", false], [862, 0.002562, " their", false]]]}, "raw_delta": 0.030375633388757706, "tuned_delta": 0.037712771902460446}, {"byte_start": 5280, "byte_end": 5286, "display": {"text": " short", "kind": "normal"}, "is_word": true, "word_id": 891, "word_key": " short", "bytes_hex": "20 73 68 6f 72 74", "compression": {"rwkv": "0.27% 0.27% 0.27% 0.27% 0.27% 0.27%", "qwen": "0.38% 0.38% 0.38% 0.38% 0.38% 0.38%"}, "model_tokens": {"rwkv": [[39675, " short", "normal", 0.9131085872650146]], "qwen": [[2805, " short", "normal", 0.8821887969970703]]}, "loss": {"rwkv": 0.2715032781620872, "qwen": 0.37675137560658395}, "topk": {"rwkv": [39675, 1, 0.9131085872650146, [[39675, 0.913109, " short", false], [52888, 0.013564, " shorter", false], [59220, 0.011799, " beginning", false], [38328, 0.008143, " early", false], [31323, 0.006482, " long", false], [38499, 0.004912, " first", false], [32386, 0.004892, " very", false], [31503, 0.00485, " near", false], [52013, 0.00386, " initial", false], [59816, 0.003839, " immediate", false]]], "qwen": [2805, 1, 0.8821887969970703, [[2805, 0.882189, " short", false], [4124, 0.03014, " early", false], [23327, 0.010896, " shorter", false], [13922, 0.009542, " immediate", false], [1602, 0.009541, " very", false], [2856, 0.007255, " initial", false], [7167, 0.005843, " beginning", false], [3143, 0.005533, " near", false], [1293, 0.003011, " long", false], [11051, 0.002668, " medium", false]]]}, "raw_delta": -0.005836193760236106, "tuned_delta": 0.0015009447534666308}, {"byte_start": 5286, "byte_end": 5291, "display": {"text": " term", "kind": "normal"}, "is_word": true, "word_id": 892, "word_key": " term", "bytes_hex": "20 74 65 72 6d", "compression": {"rwkv": "3.58% 3.58% 3.58% 3.58% 3.58%", "qwen": "2.27% 2.27% 2.27% 2.27% 2.27%"}, "model_tokens": {"rwkv": [[32219, " term", "normal", 0.3706311881542206]], "qwen": [[4647, " term", "normal", 0.5326520204544067]]}, "loss": {"rwkv": 3.5785599647050454, "qwen": 2.2718368583409934}, "topk": {"rwkv": [32219, 2, 0.3706311881542206, [[22418, 0.598936, " run", false], [32219, 0.370631, " term", false], [46, 0.025626, "-", false], [4715, 0.000633, " or", false], [4811, 0.000565, " to", false], [21265, 0.000496, " and", false], [8661, 0.000348, "run", false], [32251, 0.000256, " time", false], [45, 0.000192, ",", false], [31057, 0.000186, " haul", false]]], "qwen": [4647, 1, 0.5326520204544067, [[4647, 0.532652, " term", false], [1598, 0.433524, " run", false], [9663, 0.017027, "-term", false], [22973, 0.007456, "-run", false], [311, 0.001493, " to", false], [882, 0.001204, " time", false], [323, 0.001141, " and", false], [11, 0.000983, ",", false], [12, 0.000648, "-", false], [4686, 0.000535, "-to", false]]]}, "raw_delta": 0.0724601149559021, "tuned_delta": 0.07979725346960484}, {"byte_start": 5291, "byte_end": 5292, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "4.54%", "qwen": "7.41%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.7774084210395813]], "qwen": [[11, ",", "normal", 0.6631759405136108]]}, "loss": {"rwkv": 4.543644049674714, "qwen": 7.406705344419314}, "topk": {"rwkv": [45, 1, 0.7774084210395813, [[45, 0.777408, ",", false], [21400, 0.10044, " but", false], [275, 0.033255, " (", false], [21265, 0.03286, " and", false], [32465, 0.007609, " when", false], [5346, 0.004334, "---", false], [4596, 0.003911, " in", false], [4450, 0.0036, " by", false], [31581, 0.002735, " only", false], [51018, 0.002565, " because", false]]], "qwen": [11, 1, 0.6631759405136108, [[11, 0.663176, ",", false], [714, 0.176976, " but", false], [320, 0.032339, " (", false], [323, 0.030976, " and", false], [220, 0.013957, " ", false], [979, 0.011009, " when", false], [553, 0.010002, " by", false], [4421, 0.009404, "---", false], [1576, 0.007255, " because", false], [304, 0.005778, " in", false]]]}, "raw_delta": -0.15876182913780212, "tuned_delta": -0.15142469062409938}, {"byte_start": 5292, "byte_end": 5296, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 893, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"rwkv": "6.52% 6.52% 6.52% 6.52%", "qwen": "6.55% 6.55% 6.55% 6.55%"}, "model_tokens": {"rwkv": [[21265, " and", "normal", 0.23724249005317688]], "qwen": [[323, " and", "normal", 0.23368458449840546]]}, "loss": {"rwkv": 6.516078675890093, "qwen": 6.55426742351418}, "topk": {"rwkv": [21265, 3, 0.23724249005317688, [[21400, 0.372369, " but", false], [286, 0.288768, " 3", false], [21265, 0.237242, " and", false], [30788, 0.006661, " even", false], [40076, 0.006458, " until", false], [4423, 0.006404, " as", false], [32465, 0.0064, " when", false], [51018, 0.004987, " because", false], [4596, 0.004566, " in", false], [39171, 0.004065, " often", false]]], "qwen": [323, 3, 0.23368458449840546, [[714, 0.386545, " but", false], [220, 0.264845, " ", false], [323, 0.233685, " and", false], [1496, 0.014745, " even", false], [979, 0.008836, " when", false], [1576, 0.006399, " because", false], [438, 0.006186, " as", false], [518, 0.004264, " at", false], [3602, 0.00402, " yet", false], [5310, 0.003229, " especially", false]]]}, "raw_delta": -0.002117633819580078, "tuned_delta": 0.0052195046941226585}, {"byte_start": 5296, "byte_end": 5299, "display": {"text": " is", "kind": "normal"}, "is_word": true, "word_id": 894, "word_key": " is", "bytes_hex": "20 69 73", "compression": {"rwkv": "34.56% 34.56% 34.56%", "qwen": "36.50% 36.50% 36.50%"}, "model_tokens": {"rwkv": [[4600, " is", "normal", 0.0031528789550065994]], "qwen": [[374, " is", "normal", 0.0023053758777678013]]}, "loss": {"rwkv": 34.564568687964744, "qwen": 36.50326031808084}, "topk": {"rwkv": [4600, 8, 0.0031528789550065994, [[286, 0.913054, " 3", false], [45, 0.009591, ",", false], [39171, 0.007465, " often", false], [60523, 0.005669, " sometimes", false], [31581, 0.004967, " only", false], [32227, 0.004297, " that", false], [4596, 0.004105, " in", false], [4600, 0.003153, " is", false], [32230, 0.002506, " then", false], [61959, 0.002092, " eventually", false]]], "qwen": [374, 10, 0.0023053758777678013, [[220, 0.928814, " ", false], [1172, 0.006544, " only", false], [1221, 0.005395, " then", false], [304, 0.005333, " in", false], [11, 0.003971, ",", false], [7025, 0.002931, " sometimes", false], [429, 0.002917, " that", false], [279, 0.002799, " the", false], [3545, 0.002413, " often", false], [374, 0.002305, " is", false]]]}, "raw_delta": -0.10750389099121072, "tuned_delta": -0.10016675247750798}, {"byte_start": 5299, "byte_end": 5310, "display": {"text": " personally", "kind": "normal"}, "is_word": true, "word_id": 895, "word_key": " personally", "bytes_hex": "20 70 65 72 73 6f 6e 61 6c 6c 79", "compression": {"rwkv": "12.96% 12.96% 12.96% 12.96% 12.96% 12.96% 12.96% 12.96% 12.96% 12.96% 12.96%", "qwen": "17.72% 17.72% 17.72% 17.72% 17.72% 17.72% 17.72% 17.72% 17.72% 17.72% 17.72%"}, "model_tokens": {"rwkv": [[62309, " personally", "normal", 0.00037499581230804324]], "qwen": [[15726, " personally", "normal", 2.0252231479389593e-05]]}, "loss": {"rwkv": 12.96171325798678, "qwen": 17.717680834502143}, "topk": {"rwkv": [62309, 211, 0.00037499581230804324, [[39171, 0.142439, " often", false], [332, 0.055391, " a", false], [60645, 0.038906, " therefore", false], [22187, 0.035886, " not", false], [60523, 0.033181, " sometimes", false], [45150, 0.028032, " always", false], [32386, 0.023923, " very", false], [57403, 0.020802, " tempting", false], [30724, 0.020626, " easy", false], [53248, 0.020399, " usually", false]]], "qwen": [15726, 1258, 2.0252231479389593e-05, [[3545, 0.115149, " often", false], [264, 0.065454, " a", false], [279, 0.055977, " the", false], [6966, 0.035276, " looked", false], [2677, 0.031695, " always", false], [7025, 0.025693, " sometimes", false], [8916, 0.023796, " therefore", false], [537, 0.022601, " not", false], [3884, 0.020386, " seen", false], [5310, 0.019291, " especially", false]]]}, "raw_delta": -0.263726841319691, "tuned_delta": -0.2563897028059883}, {"byte_start": 5310, "byte_end": 5321, "display": {"text": " satisfying", "kind": "normal"}, "is_word": true, "word_id": 896, "word_key": " satisfying", "bytes_hex": "20 73 61 74 69 73 66 79 69 6e 67", "compression": {"rwkv": "1.33% 1.33% 1.33% 1.33% 1.33% 1.33% 1.33% 1.33% 1.33% 1.33% 1.33%", "qwen": "0.86% 0.86% 0.86% 0.86% 0.86% 0.86% 0.86% 0.86% 0.86% 0.86% 0.86%"}, "model_tokens": {"rwkv": [[62527, " satisfying", "normal", 0.44267943501472473]], "qwen": [[36054, " satisfying", "normal", 0.5923541188240051]]}, "loss": {"rwkv": 1.325629765021375, "qwen": 0.858486580051204}, "topk": {"rwkv": [62527, 1, 0.44267943501472473, [[62527, 0.442679, " satisfying", false], [60428, 0.113433, " rewarding", false], [31004, 0.11089, " grat", false], [59154, 0.099145, " appealing", false], [61694, 0.028625, " comforting", false], [32386, 0.024179, " very", false], [21265, 0.023442, " and", false], [61617, 0.020291, " attractive", false], [56874, 0.01911, " pleasing", false], [62029, 0.006488, " fulfilling", false]]], "qwen": [36054, 1, 0.5923541188240051, [[36054, 0.592354, " satisfying", false], [40993, 0.13555, " rewarding", false], [8728, 0.07889, " grat", false], [49598, 0.032174, " fulfilling", false], [1602, 0.013924, " very", false], [32252, 0.01271, " appealing", false], [68030, 0.008722, " comforting", false], [88589, 0.008718, " motivating", false], [18879, 0.007923, " attractive", false], [5390, 0.007654, " useful", false]]]}, "raw_delta": 0.02590391852638937, "tuned_delta": 0.03324105704009211}, {"byte_start": 5321, "byte_end": 5324, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 897, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "8.55% 8.55% 8.55%", "qwen": "10.03% 10.03% 10.03%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.24071618914604187]], "qwen": [[311, " to", "normal", 0.18857607245445251]]}, "loss": {"rwkv": 8.547216713599978, "qwen": 10.02825677701511}, "topk": {"rwkv": [4811, 2, 0.24071618914604187, [[45, 0.581697, ",", false], [4811, 0.240716, " to", false], [21700, 0.051083, " for", false], [21265, 0.032757, " and", false], [4596, 0.023196, " in", false], [275, 0.011397, " (", false], [4423, 0.009719, " as", false], [51018, 0.008212, " because", false], [5346, 0.005623, "---", false], [47, 0.005075, ".", false]]], "qwen": [311, 2, 0.18857607245445251, [[11, 0.56908, ",", false], [311, 0.188576, " to", false], [369, 0.075684, " for", false], [304, 0.048536, " in", false], [323, 0.025997, " and", false], [320, 0.018352, " (", false], [1576, 0.011494, " because", false], [979, 0.007177, " when", false], [714, 0.006805, " but", false], [518, 0.006291, " at", false]]]}, "raw_delta": -0.08212629954020184, "tuned_delta": -0.0747891610264991}, {"byte_start": 5324, "byte_end": 5328, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 898, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "2.59% 2.59% 2.59% 2.59%", "qwen": "2.68% 2.68% 2.68% 2.68%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.5647656321525574]], "qwen": [[279, " the", "normal", 0.5514378547668457]]}, "loss": {"rwkv": 2.5888204469076856, "qwen": 2.6835307552920504}, "topk": {"rwkv": [22590, 1, 0.5647656321525574, [[22590, 0.564766, " the", false], [63843, 0.08505, " researchers", false], [4491, 0.079757, " do", false], [39944, 0.052605, " those", false], [32229, 0.029836, " them", false], [31059, 0.015981, " have", false], [32499, 0.014091, " work", false], [31370, 0.010594, " many", false], [332, 0.007475, " a", false], [39931, 0.006626, " their", false]]], "qwen": [279, 1, 0.5514378547668457, [[279, 0.551438, " the", false], [11811, 0.121601, " researchers", false], [653, 0.081151, " do", false], [1846, 0.069355, " those", false], [1936, 0.029654, " build", false], [1105, 0.010795, " them", false], [1430, 0.008679, " try", false], [1657, 0.007836, " many", false], [15235, 0.004722, " AI", false], [1490, 0.004643, " see", false]]]}, "raw_delta": -0.005251854658126831, "tuned_delta": 0.0020852838555759055}, {"byte_start": 5328, "byte_end": 5339, "display": {"text": " researcher", "kind": "normal"}, "is_word": true, "word_id": 899, "word_key": " researcher", "bytes_hex": "20 72 65 73 65 61 72 63 68 65 72", "compression": {"rwkv": "1.55% 1.55% 1.55% 1.55% 1.55% 1.55% 1.55% 1.55% 1.55% 1.55% 1.55%", "qwen": "2.10% 2.10% 2.10% 2.10% 2.10% 2.10% 2.10% 2.10% 2.10% 2.10% 2.10%"}, "model_tokens": {"rwkv": [[62496, " researcher", "normal", 0.3905523717403412]], "qwen": [[31085, " researcher", "normal", 0.2772934138774872]]}, "loss": {"rwkv": 1.549770063454941, "qwen": 2.1028576694971903}, "topk": {"rwkv": [62496, 1, 0.3905523717403412, [[62496, 0.390552, " researcher", false], [63843, 0.375702, " researchers", false], [37636, 0.06703, " agent", false], [3609, 0.035073, " AI", false], [45124, 0.018961, " agents", false], [38720, 0.014546, " human", false], [62105, 0.011832, " individual", false], [46787, 0.008724, " people", false], [46795, 0.005158, " person", false], [64951, 0.004536, " investigators", false]]], "qwen": [31085, 2, 0.2772934138774872, [[11811, 0.537529, " researchers", false], [31085, 0.277293, " researcher", false], [3738, 0.018354, " human", false], [13402, 0.012415, " developers", false], [8315, 0.01054, " agent", false], [1251, 0.010197, " people", false], [15235, 0.007937, " AI", false], [3412, 0.007739, " research", false], [3842, 0.007146, " individual", false], [12014, 0.007041, " authors", false]]]}, "raw_delta": -0.030669689178466797, "tuned_delta": -0.02333255066476406}, {"byte_start": 5339, "byte_end": 5340, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "3.29%", "qwen": "4.25%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.83455491065979]], "qwen": [[11, ",", "normal", 0.7900545597076416]]}, "loss": {"rwkv": 3.29326138484175, "qwen": 4.249697752169408}, "topk": {"rwkv": [45, 1, 0.83455491065979, [[45, 0.834555, ",", false], [22762, 0.035729, " who", false], [21265, 0.019913, " and", false], [275, 0.017545, " (", false], [47, 0.009351, ".", false], [4811, 0.008962, " to", false], [4596, 0.008855, " in", false], [51018, 0.006993, " because", false], [286, 0.005292, " 3", false], [21700, 0.004763, " for", false]]], "qwen": [11, 1, 0.7900545597076416, [[11, 0.790055, ",", false], [879, 0.068329, " who", false], [320, 0.024808, " (", false], [4421, 0.010228, "---", false], [323, 0.00911, " and", false], [4460, 0.008482, " trying", false], [311, 0.007447, " to", false], [13, 0.006437, ".", false], [3730, 0.00533, " doing", false], [1576, 0.004422, " because", false]]]}, "raw_delta": -0.05303609371185303, "tuned_delta": -0.04569895519815029}, {"byte_start": 5340, "byte_end": 5344, "display": {"text": " but", "kind": "normal"}, "is_word": true, "word_id": 900, "word_key": " but", "bytes_hex": "20 62 75 74", "compression": {"rwkv": "6.02% 6.02% 6.02% 6.02%", "qwen": "4.45% 4.45% 4.45% 4.45%"}, "model_tokens": {"rwkv": [[21400, " but", "normal", 0.2637294828891754]], "qwen": [[714, " but", "normal", 0.37229880690574646]]}, "loss": {"rwkv": 6.022970019336248, "qwen": 4.45458444626276}, "topk": {"rwkv": [21400, 3, 0.2637294828891754, [[286, 0.407244, " 3", false], [21265, 0.285138, " and", false], [21400, 0.263729, " but", false], [22762, 0.007188, " who", false], [30788, 0.003868, " even", false], [51018, 0.003375, " because", false], [4423, 0.002707, " as", false], [40187, 0.00194, " while", false], [4788, 0.001859, " so", false], [55495, 0.001751, " although", false]]], "qwen": [714, 1, 0.37229880690574646, [[714, 0.372299, " but", false], [323, 0.322522, " and", false], [220, 0.249809, " ", false], [1496, 0.006742, " even", false], [1576, 0.006304, " because", false], [3602, 0.003455, " yet", false], [438, 0.003381, " as", false], [1393, 0.002528, " while", false], [773, 0.002484, " so", false], [5310, 0.001837, " especially", false]]]}, "raw_delta": 0.0869697630405426, "tuned_delta": 0.09430690155424534}, {"byte_start": 5344, "byte_end": 5346, "display": {"text": " 3", "kind": "normal"}, "is_word": true, "word_id": 901, "word_key": " 3", "bytes_hex": "20 33", "compression": {"rwkv": "2.61% 2.61%", "qwen": "4.66% 0.05%"}, "model_tokens": {"rwkv": [[286, " 3", "normal", 0.746444821357727]], "qwen": [[220, " ", "normal", 0.7723115682601929], [18, "3", "normal", 0.9974400997161865]]}, "loss": {"rwkv": 2.606431470356037, "qwen": 2.35276879806534}, "topk": {"rwkv": [286, 1, 0.746444821357727, [[286, 0.746445, " 3", false], [45, 0.042478, ",", false], [4600, 0.022662, " is", false], [4596, 0.021105, " in", false], [4601, 0.016544, " it", false], [32227, 0.015763, " that", false], [62676, 0.012106, " ultimately", false], [31601, 0.011618, " over", false], [30659, 0.008569, " does", false], [61959, 0.008509, " eventually", false]]], "qwen": [220, 1, 0.7723115682601929, [[220, 0.772312, " ", false], [374, 0.023632, " is", false], [1558, 0.023287, " does", false], [304, 0.022494, " in", false], [432, 0.015446, " it", false], [537, 0.010833, " not", false], [2581, 0.007654, " never", false], [1172, 0.007199, " only", false], [13653, 0.006963, " ultimately", false], [279, 0.00546, " the", false]]]}, "raw_delta": 0.014066045288927853, "tuned_delta": 0.02140318380263059}, {"byte_start": 5346, "byte_end": 5347, "display": {"text": ")", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "29", "compression": {"rwkv": "0.02%", "qwen": "0.01%"}, "model_tokens": {"rwkv": [[42, ")", "normal", 0.9987402558326721]], "qwen": [[8, ")", "normal", 0.9994556307792664]]}, "loss": {"rwkv": 0.02297688215527123, "qwen": 0.009819685564566784}, "topk": {"rwkv": [42, 1, 0.9987402558326721, [[42, 0.99874, ")", false], [497, 0.000594, "),", false], [499, 8.5e-05, ").", false], [47, 7.3e-05, ".", false], [276, 6.4e-05, " )", false], [45, 5.8e-05, ",", false], [98, 4.6e-05, "a", false], [4600, 2.5e-05, " is", false], [492, 1.6e-05, ")'", false], [580, 1.5e-05, ".)", false]]], "qwen": [8, 1, 0.9994556307792664, [[8, 0.999456, ")", false], [64, 0.000158, "a", false], [701, 4.8e-05, "),", false], [873, 3e-05, " )", false], [11, 2.3e-05, ",", false], [65, 1.3e-05, "b", false], [13, 1.3e-05, ".", false], [340, 1.2e-05, ")\n", false], [692, 1.1e-05, ")\n\n", false], [568, 1e-05, ").", false]]]}, "raw_delta": 0.0007295898976735771, "tuned_delta": 0.008066728411376314}, {"byte_start": 5347, "byte_end": 5350, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 902, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "12.02% 12.02% 12.02%", "qwen": "12.09% 12.09% 12.09%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.13363482058048248]], "qwen": [[304, " in", "normal", 0.1338699460029602]]}, "loss": {"rwkv": 12.022458674074693, "qwen": 12.087900939105507}, "topk": {"rwkv": [4596, 2, 0.13363482058048248, [[4601, 0.217962, " it", false], [4596, 0.133635, " in", false], [22590, 0.111196, " the", false], [32234, 0.064051, " this", false], [31601, 0.043615, " over", false], [32227, 0.032741, " that", false], [32465, 0.025117, " when", false], [61959, 0.023342, " eventually", false], [4423, 0.015835, " as", false], [62676, 0.013959, " ultimately", false]]], "qwen": [304, 2, 0.1338699460029602, [[432, 0.22157, " it", false], [304, 0.13387, " in", false], [279, 0.106598, " the", false], [419, 0.075664, " this", false], [9583, 0.036889, " eventually", false], [916, 0.021513, " over", false], [979, 0.021205, " when", false], [438, 0.015544, " as", false], [13653, 0.013909, " ultimately", false], [1493, 0.012713, " these", false]]]}, "raw_delta": -0.0036288897196452563, "tuned_delta": 0.0037082487940574803}, {"byte_start": 5350, "byte_end": 5354, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 903, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "0.57% 0.57% 0.57% 0.57%", "qwen": "0.35% 0.35% 0.35% 0.35%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.8821444511413574]], "qwen": [[279, " the", "normal", 0.9242848753929138]]}, "loss": {"rwkv": 0.5679555062093392, "qwen": 0.35497037750131616}, "topk": {"rwkv": [22590, 1, 0.8821444511413574, [[22590, 0.882144, " the", false], [51832, 0.026633, " general", false], [56901, 0.018983, " practice", false], [332, 0.015514, " a", false], [31461, 0.007905, " most", false], [31323, 0.003302, " long", false], [45145, 0.00299, " almost", false], [39920, 0.002723, " terms", false], [30808, 0.002595, " fact", false], [31370, 0.002339, " many", false]]], "qwen": [279, 1, 0.9242848753929138, [[279, 0.924285, " the", false], [6588, 0.021992, " practice", false], [4586, 0.005897, " general", false], [2097, 0.004719, " fact", false], [76553, 0.003382, " retrospect", false], [8729, 0.003154, " reality", false], [1429, 0.003066, " most", false], [264, 0.002704, " a", false], [1657, 0.002187, " many", false], [3793, 0.002115, " terms", false]]]}, "raw_delta": 0.011810403317213058, "tuned_delta": 0.019147541830915795}, {"byte_start": 5354, "byte_end": 5359, "display": {"text": " long", "kind": "normal"}, "is_word": true, "word_id": 904, "word_key": " long", "bytes_hex": "20 6c 6f 6e 67", "compression": {"rwkv": "0.51% 0.51% 0.51% 0.51% 0.51%", "qwen": "0.23% 0.23% 0.23% 0.23% 0.23%"}, "model_tokens": {"rwkv": [[31323, " long", "normal", 0.8691374659538269]], "qwen": [[1293, " long", "normal", 0.9382081031799316]]}, "loss": {"rwkv": 0.5071974753125261, "qwen": 0.23005022816518658}, "topk": {"rwkv": [31323, 1, 0.8691374659538269, [[31323, 0.869137, " long", false], [46470, 0.094605, " longer", false], [21616, 0.008443, " end", false], [32386, 0.005919, " very", false], [46536, 0.001991, " medium", false], [31466, 0.001968, " much", false], [50837, 0.001484, " absence", false], [46397, 0.001106, " larger", false], [51310, 0.000752, " context", false], [30405, 0.000732, " case", false]]], "qwen": [1293, 1, 0.9382081031799316, [[1293, 0.938208, " long", false], [5021, 0.030905, " longer", false], [835, 0.014702, " end", false], [11051, 0.003611, " medium", false], [1602, 0.001793, " very", false], [2805, 0.001152, " short", false], [3930, 0.000565, " limit", false], [3853, 0.000481, " future", false], [1931, 0.000452, " real", false], [19265, 0.000355, " absence", false]]]}, "raw_delta": 0.015368306636810302, "tuned_delta": 0.022705445150513037}, {"byte_start": 5359, "byte_end": 5363, "display": {"text": " run", "kind": "normal"}, "is_word": true, "word_id": 905, "word_key": " run", "bytes_hex": "20 72 75 6e", "compression": {"rwkv": "1.54% 1.54% 1.54% 1.54%", "qwen": "1.93% 1.93% 1.93% 1.93%"}, "model_tokens": {"rwkv": [[22418, " run", "normal", 0.7096631526947021]], "qwen": [[1598, " run", "normal", 0.6518276333808899]]}, "loss": {"rwkv": 1.5409645517307653, "qwen": 1.929492304993734}, "topk": {"rwkv": [22418, 1, 0.7096631526947021, [[22418, 0.709663, " run", false], [32219, 0.279357, " term", false], [46, 0.006419, "-", false], [31057, 0.001167, " haul", false], [45, 0.000312, ",", false], [32251, 0.000275, " time", false], [27132, 0.000238, "term", false], [39438, 0.000178, " range", false], [21265, 0.000134, " and", false], [8661, 0.000128, "run", false]]], "qwen": [1598, 1, 0.6518276333808899, [[1598, 0.651828, " run", false], [4647, 0.340334, " term", false], [9663, 0.004076, "-term", false], [22973, 0.00116, "-run", false], [11, 0.000488, ",", false], [37868, 0.000388, " haul", false], [882, 0.000245, " time", false], [3793, 0.000145, " terms", false], [320, 9.5e-05, " (", false], [835, 7.2e-05, " end", false]]]}, "raw_delta": -0.021544553339481354, "tuned_delta": -0.014207414825778617}, {"byte_start": 5363, "byte_end": 5366, "display": {"text": " it", "kind": "normal"}, "is_word": true, "word_id": 906, "word_key": " it", "bytes_hex": "20 69 74", "compression": {"rwkv": "9.96% 9.96% 9.96%", "qwen": "9.72% 9.72% 9.72%"}, "model_tokens": {"rwkv": [[4601, " it", "normal", 0.18858477473258972]], "qwen": [[432, " it", "normal", 0.19834871590137482]]}, "loss": {"rwkv": 9.956098589468107, "qwen": 9.724538281968906}, "topk": {"rwkv": [4601, 2, 0.18858477473258972, [[45, 0.589363, ",", false], [4601, 0.188585, " it", false], [32234, 0.062363, " this", false], [22590, 0.04317, " the", false], [32139, 0.011705, " such", false], [39936, 0.011586, " these", false], [275, 0.005838, " (", false], [32227, 0.004628, " that", false], [4600, 0.004369, " is", false], [63370, 0.004097, " computation", false]]], "qwen": [432, 2, 0.19834871590137482, [[11, 0.483205, ",", false], [432, 0.198349, " it", false], [279, 0.080016, " the", false], [419, 0.063814, " this", false], [34447, 0.010684, " computation", false], [1052, 0.00918, " there", false], [1493, 0.007101, " these", false], [678, 0.006852, " all", false], [6540, 0.006494, " knowledge", false], [320, 0.006237, " (", false]]]}, "raw_delta": 0.012840429941813225, "tuned_delta": 0.02017756845551596}, {"byte_start": 5366, "byte_end": 5375, "display": {"text": " plateaus", "kind": "normal"}, "is_word": true, "word_id": 907, "word_key": " plateaus", "bytes_hex": "20 70 6c 61 74 65 61 75 73", "compression": {"rwkv": "29.45% 29.45% 29.45% 29.45% 29.45% 29.45% 29.45% 29.45% 0.15%", "qwen": "45.10% 45.10% 45.10% 45.10% 45.10% 45.10% 0.02% 0.02% 0.02%"}, "model_tokens": {"rwkv": [[52488, " plateau", "normal", 2.0826118998229504e-06], [116, "s", "normal", 0.9919663667678833]], "qwen": [[11968, " plate", "normal", 3.0405055895244004e-07], [11855, "aus", "normal", 0.9973642230033875]]}, "loss": {"rwkv": 26.190160141951715, "qwen": 30.073601910940067}, "topk": {"rwkv": [52488, 1483, 2.0826118998229504e-06, [[4600, 0.30865, " is", false], [30659, 0.116086, " does", false], [45150, 0.056235, " always", false], [39115, 0.05354, " never", false], [21800, 0.028512, " has", false], [39914, 0.02179, " tends", false], [38964, 0.018677, " makes", false], [45145, 0.018071, " almost", false], [40040, 0.017267, " turns", false], [39171, 0.016274, " often", false]]], "qwen": [11968, 3160, 3.0405055895244004e-07, [[374, 0.266822, " is", false], [1558, 0.1476, " does", false], [2677, 0.056765, " always", false], [43064, 0.033064, " hurts", false], [9044, 0.026317, " becomes", false], [702, 0.025968, " has", false], [305, 0.023234, " h", false], [1172, 0.021983, " only", false], [2581, 0.021418, " never", false], [83396, 0.020202, " harms", false]]]}, "raw_delta": -0.2153437370434402, "tuned_delta": -0.20800659852973746}, {"byte_start": 5375, "byte_end": 5379, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 908, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"rwkv": "6.20% 6.20% 6.20% 6.20%", "qwen": "6.21% 6.21% 6.21% 6.21%"}, "model_tokens": {"rwkv": [[21265, " and", "normal", 0.25260308384895325]], "qwen": [[323, " and", "normal", 0.25207898020744324]]}, "loss": {"rwkv": 6.199080253819764, "qwen": 6.212663121117438}, "topk": {"rwkv": [21265, 2, 0.25260308384895325, [[45, 0.378567, ",", false], [21265, 0.252603, " and", false], [4715, 0.205441, " or", false], [22249, 0.036908, " out", false], [4596, 0.024797, " in", false], [275, 0.01395, " (", false], [4424, 0.012351, " at", false], [47, 0.012207, ".", false], [4423, 0.006188, " as", false], [5346, 0.004662, "---", false]]], "qwen": [323, 2, 0.25207898020744324, [[11, 0.284829, ",", false], [323, 0.252079, " and", false], [476, 0.094555, " or", false], [4421, 0.054411, "---", false], [5068, 0.052599, " performance", false], [518, 0.037941, " at", false], [279, 0.025653, " the", false], [304, 0.02063, " in", false], [320, 0.018466, " (", false], [13, 0.016911, ".", false]]]}, "raw_delta": -0.0007531940937042236, "tuned_delta": 0.006583944419998513}, {"byte_start": 5379, "byte_end": 5384, "display": {"text": " even", "kind": "normal"}, "is_word": true, "word_id": 909, "word_key": " even", "bytes_hex": "20 65 76 65 6e", "compression": {"rwkv": "14.15% 14.15% 14.15% 14.15% 14.15%", "qwen": "10.78% 10.78% 10.78% 10.78% 10.78%"}, "model_tokens": {"rwkv": [[30788, " even", "normal", 0.019993936643004417]], "qwen": [[1496, " even", "normal", 0.05034052953124046]]}, "loss": {"rwkv": 14.145174033716009, "qwen": 10.780339488977937}, "topk": {"rwkv": [30788, 10, 0.019993936643004417, [[32230, 0.095664, " then", false], [4600, 0.090805, " is", false], [30659, 0.080777, " does", false], [51019, 0.057034, " becomes", false], [22590, 0.044803, " the", false], [61959, 0.040195, " eventually", false], [39115, 0.022556, " never", false], [38442, 0.021411, " fails", false], [39171, 0.021297, " often", false], [30788, 0.019994, " even", false]]], "qwen": [1496, 5, 0.05034052953124046, [[1221, 0.112166, " then", false], [9044, 0.086393, " becomes", false], [374, 0.068139, " is", false], [1558, 0.066127, " does", false], [1496, 0.050341, " even", false], [14525, 0.038145, " fails", false], [9583, 0.037363, " eventually", false], [3545, 0.026048, " often", false], [279, 0.025496, " the", false], [17066, 0.022589, " falls", false]]]}, "raw_delta": 0.1865860462188721, "tuned_delta": 0.19392318473257483}, {"byte_start": 5384, "byte_end": 5393, "display": {"text": " inhibits", "kind": "normal"}, "is_word": true, "word_id": 910, "word_key": " inhibits", "bytes_hex": "20 69 6e 68 69 62 69 74 73", "compression": {"rwkv": "10.71% 10.71% 10.71% 10.71% 10.71% 10.71% 10.71% 10.71% 0.01%", "qwen": "20.57% 20.57% 20.57% 20.57% 20.57% 20.57% 0.00% 0.00% 0.00%"}, "model_tokens": {"rwkv": [[52011, " inhibit", "normal", 0.008523152209818363], [116, "s", "normal", 0.9996360540390015]], "qwen": [[20142, " inhib", "normal", 0.0010657573584467173], [1199, "its", "normal", 0.9995834231376648]]}, "loss": {"rwkv": 9.518505932612776, "qwen": 13.714591980118762}, "topk": {"rwkv": [52011, 30, 0.008523152209818363, [[38724, 0.078135, " hurts", false], [46201, 0.067064, " hinder", false], [55929, 0.067002, " declines", false], [52688, 0.057722, " regress", false], [51417, 0.040217, " degrade", false], [51019, 0.037557, " becomes", false], [47396, 0.031181, " starts", false], [38447, 0.029174, " falls", false], [40216, 0.025792, " worse", false], [39719, 0.024733, " slows", false]]], "qwen": [20142, 91, 0.0010657573584467173, [[56954, 0.174928, " declines", false], [46193, 0.106602, " wors", false], [17066, 0.083355, " falls", false], [38336, 0.071724, " deterior", false], [9044, 0.038606, " becomes", false], [42054, 0.033706, " decreases", false], [5221, 0.029796, " gets", false], [5780, 0.026763, " goes", false], [14525, 0.019451, " fails", false], [69170, 0.017272, " slows", false]]]}, "raw_delta": -0.232680417057256, "tuned_delta": -0.22534327854355327}, {"byte_start": 5393, "byte_end": 5401, "display": {"text": " further", "kind": "normal"}, "is_word": true, "word_id": 911, "word_key": " further", "bytes_hex": "20 66 75 72 74 68 65 72", "compression": {"rwkv": "6.55% 6.55% 6.55% 6.55% 6.55% 6.55% 6.55% 6.55%", "qwen": "5.51% 5.51% 5.51% 5.51% 5.51% 5.51% 5.51% 5.51%"}, "model_tokens": {"rwkv": [[51816, " further", "normal", 0.05504672974348068]], "qwen": [[4623, " further", "normal", 0.0866326093673706]]}, "loss": {"rwkv": 6.551300722786796, "qwen": 5.513978227529439}, "topk": {"rwkv": [51816, 4, 0.05504672974348068, [[56950, 0.648015, " progress", false], [63750, 0.062711, " performance", false], [22590, 0.058397, " the", false], [51816, 0.055047, " further", false], [56537, 0.025416, " learning", false], [63621, 0.025084, " improvement", false], [57103, 0.018263, " research", false], [45, 0.016254, ",", false], [63469, 0.005838, " development", false], [46064, 0.005497, " future", false]]], "qwen": [4623, 3, 0.0866326093673706, [[5098, 0.393611, " progress", false], [5068, 0.238207, " performance", false], [4623, 0.086633, " further", false], [279, 0.064738, " the", false], [15673, 0.021279, " improvement", false], [3853, 0.013209, " future", false], [3412, 0.01273, " research", false], [2393, 0.009553, " success", false], [1293, 0.009438, " long", false], [11, 0.009293, ",", false]]]}, "raw_delta": 0.05752137303352356, "tuned_delta": 0.0648585115472263}, {"byte_start": 5401, "byte_end": 5410, "display": {"text": " progress", "kind": "normal"}, "is_word": true, "word_id": 912, "word_key": " progress", "bytes_hex": "20 70 72 6f 67 72 65 73 73", "compression": {"rwkv": "0.47% 0.47% 0.47% 0.47% 0.47% 0.47% 0.47% 0.47% 0.47%", "qwen": "0.73% 0.73% 0.73% 0.73% 0.73% 0.73% 0.73% 0.73% 0.73%"}, "model_tokens": {"rwkv": [[56950, " progress", "normal", 0.789636492729187]], "qwen": [[5098, " progress", "normal", 0.6947980523109436]]}, "loss": {"rwkv": 0.4735408527223431, "qwen": 0.7296311412600225}, "topk": {"rwkv": [56950, 1, 0.789636492729187, [[56950, 0.789636, " progress", false], [63621, 0.062161, " improvement", false], [63469, 0.023507, " development", false], [57103, 0.022632, " research", false], [63750, 0.016689, " performance", false], [56537, 0.015099, " learning", false], [64423, 0.009054, " improvements", false], [55465, 0.007005, " advances", false], [53052, 0.005407, " success", false], [50862, 0.004942, " advance", false]]], "qwen": [5098, 1, 0.6947980523109436, [[5098, 0.694798, " progress", false], [15673, 0.081768, " improvement", false], [5068, 0.06162, " performance", false], [19619, 0.038062, " gains", false], [18142, 0.027084, " improvements", false], [29903, 0.015329, " advances", false], [4401, 0.011739, " development", false], [2393, 0.011474, " success", false], [3412, 0.004793, " research", false], [11912, 0.004657, " advance", false]]]}, "raw_delta": -0.014200660917494033, "tuned_delta": -0.006863522403791296}, {"byte_start": 5410, "byte_end": 5411, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "16.98%", "qwen": "24.12%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.3881472647190094]], "qwen": [[11, ",", "normal", 0.2625139057636261]]}, "loss": {"rwkv": 16.977026604210945, "qwen": 24.11917802360319}, "topk": {"rwkv": [45, 2, 0.3881472647190094, [[47, 0.440912, ".", false], [45, 0.388147, ",", false], [21265, 0.022601, " and", false], [5346, 0.018602, "---", false], [4450, 0.015193, " by", false], [4596, 0.014046, " in", false], [4423, 0.013955, " as", false], [51018, 0.013793, " because", false], [275, 0.013353, " (", false], [60, 0.011975, ";", false]]], "qwen": [11, 2, 0.2625139057636261, [[13, 0.474898, ".", false], [11, 0.262514, ",", false], [382, 0.117923, ".\n\n", false], [304, 0.022742, " in", false], [1576, 0.016775, " because", false], [320, 0.014746, " (", false], [323, 0.010745, " and", false], [553, 0.010258, " by", false], [4421, 0.008457, "---", false], [624, 0.007372, ".\n", false]]]}, "raw_delta": -0.3960449695587158, "tuned_delta": -0.3887078310450131}, {"byte_start": 5411, "byte_end": 5415, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 913, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"rwkv": "2.87% 2.87% 2.87% 2.87%", "qwen": "2.82% 2.82% 2.82% 2.82%"}, "model_tokens": {"rwkv": [[21265, " and", "normal", 0.5254503488540649]], "qwen": [[323, " and", "normal", 0.535361111164093]]}, "loss": {"rwkv": 2.8705968220813114, "qwen": 2.8169242614217325}, "topk": {"rwkv": [21265, 1, 0.5254503488540649, [[21265, 0.52545, " and", false], [287, 0.149123, " 4", false], [40187, 0.048818, " while", false], [51018, 0.04701, " because", false], [4423, 0.032275, " as", false], [53339, 0.023386, " whereas", false], [4715, 0.008269, " or", false], [61953, 0.007746, " especially", false], [32465, 0.007296, " when", false], [40186, 0.0068, " which", false]]], "qwen": [323, 1, 0.535361111164093, [[323, 0.535361, " and", false], [220, 0.107731, " ", false], [1576, 0.095174, " because", false], [438, 0.060538, " as", false], [1393, 0.013686, " while", false], [1496, 0.010414, " even", false], [4152, 0.009644, " due", false], [2474, 0.009604, " since", false], [304, 0.008119, " in", false], [773, 0.007076, " so", false]]]}, "raw_delta": 0.00297623872756958, "tuned_delta": 0.010313377241272317}, {"byte_start": 5415, "byte_end": 5417, "display": {"text": " 4", "kind": "normal"}, "is_word": true, "word_id": 914, "word_key": " 4", "bytes_hex": "20 34", "compression": {"rwkv": "1.29% 1.29%", "qwen": "2.80% 0.02%"}, "model_tokens": {"rwkv": [[287, " 4", "normal", 0.8668489456176758]], "qwen": [[220, " ", "normal", 0.8563111424446106], [19, "4", "normal", 0.9990171194076538]]}, "loss": {"rwkv": 1.285604711729667, "qwen": 1.407572999090544}, "topk": {"rwkv": [287, 1, 0.8668489456176758, [[287, 0.866849, " 4", false], [4600, 0.0103, " is", false], [32227, 0.009019, " that", false], [45, 0.008357, ",", false], [22590, 0.007527, " the", false], [51744, 0.006446, " finally", false], [61959, 0.005861, " eventually", false], [4601, 0.005507, " it", false], [4596, 0.00406, " in", false], [30788, 0.003195, " even", false]]], "qwen": [220, 1, 0.8563111424446106, [[220, 0.856311, " ", false], [429, 0.02449, " that", false], [374, 0.014326, " is", false], [304, 0.01074, " in", false], [279, 0.009291, " the", false], [5499, 0.005781, " finally", false], [11, 0.005532, ",", false], [432, 0.003642, " it", false], [3545, 0.002983, " often", false], [9583, 0.002595, " eventually", false]]]}, "raw_delta": -0.006763357960153371, "tuned_delta": 0.0005737805535493655}, {"byte_start": 5417, "byte_end": 5418, "display": {"text": ")", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "29", "compression": {"rwkv": "0.02%", "qwen": "0.01%"}, "model_tokens": {"rwkv": [[42, ")", "normal", 0.9986403584480286]], "qwen": [[8, ")", "normal", 0.9994415640830994]]}, "loss": {"rwkv": 0.0243527433621737, "qwen": 0.010073219314950659}, "topk": {"rwkv": [42, 1, 0.9986403584480286, [[42, 0.99864, ")", false], [497, 0.000253, "),", false], [499, 0.000208, ").", false], [47, 0.00017, ".", false], [276, 0.000156, " )", false], [98, 9.2e-05, "a", false], [45, 8.2e-05, ",", false], [580, 5.3e-05, ".)", false], [22590, 3.5e-05, " the", false], [32227, 2.6e-05, " that", false]]], "qwen": [8, 1, 0.9994415640830994, [[8, 0.999442, ")", false], [701, 0.000149, "),", false], [11, 4.9e-05, ",", false], [64, 4.9e-05, "a", false], [873, 4.5e-05, " )", false], [568, 1.8e-05, ").", false], [13, 1.6e-05, ".", false], [6138, 1.3e-05, ".)", false], [323, 1.3e-05, " and", false], [692, 1.2e-05, ")\n\n", false]]]}, "raw_delta": 0.0007918249466456473, "tuned_delta": 0.008128963460348384}, {"byte_start": 5418, "byte_end": 5431, "display": {"text": " breakthrough", "kind": "normal"}, "is_word": true, "word_id": 915, "word_key": " breakthrough", "bytes_hex": "20 62 72 65 61 6b 74 68 72 6f 75 67 68", "compression": {"rwkv": "12.92% 12.92% 12.92% 12.92% 12.92% 12.92% 12.92% 12.92% 12.92% 12.92% 12.92% 12.92% 12.92%", "qwen": "12.14% 12.14% 12.14% 12.14% 12.14% 12.14% 12.14% 12.14% 12.14% 12.14% 12.14% 12.14% 12.14%"}, "model_tokens": {"rwkv": [[64266, " breakthrough", "normal", 8.767345570959151e-05]], "qwen": [[41345, " breakthrough", "normal", 0.00015804381109774113]]}, "loss": {"rwkv": 12.918363046421609, "qwen": 12.14171849988146}, "topk": {"rwkv": [64266, 346, 8.767345570959151e-05, [[22590, 0.223736, " the", false], [4601, 0.067109, " it", false], [4596, 0.060295, " in", false], [52028, 0.055638, " instead", false], [39934, 0.033519, " there", false], [32234, 0.028395, " this", false], [52224, 0.025935, " methods", false], [32465, 0.024755, " when", false], [332, 0.02386, " a", false], [32227, 0.021687, " that", false]]], "qwen": [41345, 300, 0.00015804381109774113, [[279, 0.178854, " the", false], [304, 0.09324, " in", false], [432, 0.061079, " it", false], [419, 0.046795, " this", false], [1052, 0.037482, " there", false], [979, 0.030111, " when", false], [438, 0.018218, " as", false], [582, 0.016687, " we", false], [429, 0.016293, " that", false], [20219, 0.015668, " Moore", false]]]}, "raw_delta": 0.04306631821852469, "tuned_delta": 0.05040345673222743}, {"byte_start": 5431, "byte_end": 5440, "display": {"text": " progress", "kind": "normal"}, "is_word": true, "word_id": 916, "word_key": " progress", "bytes_hex": "20 70 72 6f 67 72 65 73 73", "compression": {"rwkv": "5.01% 5.01% 5.01% 5.01% 5.01% 5.01% 5.01% 5.01% 5.01%", "qwen": "6.42% 6.42% 6.42% 6.42% 6.42% 6.42% 6.42% 6.42% 6.42%"}, "model_tokens": {"rwkv": [[56950, " progress", "normal", 0.08279954642057419]], "qwen": [[5098, " progress", "normal", 0.040597595274448395]]}, "loss": {"rwkv": 5.009357780864455, "qwen": 6.420086081581431}, "topk": {"rwkv": [56950, 2, 0.08279954642057419, [[116, 0.767463, "s", false], [56950, 0.0828, " progress", false], [52224, 0.060839, " methods", false], [63750, 0.009698, " performance", false], [64423, 0.008952, " improvements", false], [62633, 0.007535, " techniques", false], [57103, 0.00728, " research", false], [52738, 0.006113, " results", false], [55465, 0.005914, " advances", false], [61590, 0.004575, " approaches", false]]], "qwen": [5098, 2, 0.040597595274448395, [[82, 0.860475, "s", false], [5098, 0.040598, " progress", false], [5413, 0.019827, " methods", false], [3059, 0.011784, " results", false], [29903, 0.004517, " advances", false], [3412, 0.004024, " research", false], [18142, 0.003056, " improvements", false], [15235, 0.003025, " AI", false], [4041, 0.002972, " comes", false], [5068, 0.002947, " performance", false]]]}, "raw_delta": -0.07822738753424752, "tuned_delta": -0.07089024902054478}, {"byte_start": 5440, "byte_end": 5451, "display": {"text": " eventually", "kind": "normal"}, "is_word": true, "word_id": 917, "word_key": " eventually", "bytes_hex": "20 65 76 65 6e 74 75 61 6c 6c 79", "compression": {"rwkv": "11.12% 11.12% 11.12% 11.12% 11.12% 11.12% 11.12% 11.12% 11.12% 11.12% 11.12%", "qwen": "7.91% 7.91% 7.91% 7.91% 7.91% 7.91% 7.91% 7.91% 7.91% 7.91% 7.91%"}, "model_tokens": {"rwkv": [[61959, " eventually", "normal", 0.0011233455734327435]], "qwen": [[9583, " eventually", "normal", 0.008022933267056942]]}, "loss": {"rwkv": 11.117358802304864, "qwen": 7.910971326589175}, "topk": {"rwkv": [61959, 51, 0.0011233455734327435, [[4600, 0.271174, " is", false], [38087, 0.141363, " comes", false], [21800, 0.085821, " has", false], [4596, 0.071368, " in", false], [45150, 0.058056, " always", false], [21413, 0.050944, " can", false], [45, 0.026541, ",", false], [46697, 0.023706, " occurs", false], [57102, 0.022285, " requires", false], [45145, 0.017331, " almost", false]]], "qwen": [9583, 19, 0.008022933267056942, [[374, 0.216913, " is", false], [4041, 0.17991, " comes", false], [304, 0.122485, " in", false], [702, 0.053817, " has", false], [13666, 0.036241, " occurs", false], [2677, 0.034178, " always", false], [7460, 0.031665, " requires", false], [8573, 0.028992, " happens", false], [646, 0.028319, " can", false], [3545, 0.019932, " often", false]]]}, "raw_delta": 0.17779987508600412, "tuned_delta": 0.18513701359970686}, {"byte_start": 5451, "byte_end": 5459, "display": {"text": " arrives", "kind": "normal"}, "is_word": true, "word_id": 918, "word_key": " arrives", "bytes_hex": "20 61 72 72 69 76 65 73", "compression": {"rwkv": "8.98% 8.98% 8.98% 8.98% 8.98% 8.98% 8.98% 8.98%", "qwen": "8.48% 8.48% 8.48% 8.48% 8.48% 8.48% 8.48% 8.48%"}, "model_tokens": {"rwkv": [[50956, " arrives", "normal", 0.01836257614195347]], "qwen": [[29682, " arrives", "normal", 0.02329213172197342]]}, "loss": {"rwkv": 8.981621958659318, "qwen": 8.475021263145285}, "topk": {"rwkv": [50956, 7, 0.01836257614195347, [[38087, 0.650356, " comes", false], [46697, 0.062907, " occurs", false], [57102, 0.038997, " requires", false], [51896, 0.032624, " happens", false], [30659, 0.020312, " does", false], [4600, 0.019042, " is", false], [50956, 0.018363, " arrives", false], [45199, 0.013405, " arises", false], [51586, 0.011251, " emerges", false], [52738, 0.008406, " results", false]]], "qwen": [29682, 7, 0.02329213172197342, [[4041, 0.635852, " comes", false], [8573, 0.055551, " happens", false], [13666, 0.050596, " occurs", false], [7460, 0.040678, " requires", false], [3697, 0.023872, " came", false], [3059, 0.023389, " results", false], [29682, 0.023292, " arrives", false], [13798, 0.013052, " depends", false], [33644, 0.009571, " relies", false], [702, 0.009373, " has", false]]]}, "raw_delta": 0.028091907501220703, "tuned_delta": 0.03542904601492344}, {"byte_start": 5459, "byte_end": 5462, "display": {"text": " by", "kind": "normal"}, "is_word": true, "word_id": 919, "word_key": " by", "bytes_hex": "20 62 79", "compression": {"rwkv": "14.37% 14.37% 14.37%", "qwen": "13.84% 13.84% 13.84%"}, "model_tokens": {"rwkv": [[4450, " by", "normal", 0.09121424704790115]], "qwen": [[553, " by", "normal", 0.0999731495976448]]}, "loss": {"rwkv": 14.370595133854907, "qwen": 13.842981024782954}, "topk": {"rwkv": [4450, 3, 0.09121424704790115, [[32465, 0.241468, " when", false], [30917, 0.147226, " from", false], [4450, 0.091214, " by", false], [31581, 0.084687, " only", false], [53140, 0.075515, " through", false], [45, 0.040869, ",", false], [32487, 0.031839, " with", false], [22705, 0.031656, " via", false], [32227, 0.029131, " that", false], [4423, 0.028353, " as", false]]], "qwen": [553, 3, 0.0999731495976448, [[979, 0.241971, " when", false], [504, 0.153203, " from", false], [553, 0.099973, " by", false], [1526, 0.089356, " through", false], [11, 0.072803, ",", false], [304, 0.045917, " in", false], [1172, 0.044993, " only", false], [448, 0.036462, " with", false], [518, 0.023641, " at", false], [429, 0.023147, " that", false]]]}, "raw_delta": 0.029257138570149777, "tuned_delta": 0.03659427708385252}, {"byte_start": 5462, "byte_end": 5465, "display": {"text": " an", "kind": "normal"}, "is_word": true, "word_id": 920, "word_key": " an", "bytes_hex": "20 61 6e", "compression": {"rwkv": "35.50% 35.50% 35.50%", "qwen": "35.53% 35.53% 35.53%"}, "model_tokens": {"rwkv": [[4419, " an", "normal", 0.0027575676795095205]], "qwen": [[458, " an", "normal", 0.0027115787379443645]]}, "loss": {"rwkv": 35.50382327187683, "qwen": 35.52771166208167}, "topk": {"rwkv": [4419, 49, 0.0027575676795095205, [[38888, 0.125534, " lever", false], [40085, 0.080613, " using", false], [47497, 0.072147, " taking", false], [59611, 0.070695, " embracing", false], [46500, 0.045172, " making", false], [38989, 0.041409, " means", false], [55666, 0.038014, " building", false], [332, 0.025407, " a", false], [39193, 0.025322, " other", false], [22590, 0.016548, " the", false]]], "qwen": [458, 61, 0.0027115787379443645, [[76482, 0.117065, " leveraging", false], [1667, 0.062866, " using", false], [55401, 0.034076, " embracing", false], [4752, 0.031185, " building", false], [18950, 0.026335, " applying", false], [264, 0.025556, " a", false], [4633, 0.025075, " taking", false], [77239, 0.025066, " abandoning", false], [7218, 0.022691, " moving", false], [4936, 0.022481, " simply", false]]]}, "raw_delta": -0.0013246536254882812, "tuned_delta": 0.006012484888214455}, {"byte_start": 5465, "byte_end": 5474, "display": {"text": " opposing", "kind": "normal"}, "is_word": true, "word_id": 921, "word_key": " opposing", "bytes_hex": "20 6f 70 70 6f 73 69 6e 67", "compression": {"rwkv": "14.09% 14.09% 14.09% 14.09% 14.09% 14.09% 14.09% 14.09% 14.09%", "qwen": "17.69% 17.69% 17.69% 17.69% 17.69% 17.69% 17.69% 17.69% 17.69%"}, "model_tokens": {"rwkv": [[56766, " opposing", "normal", 0.0008981300634332001]], "qwen": [[30222, " opposing", "normal", 0.00014682918845210224]]}, "loss": {"rwkv": 14.088818758681281, "qwen": 17.685518689032}, "topk": {"rwkv": [56766, 59, 0.0008981300634332001, [[63277, 0.39002, " alternative", false], [56131, 0.239348, " entirely", false], [55532, 0.098231, " approach", false], [59121, 0.01591, " alternate", false], [63627, 0.014923, " independent", false], [39193, 0.012271, " other", false], [56767, 0.008406, " opposite", false], [62688, 0.007653, " unexpected", false], [37636, 0.007501, " agent", false], [56438, 0.006043, " indirect", false]]], "qwen": [30222, 267, 0.00014682918845210224, [[11368, 0.350579, " entirely", false], [5486, 0.224518, " approach", false], [10555, 0.062742, " alternative", false], [7373, 0.0206, " effective", false], [9489, 0.020104, " independent", false], [650, 0.017477, " un", false], [16500, 0.016767, " unexpected", false], [3766, 0.016207, " application", false], [30055, 0.015551, " altogether", false], [4558, 0.010551, " almost", false]]]}, "raw_delta": -0.1994433932834201, "tuned_delta": -0.19210625476971735}, {"byte_start": 5474, "byte_end": 5483, "display": {"text": " approach", "kind": "normal"}, "is_word": true, "word_id": 922, "word_key": " approach", "bytes_hex": "20 61 70 70 72 6f 61 63 68", "compression": {"rwkv": "4.38% 4.38% 4.38% 4.38% 4.38% 4.38% 4.38% 4.38% 4.38%", "qwen": "3.28% 3.28% 3.28% 3.28% 3.28% 3.28% 3.28% 3.28% 3.28%"}, "model_tokens": {"rwkv": [[55532, " approach", "normal", 0.11291785538196564]], "qwen": [[5486, " approach", "normal", 0.19462503492832184]]}, "loss": {"rwkv": 4.3831880582563985, "qwen": 3.279487246561189}, "topk": {"rwkv": [55532, 3, 0.11291785538196564, [[39552, 0.382084, " route", false], [46561, 0.11372, " method", false], [55532, 0.112918, " approach", false], [31637, 0.068942, " path", false], [45, 0.059852, ",", false], [57317, 0.04228, " strategy", false], [38989, 0.026891, " means", false], [51832, 0.020824, " general", false], [38536, 0.019925, " force", false], [59526, 0.018227, " direction", false]]], "qwen": [5486, 2, 0.19462503492832184, [[6021, 0.198698, " route", false], [5486, 0.194625, " approach", false], [1714, 0.128327, " method", false], [3363, 0.111152, " means", false], [1815, 0.099305, " path", false], [11, 0.036819, ",", false], [5344, 0.02711, " force", false], [8282, 0.026197, " strategy", false], [16953, 0.015982, " mechanism", false], [1882, 0.014992, " process", false]]]}, "raw_delta": 0.061202168464660645, "tuned_delta": 0.06853930697836338}, {"byte_start": 5483, "byte_end": 5489, "display": {"text": " based", "kind": "normal"}, "is_word": true, "word_id": 923, "word_key": " based", "bytes_hex": "20 62 61 73 65 64", "compression": {"rwkv": "10.47% 10.47% 10.47% 10.47% 10.47% 10.47%", "qwen": "11.40% 11.40% 11.40% 11.40% 11.40% 11.40%"}, "model_tokens": {"rwkv": [[37810, " based", "normal", 0.03023824654519558]], "qwen": [[3118, " based", "normal", 0.022526785731315613]]}, "loss": {"rwkv": 10.472688610619752, "qwen": 11.400447587510417}, "topk": {"rwkv": [37810, 5, 0.03023824654519558, [[32227, 0.342876, " that", false], [45, 0.246688, ",", false], [47, 0.132666, ".", false], [5346, 0.115348, "---", false], [37810, 0.030238, " based", false], [59, 0.020029, ":", false], [4706, 0.019678, " of", false], [275, 0.013884, " (", false], [21265, 0.011955, " and", false], [4811, 0.009926, " to", false]]], "qwen": [3118, 8, 0.022526785731315613, [[429, 0.246227, " that", false], [11, 0.240545, ",", false], [4421, 0.184119, "---", false], [13, 0.09639, ".", false], [25, 0.051621, ":", false], [315, 0.030846, " of", false], [382, 0.028947, ".\n\n", false], [3118, 0.022527, " based", false], [320, 0.021723, " (", false], [311, 0.01038, " to", false]]]}, "raw_delta": -0.05144588152567553, "tuned_delta": -0.04410874301197279}, {"byte_start": 5489, "byte_end": 5492, "display": {"text": " on", "kind": "normal"}, "is_word": true, "word_id": 924, "word_key": " on", "bytes_hex": "20 6f 6e", "compression": {"rwkv": "0.51% 0.51% 0.51%", "qwen": "0.40% 0.40% 0.40%"}, "model_tokens": {"rwkv": [[4712, " on", "normal", 0.9193049669265747]], "qwen": [[389, " on", "normal", 0.9363231658935547]]}, "loss": {"rwkv": 0.5077845094274712, "qwen": 0.39550657634180847}, "topk": {"rwkv": [4712, 1, 0.9193049669265747, [[4712, 0.919305, " on", false], [31581, 0.014346, " only", false], [47330, 0.013137, " solely", false], [22187, 0.008035, " not", false], [31458, 0.007765, " more", false], [46957, 0.006237, " purely", false], [52028, 0.003362, " instead", false], [56131, 0.003359, " entirely", false], [4596, 0.003175, " in", false], [47285, 0.001917, " simply", false]]], "qwen": [389, 1, 0.9363231658935547, [[389, 0.936323, " on", false], [21063, 0.011515, " solely", false], [31127, 0.005355, " purely", false], [1172, 0.004652, " only", false], [537, 0.004412, " not", false], [803, 0.004253, " more", false], [304, 0.003795, " in", false], [11368, 0.003471, " entirely", false], [13771, 0.002031, " largely", false], [4558, 0.001982, " almost", false]]]}, "raw_delta": 0.006226010620594025, "tuned_delta": 0.013563149134296761}, {"byte_start": 5492, "byte_end": 5500, "display": {"text": " scaling", "kind": "normal"}, "is_word": true, "word_id": 925, "word_key": " scaling", "bytes_hex": "20 73 63 61 6c 69 6e 67", "compression": {"rwkv": "16.13% 16.13% 16.13% 16.13% 16.13% 16.13% 16.13% 16.13%", "qwen": "12.54% 12.54% 12.54% 12.54% 12.54% 12.54% 12.54% 12.54%"}, "model_tokens": {"rwkv": [[52805, " scaling", "normal", 0.0007733011734671891]], "qwen": [[26943, " scaling", "normal", 0.003844857681542635]]}, "loss": {"rwkv": 16.131697478690068, "qwen": 12.535710082016466}, "topk": {"rwkv": [52805, 56, 0.0007733011734671891, [[52195, 0.464863, " massive", false], [63370, 0.173622, " computation", false], [59988, 0.040389, " massively", false], [38888, 0.034736, " lever", false], [22590, 0.032136, " the", false], [51832, 0.020182, " general", false], [47202, 0.017789, " search", false], [31458, 0.01221, " more", false], [332, 0.011054, " a", false], [31466, 0.009629, " much", false]]], "qwen": [26943, 27, 0.003844857681542635, [[76482, 0.224468, " leveraging", false], [34447, 0.194775, " computation", false], [10951, 0.113851, " massive", false], [279, 0.040022, " the", false], [63707, 0.024968, " massively", false], [2711, 0.022049, " search", false], [32064, 0.02161, " leverage", false], [4586, 0.019638, " general", false], [6832, 0.014682, " learning", false], [54480, 0.013875, " computational", false]]]}, "raw_delta": 0.19940388202667236, "tuned_delta": 0.2067410205403751}, {"byte_start": 5500, "byte_end": 5512, "display": {"text": " computation", "kind": "normal"}, "is_word": true, "word_id": 926, "word_key": " computation", "bytes_hex": "20 63 6f 6d 70 75 74 61 74 69 6f 6e", "compression": {"rwkv": "1.02% 1.02% 1.02% 1.02% 1.02% 1.02% 1.02% 1.02% 1.02% 1.02% 1.02% 1.02%", "qwen": "2.47% 2.47% 2.47% 2.47% 2.47% 2.47% 2.47% 2.47% 2.47% 2.47% 2.47% 2.47%"}, "model_tokens": {"rwkv": [[63370, " computation", "normal", 0.506813108921051]], "qwen": [[34447, " computation", "normal", 0.1930505931377411]]}, "loss": {"rwkv": 1.0155690188549422, "qwen": 2.471822082714474}, "topk": {"rwkv": [63370, 1, 0.506813108921051, [[63370, 0.506813, " computation", false], [4833, 0.248318, " up", false], [21265, 0.047897, " and", false], [45, 0.025378, ",", false], [52195, 0.020054, " massive", false], [47, 0.014108, ".", false], [4706, 0.012979, " of", false], [64862, 0.011904, " computational", false], [22590, 0.010527, " the", false], [46, 0.006845, "-", false]]], "qwen": [34447, 2, 0.1930505931377411, [[705, 0.524018, " up", false], [34447, 0.193051, " computation", false], [5239, 0.053742, "-up", false], [279, 0.033484, " the", false], [63707, 0.019079, " massively", false], [323, 0.01254, " and", false], [700, 0.010937, " out", false], [990, 0.010724, " use", false], [315, 0.010249, " of", false], [10951, 0.009639, " massive", false]]]}, "raw_delta": -0.08075181643168135, "tuned_delta": -0.07341467791797861}, {"byte_start": 5512, "byte_end": 5515, "display": {"text": " by", "kind": "normal"}, "is_word": true, "word_id": 927, "word_key": " by", "bytes_hex": "20 62 79", "compression": {"rwkv": "26.67% 26.67% 26.67%", "qwen": "23.53% 23.53% 23.53%"}, "model_tokens": {"rwkv": [[4450, " by", "normal", 0.011968706734478474]], "qwen": [[553, " by", "normal", 0.019953183829784393]]}, "loss": {"rwkv": 26.67483018310323, "qwen": 23.530156075851913}, "topk": {"rwkv": [4450, 11, 0.011968706734478474, [[21265, 0.309914, " and", false], [47, 0.238352, ".", false], [45, 0.142668, ",", false], [4811, 0.059102, " to", false], [275, 0.025202, " (", false], [4833, 0.023403, " up", false], [47001, 0.020411, " rather", false], [4596, 0.018678, " in", false], [5346, 0.017122, "---", false], [4715, 0.013533, " or", false]]], "qwen": [553, 8, 0.019953183829784393, [[13, 0.347101, ".", false], [382, 0.137095, ".\n\n", false], [11, 0.105796, ",", false], [311, 0.075456, " to", false], [323, 0.055648, " and", false], [705, 0.049668, " up", false], [4421, 0.022753, "---", false], [553, 0.019953, " by", false], [320, 0.015454, " (", false], [4751, 0.014441, " rather", false]]]}, "raw_delta": 0.17437775929768895, "tuned_delta": 0.1817148978113917}, {"byte_start": 5515, "byte_end": 5522, "display": {"text": " search", "kind": "normal"}, "is_word": true, "word_id": 928, "word_key": " search", "bytes_hex": "20 73 65 61 72 63 68", "compression": {"rwkv": "11.51% 11.51% 11.51% 11.51% 11.51% 11.51% 11.51%", "qwen": "17.54% 17.54% 17.54% 17.54% 17.54% 17.54% 17.54%"}, "model_tokens": {"rwkv": [[47202, " search", "normal", 0.01159964594990015]], "qwen": [[2711, " search", "normal", 0.001106332871131599]]}, "loss": {"rwkv": 11.512577614236704, "qwen": 17.53571224553878}, "topk": {"rwkv": [47202, 11, 0.01159964594990015, [[37045, 0.257139, " Moore", false], [52195, 0.22534, " massive", false], [59988, 0.070571, " massively", false], [332, 0.06206, " a", false], [38888, 0.047516, " lever", false], [40085, 0.027166, " using", false], [22590, 0.018027, " the", false], [38989, 0.013977, " means", false], [4419, 0.013775, " an", false], [51832, 0.012269, " general", false]]], "qwen": [2711, 77, 0.001106332871131599, [[20219, 0.245247, " Moore", false], [264, 0.113989, " a", false], [76482, 0.085343, " leveraging", false], [279, 0.025898, " the", false], [63707, 0.024991, " massively", false], [10951, 0.02362, " massive", false], [1667, 0.023573, " using", false], [803, 0.022908, " more", false], [10163, 0.020346, " orders", false], [458, 0.019338, " an", false]]]}, "raw_delta": -0.3339935030255999, "tuned_delta": -0.32665636451189717}, {"byte_start": 5522, "byte_end": 5526, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 929, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"rwkv": "4.24% 4.24% 4.24% 4.24%", "qwen": "1.60% 1.60% 1.60% 1.60%"}, "model_tokens": {"rwkv": [[21265, " and", "normal", 0.3881458044052124]], "qwen": [[323, " and", "normal", 0.7012136578559875]]}, "loss": {"rwkv": 4.244256651052736, "qwen": 1.600231116832549}, "topk": {"rwkv": [21265, 2, 0.3881458044052124, [[4715, 0.405685, " or", false], [21265, 0.388146, " and", false], [45, 0.087593, ",", false], [47, 0.050044, ".", false], [275, 0.025062, " (", false], [48, 0.008715, "/", false], [5346, 0.005305, "---", false], [4596, 0.004761, " in", false], [52224, 0.00218, " methods", false], [4811, 0.001786, " to", false]]], "qwen": [323, 1, 0.7012136578559875, [[323, 0.701214, " and", false], [476, 0.160536, " or", false], [11, 0.06367, ",", false], [13, 0.02418, ".", false], [320, 0.011431, " (", false], [382, 0.009288, ".\n\n", false], [9777, 0.003663, "-and", false], [5413, 0.003568, " methods", false], [5980, 0.002035, "-based", false], [4421, 0.001439, "---", false]]]}, "raw_delta": 0.1466159075498581, "tuned_delta": 0.15395304606356083}, {"byte_start": 5526, "byte_end": 5535, "display": {"text": " learning", "kind": "normal"}, "is_word": true, "word_id": 930, "word_key": " learning", "bytes_hex": "20 6c 65 61 72 6e 69 6e 67", "compression": {"rwkv": "0.98% 0.98% 0.98% 0.98% 0.98% 0.98% 0.98% 0.98% 0.98%", "qwen": "0.42% 0.42% 0.42% 0.42% 0.42% 0.42% 0.42% 0.42% 0.42%"}, "model_tokens": {"rwkv": [[56537, " learning", "normal", 0.6158739328384399]], "qwen": [[6832, " learning", "normal", 0.8108955025672913]]}, "loss": {"rwkv": 0.9823037523413893, "qwen": 0.4200167166734307}, "topk": {"rwkv": [56537, 1, 0.6158739328384399, [[56537, 0.615874, " learning", false], [48, 0.153189, "/", false], [4450, 0.078845, " by", false], [38888, 0.021924, " lever", false], [31978, 0.016814, " self", false], [62577, 0.008849, " statistics", false], [63885, 0.008646, " statistical", false], [56540, 0.006704, " leverage", false], [45, 0.006627, ",", false], [22590, 0.005086, " the", false]]], "qwen": [6832, 1, 0.8108955025672913, [[6832, 0.810896, " learning", false], [5144, 0.053234, "/or", false], [553, 0.026637, " by", false], [76482, 0.009203, " leveraging", false], [389, 0.00778, " on", false], [5538, 0.007117, " deep", false], [5662, 0.006245, " machine", false], [1008, 0.004239, " other", false], [656, 0.004126, " self", false], [1221, 0.004103, " then", false]]]}, "raw_delta": 0.031179813875092395, "tuned_delta": 0.03851695238879513}, {"byte_start": 5535, "byte_end": 5536, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "9.79%", "qwen": "10.93%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.5853410959243774]], "qwen": [[13, ".", "normal", 0.5454769134521484]]}, "loss": {"rwkv": 9.79172903728349, "qwen": 10.930124124115569}, "topk": {"rwkv": [47, 1, 0.5853410959243774, [[47, 0.585341, ".", false], [45, 0.18044, ",", false], [5346, 0.051295, "---", false], [4450, 0.040386, " by", false], [21265, 0.026637, " and", false], [275, 0.019486, " (", false], [4596, 0.010836, " in", false], [4811, 0.008063, " to", false], [47001, 0.006385, " rather", false], [30917, 0.006127, " from", false]]], "qwen": [13, 1, 0.5454769134521484, [[13, 0.545477, ".", false], [382, 0.178999, ".\n\n", false], [11, 0.11097, ",", false], [320, 0.025356, " (", false], [624, 0.016818, ".\n", false], [5413, 0.016496, " methods", false], [4421, 0.014729, "---", false], [323, 0.010313, " and", false], [12538, 0.008433, " techniques", false], [4751, 0.006221, " rather", false]]]}, "raw_delta": -0.06312602758407593, "tuned_delta": -0.05578888907037319}, {"byte_start": 5536, "byte_end": 5540, "display": {"text": " The", "kind": "normal"}, "is_word": true, "word_id": 931, "word_key": " the", "bytes_hex": "20 54 68 65", "compression": {"rwkv": "11.41% 11.41% 11.41% 11.41%", "qwen": "8.76% 8.76% 8.76% 8.76%"}, "model_tokens": {"rwkv": [[20996, " The", "normal", 0.0790608823299408]], "qwen": [[576, " The", "normal", 0.14312496781349182]]}, "loss": {"rwkv": 11.411943194531839, "qwen": 8.76454008228244}, "topk": {"rwkv": [20996, 2, 0.0790608823299408, [[261, 0.521215, "\n\n", false], [20996, 0.079061, " The", false], [29894, 0.04304, " This", false], [267, 0.038361, "  ", false], [4331, 0.032199, " We", false], [3918, 0.018546, " It", false], [3913, 0.017925, " In", false], [37453, 0.016501, " These", false], [0, 0.012201, "[0]", false], [3336, 0.009944, " \n\n", false]]], "qwen": [576, 2, 0.14312496781349182, [[220, 0.151022, " ", false], [576, 0.143125, " The", false], [1096, 0.06928, " This", false], [1205, 0.054866, " We", false], [1084, 0.044859, " It", false], [4220, 0.043008, " These", false], [758, 0.041557, " In", false], [2014, 0.022343, " To", false], [2619, 0.02132, " There", false], [1634, 0.01157, " As", false]]]}, "raw_delta": 0.14680320024490356, "tuned_delta": 0.1541403387586063}, {"byte_start": 5540, "byte_end": 5549, "display": {"text": " eventual", "kind": "normal"}, "is_word": true, "word_id": 932, "word_key": " eventual", "bytes_hex": "20 65 76 65 6e 74 75 61 6c", "compression": {"rwkv": "16.41% 16.41% 16.41% 16.41% 16.41% 16.41% 16.41% 16.41% 16.41%", "qwen": "14.95% 14.95% 14.95% 14.95% 14.95% 14.95% 14.95% 14.95% 14.95%"}, "model_tokens": {"rwkv": [[56154, " eventual", "normal", 0.0002810857549775392]], "qwen": [[41735, " eventual", "normal", 0.0005762152140960097]]}, "loss": {"rwkv": 16.405646732331093, "qwen": 14.945978379663178}, "topk": {"rwkv": [56154, 327, 0.0002810857549775392, [[45315, 0.238854, " bitter", false], [46430, 0.106555, " lesson", false], [45184, 0.022033, " appeal", false], [47009, 0.021458, " reason", false], [21952, 0.018025, " key", false], [52127, 0.017397, " lessons", false], [31461, 0.012533, " most", false], [38499, 0.010843, " first", false], [31581, 0.010621, " only", false], [21357, 0.010474, " big", false]]], "qwen": [41735, 191, 0.0005762152140960097, [[25180, 0.315766, " bitter", false], [17755, 0.034954, " lesson", false], [78996, 0.024005, " bitterness", false], [1376, 0.015684, " key", false], [1429, 0.014092, " most", false], [1156, 0.013176, " first", false], [1172, 0.011851, " only", false], [2874, 0.009096, " reason", false], [1293, 0.00799, " long", false], [1537, 0.007683, " last", false]]]}, "raw_delta": 0.08094120025634766, "tuned_delta": 0.0882783387700504}, {"byte_start": 5549, "byte_end": 5557, "display": {"text": " success", "kind": "normal"}, "is_word": true, "word_id": 933, "word_key": " success", "bytes_hex": "20 73 75 63 63 65 73 73", "compression": {"rwkv": "4.49% 4.49% 4.49% 4.49% 4.49% 4.49% 4.49% 4.49%", "qwen": "7.22% 7.22% 7.22% 7.22% 7.22% 7.22% 7.22% 7.22%"}, "model_tokens": {"rwkv": [[53052, " success", "normal", 0.13621331751346588]], "qwen": [[2393, " success", "normal", 0.04058763012290001]]}, "loss": {"rwkv": 4.490810979329659, "qwen": 7.22314987349079}, "topk": {"rwkv": [53052, 1, 0.13621331751346588, [[53052, 0.136213, " success", false], [64266, 0.073289, " breakthrough", false], [57260, 0.038315, " solution", false], [53198, 0.033041, " triumph", false], [47798, 0.029689, " winner", false], [7933, 0.027677, "ity", false], [56950, 0.022749, " progress", false], [53283, 0.020035, " victory", false], [46430, 0.018792, " lesson", false], [52382, 0.014881, " outcome", false]]], "qwen": [2393, 4, 0.04058763012290001, [[41345, 0.226281, " breakthrough", false], [5486, 0.093374, " approach", false], [37486, 0.045089, " triumph", false], [2393, 0.040588, " success", false], [5098, 0.026488, " progress", false], [18647, 0.015863, " arrival", false], [13632, 0.015807, " winner", false], [15274, 0.014492, " outcome", false], [48079, 0.012363, " emergence", false], [12560, 0.011613, " victory", false]]]}, "raw_delta": -0.15151304006576538, "tuned_delta": -0.14417590155206264}, {"byte_start": 5557, "byte_end": 5560, "display": {"text": " is", "kind": "normal"}, "is_word": true, "word_id": 934, "word_key": " is", "bytes_hex": "20 69 73", "compression": {"rwkv": "17.56% 17.56% 17.56%", "qwen": "18.80% 18.80% 18.80%"}, "model_tokens": {"rwkv": [[4600, " is", "normal", 0.05434781312942505]], "qwen": [[374, " is", "normal", 0.04383223131299019]]}, "loss": {"rwkv": 17.564060719156, "qwen": 18.799433598134907}, "topk": {"rwkv": [4600, 2, 0.05434781312942505, [[4706, 0.793597, " of", false], [4600, 0.054348, " is", false], [4596, 0.030627, " in", false], [38087, 0.012735, " comes", false], [45, 0.007767, ",", false], [32475, 0.006353, " will", false], [51434, 0.006353, " depends", false], [21800, 0.005113, " has", false], [4450, 0.004919, " by", false], [22748, 0.004699, " was", false]]], "qwen": [374, 3, 0.04383223131299019, [[315, 0.707315, " of", false], [304, 0.068246, " in", false], [374, 0.043832, " is", false], [702, 0.016581, " has", false], [553, 0.014604, " by", false], [572, 0.013944, " was", false], [429, 0.013445, " that", false], [448, 0.01158, " with", false], [11, 0.009154, ",", false], [4041, 0.008134, " comes", false]]]}, "raw_delta": -0.06850361824035633, "tuned_delta": -0.061166479726653594}, {"byte_start": 5560, "byte_end": 5565, "display": {"text": " ting", "kind": "normal"}, "is_word": true, "word_id": 935, "word_key": " ting", "bytes_hex": "20 74 69 6e 67", "compression": {"rwkv": "48.92% 48.92% 48.92% 48.92% 48.92%", "qwen": "39.10% 39.10% 39.10% 39.10% 39.10%"}, "model_tokens": {"rwkv": [[32252, " ting", "normal", 1.2540949683170766e-06]], "qwen": [[42227, " ting", "normal", 1.9561890439945273e-05]]}, "loss": {"rwkv": 48.91637873014141, "qwen": 39.103987697183264}, "topk": {"rwkv": [32252, 4482, 1.2540949683170766e-06, [[22187, 0.136674, " not", false], [37810, 0.12397, " based", false], [45150, 0.077698, " always", false], [21572, 0.052864, " due", false], [332, 0.044098, " a", false], [22590, 0.036062, " the", false], [62109, 0.020334, " inevitable", false], [62046, 0.017329, " guaranteed", false], [4596, 0.015407, " in", false], [39171, 0.014764, " often", false]]], "qwen": [42227, 1268, 1.9561890439945273e-05, [[3118, 0.144691, " based", false], [537, 0.08893, " not", false], [4152, 0.060983, " due", false], [2677, 0.049161, " always", false], [264, 0.041665, " a", false], [3545, 0.040587, " often", false], [16994, 0.029664, " achieved", false], [553, 0.027469, " by", false], [279, 0.026745, " the", false], [304, 0.019998, " in", false]]]}, "raw_delta": 0.5441144943237304, "tuned_delta": 0.5514516328374331}, {"byte_start": 5565, "byte_end": 5567, "display": {"text": "ed", "kind": "normal"}, "is_word": true, "word_id": 936, "word_key": "ed", "bytes_hex": "65 64", "compression": {"rwkv": "0.01% 0.01%", "qwen": "0.01% 0.01%"}, "model_tokens": {"rwkv": [[1843, "ed", "normal", 0.9994370341300964]], "qwen": [[291, "ed", "normal", 0.9991808533668518]]}, "loss": {"rwkv": 0.005090686465539135, "qwen": 0.007389000931368411}, "topk": {"rwkv": [1843, 1, 0.9994370341300964, [[1843, 0.999437, "ed", false], [1858, 9.5e-05, "es", false], [8067, 9e-05, "led", false], [25206, 8.5e-05, "eing", false], [7856, 6.7e-05, "ing", false], [102, 6.6e-05, "e", false], [2030, 2e-05, "ly", false], [101, 1.7e-05, "d", false], [26151, 1.6e-05, "ling", false], [7612, 1.3e-05, "ged", false]]], "qwen": [291, 1, 0.9991808533668518, [[291, 0.999181, "ed", false], [2718, 0.000341, "ling", false], [832, 0.000193, "led", false], [3556, 4.4e-05, "ged", false], [75, 2.1e-05, "l", false], [1151, 1.4e-05, "red", false], [12336, 1.2e-05, "ered", false], [3018, 1.2e-05, "ored", false], [3260, 9e-06, "ued", false], [2181, 8e-06, "iled", false]]]}, "raw_delta": -0.00012744561536237597, "tuned_delta": 0.007209692898340361}, {"byte_start": 5567, "byte_end": 5572, "display": {"text": " with", "kind": "normal"}, "is_word": true, "word_id": 937, "word_key": " with", "bytes_hex": "20 77 69 74 68", "compression": {"rwkv": "0.51% 0.51% 0.51% 0.51% 0.51%", "qwen": "0.47% 0.47% 0.47% 0.47% 0.47%"}, "model_tokens": {"rwkv": [[32487, " with", "normal", 0.8696205019950867]], "qwen": [[448, " with", "normal", 0.8772037029266357]]}, "loss": {"rwkv": 0.5071974753125261, "qwen": 0.47254039142390725}, "topk": {"rwkv": [32487, 1, 0.8696205019950867, [[32487, 0.869621, " with", false], [4450, 0.095439, " by", false], [45, 0.010596, ",", false], [4596, 0.007593, " in", false], [57263, 0.002091, " somewhat", false], [332, 0.002023, " a", false], [57245, 0.00126, " slightly", false], [22187, 0.000919, " not", false], [4706, 0.000762, " of", false], [30322, 0.000757, " both", false]]], "qwen": [448, 1, 0.8772037029266357, [[448, 0.877204, " with", false], [553, 0.096491, " by", false], [11, 0.009353, ",", false], [304, 0.002796, " in", false], [264, 0.001064, " a", false], [537, 0.001013, " not", false], [14400, 0.000839, " somewhat", false], [315, 0.000753, " of", false], [311, 0.000588, " to", false], [320, 0.000395, " (", false]]]}, "raw_delta": 0.001921796798706056, "tuned_delta": 0.009258935312408793}, {"byte_start": 5572, "byte_end": 5583, "display": {"text": " bitterness", "kind": "normal"}, "is_word": true, "word_id": 938, "word_key": " bitterness", "bytes_hex": "20 62 69 74 74 65 72 6e 65 73 73", "compression": {"rwkv": "3.97% 3.97% 3.97% 3.97% 3.97% 3.97% 3.97% 3.97% 3.97% 3.97% 3.97%", "qwen": "1.50% 1.50% 1.50% 1.50% 1.50% 1.50% 1.50% 1.50% 1.50% 1.50% 1.50%"}, "model_tokens": {"rwkv": [[61640, " bitterness", "normal", 0.08698030561208725]], "qwen": [[78996, " bitterness", "normal", 0.40061235427856445]]}, "loss": {"rwkv": 3.9704852865374525, "qwen": 1.4996831456310211}, "topk": {"rwkv": [61640, 3, 0.08698030561208725, [[332, 0.148571, " a", false], [22590, 0.114089, " the", false], [61640, 0.08698, " bitterness", false], [45315, 0.086031, " bitter", false], [52793, 0.080018, " sadness", false], [47048, 0.056889, " regret", false], [65126, 0.051745, " disappointment", false], [53178, 0.046122, " tragedy", false], [38805, 0.043396, " irony", false], [63588, 0.024788, " frustration", false]]], "qwen": [78996, 1, 0.40061235427856445, [[78996, 0.400612, " bitterness", false], [50878, 0.184147, " sadness", false], [22231, 0.077142, " regret", false], [264, 0.058002, " a", false], [25180, 0.050059, " bitter", false], [279, 0.027139, " the", false], [50605, 0.026256, " irony", false], [40598, 0.02382, " disappointment", false], [57496, 0.012962, " sorrow", false], [86063, 0.007106, " melanch", false]]]}, "raw_delta": 0.13701036301526157, "tuned_delta": 0.1443475015289643}, {"byte_start": 5583, "byte_end": 5584, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "18.17%", "qwen": "22.51%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.36312466859817505]], "qwen": [[11, ",", "normal", 0.28709185123443604]]}, "loss": {"rwkv": 18.174576198698855, "qwen": 22.50519823744862}, "topk": {"rwkv": [45, 1, 0.36312466859817505, [[45, 0.363125, ",", false], [51018, 0.190955, " because", false], [21700, 0.114388, " for", false], [47, 0.0559, ".", false], [21265, 0.031092, " and", false], [5346, 0.030827, "---", false], [4423, 0.028048, " as", false], [32227, 0.025004, " that", false], [4596, 0.022121, " in", false], [59, 0.015739, ":", false]]], "qwen": [11, 2, 0.28709185123443604, [[1576, 0.375146, " because", false], [11, 0.287092, ",", false], [553, 0.066923, " by", false], [13, 0.044343, ".", false], [369, 0.032616, " for", false], [323, 0.026326, " and", false], [438, 0.023125, " as", false], [382, 0.015253, ".\n\n", false], [518, 0.013712, " at", false], [304, 0.013023, " in", false]]]}, "raw_delta": -0.24014067649841309, "tuned_delta": -0.23280353798471035}, {"byte_start": 5584, "byte_end": 5588, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 939, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"rwkv": "12.47% 12.47% 12.47% 12.47%", "qwen": "9.34% 9.34% 9.34% 9.34%"}, "model_tokens": {"rwkv": [[21265, " and", "normal", 0.06259933114051819]], "qwen": [[323, " and", "normal", 0.1260937601327896]]}, "loss": {"rwkv": 12.468604601432935, "qwen": 9.335722412978594}, "topk": {"rwkv": [21265, 4, 0.06259933114051819, [[21400, 0.3183, " but", false], [51018, 0.254542, " because", false], [4423, 0.162206, " as", false], [21265, 0.062599, " and", false], [21700, 0.028915, " for", false], [4596, 0.021036, " in", false], [39690, 0.014661, " since", false], [22187, 0.01433, " not", false], [22590, 0.008579, " the", false], [40186, 0.008041, " which", false]]], "qwen": [323, 3, 0.1260937601327896, [[1576, 0.302206, " because", false], [438, 0.175248, " as", false], [323, 0.126094, " and", false], [714, 0.084405, " but", false], [369, 0.046944, " for", false], [537, 0.036781, " not", false], [2474, 0.03465, " since", false], [892, 0.015301, " which", false], [304, 0.013924, " in", false], [773, 0.010399, " so", false]]]}, "raw_delta": 0.17372387647628784, "tuned_delta": 0.18106101498999058}, {"byte_start": 5588, "byte_end": 5594, "display": {"text": " often", "kind": "normal"}, "is_word": true, "word_id": 940, "word_key": " often", "bytes_hex": "20 6f 66 74 65 6e", "compression": {"rwkv": "14.93% 14.93% 14.93% 14.93% 14.93% 14.93%", "qwen": "11.66% 11.66% 11.66% 11.66% 11.66% 11.66%"}, "model_tokens": {"rwkv": [[39171, " often", "normal", 0.006934772711247206]], "qwen": [[3545, " often", "normal", 0.020638203248381615]]}, "loss": {"rwkv": 14.934147884202158, "qwen": 11.663622605804472}, "topk": {"rwkv": [39171, 21, 0.006934772711247206, [[22590, 0.172366, " the", false], [4601, 0.081691, " it", false], [4600, 0.064422, " is", false], [4858, 0.062589, " we", false], [32234, 0.049779, " this", false], [32227, 0.030264, " that", false], [63843, 0.023091, " researchers", false], [39934, 0.020607, " there", false], [4788, 0.019624, " so", false], [332, 0.018626, " a", false]]], "qwen": [3545, 9, 0.020638203248381615, [[279, 0.181648, " the", false], [419, 0.066944, " this", false], [432, 0.062067, " it", false], [374, 0.05647, " is", false], [582, 0.040288, " we", false], [429, 0.040272, " that", false], [773, 0.023409, " so", false], [264, 0.021673, " a", false], [3545, 0.020638, " often", false], [304, 0.019978, " in", false]]]}, "raw_delta": 0.18135643005371094, "tuned_delta": 0.18869356856741368}, {"byte_start": 5594, "byte_end": 5607, "display": {"text": " incompletely", "kind": "normal"}, "is_word": true, "word_id": 941, "word_key": " incompletely", "bytes_hex": "20 69 6e 63 6f 6d 70 6c 65 74 65 6c 79", "compression": {"rwkv": "12.71% 12.71% 12.71% 12.71% 12.71% 12.71% 12.71% 12.71% 12.71% 12.71% 12.71% 13.53% 13.53%", "qwen": "25.61% 25.61% 25.61% 25.61% 25.61% 25.61% 10.83% 10.83% 10.83% 10.83% 10.83% 10.83% 10.83%"}, "model_tokens": {"rwkv": [[62091, " incomplete", "normal", 0.00043250687303952873], [2030, "ly", "normal", 0.22152046859264374]], "qwen": [[52890, " incom", "normal", 0.00019925166270695627], [49168, "pletely", "normal", 0.014954663813114166]]}, "loss": {"rwkv": 12.831662623291262, "qwen": 17.650366464151663}, "topk": {"rwkv": [62091, 225, 0.00043250687303952873, [[32487, 0.07944, " with", false], [22590, 0.070365, " the", false], [56501, 0.050676, " involves", false], [4600, 0.030867, " is", false], [4601, 0.027651, " it", false], [332, 0.025977, " a", false], [39934, 0.022004, " there", false], [38875, 0.021249, " leads", false], [38087, 0.020175, " comes", false], [39620, 0.019435, " seems", false]]], "qwen": [52890, 448, 0.00019925166270695627, [[448, 0.113979, " with", false], [279, 0.073731, " the", false], [374, 0.044957, " is", false], [23943, 0.031305, " accompanied", false], [4041, 0.030687, " comes", false], [432, 0.024818, " it", false], [11811, 0.020573, " researchers", false], [264, 0.018769, " a", false], [11508, 0.015304, " leads", false], [17601, 0.013093, " involves", false]]]}, "raw_delta": -0.2672056784996619, "tuned_delta": -0.2598685399859592}, {"byte_start": 5607, "byte_end": 5616, "display": {"text": " digested", "kind": "normal"}, "is_word": true, "word_id": 942, "word_key": " digested", "bytes_hex": "20 64 69 67 65 73 74 65 64", "compression": {"rwkv": "17.47% 17.47% 17.47% 17.47% 17.47% 17.47% 17.47% 0.03% 0.03%", "qwen": "40.72% 40.72% 40.72% 40.72% 0.00% 0.00% 0.00% 0.00% 0.00%"}, "model_tokens": {"rwkv": [[45746, " digest", "normal", 0.0011289140675216913], [1843, "ed", "normal", 0.9963731169700623]], "qwen": [[4078, " dig", "normal", 0.00011939474643440917], [9980, "ested", "normal", 0.9998053908348083]]}, "loss": {"rwkv": 13.595159757644677, "qwen": 18.100352509323848}, "topk": {"rwkv": [45746, 38, 0.0011289140675216913, [[62684, 0.486927, " understood", false], [63289, 0.247998, " appreciated", false], [62438, 0.054035, " recognized", false], [64238, 0.026, " acknowledged", false], [55428, 0.015443, " accepted", false], [57027, 0.012789, " realized", false], [38625, 0.008919, " grasp", false], [56098, 0.006516, " embraced", false], [52112, 0.006507, " learned", false], [59684, 0.00555, " explained", false]]], "qwen": [4078, 214, 0.00011939474643440917, [[15985, 0.482853, " understood", false], [25498, 0.044029, " acknowledged", false], [9498, 0.037975, " learned", false], [14975, 0.036413, " recognized", false], [25808, 0.033701, " appreciated", false], [11247, 0.031423, " explained", false], [773, 0.02678, " so", false], [15043, 0.024798, " realized", false], [34416, 0.021106, " justified", false], [26471, 0.019687, " remembered", false]]]}, "raw_delta": -0.24982093229644095, "tuned_delta": -0.2424837937827382}, {"byte_start": 5616, "byte_end": 5617, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "17.89%", "qwen": "27.08%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.3699078857898712]], "qwen": [[11, ",", "normal", 0.22278772294521332]]}, "loss": {"rwkv": 17.892799823525227, "qwen": 27.07822767280638}, "topk": {"rwkv": [45, 1, 0.3699078857898712, [[45, 0.369908, ",", false], [4450, 0.25617, " by", false], [47, 0.187156, ".", false], [4596, 0.021318, " in", false], [5346, 0.019447, "---", false], [21265, 0.017328, " and", false], [32465, 0.012849, " when", false], [4424, 0.010761, " at", false], [4423, 0.010698, " as", false], [40076, 0.010527, " until", false]]], "qwen": [11, 2, 0.22278772294521332, [[553, 0.285165, " by", false], [11, 0.222788, ",", false], [13, 0.206131, ".", false], [382, 0.079159, ".\n\n", false], [304, 0.021819, " in", false], [518, 0.019729, " at", false], [323, 0.017123, " and", false], [369, 0.011375, " for", false], [438, 0.010354, " as", false], [476, 0.010326, " or", false]]]}, "raw_delta": -0.5093482732772827, "tuned_delta": -0.50201113476358}, {"byte_start": 5617, "byte_end": 5625, "display": {"text": " because", "kind": "normal"}, "is_word": true, "word_id": 943, "word_key": " because", "bytes_hex": "20 62 65 63 61 75 73 65", "compression": {"rwkv": "3.68% 3.68% 3.68% 3.68% 3.68% 3.68% 3.68% 3.68%", "qwen": "3.01% 3.01% 3.01% 3.01% 3.01% 3.01% 3.01% 3.01%"}, "model_tokens": {"rwkv": [[51018, " because", "normal", 0.19626040756702423]], "qwen": [[1576, " because", "normal", 0.26296961307525635]]}, "loss": {"rwkv": 3.6807039007054847, "qwen": 3.0109873348721896}, "topk": {"rwkv": [51018, 2, 0.19626040756702423, [[21400, 0.363875, " but", false], [51018, 0.19626, " because", false], [4423, 0.098155, " as", false], [4450, 0.063619, " by", false], [21265, 0.046131, " and", false], [21700, 0.028844, " for", false], [4788, 0.019426, " so", false], [4596, 0.017545, " in", false], [32465, 0.016342, " when", false], [40076, 0.015883, " until", false]]], "qwen": [1576, 1, 0.26296961307525635, [[1576, 0.26297, " because", false], [714, 0.15885, " but", false], [438, 0.139906, " as", false], [323, 0.089964, " and", false], [553, 0.056858, " by", false], [369, 0.040796, " for", false], [773, 0.025334, " so", false], [2474, 0.021178, " since", false], [304, 0.01481, " in", false], [1496, 0.012878, " even", false]]]}, "raw_delta": 0.037136971950531006, "tuned_delta": 0.044474110464233746}, {"byte_start": 5625, "byte_end": 5628, "display": {"text": " it", "kind": "normal"}, "is_word": true, "word_id": 944, "word_key": " it", "bytes_hex": "20 69 74", "compression": {"rwkv": "10.28% 10.28% 10.28%", "qwen": "9.17% 9.17% 9.17%"}, "model_tokens": {"rwkv": [[4601, " it", "normal", 0.18280662596225739]], "qwen": [[432, " it", "normal", 0.2176695615053177]]}, "loss": {"rwkv": 10.284837693837336, "qwen": 9.165785280769484}, "topk": {"rwkv": [4601, 2, 0.18280662596225739, [[22590, 0.334214, " the", false], [4601, 0.182807, " it", false], [4706, 0.088665, " of", false], [4858, 0.086721, " we", false], [63843, 0.047622, " researchers", false], [284, 0.01928, " 1", false], [39934, 0.015671, " there", false], [46787, 0.011049, " people", false], [4596, 0.009968, " in", false], [32234, 0.009265, " this", false]]], "qwen": [432, 2, 0.2176695615053177, [[279, 0.285832, " the", false], [432, 0.21767, " it", false], [315, 0.098557, " of", false], [11811, 0.038652, " researchers", false], [582, 0.033831, " we", false], [220, 0.029431, " ", false], [1052, 0.021834, " there", false], [304, 0.018553, " in", false], [11, 0.010721, ",", false], [1429, 0.00928, " most", false]]]}, "raw_delta": 0.06205344200134277, "tuned_delta": 0.06939058051504551}, {"byte_start": 5628, "byte_end": 5631, "display": {"text": " is", "kind": "normal"}, "is_word": true, "word_id": 945, "word_key": " is", "bytes_hex": "20 69 73", "compression": {"rwkv": "6.95% 6.95% 6.95%", "qwen": "7.18% 7.18% 7.18%"}, "model_tokens": {"rwkv": [[4600, " is", "normal", 0.31223273277282715]], "qwen": [[374, " is", "normal", 0.3027406334877014]]}, "loss": {"rwkv": 6.9504839209494325, "qwen": 7.182690596578126}, "topk": {"rwkv": [4600, 1, 0.31223273277282715, [[4600, 0.312233, " is", false], [30659, 0.062437, " does", false], [22748, 0.055203, " was", false], [21800, 0.035783, " has", false], [38087, 0.034546, " comes", false], [56501, 0.034423, " involves", false], [39888, 0.030581, " takes", false], [39620, 0.024533, " seems", false], [57102, 0.024395, " requires", false], [31908, 0.015982, " runs", false]]], "qwen": [374, 1, 0.3027406334877014, [[374, 0.302741, " is", false], [4041, 0.105995, " comes", false], [29682, 0.065926, " arrives", false], [1558, 0.04941, " does", false], [572, 0.02891, " was", false], [7460, 0.028253, " requires", false], [4990, 0.026667, " takes", false], [702, 0.020119, " has", false], [8573, 0.015152, " happens", false], [3697, 0.012295, " came", false]]]}, "raw_delta": -0.012876272201538086, "tuned_delta": -0.005539133687835349}, {"byte_start": 5631, "byte_end": 5639, "display": {"text": " success", "kind": "normal"}, "is_word": true, "word_id": 946, "word_key": " success", "bytes_hex": "20 73 75 63 63 65 73 73", "compression": {"rwkv": "22.26% 22.26% 22.26% 22.26% 22.26% 22.26% 22.26% 22.26%", "qwen": "22.30% 22.30% 22.30% 22.30% 22.30% 22.30% 22.30% 22.30%"}, "model_tokens": {"rwkv": [[53052, " success", "normal", 5.223894913797267e-05]], "qwen": [[2393, " success", "normal", 5.052114283898845e-05]]}, "loss": {"rwkv": 22.260333638716425, "qwen": 22.301177368513205}, "topk": {"rwkv": [53052, 716, 5.223894913797267e-05, [[22187, 0.138884, " not", false], [4788, 0.100169, " so", false], [332, 0.077669, " a", false], [31048, 0.061809, " hard", false], [45315, 0.051675, " bitter", false], [22590, 0.044962, " the", false], [51336, 0.03983, " counter", false], [37810, 0.030901, " based", false], [59516, 0.026859, " difficult", false], [31968, 0.024107, " seen", false]]], "qwen": [2393, 891, 5.052114283898845e-05, [[537, 0.12214, " not", false], [264, 0.085189, " a", false], [3118, 0.077157, " based", false], [773, 0.071189, " so", false], [279, 0.042447, " the", false], [3545, 0.025751, " often", false], [5546, 0.024856, " counter", false], [2238, 0.022544, " too", false], [2588, 0.021346, " hard", false], [16500, 0.017735, " unexpected", false]]]}, "raw_delta": -0.002264857292175293, "tuned_delta": 0.005072281221527444}, {"byte_start": 5639, "byte_end": 5644, "display": {"text": " over", "kind": "normal"}, "is_word": true, "word_id": 947, "word_key": " over", "bytes_hex": "20 6f 76 65 72", "compression": {"rwkv": "23.11% 23.11% 23.11% 23.11% 23.11%", "qwen": "14.60% 14.60% 14.60% 14.60% 14.60%"}, "model_tokens": {"rwkv": [[31601, " over", "normal", 0.001631698221899569]], "qwen": [[916, " over", "normal", 0.01744821108877659]]}, "loss": {"rwkv": 23.1056627642373, "qwen": 14.601942756142542}, "topk": {"rwkv": [31601, 43, 0.001631698221899569, [[37810, 0.15397, " based", false], [32227, 0.119726, " that", false], [4596, 0.075271, " in", false], [4450, 0.07065, " by", false], [37634, 0.05486, " after", false], [4424, 0.041355, " at", false], [37924, 0.036753, " built", false], [55437, 0.034989, " achieved", false], [50870, 0.034904, " against", false], [31581, 0.034077, " only", false]]], "qwen": [916, 14, 0.01744821108877659, [[304, 0.155545, " in", false], [429, 0.120506, " that", false], [518, 0.07092, " at", false], [2348, 0.067026, " against", false], [553, 0.062182, " by", false], [16994, 0.051364, " achieved", false], [3118, 0.048459, " based", false], [315, 0.036886, " of", false], [1283, 0.032752, " after", false], [369, 0.032327, " for", false]]]}, "raw_delta": 0.4715463638305664, "tuned_delta": 0.47888350234426913}, {"byte_start": 5644, "byte_end": 5646, "display": {"text": " a", "kind": "normal"}, "is_word": true, "word_id": 948, "word_key": " a", "bytes_hex": "20 61", "compression": {"rwkv": "11.76% 11.76%", "qwen": "10.54% 10.54%"}, "model_tokens": {"rwkv": [[332, " a", "normal", 0.2699261009693146]], "qwen": [[264, " a", "normal", 0.3108728528022766]]}, "loss": {"rwkv": 11.76416366349887, "qwen": 10.535021930939031}, "topk": {"rwkv": [332, 1, 0.2699261009693146, [[332, 0.269926, " a", false], [22590, 0.17514, " the", false], [38720, 0.06638, " human", false], [4419, 0.053975, " an", false], [60522, 0.024599, " something", false], [32464, 0.023522, " what", false], [32251, 0.022729, " time", false], [59943, 0.017814, " knowledge", false], [51396, 0.015432, " decades", false], [22248, 0.013415, " our", false]]], "qwen": [264, 1, 0.3108728528022766, [[264, 0.310873, " a", false], [279, 0.133102, " the", false], [458, 0.105017, " an", false], [10793, 0.034139, " decades", false], [1128, 0.025159, " what", false], [882, 0.023667, " time", false], [1657, 0.022911, " many", false], [2494, 0.017569, " something", false], [892, 0.015761, " which", false], [3738, 0.012052, " human", false]]]}, "raw_delta": 0.0681580901145935, "tuned_delta": 0.07549522862829625}, {"byte_start": 5646, "byte_end": 5654, "display": {"text": " favored", "kind": "normal"}, "is_word": true, "word_id": 949, "word_key": " favored", "bytes_hex": "20 66 61 76 6f 72 65 64", "compression": {"rwkv": "23.95% 23.95% 23.95% 23.95% 23.95% 23.95% 23.95% 23.95%", "qwen": "23.85% 23.85% 23.85% 23.85% 23.85% 23.85% 23.85% 23.85%"}, "model_tokens": {"rwkv": [[51722, " favored", "normal", 2.4341365133295767e-05]], "qwen": [[45503, " favored", "normal", 2.53817252087174e-05]]}, "loss": {"rwkv": 23.95099188975818, "qwen": 23.852890835922896}, "topk": {"rwkv": [51722, 1063, 2.4341365133295767e-05, [[31323, 0.314257, " long", false], [46470, 0.090357, " longer", false], [31466, 0.086845, " much", false], [32386, 0.080617, " very", false], [31118, 0.014816, " huge", false], [38864, 0.014429, " large", false], [47708, 0.013791, " vastly", false], [46790, 0.013606, " period", false], [62471, 0.012715, " relatively", false], [39675, 0.012435, " short", false]]], "qwen": [45503, 1111, 2.53817252087174e-05, [[1293, 0.219826, " long", false], [1602, 0.085832, " very", false], [1753, 0.078482, " much", false], [4168, 0.072124, " period", false], [882, 0.056071, " time", false], [5021, 0.048234, " longer", false], [2155, 0.021774, " different", false], [12767, 0.011735, " vast", false], [1714, 0.010897, " method", false], [3460, 0.010863, " large", false]]]}, "raw_delta": 0.005439877510070801, "tuned_delta": 0.012777016023773537}, {"byte_start": 5654, "byte_end": 5655, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "63.96%", "qwen": "59.41%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.02850189059972763]], "qwen": [[11, ",", "normal", 0.03708159551024437]]}, "loss": {"rwkv": 63.96323716441302, "qwen": 59.41441213738106}, "topk": {"rwkv": [45, 6, 0.02850189059972763, [[55532, 0.468098, " approach", false], [46561, 0.132644, " method", false], [22752, 0.038385, " way", false], [38720, 0.034412, " human", false], [21400, 0.028642, " but", false], [45, 0.028502, ",", false], [21265, 0.019596, " and", false], [57317, 0.017333, " strategy", false], [63277, 0.010085, " alternative", false], [31135, 0.010061, " idea", false]]], "qwen": [11, 3, 0.03708159551024437, [[5486, 0.512128, " approach", false], [1815, 0.046588, " path", false], [11, 0.037082, ",", false], [1714, 0.029168, " method", false], [323, 0.024596, " and", false], [1616, 0.019403, " way", false], [714, 0.014412, " but", false], [10555, 0.013887, " alternative", false], [2856, 0.013755, " initial", false], [2309, 0.013726, " position", false]]]}, "raw_delta": 0.2522404193878174, "tuned_delta": 0.2595775579015201}, {"byte_start": 5655, "byte_end": 5661, "display": {"text": " human", "kind": "normal"}, "is_word": true, "word_id": 950, "word_key": " human", "bytes_hex": "20 68 75 6d 61 6e", "compression": {"rwkv": "5.89% 5.89% 5.89% 5.89% 5.89% 5.89%", "qwen": "7.77% 7.77% 7.77% 7.77% 7.77% 7.77%"}, "model_tokens": {"rwkv": [[38720, " human", "normal", 0.1406121850013733]], "qwen": [[3738, " human", "normal", 0.07525920867919922]]}, "loss": {"rwkv": 5.8938225140483365, "qwen": 7.774975198535144}, "topk": {"rwkv": [38720, 2, 0.1406121850013733, [[21400, 0.225893, " but", false], [38720, 0.140612, " human", false], [21265, 0.070715, " and", false], [56847, 0.047999, " personal", false], [39675, 0.036481, " short", false], [31323, 0.02148, " long", false], [56205, 0.02001, " familiar", false], [47544, 0.018472, " though", false], [45132, 0.017131, " albeit", false], [62309, 0.015536, " personally", false]]], "qwen": [3738, 2, 0.07525920867919922, [[714, 0.151215, " but", false], [3738, 0.075259, " human", false], [323, 0.063641, " and", false], [1293, 0.049341, " long", false], [3281, 0.018588, " special", false], [81044, 0.017409, " entrenched", false], [2805, 0.013023, " short", false], [4345, 0.011846, " personal", false], [15102, 0.011559, " initially", false], [4124, 0.011314, " early", false]]]}, "raw_delta": -0.10431325435638428, "tuned_delta": -0.09697611584268154}, {"byte_start": 5661, "byte_end": 5669, "display": {"text": "-centric", "kind": "normal"}, "is_word": true, "word_id": 951, "word_key": "-centric", "bytes_hex": "2d 63 65 6e 74 72 69 63", "compression": {"rwkv": "4.86% 7.69% 7.69% 7.69% 7.69% 7.69% 7.69% 7.69%", "qwen": "7.71% 7.71% 7.71% 7.71% 7.71% 7.71% 7.71% 7.71%"}, "model_tokens": {"rwkv": [[46, "-", "normal", 0.7633634209632874], [48948, "centric", "normal", 0.05066029727458954]], "qwen": [[64424, "-centric", "normal", 0.032710764557123184]]}, "loss": {"rwkv": 7.3349912662384416, "qwen": 7.709516810130813}, "topk": {"rwkv": [46, 1, 0.7633634209632874, [[46, 0.763363, "-", false], [55532, 0.04569, " approach", false], [22752, 0.04332, " way", false], [45, 0.024073, ",", false], [2030, 0.022829, "ly", false], [34864, 0.015959, "istic", false], [59943, 0.008371, " knowledge", false], [46561, 0.00717, " method", false], [7919, 0.00711, "ist", false], [65034, 0.006926, " understanding", false]]], "qwen": [64424, 4, 0.032710764557123184, [[12646, 0.578206, "-k", false], [49382, 0.05646, "-centered", false], [71107, 0.045622, "-under", false], [64424, 0.032711, "-centric", false], [12681, 0.023995, "-like", false], [35085, 0.021641, "-oriented", false], [6540, 0.017246, " knowledge", false], [5980, 0.016713, "-based", false], [12, 0.014339, "-", false], [3419, 0.010668, "-in", false]]]}, "raw_delta": -0.020768105983734145, "tuned_delta": -0.013430967470031408}, {"byte_start": 5669, "byte_end": 5678, "display": {"text": " approach", "kind": "normal"}, "is_word": true, "word_id": 952, "word_key": " approach", "bytes_hex": "20 61 70 70 72 6f 61 63 68", "compression": {"rwkv": "1.22% 1.22% 1.22% 1.22% 1.22% 1.22% 1.22% 1.22% 1.22%", "qwen": "1.34% 1.34% 1.34% 1.34% 1.34% 1.34% 1.34% 1.34% 1.34%"}, "model_tokens": {"rwkv": [[55532, " approach", "normal", 0.5443591475486755]], "qwen": [[5486, " approach", "normal", 0.5117776393890381]]}, "loss": {"rwkv": 1.221030959085711, "qwen": 1.342237523767222}, "topk": {"rwkv": [55532, 1, 0.5443591475486755, [[55532, 0.544359, " approach", false], [45, 0.120822, ",", false], [46561, 0.061693, " method", false], [22752, 0.039413, " way", false], [32398, 0.037207, " view", false], [57317, 0.015693, " strategy", false], [46681, 0.014377, " notion", false], [63708, 0.00899, " methodology", false], [56810, 0.008537, " paradigm", false], [31135, 0.008427, " idea", false]]], "qwen": [5486, 1, 0.5117776393890381, [[5486, 0.511778, " approach", false], [11, 0.194958, ",", false], [1651, 0.037037, " view", false], [1616, 0.025717, " way", false], [13057, 0.025309, " perspective", false], [11129, 0.017677, " vision", false], [1714, 0.013919, " method", false], [48240, 0.010254, " paradigm", false], [1614, 0.008498, " model", false], [42556, 0.006575, " conception", false]]]}, "raw_delta": -0.006721119085947677, "tuned_delta": 0.0006160194277550594}, {"byte_start": 5678, "byte_end": 5680, "display": {"text": ".\n", "kind": "control"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e 0a", "compression": {"rwkv": "11.34% 9.79%", "qwen": "13.81% 13.81%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.5361168384552002], [261, "\n\n", "control", 0.3343088626861572]], "qwen": [[382, ".\n\n", "control", 0.10044247657060623]]}, "loss": {"rwkv": 10.566614069010962, "qwen": 13.814827464836712}, "topk": {"rwkv": [47, 1, 0.5361168384552002, [[47, 0.536117, ".", false], [32227, 0.159392, " that", false], [45, 0.150628, ",", false], [4811, 0.057714, " to", false], [21265, 0.015874, " and", false], [5346, 0.009687, "---", false], [47001, 0.008127, " rather", false], [60, 0.007287, ";", false], [4596, 0.005889, " in", false], [275, 0.005701, " (", false]]], "qwen": [382, 4, 0.10044247657060623, [[13, 0.279323, ".", false], [11, 0.207899, ",", false], [429, 0.159146, " that", false], [382, 0.100442, ".\n\n", false], [311, 0.059556, " to", false], [4421, 0.037203, "---", false], [323, 0.026511, " and", false], [4751, 0.016863, " rather", false], [3118, 0.014959, " based", false], [320, 0.011289, " (", false]]]}, "raw_delta": -0.1801191965738932, "tuned_delta": -0.17278205806019045}, {"byte_start": 5680, "byte_end": 5681, "display": {"text": "\n", "kind": "control"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "0a", "compression": {"rwkv": "9.79%", "qwen": "13.81%"}, "model_tokens": {"rwkv": [[261, "\n\n", "control", 0.3343088626861572]], "qwen": [[382, ".\n\n", "control", 0.10044247657060623]]}, "loss": {"rwkv": 9.79172903728349, "qwen": 13.814827464836712}, "topk": {"rwkv": [261, 1, 0.3343088626861572, [[261, 0.334309, "\n\n", false], [19555, 0.147468, " But", false], [20996, 0.094356, " The", false], [3918, 0.044073, " It", false], [29894, 0.04175, " This", false], [4331, 0.03526, " We", false], [267, 0.021818, "  ", false], [3913, 0.016295, " In", false], [19417, 0.011072, " And", false], [0, 0.010797, "[0]", false]]], "qwen": [382, 4, 0.10044247657060623, [[13, 0.279323, ".", false], [11, 0.207899, ",", false], [429, 0.159146, " that", false], [382, 0.100442, ".\n\n", false], [311, 0.059556, " to", false], [4421, 0.037203, "---", false], [323, 0.026511, " and", false], [4751, 0.016863, " rather", false], [3118, 0.014959, " based", false], [320, 0.011289, " (", false]]]}, "raw_delta": -0.2230879465738932, "tuned_delta": -0.21575080806019045}, {"byte_start": 5681, "byte_end": 5684, "display": {"text": "One", "kind": "normal"}, "is_word": true, "word_id": 953, "word_key": "one", "bytes_hex": "4f 6e 65", "compression": {"rwkv": "25.17% 25.17% 25.17%", "qwen": "25.47% 25.47% 25.47%"}, "model_tokens": {"rwkv": [[6393, "One", "normal", 0.015050908550620079]], "qwen": [[3966, "One", "normal", 0.014451012015342712]]}, "loss": {"rwkv": 25.172022848843888, "qwen": 25.46952417106141}, "topk": {"rwkv": [6393, 13, 0.015050908550620079, [[6699, 0.177685, "The", false], [1136, 0.064493, "In", false], [24242, 0.059646, "This", false], [33504, 0.04453, "There", false], [1589, 0.043323, "We", false], [66, 0.03483, "A", false], [1141, 0.034018, "It", false], [1500, 0.031444, "To", false], [74, 0.026629, "I", false], [24326, 0.021604, "What", false]]], "qwen": [3966, 12, 0.014451012015342712, [[785, 0.170455, "The", false], [1986, 0.064505, "This", false], [641, 0.054122, "In", false], [3862, 0.035957, "There", false], [2132, 0.034442, "It", false], [1654, 0.034082, "We", false], [32, 0.026993, "A", false], [1249, 0.026394, "To", false], [40, 0.018889, "I", false], [3983, 0.016479, "But", false]]]}, "raw_delta": -0.016496976216634263, "tuned_delta": -0.009159837702931526}, {"byte_start": 5684, "byte_end": 5690, "display": {"text": " thing", "kind": "normal"}, "is_word": true, "word_id": 954, "word_key": " thing", "bytes_hex": "20 74 68 69 6e 67", "compression": {"rwkv": "11.46% 11.46% 11.46% 11.46% 11.46% 11.46%", "qwen": "11.64% 11.64% 11.64% 11.64% 11.64% 11.64%"}, "model_tokens": {"rwkv": [[39941, " thing", "normal", 0.022175639867782593]], "qwen": [[3166, " thing", "normal", 0.020781708881258965]]}, "loss": {"rwkv": 11.458905923727443, "qwen": 11.642795506784987}, "topk": {"rwkv": [39941, 7, 0.022175639867782593, [[4706, 0.170438, " of", false], [22752, 0.108849, " way", false], [47009, 0.064625, " reason", false], [21413, 0.045854, " can", false], [39021, 0.03549, " might", false], [46430, 0.024085, " lesson", false], [39941, 0.022176, " thing", false], [51668, 0.020439, " example", false], [59829, 0.017523, " important", false], [56895, 0.015965, " possible", false]]], "qwen": [3166, 5, 0.020781708881258965, [[315, 0.175248, " of", false], [2874, 0.116729, " reason", false], [1616, 0.105777, " way", false], [646, 0.042688, " can", false], [3166, 0.020782, " thing", false], [2578, 0.019364, " might", false], [2989, 0.016264, " important", false], [5486, 0.014129, " approach", false], [1590, 0.01315, " final", false], [803, 0.013112, " more", false]]]}, "raw_delta": -0.010197003682454464, "tuned_delta": -0.0028598651687517275}, {"byte_start": 5690, "byte_end": 5695, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 955, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"rwkv": "2.52% 2.52% 2.52% 2.52% 2.52%", "qwen": "2.65% 2.65% 2.65% 2.65% 2.65%"}, "model_tokens": {"rwkv": [[32227, " that", "normal", 0.49280062317848206]], "qwen": [[429, " that", "normal", 0.47998541593551636]]}, "loss": {"rwkv": 2.5218985578039494, "qwen": 2.6473437782348497}, "topk": {"rwkv": [32227, 1, 0.49280062317848206, [[32227, 0.492801, " that", false], [4858, 0.158727, " we", false], [4811, 0.096014, " to", false], [4600, 0.03451, " is", false], [32234, 0.030564, " this", false], [308, 0.02704, " I", false], [22590, 0.02395, " the", false], [37598, 0.01049, " about", false], [3609, 0.009143, " AI", false], [39936, 0.005701, " these", false]]], "qwen": [429, 1, 0.47998541593551636, [[429, 0.479985, " that", false], [311, 0.16196, " to", false], [582, 0.093175, " we", false], [374, 0.059273, " is", false], [358, 0.025259, " I", false], [911, 0.022871, " about", false], [279, 0.016734, " the", false], [419, 0.014615, " this", false], [5802, 0.008468, " worth", false], [15235, 0.00763, " AI", false]]]}, "raw_delta": -0.006956160068511963, "tuned_delta": 0.0003809784451907737}, {"byte_start": 5695, "byte_end": 5702, "display": {"text": " should", "kind": "normal"}, "is_word": true, "word_id": 956, "word_key": " should", "bytes_hex": "20 73 68 6f 75 6c 64", "compression": {"rwkv": "11.11% 11.11% 11.11% 11.11% 11.11% 11.11% 11.11%", "qwen": "11.03% 11.03% 11.03% 11.03% 11.03% 11.03% 11.03%"}, "model_tokens": {"rwkv": [[47266, " should", "normal", 0.013272942043840885]], "qwen": [[1265, " should", "normal", 0.013812181539833546]]}, "loss": {"rwkv": 11.110039935417243, "qwen": 11.031991751560685}, "topk": {"rwkv": [47266, 16, 0.013272942043840885, [[4600, 0.185279, " is", false], [21800, 0.081013, " has", false], [4858, 0.054314, " we", false], [38964, 0.049327, " makes", false], [21413, 0.047148, " can", false], [22590, 0.029851, " the", false], [22074, 0.022044, " may", false], [38686, 0.02118, " helps", false], [3609, 0.020754, " AI", false], [39021, 0.020189, " might", false]]], "qwen": [1265, 15, 0.013812181539833546, [[374, 0.176985, " is", false], [646, 0.06568, " can", false], [582, 0.061963, " we", false], [702, 0.052179, " has", false], [3643, 0.036484, " makes", false], [279, 0.036215, " the", false], [8609, 0.036166, " helps", false], [1558, 0.028032, " does", false], [11811, 0.024418, " researchers", false], [358, 0.023333, " I", false]]]}, "raw_delta": 0.004327910287039605, "tuned_delta": 0.011665048800742341}, {"byte_start": 5702, "byte_end": 5705, "display": {"text": " be", "kind": "normal"}, "is_word": true, "word_id": 957, "word_key": " be", "bytes_hex": "20 62 65", "compression": {"rwkv": "2.44% 2.44% 2.44%", "qwen": "3.09% 3.09% 3.09%"}, "model_tokens": {"rwkv": [[4435, " be", "normal", 0.662806510925293]], "qwen": [[387, " be", "normal", 0.5976617932319641]]}, "loss": {"rwkv": 2.442061918171422, "qwen": 3.094161369504148}, "topk": {"rwkv": [4435, 1, 0.662806510925293, [[4435, 0.662807, " be", false], [31073, 0.069093, " help", false], [22187, 0.049603, " not", false], [31059, 0.02136, " have", false], [31358, 0.015835, " make", false], [30135, 0.015578, " also", false], [30482, 0.011283, " come", false], [45284, 0.01066, " become", false], [39797, 0.007296, " stand", false], [47428, 0.006829, " strike", false]]], "qwen": [387, 1, 0.5976617932319641, [[387, 0.597662, " be", false], [537, 0.079499, " not", false], [1492, 0.06085, " help", false], [1281, 0.035471, " make", false], [614, 0.023218, " have", false], [1083, 0.012459, " also", false], [2525, 0.011101, " come", false], [2968, 0.008135, " give", false], [3635, 0.007961, " become", false], [32944, 0.006529, " emerge", false]]]}, "raw_delta": -0.03616007169087729, "tuned_delta": -0.02882293317717455}, {"byte_start": 5705, "byte_end": 5713, "display": {"text": " learned", "kind": "normal"}, "is_word": true, "word_id": 958, "word_key": " learned", "bytes_hex": "20 6c 65 61 72 6e 65 64", "compression": {"rwkv": "4.83% 4.83% 4.83% 4.83% 4.83% 4.83% 4.83% 4.83%", "qwen": "7.63% 7.63% 7.63% 7.63% 7.63% 7.63% 7.63% 7.63%"}, "model_tokens": {"rwkv": [[52112, " learned", "normal", 0.11948658525943756]], "qwen": [[9498, " learned", "normal", 0.033842235803604126]]}, "loss": {"rwkv": 4.825420424848339, "qwen": 7.632860917966555}, "topk": {"rwkv": [52112, 2, 0.11948658525943756, [[38049, 0.263173, " clear", false], [52112, 0.119487, " learned", false], [39140, 0.071518, " noted", false], [52346, 0.046066, " obvious", false], [61934, 0.031661, " emphasized", false], [31207, 0.029328, " kept", false], [62684, 0.026553, " understood", false], [62479, 0.022931, " remembered", false], [55524, 0.019985, " apparent", false], [31351, 0.019849, " made", false]]], "qwen": [9498, 7, 0.033842235803604126, [[2797, 0.275875, " clear", false], [10342, 0.093688, " noted", false], [8036, 0.061994, " obvious", false], [3694, 0.059659, " added", false], [1053, 0.05515, " said", false], [45628, 0.043568, " emphasized", false], [9498, 0.033842, " learned", false], [31547, 0.029003, " stressed", false], [29476, 0.021034, " evident", false], [9733, 0.019105, " mentioned", false]]]}, "raw_delta": -0.15567755699157715, "tuned_delta": -0.1483404184778744}, {"byte_start": 5713, "byte_end": 5718, "display": {"text": " from", "kind": "normal"}, "is_word": true, "word_id": 959, "word_key": " from", "bytes_hex": "20 66 72 6f 6d", "compression": {"rwkv": "2.07% 2.07% 2.07% 2.07% 2.07%", "qwen": "2.05% 2.05% 2.05% 2.05% 2.05%"}, "model_tokens": {"rwkv": [[30917, " from", "normal", 0.5585579872131348]], "qwen": [[504, " from", "normal", 0.5667757391929626]]}, "loss": {"rwkv": 2.0710563575261483, "qwen": 2.0478752459729774}, "topk": {"rwkv": [30917, 1, 0.5585579872131348, [[30917, 0.558558, " from", false], [4600, 0.269791, " is", false], [45, 0.042443, ",", false], [31077, 0.021606, " here", false], [37598, 0.016718, " about", false], [4450, 0.012164, " by", false], [4596, 0.011486, " in", false], [21265, 0.007243, " and", false], [32458, 0.007101, " well", false], [59, 0.004373, ":", false]]], "qwen": [504, 1, 0.5667757391929626, [[504, 0.566776, " from", false], [374, 0.260513, " is", false], [11, 0.046342, ",", false], [304, 0.019425, " in", false], [1588, 0.018739, " here", false], [553, 0.014429, " by", false], [911, 0.012014, " about", false], [323, 0.004805, " and", false], [438, 0.004626, " as", false], [518, 0.004103, " at", false]]]}, "raw_delta": 0.0012854337692260742, "tuned_delta": 0.00862257228292881}, {"byte_start": 5718, "byte_end": 5722, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 960, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "6.30% 6.30% 6.30% 6.30%", "qwen": "7.25% 7.25% 7.25% 7.25%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.24672578275203705]], "qwen": [[279, " the", "normal", 0.20029723644256592]]}, "loss": {"rwkv": 6.304746394509873, "qwen": 7.249329932518381}, "topk": {"rwkv": [22590, 2, 0.24672578275203705, [[32234, 0.372783, " this", false], [22590, 0.246726, " the", false], [39936, 0.196215, " these", false], [21256, 0.070858, " all", false], [3609, 0.02108, " AI", false], [45315, 0.010912, " bitter", false], [51929, 0.007206, " history", false], [55809, 0.004303, " computer", false], [3543, 0.003954, " 70", false], [57331, 0.003544, " studying", false]]], "qwen": [279, 2, 0.20029723644256592, [[419, 0.461009, " this", false], [279, 0.200297, " the", false], [1493, 0.151398, " these", false], [678, 0.087104, " all", false], [6366, 0.00636, " computer", false], [15235, 0.004603, " AI", false], [3840, 0.003931, " history", false], [20219, 0.003923, " Moore", false], [1817, 0.003834, " each", false], [264, 0.003543, " a", false]]]}, "raw_delta": -0.052378833293914795, "tuned_delta": -0.045041694780212055}, {"byte_start": 5722, "byte_end": 5729, "display": {"text": " bitter", "kind": "normal"}, "is_word": true, "word_id": 961, "word_key": " bitter", "bytes_hex": "20 62 69 74 74 65 72", "compression": {"rwkv": "0.75% 0.75% 0.75% 0.75% 0.75% 0.75% 0.75%", "qwen": "0.45% 0.45% 0.45% 0.45% 0.45% 0.45% 0.45%"}, "model_tokens": {"rwkv": [[45315, " bitter", "normal", 0.7421367168426514]], "qwen": [[25180, " bitter", "normal", 0.8381265997886658]]}, "loss": {"rwkv": 0.7547581477864971, "qwen": 0.45492843128433225}, "topk": {"rwkv": [45315, 1, 0.7421367168426514, [[45315, 0.742137, " bitter", false], [51929, 0.045971, " history", false], [37599, 0.012061, " above", false], [3609, 0.010099, " AI", false], [31636, 0.008555, " past", false], [60587, 0.00829, " successes", false], [56162, 0.008018, " examples", false], [61640, 0.006769, " bitterness", false], [62061, 0.006483, " historical", false], [52127, 0.006214, " lessons", false]]], "qwen": [25180, 1, 0.8381265997886658, [[25180, 0.838127, " bitter", false], [3840, 0.020017, " history", false], [3403, 0.01126, " above", false], [78996, 0.010213, " bitterness", false], [6366, 0.008315, " computer", false], [18366, 0.00567, " lessons", false], [3139, 0.005327, " experience", false], [13656, 0.004365, " historical", false], [3267, 0.004178, " past", false], [4124, 0.003944, " early", false]]]}, "raw_delta": 0.01662608981132507, "tuned_delta": 0.023963228325027806}, {"byte_start": 5729, "byte_end": 5736, "display": {"text": " lesson", "kind": "normal"}, "is_word": true, "word_id": 962, "word_key": " lesson", "bytes_hex": "20 6c 65 73 73 6f 6e", "compression": {"rwkv": "1.97% 1.97% 1.97% 1.97% 1.97% 1.97% 1.97%", "qwen": "0.52% 0.52% 0.52% 0.52% 0.52% 0.52% 0.52%"}, "model_tokens": {"rwkv": [[46430, " lesson", "normal", 0.4661090075969696]], "qwen": [[17755, " lesson", "normal", 0.8182079195976257]]}, "loss": {"rwkv": 1.9724346262153793, "qwen": 0.5168938955571559}, "topk": {"rwkv": [46430, 2, 0.4661090075969696, [[52127, 0.472814, " lessons", false], [46430, 0.466109, " lesson", false], [61979, 0.014762, " experience", false], [63558, 0.005088, " experiences", false], [46, 0.004753, "-", false], [51929, 0.004456, " history", false], [31636, 0.002177, " past", false], [39899, 0.001563, " taste", false], [45, 0.001297, ",", false], [56652, 0.001291, " mistakes", false]]], "qwen": [17755, 1, 0.8182079195976257, [[17755, 0.818208, " lesson", false], [18366, 0.105563, " lessons", false], [3139, 0.03114, " experience", false], [3840, 0.013571, " history", false], [11449, 0.004299, " experiences", false], [15235, 0.003162, " AI", false], [11, 0.001942, ",", false], [13656, 0.00183, " historical", false], [3267, 0.001488, " past", false], [323, 0.000688, " and", false]]]}, "raw_delta": 0.08071231629167284, "tuned_delta": 0.08804945480537558}, {"byte_start": 5736, "byte_end": 5739, "display": {"text": " is", "kind": "normal"}, "is_word": true, "word_id": 963, "word_key": " is", "bytes_hex": "20 69 73", "compression": {"rwkv": "1.26% 1.26% 1.26%", "qwen": "1.21% 1.21% 1.21%"}, "model_tokens": {"rwkv": [[4600, " is", "normal", 0.8119887113571167]], "qwen": [[374, " is", "normal", 0.817969799041748]]}, "loss": {"rwkv": 1.2562530059824142, "qwen": 1.2078356797725596}, "topk": {"rwkv": [4600, 1, 0.8119887113571167, [[4600, 0.811989, " is", false], [4706, 0.069306, " of", false], [45, 0.046331, ",", false], [4596, 0.014451, " in", false], [32227, 0.010821, " that", false], [37598, 0.0108, " about", false], [59, 0.006137, ":", false], [21265, 0.004157, " and", false], [4712, 0.002779, " on", false], [5346, 0.002243, "---", false]]], "qwen": [374, 1, 0.817969799041748, [[374, 0.81797, " is", false], [315, 0.068726, " of", false], [11, 0.038809, ",", false], [304, 0.012614, " in", false], [911, 0.007968, " about", false], [429, 0.006566, " that", false], [25, 0.006301, ":", false], [4421, 0.005378, "---", false], [323, 0.004139, " and", false], [389, 0.002969, " on", false]]]}, "raw_delta": 0.0026848266522089548, "tuned_delta": 0.010021965165911691}, {"byte_start": 5739, "byte_end": 5743, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 964, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "10.78% 10.78% 10.78% 10.78%", "qwen": "10.35% 10.35% 10.35% 10.35%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.09193588048219681]], "qwen": [[279, " the", "normal", 0.10073703527450562]]}, "loss": {"rwkv": 10.777946350391181, "qwen": 10.347918780390678}, "topk": {"rwkv": [22590, 3, 0.09193588048219681, [[32227, 0.673385, " that", false], [4811, 0.09697, " to", false], [22590, 0.091936, " the", false], [22187, 0.029321, " not", false], [21835, 0.023214, " how", false], [32234, 0.015229, " this", false], [332, 0.01295, " a", false], [59, 0.004957, ":", false], [45, 0.004581, ",", false], [32464, 0.004514, " what", false]]], "qwen": [279, 2, 0.10073703527450562, [[429, 0.677339, " that", false], [279, 0.100737, " the", false], [311, 0.073085, " to", false], [1246, 0.036996, " how", false], [537, 0.025421, " not", false], [264, 0.013102, " a", false], [419, 0.009452, " this", false], [1128, 0.009201, " what", false], [911, 0.00403, " about", false], [1101, 0.003283, " just", false]]]}, "raw_delta": 0.023845791816711426, "tuned_delta": 0.031182930330414162}, {"byte_start": 5743, "byte_end": 5749, "display": {"text": " great", "kind": "normal"}, "is_word": true, "word_id": 965, "word_key": " great", "bytes_hex": "20 67 72 65 61 74", "compression": {"rwkv": "15.97% 15.97% 15.97% 15.97% 15.97% 15.97%", "qwen": "13.41% 13.41% 13.41% 13.41% 13.41% 13.41%"}, "model_tokens": {"rwkv": [[38629, " great", "normal", 0.004896262194961309]], "qwen": [[2244, " great", "normal", 0.011553216725587845]]}, "loss": {"rwkv": 15.967327926505453, "qwen": 13.40742062958532}, "topk": {"rwkv": [38629, 18, 0.004896262194961309, [[62079, 0.263492, " importance", false], [31506, 0.108256, " need", false], [40093, 0.037795, " value", false], [59725, 0.019692, " following", false], [45661, 0.014542, " danger", false], [21719, 0.013373, " fut", false], [30808, 0.012481, " fact", false], [63820, 0.010554, " realization", false], [31135, 0.008251, " idea", false], [39339, 0.007671, " power", false]]], "qwen": [2244, 10, 0.011553216725587845, [[12650, 0.178247, " importance", false], [1184, 0.076754, " need", false], [897, 0.037843, " value", false], [2355, 0.019332, " power", false], [2097, 0.017897, " fact", false], [3476, 0.012779, " role", false], [6672, 0.012589, " difference", false], [23389, 0.012551, " wisdom", false], [17755, 0.012181, " lesson", false], [2244, 0.011553, " great", false]]]}, "raw_delta": 0.14195140202840162, "tuned_delta": 0.14928854054210436}, {"byte_start": 5749, "byte_end": 5755, "display": {"text": " power", "kind": "normal"}, "is_word": true, "word_id": 966, "word_key": " power", "bytes_hex": "20 70 6f 77 65 72", "compression": {"rwkv": "7.98% 7.98% 7.98% 7.98% 7.98% 7.98%", "qwen": "6.64% 6.64% 6.64% 6.64% 6.64% 6.64%"}, "model_tokens": {"rwkv": [[39339, " power", "normal", 0.07024160027503967]], "qwen": [[2355, " power", "normal", 0.10960918664932251]]}, "loss": {"rwkv": 7.983663963252726, "qwen": 6.644915179217694}, "topk": {"rwkv": [39339, 3, 0.07024160027503967, [[62079, 0.317759, " importance", false], [40093, 0.174476, " value", false], [39339, 0.070242, " power", false], [60211, 0.027899, " potential", false], [59093, 0.024464, " advantage", false], [51030, 0.023209, " benefit", false], [45661, 0.020927, " danger", false], [31506, 0.017957, " need", false], [61865, 0.014665, " difficulty", false], [30510, 0.01198, " cost", false]]], "qwen": [2355, 3, 0.10960918664932251, [[12650, 0.233723, " importance", false], [897, 0.15247, " value", false], [2355, 0.109609, " power", false], [4650, 0.025403, " potential", false], [16829, 0.025179, " difficulty", false], [6672, 0.019781, " difference", false], [1184, 0.019257, " need", false], [9423, 0.014658, " advantage", false], [7978, 0.011806, " danger", false], [8760, 0.011559, " benefit", false]]]}, "raw_delta": 0.074235995610555, "tuned_delta": 0.08157313412425773}, {"byte_start": 5755, "byte_end": 5758, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 967, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "1.19% 1.19% 1.19%", "qwen": "0.86% 0.86% 0.86%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.8207558989524841]], "qwen": [[315, " of", "normal", 0.8665686249732971]]}, "loss": {"rwkv": 1.1916792533384586, "qwen": 0.8608919430866092}, "topk": {"rwkv": [4706, 1, 0.8207558989524841, [[4706, 0.820756, " of", false], [32227, 0.06514, " that", false], [21265, 0.045903, " and", false], [4596, 0.014503, " in", false], [45, 0.00973, ",", false], [4811, 0.006957, " to", false], [4858, 0.003272, " we", false], [59206, 0.002996, " available", false], [56454, 0.00201, " inherent", false], [275, 0.00156, " (", false]]], "qwen": [315, 1, 0.8665686249732971, [[315, 0.866569, " of", false], [429, 0.055394, " that", false], [323, 0.03366, " and", false], [304, 0.016253, " in", false], [11, 0.004085, ",", false], [2500, 0.002322, " available", false], [582, 0.001572, " we", false], [36988, 0.001447, " inherent", false], [320, 0.001337, " (", false], [311, 0.001265, " to", false]]]}, "raw_delta": 0.018342743317286178, "tuned_delta": 0.025679881830988915}, {"byte_start": 5758, "byte_end": 5766, "display": {"text": " general", "kind": "normal"}, "is_word": true, "word_id": 968, "word_key": " general", "bytes_hex": "20 67 65 6e 65 72 61 6c", "compression": {"rwkv": "7.01% 7.01% 7.01% 7.01% 7.01% 7.01% 7.01% 7.01%", "qwen": "8.35% 8.35% 8.35% 8.35% 8.35% 8.35% 8.35% 8.35%"}, "model_tokens": {"rwkv": [[51832, " general", "normal", 0.04430420696735382]], "qwen": [[4586, " general", "normal", 0.02458660677075386]]}, "loss": {"rwkv": 7.009187332443938, "qwen": 8.353099537273936}, "topk": {"rwkv": [51832, 6, 0.04430420696735382, [[63370, 0.120057, " computation", false], [22590, 0.110868, " the", false], [47202, 0.078349, " search", false], [52195, 0.061203, " massive", false], [56537, 0.056924, " learning", false], [51832, 0.044304, " general", false], [37045, 0.038566, " Moore", false], [30597, 0.035247, " deep", false], [38888, 0.030758, " lever", false], [38720, 0.030664, " human", false]]], "qwen": [4586, 8, 0.02458660677075386, [[2711, 0.130795, " search", false], [34447, 0.084417, " computation", false], [6832, 0.075878, " learning", false], [26943, 0.074503, " scaling", false], [279, 0.052316, " the", false], [76482, 0.037135, " leveraging", false], [3738, 0.027417, " human", false], [4586, 0.024587, " general", false], [5538, 0.022336, " deep", false], [20219, 0.017969, " Moore", false]]]}, "raw_delta": -0.07452231645584106, "tuned_delta": -0.06718517794213832}, {"byte_start": 5766, "byte_end": 5774, "display": {"text": " purpose", "kind": "normal"}, "is_word": true, "word_id": 969, "word_key": " purpose", "bytes_hex": "20 70 75 72 70 6f 73 65", "compression": {"rwkv": "15.71% 15.71% 15.71% 15.71% 15.71% 15.71% 15.71% 15.71%", "qwen": "13.16% 13.16% 13.16% 13.16% 13.16% 13.16% 13.16% 13.16%"}, "model_tokens": {"rwkv": [[52610, " purpose", "normal", 0.0009392458596266806]], "qwen": [[7428, " purpose", "normal", 0.0029112529009580612]]}, "loss": {"rwkv": 15.70903291592963, "qwen": 13.162725505423662}, "topk": {"rwkv": [52610, 25, 0.0009392458596266806, [[52224, 0.743039, " methods", false], [7933, 0.042492, "ity", false], [45, 0.035831, ",", false], [61590, 0.02665, " approaches", false], [47202, 0.024667, " search", false], [63370, 0.022236, " computation", false], [46, 0.012739, "-", false], [62633, 0.009637, " techniques", false], [64862, 0.006711, " computational", false], [61559, 0.005334, " algorithms", false]]], "qwen": [7428, 16, 0.0029112529009580612, [[5413, 0.702868, " methods", false], [58238, 0.059669, "-purpose", false], [2022, 0.028043, "ization", false], [11, 0.025752, ",", false], [12538, 0.025624, " techniques", false], [19827, 0.023412, " approaches", false], [34447, 0.018258, " computation", false], [4849, 0.013943, "izing", false], [2711, 0.010966, " search", false], [16170, 0.00461, " principles", false]]]}, "raw_delta": 0.14119726419448853, "tuned_delta": 0.14853440270819127}, {"byte_start": 5774, "byte_end": 5782, "display": {"text": " methods", "kind": "normal"}, "is_word": true, "word_id": 970, "word_key": " methods", "bytes_hex": "20 6d 65 74 68 6f 64 73", "compression": {"rwkv": "3.38% 3.38% 3.38% 3.38% 3.38% 3.38% 3.38% 3.38%", "qwen": "1.14% 1.14% 1.14% 1.14% 1.14% 1.14% 1.14% 1.14%"}, "model_tokens": {"rwkv": [[52224, " methods", "normal", 0.2201198935508728]], "qwen": [[5413, " methods", "normal", 0.6017976403236389]]}, "loss": {"rwkv": 3.3813165020835076, "qwen": 1.1447650286248554}, "topk": {"rwkv": [52224, 2, 0.2201198935508728, [[63370, 0.384273, " computation", false], [52224, 0.22012, " methods", false], [45, 0.075397, ",", false], [47202, 0.056132, " search", false], [59346, 0.033915, " computing", false], [56537, 0.020645, " learning", false], [61590, 0.018413, " approaches", false], [52167, 0.017347, " machine", false], [64862, 0.0154, " computational", false], [61559, 0.013282, " algorithms", false]]], "qwen": [5413, 1, 0.6017976403236389, [[5413, 0.601798, " methods", false], [34447, 0.076976, " computation", false], [11, 0.038898, ",", false], [12538, 0.035484, " techniques", false], [6832, 0.021442, " learning", false], [19827, 0.019211, " approaches", false], [2711, 0.018296, " search", false], [24231, 0.017946, " computing", false], [25185, 0.015499, " algorithms", false], [7375, 0.010698, " tools", false]]]}, "raw_delta": 0.12402074784040451, "tuned_delta": 0.13135788635410725}, {"byte_start": 5782, "byte_end": 5783, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "35.22%", "qwen": "36.43%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.1402633935213089]], "qwen": [[11, ",", "normal", 0.1326359212398529]]}, "loss": {"rwkv": 35.222046896703205, "qwen": 36.430706570436854}, "topk": {"rwkv": [45, 3, 0.1402633935213089, [[47, 0.27583, ".", false], [32227, 0.186035, " that", false], [45, 0.140263, ",", false], [37810, 0.119603, " based", false], [38888, 0.030657, " lever", false], [21700, 0.029616, " for", false], [4811, 0.025913, " to", false], [31296, 0.0257, " like", false], [21265, 0.020502, " and", false], [4596, 0.020087, " in", false]]], "qwen": [11, 3, 0.1326359212398529, [[429, 0.30262, " that", false], [13, 0.202239, ".", false], [11, 0.132636, ",", false], [3118, 0.076307, " based", false], [369, 0.057671, " for", false], [76482, 0.053195, " leveraging", false], [4421, 0.025408, "---", false], [323, 0.017669, " and", false], [320, 0.012069, " (", false], [315, 0.009734, " of", false]]]}, "raw_delta": -0.06702232360839844, "tuned_delta": -0.0596851850946957}, {"byte_start": 5783, "byte_end": 5786, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 971, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "25.17% 25.17% 25.17%", "qwen": "27.84% 27.84% 27.84%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.01513650082051754]], "qwen": [[315, " of", "normal", 0.009746178984642029]]}, "loss": {"rwkv": 25.172022848843888, "qwen": 27.83728098492755}, "topk": {"rwkv": [4706, 15, 0.01513650082051754, [[21265, 0.201004, " and", false], [40186, 0.081214, " which", false], [37810, 0.079138, " based", false], [32139, 0.055665, " such", false], [31296, 0.051053, " like", false], [61953, 0.045036, " especially", false], [4423, 0.029465, " as", false], [4596, 0.028353, " in", false], [32227, 0.021198, " that", false], [52224, 0.019327, " methods", false]]], "qwen": [315, 21, 0.009746178984642029, [[323, 0.2285, " and", false], [892, 0.108199, " which", false], [1741, 0.049188, " such", false], [5310, 0.043817, " especially", false], [5413, 0.043779, " methods", false], [429, 0.04067, " that", false], [3118, 0.03595, " based", false], [304, 0.033636, " in", false], [438, 0.024886, " as", false], [1075, 0.021069, " like", false]]]}, "raw_delta": -0.14779329299926758, "tuned_delta": -0.14045615448556484}, {"byte_start": 5786, "byte_end": 5794, "display": {"text": " methods", "kind": "normal"}, "is_word": true, "word_id": 972, "word_key": " methods", "bytes_hex": "20 6d 65 74 68 6f 64 73", "compression": {"rwkv": "2.31% 2.31% 2.31% 2.31% 2.31% 2.31% 2.31% 2.31%", "qwen": "1.69% 1.69% 1.69% 1.69% 1.69% 1.69% 1.69% 1.69%"}, "model_tokens": {"rwkv": [[52224, " methods", "normal", 0.35644426941871643]], "qwen": [[5413, " methods", "normal", 0.4725334644317627]]}, "loss": {"rwkv": 2.30704407173406, "qwen": 1.6898617563899454}, "topk": {"rwkv": [52224, 1, 0.35644426941871643, [[52224, 0.356444, " methods", false], [63370, 0.060306, " computation", false], [51832, 0.056291, " general", false], [22590, 0.055614, " the", false], [47202, 0.045822, " search", false], [38888, 0.039021, " lever", false], [56537, 0.02057, " learning", false], [52195, 0.019121, " massive", false], [39944, 0.016459, " those", false], [59346, 0.013864, " computing", false]]], "qwen": [5413, 1, 0.4725334644317627, [[5413, 0.472533, " methods", false], [76482, 0.103653, " leveraging", false], [2711, 0.027005, " search", false], [892, 0.024523, " which", false], [12538, 0.022774, " techniques", false], [279, 0.018274, " the", false], [4586, 0.016407, " general", false], [1667, 0.015324, " using", false], [26943, 0.014974, " scaling", false], [34447, 0.013791, " computation", false]]]}, "raw_delta": 0.034223854541778564, "tuned_delta": 0.041560993055481305}, {"byte_start": 5794, "byte_end": 5799, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 973, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"rwkv": "1.18% 1.18% 1.18% 1.18% 1.18%", "qwen": "0.76% 0.76% 0.76% 0.76% 0.76%"}, "model_tokens": {"rwkv": [[32227, " that", "normal", 0.7168906331062317]], "qwen": [[429, " that", "normal", 0.8100671768188477]]}, "loss": {"rwkv": 1.176416366349887, "qwen": 0.7597162156659493}, "topk": {"rwkv": [32227, 1, 0.7168906331062317, [[32227, 0.716891, " that", false], [37810, 0.109687, " based", false], [31296, 0.014968, " like", false], [22187, 0.014033, " not", false], [37924, 0.012525, " built", false], [38888, 0.009987, " lever", false], [4596, 0.0071, " in", false], [21700, 0.006573, " for", false], [55966, 0.006388, " designed", false], [32487, 0.006295, " with", false]]], "qwen": [429, 1, 0.8100671768188477, [[429, 0.810067, " that", false], [3118, 0.062734, " based", false], [76482, 0.010371, " leveraging", false], [537, 0.009305, " not", false], [892, 0.007798, " which", false], [369, 0.006217, " for", false], [304, 0.004875, " in", false], [6693, 0.004694, " whose", false], [315, 0.004501, " of", false], [448, 0.004247, " with", false]]]}, "raw_delta": 0.023106762766838068, "tuned_delta": 0.030443901280540805}, {"byte_start": 5799, "byte_end": 5808, "display": {"text": " continue", "kind": "normal"}, "is_word": true, "word_id": 974, "word_key": " continue", "bytes_hex": "20 63 6f 6e 74 69 6e 75 65", "compression": {"rwkv": "20.66% 20.66% 20.66% 20.66% 20.66% 20.66% 20.66% 20.66% 20.66%", "qwen": "17.37% 17.37% 17.37% 17.37% 17.37% 17.37% 17.37% 17.37% 17.37%"}, "model_tokens": {"rwkv": [[55851, " continue", "normal", 3.4100001357728615e-05]], "qwen": [[3060, " continue", "normal", 0.00017152675718534738]]}, "loss": {"rwkv": 20.66360084606588, "qwen": 17.373998869850823}, "topk": {"rwkv": [55851, 543, 3.4100001357728615e-05, [[21286, 0.197369, " are", false], [21413, 0.129306, " can", false], [4491, 0.112376, " do", false], [56540, 0.080785, " leverage", false], [32499, 0.048057, " work", false], [22681, 0.0399, " use", false], [32187, 0.039287, " take", false], [31358, 0.036648, " make", false], [39590, 0.023734, " scale", false], [37730, 0.01443, " apply", false]]], "qwen": [3060, 229, 0.00017152675718534738, [[32064, 0.184149, " leverage", false], [646, 0.143933, " can", false], [653, 0.121026, " do", false], [525, 0.112008, " are", false], [1896, 0.035563, " take", false], [5452, 0.028873, " scale", false], [975, 0.026423, " work", false], [1281, 0.025458, " make", false], [990, 0.024203, " use", false], [32194, 0.013727, " exploit", false]]]}, "raw_delta": 0.18241426679823125, "tuned_delta": 0.189751405311934}, {"byte_start": 5808, "byte_end": 5811, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 975, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "0.50% 0.50% 0.50%", "qwen": "0.29% 0.29% 0.29%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.9196329116821289]], "qwen": [[311, " to", "normal", 0.9529430270195007]]}, "loss": {"rwkv": 0.5019141682780207, "qwen": 0.28974210546681106}, "topk": {"rwkv": [4811, 1, 0.9196329116821289, [[4811, 0.919633, " to", false], [38888, 0.007704, " lever", false], [22590, 0.004896, " the", false], [52805, 0.004568, " scaling", false], [45, 0.003514, ",", false], [4596, 0.002361, " in", false], [4712, 0.002336, " on", false], [60463, 0.002098, " searching", false], [39931, 0.001944, " their", false], [59832, 0.001894, " improving", false]]], "qwen": [311, 1, 0.9529430270195007, [[311, 0.952943, " to", false], [26943, 0.00323, " scaling", false], [6832, 0.002523, " learning", false], [3238, 0.002497, " working", false], [40928, 0.002333, " evolving", false], [18392, 0.001735, " improving", false], [15039, 0.001664, " searching", false], [279, 0.001274, " the", false], [862, 0.001127, " their", false], [304, 0.001102, " in", false]]]}, "raw_delta": 0.011765317370494207, "tuned_delta": 0.019102455884196942}, {"byte_start": 5811, "byte_end": 5817, "display": {"text": " scale", "kind": "normal"}, "is_word": true, "word_id": 976, "word_key": " scale", "bytes_hex": "20 73 63 61 6c 65", "compression": {"rwkv": "5.57% 5.57% 5.57% 5.57% 5.57% 5.57%", "qwen": "8.58% 8.58% 8.58% 8.58% 8.58% 8.58%"}, "model_tokens": {"rwkv": [[39590, " scale", "normal", 0.15863826870918274]], "qwen": [[5452, " scale", "normal", 0.05761812999844551]]}, "loss": {"rwkv": 5.565083409679106, "qwen": 8.577778030658298}, "topk": {"rwkv": [39590, 1, 0.15863826870918274, [[39590, 0.158638, " scale", false], [51982, 0.112899, " improve", false], [32499, 0.10068, " work", false], [4435, 0.079976, " be", false], [56540, 0.068653, " leverage", false], [38877, 0.022838, " learn", false], [31017, 0.022252, " grow", false], [31358, 0.021849, " make", false], [21751, 0.019851, " get", false], [52573, 0.017467, " produce", false]]], "qwen": [5452, 4, 0.05761812999844551, [[387, 0.151001, " be", false], [975, 0.120046, " work", false], [7269, 0.116449, " improve", false], [5452, 0.057618, " scale", false], [37580, 0.044474, " evolve", false], [1281, 0.040973, " make", false], [3063, 0.036439, " grow", false], [32064, 0.021143, " leverage", false], [8760, 0.01922, " benefit", false], [3960, 0.013668, " learn", false]]]}, "raw_delta": -0.1670592625935872, "tuned_delta": -0.15972212407988445}, {"byte_start": 5817, "byte_end": 5822, "display": {"text": " with", "kind": "normal"}, "is_word": true, "word_id": 977, "word_key": " with", "bytes_hex": "20 77 69 74 68", "compression": {"rwkv": "7.02% 7.02% 7.02% 7.02% 7.02%", "qwen": "4.33% 4.33% 4.33% 4.33% 4.33%"}, "model_tokens": {"rwkv": [[32487, " with", "normal", 0.14284653961658478]], "qwen": [[448, " with", "normal", 0.3008979856967926]]}, "loss": {"rwkv": 7.016231741823278, "qwen": 4.331634156650095}, "topk": {"rwkv": [32487, 1, 0.14284653961658478, [[32487, 0.142847, " with", false], [63370, 0.098776, " computation", false], [4596, 0.095946, " in", false], [21265, 0.075648, " and", false], [45, 0.072032, ",", false], [4423, 0.071088, " as", false], [64911, 0.045427, " exponentially", false], [47, 0.037325, ".", false], [4833, 0.024998, " up", false], [59988, 0.021688, " massively", false]]], "qwen": [448, 1, 0.3008979856967926, [[448, 0.300898, " with", false], [438, 0.116872, " as", false], [705, 0.065229, " up", false], [323, 0.064483, " and", false], [11, 0.062953, ",", false], [13, 0.04911, ".", false], [34447, 0.038239, " computation", false], [304, 0.036669, " in", false], [1632, 0.029503, " well", false], [553, 0.024149, " by", false]]]}, "raw_delta": 0.14886569976806638, "tuned_delta": 0.15620283828176912}, {"byte_start": 5822, "byte_end": 5832, "display": {"text": " increased", "kind": "normal"}, "is_word": true, "word_id": 978, "word_key": " increased", "bytes_hex": "20 69 6e 63 72 65 61 73 65 64", "compression": {"rwkv": "6.11% 6.11% 6.11% 6.11% 6.11% 6.11% 6.11% 6.11% 6.11% 6.11%", "qwen": "7.67% 7.67% 7.67% 7.67% 7.67% 7.67% 7.67% 7.67% 7.67% 7.67%"}, "model_tokens": {"rwkv": [[59846, " increased", "normal", 0.03438793867826462]], "qwen": [[7172, " increased", "normal", 0.014236995950341225]]}, "loss": {"rwkv": 6.114547341267675, "qwen": 7.667763937045909}, "topk": {"rwkv": [59846, 8, 0.03438793867826462, [[22590, 0.193636, " the", false], [63370, 0.156598, " computation", false], [31458, 0.067224, " more", false], [30789, 0.066241, " ever", false], [62092, 0.060614, " increasing", false], [37045, 0.043955, " Moore", false], [52195, 0.043565, " massive", false], [59846, 0.034388, " increased", false], [61535, 0.019675, " additional", false], [51816, 0.01832, " further", false]]], "qwen": [7172, 8, 0.014236995950341225, [[20219, 0.292234, " Moore", false], [279, 0.172921, " the", false], [34447, 0.141059, " computation", false], [7703, 0.047749, " increasing", false], [2500, 0.027034, " available", false], [54480, 0.016824, " computational", false], [803, 0.015453, " more", false], [7172, 0.014237, " increased", false], [10951, 0.012732, " massive", false], [501, 0.01187, " new", false]]]}, "raw_delta": -0.08612861633300783, "tuned_delta": -0.0787914778193051}, {"byte_start": 5832, "byte_end": 5844, "display": {"text": " computation", "kind": "normal"}, "is_word": true, "word_id": 979, "word_key": " computation", "bytes_hex": "20 63 6f 6d 70 75 74 61 74 69 6f 6e", "compression": {"rwkv": "1.07% 1.07% 1.07% 1.07% 1.07% 1.07% 1.07% 1.07% 1.07% 1.07% 1.07% 1.07%", "qwen": "0.65% 0.65% 0.65% 0.65% 0.65% 0.65% 0.65% 0.65% 0.65% 0.65% 0.65% 0.65%"}, "model_tokens": {"rwkv": [[63370, " computation", "normal", 0.4895477890968323]], "qwen": [[34447, " computation", "normal", 0.6468513011932373]]}, "loss": {"rwkv": 1.0742724303494477, "qwen": 0.6546811617302088}, "topk": {"rwkv": [63370, 1, 0.4895477890968323, [[63370, 0.489548, " computation", false], [64862, 0.105092, " computational", false], [59346, 0.070708, " computing", false], [60406, 0.045169, " resources", false], [50897, 0.026294, " amounts", false], [51266, 0.022165, " compute", false], [59206, 0.013976, " available", false], [39339, 0.013104, " power", false], [56353, 0.011929, " hardware", false], [30579, 0.011643, " data", false]]], "qwen": [34447, 1, 0.6468513011932373, [[34447, 0.646851, " computation", false], [54480, 0.09894, " computational", false], [14713, 0.078807, " amounts", false], [24231, 0.046903, " computing", false], [2500, 0.015446, " available", false], [18048, 0.013459, " availability", false], [6366, 0.010488, " computer", false], [2783, 0.006107, " cost", false], [4963, 0.005944, " resources", false], [11773, 0.005312, " hardware", false]]]}, "raw_delta": 0.0232670803864797, "tuned_delta": 0.030604218900182438}, {"byte_start": 5844, "byte_end": 5849, "display": {"text": " even", "kind": "normal"}, "is_word": true, "word_id": 980, "word_key": " even", "bytes_hex": "20 65 76 65 6e", "compression": {"rwkv": "17.70% 17.70% 17.70% 17.70% 17.70%", "qwen": "19.09% 19.09% 19.09% 19.09% 19.09%"}, "model_tokens": {"rwkv": [[30788, " even", "normal", 0.00738136051222682]], "qwen": [[1496, " even", "normal", 0.005025168415158987]]}, "loss": {"rwkv": 17.69555636090369, "qwen": 19.091530938824565}, "topk": {"rwkv": [30788, 9, 0.00738136051222682, [[47, 0.432861, ".", false], [45, 0.273278, ",", false], [21265, 0.144218, " and", false], [5346, 0.013877, "---", false], [31601, 0.012073, " over", false], [275, 0.009163, " (", false], [4423, 0.008851, " as", false], [4596, 0.007822, " in", false], [30788, 0.007381, " even", false], [4450, 0.006698, " by", false]]], "qwen": [1496, 15, 0.005025168415158987, [[13, 0.533932, ".", false], [11, 0.231739, ",", false], [323, 0.065042, " and", false], [2355, 0.018454, " power", false], [2500, 0.016098, " available", false], [320, 0.012527, " (", false], [304, 0.01184, " in", false], [438, 0.010132, " as", false], [4421, 0.00899, "---", false], [382, 0.007814, ".\n\n", false]]]}, "raw_delta": -0.07740926742553711, "tuned_delta": -0.07007212891183437}, {"byte_start": 5849, "byte_end": 5852, "display": {"text": " as", "kind": "normal"}, "is_word": true, "word_id": 981, "word_key": " as", "bytes_hex": "20 61 73", "compression": {"rwkv": "7.33% 7.33% 7.33%", "qwen": "6.94% 6.94% 6.94%"}, "model_tokens": {"rwkv": [[4423, " as", "normal", 0.29345259070396423]], "qwen": [[438, " as", "normal", 0.3154607117176056]]}, "loss": {"rwkv": 7.326185754514267, "qwen": 6.935282804396296}, "topk": {"rwkv": [4423, 1, 0.29345259070396423, [[4423, 0.293453, " as", false], [32465, 0.260425, " when", false], [4596, 0.107043, " in", false], [4588, 0.075923, " if", false], [37634, 0.07347, " after", false], [47544, 0.068967, " though", false], [40187, 0.027339, " while", false], [31601, 0.007601, " over", false], [21700, 0.007546, " for", false], [50870, 0.005935, " against", false]]], "qwen": [438, 1, 0.3154607117176056, [[438, 0.315461, " as", false], [979, 0.261261, " when", false], [421, 0.124773, " if", false], [1283, 0.103627, " after", false], [304, 0.055037, " in", false], [3498, 0.036656, " though", false], [1393, 0.022834, " while", false], [7797, 0.017056, " beyond", false], [2041, 0.010729, " without", false], [518, 0.007943, " at", false]]]}, "raw_delta": 0.02167626221974689, "tuned_delta": 0.029013400733449626}, {"byte_start": 5852, "byte_end": 5856, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 982, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "5.88% 5.88% 5.88% 5.88%", "qwen": "5.45% 5.45% 5.45% 5.45%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.2738429605960846]], "qwen": [[279, " the", "normal", 0.2983497083187103]]}, "loss": {"rwkv": 5.882081831749435, "qwen": 5.452886765268265}, "topk": {"rwkv": [22590, 1, 0.2738429605960846, [[22590, 0.273843, " the", false], [32232, 0.190757, " they", false], [4858, 0.085906, " we", false], [38720, 0.060735, " human", false], [39931, 0.038152, " their", false], [39193, 0.02744, " other", false], [31458, 0.022442, " more", false], [63370, 0.01958, " computation", false], [22248, 0.016678, " our", false], [22168, 0.010046, " new", false]]], "qwen": [279, 1, 0.2983497083187103, [[279, 0.29835, " the", false], [807, 0.211722, " they", false], [3738, 0.084128, " human", false], [862, 0.071106, " their", false], [34447, 0.025875, " computation", false], [803, 0.025603, " more", false], [582, 0.01675, " we", false], [501, 0.016648, " new", false], [3151, 0.015792, " specific", false], [11811, 0.012698, " researchers", false]]]}, "raw_delta": 0.023799628019332886, "tuned_delta": 0.031136766533035622}, {"byte_start": 5856, "byte_end": 5866, "display": {"text": " available", "kind": "normal"}, "is_word": true, "word_id": 983, "word_key": " available", "bytes_hex": "20 61 76 61 69 6c 61 62 6c 65", "compression": {"rwkv": "8.40% 8.40% 8.40% 8.40% 8.40% 8.40% 8.40% 8.40% 8.40% 8.40%", "qwen": "8.28% 8.28% 8.28% 8.28% 8.28% 8.28% 8.28% 8.28% 8.28% 8.28%"}, "model_tokens": {"rwkv": [[59206, " available", "normal", 0.009530733339488506]], "qwen": [[2500, " available", "normal", 0.010146329179406166]]}, "loss": {"rwkv": 8.396935980174046, "qwen": 8.278623095252737}, "topk": {"rwkv": [59206, 22, 0.009530733339488506, [[45775, 0.114093, " domain", false], [52569, 0.086557, " problem", false], [38720, 0.053422, " human", false], [52224, 0.040065, " methods", false], [62680, 0.029402, " underlying", false], [45157, 0.026116, " amount", false], [38478, 0.025058, " field", false], [57103, 0.020151, " research", false], [61720, 0.018814, " complexity", false], [62293, 0.018634, " particular", false]]], "qwen": [2500, 19, 0.010146329179406166, [[34447, 0.102133, " computation", false], [3738, 0.094568, " human", false], [3311, 0.074239, " amount", false], [7947, 0.047311, " domain", false], [3151, 0.036203, " specific", false], [5413, 0.034137, " methods", false], [3491, 0.030156, " problem", false], [6540, 0.021283, " knowledge", false], [54480, 0.019491, " computational", false], [6993, 0.016969, " nature", false]]]}, "raw_delta": 0.006560659408569369, "tuned_delta": 0.013897797922272106}, {"byte_start": 5866, "byte_end": 5878, "display": {"text": " computation", "kind": "normal"}, "is_word": true, "word_id": 984, "word_key": " computation", "bytes_hex": "20 63 6f 6d 70 75 74 61 74 69 6f 6e", "compression": {"rwkv": "3.48% 3.48% 3.48% 3.48% 3.48% 3.48% 3.48% 3.48% 3.48% 3.48% 3.48% 3.48%", "qwen": "1.13% 1.13% 1.13% 1.13% 1.13% 1.13% 1.13% 1.13% 1.13% 1.13% 1.13% 1.13%"}, "model_tokens": {"rwkv": [[63370, " computation", "normal", 0.09843704849481583]], "qwen": [[34447, " computation", "normal", 0.47061216831207275]]}, "loss": {"rwkv": 3.4752419604747162, "qwen": 1.132697444927869}, "topk": {"rwkv": [63370, 3, 0.09843704849481583, [[38720, 0.414505, " human", false], [59943, 0.215194, " knowledge", false], [63370, 0.098437, " computation", false], [30579, 0.050889, " data", false], [45775, 0.037924, " domain", false], [63637, 0.03553, " information", false], [64862, 0.008171, " computational", false], [45157, 0.007788, " amount", false], [60406, 0.007047, " resources", false], [22363, 0.006262, " raw", false]]], "qwen": [34447, 1, 0.47061216831207275, [[34447, 0.470612, " computation", false], [6540, 0.165297, " knowledge", false], [3738, 0.115396, " human", false], [3311, 0.043473, " amount", false], [54480, 0.022194, " computational", false], [5413, 0.011345, " methods", false], [11773, 0.007348, " hardware", false], [7947, 0.0073, " domain", false], [821, 0.00552, " data", false], [1995, 0.005116, " information", false]]]}, "raw_delta": 0.12989825010299683, "tuned_delta": 0.13723538861669957}, {"byte_start": 5878, "byte_end": 5886, "display": {"text": " becomes", "kind": "normal"}, "is_word": true, "word_id": 985, "word_key": " becomes", "bytes_hex": "20 62 65 63 6f 6d 65 73", "compression": {"rwkv": "8.07% 8.07% 8.07% 8.07% 8.07% 8.07% 8.07% 8.07%", "qwen": "6.26% 6.26% 6.26% 6.26% 6.26% 6.26% 6.26% 6.26%"}, "model_tokens": {"rwkv": [[51019, " becomes", "normal", 0.027868805453181267]], "qwen": [[9044, " becomes", "normal", 0.06228700652718544]]}, "loss": {"rwkv": 8.065848739345034, "qwen": 6.257695165908513}, "topk": {"rwkv": [51019, 7, 0.027868805453181267, [[59847, 0.46205, " increases", false], [38642, 0.172917, " grows", false], [47181, 0.055605, " scales", false], [4600, 0.043152, " is", false], [46342, 0.039382, " itself", false], [59393, 0.029412, " continues", false], [51019, 0.027869, " becomes", false], [30659, 0.023704, " does", false], [39529, 0.008062, " rises", false], [51682, 0.007764, " expands", false]]], "qwen": [9044, 4, 0.06228700652718544, [[12703, 0.253245, " increases", false], [5086, 0.142313, " itself", false], [27715, 0.085325, " grows", false], [9044, 0.062287, " becomes", false], [374, 0.053701, " is", false], [9539, 0.046072, " continues", false], [28405, 0.03588, " scales", false], [39296, 0.033377, " doubles", false], [37168, 0.017151, " rises", false], [5221, 0.016072, " gets", false]]]}, "raw_delta": 0.10026532411575317, "tuned_delta": 0.10760246262945591}, {"byte_start": 5886, "byte_end": 5891, "display": {"text": " very", "kind": "normal"}, "is_word": true, "word_id": 986, "word_key": " very", "bytes_hex": "20 76 65 72 79", "compression": {"rwkv": "16.79% 16.79% 16.79% 16.79% 16.79%", "qwen": "15.78% 15.78% 15.78% 15.78% 15.78%"}, "model_tokens": {"rwkv": [[32386, " very", "normal", 0.009424434043467045]], "qwen": [[1602, " very", "normal", 0.012585463002324104]]}, "loss": {"rwkv": 16.79387196034809, "qwen": 15.780244052345884}, "topk": {"rwkv": [32386, 17, 0.009424434043467045, [[31458, 0.244896, " more", false], [64430, 0.082322, " increasingly", false], [51867, 0.04863, " greater", false], [30789, 0.04502, " ever", false], [59206, 0.044943, " available", false], [47708, 0.042764, " vastly", false], [51178, 0.041933, " cheaper", false], [46397, 0.038794, " larger", false], [59988, 0.033188, " massively", false], [32373, 0.030244, " vast", false]]], "qwen": [1602, 14, 0.012585463002324104, [[803, 0.190779, " more", false], [23048, 0.136486, " cheaper", false], [74151, 0.043393, " exponentially", false], [2686, 0.043111, " less", false], [3512, 0.039846, " ever", false], [14756, 0.035201, " increasingly", false], [1753, 0.026386, " much", false], [52008, 0.024412, " vastly", false], [9155, 0.018486, " smaller", false], [8131, 0.017435, " larger", false]]]}, "raw_delta": 0.056207466125488326, "tuned_delta": 0.06354460463919107}, {"byte_start": 5891, "byte_end": 5897, "display": {"text": " great", "kind": "normal"}, "is_word": true, "word_id": 987, "word_key": " great", "bytes_hex": "20 67 72 65 61 74", "compression": {"rwkv": "15.78% 15.78% 15.78% 15.78% 15.78% 15.78%", "qwen": "14.65% 14.65% 14.65% 14.65% 14.65% 14.65%"}, "model_tokens": {"rwkv": [[38629, " great", "normal", 0.005289455875754356]], "qwen": [[2244, " great", "normal", 0.00763477198779583]]}, "loss": {"rwkv": 15.779477009723035, "qwen": 14.652497629639166}, "topk": {"rwkv": [38629, 15, 0.005289455875754356, [[38864, 0.62691, " large", false], [31466, 0.050232, " much", false], [52195, 0.037726, " massive", false], [59682, 0.036221, " expensive", false], [38006, 0.029453, " cheap", false], [45, 0.023396, ",", false], [55425, 0.022466, " abundant", false], [52140, 0.020414, " limited", false], [31082, 0.01228, " high", false], [56900, 0.011446, " powerful", false]]], "qwen": [2244, 12, 0.00763477198779583, [[3460, 0.591815, " large", false], [11392, 0.079838, " expensive", false], [11872, 0.058693, " cheap", false], [33248, 0.030851, " costly", false], [10951, 0.025125, " massive", false], [1753, 0.021907, " much", false], [1550, 0.015571, " high", false], [2155, 0.015023, " different", false], [11, 0.01191, ",", false], [2613, 0.010517, " small", false]]]}, "raw_delta": 0.06249300638834632, "tuned_delta": 0.06983014490204906}, {"byte_start": 5897, "byte_end": 5898, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "3.22%", "qwen": "4.96%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.835978090763092]], "qwen": [[13, ".", "normal", 0.7596530914306641]]}, "loss": {"rwkv": 3.2228172910483432, "qwen": 4.957342404421576}, "topk": {"rwkv": [47, 1, 0.835978090763092, [[47, 0.835978, ".", false], [45, 0.097559, ",", false], [21265, 0.018007, " and", false], [5346, 0.014998, "---", false], [275, 0.009234, " (", false], [46272, 0.005245, " indeed", false], [4596, 0.003768, " in", false], [59, 0.00206, ":", false], [4715, 0.001534, " or", false], [57070, 0.001347, " relative", false]]], "qwen": [13, 1, 0.7596530914306641, [[13, 0.759653, ".", false], [11, 0.090143, ",", false], [12824, 0.03693, " indeed", false], [323, 0.028389, " and", false], [382, 0.018928, ".\n\n", false], [320, 0.013618, " (", false], [304, 0.013529, " in", false], [4421, 0.007694, "---", false], [7707, 0.004819, " compared", false], [624, 0.002992, ".\n", false]]]}, "raw_delta": -0.09618249535560608, "tuned_delta": -0.08884535684190334}, {"byte_start": 5898, "byte_end": 5902, "display": {"text": " The", "kind": "normal"}, "is_word": true, "word_id": 988, "word_key": " the", "bytes_hex": "20 54 68 65", "compression": {"rwkv": "8.91% 8.91% 8.91% 8.91%", "qwen": "9.63% 9.63% 9.63% 9.63%"}, "model_tokens": {"rwkv": [[20996, " The", "normal", 0.13893863558769226]], "qwen": [[576, " The", "normal", 0.11811265349388123]]}, "loss": {"rwkv": 8.91117786486591, "qwen": 9.63051465014783}, "topk": {"rwkv": [20996, 1, 0.13893863558769226, [[20996, 0.138939, " The", false], [29894, 0.092007, " This", false], [37453, 0.079556, " These", false], [49964, 0.048616, " Another", false], [3913, 0.042191, " In", false], [3918, 0.039156, " It", false], [4331, 0.033864, " We", false], [300, 0.023888, " A", false], [37451, 0.022641, " There", false], [20556, 0.021518, " One", false]]], "qwen": [576, 1, 0.11811265349388123, [[576, 0.118113, " The", false], [4220, 0.089386, " These", false], [1096, 0.089242, " This", false], [758, 0.044741, " In", false], [1084, 0.040934, " It", false], [18801, 0.036011, " Methods", false], [3251, 0.02725, " General", false], [15132, 0.026036, " Such", false], [1205, 0.022733, " We", false], [362, 0.021711, " A", false]]]}, "raw_delta": -0.03988850116729736, "tuned_delta": -0.03255136265359462}, {"byte_start": 5902, "byte_end": 5906, "display": {"text": " two", "kind": "normal"}, "is_word": true, "word_id": 989, "word_key": " two", "bytes_hex": "20 74 77 6f", "compression": {"rwkv": "25.64% 25.64% 25.64% 25.64%", "qwen": "22.49% 22.49% 22.49% 22.49%"}, "model_tokens": {"rwkv": [[22638, " two", "normal", 0.003439505584537983]], "qwen": [[1378, " two", "normal", 0.006819556001573801]]}, "loss": {"rwkv": 25.641650140799932, "qwen": 22.487832289277748}, "topk": {"rwkv": [22638, 46, 0.003439505584537983, [[45315, 0.05214, " bitter", false], [52224, 0.050568, " methods", false], [39193, 0.043092, " other", false], [51832, 0.031421, " general", false], [31461, 0.029041, " most", false], [46430, 0.026073, " lesson", false], [39339, 0.024314, " power", false], [38720, 0.02409, " human", false], [38629, 0.019845, " great", false], [31458, 0.013868, " more", false]]], "qwen": [1378, 22, 0.006819556001573801, [[25180, 0.054846, " bitter", false], [2244, 0.045813, " great", false], [2355, 0.035684, " power", false], [1429, 0.035433, " most", false], [1008, 0.02844, " other", false], [803, 0.023813, " more", false], [1850, 0.019804, " best", false], [17755, 0.019538, " lesson", false], [4586, 0.018616, " general", false], [16724, 0.018521, " ultimate", false]]]}, "raw_delta": 0.17488479614257812, "tuned_delta": 0.18222193465628087}, {"byte_start": 5906, "byte_end": 5914, "display": {"text": " methods", "kind": "normal"}, "is_word": true, "word_id": 990, "word_key": " methods", "bytes_hex": "20 6d 65 74 68 6f 64 73", "compression": {"rwkv": "6.13% 6.13% 6.13% 6.13% 6.13% 6.13% 6.13% 6.13%", "qwen": "7.09% 7.09% 7.09% 7.09% 7.09% 7.09% 7.09% 7.09%"}, "model_tokens": {"rwkv": [[52224, " methods", "normal", 0.0659329891204834]], "qwen": [[5413, " methods", "normal", 0.04310791566967964]]}, "loss": {"rwkv": 6.128636160026358, "qwen": 7.0873491476948125}, "topk": {"rwkv": [52224, 3, 0.0659329891204834, [[31461, 0.229599, " most", false], [56162, 0.097188, " examples", false], [52224, 0.065933, " methods", false], [61590, 0.053488, " approaches", false], [31356, 0.037607, " main", false], [51832, 0.037395, " general", false], [39193, 0.028713, " other", false], [21357, 0.025919, " big", false], [51200, 0.025231, " classes", false], [38841, 0.023008, " kinds", false]]], "qwen": [5413, 3, 0.04310791566967964, [[1429, 0.319986, " most", false], [2244, 0.061233, " great", false], [5413, 0.043108, " methods", false], [1850, 0.038617, " best", false], [1887, 0.037959, " main", false], [19827, 0.027477, " approaches", false], [6846, 0.022287, " classes", false], [10295, 0.02201, " examples", false], [3598, 0.021598, " major", false], [4586, 0.016298, " general", false]]]}, "raw_delta": -0.053162336349487305, "tuned_delta": -0.045825197835784565}, {"byte_start": 5914, "byte_end": 5919, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 991, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"rwkv": "2.07% 2.07% 2.07% 2.07% 2.07%", "qwen": "1.54% 1.54% 1.54% 1.54% 1.54%"}, "model_tokens": {"rwkv": [[32227, " that", "normal", 0.5605869889259338]], "qwen": [[429, " that", "normal", 0.651837944984436]]}, "loss": {"rwkv": 2.0710563575261483, "qwen": 1.5435369822310456}, "topk": {"rwkv": [32227, 1, 0.5605869889259338, [[32227, 0.560587, " that", false], [31461, 0.038841, " most", false], [45, 0.038774, ",", false], [4596, 0.036157, " in", false], [60003, 0.034913, " mentioned", false], [21286, 0.027814, " are", false], [4706, 0.026996, " of", false], [59546, 0.020205, " discussed", false], [5346, 0.016243, "---", false], [4858, 0.015334, " we", false]]], "qwen": [429, 1, 0.651837944984436, [[429, 0.651838, " that", false], [315, 0.050855, " of", false], [1429, 0.033235, " most", false], [11, 0.026012, ",", false], [448, 0.022792, " with", false], [369, 0.017932, " for", false], [304, 0.012973, " in", false], [582, 0.011556, " we", false], [4421, 0.010776, "---", false], [525, 0.009607, " are", false]]]}, "raw_delta": 0.029251885414123536, "tuned_delta": 0.03658902392782627}, {"byte_start": 5919, "byte_end": 5924, "display": {"text": " seem", "kind": "normal"}, "is_word": true, "word_id": 992, "word_key": " seem", "bytes_hex": "20 73 65 65 6d", "compression": {"rwkv": "17.81% 17.81% 17.81% 17.81% 17.81%", "qwen": "14.39% 14.39% 14.39% 14.39% 14.39%"}, "model_tokens": {"rwkv": [[31967, " seem", "normal", 0.007224781904369593]], "qwen": [[2803, " seem", "normal", 0.01850428618490696]]}, "loss": {"rwkv": 17.808266910973142, "qwen": 14.389991337219216}, "topk": {"rwkv": [31967, 17, 0.007224781904369593, [[31059, 0.245231, " have", false], [21286, 0.092421, " are", false], [56041, 0.089449, " dominate", false], [22777, 0.043514, " won", false], [56540, 0.035016, " leverage", false], [22770, 0.023828, " win", false], [39590, 0.019967, " scale", false], [4491, 0.01991, " do", false], [31461, 0.016144, " most", false], [52597, 0.013332, " provide", false]]], "qwen": [2803, 5, 0.01850428618490696, [[614, 0.365672, " have", false], [525, 0.109491, " are", false], [40736, 0.044416, " dominate", false], [582, 0.019356, " we", false], [2803, 0.018504, " seem", false], [653, 0.01835, " do", false], [358, 0.015936, " I", false], [1033, 0.015454, " were", false], [975, 0.013802, " work", false], [29701, 0.01267, " dominated", false]]]}, "raw_delta": 0.18954944610595703, "tuned_delta": 0.19688658461965977}, {"byte_start": 5924, "byte_end": 5927, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 993, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "2.90% 2.90% 2.90%", "qwen": "2.36% 2.36% 2.36%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.6188631057739258]], "qwen": [[311, " to", "normal", 0.6752561926841736]]}, "loss": {"rwkv": 2.8999485278285637, "qwen": 2.360387894722458}, "topk": {"rwkv": [4811, 1, 0.6188631057739258, [[4811, 0.618863, " to", false], [31461, 0.199723, " most", false], [30273, 0.020028, " best", false], [46439, 0.018644, " likely", false], [22590, 0.012985, " the", false], [31296, 0.009549, " like", false], [55971, 0.008532, " destined", false], [45, 0.007176, ",", false], [61953, 0.006018, " especially", false], [64507, 0.004086, " particularly", false]]], "qwen": [311, 1, 0.6752561926841736, [[311, 0.675256, " to", false], [1429, 0.155037, " most", false], [1850, 0.035498, " best", false], [4363, 0.016922, " likely", false], [279, 0.012212, " the", false], [7945, 0.004961, " particularly", false], [5310, 0.003635, " especially", false], [3245, 0.0036, " least", false], [2677, 0.0034, " always", false], [1075, 0.002733, " like", false]]]}, "raw_delta": 0.029919594526290894, "tuned_delta": 0.037256733039993634}, {"byte_start": 5927, "byte_end": 5933, "display": {"text": " scale", "kind": "normal"}, "is_word": true, "word_id": 994, "word_key": " scale", "bytes_hex": "20 73 63 61 6c 65", "compression": {"rwkv": "13.90% 13.90% 13.90% 13.90% 13.90% 13.90%", "qwen": "11.71% 11.71% 11.71% 11.71% 11.71% 11.71%"}, "model_tokens": {"rwkv": [[39590, " scale", "normal", 0.009887528605759144]], "qwen": [[5452, " scale", "normal", 0.02033877931535244]]}, "loss": {"rwkv": 13.900967841898865, "qwen": 11.707547691429212}, "topk": {"rwkv": [39590, 12, 0.009887528605759144, [[4435, 0.224231, " be", false], [31059, 0.188983, " have", false], [56041, 0.087575, " dominate", false], [4491, 0.032721, " do", false], [22770, 0.029415, " win", false], [32499, 0.025858, " work", false], [52597, 0.02024, " provide", false], [39169, 0.016415, " offer", false], [4660, 0.015284, " me", false], [31461, 0.014894, " most", false]]], "qwen": [5452, 6, 0.02033877931535244, [[614, 0.291799, " have", false], [387, 0.190763, " be", false], [975, 0.063204, " work", false], [40736, 0.052469, " dominate", false], [653, 0.026229, " do", false], [5452, 0.020339, " scale", false], [3010, 0.016682, " offer", false], [6359, 0.01375, " deliver", false], [1850, 0.013632, " best", false], [3410, 0.01356, " provide", false]]]}, "raw_delta": 0.12162903944651293, "tuned_delta": 0.12896617796021567}, {"byte_start": 5933, "byte_end": 5945, "display": {"text": " arbitrarily", "kind": "normal"}, "is_word": true, "word_id": 995, "word_key": " arbitrarily", "bytes_hex": "20 61 72 62 69 74 72 61 72 69 6c 79", "compression": {"rwkv": "16.34% 16.34% 16.34% 16.34% 16.34% 16.34% 16.34% 16.34% 16.34% 16.34% 16.34% 16.34%", "qwen": "15.63% 15.63% 15.63% 15.63% 15.63% 15.63% 15.63% 15.63% 15.63% 15.63% 15.63% 15.63%"}, "model_tokens": {"rwkv": [[63293, " arbitrarily", "normal", 1.8695352991926484e-05]], "qwen": [[85657, " arbitrarily", "normal", 3.0418892492889427e-05]]}, "loss": {"rwkv": 16.343029760070287, "qwen": 15.62986786854872}, "topk": {"rwkv": [63293, 485, 1.8695352991926484e-05, [[30273, 0.24762, " best", false], [31461, 0.1851, " most", false], [32487, 0.121535, " with", false], [22590, 0.087206, " the", false], [4596, 0.069772, " in", false], [21286, 0.030094, " are", false], [32234, 0.019556, " this", false], [4811, 0.017016, " to", false], [45, 0.012342, ",", false], [4788, 0.011947, " so", false]]], "qwen": [85657, 371, 3.0418892492889427e-05, [[279, 0.217243, " the", false], [1850, 0.180104, " best", false], [1429, 0.147235, " most", false], [1632, 0.076015, " well", false], [773, 0.056074, " so", false], [448, 0.047299, " with", false], [304, 0.03944, " in", false], [525, 0.015779, " are", false], [1602, 0.011276, " very", false], [311, 0.010897, " to", false]]]}, "raw_delta": 0.039546092351277706, "tuned_delta": 0.046883230864980446}, {"byte_start": 5945, "byte_end": 5948, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 996, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "25.36% 25.36% 25.36%", "qwen": "19.13% 19.13% 19.13%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.014601743780076504]], "qwen": [[304, " in", "normal", 0.04151996970176697]]}, "loss": {"rwkv": 25.359873765626308, "qwen": 19.125211734531785}, "topk": {"rwkv": [4596, 7, 0.014601743780076504, [[32458, 0.53993, " well", false], [21286, 0.168564, " are", false], [45, 0.073744, ",", false], [32487, 0.065054, " with", false], [5346, 0.020241, "---", false], [30826, 0.016679, " fast", false], [4596, 0.014602, " in", false], [275, 0.010519, " (", false], [21265, 0.00855, " and", false], [31466, 0.006843, " much", false]]], "qwen": [304, 5, 0.04151996970176697, [[1632, 0.421549, " well", false], [448, 0.154494, " with", false], [525, 0.142794, " are", false], [11, 0.07809, ",", false], [304, 0.04152, " in", false], [323, 0.027385, " and", false], [320, 0.014245, " (", false], [4421, 0.01004, "---", false], [438, 0.008332, " as", false], [311, 0.007703, " to", false]]]}, "raw_delta": 0.3457230726877849, "tuned_delta": 0.3530602112014876}, {"byte_start": 5948, "byte_end": 5953, "display": {"text": " this", "kind": "normal"}, "is_word": true, "word_id": 997, "word_key": " this", "bytes_hex": "20 74 68 69 73", "compression": {"rwkv": "1.87% 1.87% 1.87% 1.87% 1.87%", "qwen": "3.12% 3.12% 3.12% 3.12% 3.12%"}, "model_tokens": {"rwkv": [[32234, " this", "normal", 0.5927859544754028]], "qwen": [[419, " this", "normal", 0.42092493176460266]]}, "loss": {"rwkv": 1.8738128949046107, "qwen": 3.1209128408892304}, "topk": {"rwkv": [32234, 1, 0.5927859544754028, [[32234, 0.592786, " this", false], [22590, 0.086025, " the", false], [32227, 0.037827, " that", false], [39339, 0.035355, " power", false], [332, 0.029056, " a", false], [21256, 0.017115, " all", false], [3609, 0.016043, " AI", false], [63370, 0.014001, " computation", false], [39931, 0.011707, " their", false], [39920, 0.011661, " terms", false]]], "qwen": [419, 1, 0.42092493176460266, [[419, 0.420925, " this", false], [279, 0.199113, " the", false], [264, 0.028031, " a", false], [3793, 0.022434, " terms", false], [429, 0.019819, " that", false], [15235, 0.015791, " AI", false], [6588, 0.015505, " practice", false], [862, 0.015268, " their", false], [678, 0.014585, " all", false], [34447, 0.011417, " computation", false]]]}, "raw_delta": -0.06915390491485596, "tuned_delta": -0.06181676640115322}, {"byte_start": 5953, "byte_end": 5957, "display": {"text": " way", "kind": "normal"}, "is_word": true, "word_id": 998, "word_key": " way", "bytes_hex": "20 77 61 79", "compression": {"rwkv": "0.99% 0.99% 0.99% 0.99%", "qwen": "1.40% 1.40% 1.40% 1.40%"}, "model_tokens": {"rwkv": [[22752, " way", "normal", 0.802659273147583]], "qwen": [[1616, " way", "normal", 0.7331099510192871]]}, "loss": {"rwkv": 0.9906200689697776, "qwen": 1.3996826851072117}, "topk": {"rwkv": [22752, 1, 0.802659273147583, [[22752, 0.802659, " way", false], [51717, 0.053244, " fashion", false], [46505, 0.04428, " manner", false], [39631, 0.027316, " sense", false], [47043, 0.023033, " regard", false], [52731, 0.017141, " respect", false], [59526, 0.008744, " direction", false], [51310, 0.002876, " context", false], [32375, 0.002083, " vein", false], [30405, 0.001965, " case", false]]], "qwen": [1616, 1, 0.7331099510192871, [[1616, 0.73311, " way", false], [5530, 0.073809, " sense", false], [11566, 0.067566, " manner", false], [5091, 0.025314, " respect", false], [5250, 0.023959, " regard", false], [11153, 0.023104, " fashion", false], [4586, 0.003667, " general", false], [5106, 0.003347, " direction", false], [2266, 0.003034, " context", false], [8913, 0.002671, " spirit", false]]]}, "raw_delta": -0.022683247923851013, "tuned_delta": -0.015346109410148277}, {"byte_start": 5957, "byte_end": 5961, "display": {"text": " are", "kind": "normal"}, "is_word": true, "word_id": 999, "word_key": " are", "bytes_hex": "20 61 72 65", "compression": {"rwkv": "0.91% 0.91% 0.91% 0.91%", "qwen": "1.42% 1.42% 1.42% 1.42%"}, "model_tokens": {"rwkv": [[21286, " are", "normal", 0.8155147433280945]], "qwen": [[525, " are", "normal", 0.7301681637763977]]}, "loss": {"rwkv": 0.9113704634521954, "qwen": 1.4178103283153818}, "topk": {"rwkv": [21286, 1, 0.8155147433280945, [[21286, 0.815515, " are", false], [45, 0.088175, ",", false], [5346, 0.027272, "---", false], [4596, 0.012466, " in", false], [275, 0.011901, " (", false], [21265, 0.00843, " and", false], [31059, 0.003964, " have", false], [21700, 0.00193, " for", false], [32227, 0.001569, " that", false], [32462, 0.001541, " were", false]]], "qwen": [525, 1, 0.7301681637763977, [[525, 0.730168, " are", false], [11, 0.117868, ",", false], [4421, 0.057707, "---", false], [320, 0.011839, " (", false], [323, 0.009408, " and", false], [614, 0.008631, " have", false], [304, 0.008361, " in", false], [313, 0.004455, "--", false], [1033, 0.003958, " were", false], [448, 0.002738, " with", false]]]}, "raw_delta": -0.028082989156246185, "tuned_delta": -0.02074585064254345}, {"byte_start": 5961, "byte_end": 5968, "display": {"text": " search", "kind": "normal"}, "is_word": true, "word_id": 1000, "word_key": " search", "bytes_hex": "20 73 65 61 72 63 68", "compression": {"rwkv": "1.98% 1.98% 1.98% 1.98% 1.98% 1.98% 1.98%", "qwen": "1.19% 1.19% 1.19% 1.19% 1.19% 1.19% 1.19%"}, "model_tokens": {"rwkv": [[47202, " search", "normal", 0.46652165055274963]], "qwen": [[2711, " search", "normal", 0.6300439238548279]]}, "loss": {"rwkv": 1.9824980681858662, "qwen": 1.190135069230555}, "topk": {"rwkv": [47202, 1, 0.46652165055274963, [[47202, 0.466522, " search", false], [56537, 0.209744, " learning", false], [30597, 0.063982, " deep", false], [22590, 0.024934, " the", false], [51832, 0.019645, " general", false], [52224, 0.013753, " methods", false], [59, 0.011958, ":", false], [275, 0.011808, " (", false], [284, 0.011792, " 1", false], [45, 0.009657, ",", false]]], "qwen": [2711, 1, 0.6300439238548279, [[2711, 0.630044, " search", false], [5538, 0.037948, " deep", false], [220, 0.03342, " ", false], [71278, 0.0333, " reinforcement", false], [6832, 0.030104, " learning", false], [279, 0.020244, " the", false], [320, 0.019229, " (", false], [29728, 0.015948, " neural", false], [5413, 0.006827, " methods", false], [4586, 0.006082, " general", false]]]}, "raw_delta": 0.04393793429647174, "tuned_delta": 0.051275072810174474}, {"byte_start": 5968, "byte_end": 5972, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 1001, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"rwkv": "0.81% 0.81% 0.81% 0.81%", "qwen": "0.94% 0.94% 0.94% 0.94%"}, "model_tokens": {"rwkv": [[21265, " and", "normal", 0.8348367214202881]], "qwen": [[323, " and", "normal", 0.8115851879119873]]}, "loss": {"rwkv": 0.8101070786241737, "qwen": 0.9412047507262832}, "topk": {"rwkv": [21265, 1, 0.8348367214202881, [[21265, 0.834837, " and", false], [45, 0.042921, ",", false], [275, 0.038238, " (", false], [4450, 0.016255, " by", false], [52224, 0.008695, " methods", false], [21700, 0.008643, " for", false], [4596, 0.007697, " in", false], [46, 0.007645, "-", false], [48, 0.007489, "/", false], [5346, 0.005259, "---", false]]], "qwen": [323, 1, 0.8115851879119873, [[323, 0.811585, " and", false], [11, 0.049152, ",", false], [5980, 0.035495, "-based", false], [320, 0.035066, " (", false], [5413, 0.017255, " methods", false], [3118, 0.00808, " based", false], [448, 0.006759, " with", false], [304, 0.004219, " in", false], [553, 0.004205, " by", false], [4421, 0.003902, "---", false]]]}, "raw_delta": -0.007269598543643951, "tuned_delta": 6.753997005878518e-05}, {"byte_start": 5972, "byte_end": 5981, "display": {"text": " learning", "kind": "normal"}, "is_word": true, "word_id": 1002, "word_key": " learning", "bytes_hex": "20 6c 65 61 72 6e 69 6e 67", "compression": {"rwkv": "0.10% 0.10% 0.10% 0.10% 0.10% 0.10% 0.10% 0.10% 0.10%", "qwen": "0.45% 0.45% 0.45% 0.45% 0.45% 0.45% 0.45% 0.45% 0.45%"}, "model_tokens": {"rwkv": [[56537, " learning", "normal", 0.952091634273529]], "qwen": [[6832, " learning", "normal", 0.7982138395309448]]}, "loss": {"rwkv": 0.09881740934908398, "qwen": 0.4516011214976917}, "topk": {"rwkv": [56537, 1, 0.952091634273529, [[56537, 0.952092, " learning", false], [30597, 0.008949, " deep", false], [31978, 0.007388, " self", false], [63885, 0.00371, " statistical", false], [63370, 0.002517, " computation", false], [22590, 0.00219, " the", false], [62577, 0.002126, " statistics", false], [52167, 0.001799, " machine", false], [45, 0.00138, ",", false], [51832, 0.000951, " general", false]]], "qwen": [6832, 1, 0.7982138395309448, [[6832, 0.798214, " learning", false], [5538, 0.078967, " deep", false], [5662, 0.018328, " machine", false], [71278, 0.009165, " reinforcement", false], [29728, 0.007465, " neural", false], [4586, 0.007452, " general", false], [279, 0.006766, " the", false], [656, 0.006574, " self", false], [28464, 0.004518, " statistical", false], [11, 0.004284, ",", false]]]}, "raw_delta": -0.019562482833862305, "tuned_delta": -0.012225344320159568}, {"byte_start": 5981, "byte_end": 5983, "display": {"text": ".\n", "kind": "control"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e 0a", "compression": {"rwkv": "6.97% 29.73%", "qwen": "20.61% 20.61%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.6799267530441284], [261, "\n\n", "control", 0.03706193342804909]], "qwen": [[382, ".\n\n", "control", 0.03244423121213913]]}, "loss": {"rwkv": 18.35068643318237, "qwen": 20.607891365885145}, "topk": {"rwkv": [47, 1, 0.6799267530441284, [[47, 0.679927, ".", false], [45, 0.129119, ",", false], [4450, 0.089637, " by", false], [5346, 0.043321, "---", false], [275, 0.021155, " (", false], [60, 0.007595, ";", false], [37810, 0.004295, " based", false], [4596, 0.002568, " in", false], [22705, 0.002472, " via", false], [59, 0.002444, ":", false]]], "qwen": [382, 4, 0.03244423121213913, [[13, 0.64142, ".", false], [11, 0.169912, ",", false], [553, 0.05934, " by", false], [382, 0.032444, ".\n\n", false], [320, 0.022388, " (", false], [4421, 0.014733, "---", false], [26, 0.010116, ";", false], [25, 0.006254, ":", false], [624, 0.004282, ".\n", false], [389, 0.003554, " on", false]]]}, "raw_delta": -0.12516601880391431, "tuned_delta": -0.11782888029021157}, {"byte_start": 5983, "byte_end": 5984, "display": {"text": "\n", "kind": "control"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "0a", "compression": {"rwkv": "29.73%", "qwen": "20.61%"}, "model_tokens": {"rwkv": [[261, "\n\n", "control", 0.03706193342804909]], "qwen": [[382, ".\n\n", "control", 0.03244423121213913]]}, "loss": {"rwkv": 29.727407580817506, "qwen": 20.607891365885145}, "topk": {"rwkv": [261, 5, 0.03706193342804909, [[20996, 0.12684, " The", false], [44844, 0.076067, " Search", false], [37453, 0.073632, " These", false], [29893, 0.053759, " They", false], [261, 0.037062, "\n\n", false], [3913, 0.037005, " In", false], [28530, 0.032893, " Both", false], [29894, 0.031102, " This", false], [3918, 0.02905, " It", false], [37451, 0.027955, " There", false]]], "qwen": [382, 4, 0.03244423121213913, [[13, 0.64142, ".", false], [11, 0.169912, ",", false], [553, 0.05934, " by", false], [382, 0.032444, ".\n\n", false], [320, 0.022388, " (", false], [4421, 0.014733, "---", false], [26, 0.010116, ";", false], [25, 0.006254, ":", false], [624, 0.004282, ".\n", false], [389, 0.003554, " on", false]]]}, "raw_delta": 0.5056933561960857, "tuned_delta": 0.5130304947097885}, {"byte_start": 5984, "byte_end": 5987, "display": {"text": "The", "kind": "normal"}, "is_word": true, "word_id": 1003, "word_key": "the", "bytes_hex": "54 68 65", "compression": {"rwkv": "10.57% 10.57% 10.57%", "qwen": "11.43% 11.43% 11.43%"}, "model_tokens": {"rwkv": [[6699, "The", "normal", 0.17412428557872772]], "qwen": [[785, "The", "normal", 0.14927057921886444]]}, "loss": {"rwkv": 10.566614069010962, "qwen": 11.433325654194736}, "topk": {"rwkv": [6699, 1, 0.17412428557872772, [[6699, 0.174124, "The", false], [48358, 0.078606, "Another", false], [1136, 0.063174, "In", false], [66, 0.06082, "A", false], [33504, 0.043227, "There", false], [40754, 0.040798, "Search", false], [24242, 0.031296, "This", false], [1141, 0.029763, "It", false], [1589, 0.025991, "We", false], [5658, 0.020829, "But", false]]], "qwen": [785, 1, 0.14927057921886444, [[785, 0.149271, "The", false], [5890, 0.131513, "Search", false], [641, 0.051216, "In", false], [14037, 0.033545, "Another", false], [32, 0.029603, "A", false], [3862, 0.029517, "There", false], [2132, 0.018916, "It", false], [1986, 0.01801, "This", false], [3966, 0.017081, "One", false], [1654, 0.015245, "We", false]]]}, "raw_delta": -0.048060695330301884, "tuned_delta": -0.040723556816599144}, {"byte_start": 5987, "byte_end": 5994, "display": {"text": " second", "kind": "normal"}, "is_word": true, "word_id": 1004, "word_key": " second", "bytes_hex": "20 73 65 63 6f 6e 64", "compression": {"rwkv": "6.56% 6.56% 6.56% 6.56% 6.56% 6.56% 6.56%", "qwen": "7.41% 7.41% 7.41% 7.41% 7.41% 7.41% 7.41%"}, "model_tokens": {"rwkv": [[47205, " second", "normal", 0.07765278965234756]], "qwen": [[2086, " second", "normal", 0.05633553862571716]]}, "loss": {"rwkv": 6.561364164757282, "qwen": 7.410376790125389}, "topk": {"rwkv": [47205, 2, 0.07765278965234756, [[39193, 0.10866, " other", false], [47205, 0.077653, " second", false], [45315, 0.066224, " bitter", false], [47202, 0.027522, " search", false], [38499, 0.025176, " first", false], [46430, 0.024738, " lesson", false], [31515, 0.02133, " next", false], [19523, 0.018791, " Bit", false], [31461, 0.016931, " most", false], [45184, 0.016371, " appeal", false]]], "qwen": [2086, 3, 0.05633553862571716, [[25180, 0.123237, " bitter", false], [1008, 0.085452, " other", false], [2086, 0.056336, " second", false], [17755, 0.025586, " lesson", false], [1156, 0.024374, " first", false], [425, 0.024121, " B", false], [1378, 0.023931, " two", false], [2711, 0.02016, " search", false], [1790, 0.019953, " next", false], [1429, 0.018854, " most", false]]]}, "raw_delta": -0.04707925660269602, "tuned_delta": -0.03974211808899328}, {"byte_start": 5994, "byte_end": 6002, "display": {"text": " general", "kind": "normal"}, "is_word": true, "word_id": 1005, "word_key": " general", "bytes_hex": "20 67 65 6e 65 72 61 6c", "compression": {"rwkv": "12.47% 12.47% 12.47% 12.47% 12.47% 12.47% 12.47% 12.47%", "qwen": "13.77% 13.77% 13.77% 13.77% 13.77% 13.77% 13.77% 13.77%"}, "model_tokens": {"rwkv": [[51832, " general", "normal", 0.0040090857073664665]], "qwen": [[4586, " general", "normal", 0.0022193738259375095]]}, "loss": {"rwkv": 12.468604601432935, "qwen": 13.774423723988388}, "topk": {"rwkv": [51832, 20, 0.0040090857073664665, [[46430, 0.424224, " lesson", false], [39941, 0.308201, " thing", false], [21357, 0.034534, " big", false], [59829, 0.028154, " important", false], [45, 0.024413, ",", false], [38629, 0.020566, " great", false], [45315, 0.015041, " bitter", false], [4600, 0.011395, " is", false], [38961, 0.011146, " major", false], [21365, 0.008417, " bit", false]]], "qwen": [4586, 32, 0.0022193738259375095, [[17755, 0.239377, " lesson", false], [3166, 0.11453, " thing", false], [25180, 0.067352, " bitter", false], [2409, 0.06589, " big", false], [1429, 0.053341, " most", false], [2989, 0.039198, " important", false], [2244, 0.033994, " great", false], [949, 0.02987, " part", false], [374, 0.025651, " is", false], [1459, 0.022695, " point", false]]]}, "raw_delta": -0.072409987449646, "tuned_delta": -0.06507284893594326}, {"byte_start": 6002, "byte_end": 6008, "display": {"text": " point", "kind": "normal"}, "is_word": true, "word_id": 1006, "word_key": " point", "bytes_hex": "20 70 6f 69 6e 74", "compression": {"rwkv": "12.68% 12.68% 12.68% 12.68% 12.68% 12.68%", "qwen": "13.17% 13.17% 13.17% 13.17% 13.17% 13.17%"}, "model_tokens": {"rwkv": [[39310, " point", "normal", 0.014528748579323292]], "qwen": [[1459, " point", "normal", 0.012501237913966179]]}, "loss": {"rwkv": 12.679936882813154, "qwen": 13.170385541033655}, "topk": {"rwkv": [39310, 5, 0.014528748579323292, [[46430, 0.812103, " lesson", false], [46561, 0.039196, " method", false], [60250, 0.018576, " principle", false], [63729, 0.016949, " observation", false], [39310, 0.014529, " point", false], [52022, 0.009583, " insight", false], [38046, 0.00708, " class", false], [46, 0.00582, "-", false], [61735, 0.005255, " conclusion", false], [52610, 0.00508, " purpose", false]]], "qwen": [1459, 8, 0.012501237913966179, [[17755, 0.291199, " lesson", false], [1714, 0.180131, " method", false], [58238, 0.152266, "-purpose", false], [2022, 0.074681, "ization", false], [7428, 0.073605, " purpose", false], [17508, 0.0455, " principle", false], [5486, 0.015525, " approach", false], [1459, 0.012501, " point", false], [5912, 0.009425, " rule", false], [8335, 0.008556, "izable", false]]]}, "raw_delta": -0.02719624837239587, "tuned_delta": -0.019859109858693134}, {"byte_start": 6008, "byte_end": 6011, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 1007, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "12.87% 12.87% 12.87%", "qwen": "10.77% 10.77% 10.77%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.1159430667757988]], "qwen": [[311, " to", "normal", 0.16670064628124237]]}, "loss": {"rwkv": 12.86778779959557, "qwen": 10.769451840627315}, "topk": {"rwkv": [4811, 3, 0.1159430667757988, [[4600, 0.542428, " is", false], [32227, 0.152021, " that", false], [4811, 0.115943, " to", false], [45, 0.034817, ",", false], [4706, 0.029491, " of", false], [4858, 0.019619, " we", false], [30917, 0.018906, " from", false], [47266, 0.010903, " should", false], [37598, 0.010146, " about", false], [21800, 0.005024, " has", false]]], "qwen": [311, 3, 0.16670064628124237, [[374, 0.369789, " is", false], [429, 0.215947, " that", false], [311, 0.166701, " to", false], [911, 0.052649, " about", false], [315, 0.040486, " of", false], [504, 0.027561, " from", false], [11, 0.024677, ",", false], [582, 0.01348, " we", false], [304, 0.010125, " in", false], [358, 0.009444, " I", false]]]}, "raw_delta": 0.11635645230611158, "tuned_delta": 0.12369359081981432}, {"byte_start": 6011, "byte_end": 6014, "display": {"text": " be", "kind": "normal"}, "is_word": true, "word_id": 1008, "word_key": " be", "bytes_hex": "20 62 65", "compression": {"rwkv": "5.12% 5.12% 5.12%", "qwen": "4.18% 4.18% 4.18%"}, "model_tokens": {"rwkv": [[4435, " be", "normal", 0.4284442663192749]], "qwen": [[387, " be", "normal", 0.4988078474998474]]}, "loss": {"rwkv": 5.118937482320866, "qwen": 4.1810164805473455}, "topk": {"rwkv": [4435, 1, 0.4284442663192749, [[4435, 0.428444, " be", false], [38877, 0.246714, " learn", false], [32187, 0.118476, " take", false], [31539, 0.031807, " note", false], [31358, 0.029563, " make", false], [62683, 0.02096, " understand", false], [30681, 0.014464, " draw", false], [38625, 0.00856, " grasp", false], [45846, 0.008558, " emerge", false], [30482, 0.008042, " come", false]]], "qwen": [387, 1, 0.4988078474998474, [[387, 0.498808, " be", false], [3960, 0.15009, " learn", false], [1281, 0.088365, " make", false], [1896, 0.042628, " take", false], [5185, 0.040671, " note", false], [3535, 0.036939, " understand", false], [32944, 0.021993, " emerge", false], [4038, 0.017, " draw", false], [2908, 0.011306, " consider", false], [2525, 0.009433, " come", false]]]}, "raw_delta": 0.05200938383738202, "tuned_delta": 0.05934652235108476}, {"byte_start": 6014, "byte_end": 6022, "display": {"text": " learned", "kind": "normal"}, "is_word": true, "word_id": 1009, "word_key": " learned", "bytes_hex": "20 6c 65 61 72 6e 65 64", "compression": {"rwkv": "0.43% 0.43% 0.43% 0.43% 0.43% 0.43% 0.43% 0.43%", "qwen": "0.95% 0.95% 0.95% 0.95% 0.95% 0.95% 0.95% 0.95%"}, "model_tokens": {"rwkv": [[52112, " learned", "normal", 0.824234664440155]], "qwen": [[9498, " learned", "normal", 0.6572651267051697]]}, "loss": {"rwkv": 0.4336714524156582, "qwen": 0.9460197275046579}, "topk": {"rwkv": [52112, 1, 0.824234664440155, [[52112, 0.824235, " learned", false], [31351, 0.074261, " made", false], [38297, 0.033836, " drawn", false], [51438, 0.011373, " derived", false], [39887, 0.009441, " taken", false], [62684, 0.006686, " understood", false], [59697, 0.006147, " extracted", false], [39140, 0.003698, " noted", false], [46071, 0.00298, " gained", false], [31968, 0.002094, " seen", false]]], "qwen": [9498, 1, 0.6572651267051697, [[9498, 0.657265, " learned", false], [1865, 0.20109, " made", false], [14764, 0.041951, " drawn", false], [15985, 0.020831, " understood", false], [4429, 0.011879, " taken", false], [94016, 0.009719, " glean", false], [14257, 0.008286, " derived", false], [49250, 0.004656, " learnt", false], [10342, 0.004631, " noted", false], [27432, 0.004047, " extracted", false]]]}, "raw_delta": -0.028410620987415314, "tuned_delta": -0.021073482473712577}, {"byte_start": 6022, "byte_end": 6027, "display": {"text": " from", "kind": "normal"}, "is_word": true, "word_id": 1010, "word_key": " from", "bytes_hex": "20 66 72 6f 6d", "compression": {"rwkv": "3.34% 3.34% 3.34% 3.34% 3.34%", "qwen": "2.35% 2.35% 2.35% 2.35% 2.35%"}, "model_tokens": {"rwkv": [[30917, " from", "normal", 0.3960491716861725]], "qwen": [[504, " from", "normal", 0.5210452675819397]]}, "loss": {"rwkv": 3.339050045807464, "qwen": 2.3512986474540782}, "topk": {"rwkv": [30917, 2, 0.3960491716861725, [[4600, 0.541153, " is", false], [30917, 0.396049, " from", false], [45, 0.020766, ",", false], [4450, 0.006813, " by", false], [37598, 0.004397, " about", false], [31077, 0.004173, " here", false], [4596, 0.003639, " in", false], [21800, 0.002632, " has", false], [47266, 0.002051, " should", false], [52694, 0.001588, " relates", false]]], "qwen": [504, 1, 0.5210452675819397, [[504, 0.521045, " from", false], [374, 0.421965, " is", false], [11, 0.026251, ",", false], [911, 0.004493, " about", false], [1588, 0.004179, " here", false], [304, 0.004135, " in", false], [320, 0.002605, " (", false], [553, 0.001493, " by", false], [429, 0.000956, " that", false], [702, 0.000948, " has", false]]]}, "raw_delta": 0.054772567749023414, "tuned_delta": 0.06210970626272615}, {"byte_start": 6027, "byte_end": 6031, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 1011, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "1.01% 1.01% 1.01% 1.01%", "qwen": "1.49% 1.49% 1.49% 1.49%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.7996769547462463]], "qwen": [[279, " the", "normal", 0.7185409665107727]]}, "loss": {"rwkv": 1.0082310924181292, "qwen": 1.4901802247141136}, "topk": {"rwkv": [22590, 1, 0.7996769547462463, [[22590, 0.799677, " the", false], [32234, 0.126687, " this", false], [45315, 0.016075, " bitter", false], [39936, 0.012431, " these", false], [3609, 0.005838, " AI", false], [51929, 0.00381, " history", false], [3543, 0.003186, " 70", false], [21256, 0.002449, " all", false], [62061, 0.00193, " historical", false], [31636, 0.001773, " past", false]]], "qwen": [279, 1, 0.7185409665107727, [[279, 0.718541, " the", false], [419, 0.167578, " this", false], [1493, 0.048285, " these", false], [678, 0.017376, " all", false], [25180, 0.007513, " bitter", false], [20219, 0.003286, " Moore", false], [220, 0.00309, " ", false], [264, 0.002845, " a", false], [15235, 0.002356, " AI", false], [1039, 0.002221, " our", false]]]}, "raw_delta": -0.026724934577941895, "tuned_delta": -0.019387796064239158}, {"byte_start": 6031, "byte_end": 6038, "display": {"text": " bitter", "kind": "normal"}, "is_word": true, "word_id": 1012, "word_key": " bitter", "bytes_hex": "20 62 69 74 74 65 72", "compression": {"rwkv": "0.09% 0.09% 0.09% 0.09% 0.09% 0.09% 0.09%", "qwen": "0.06% 0.06% 0.06% 0.06% 0.06% 0.06% 0.06%"}, "model_tokens": {"rwkv": [[45315, " bitter", "normal", 0.9648310542106628]], "qwen": [[25180, " bitter", "normal", 0.9765259623527527]]}, "loss": {"rwkv": 0.0918289079806905, "qwen": 0.061195885097820216}, "topk": {"rwkv": [45315, 1, 0.9648310542106628, [[45315, 0.964831, " bitter", false], [61640, 0.009503, " bitterness", false], [51929, 0.002831, " history", false], [21365, 0.001909, " bit", false], [62061, 0.001521, " historical", false], [19523, 0.00117, " Bit", false], [31636, 0.001156, " past", false], [52127, 0.001067, " lessons", false], [46430, 0.000922, " lesson", false], [52427, 0.000573, " pattern", false]]], "qwen": [25180, 1, 0.9765259623527527, [[25180, 0.976526, " bitter", false], [78996, 0.005516, " bitterness", false], [17755, 0.001699, " lesson", false], [3840, 0.001541, " history", false], [425, 0.001217, " B", false], [3403, 0.00092, " above", false], [18366, 0.000657, " lessons", false], [13656, 0.000452, " historical", false], [3412, 0.000375, " research", false], [3139, 0.000287, " experience", false]]]}, "raw_delta": 0.0016986554754631863, "tuned_delta": 0.009035793989165923}, {"byte_start": 6038, "byte_end": 6045, "display": {"text": " lesson", "kind": "normal"}, "is_word": true, "word_id": 1013, "word_key": " lesson", "bytes_hex": "20 6c 65 73 73 6f 6e", "compression": {"rwkv": "0.14% 0.14% 0.14% 0.14% 0.14% 0.14% 0.14%", "qwen": "0.08% 0.08% 0.08% 0.08% 0.08% 0.08% 0.08%"}, "model_tokens": {"rwkv": [[46430, " lesson", "normal", 0.9476190209388733]], "qwen": [[17755, " lesson", "normal", 0.970899760723114]]}, "loss": {"rwkv": 0.13774336197103573, "qwen": 0.07608165533722623}, "topk": {"rwkv": [46430, 1, 0.9476190209388733, [[46430, 0.947619, " lesson", false], [52127, 0.046093, " lessons", false], [61979, 0.002733, " experience", false], [46, 0.000518, "-", false], [26127, 0.000192, "less", false], [39899, 0.000164, " taste", false], [31636, 0.00013, " past", false], [51929, 0.000115, " history", false], [39831, 0.000109, " story", false], [4600, 0.000105, " is", false]]], "qwen": [17755, 1, 0.970899760723114, [[17755, 0.9709, " lesson", false], [18366, 0.014189, " lessons", false], [3139, 0.006979, " experience", false], [3840, 0.001089, " history", false], [11, 0.000636, ",", false], [15235, 0.000578, " AI", false], [323, 0.000363, " and", false], [320, 0.000222, " (", false], [12, 0.000184, "-", false], [512, 0.000149, " le", false]]]}, "raw_delta": 0.003419251048139164, "tuned_delta": 0.010756389561841901}, {"byte_start": 6045, "byte_end": 6048, "display": {"text": " is", "kind": "normal"}, "is_word": true, "word_id": 1014, "word_key": " is", "bytes_hex": "20 69 73", "compression": {"rwkv": "0.31% 0.31% 0.31%", "qwen": "0.40% 0.40% 0.40%"}, "model_tokens": {"rwkv": [[4600, " is", "normal", 0.9492695927619934]], "qwen": [[374, " is", "normal", 0.9348880052566528]]}, "loss": {"rwkv": 0.3125956662082409, "qwen": 0.4047272649340828}, "topk": {"rwkv": [4600, 1, 0.9492695927619934, [[4600, 0.94927, " is", false], [45, 0.017873, ",", false], [21800, 0.004211, " has", false], [4706, 0.004073, " of", false], [55817, 0.003416, " concerns", false], [4596, 0.002434, " in", false], [47266, 0.002244, " should", false], [37598, 0.001397, " about", false], [32227, 0.001281, " that", false], [275, 0.001245, " (", false]]], "qwen": [374, 1, 0.9348880052566528, [[374, 0.934888, " is", false], [11, 0.019629, ",", false], [315, 0.014443, " of", false], [10520, 0.003587, " concerns", false], [320, 0.002818, " (", false], [429, 0.002524, " that", false], [304, 0.00217, " in", false], [702, 0.002084, " has", false], [911, 0.002025, " about", false], [4421, 0.001162, "---", false]]]}, "raw_delta": -0.005108860631783802, "tuned_delta": 0.0022282778819189344}, {"byte_start": 6048, "byte_end": 6053, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 1015, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"rwkv": "1.08% 1.08% 1.08% 1.08% 1.08%", "qwen": "1.29% 1.29% 1.29% 1.29% 1.29%"}, "model_tokens": {"rwkv": [[32227, " that", "normal", 0.7404853701591492]], "qwen": [[429, " that", "normal", 0.6995595693588257]]}, "loss": {"rwkv": 1.077794635039118, "qwen": 1.2887028716958038}, "topk": {"rwkv": [32227, 1, 0.7404853701591492, [[32227, 0.740485, " that", false], [22590, 0.151242, " the", false], [21835, 0.018109, " how", false], [4811, 0.016803, " to", false], [32234, 0.011967, " this", false], [332, 0.010373, " a", false], [37598, 0.005974, " about", false], [45, 0.005306, ",", false], [32464, 0.004766, " what", false], [4419, 0.002472, " an", false]]], "qwen": [429, 1, 0.6995595693588257, [[429, 0.69956, " that", false], [279, 0.185011, " the", false], [911, 0.015583, " about", false], [311, 0.014676, " to", false], [419, 0.011509, " this", false], [264, 0.008822, " a", false], [1246, 0.00828, " how", false], [537, 0.005344, " not", false], [1128, 0.005076, " what", false], [825, 0.00361, " one", false]]]}, "raw_delta": -0.011695235967636108, "tuned_delta": -0.004358097453933372}, {"byte_start": 6053, "byte_end": 6057, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 1016, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "7.89% 7.89% 7.89% 7.89%", "qwen": "8.51% 8.51% 8.51% 8.51%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.1748410016298294]], "qwen": [[279, " the", "normal", 0.1515452116727829]]}, "loss": {"rwkv": 7.889738504861517, "qwen": 8.506812256157275}, "topk": {"rwkv": [22590, 1, 0.1748410016298294, [[22590, 0.174841, " the", false], [45, 0.060123, ",", false], [4601, 0.059038, " it", false], [38720, 0.054901, " human", false], [39934, 0.051321, " there", false], [4858, 0.03502, " we", false], [4596, 0.0242, " in", false], [52224, 0.019709, " methods", false], [332, 0.017632, " a", false], [56537, 0.015693, " learning", false]]], "qwen": [279, 1, 0.1515452116727829, [[279, 0.151545, " the", false], [1052, 0.060307, " there", false], [3738, 0.059422, " human", false], [432, 0.053269, " it", false], [11, 0.04297, ",", false], [582, 0.033542, " we", false], [304, 0.030668, " in", false], [4586, 0.024622, " general", false], [5413, 0.017795, " methods", false], [264, 0.017794, " a", false]]]}, "raw_delta": -0.03421783447265625, "tuned_delta": -0.026880695958953513}, {"byte_start": 6057, "byte_end": 6064, "display": {"text": " actual", "kind": "normal"}, "is_word": true, "word_id": 1017, "word_key": " actual", "bytes_hex": "20 61 63 74 75 61 6c", "compression": {"rwkv": "18.60% 18.60% 18.60% 18.60% 18.60% 18.60% 18.60%", "qwen": "18.34% 18.34% 18.34% 18.34% 18.34% 18.34% 18.34%"}, "model_tokens": {"rwkv": [[45098, " actual", "normal", 0.0007230545161291957]], "qwen": [[5042, " actual", "normal", 0.0008084636065177619]]}, "loss": {"rwkv": 18.597240761459293, "qwen": 18.343802213357833}, "topk": {"rwkv": [45098, 203, 0.0007230545161291957, [[38720, 0.100432, " human", false], [52224, 0.044905, " methods", false], [31461, 0.032328, " most", false], [22638, 0.028217, " two", false], [45184, 0.022037, " appeal", false], [47202, 0.017538, " search", false], [30273, 0.016056, " best", false], [22752, 0.013919, " way", false], [45315, 0.011766, " bitter", false], [22681, 0.011552, " use", false]]], "qwen": [5042, 193, 0.0008084636065177619, [[3738, 0.05743, " human", false], [1429, 0.036709, " most", false], [1850, 0.02961, " best", false], [1378, 0.027693, " two", false], [2070, 0.019168, " field", false], [25180, 0.013765, " bitter", false], [803, 0.013295, " more", false], [5413, 0.013289, " methods", false], [2711, 0.013264, " search", false], [1172, 0.013, " only", false]]]}, "raw_delta": 0.014053617204938584, "tuned_delta": 0.02139075571864132}, {"byte_start": 6064, "byte_end": 6073, "display": {"text": " contents", "kind": "normal"}, "is_word": true, "word_id": 1018, "word_key": " contents", "bytes_hex": "20 63 6f 6e 74 65 6e 74 73", "compression": {"rwkv": "13.27% 13.27% 13.27% 13.27% 13.27% 13.27% 13.27% 13.27% 13.27%", "qwen": "15.03% 15.03% 15.03% 15.03% 15.03% 15.03% 15.03% 15.03% 15.03%"}, "model_tokens": {"rwkv": [[55847, " contents", "normal", 0.0013142244424670935]], "qwen": [[8794, " contents", "normal", 0.0005515777156688273]]}, "loss": {"rwkv": 13.274798119290809, "qwen": 15.03353856905412}, "topk": {"rwkv": [55847, 127, 0.0013142244424670935, [[52224, 0.087561, " methods", false], [56950, 0.024465, " progress", false], [38720, 0.023851, " human", false], [57103, 0.022045, " research", false], [53052, 0.02002, " success", false], [51308, 0.019181, " content", false], [62633, 0.018838, " techniques", false], [63370, 0.016573, " computation", false], [60572, 0.014549, " structure", false], [22752, 0.014447, " way", false]]], "qwen": [8794, 287, 0.0005515777156688273, [[3738, 0.026625, " human", false], [3311, 0.024815, " amount", false], [5413, 0.023012, " methods", false], [5068, 0.02043, " performance", false], [2393, 0.017845, " success", false], [8129, 0.016658, " implementation", false], [897, 0.01486, " value", false], [11, 0.013857, ",", false], [6832, 0.013082, " learning", false], [990, 0.013004, " use", false]]]}, "raw_delta": -0.0975252787272135, "tuned_delta": -0.09018814021351076}, {"byte_start": 6073, "byte_end": 6076, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 1019, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "0.23% 0.23% 0.23%", "qwen": "0.24% 0.24% 0.24%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.962536633014679]], "qwen": [[315, " of", "normal", 0.9605894684791565]]}, "loss": {"rwkv": 0.22747571954120818, "qwen": 0.24170031949848864}, "topk": {"rwkv": [4706, 1, 0.962536633014679, [[4706, 0.962537, " of", false], [21265, 0.014143, " and", false], [45, 0.004757, ",", false], [32227, 0.004194, " that", false], [4715, 0.003819, " or", false], [275, 0.001489, " (", false], [4596, 0.001083, " in", false], [21286, 0.000899, " are", false], [5346, 0.000847, "---", false], [46530, 0.000842, " matter", false]]], "qwen": [315, 1, 0.9605894684791565, [[315, 0.960589, " of", false], [323, 0.017903, " and", false], [11, 0.005787, ",", false], [429, 0.002832, " that", false], [320, 0.002554, " (", false], [476, 0.002003, " or", false], [525, 0.001233, " are", false], [4925, 0.000675, " matter", false], [4421, 0.00062, "---", false], [304, 0.000604, " in", false]]]}, "raw_delta": -0.0007887793083985652, "tuned_delta": 0.006548359205304171}, {"byte_start": 6076, "byte_end": 6082, "display": {"text": " minds", "kind": "normal"}, "is_word": true, "word_id": 1020, "word_key": " minds", "bytes_hex": "20 6d 69 6e 64 73", "compression": {"rwkv": "22.82% 22.82% 22.82% 22.82% 22.82% 22.82%", "qwen": "22.99% 22.99% 22.99% 22.99% 22.99% 22.99%"}, "model_tokens": {"rwkv": [[39026, " minds", "normal", 0.000510960235260427]], "qwen": [[20062, " minds", "normal", 0.0004761377349495888]]}, "loss": {"rwkv": 22.823886389063677, "qwen": 22.992360593848883}, "topk": {"rwkv": [39026, 66, 0.000510960235260427, [[22590, 0.359717, " the", false], [332, 0.095102, " a", false], [59943, 0.082342, " knowledge", false], [38720, 0.064509, " human", false], [3609, 0.061252, " AI", false], [32464, 0.030682, " what", false], [22248, 0.029596, " our", false], [39936, 0.025075, " these", false], [52224, 0.024153, " methods", false], [4419, 0.023399, " an", false]]], "qwen": [20062, 80, 0.0004761377349495888, [[279, 0.313124, " the", false], [3738, 0.179506, " human", false], [6540, 0.121824, " knowledge", false], [264, 0.092694, " a", false], [1039, 0.031638, " our", false], [458, 0.027065, " an", false], [1128, 0.023767, " what", false], [894, 0.013029, " any", false], [825, 0.012983, " one", false], [15235, 0.012561, " AI", false]]]}, "raw_delta": -0.009342193603515625, "tuned_delta": -0.0020050550898128884}, {"byte_start": 6082, "byte_end": 6086, "display": {"text": " are", "kind": "normal"}, "is_word": true, "word_id": 1021, "word_key": " are", "bytes_hex": "20 61 72 65", "compression": {"rwkv": "5.85% 5.85% 5.85% 5.85%", "qwen": "4.95% 4.95% 4.95% 4.95%"}, "model_tokens": {"rwkv": [[21286, " are", "normal", 0.27479615807533264]], "qwen": [[525, " are", "normal", 0.3335510194301605]]}, "loss": {"rwkv": 5.846859784852732, "qwen": 4.950064313615376}, "topk": {"rwkv": [21286, 1, 0.27479615807533264, [[21286, 0.274796, " are", false], [45, 0.179216, ",", false], [21265, 0.080195, " and", false], [5346, 0.068497, "---", false], [4600, 0.052511, " is", false], [4491, 0.043966, " do", false], [4706, 0.028087, " of", false], [4715, 0.023878, " or", false], [275, 0.023178, " (", false], [46530, 0.02307, " matter", false]]], "qwen": [525, 1, 0.3335510194301605, [[525, 0.333551, " are", false], [11, 0.114802, ",", false], [4421, 0.079364, "---", false], [323, 0.063299, " and", false], [4925, 0.05121, " matter", false], [653, 0.043679, " do", false], [320, 0.036484, " (", false], [646, 0.036335, " can", false], [1745, 0.021339, " differ", false], [429, 0.018434, " that", false]]]}, "raw_delta": 0.04972890019416809, "tuned_delta": 0.05706603870787083}, {"byte_start": 6086, "byte_end": 6099, "display": {"text": " tremendously", "kind": "normal"}, "is_word": true, "word_id": 1022, "word_key": " tremendously", "bytes_hex": "20 74 72 65 6d 65 6e 64 6f 75 73 6c 79", "compression": {"rwkv": "14.14% 14.14% 14.14% 14.14% 14.14% 14.14% 14.14% 14.14% 14.14% 14.14% 14.14% 0.06% 0.06%", "qwen": "12.55% 12.55% 12.55% 12.55% 12.55% 12.55% 12.55% 12.55% 12.55% 12.55% 12.55% 12.55% 12.55%"}, "model_tokens": {"rwkv": [[62670, " tremendous", "normal", 0.0001751370436977595], [2030, "ly", "normal", 0.9933493733406067]], "qwen": [[71323, " tremendously", "normal", 0.00011814780737040564]]}, "loss": {"rwkv": 11.973887245621787, "qwen": 12.545307540774282}, "topk": {"rwkv": [62670, 252, 0.0001751370436977595, [[22187, 0.257466, " not", false], [62161, 0.10494, " irrelevant", false], [32386, 0.04031, " very", false], [39171, 0.034316, " often", false], [31466, 0.032905, " much", false], [31277, 0.026565, " less", false], [4706, 0.021336, " of", false], [332, 0.018659, " a", false], [59516, 0.018521, " difficult", false], [45, 0.01603, ",", false]]], "qwen": [71323, 309, 0.00011814780737040564, [[537, 0.245593, " not", false], [39715, 0.157858, " irrelevant", false], [2686, 0.040909, " less", false], [3545, 0.037021, " often", false], [315, 0.036599, " of", false], [4893, 0.025389, " imm", false], [13771, 0.022763, " largely", false], [650, 0.02013, " un", false], [264, 0.015697, " a", false], [11, 0.014247, ",", false]]]}, "raw_delta": -0.03168626931997453, "tuned_delta": -0.024349130806271792}, {"byte_start": 6099, "byte_end": 6100, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "99.19%", "qwen": "102.99%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.004099441226571798]], "qwen": [[11, ",", "normal", 0.003309671999886632]]}, "loss": {"rwkv": 99.18528406111622, "qwen": 102.98869758321233}, "topk": {"rwkv": [45, 15, 0.004099441226571798, [[59516, 0.202784, " difficult", false], [51258, 0.199874, " complex", false], [63366, 0.159224, " complicated", false], [31048, 0.11287, " hard", false], [31458, 0.043709, " more", false], [59829, 0.030992, " important", false], [51507, 0.025995, " diverse", false], [57518, 0.019725, " variable", false], [31277, 0.018485, " less", false], [47705, 0.018152, " varied", false]]], "qwen": [11, 36, 0.003309671999886632, [[2989, 0.192251, " important", false], [2686, 0.099634, " less", false], [6351, 0.078771, " complex", false], [39715, 0.076917, " irrelevant", false], [2155, 0.043931, " different", false], [16965, 0.038716, " complicated", false], [803, 0.037987, " more", false], [5000, 0.034358, " difficult", false], [2588, 0.022752, " hard", false], [650, 0.022206, " un", false]]]}, "raw_delta": -0.2109060287475586, "tuned_delta": -0.20356889023385585}, {"byte_start": 6100, "byte_end": 6105, "display": {"text": " irre", "kind": "normal"}, "is_word": true, "word_id": 1023, "word_key": " irre", "bytes_hex": "20 69 72 72 65", "compression": {"rwkv": "19.61% 19.61% 19.61% 19.61% 19.61%", "qwen": "16.00% 16.00% 16.00% 16.00% 16.00%"}, "model_tokens": {"rwkv": [[31170, " irre", "normal", 0.004343354608863592]], "qwen": [[24870, " irre", "normal", 0.011836192570626736]]}, "loss": {"rwkv": 19.611635712084343, "qwen": 16.001626999842525}, "topk": {"rwkv": [31170, 45, 0.004343354608863592, [[21265, 0.084817, " and", false], [46269, 0.05788, " incomp", false], [52448, 0.037836, " perhaps", false], [30788, 0.031121, " even", false], [59988, 0.02943, " massively", false], [47708, 0.026518, " vastly", false], [64911, 0.021479, " exponentially", false], [45145, 0.020292, " almost", false], [21400, 0.019449, " but", false], [31427, 0.015917, " mind", false]]], "qwen": [24870, 15, 0.011836192570626736, [[323, 0.207878, " and", false], [714, 0.051271, " but", false], [1496, 0.050814, " even", false], [421, 0.023342, " if", false], [52890, 0.022976, " incom", false], [8365, 0.02207, " perhaps", false], [3498, 0.020079, " though", false], [83544, 0.018703, " unknow", false], [4558, 0.015977, " almost", false], [71323, 0.015372, " tremendously", false]]]}, "raw_delta": 0.20018138885498038, "tuned_delta": 0.20751852736868312}, {"byte_start": 6105, "byte_end": 6113, "display": {"text": "deemably", "kind": "normal"}, "is_word": true, "word_id": 1024, "word_key": "deemably", "bytes_hex": "64 65 65 6d 61 62 6c 79", "compression": {"rwkv": "21.60% 21.60% 21.60% 0.05% 0.05% 0.02% 0.02% 0.02%", "qwen": "26.66% 26.66% 0.01% 0.01% 0.01% 0.01% 0.01% 0.01%"}, "model_tokens": {"rwkv": [[7333, "dee", "normal", 0.02744680643081665], [2034, "ma", "normal", 0.9943073391914368], [7166, "bly", "normal", 0.9962118864059448]], "qwen": [[450, "de", "normal", 0.051972292363643646], [336, "em", "normal", 0.9987937211990356], [2845, "ably", "normal", 0.9985482096672058]]}, "loss": {"rwkv": 8.122293445358206, "qwen": 6.671797688020069}, "topk": {"rwkv": [7333, 5, 0.02744680643081665, [[7387, 0.716223, "duc", false], [27190, 0.072552, "trie", false], [27418, 0.055665, "vers", false], [35986, 0.033324, "vocab", false], [7333, 0.027447, "dee", false], [34176, 0.014905, "cover", false], [35389, 0.013173, "place", false], [25053, 0.010901, "conc", false], [26645, 0.00876, "para", false], [35054, 0.008165, "media", false]]], "qwen": [450, 5, 0.051972292363643646, [[7545, 0.391993, "duc", false], [8927, 0.16819, "trie", false], [3004, 0.134581, "vers", false], [78285, 0.059703, "ducible", false], [450, 0.051972, "de", false], [40446, 0.049267, "conc", false], [1732, 0.029554, "par", false], [3449, 0.025845, "lev", false], [273, 0.024408, "le", false], [32094, 0.020225, "levance", false]]]}, "raw_delta": 0.0804325635690475, "tuned_delta": 0.08776970208275024}, {"byte_start": 6113, "byte_end": 6121, "display": {"text": " complex", "kind": "normal"}, "is_word": true, "word_id": 1025, "word_key": " complex", "bytes_hex": "20 63 6f 6d 70 6c 65 78", "compression": {"rwkv": "4.75% 4.75% 4.75% 4.75% 4.75% 4.75% 4.75% 4.75%", "qwen": "5.27% 5.27% 5.27% 5.27% 5.27% 5.27% 5.27% 5.27%"}, "model_tokens": {"rwkv": [[51258, " complex", "normal", 0.12180574983358383]], "qwen": [[6351, " complex", "normal", 0.09666675329208374]]}, "loss": {"rwkv": 4.754976331054933, "qwen": 5.2669321363602055}, "topk": {"rwkv": [51258, 3, 0.12180574983358383, [[59516, 0.194431, " difficult", false], [31048, 0.123883, " hard", false], [51258, 0.121806, " complex", false], [63366, 0.096199, " complicated", false], [45, 0.095088, ",", false], [39011, 0.078053, " messy", false], [59829, 0.02069, " important", false], [46706, 0.018994, " opaque", false], [62234, 0.013268, " mysterious", false], [51507, 0.008602, " diverse", false]]], "qwen": [6351, 2, 0.09666675329208374, [[11, 0.242719, ",", false], [6351, 0.096667, " complex", false], [2155, 0.091925, " different", false], [16965, 0.03225, " complicated", false], [2989, 0.031886, " important", false], [39715, 0.025306, " irrelevant", false], [650, 0.024848, " un", false], [5000, 0.020229, " difficult", false], [869, 0.017272, " private", false], [46484, 0.014961, " opaque", false]]]}, "raw_delta": -0.0283888578414917, "tuned_delta": -0.021051719327788963}, {"byte_start": 6121, "byte_end": 6122, "display": {"text": ";", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "3b", "compression": {"rwkv": "84.53%", "qwen": "82.18%"}, "model_tokens": {"rwkv": [[60, ";", "normal", 0.009526293724775314]], "qwen": [[26, ";", "normal", 0.010491050779819489]]}, "loss": {"rwkv": 84.5329125520877, "qwen": 82.18371553262716}, "topk": {"rwkv": [60, 5, 0.009526293724775314, [[47, 0.449881, ".", false], [45, 0.299116, ",", false], [5346, 0.099773, "---", false], [21265, 0.081344, " and", false], [60, 0.009526, ";", false], [275, 0.008199, " (", false], [4811, 0.008149, " to", false], [4596, 0.008125, " in", false], [21700, 0.005763, " for", false], [59, 0.004539, ":", false]]], "qwen": [26, 5, 0.010491050779819489, [[13, 0.562278, ".", false], [11, 0.241227, ",", false], [323, 0.091116, " and", false], [4421, 0.037604, "---", false], [26, 0.010491, ";", false], [320, 0.00747, " (", false], [311, 0.00652, " to", false], [382, 0.005579, ".\n\n", false], [25, 0.004955, ":", false], [2513, 0.004913, " things", false]]]}, "raw_delta": 0.13026714324951172, "tuned_delta": 0.13760428176321446}, {"byte_start": 6122, "byte_end": 6125, "display": {"text": " we", "kind": "normal"}, "is_word": true, "word_id": 1026, "word_key": " we", "bytes_hex": "20 77 65", "compression": {"rwkv": "17.47% 17.47% 17.47%", "qwen": "14.50% 14.50% 14.50%"}, "model_tokens": {"rwkv": [[4858, " we", "normal", 0.05461563542485237]], "qwen": [[582, " we", "normal", 0.08956600725650787]]}, "loss": {"rwkv": 17.47013526076479, "qwen": 14.503769899550523}, "topk": {"rwkv": [4858, 6, 0.05461563542485237, [[32232, 0.102469, " they", false], [22590, 0.088076, " the", false], [21265, 0.084861, " and", false], [39934, 0.064301, " there", false], [32227, 0.062176, " that", false], [4858, 0.054616, " we", false], [4601, 0.046997, " it", false], [32234, 0.032904, " this", false], [4596, 0.027406, " in", false], [4692, 0.021625, " no", false]]], "qwen": [582, 2, 0.08956600725650787, [[323, 0.130866, " and", false], [582, 0.089566, " we", false], [279, 0.07098, " the", false], [432, 0.067737, " it", false], [807, 0.059452, " they", false], [429, 0.053745, " that", false], [1052, 0.030598, " there", false], [419, 0.028595, " this", false], [304, 0.025112, " in", false], [773, 0.018137, " so", false]]]}, "raw_delta": 0.1644902229309082, "tuned_delta": 0.17182736144461094}, {"byte_start": 6125, "byte_end": 6132, "display": {"text": " should", "kind": "normal"}, "is_word": true, "word_id": 1027, "word_key": " should", "bytes_hex": "20 73 68 6f 75 6c 64", "compression": {"rwkv": "9.22% 9.22% 9.22% 9.22% 9.22% 9.22% 9.22%", "qwen": "6.97% 6.97% 6.97% 6.97% 6.97% 6.97% 6.97%"}, "model_tokens": {"rwkv": [[47266, " should", "normal", 0.028033364564180374]], "qwen": [[1265, " should", "normal", 0.06674191355705261]]}, "loss": {"rwkv": 9.218112844965754, "qwen": 6.973683971068322}, "topk": {"rwkv": [47266, 8, 0.028033364564180374, [[4491, 0.166599, " do", false], [31059, 0.151215, " have", false], [21286, 0.104555, " are", false], [45409, 0.100942, " cannot", false], [21413, 0.09111, " can", false], [32475, 0.045839, " will", false], [31223, 0.035558, " know", false], [47266, 0.028033, " should", false], [46227, 0.02461, " humans", false], [47285, 0.023203, " simply", false]]], "qwen": [1265, 6, 0.06674191355705261, [[653, 0.17182, " do", false], [614, 0.130978, " have", false], [4157, 0.13019, " cannot", false], [646, 0.105554, " can", false], [525, 0.073844, " are", false], [1265, 0.066742, " should", false], [1414, 0.033922, " know", false], [1513, 0.027113, " don", false], [686, 0.020999, " will", false], [4936, 0.019961, " simply", false]]]}, "raw_delta": 0.12445756367274696, "tuned_delta": 0.1317947021864497}, {"byte_start": 6132, "byte_end": 6137, "display": {"text": " stop", "kind": "normal"}, "is_word": true, "word_id": 1028, "word_key": " stop", "bytes_hex": "20 73 74 6f 70", "compression": {"rwkv": "15.89% 15.89% 15.89% 15.89% 15.89%", "qwen": "17.86% 17.86% 17.86% 17.86% 17.86%"}, "model_tokens": {"rwkv": [[32122, " stop", "normal", 0.012202269397675991]], "qwen": [[2936, " stop", "normal", 0.00706950668245554]]}, "loss": {"rwkv": 15.892187559792486, "qwen": 17.860436128285865}, "topk": {"rwkv": [32122, 9, 0.012202269397675991, [[22187, 0.428189, " not", false], [39115, 0.11365, " never", false], [45926, 0.063481, " expect", false], [4435, 0.059984, " be", false], [60645, 0.02521, " therefore", false], [31059, 0.019113, " have", false], [45084, 0.017836, " accept", false], [45150, 0.017279, " always", false], [32122, 0.012202, " stop", false], [38877, 0.008744, " learn", false]]], "qwen": [2936, 13, 0.00706950668245554, [[537, 0.530159, " not", false], [387, 0.074207, " be", false], [2581, 0.044176, " never", false], [8916, 0.022915, " therefore", false], [5648, 0.019162, " avoid", false], [1430, 0.013761, " try", false], [1720, 0.010714, " expect", false], [614, 0.008325, " have", false], [2677, 0.007854, " always", false], [5274, 0.007544, " leave", false]]]}, "raw_delta": -0.1091428756713867, "tuned_delta": -0.10180573715768396}, {"byte_start": 6137, "byte_end": 6144, "display": {"text": " trying", "kind": "normal"}, "is_word": true, "word_id": 1029, "word_key": " trying", "bytes_hex": "20 74 72 79 69 6e 67", "compression": {"rwkv": "1.49% 1.49% 1.49% 1.49% 1.49% 1.49% 1.49%", "qwen": "1.79% 1.79% 1.79% 1.79% 1.79% 1.79% 1.79%"}, "model_tokens": {"rwkv": [[47629, " trying", "normal", 0.5588558316230774]], "qwen": [[4460, " trying", "normal", 0.4985191822052002]]}, "loss": {"rwkv": 1.4893894116320212, "qwen": 1.7933555412213442}, "topk": {"rwkv": [47629, 1, 0.5588558316230774, [[47629, 0.558856, " trying", false], [57419, 0.098311, " thinking", false], [62360, 0.046329, " pretending", false], [53320, 0.01844, " wasting", false], [46500, 0.016038, " making", false], [59681, 0.015956, " expecting", false], [52157, 0.015261, " looking", false], [59224, 0.011838, " believing", false], [46217, 0.009313, " hoping", false], [55562, 0.008585, " assuming", false]]], "qwen": [4460, 1, 0.4985191822052002, [[4460, 0.498519, " trying", false], [7274, 0.087178, " thinking", false], [47797, 0.028093, " wasting", false], [39776, 0.019131, " worrying", false], [3259, 0.018178, " making", false], [54806, 0.017214, " pretending", false], [3330, 0.016465, " looking", false], [26625, 0.016464, " treating", false], [10161, 0.015371, " asking", false], [25538, 0.014384, " assuming", false]]]}, "raw_delta": -0.01685546125684466, "tuned_delta": -0.009518322743141922}, {"byte_start": 6144, "byte_end": 6147, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 1030, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "0.18% 0.18% 0.18%", "qwen": "0.14% 0.14% 0.14%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.9704799056053162]], "qwen": [[311, " to", "normal", 0.9774839878082275]]}, "loss": {"rwkv": 0.1797791977019226, "qwen": 0.13689611868117005}, "topk": {"rwkv": [4811, 1, 0.9704799056053162, [[4811, 0.97048, " to", false], [47, 0.005504, ".", false], [4788, 0.004868, " so", false], [45, 0.004468, ",", false], [4596, 0.001767, " in", false], [21265, 0.001755, " and", false], [21700, 0.000926, " for", false], [63461, 0.000831, " desperately", false], [275, 0.000759, " (", false], [31048, 0.000545, " hard", false]]], "qwen": [311, 1, 0.9774839878082275, [[311, 0.977484, " to", false], [11, 0.003888, ",", false], [773, 0.002972, " so", false], [37543, 0.001506, " desperately", false], [304, 0.00114, " in", false], [323, 0.001132, " and", false], [369, 0.001086, " for", false], [320, 0.000969, " (", false], [13, 0.000955, ".", false], [2238, 0.000853, " too", false]]]}, "raw_delta": 0.0023779428253571195, "tuned_delta": 0.009715081339059857}, {"byte_start": 6147, "byte_end": 6152, "display": {"text": " find", "kind": "normal"}, "is_word": true, "word_id": 1031, "word_key": " find", "bytes_hex": "20 66 69 6e 64", "compression": {"rwkv": "17.58% 17.58% 17.58% 17.58% 17.58%", "qwen": "17.29% 17.29% 17.29% 17.29% 17.29%"}, "model_tokens": {"rwkv": [[30858, " find", "normal", 0.007666742894798517]], "qwen": [[1477, " find", "normal", 0.008287807926535606]]}, "loss": {"rwkv": 17.58284581083424, "qwen": 17.28698405655495}, "topk": {"rwkv": [30858, 26, 0.007666742894798517, [[62683, 0.090653, " understand", false], [39043, 0.079389, " model", false], [37923, 0.076387, " build", false], [22339, 0.060166, " put", false], [31358, 0.044674, " make", false], [47030, 0.029202, " reduce", false], [39025, 0.019377, " mimic", false], [51133, 0.019052, " capture", false], [63292, 0.018321, " approximate", false], [60386, 0.018082, " replicate", false]]], "qwen": [1477, 12, 0.008287807926535606, [[3535, 0.28374, " understand", false], [1614, 0.094508, " model", false], [1936, 0.090455, " build", false], [1281, 0.026458, " make", false], [2182, 0.02417, " put", false], [4009, 0.016793, " represent", false], [12322, 0.016563, " capture", false], [633, 0.015462, " get", false], [7949, 0.014764, " reduce", false], [7512, 0.013279, " describe", false]]]}, "raw_delta": 0.01640605926513672, "tuned_delta": 0.023743197778839455}, {"byte_start": 6152, "byte_end": 6159, "display": {"text": " simple", "kind": "normal"}, "is_word": true, "word_id": 1032, "word_key": " simple", "bytes_hex": "20 73 69 6d 70 6c 65", "compression": {"rwkv": "6.40% 6.40% 6.40% 6.40% 6.40% 6.40% 6.40%", "qwen": "5.90% 5.90% 5.90% 5.90% 5.90% 5.90% 5.90%"}, "model_tokens": {"rwkv": [[47284, " simple", "normal", 0.08274747431278229]], "qwen": [[4285, " simple", "normal", 0.10120167583227158]]}, "loss": {"rwkv": 6.400349093229498, "qwen": 5.901241313279305}, "topk": {"rwkv": [47284, 3, 0.08274747431278229, [[332, 0.136403, " a", false], [32448, 0.10713, " ways", false], [47284, 0.082747, " simple", false], [22590, 0.068402, " the", false], [22249, 0.047246, " out", false], [51832, 0.032437, " general", false], [32229, 0.026639, " them", false], [4419, 0.023933, " an", false], [30724, 0.021575, " easy", false], [21265, 0.018438, " and", false]]], "qwen": [4285, 3, 0.10120167583227158, [[700, 0.118878, " out", false], [264, 0.101372, " a", false], [4285, 0.101202, " simple", false], [5510, 0.095032, " ways", false], [1105, 0.049416, " them", false], [279, 0.049007, " the", false], [458, 0.016485, " an", false], [1661, 0.01402, " good", false], [894, 0.01358, " any", false], [11464, 0.013484, " explicit", false]]]}, "raw_delta": 0.0276764120374407, "tuned_delta": 0.03501355055114344}, {"byte_start": 6159, "byte_end": 6164, "display": {"text": " ways", "kind": "normal"}, "is_word": true, "word_id": 1033, "word_key": " ways", "bytes_hex": "20 77 61 79 73", "compression": {"rwkv": "7.72% 7.72% 7.72% 7.72% 7.72%", "qwen": "10.46% 10.46% 10.46% 10.46% 10.46%"}, "model_tokens": {"rwkv": [[32448, " ways", "normal", 0.1175675094127655]], "qwen": [[5510, " ways", "normal", 0.05498006194829941]]}, "loss": {"rwkv": 7.720672679757342, "qwen": 10.462368505016979}, "topk": {"rwkv": [32448, 2, 0.1175675094127655, [[45, 0.199164, ",", false], [32448, 0.117568, " ways", false], [64392, 0.068426, " explanations", false], [39558, 0.060706, " rules", false], [46587, 0.055927, " models", false], [64351, 0.034902, " descriptions", false], [65275, 0.034696, " representations", false], [60521, 0.032307, " solutions", false], [51832, 0.021598, " general", false], [38720, 0.015742, " human", false]]], "qwen": [5510, 5, 0.05498006194829941, [[11, 0.200505, ",", false], [4119, 0.119313, " models", false], [43613, 0.083355, " representations", false], [40841, 0.072082, " explanations", false], [5510, 0.05498, " ways", false], [323, 0.034541, " and", false], [10502, 0.028146, " mental", false], [27787, 0.025921, " descriptions", false], [5601, 0.019599, " rules", false], [23400, 0.014106, " analog", false]]]}, "raw_delta": -0.15203189849853516, "tuned_delta": -0.14469475998483242}, {"byte_start": 6164, "byte_end": 6167, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 1034, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "1.68% 1.68% 1.68%", "qwen": "1.91% 1.91% 1.91%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.757064938545227]], "qwen": [[311, " to", "normal", 0.7277523875236511]]}, "loss": {"rwkv": 1.6789175687428526, "qwen": 1.9103352739607122}, "topk": {"rwkv": [4811, 1, 0.757064938545227, [[4811, 0.757065, " to", false], [4706, 0.182493, " of", false], [21700, 0.021049, " for", false], [4596, 0.012991, " in", false], [45202, 0.005866, " around", false], [32227, 0.004293, " that", false], [45, 0.003274, ",", false], [22249, 0.002382, " out", false], [31162, 0.002118, " into", false], [275, 0.001988, " (", false]]], "qwen": [311, 1, 0.7277523875236511, [[311, 0.727752, " to", false], [315, 0.238862, " of", false], [304, 0.005255, " in", false], [429, 0.00495, " that", false], [369, 0.004693, " for", false], [1119, 0.00412, " into", false], [11, 0.003879, ",", false], [700, 0.002278, " out", false], [320, 0.001997, " (", false], [2163, 0.001271, " around", false]]]}, "raw_delta": -0.01283252239227295, "tuned_delta": -0.005495383878570213}, {"byte_start": 6167, "byte_end": 6173, "display": {"text": " think", "kind": "normal"}, "is_word": true, "word_id": 1035, "word_key": " think", "bytes_hex": "20 74 68 69 6e 6b", "compression": {"rwkv": "15.69% 15.69% 15.69% 15.69% 15.69% 15.69%", "qwen": "13.14% 13.14% 13.14% 13.14% 13.14% 13.14%"}, "model_tokens": {"rwkv": [[39942, " think", "normal", 0.005354481749236584]], "qwen": [[1744, " think", "normal", 0.012629715725779533]]}, "loss": {"rwkv": 15.685551551331827, "qwen": 13.139653674513227}, "topk": {"rwkv": [39942, 24, 0.005354481749236584, [[60389, 0.136737, " represent", false], [55961, 0.109027, " describe", false], [39043, 0.087679, " model", false], [51133, 0.059309, " capture", false], [22339, 0.057766, " put", false], [62683, 0.050469, " understand", false], [51688, 0.03761, " explain", false], [37923, 0.030223, " build", false], [45854, 0.025115, " encode", false], [31358, 0.024918, " make", false]]], "qwen": [1744, 10, 0.012629715725779533, [[4009, 0.175052, " represent", false], [3535, 0.125118, " understand", false], [1614, 0.116433, " model", false], [7512, 0.06857, " describe", false], [12322, 0.057066, " capture", false], [1936, 0.050149, " build", false], [16164, 0.022086, " encode", false], [10339, 0.019037, " explain", false], [633, 0.013144, " get", false], [1744, 0.01263, " think", false]]]}, "raw_delta": 0.1411745548248291, "tuned_delta": 0.14851169333853184}, {"byte_start": 6173, "byte_end": 6179, "display": {"text": " about", "kind": "normal"}, "is_word": true, "word_id": 1036, "word_key": " about", "bytes_hex": "20 61 62 6f 75 74", "compression": {"rwkv": "1.78% 1.78% 1.78% 1.78% 1.78% 1.78%", "qwen": "3.15% 3.15% 3.15% 3.15% 3.15% 3.15%"}, "model_tokens": {"rwkv": [[37598, " about", "normal", 0.5546380281448364]], "qwen": [[911, " about", "normal", 0.35096195340156555]]}, "loss": {"rwkv": 1.7845837094329622, "qwen": 3.1471112447329133}, "topk": {"rwkv": [37598, 1, 0.5546380281448364, [[37598, 0.554638, " about", false], [31296, 0.173434, " like", false], [4706, 0.040848, " of", false], [47, 0.034427, ".", false], [21265, 0.032462, " and", false], [32227, 0.030477, " that", false], [45, 0.027151, ",", false], [4596, 0.015153, " in", false], [4715, 0.009506, " or", false], [22248, 0.007199, " our", false]]], "qwen": [911, 1, 0.35096195340156555, [[911, 0.350962, " about", false], [13, 0.1403, ".", false], [11, 0.080916, ",", false], [429, 0.079425, " that", false], [323, 0.075951, " and", false], [315, 0.051051, " of", false], [1075, 0.042088, " like", false], [476, 0.022743, " or", false], [304, 0.022563, " in", false], [382, 0.012704, ".\n\n", false]]]}, "raw_delta": -0.0755545695622762, "tuned_delta": -0.06821743104857346}, {"byte_start": 6179, "byte_end": 6183, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 1037, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "9.72% 9.72% 9.72% 9.72%", "qwen": "12.21% 12.21% 12.21% 12.21%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.11386032402515411]], "qwen": [[279, " the", "normal", 0.06668713688850403]]}, "loss": {"rwkv": 9.721284943490085, "qwen": 12.207648875929388}, "topk": {"rwkv": [22590, 3, 0.11386032402515411, [[32229, 0.419121, " them", false], [39026, 0.125669, " minds", false], [22590, 0.11386, " the", false], [21835, 0.055404, " how", false], [4601, 0.031658, " it", false], [32464, 0.024429, " what", false], [21265, 0.022676, " and", false], [22248, 0.020634, " our", false], [51258, 0.017868, " complex", false], [47539, 0.017024, " things", false]]], "qwen": [279, 3, 0.06668713688850403, [[1105, 0.503293, " them", false], [20062, 0.069343, " minds", false], [279, 0.066687, " the", false], [1128, 0.034867, " what", false], [1246, 0.030605, " how", false], [15235, 0.024006, " AI", false], [6351, 0.020271, " complex", false], [419, 0.017523, " this", false], [323, 0.017303, " and", false], [476, 0.016512, " or", false]]]}, "raw_delta": -0.13787329196929932, "tuned_delta": -0.13053615345559658}, {"byte_start": 6183, "byte_end": 6192, "display": {"text": " contents", "kind": "normal"}, "is_word": true, "word_id": 1038, "word_key": " contents", "bytes_hex": "20 63 6f 6e 74 65 6e 74 73", "compression": {"rwkv": "4.32% 4.32% 4.32% 4.32% 4.32% 4.32% 4.32% 4.32% 4.32%", "qwen": "3.10% 3.10% 3.10% 3.10% 3.10% 3.10% 3.10% 3.10% 3.10%"}, "model_tokens": {"rwkv": [[55847, " contents", "normal", 0.11623040586709976]], "qwen": [[8794, " contents", "normal", 0.2131236046552658]]}, "loss": {"rwkv": 4.320571085995593, "qwen": 3.0975522941036595}, "topk": {"rwkv": [55847, 3, 0.11623040586709976, [[31427, 0.277653, " mind", false], [40213, 0.23286, " world", false], [55847, 0.11623, " contents", false], [39026, 0.074656, " minds", false], [38720, 0.041644, " human", false], [51258, 0.039217, " complex", false], [61720, 0.029453, " complexity", false], [22752, 0.012546, " way", false], [37898, 0.012007, " brain", false], [47539, 0.007251, " things", false]]], "qwen": [8794, 1, 0.2131236046552658, [[8794, 0.213124, " contents", false], [3971, 0.117353, " mind", false], [1879, 0.113957, " world", false], [20062, 0.074614, " minds", false], [23094, 0.047547, " complexity", false], [6351, 0.021124, " complex", false], [2213, 0.020462, " content", false], [3491, 0.019065, " problem", false], [3738, 0.018264, " human", false], [5322, 0.015819, " problems", false]]]}, "raw_delta": 0.06781856218973797, "tuned_delta": 0.07515570070344071}, {"byte_start": 6192, "byte_end": 6195, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 1039, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "0.50% 0.50% 0.50%", "qwen": "0.67% 0.67% 0.67%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.921164333820343]], "qwen": [[315, " of", "normal", 0.8948466181755066]]}, "loss": {"rwkv": 0.49604382712857015, "qwen": 0.6678653786176408}, "topk": {"rwkv": [4706, 1, 0.921164333820343, [[4706, 0.921164, " of", false], [47, 0.028999, ".", false], [45, 0.016989, ",", false], [21265, 0.014194, " and", false], [4596, 0.003427, " in", false], [32227, 0.002375, " that", false], [60, 0.001972, ";", false], [4715, 0.001541, " or", false], [275, 0.00116, " (", false], [4450, 0.001035, " by", false]]], "qwen": [315, 1, 0.8948466181755066, [[315, 0.894847, " of", false], [13, 0.047853, ".", false], [11, 0.01782, ",", false], [323, 0.01475, " and", false], [382, 0.004503, ".\n\n", false], [4421, 0.00264, "---", false], [429, 0.002627, " that", false], [320, 0.001751, " (", false], [304, 0.001715, " in", false], [476, 0.00163, " or", false]]]}, "raw_delta": -0.009527809917926785, "tuned_delta": -0.0021906714042240483}, {"byte_start": 6195, "byte_end": 6201, "display": {"text": " minds", "kind": "normal"}, "is_word": true, "word_id": 1040, "word_key": " minds", "bytes_hex": "20 6d 69 6e 64 73", "compression": {"rwkv": "0.39% 0.39% 0.39% 0.39% 0.39% 0.39%", "qwen": "0.79% 0.79% 0.79% 0.79% 0.79% 0.79%"}, "model_tokens": {"rwkv": [[39026, " minds", "normal", 0.877874493598938]], "qwen": [[20062, " minds", "normal", 0.7699849605560303]]}, "loss": {"rwkv": 0.39331285701318575, "qwen": 0.7856205112617974}, "topk": {"rwkv": [39026, 1, 0.877874493598938, [[39026, 0.877874, " minds", false], [22248, 0.029887, " our", false], [22590, 0.022268, " the", false], [38720, 0.014043, " human", false], [332, 0.012643, " a", false], [39193, 0.007269, " other", false], [31427, 0.003025, " mind", false], [39931, 0.002623, " their", false], [45124, 0.002111, " agents", false], [39944, 0.001973, " those", false]]], "qwen": [20062, 1, 0.7699849605560303, [[20062, 0.769985, " minds", false], [1039, 0.059714, " our", false], [279, 0.039389, " the", false], [3738, 0.021807, " human", false], [264, 0.0203, " a", false], [1846, 0.007593, " those", false], [3971, 0.007428, " mind", false], [1493, 0.006947, " these", false], [1008, 0.006242, " other", false], [1251, 0.004898, " people", false]]]}, "raw_delta": -0.02175415555636088, "tuned_delta": -0.014417017042658145}, {"byte_start": 6201, "byte_end": 6202, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "25.08%", "qwen": "27.39%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.24913270771503448]], "qwen": [[11, ",", "normal", 0.21901921927928925]]}, "loss": {"rwkv": 25.078097390452683, "qwen": 27.385883137368587}, "topk": {"rwkv": [45, 2, 0.24913270771503448, [[47, 0.440822, ".", false], [45, 0.249133, ",", false], [21265, 0.127508, " and", false], [32227, 0.034135, " that", false], [60, 0.025304, ";", false], [4596, 0.0226, " in", false], [275, 0.016498, " (", false], [4423, 0.012536, " as", false], [5346, 0.011902, "---", false], [51018, 0.006202, " because", false]]], "qwen": [11, 2, 0.21901921927928925, [[13, 0.494029, ".", false], [11, 0.219019, ",", false], [323, 0.098597, " and", false], [382, 0.051394, ".\n\n", false], [4421, 0.019468, "---", false], [429, 0.017928, " that", false], [320, 0.014993, " (", false], [26, 0.014264, ";", false], [304, 0.013559, " in", false], [476, 0.010207, " or", false]]]}, "raw_delta": -0.12797081470489502, "tuned_delta": -0.12063367619119228}, {"byte_start": 6202, "byte_end": 6207, "display": {"text": " such", "kind": "normal"}, "is_word": true, "word_id": 1041, "word_key": " such", "bytes_hex": "20 73 75 63 68", "compression": {"rwkv": "17.13% 17.13% 17.13% 17.13% 17.13%", "qwen": "14.75% 14.75% 14.75% 14.75% 14.75%"}, "model_tokens": {"rwkv": [[32139, " such", "normal", 0.008582547307014465]], "qwen": [[1741, " such", "normal", 0.016764383763074875]]}, "loss": {"rwkv": 17.13200361055644, "qwen": 14.746141609758464}, "topk": {"rwkv": [32139, 12, 0.008582547307014465, [[21265, 0.593643, " and", false], [4715, 0.053734, " or", false], [51018, 0.053488, " because", false], [4423, 0.026306, " as", false], [21400, 0.018013, " but", false], [4811, 0.016168, " to", false], [4596, 0.015621, " in", false], [4858, 0.015603, " we", false], [40186, 0.015232, " which", false], [30788, 0.011755, " even", false]]], "qwen": [1741, 8, 0.016764383763074875, [[323, 0.5002, " and", false], [476, 0.087305, " or", false], [1576, 0.081886, " because", false], [438, 0.050973, " as", false], [892, 0.023271, " which", false], [2474, 0.018089, " since", false], [714, 0.017288, " but", false], [1741, 0.016764, " such", false], [1496, 0.015244, " even", false], [311, 0.015047, " to", false]]]}, "raw_delta": 0.13230028152465811, "tuned_delta": 0.13963742003836085}, {"byte_start": 6207, "byte_end": 6210, "display": {"text": " as", "kind": "normal"}, "is_word": true, "word_id": 1042, "word_key": " as", "bytes_hex": "20 61 73", "compression": {"rwkv": "0.15% 0.15% 0.15%", "qwen": "0.03% 0.03% 0.03%"}, "model_tokens": {"rwkv": [[4423, " as", "normal", 0.9752819538116455]], "qwen": [[438, " as", "normal", 0.9950841069221497]]}, "loss": {"rwkv": 0.1496936993109886, "qwen": 0.02962327542236265}, "topk": {"rwkv": [4423, 1, 0.9752819538116455, [[4423, 0.975282, " as", false], [32227, 0.018731, " that", false], [4450, 0.000825, " by", false], [332, 0.000705, " a", false], [52224, 0.000447, " methods", false], [32448, 0.000371, " ways", false], [4419, 0.000331, " an", false], [4600, 0.000203, " is", false], [47284, 0.000203, " simple", false], [22590, 0.000202, " the", false]]], "qwen": [438, 1, 0.9950841069221497, [[438, 0.995084, " as", false], [429, 0.00189, " that", false], [264, 0.000488, " a", false], [5510, 0.000193, " ways", false], [7274, 0.000175, " thinking", false], [5413, 0.000133, " methods", false], [374, 9.6e-05, " is", false], [553, 8.8e-05, " by", false], [4285, 8.8e-05, " simple", false], [4460, 8.3e-05, " trying", false]]]}, "raw_delta": 0.006658118062963088, "tuned_delta": 0.013995256576665824}, {"byte_start": 6210, "byte_end": 6217, "display": {"text": " simple", "kind": "normal"}, "is_word": true, "word_id": 1043, "word_key": " simple", "bytes_hex": "20 73 69 6d 70 6c 65", "compression": {"rwkv": "8.98% 8.98% 8.98% 8.98% 8.98% 8.98% 8.98%", "qwen": "14.47% 14.47% 14.47% 14.47% 14.47% 14.47% 14.47%"}, "model_tokens": {"rwkv": [[47284, " simple", "normal", 0.030458124354481697]], "qwen": [[4285, " simple", "normal", 0.003632637206465006]]}, "loss": {"rwkv": 8.976590237674074, "qwen": 14.472798281025144}, "topk": {"rwkv": [47284, 6, 0.030458124354481697, [[4450, 0.187784, " by", false], [4596, 0.103162, " in", false], [22590, 0.082597, " the", false], [4404, 0.047952, " ``", false], [53140, 0.034104, " through", false], [47284, 0.030458, " simple", false], [55666, 0.02322, " building", false], [47629, 0.021969, " trying", false], [40085, 0.021514, " using", false], [38720, 0.017094, " human", false]]], "qwen": [4285, 37, 0.003632637206465006, [[279, 0.133687, " the", false], [4460, 0.052323, " trying", false], [553, 0.03949, " by", false], [304, 0.03373, " in", false], [7274, 0.031925, " thinking", false], [9902, 0.026922, " ``", false], [6540, 0.024552, " knowledge", false], [15039, 0.02171, " searching", false], [4752, 0.017244, " building", false], [3738, 0.016192, " human", false]]]}, "raw_delta": -0.30477448872157503, "tuned_delta": -0.2974373502078723}, {"byte_start": 6217, "byte_end": 6222, "display": {"text": " ways", "kind": "normal"}, "is_word": true, "word_id": 1044, "word_key": " ways", "bytes_hex": "20 77 61 79 73", "compression": {"rwkv": "12.62% 12.62% 12.62% 12.62% 12.62%", "qwen": "19.04% 19.04% 19.04% 19.04% 19.04%"}, "model_tokens": {"rwkv": [[32448, " ways", "normal", 0.030196072533726692]], "qwen": [[5510, " ways", "normal", 0.005097561050206423]]}, "loss": {"rwkv": 12.623581607778428, "qwen": 19.039943022871757}, "topk": {"rwkv": [32448, 6, 0.030196072533726692, [[65275, 0.088014, " representations", false], [46587, 0.072726, " models", false], [39558, 0.054941, " rules", false], [59943, 0.041793, " knowledge", false], [46658, 0.030701, " neural", false], [32448, 0.030196, " ways", false], [45, 0.029637, ",", false], [57375, 0.02267, " symbolic", false], [38720, 0.020683, " human", false], [46545, 0.015814, " mental", false]]], "qwen": [5510, 30, 0.005097561050206423, [[43613, 0.065501, " representations", false], [6540, 0.05868, " knowledge", false], [5601, 0.054789, " rules", false], [4119, 0.040498, " models", false], [35296, 0.029279, " symbolic", false], [11, 0.024659, ",", false], [24970, 0.017899, " theories", false], [4419, 0.016319, " features", false], [10502, 0.014763, " mental", false], [29728, 0.01381, " neural", false]]]}, "raw_delta": -0.35579862594604506, "tuned_delta": -0.34846148743234234}, {"byte_start": 6222, "byte_end": 6225, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 1045, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "1.15% 1.15% 1.15%", "qwen": "1.92% 1.92% 1.92%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.8262966275215149]], "qwen": [[311, " to", "normal", 0.7263924479484558]]}, "loss": {"rwkv": 1.1505868652923046, "qwen": 1.921578818909463}, "topk": {"rwkv": [4811, 1, 0.8262966275215149, [[4811, 0.826297, " to", false], [4706, 0.149473, " of", false], [21700, 0.014067, " for", false], [32227, 0.00323, " that", false], [4596, 0.002299, " in", false], [275, 0.000481, " (", false], [45, 0.000481, ",", false], [31296, 0.000384, " like", false], [37810, 0.000376, " based", false], [4858, 0.000257, " we", false]]], "qwen": [311, 1, 0.7263924479484558, [[311, 0.726392, " to", false], [315, 0.224225, " of", false], [429, 0.014931, " that", false], [304, 0.011929, " in", false], [369, 0.005449, " for", false], [3118, 0.004559, " based", false], [1119, 0.001091, " into", false], [11, 0.000979, ",", false], [1075, 0.000975, " like", false], [320, 0.00066, " (", false]]]}, "raw_delta": -0.042752871910730995, "tuned_delta": -0.03541573339702826}, {"byte_start": 6225, "byte_end": 6231, "display": {"text": " think", "kind": "normal"}, "is_word": true, "word_id": 1046, "word_key": " think", "bytes_hex": "20 74 68 69 6e 6b", "compression": {"rwkv": "6.34% 6.34% 6.34% 6.34% 6.34% 6.34%", "qwen": "4.14% 4.14% 4.14% 4.14% 4.14% 4.14%"}, "model_tokens": {"rwkv": [[39942, " think", "normal", 0.12134646624326706]], "qwen": [[1744, " think", "normal", 0.2525695562362671]]}, "loss": {"rwkv": 6.339968441406577, "qwen": 4.135931945218039}, "topk": {"rwkv": [39942, 2, 0.12134646624326706, [[60389, 0.133519, " represent", false], [39942, 0.121346, " think", false], [37923, 0.052185, " build", false], [55961, 0.051046, " describe", false], [22339, 0.039438, " put", false], [39043, 0.036304, " model", false], [45688, 0.03117, " define", false], [45854, 0.024355, " encode", false], [62683, 0.022214, " understand", false], [64276, 0.016644, " characterize", false]]], "qwen": [1744, 1, 0.2525695562362671, [[1744, 0.25257, " think", false], [4009, 0.241383, " represent", false], [16164, 0.048848, " encode", false], [7512, 0.036788, " describe", false], [1614, 0.031156, " model", false], [1936, 0.020897, " build", false], [3535, 0.020736, " understand", false], [12322, 0.013109, " capture", false], [3158, 0.012055, " express", false], [2415, 0.010918, " map", false]]]}, "raw_delta": 0.12221773465474449, "tuned_delta": 0.12955487316844722}, {"byte_start": 6231, "byte_end": 6237, "display": {"text": " about", "kind": "normal"}, "is_word": true, "word_id": 1047, "word_key": " about", "bytes_hex": "20 61 62 6f 75 74", "compression": {"rwkv": "0.21% 0.21% 0.21% 0.21% 0.21% 0.21%", "qwen": "0.26% 0.26% 0.26% 0.26% 0.26% 0.26%"}, "model_tokens": {"rwkv": [[37598, " about", "normal", 0.9315695762634277]], "qwen": [[911, " about", "normal", 0.9184801578521729]]}, "loss": {"rwkv": 0.21279986666758188, "qwen": 0.25558232016207766}, "topk": {"rwkv": [37598, 1, 0.9315695762634277, [[37598, 0.93157, " about", false], [4706, 0.037801, " of", false], [32227, 0.009826, " that", false], [4596, 0.00698, " in", false], [32464, 0.000889, " what", false], [31296, 0.000851, " like", false], [21835, 0.000692, " how", false], [21265, 0.000617, " and", false], [45, 0.000414, ",", false], [4858, 0.000378, " we", false]]], "qwen": [911, 1, 0.9184801578521729, [[911, 0.91848, " about", false], [315, 0.066512, " of", false], [304, 0.004573, " in", false], [429, 0.001382, " that", false], [1075, 0.000739, " like", false], [476, 0.000675, " or", false], [11, 0.00053, ",", false], [1246, 0.000372, " how", false], [279, 0.000333, " the", false], [323, 0.000302, " and", false]]]}, "raw_delta": -0.0023723629613717385, "tuned_delta": 0.004964775552330998}, {"byte_start": 6237, "byte_end": 6243, "display": {"text": " space", "kind": "normal"}, "is_word": true, "word_id": 1048, "word_key": " space", "bytes_hex": "20 73 70 61 63 65", "compression": {"rwkv": "21.79% 21.79% 21.79% 21.79% 21.79% 21.79%", "qwen": "23.57% 23.57% 23.57% 23.57% 23.57% 23.57%"}, "model_tokens": {"rwkv": [[39750, " space", "normal", 0.0007154013146646321]], "qwen": [[3550, " space", "normal", 0.00039288686821237206]]}, "loss": {"rwkv": 21.79070634676038, "qwen": 23.569997290113044}, "topk": {"rwkv": [39750, 117, 0.0007154013146646321, [[22590, 0.233173, " the", false], [21835, 0.136948, " how", false], [32464, 0.078844, " what", false], [38720, 0.043935, " human", false], [47732, 0.036514, " vision", false], [59943, 0.03212, " knowledge", false], [4404, 0.019466, " ``", false], [62300, 0.017582, " perception", false], [56529, 0.010885, " language", false], [332, 0.01021, " a", false]]], "qwen": [3550, 166, 0.00039288686821237206, [[279, 0.177559, " the", false], [1246, 0.083276, " how", false], [3738, 0.082368, " human", false], [6540, 0.076958, " knowledge", false], [11129, 0.057263, " vision", false], [1128, 0.055498, " what", false], [4244, 0.027448, " words", false], [4128, 0.024734, " language", false], [8806, 0.019701, " speech", false], [862, 0.016263, " their", false]]]}, "raw_delta": -0.09866484006245946, "tuned_delta": -0.09132770154875672}, {"byte_start": 6243, "byte_end": 6244, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "19.30%", "qwen": "16.97%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.3421191871166229]], "qwen": [[11, ",", "normal", 0.39013928174972534]]}, "loss": {"rwkv": 19.301681699393356, "qwen": 16.97423511080913}, "topk": {"rwkv": [45, 1, 0.3421191871166229, [[45, 0.342119, ",", false], [21265, 0.19502, " and", false], [4715, 0.193126, " or", false], [47, 0.144844, ".", false], [4596, 0.020364, " in", false], [275, 0.019517, " (", false], [4423, 0.017375, " as", false], [46, 0.007237, "-", false], [32227, 0.00532, " that", false], [5346, 0.005038, "---", false]]], "qwen": [11, 1, 0.39013928174972534, [[11, 0.390139, ",", false], [323, 0.262821, " and", false], [476, 0.154869, " or", false], [13, 0.087858, ".", false], [320, 0.025548, " (", false], [7246, 0.02115, "-time", false], [304, 0.019751, " in", false], [382, 0.007857, ".\n\n", false], [315, 0.003637, " of", false], [26, 0.003188, ";", false]]]}, "raw_delta": 0.1290610432624817, "tuned_delta": 0.13639818177618443}, {"byte_start": 6244, "byte_end": 6252, "display": {"text": " objects", "kind": "normal"}, "is_word": true, "word_id": 1049, "word_key": " objects", "bytes_hex": "20 6f 62 6a 65 63 74 73", "compression": {"rwkv": "10.57% 10.57% 10.57% 10.57% 10.57% 10.57% 10.57% 10.57%", "qwen": "11.01% 11.01% 11.01% 11.01% 11.01% 11.01% 11.01% 11.01%"}, "model_tokens": {"rwkv": [[52342, " objects", "normal", 0.009126161225140095]], "qwen": [[6171, " objects", "normal", 0.007564160972833633]]}, "loss": {"rwkv": 10.566614069010962, "qwen": 11.010318559321329}, "topk": {"rwkv": [52342, 11, 0.009126161225140095, [[4715, 0.364549, " or", false], [21265, 0.128043, " and", false], [47284, 0.102214, " simple", false], [37598, 0.056185, " about", false], [32251, 0.040379, " time", false], [32139, 0.031933, " such", false], [4423, 0.02324, " as", false], [4811, 0.017825, " to", false], [51018, 0.012152, " because", false], [31296, 0.009653, " like", false]]], "qwen": [6171, 12, 0.007564160972833633, [[476, 0.347496, " or", false], [882, 0.303176, " time", false], [323, 0.0296, " and", false], [911, 0.027436, " about", false], [4128, 0.022497, " language", false], [438, 0.018997, " as", false], [1894, 0.018668, " color", false], [1741, 0.016463, " such", false], [311, 0.013976, " to", false], [4285, 0.012753, " simple", false]]]}, "raw_delta": -0.024604201316833496, "tuned_delta": -0.01726706280313076}, {"byte_start": 6252, "byte_end": 6253, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "1.24%", "qwen": "0.86%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.9333276748657227]], "qwen": [[11, ",", "normal", 0.9531685709953308]]}, "loss": {"rwkv": 1.241577153108788, "qwen": 0.8649585266108387}, "topk": {"rwkv": [45, 1, 0.9333276748657227, [[45, 0.933328, ",", false], [21265, 0.035675, " and", false], [4715, 0.011996, " or", false], [4596, 0.011143, " in", false], [275, 0.001511, " (", false], [4706, 0.001208, " of", false], [32227, 0.000572, " that", false], [32487, 0.000505, " with", false], [4423, 0.000437, " as", false], [21643, 0.000333, " etc", false]]], "qwen": [11, 1, 0.9531685709953308, [[11, 0.953169, ",", false], [323, 0.025544, " and", false], [476, 0.008522, " or", false], [304, 0.007181, " in", false], [320, 0.001544, " (", false], [315, 0.000549, " of", false], [429, 0.000304, " that", false], [4992, 0.000284, " etc", false], [438, 0.000209, " as", false], [13, 0.000204, ".", false]]]}, "raw_delta": 0.02088417112827301, "tuned_delta": 0.028221309641975747}, {"byte_start": 6253, "byte_end": 6262, "display": {"text": " multiple", "kind": "normal"}, "is_word": true, "word_id": 1050, "word_key": " multiple", "bytes_hex": "20 6d 75 6c 74 69 70 6c 65", "compression": {"rwkv": "21.42% 21.42% 21.42% 21.42% 21.42% 21.42% 21.42% 21.42% 21.42%", "qwen": "21.59% 21.59% 21.59% 21.59% 21.59% 21.59% 21.59% 21.59% 21.59%"}, "model_tokens": {"rwkv": [[56679, " multiple", "normal", 2.3495298592024483e-05]], "qwen": [[5248, " multiple", "normal", 2.091510032187216e-05]]}, "loss": {"rwkv": 21.415004513195548, "qwen": 21.590409618810526}, "topk": {"rwkv": [56679, 795, 2.3495298592024483e-05, [[21265, 0.14862, " and", false], [4715, 0.125518, " or", false], [50851, 0.106239, " actions", false], [38604, 0.041454, " goals", false], [45909, 0.037262, " events", false], [21643, 0.031879, " etc", false], [46606, 0.024755, " motion", false], [61661, 0.023531, " categories", false], [55816, 0.021772, " concepts", false], [47184, 0.021755, " scenes", false]]], "qwen": [5248, 1010, 2.091510032187216e-05, [[476, 0.146282, " or", false], [323, 0.125577, " and", false], [882, 0.073682, " time", false], [4992, 0.044693, " etc", false], [4244, 0.041437, " words", false], [4357, 0.028706, " events", false], [4128, 0.028093, " language", false], [6168, 0.020604, " actions", false], [11379, 0.01876, " motion", false], [279, 0.016326, " the", false]]]}, "raw_delta": -0.009726524353027344, "tuned_delta": -0.002389385839324607}, {"byte_start": 6262, "byte_end": 6269, "display": {"text": " agents", "kind": "normal"}, "is_word": true, "word_id": 1051, "word_key": " agents", "bytes_hex": "20 61 67 65 6e 74 73", "compression": {"rwkv": "9.62% 9.62% 9.62% 9.62% 9.62% 9.62% 9.62%", "qwen": "3.37% 3.37% 3.37% 3.37% 3.37% 3.37% 3.37%"}, "model_tokens": {"rwkv": [[45124, " agents", "normal", 0.02382061630487442]], "qwen": [[13009, " agents", "normal", 0.27024340629577637]]}, "loss": {"rwkv": 9.62065052378522, "qwen": 3.3708369235203084}, "topk": {"rwkv": [45124, 3, 0.02382061630487442, [[52342, 0.696441, " objects", false], [46691, 0.034512, " object", false], [45124, 0.023821, " agents", false], [47539, 0.017023, " things", false], [38604, 0.010764, " goals", false], [46, 0.010403, "-", false], [56606, 0.010091, " meanings", false], [55816, 0.008463, " concepts", false], [65275, 0.008271, " representations", false], [61867, 0.006349, " dimensions", false]]], "qwen": [13009, 1, 0.27024340629577637, [[13009, 0.270243, " agents", false], [6171, 0.051458, " objects", false], [43613, 0.049531, " representations", false], [15336, 0.044358, " dimensions", false], [38455, 0.029288, " perspectives", false], [20062, 0.022272, " minds", false], [1251, 0.020611, " people", false], [2513, 0.018062, " things", false], [37107, 0.016936, " senses", false], [6194, 0.015997, " views", false]]]}, "raw_delta": 0.34656325408390604, "tuned_delta": 0.35390039259760875}, {"byte_start": 6269, "byte_end": 6270, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "2.87%", "qwen": "2.10%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.8532267212867737]], "qwen": [[11, ",", "normal", 0.8899271488189697]]}, "loss": {"rwkv": 2.8705968220813114, "qwen": 2.103010975907061}, "topk": {"rwkv": [45, 1, 0.8532267212867737, [[45, 0.853227, ",", false], [21265, 0.027403, " and", false], [63662, 0.026601, " interacting", false], [4596, 0.015871, " in", false], [47, 0.013555, ".", false], [4715, 0.010275, " or", false], [45094, 0.008728, " acting", false], [45580, 0.004688, " cooper", false], [21643, 0.00383, " etc", false], [53362, 0.003624, " working", false]]], "qwen": [11, 1, 0.8899271488189697, [[11, 0.889927, ",", false], [323, 0.024245, " and", false], [13, 0.015877, ".", false], [44730, 0.011038, " interacting", false], [304, 0.00927, " in", false], [476, 0.009064, " or", false], [6, 0.005501, "'", false], [448, 0.005398, " with", false], [4992, 0.005097, " etc", false], [320, 0.003637, " (", false]]]}, "raw_delta": 0.04256399720907211, "tuned_delta": 0.04990113572277485}, {"byte_start": 6270, "byte_end": 6273, "display": {"text": " or", "kind": "normal"}, "is_word": true, "word_id": 1052, "word_key": " or", "bytes_hex": "20 6f 72", "compression": {"rwkv": "13.34% 13.34% 13.34%", "qwen": "16.14% 16.14% 16.14%"}, "model_tokens": {"rwkv": [[4715, " or", "normal", 0.10893495380878448]], "qwen": [[476, " or", "normal", 0.06827627867460251]]}, "loss": {"rwkv": 13.337415091551614, "qwen": 16.135299082036887}, "topk": {"rwkv": [4715, 3, 0.10893495380878448, [[21643, 0.168282, " etc", false], [21265, 0.130906, " and", false], [4715, 0.108935, " or", false], [38604, 0.047593, " goals", false], [50851, 0.03606, " actions", false], [45432, 0.021087, " causal", false], [56529, 0.01665, " language", false], [32251, 0.012806, " time", false], [22590, 0.012435, " the", false], [45095, 0.011523, " action", false]]], "qwen": [476, 3, 0.06827627867460251, [[4992, 0.362629, " etc", false], [323, 0.112262, " and", false], [476, 0.068276, " or", false], [882, 0.028907, " time", false], [5248, 0.022951, " multiple", false], [4128, 0.018681, " language", false], [279, 0.014417, " the", false], [6540, 0.013399, " knowledge", false], [8845, 0.012834, " goals", false], [3738, 0.009357, " human", false]]]}, "raw_delta": -0.155147631963094, "tuned_delta": -0.14781049344939126}, {"byte_start": 6273, "byte_end": 6280, "display": {"text": " symmet", "kind": "normal"}, "is_word": true, "word_id": 1053, "word_key": " symmet", "bytes_hex": "20 73 79 6d 6d 65 74", "compression": {"rwkv": "25.44% 25.44% 25.44% 25.44% 25.44% 25.44% 25.44%", "qwen": "39.61% 39.61% 39.61% 39.61% 0.16% 0.16% 0.16%"}, "model_tokens": {"rwkv": [[47484, " symmet", "normal", 5.052498454460874e-05]], "qwen": [[7886, " sym", "normal", 0.00015302766405511647], [4059, "met", "normal", 0.9731724262237549]]}, "loss": {"rwkv": 25.440381301390207, "qwen": 22.702058773788}, "topk": {"rwkv": [47484, 969, 5.052498454460874e-05, [[30788, 0.078685, " even", false], [22590, 0.076452, " the", false], [45432, 0.03184, " causal", false], [38604, 0.029695, " goals", false], [47284, 0.026993, " simple", false], [39193, 0.025683, " other", false], [50851, 0.024819, " actions", false], [38720, 0.020936, " human", false], [56529, 0.019862, " language", false], [55816, 0.016114, " concepts", false]]], "qwen": [7886, 472, 0.00015302766405511647, [[279, 0.078277, " the", false], [1496, 0.069353, " even", false], [3738, 0.034636, " human", false], [1008, 0.032857, " other", false], [4128, 0.032166, " language", false], [5248, 0.025747, " multiple", false], [882, 0.020751, " time", false], [6540, 0.018177, " knowledge", false], [894, 0.017684, " any", false], [4113, 0.015942, " anything", false]]]}, "raw_delta": 0.15184484315770025, "tuned_delta": 0.159181981671403}, {"byte_start": 6280, "byte_end": 6284, "display": {"text": "ries", "kind": "normal"}, "is_word": true, "word_id": 1054, "word_key": "ries", "bytes_hex": "72 69 65 73", "compression": {"rwkv": "0.01% 0.01% 0.01% 0.01%", "qwen": "0.00% 0.00% 0.00% 0.00%"}, "model_tokens": {"rwkv": [[26892, "ries", "normal", 0.9985963702201843]], "qwen": [[4019, "ries", "normal", 0.9997239708900452]]}, "loss": {"rwkv": 0.006294565021578795, "qwen": 0.0012445526786539558}, "topk": {"rwkv": [26892, 1, 0.9985963702201843, [[26892, 0.998596, "ries", false], [8623, 0.000666, "riz", false], [7789, 0.000275, "ies", false], [122, 7.9e-05, "y", false], [1939, 6.6e-05, "ic", false], [8619, 3e-05, "ris", false], [26910, 3e-05, "rise", false], [8608, 3e-05, "rie", false], [8562, 1.6e-05, "ral", false], [2159, 1.3e-05, "ri", false]]], "qwen": [4019, 1, 0.9997239708900452, [[4019, 0.999724, "ries", false], [81, 8.5e-05, "r", false], [7231, 2.8e-05, "rie", false], [4543, 2.7e-05, "tries", false], [550, 1.7e-05, "ies", false], [5963, 1.5e-05, "ris", false], [461, 1.3e-05, "ri", false], [1539, 7e-06, "try", false], [376, 6e-06, "tr", false], [25610, 5e-06, "rons", false]]]}, "raw_delta": 0.0002800321453833021, "tuned_delta": 0.007617170659086039}, {"byte_start": 6284, "byte_end": 6285, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "9.93%", "qwen": "12.28%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.5768051147460938]], "qwen": [[13, ".", "normal", 0.5062693953514099]]}, "loss": {"rwkv": 9.932617224870304, "qwen": 12.275286427839026}, "topk": {"rwkv": [47, 1, 0.5768051147460938, [[47, 0.576805, ".", false], [45, 0.290256, ",", false], [4706, 0.02608, " of", false], [4596, 0.025316, " in", false], [60, 0.016649, ";", false], [21265, 0.013815, " and", false], [4715, 0.013222, " or", false], [275, 0.011696, " (", false], [5346, 0.00602, "---", false], [32227, 0.003859, " that", false]]], "qwen": [13, 1, 0.5062693953514099, [[13, 0.506269, ".", false], [11, 0.235655, ",", false], [382, 0.050041, ".\n\n", false], [323, 0.049627, " and", false], [476, 0.036576, " or", false], [304, 0.02841, " in", false], [315, 0.025678, " of", false], [4421, 0.014913, "---", false], [26, 0.014688, ";", false], [320, 0.012269, " (", false]]]}, "raw_delta": -0.12990516424179077, "tuned_delta": -0.12256802572808803}, {"byte_start": 6285, "byte_end": 6289, "display": {"text": " All", "kind": "normal"}, "is_word": true, "word_id": 1055, "word_key": " all", "bytes_hex": "20 41 6c 6c", "compression": {"rwkv": "20.99% 20.99% 20.99% 20.99%", "qwen": "19.97% 19.97% 19.97% 19.97%"}, "model_tokens": {"rwkv": [[19407, " All", "normal", 0.009454779326915741]], "qwen": [[2009, " All", "normal", 0.011931069195270538]]}, "loss": {"rwkv": 20.99233995043511, "qwen": 19.966039930760708}, "topk": {"rwkv": [19407, 16, 0.009454779326915741, [[20996, 0.16562, " The", false], [4331, 0.110095, " We", false], [37453, 0.057347, " These", false], [29894, 0.050447, " This", false], [50342, 0.050221, " Instead", false], [261, 0.040863, "\n\n", false], [3918, 0.032445, " It", false], [37451, 0.030086, " There", false], [3913, 0.028734, " In", false], [29834, 0.022689, " Such", false]]], "qwen": [2009, 15, 0.011931069195270538, [[576, 0.137482, " The", false], [1205, 0.108703, " We", false], [12090, 0.078001, " Instead", false], [1096, 0.065582, " This", false], [4220, 0.051513, " These", false], [1084, 0.039099, " It", false], [758, 0.025056, " In", false], [2619, 0.024796, " There", false], [15132, 0.024106, " Such", false], [1416, 0.021449, " If", false]]]}, "raw_delta": 0.056910157203674316, "tuned_delta": 0.06424729571737706}, {"byte_start": 6289, "byte_end": 6295, "display": {"text": " these", "kind": "normal"}, "is_word": true, "word_id": 1056, "word_key": " these", "bytes_hex": "20 74 68 65 73 65", "compression": {"rwkv": "4.25% 4.25% 4.25% 4.25% 4.25% 4.25%", "qwen": "4.02% 4.02% 4.02% 4.02% 4.02% 4.02%"}, "model_tokens": {"rwkv": [[39936, " these", "normal", 0.2438395619392395]], "qwen": [[1493, " these", "normal", 0.26273828744888306]]}, "loss": {"rwkv": 4.250126992202187, "qwen": 4.0172950879781695}, "topk": {"rwkv": [39936, 2, 0.2438395619392395, [[4706, 0.33131, " of", false], [39936, 0.24384, " these", false], [32139, 0.113905, " such", false], [22590, 0.071002, " the", false], [32234, 0.036246, " this", false], [39944, 0.031499, " those", false], [32227, 0.018973, " that", false], [22248, 0.016006, " our", false], [4858, 0.015094, " we", false], [38720, 0.008961, " human", false]]], "qwen": [1493, 2, 0.26273828744888306, [[315, 0.365524, " of", false], [1493, 0.262738, " these", false], [1741, 0.059072, " such", false], [279, 0.050706, " the", false], [419, 0.038164, " this", false], [429, 0.035941, " that", false], [582, 0.032031, " we", false], [1846, 0.029898, " those", false], [1039, 0.023221, " our", false], [13553, 0.009483, " attempts", false]]]}, "raw_delta": 0.012910942236582457, "tuned_delta": 0.020248080750285193}, {"byte_start": 6295, "byte_end": 6299, "display": {"text": " are", "kind": "normal"}, "is_word": true, "word_id": 1057, "word_key": " are", "bytes_hex": "20 61 72 65", "compression": {"rwkv": "7.11% 7.11% 7.11% 7.11%", "qwen": "7.74% 7.74% 7.74% 7.74%"}, "model_tokens": {"rwkv": [[21286, " are", "normal", 0.20627470314502716]], "qwen": [[525, " are", "normal", 0.17949646711349487]]}, "loss": {"rwkv": 7.114853473134048, "qwen": 7.743664502905407}, "topk": {"rwkv": [21286, 1, 0.20627470314502716, [[21286, 0.206275, " are", false], [47539, 0.129968, " things", false], [47284, 0.080017, " simple", false], [32448, 0.039883, " ways", false], [61590, 0.036222, " approaches", false], [51566, 0.031937, " efforts", false], [38735, 0.031696, " ideas", false], [55572, 0.029944, " attempts", false], [52326, 0.028261, " notions", false], [55816, 0.023095, " concepts", false]]], "qwen": [525, 1, 0.17949646711349487, [[525, 0.179496, " are", false], [2513, 0.14278, " things", false], [4285, 0.083813, " simple", false], [614, 0.033614, " have", false], [18940, 0.026301, " concepts", false], [6708, 0.024537, " ideas", false], [58582, 0.022189, " notions", false], [5510, 0.021111, " ways", false], [2803, 0.020764, " seem", false], [13553, 0.019804, " attempts", false]]]}, "raw_delta": -0.03486868739128113, "tuned_delta": -0.02753154887757839}, {"byte_start": 6299, "byte_end": 6304, "display": {"text": " part", "kind": "normal"}, "is_word": true, "word_id": 1058, "word_key": " part", "bytes_hex": "20 70 61 72 74", "compression": {"rwkv": "20.63% 20.63% 20.63% 20.63% 20.63%", "qwen": "17.79% 17.79% 17.79% 17.79% 17.79%"}, "model_tokens": {"rwkv": [[31633, " part", "normal", 0.003264595055952668]], "qwen": [[949, " part", "normal", 0.00720400782302022]]}, "loss": {"rwkv": 20.626030662709397, "qwen": 17.79246170535885}, "topk": {"rwkv": [31633, 55, 0.003264595055952668, [[32386, 0.057129, " very", false], [51258, 0.040381, " complex", false], [47284, 0.039417, " simple", false], [22614, 0.036206, " too", false], [59829, 0.032996, " important", false], [32448, 0.024985, " ways", false], [47687, 0.0205, " useful", false], [59699, 0.017606, " extremely", false], [30992, 0.017008, " good", false], [47539, 0.015304, " things", false]]], "qwen": [949, 26, 0.00720400782302022, [[5390, 0.053922, " useful", false], [4285, 0.028505, " simple", false], [6351, 0.027971, " complex", false], [1602, 0.026334, " very", false], [2238, 0.025342, " too", false], [2989, 0.023064, " important", false], [1101, 0.019092, " just", false], [2244, 0.016302, " great", false], [9016, 0.016134, " extremely", false], [1661, 0.015528, " good", false]]]}, "raw_delta": 0.15712642669677734, "tuned_delta": 0.16446356521048008}, {"byte_start": 6304, "byte_end": 6307, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 1059, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "0.07% 0.07% 0.07%", "qwen": "0.11% 0.11% 0.11%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.9886198043823242]], "qwen": [[315, " of", "normal", 0.9824559688568115]]}, "loss": {"rwkv": 0.06934340482788444, "qwen": 0.10639722371129687}, "topk": {"rwkv": [4706, 1, 0.9886198043823242, [[4706, 0.98862, " of", false], [21265, 0.007997, " and", false], [46, 0.000928, "-", false], [45, 0.000809, ",", false], [22590, 0.000305, " the", false], [275, 0.000103, " (", false], [4596, 9.4e-05, " in", false], [38720, 6.5e-05, " human", false], [4715, 6.2e-05, " or", false], [32464, 4.4e-05, " what", false]]], "qwen": [315, 1, 0.9824559688568115, [[315, 0.982456, " of", false], [323, 0.012155, " and", false], [11, 0.002275, ",", false], [9777, 0.000429, "-and", false], [4421, 0.000221, "---", false], [6351, 0.000212, " complex", false], [320, 0.000203, " (", false], [714, 0.000132, " but", false], [279, 0.000132, " the", false], [476, 0.000102, " or", false]]]}, "raw_delta": -0.002054700007041295, "tuned_delta": 0.0052824385066614415}, {"byte_start": 6307, "byte_end": 6311, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 1060, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "2.62% 2.62% 2.62% 2.62%", "qwen": "2.77% 2.77% 2.77% 2.77%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.5518704652786255]], "qwen": [[279, " the", "normal", 0.5408031344413757]]}, "loss": {"rwkv": 2.6240424938043887, "qwen": 2.7713270923888382}, "topk": {"rwkv": [22590, 1, 0.5518704652786255, [[22590, 0.55187, " the", false], [32464, 0.081082, " what", false], [22248, 0.049199, " our", false], [38720, 0.042775, " human", false], [332, 0.034769, " a", false], [39026, 0.034717, " minds", false], [21835, 0.032961, " how", false], [52652, 0.025567, " reality", false], [51258, 0.014128, " complex", false], [57419, 0.012332, " thinking", false]]], "qwen": [279, 1, 0.5408031344413757, [[279, 0.540803, " the", false], [1039, 0.075508, " our", false], [1128, 0.062604, " what", false], [3738, 0.043597, " human", false], [20062, 0.042312, " minds", false], [264, 0.041211, " a", false], [3971, 0.020199, " mind", false], [6351, 0.016703, " complex", false], [1246, 0.009529, " how", false], [4586, 0.008416, " general", false]]]}, "raw_delta": -0.008167192339897156, "tuned_delta": -0.0008300538261944192}, {"byte_start": 6311, "byte_end": 6321, "display": {"text": " arbitrary", "kind": "normal"}, "is_word": true, "word_id": 1061, "word_key": " arbitrary", "bytes_hex": "20 61 72 62 69 74 72 61 72 79", "compression": {"rwkv": "18.60% 18.60% 18.60% 18.60% 18.60% 18.60% 18.60% 18.60% 18.60% 18.60%", "qwen": "18.48% 18.48% 18.48% 18.48% 18.48% 18.48% 18.48% 18.48% 18.48% 18.48%"}, "model_tokens": {"rwkv": [[59163, " arbitrary", "normal", 3.2954776543192565e-05]], "qwen": [[24168, " arbitrary", "normal", 3.55418051185552e-05]]}, "loss": {"rwkv": 18.597240761459293, "qwen": 18.475153717264796}, "topk": {"rwkv": [59163, 989, 3.2954776543192565e-05, [[61720, 0.189838, " complexity", false], [55847, 0.125843, " contents", false], [31427, 0.064222, " mind", false], [38720, 0.061051, " human", false], [51258, 0.034489, " complex", false], [52569, 0.034392, " problem", false], [31835, 0.029809, " real", false], [45098, 0.02618, " actual", false], [51308, 0.024316, " content", false], [22752, 0.023266, " way", false]]], "qwen": [24168, 1218, 3.55418051185552e-05, [[23094, 0.230235, " complexity", false], [3971, 0.082195, " mind", false], [6351, 0.044407, " complex", false], [3738, 0.025924, " human", false], [8794, 0.024136, " contents", false], [5042, 0.021258, " actual", false], [3491, 0.020376, " problem", false], [20062, 0.020193, " minds", false], [88930, 0.0185, " richness", false], [2213, 0.016962, " content", false]]]}, "raw_delta": 0.006769943237304732, "tuned_delta": 0.014107081751007469}, {"byte_start": 6321, "byte_end": 6322, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "44.24%", "qwen": "36.15%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.08709270507097244]], "qwen": [[11, ",", "normal", 0.13471338152885437]]}, "loss": {"rwkv": 44.23889090225922, "qwen": 36.15043504345827}, "topk": {"rwkv": [45, 2, 0.08709270507097244, [[61720, 0.559498, " complexity", false], [45, 0.087093, ",", false], [60572, 0.027163, " structure", false], [21265, 0.0266, " and", false], [64294, 0.023058, " complexities", false], [55847, 0.020693, " contents", false], [51308, 0.014577, " content", false], [46642, 0.011248, " nature", false], [22752, 0.009168, " way", false], [38720, 0.008917, " human", false]]], "qwen": [11, 2, 0.13471338152885437, [[23094, 0.148095, " complexity", false], [11, 0.134713, ",", false], [323, 0.055262, " and", false], [5944, 0.043879, " structure", false], [3738, 0.041658, " human", false], [15491, 0.030826, " simpl", false], [3565, 0.021551, " details", false], [10502, 0.014835, " mental", false], [2213, 0.014607, " content", false], [6993, 0.014223, " nature", false]]]}, "raw_delta": 0.448519229888916, "tuned_delta": 0.45585636840261873}, {"byte_start": 6322, "byte_end": 6336, "display": {"text": " intrinsically", "kind": "normal"}, "is_word": true, "word_id": 1062, "word_key": " intrinsically", "bytes_hex": "20 69 6e 74 72 69 6e 73 69 63 61 6c 6c 79", "compression": {"rwkv": "10.76% 10.76% 10.76% 10.76% 10.76% 10.76% 10.76% 10.76% 10.76% 10.76% 6.52% 6.52% 6.52% 6.52%", "qwen": "30.80% 30.80% 30.80% 30.80% 30.80% 0.10% 0.10% 0.10% 0.00% 0.00% 0.00% 0.00% 0.00% 0.00%"}, "model_tokens": {"rwkv": [[59914, " intrinsic", "normal", 0.00257006729952991], [24525, "ally", "normal", 0.2388787418603897]], "qwen": [[10582, " intr", "normal", 0.00019538900232873857], [1330, "ins", "normal", 0.9828972220420837], [2673, "ically", "normal", 0.9994437098503113]]}, "loss": {"rwkv": 9.55020642999181, "qwen": 11.024154460112934}, "topk": {"rwkv": [59914, 41, 0.00257006729952991, [[51258, 0.168112, " complex", false], [38720, 0.120729, " human", false], [39011, 0.039742, " messy", false], [63366, 0.037008, " complicated", false], [21265, 0.023765, " and", false], [62590, 0.013957, " subjective", false], [21400, 0.012166, " but", false], [22184, 0.012023, " non", false], [31170, 0.011246, " irre", false], [47284, 0.009976, " simple", false]]], "qwen": [10582, 561, 0.00019538900232873857, [[24870, 0.118122, " irre", false], [6351, 0.08494, " complex", false], [3738, 0.072046, " human", false], [323, 0.033334, " and", false], [714, 0.015954, " but", false], [650, 0.015624, " un", false], [16965, 0.01198, " complicated", false], [877, 0.011912, " id", false], [45846, 0.010069, " messy", false], [24168, 0.009484, " arbitrary", false]]]}, "raw_delta": -0.08173303370962712, "tuned_delta": -0.07439589519592438}, {"byte_start": 6336, "byte_end": 6344, "display": {"text": "-complex", "kind": "normal"}, "is_word": true, "word_id": 1063, "word_key": "-complex", "bytes_hex": "2d 63 6f 6d 70 6c 65 78", "compression": {"rwkv": "73.26% 1.90% 1.90% 1.90% 1.90% 1.90% 1.90% 1.90%", "qwen": "21.28% 21.28% 21.28% 21.28% 0.08% 0.08% 0.08% 0.08%"}, "model_tokens": {"rwkv": [[46, "-", "normal", 0.017100265249609947], [48997, "complex", "normal", 0.48026081919670105]], "qwen": [[11476, "-com", "normal", 0.008921952918171883], [9111, "plex", "normal", 0.9829851984977722]]}, "loss": {"rwkv": 10.82197390901206, "qwen": 10.676848137768228}, "topk": {"rwkv": [46, 8, 0.017100265249609947, [[51258, 0.392322, " complex", false], [63366, 0.07073, " complicated", false], [39011, 0.063155, " messy", false], [59516, 0.038032, " difficult", false], [38720, 0.033667, " human", false], [31048, 0.02772, " hard", false], [38797, 0.017816, " intra", false], [46, 0.0171, "-", false], [63667, 0.013607, " interesting", false], [47284, 0.012087, " simple", false]]], "qwen": [11476, 9, 0.008921952918171883, [[6351, 0.474555, " complex", false], [16965, 0.050957, " complicated", false], [5000, 0.04705, " difficult", false], [83544, 0.027861, " unknow", false], [650, 0.021079, " un", false], [2588, 0.018002, " hard", false], [24870, 0.01069, " irre", false], [3738, 0.009019, " human", false], [11476, 0.008922, "-com", false], [55926, 0.007587, " meaningless", false]]]}, "raw_delta": 0.008047481533139944, "tuned_delta": 0.01538462004684268}, {"byte_start": 6344, "byte_end": 6345, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "45.65%", "qwen": "37.66%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.08097254484891891]], "qwen": [[11, ",", "normal", 0.12389146536588669]]}, "loss": {"rwkv": 45.647772778127354, "qwen": 37.66064049808222}, "topk": {"rwkv": [45, 4, 0.08097254484891891, [[55847, 0.368191, " contents", false], [46642, 0.144451, " nature", false], [60572, 0.091373, " structure", false], [45, 0.080973, ",", false], [51308, 0.060029, " content", false], [38720, 0.013545, " human", false], [61720, 0.013356, " complexity", false], [52652, 0.011121, " reality", false], [56480, 0.010663, " internal", false], [46, 0.007485, "-", false]]], "qwen": [11, 1, 0.12389146536588669, [[11, 0.123891, ",", false], [8794, 0.092671, " contents", false], [6993, 0.071234, " nature", false], [5944, 0.060559, " structure", false], [1879, 0.058331, " world", false], [2213, 0.033085, " content", false], [3971, 0.03014, " mind", false], [10502, 0.023869, " mental", false], [323, 0.022605, " and", false], [20062, 0.01616, " minds", false]]]}, "raw_delta": 0.4429006576538086, "tuned_delta": 0.4502377961675113}, {"byte_start": 6345, "byte_end": 6353, "display": {"text": " outside", "kind": "normal"}, "is_word": true, "word_id": 1064, "word_key": " outside", "bytes_hex": "20 6f 75 74 73 69 64 65", "compression": {"rwkv": "23.95% 23.95% 23.95% 23.95% 23.95% 23.95% 23.95% 23.95%", "qwen": "21.42% 21.42% 21.42% 21.42% 21.42% 21.42% 21.42% 21.42%"}, "model_tokens": {"rwkv": [[52391, " outside", "normal", 2.4207374735851772e-05]], "qwen": [[4889, " outside", "normal", 7.482973160222173e-05]]}, "loss": {"rwkv": 23.95099188975818, "qwen": 21.41567094596764}, "topk": {"rwkv": [52391, 1737, 2.4207374735851772e-05, [[55847, 0.092141, " contents", false], [21265, 0.066423, " and", false], [38720, 0.055793, " human", false], [60572, 0.032053, " structure", false], [39011, 0.031904, " messy", false], [46642, 0.026401, " nature", false], [51308, 0.02518, " content", false], [56480, 0.021106, " internal", false], [31835, 0.020792, " real", false], [63682, 0.020069, " irreducible", false]]], "qwen": [4889, 960, 7.482973160222173e-05, [[24870, 0.181912, " irre", false], [323, 0.08592, " and", false], [3971, 0.045985, " mind", false], [3738, 0.029883, " human", false], [20062, 0.022767, " minds", false], [8794, 0.020036, " contents", false], [1931, 0.011558, " real", false], [2213, 0.010374, " content", false], [10502, 0.008828, " mental", false], [7548, 0.008385, " highly", false]]]}, "raw_delta": 0.14058804512023926, "tuned_delta": 0.147925183633942}, {"byte_start": 6353, "byte_end": 6359, "display": {"text": " world", "kind": "normal"}, "is_word": true, "word_id": 1065, "word_key": " world", "bytes_hex": "20 77 6f 72 6c 64", "compression": {"rwkv": "6.39% 6.39% 6.39% 6.39% 6.39% 6.39%", "qwen": "3.07% 3.07% 3.07% 3.07% 3.07% 3.07%"}, "model_tokens": {"rwkv": [[40213, " world", "normal", 0.12151630222797394]], "qwen": [[1879, " world", "normal", 0.3606451451778412]]}, "loss": {"rwkv": 6.386931170602182, "qwen": 3.065308771741586}, "topk": {"rwkv": [40213, 2, 0.12151630222797394, [[46, 0.661598, "-", false], [40213, 0.121516, " world", false], [22590, 0.019796, " the", false], [52652, 0.016935, " reality", false], [4706, 0.016761, " of", false], [46642, 0.012924, " nature", false], [63536, 0.011069, " environment", false], [63637, 0.006784, " information", false], [60572, 0.006285, " structure", false], [32398, 0.006103, " view", false]]], "qwen": [1879, 1, 0.3606451451778412, [[1879, 0.360645, " world", false], [10603, 0.193052, "-the", false], [315, 0.051654, " of", false], [30084, 0.041532, "-world", false], [279, 0.03997, " the", false], [8729, 0.039052, " reality", false], [11, 0.023874, ",", false], [8668, 0.017669, "-of", false], [7947, 0.014426, " domain", false], [12, 0.006347, "-", false]]]}, "raw_delta": 0.1841898560523987, "tuned_delta": 0.19152699456610145}, {"byte_start": 6359, "byte_end": 6360, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "19.44%", "qwen": "32.75%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.33790165185928345]], "qwen": [[13, ".", "normal", 0.16265623271465302]]}, "loss": {"rwkv": 19.44256988698017, "qwen": 32.751273191564614}, "topk": {"rwkv": [47, 1, 0.33790165185928345, [[47, 0.337902, ".", false], [45, 0.240342, ",", false], [32227, 0.111731, " that", false], [4706, 0.060144, " of", false], [4858, 0.055727, " we", false], [60, 0.038773, ";", false], [5346, 0.031326, "---", false], [21265, 0.027216, " and", false], [4596, 0.020275, " in", false], [4811, 0.009836, " to", false]]], "qwen": [13, 3, 0.16265623271465302, [[11, 0.304169, ",", false], [429, 0.212047, " that", false], [13, 0.162656, ".", false], [315, 0.073421, " of", false], [582, 0.04008, " we", false], [323, 0.037262, " and", false], [304, 0.03095, " in", false], [26, 0.019891, ";", false], [382, 0.013724, ".\n\n", false], [4421, 0.011087, "---", false]]]}, "raw_delta": -0.737991213798523, "tuned_delta": -0.7306540752848202}, {"byte_start": 6360, "byte_end": 6365, "display": {"text": " They", "kind": "normal"}, "is_word": true, "word_id": 1066, "word_key": " they", "bytes_hex": "20 54 68 65 79", "compression": {"rwkv": "10.65% 10.65% 10.65% 10.65% 10.65%", "qwen": "11.05% 11.05% 11.05% 11.05% 11.05%"}, "model_tokens": {"rwkv": [[29893, " They", "normal", 0.052063412964344025]], "qwen": [[2379, " They", "normal", 0.046690043061971664]]}, "loss": {"rwkv": 10.651146981563048, "qwen": 11.051852799461324}, "topk": {"rwkv": [29893, 3, 0.052063412964344025, [[20996, 0.167592, " The", false], [4331, 0.125362, " We", false], [29893, 0.052063, " They", false], [50342, 0.037181, " Instead", false], [30031, 0.036277, " What", false], [261, 0.036057, "\n\n", false], [19555, 0.034961, " But", false], [3918, 0.032141, " It", false], [37451, 0.027166, " There", false], [20571, 0.026627, " Our", false]]], "qwen": [2379, 3, 0.046690043061971664, [[576, 0.16355, " The", false], [1205, 0.103303, " We", false], [2379, 0.04669, " They", false], [1084, 0.039729, " It", false], [12090, 0.027401, " Instead", false], [2619, 0.024403, " There", false], [2014, 0.023697, " To", false], [758, 0.022879, " In", false], [1416, 0.022751, " If", false], [1597, 0.022629, " And", false]]]}, "raw_delta": -0.022219848632812567, "tuned_delta": -0.01488271011910983}, {"byte_start": 6365, "byte_end": 6369, "display": {"text": " are", "kind": "normal"}, "is_word": true, "word_id": 1067, "word_key": " are", "bytes_hex": "20 61 72 65", "compression": {"rwkv": "3.08% 3.08% 3.08% 3.08%", "qwen": "2.57% 2.57% 2.57% 2.57%"}, "model_tokens": {"rwkv": [[21286, " are", "normal", 0.5015393495559692]], "qwen": [[525, " are", "normal", 0.5650731921195984]]}, "loss": {"rwkv": 3.0819291034615306, "qwen": 2.5734070392698905}, "topk": {"rwkv": [21286, 1, 0.5015393495559692, [[21286, 0.501539, " are", false], [4491, 0.077681, " do", false], [47266, 0.054977, " should", false], [31059, 0.048038, " have", false], [21413, 0.040852, " can", false], [45409, 0.038683, " cannot", false], [22074, 0.019346, " may", false], [21256, 0.015873, " all", false], [32475, 0.015828, " will", false], [31506, 0.011301, " need", false]]], "qwen": [525, 1, 0.5650731921195984, [[525, 0.565073, " are", false], [653, 0.050742, " do", false], [614, 0.046284, " have", false], [646, 0.043862, " can", false], [1265, 0.041158, " should", false], [1231, 0.027971, " may", false], [4157, 0.024155, " cannot", false], [3000, 0.012619, " exist", false], [1969, 0.011286, " must", false], [1184, 0.011214, " need", false]]]}, "raw_delta": 0.028198450803756714, "tuned_delta": 0.035535589317459454}, {"byte_start": 6369, "byte_end": 6373, "display": {"text": " not", "kind": "normal"}, "is_word": true, "word_id": 1068, "word_key": " not", "bytes_hex": "20 6e 6f 74", "compression": {"rwkv": "5.71% 5.71% 5.71% 5.71%", "qwen": "5.43% 5.43% 5.43% 5.43%"}, "model_tokens": {"rwkv": [[22187, " not", "normal", 0.28315263986587524]], "qwen": [[537, " not", "normal", 0.29971134662628174]]}, "loss": {"rwkv": 5.705971597265919, "qwen": 5.4323574112130855}, "topk": {"rwkv": [22187, 1, 0.28315263986587524, [[22187, 0.283153, " not", false], [31633, 0.052959, " part", false], [21256, 0.046857, " all", false], [22590, 0.046311, " the", false], [332, 0.016409, " a", false], [31198, 0.013404, " just", false], [31296, 0.012964, " like", false], [45, 0.012488, ",", false], [32464, 0.011116, " what", false], [47687, 0.010121, " useful", false]]], "qwen": [537, 1, 0.29971134662628174, [[537, 0.299711, " not", false], [949, 0.055794, " part", false], [279, 0.04706, " the", false], [678, 0.025093, " all", false], [1101, 0.018226, " just", false], [1128, 0.015271, " what", false], [1172, 0.014496, " only", false], [5390, 0.012231, " useful", false], [11, 0.010814, ",", false], [2513, 0.010723, " things", false]]]}, "raw_delta": 0.015172392129898071, "tuned_delta": 0.022509530643600808}, {"byte_start": 6373, "byte_end": 6378, "display": {"text": " what", "kind": "normal"}, "is_word": true, "word_id": 1069, "word_key": " what", "bytes_hex": "20 77 68 61 74", "compression": {"rwkv": "16.68% 16.68% 16.68% 16.68% 16.68%", "qwen": "13.71% 13.71% 13.71% 13.71% 13.71%"}, "model_tokens": {"rwkv": [[32464, " what", "normal", 0.009767157025635242]], "qwen": [[1128, " what", "normal", 0.022369293496012688]]}, "loss": {"rwkv": 16.681161410278637, "qwen": 13.705840912433946}, "topk": {"rwkv": [32464, 13, 0.009767157025635242, [[31633, 0.125699, " part", false], [22590, 0.104922, " the", false], [59914, 0.099353, " intrinsic", false], [47284, 0.045616, " simple", false], [45, 0.026272, ",", false], [4596, 0.021291, " in", false], [47539, 0.016635, " things", false], [63591, 0.013779, " fundamental", false], [332, 0.012337, " a", false], [4811, 0.011596, " to", false]]], "qwen": [1128, 5, 0.022369293496012688, [[949, 0.257528, " part", false], [279, 0.149537, " the", false], [304, 0.03459, " in", false], [4766, 0.029046, " inside", false], [1128, 0.022369, " what", false], [46601, 0.018088, " intrinsic", false], [11, 0.013909, ",", false], [4285, 0.012322, " simple", false], [264, 0.011966, " a", false], [9902, 0.011239, " ``", false]]]}, "raw_delta": 0.164986801147461, "tuned_delta": 0.17232393966116374}, {"byte_start": 6378, "byte_end": 6385, "display": {"text": " should", "kind": "normal"}, "is_word": true, "word_id": 1070, "word_key": " should", "bytes_hex": "20 73 68 6f 75 6c 64", "compression": {"rwkv": "12.00% 12.00% 12.00% 12.00% 12.00% 12.00% 12.00%", "qwen": "16.70% 16.70% 16.70% 16.70% 16.70% 16.70% 16.70%"}, "model_tokens": {"rwkv": [[47266, " should", "normal", 0.009509346447885036]], "qwen": [[1265, " should", "normal", 0.0015293064061552286]]}, "loss": {"rwkv": 11.99562282882006, "qwen": 16.701618500909266}, "topk": {"rwkv": [47266, 15, 0.009509346447885036, [[4858, 0.245569, " we", false], [4600, 0.137036, " is", false], [39026, 0.12414, " minds", false], [22590, 0.097321, " the", false], [3609, 0.038226, " AI", false], [38964, 0.023178, " makes", false], [21286, 0.016222, " are", false], [52201, 0.014551, " matters", false], [22248, 0.01279, " our", false], [31358, 0.01176, " make", false]]], "qwen": [1265, 39, 0.0015293064061552286, [[279, 0.238696, " the", false], [582, 0.149782, " we", false], [374, 0.120309, " is", false], [20062, 0.100219, " minds", false], [1039, 0.050444, " our", false], [3643, 0.0339, " makes", false], [432, 0.024385, " it", false], [5780, 0.018558, " goes", false], [12677, 0.015993, " humans", false], [264, 0.011859, " a", false]]]}, "raw_delta": -0.260955810546875, "tuned_delta": -0.2536186720331723}, {"byte_start": 6385, "byte_end": 6388, "display": {"text": " be", "kind": "normal"}, "is_word": true, "word_id": 1071, "word_key": " be", "bytes_hex": "20 62 65", "compression": {"rwkv": "0.91% 0.91% 0.91%", "qwen": "1.14% 1.14% 1.14%"}, "model_tokens": {"rwkv": [[4435, " be", "normal", 0.8579688668251038]], "qwen": [[387, " be", "normal", 0.8268448710441589]]}, "loss": {"rwkv": 0.9099028781648327, "qwen": 1.1429644508871892}, "topk": {"rwkv": [4435, 1, 0.8579688668251038, [[4435, 0.857969, " be", false], [46530, 0.01667, " matter", false], [38306, 0.015391, " drive", false], [38649, 0.012407, " guide", false], [51273, 0.008099, " concern", false], [4715, 0.005676, " or", false], [38377, 0.004288, " enter", false], [46286, 0.003808, " inform", false], [56675, 0.003457, " motivate", false], [4559, 0.003118, " go", false]]], "qwen": [387, 1, 0.8268448710441589, [[387, 0.826845, " be", false], [8474, 0.029989, " guide", false], [6541, 0.017479, " drive", false], [6051, 0.009878, " inform", false], [728, 0.00861, " go", false], [4925, 0.007859, " matter", false], [8253, 0.007208, " determine", false], [61325, 0.005009, " motivate", false], [6979, 0.004122, " define", false], [1281, 0.003884, " make", false]]]}, "raw_delta": -0.012923677762349449, "tuned_delta": -0.005586539248646712}, {"byte_start": 6388, "byte_end": 6394, "display": {"text": " built", "kind": "normal"}, "is_word": true, "word_id": 1072, "word_key": " built", "bytes_hex": "20 62 75 69 6c 74", "compression": {"rwkv": "10.75% 10.75% 10.75% 10.75% 10.75% 10.75%", "qwen": "11.21% 11.21% 11.21% 11.21% 11.21% 11.21%"}, "model_tokens": {"rwkv": [[37924, " built", "normal", 0.027898862957954407]], "qwen": [[5798, " built", "normal", 0.023984147235751152]]}, "loss": {"rwkv": 10.754464985793378, "qwen": 11.212031277763288}, "topk": {"rwkv": [37924, 8, 0.027898862957954407, [[22339, 0.098334, " put", false], [22590, 0.084747, " the", false], [53137, 0.060074, " thought", false], [53035, 0.050332, " studied", false], [52249, 0.037992, " modeled", false], [52112, 0.036045, " learned", false], [4596, 0.034163, " in", false], [37924, 0.027899, " built", false], [32354, 0.025557, " used", false], [61755, 0.0234, " considered", false]]], "qwen": [5798, 9, 0.023984147235751152, [[3381, 0.102225, " thought", false], [279, 0.082371, " the", false], [61553, 0.073139, " modeled", false], [304, 0.057516, " in", false], [4766, 0.056733, " inside", false], [15251, 0.036094, " represented", false], [9498, 0.034182, " learned", false], [518, 0.025864, " at", false], [5798, 0.023984, " built", false], [19476, 0.023806, " studied", false]]]}, "raw_delta": -0.025372862815856934, "tuned_delta": -0.018035724302154197}, {"byte_start": 6394, "byte_end": 6397, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 1073, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "16.53% 16.53% 16.53%", "qwen": "10.69% 10.69% 10.69%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.06395498663187027]], "qwen": [[304, " in", "normal", 0.16885791718959808]]}, "loss": {"rwkv": 16.530880676852703, "qwen": 10.692159254357676}, "topk": {"rwkv": [4596, 2, 0.06395498663187027, [[31162, 0.887248, " into", false], [4596, 0.063955, " in", false], [46, 0.007633, "-", false], [46301, 0.005777, " inside", false], [4450, 0.004352, " by", false], [47, 0.003867, ".", false], [45, 0.003111, ",", false], [4712, 0.002163, " on", false], [21265, 0.002148, " and", false], [4423, 0.001869, " as", false]]], "qwen": [304, 2, 0.16885791718959808, [[1119, 0.712143, " into", false], [304, 0.168858, " in", false], [4766, 0.053773, " inside", false], [11, 0.00777, ",", false], [2878, 0.006168, " within", false], [311, 0.005287, " to", false], [323, 0.004373, " and", false], [13, 0.004349, ".", false], [553, 0.004262, " by", false], [369, 0.003311, " for", false]]]}, "raw_delta": 0.32376746336619056, "tuned_delta": 0.33110460187989327}, {"byte_start": 6397, "byte_end": 6398, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "40.86%", "qwen": "48.25%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.10300812125205994]], "qwen": [[11, ",", "normal", 0.0688665434718132]]}, "loss": {"rwkv": 40.857574400175714, "qwen": 48.25066140587562}, "topk": {"rwkv": [45, 3, 0.10300812125205994, [[4811, 0.450276, " to", false], [47, 0.232219, ".", false], [45, 0.103008, ",", false], [4423, 0.044338, " as", false], [4450, 0.018468, " by", false], [60, 0.015844, ";", false], [21265, 0.01479, " and", false], [4715, 0.01246, " or", false], [22590, 0.012325, " the", false], [5346, 0.010281, "---", false]]], "qwen": [11, 3, 0.0688665434718132, [[311, 0.609426, " to", false], [13, 0.07712, ".", false], [11, 0.068867, ",", false], [279, 0.042724, " the", false], [1039, 0.025157, " our", false], [264, 0.023088, " a", false], [382, 0.016726, ".\n\n", false], [476, 0.014431, " or", false], [458, 0.013104, " an", false], [20062, 0.009841, " minds", false]]]}, "raw_delta": -0.4099597930908203, "tuned_delta": -0.4026226545771176}, {"byte_start": 6398, "byte_end": 6401, "display": {"text": " as", "kind": "normal"}, "is_word": true, "word_id": 1074, "word_key": " as", "bytes_hex": "20 61 73", "compression": {"rwkv": "16.06% 16.06% 16.06%", "qwen": "20.21% 20.21% 20.21%"}, "model_tokens": {"rwkv": [[4423, " as", "normal", 0.06949476897716522]], "qwen": [[438, " as", "normal", 0.03467898070812225]]}, "loss": {"rwkv": 16.061253384896663, "qwen": 20.20747849176884}, "topk": {"rwkv": [4423, 5, 0.06949476897716522, [[21265, 0.190713, " and", false], [21400, 0.189232, " but", false], [4715, 0.096492, " or", false], [32232, 0.075727, " they", false], [4423, 0.069495, " as", false], [22185, 0.035437, " nor", false], [51018, 0.034658, " because", false], [4596, 0.032904, " in", false], [4811, 0.016522, " to", false], [22187, 0.012724, " not", false]]], "qwen": [438, 7, 0.03467898070812225, [[323, 0.207156, " and", false], [476, 0.162336, " or", false], [6329, 0.139448, " nor", false], [714, 0.08335, " but", false], [1576, 0.046677, " because", false], [807, 0.039988, " they", false], [438, 0.034679, " as", false], [1496, 0.025316, " even", false], [311, 0.022693, " to", false], [304, 0.021659, " in", false]]]}, "raw_delta": -0.22991553942362475, "tuned_delta": -0.222578400909922}, {"byte_start": 6401, "byte_end": 6407, "display": {"text": " their", "kind": "normal"}, "is_word": true, "word_id": 1075, "word_key": " their", "bytes_hex": "20 74 68 65 69 72", "compression": {"rwkv": "15.97% 15.97% 15.97% 15.97% 15.97% 15.97%", "qwen": "15.12% 15.12% 15.12% 15.12% 15.12% 15.12%"}, "model_tokens": {"rwkv": [[39931, " their", "normal", 0.004956191871315241]], "qwen": [[862, " their", "normal", 0.006524569820612669]]}, "loss": {"rwkv": 15.967327926505453, "qwen": 15.124794952249854}, "topk": {"rwkv": [39931, 31, 0.004956191871315241, [[32232, 0.158113, " they", false], [22590, 0.068888, " the", false], [332, 0.066142, " a", false], [31633, 0.051093, " part", false], [4858, 0.041154, " we", false], [4601, 0.032295, " it", false], [4588, 0.029713, " if", false], [55666, 0.026474, " building", false], [52369, 0.022488, " opposed", false], [4600, 0.018126, " is", false]]], "qwen": [862, 25, 0.006524569820612669, [[807, 0.175156, " they", false], [279, 0.082138, " the", false], [264, 0.064957, " a", false], [582, 0.056716, " we", false], [421, 0.045218, " if", false], [419, 0.044418, " this", false], [429, 0.036722, " that", false], [949, 0.031809, " part", false], [432, 0.02626, " it", false], [1493, 0.02526, " these", false]]]}, "raw_delta": 0.04671994845072425, "tuned_delta": 0.05405708696442699}, {"byte_start": 6407, "byte_end": 6418, "display": {"text": " complexity", "kind": "normal"}, "is_word": true, "word_id": 1076, "word_key": " complexity", "bytes_hex": "20 63 6f 6d 70 6c 65 78 69 74 79", "compression": {"rwkv": "3.46% 3.46% 3.46% 3.46% 3.46% 3.46% 3.46% 3.46% 3.46% 3.46% 3.46%", "qwen": "4.88% 4.88% 4.88% 4.88% 4.88% 4.88% 4.88% 4.88% 4.88% 4.88% 4.88%"}, "model_tokens": {"rwkv": [[61720, " complexity", "normal", 0.11990325152873993]], "qwen": [[23094, " complexity", "normal", 0.050824154168367386]]}, "loss": {"rwkv": 3.458164604403588, "qwen": 4.884479658024287}, "topk": {"rwkv": [61720, 1, 0.11990325152873993, [[61720, 0.119903, " complexity", false], [55847, 0.069264, " contents", false], [56916, 0.051108, " presence", false], [22681, 0.033647, " use", false], [32386, 0.027639, " very", false], [59914, 0.021764, " intrinsic", false], [59677, 0.021245, " existence", false], [51308, 0.015142, " content", false], [45098, 0.014203, " actual", false], [31894, 0.012041, " role", false]]], "qwen": [23094, 2, 0.050824154168367386, [[8794, 0.118183, " contents", false], [23094, 0.050824, " complexity", false], [13885, 0.036968, " existence", false], [9362, 0.031106, " presence", false], [2213, 0.029506, " content", false], [4752, 0.025276, " building", false], [13042, 0.022211, " representation", false], [6993, 0.015222, " nature", false], [990, 0.011962, " use", false], [54480, 0.011863, " computational", false]]]}, "raw_delta": -0.07909170064059168, "tuned_delta": -0.07175456212688894}, {"byte_start": 6418, "byte_end": 6421, "display": {"text": " is", "kind": "normal"}, "is_word": true, "word_id": 1077, "word_key": " is", "bytes_hex": "20 69 73", "compression": {"rwkv": "7.47% 7.47% 7.47%", "qwen": "8.06% 8.06% 8.06%"}, "model_tokens": {"rwkv": [[4600, " is", "normal", 0.2851680815219879]], "qwen": [[374, " is", "normal", 0.2616298794746399]]}, "loss": {"rwkv": 7.467073942101079, "qwen": 8.060003478998834}, "topk": {"rwkv": [4600, 1, 0.2851680815219879, [[4600, 0.285168, " is", false], [38964, 0.077583, " makes", false], [40219, 0.050165, " would", false], [32475, 0.045758, " will", false], [21265, 0.044136, " and", false], [45409, 0.030682, " cannot", false], [21413, 0.029812, " can", false], [30659, 0.023042, " does", false], [47266, 0.019247, " should", false], [21800, 0.017056, " has", false]]], "qwen": [374, 1, 0.2616298794746399, [[374, 0.26163, " is", false], [3643, 0.093887, " makes", false], [323, 0.05325, " and", false], [686, 0.04864, " will", false], [1035, 0.031732, " would", false], [4157, 0.02455, " cannot", false], [646, 0.0233, " can", false], [3363, 0.018559, " means", false], [27715, 0.017811, " grows", false], [27934, 0.016117, " prevents", false]]]}, "raw_delta": -0.032878994941711426, "tuned_delta": -0.02554185642800869}, {"byte_start": 6421, "byte_end": 6429, "display": {"text": " endless", "kind": "normal"}, "is_word": true, "word_id": 1078, "word_key": " endless", "bytes_hex": "20 65 6e 64 6c 65 73 73", "compression": {"rwkv": "18.03% 18.03% 18.03% 18.03% 18.03% 18.03% 18.03% 18.03%", "qwen": "18.18% 18.18% 18.18% 18.18% 18.18% 18.18% 18.18% 18.18%"}, "model_tokens": {"rwkv": [[51607, " endless", "normal", 0.0003396036918275058]], "qwen": [[25678, " endless", "normal", 0.00031490589026361704]]}, "loss": {"rwkv": 18.03368801111204, "qwen": 18.17623583127968}, "topk": {"rwkv": [51607, 249, 0.0003396036918275058, [[22187, 0.173715, " not", false], [332, 0.068451, " a", false], [22614, 0.064905, " too", false], [4419, 0.040421, " an", false], [45302, 0.029566, " beyond", false], [31581, 0.023512, " only", false], [62161, 0.020926, " irrelevant", false], [31633, 0.020267, " part", false], [47285, 0.019136, " simply", false], [22590, 0.017136, " the", false]]], "qwen": [25678, 295, 0.00031490589026361704, [[537, 0.092246, " not", false], [264, 0.06122, " a", false], [7797, 0.059096, " beyond", false], [773, 0.041949, " so", false], [2238, 0.037008, " too", false], [24870, 0.025747, " irre", false], [458, 0.02232, " an", false], [279, 0.021553, " the", false], [39715, 0.019333, " irrelevant", false], [3041, 0.018743, " far", false]]]}, "raw_delta": -0.007904529571533203, "tuned_delta": -0.0005673910578304665}, {"byte_start": 6429, "byte_end": 6430, "display": {"text": ";", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "3b", "compression": {"rwkv": "81.72%", "qwen": "71.32%"}, "model_tokens": {"rwkv": [[60, ";", "normal", 0.010762616991996765]], "qwen": [[26, ";", "normal", 0.0191591028124094]]}, "loss": {"rwkv": 81.71514880035143, "qwen": 71.32282624929111}, "topk": {"rwkv": [60, 5, 0.010762616991996765, [[2030, 0.5095, "ly", false], [47, 0.192344, ".", false], [21265, 0.139689, " and", false], [45, 0.118806, ",", false], [60, 0.010763, ";", false], [4596, 0.005694, " in", false], [5346, 0.003441, "---", false], [275, 0.002819, " (", false], [4811, 0.001525, " to", false], [55794, 0.001422, " compared", false]]], "qwen": [26, 5, 0.0191591028124094, [[13, 0.294122, ".", false], [11, 0.279669, ",", false], [323, 0.27395, " and", false], [382, 0.055618, ".\n\n", false], [26, 0.019159, ";", false], [304, 0.016172, " in", false], [320, 0.012282, " (", false], [4421, 0.005053, "---", false], [311, 0.003033, " to", false], [1576, 0.002492, " because", false]]]}, "raw_delta": 0.57627272605896, "tuned_delta": 0.5836098645726627}, {"byte_start": 6430, "byte_end": 6438, "display": {"text": " instead", "kind": "normal"}, "is_word": true, "word_id": 1079, "word_key": " instead", "bytes_hex": "20 69 6e 73 74 65 61 64", "compression": {"rwkv": "5.35% 5.35% 5.35% 5.35% 5.35% 5.35% 5.35% 5.35%", "qwen": "6.45% 6.45% 6.45% 6.45% 6.45% 6.45% 6.45% 6.45%"}, "model_tokens": {"rwkv": [[52028, " instead", "normal", 0.09278695285320282]], "qwen": [[4518, " instead", "normal", 0.05730580538511276]]}, "loss": {"rwkv": 5.353751128298887, "qwen": 6.445586211976131}, "topk": {"rwkv": [52028, 3, 0.09278695285320282, [[32232, 0.280362, " they", false], [4858, 0.118927, " we", false], [52028, 0.092787, " instead", false], [22590, 0.077168, " the", false], [32464, 0.058902, " what", false], [4601, 0.041245, " it", false], [47001, 0.036929, " rather", false], [21265, 0.028704, " and", false], [39931, 0.022382, " their", false], [21256, 0.016498, " all", false]]], "qwen": [4518, 4, 0.05730580538511276, [[807, 0.1876, " they", false], [432, 0.067963, " it", false], [582, 0.060777, " we", false], [4518, 0.057306, " instead", false], [323, 0.056879, " and", false], [279, 0.05503, " the", false], [4751, 0.035705, " rather", false], [1052, 0.030189, " there", false], [862, 0.030058, " their", false], [304, 0.020754, " in", false]]]}, "raw_delta": -0.06054419279098511, "tuned_delta": -0.05320705427728237}, {"byte_start": 6438, "byte_end": 6441, "display": {"text": " we", "kind": "normal"}, "is_word": true, "word_id": 1080, "word_key": " we", "bytes_hex": "20 77 65", "compression": {"rwkv": "9.02% 9.02% 9.02%", "qwen": "14.87% 14.87% 14.87%"}, "model_tokens": {"rwkv": [[4858, " we", "normal", 0.225086972117424]], "qwen": [[582, " we", "normal", 0.0842391699552536]]}, "loss": {"rwkv": 9.01684400555602, "qwen": 14.872354517747151}, "topk": {"rwkv": [4858, 2, 0.225086972117424, [[45, 0.59832, ",", false], [4858, 0.225087, " we", false], [32232, 0.065118, " they", false], [22590, 0.027785, " the", false], [32464, 0.017297, " what", false], [4706, 0.013835, " of", false], [22226, 0.005706, " one", false], [4601, 0.005062, " it", false], [21256, 0.003536, " all", false], [22248, 0.003487, " our", false]]], "qwen": [582, 3, 0.0842391699552536, [[11, 0.677031, ",", false], [807, 0.117721, " they", false], [582, 0.084239, " we", false], [279, 0.028229, " the", false], [1128, 0.014383, " what", false], [432, 0.01135, " it", false], [315, 0.010613, " of", false], [825, 0.005054, " one", false], [862, 0.004203, " their", false], [1052, 0.003506, " there", false]]]}, "raw_delta": -0.32469844818115234, "tuned_delta": -0.31736130966744963}, {"byte_start": 6441, "byte_end": 6448, "display": {"text": " should", "kind": "normal"}, "is_word": true, "word_id": 1081, "word_key": " should", "bytes_hex": "20 73 68 6f 75 6c 64", "compression": {"rwkv": "0.26% 0.26% 0.26% 0.26% 0.26% 0.26% 0.26%", "qwen": "0.41% 0.41% 0.41% 0.41% 0.41% 0.41% 0.41%"}, "model_tokens": {"rwkv": [[47266, " should", "normal", 0.9046232104301453]], "qwen": [[1265, " should", "normal", 0.8530765771865845]]}, "loss": {"rwkv": 0.25787570049371983, "qwen": 0.4093801314287926}, "topk": {"rwkv": [47266, 1, 0.9046232104301453, [[47266, 0.904623, " should", false], [31475, 0.029229, " must", false], [31506, 0.019525, " need", false], [31059, 0.010758, " have", false], [21286, 0.005716, " are", false], [39196, 0.004474, " ought", false], [21413, 0.003611, " can", false], [37923, 0.001965, " build", false], [32435, 0.001395, " want", false], [22626, 0.001112, " try", false]]], "qwen": [1265, 1, 0.8530765771865845, [[1265, 0.853077, " should", false], [1184, 0.034088, " need", false], [646, 0.024345, " can", false], [1969, 0.016667, " must", false], [614, 0.015318, " have", false], [1936, 0.009191, " build", false], [21776, 0.008415, " ought", false], [525, 0.006014, " are", false], [5931, 0.002937, " seek", false], [1366, 0.002463, " want", false]]]}, "raw_delta": -0.00840118953159877, "tuned_delta": -0.0010640510178960335}, {"byte_start": 6448, "byte_end": 6454, "display": {"text": " build", "kind": "normal"}, "is_word": true, "word_id": 1082, "word_key": " build", "bytes_hex": "20 62 75 69 6c 64", "compression": {"rwkv": "5.47% 5.47% 5.47% 5.47% 5.47% 5.47%", "qwen": "4.60% 4.60% 4.60% 4.60% 4.60% 4.60%"}, "model_tokens": {"rwkv": [[37923, " build", "normal", 0.16256456077098846]], "qwen": [[1936, " build", "normal", 0.21648700535297394]]}, "loss": {"rwkv": 5.471157951287898, "qwen": 4.59926610534126}, "topk": {"rwkv": [37923, 1, 0.16256456077098846, [[37923, 0.162565, " build", false], [38530, 0.107315, " focus", false], [4435, 0.092197, " be", false], [38877, 0.050963, " learn", false], [22626, 0.048028, " try", false], [31966, 0.03456, " seek", false], [63373, 0.027311, " concentrate", false], [32122, 0.02306, " stop", false], [22681, 0.021543, " use", false], [39942, 0.018536, " think", false]]], "qwen": [1936, 1, 0.21648700535297394, [[1936, 0.216487, " build", false], [5244, 0.116851, " focus", false], [1430, 0.068962, " try", false], [5931, 0.06029, " seek", false], [387, 0.056968, " be", false], [1401, 0.031789, " look", false], [1744, 0.031542, " think", false], [36355, 0.024805, " concentrate", false], [990, 0.017762, " use", false], [1477, 0.016482, " find", false]]]}, "raw_delta": 0.04834794998168945, "tuned_delta": 0.05568508849539219}, {"byte_start": 6454, "byte_end": 6457, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 1083, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "8.74% 8.74% 8.74%", "qwen": "4.42% 4.42% 4.42%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.23339763283729553]], "qwen": [[304, " in", "normal", 0.479447603225708]]}, "loss": {"rwkv": 8.735067630382394, "qwen": 4.418978842224913}, "topk": {"rwkv": [4596, 1, 0.23339763283729553, [[4596, 0.233398, " in", false], [52224, 0.115297, " methods", false], [53087, 0.076517, " systems", false], [22590, 0.041105, " the", false], [45124, 0.039255, " agents", false], [332, 0.028688, " a", false], [22248, 0.025575, " our", false], [56567, 0.022148, " machines", false], [51258, 0.019313, " complex", false], [51832, 0.017407, " general", false]]], "qwen": [304, 1, 0.479447603225708, [[304, 0.479448, " in", false], [5413, 0.091186, " methods", false], [279, 0.037211, " the", false], [4586, 0.029043, " general", false], [34447, 0.024152, " computation", false], [389, 0.019459, " on", false], [1039, 0.019375, " our", false], [5942, 0.016499, " systems", false], [2513, 0.014034, " things", false], [25185, 0.011642, " algorithms", false]]]}, "raw_delta": 0.23933478196461996, "tuned_delta": 0.2466719204783227}, {"byte_start": 6457, "byte_end": 6462, "display": {"text": " only", "kind": "normal"}, "is_word": true, "word_id": 1084, "word_key": " only", "bytes_hex": "20 6f 6e 6c 79", "compression": {"rwkv": "14.09% 14.09% 14.09% 14.09% 14.09%", "qwen": "12.35% 12.35% 12.35% 12.35% 12.35%"}, "model_tokens": {"rwkv": [[31581, " only", "normal", 0.020120054483413696]], "qwen": [[1172, " only", "normal", 0.03259682282805443]]}, "loss": {"rwkv": 14.088818758681281, "qwen": 12.347811726686185}, "topk": {"rwkv": [31581, 10, 0.020120054483413696, [[22590, 0.165143, " the", false], [52224, 0.091122, " methods", false], [63370, 0.051963, " computation", false], [332, 0.044219, " a", false], [51832, 0.037135, " general", false], [32464, 0.034414, " what", false], [64862, 0.022889, " computational", false], [32448, 0.022471, " ways", false], [52195, 0.022044, " massive", false], [31581, 0.02012, " only", false]]], "qwen": [1172, 8, 0.03259682282805443, [[279, 0.193697, " the", false], [5413, 0.111508, " methods", false], [4586, 0.074875, " general", false], [34447, 0.058896, " computation", false], [1246, 0.040794, " how", false], [1128, 0.035663, " what", false], [5510, 0.033375, " ways", false], [1172, 0.032597, " only", false], [264, 0.025612, " a", false], [4285, 0.015885, " simple", false]]]}, "raw_delta": 0.09654192924499516, "tuned_delta": 0.1038790677586979}, {"byte_start": 6462, "byte_end": 6466, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 1085, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "4.58% 4.58% 4.58% 4.58%", "qwen": "4.33% 4.33% 4.33% 4.33%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.36237138509750366]], "qwen": [[279, " the", "normal", 0.3827328383922577]]}, "loss": {"rwkv": 4.578866096571416, "qwen": 4.32997011701384}, "topk": {"rwkv": [22590, 1, 0.36237138509750366, [[22590, 0.362371, " the", false], [32464, 0.250409, " what", false], [332, 0.04651, " a", false], [39944, 0.035939, " those", false], [47284, 0.03561, " simple", false], [32227, 0.025152, " that", false], [4423, 0.024181, " as", false], [39931, 0.014073, " their", false], [21835, 0.011588, " how", false], [45865, 0.011292, " enough", false]]], "qwen": [279, 1, 0.3827328383922577, [[279, 0.382733, " the", false], [1128, 0.12453, " what", false], [4586, 0.05139, " general", false], [1846, 0.03903, " those", false], [264, 0.038345, " a", false], [5413, 0.026603, " methods", false], [34447, 0.024977, " computation", false], [4285, 0.024853, " simple", false], [1602, 0.019209, " very", false], [2513, 0.015342, " things", false]]]}, "raw_delta": 0.013801723718643188, "tuned_delta": 0.021138862232345925}, {"byte_start": 6466, "byte_end": 6471, "display": {"text": " meta", "kind": "normal"}, "is_word": true, "word_id": 1086, "word_key": " meta", "bytes_hex": "20 6d 65 74 61", "compression": {"rwkv": "36.52% 36.52% 36.52% 36.52% 36.52%", "qwen": "31.24% 31.24% 31.24% 31.24% 31.24%"}, "model_tokens": {"rwkv": [[31416, " meta", "normal", 3.984987051808275e-05]], "qwen": [[8823, " meta", "normal", 0.00017295297584496439]]}, "loss": {"rwkv": 36.51821822250188, "qwen": 31.243331458582645}, "topk": {"rwkv": [31416, 1042, 3.984987051808275e-05, [[57234, 0.061023, " simplest", false], [47284, 0.056931, " simple", false], [52236, 0.049452, " minimal", false], [32386, 0.040343, " very", false], [47539, 0.036873, " things", false], [61720, 0.033382, " complexity", false], [59644, 0.029384, " essential", false], [60050, 0.027863, " necessary", false], [52237, 0.026598, " minimum", false], [64862, 0.024904, " computational", false]]], "qwen": [8823, 457, 0.00017295297584496439, [[4586, 0.075737, " general", false], [1429, 0.057345, " most", false], [4285, 0.04441, " simple", false], [44548, 0.040875, " simplest", false], [5413, 0.030342, " methods", false], [1602, 0.022685, " very", false], [54480, 0.020146, " computational", false], [6770, 0.018722, " basic", false], [12829, 0.018643, " kinds", false], [5871, 0.017594, " necessary", false]]]}, "raw_delta": 0.2925018310546874, "tuned_delta": 0.2998389695683901}, {"byte_start": 6471, "byte_end": 6479, "display": {"text": "-methods", "kind": "normal"}, "is_word": true, "word_id": 1087, "word_key": "-methods", "bytes_hex": "2d 6d 65 74 68 6f 64 73", "compression": {"rwkv": "4.14% 14.09% 14.09% 14.09% 14.09% 14.09% 14.09% 14.09%", "qwen": "12.34% 12.34% 12.34% 12.34% 12.34% 12.34% 12.34% 1.24%"}, "model_tokens": {"rwkv": [[46, "-", "normal", 0.796599805355072], [49411, "methods", "normal", 0.004223444499075413]], "qwen": [[50297, "-method", "normal", 0.008322557434439659], [82, "s", "normal", 0.9337674379348755]]}, "loss": {"rwkv": 12.84504022764145, "qwen": 10.949410231711036}, "topk": {"rwkv": [46, 1, 0.796599805355072, [[46, 0.7966, "-", false], [58313, 0.018248, "knowledge", false], [1798, 0.018139, "co", false], [59943, 0.011431, " knowledge", false], [58449, 0.009784, "structure", false], [63039, 0.009269, "computation", false], [38887, 0.007528, " level", false], [45, 0.005498, ",", false], [65275, 0.00422, " representations", false], [65062, 0.003953, "representation", false]]], "qwen": [50297, 18, 0.008322557434439659, [[11591, 0.193179, "-level", false], [12, 0.164031, "-", false], [12646, 0.135322, "-k", false], [46094, 0.033313, "structures", false], [80739, 0.026792, "-information", false], [7837, 0.024583, "structure", false], [1448, 0.024123, "-m", false], [6540, 0.019148, " knowledge", false], [14389, 0.014137, " structures", false], [5504, 0.011423, "-re", false]]]}, "raw_delta": 0.1051160469651222, "tuned_delta": 0.11245318547882494}, {"byte_start": 6479, "byte_end": 6484, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 1088, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"rwkv": "2.51% 2.51% 2.51% 2.51% 2.51%", "qwen": "3.78% 3.78% 3.78% 3.78% 3.78%"}, "model_tokens": {"rwkv": [[32227, " that", "normal", 0.49592798948287964]], "qwen": [[429, " that", "normal", 0.3503324091434479]]}, "loss": {"rwkv": 2.5078097390452685, "qwen": 3.7830090704411083}, "topk": {"rwkv": [32227, 1, 0.49592798948287964, [[32227, 0.495928, " that", false], [45, 0.153088, ",", false], [21700, 0.067381, " for", false], [4706, 0.049, " of", false], [21265, 0.038538, " and", false], [4811, 0.033764, " to", false], [5346, 0.028882, "---", false], [46650, 0.027138, " needed", false], [4858, 0.012509, " we", false], [47, 0.012496, ".", false]]], "qwen": [429, 1, 0.3503324091434479, [[429, 0.350332, " that", false], [11, 0.172676, ",", false], [315, 0.140634, " of", false], [369, 0.101778, " for", false], [323, 0.035062, " and", false], [4421, 0.030228, "---", false], [311, 0.02602, " to", false], [320, 0.01569, " (", false], [13, 0.015441, ".", false], [25, 0.014572, ":", false]]]}, "raw_delta": -0.07071206569671631, "tuned_delta": -0.06337492718301357}, {"byte_start": 6484, "byte_end": 6488, "display": {"text": " can", "kind": "normal"}, "is_word": true, "word_id": 1089, "word_key": " can", "bytes_hex": "20 63 61 6e", "compression": {"rwkv": "10.92% 10.92% 10.92% 10.92%", "qwen": "8.84% 8.84% 8.84% 8.84%"}, "model_tokens": {"rwkv": [[21413, " can", "normal", 0.08990895003080368]], "qwen": [[646, " can", "normal", 0.14080820977687836]]}, "loss": {"rwkv": 10.918834537977993, "qwen": 8.83811426032155}, "topk": {"rwkv": [21413, 3, 0.08990895003080368, [[21286, 0.129939, " are", false], [45851, 0.12884, " enable", false], [21413, 0.089909, " can", false], [39590, 0.069381, " scale", false], [37675, 0.068671, " allow", false], [56540, 0.04463, " leverage", false], [31358, 0.03934, " make", false], [4858, 0.02903, " we", false], [32475, 0.022038, " will", false], [31073, 0.01681, " help", false]]], "qwen": [646, 1, 0.14080820977687836, [[646, 0.140808, " can", false], [525, 0.112271, " are", false], [7283, 0.094056, " enable", false], [2138, 0.087731, " allow", false], [5452, 0.065495, " scale", false], [1281, 0.041473, " make", false], [686, 0.038862, " will", false], [582, 0.032966, " we", false], [32064, 0.025115, " leverage", false], [1077, 0.013032, " let", false]]]}, "raw_delta": 0.11537963151931763, "tuned_delta": 0.12271677003302037}, {"byte_start": 6488, "byte_end": 6493, "display": {"text": " find", "kind": "normal"}, "is_word": true, "word_id": 1090, "word_key": " find", "bytes_hex": "20 66 69 6e 64", "compression": {"rwkv": "18.71% 18.71% 18.71% 18.71% 18.71%", "qwen": "18.87% 18.87% 18.87% 18.87% 18.87%"}, "model_tokens": {"rwkv": [[30858, " find", "normal", 0.005635255016386509]], "qwen": [[1477, " find", "normal", 0.0053453813306987286]]}, "loss": {"rwkv": 18.709951311528744, "qwen": 18.868729134458306}, "topk": {"rwkv": [30858, 24, 0.005635255016386509, [[39590, 0.169386, " scale", false], [4435, 0.110111, " be", false], [56540, 0.073163, " leverage", false], [32187, 0.045735, " take", false], [46158, 0.035232, " handle", false], [38877, 0.032738, " learn", false], [31358, 0.032578, " make", false], [30587, 0.029644, " deal", false], [22681, 0.025093, " use", false], [31073, 0.016514, " help", false]]], "qwen": [1477, 23, 0.0053453813306987286, [[387, 0.225458, " be", false], [5452, 0.197008, " scale", false], [32064, 0.081598, " leverage", false], [1896, 0.052988, " take", false], [3705, 0.027218, " handle", false], [32194, 0.023882, " exploit", false], [1281, 0.020005, " make", false], [1492, 0.016496, " help", false], [3060, 0.0129, " continue", false], [13444, 0.012311, " effectively", false]]]}, "raw_delta": -0.008804512023925737, "tuned_delta": -0.0014673735102230002}, {"byte_start": 6493, "byte_end": 6497, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 1091, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"rwkv": "10.71% 10.71% 10.71% 10.71%", "qwen": "11.80% 11.80% 11.80% 11.80%"}, "model_tokens": {"rwkv": [[21265, " and", "normal", 0.09246404469013214]], "qwen": [[323, " and", "normal", 0.0730060413479805]]}, "loss": {"rwkv": 10.707502256597774, "qwen": 11.799500723793338}, "topk": {"rwkv": [21265, 2, 0.09246404469013214, [[22590, 0.156998, " the", false], [21265, 0.092464, " and", false], [32448, 0.066924, " ways", false], [332, 0.052704, " a", false], [60521, 0.051232, " solutions", false], [39931, 0.038006, " their", false], [47284, 0.034711, " simple", false], [51832, 0.032497, " general", false], [56832, 0.026873, " patterns", false], [45, 0.022569, ",", false]]], "qwen": [323, 2, 0.0730060413479805, [[279, 0.141221, " the", false], [323, 0.073006, " and", false], [1661, 0.060295, " good", false], [264, 0.054906, " a", false], [5510, 0.054743, " ways", false], [9904, 0.046261, " solutions", false], [1493, 0.041047, " these", false], [4285, 0.038317, " simple", false], [862, 0.029244, " their", false], [1105, 0.02607, " them", false]]]}, "raw_delta": -0.06055325269699097, "tuned_delta": -0.05321611418328823}, {"byte_start": 6497, "byte_end": 6505, "display": {"text": " capture", "kind": "normal"}, "is_word": true, "word_id": 1092, "word_key": " capture", "bytes_hex": "20 63 61 70 74 75 72 65", "compression": {"rwkv": "13.81% 13.81% 13.81% 13.81% 13.81% 13.81% 13.81% 13.81%", "qwen": "16.17% 16.17% 16.17% 16.17% 16.17% 16.17% 16.17% 16.17%"}, "model_tokens": {"rwkv": [[51133, " capture", "normal", 0.0021711860317736864]], "qwen": [[12322, " capture", "normal", 0.0007653105421923101]]}, "loss": {"rwkv": 13.807042383507657, "qwen": 16.17448031287533}, "topk": {"rwkv": [51133, 41, 0.0021711860317736864, [[51690, 0.221346, " exploit", false], [22681, 0.169166, " use", false], [38877, 0.060183, " learn", false], [56540, 0.043563, " leverage", false], [53251, 0.041547, " utilize", false], [32187, 0.029985, " take", false], [31358, 0.028075, " make", false], [39590, 0.027811, " scale", false], [37923, 0.017156, " build", false], [30587, 0.016644, " deal", false]]], "qwen": [12322, 91, 0.0007653105421923101, [[990, 0.19459, " use", false], [32194, 0.186764, " exploit", false], [32064, 0.077788, " leverage", false], [28066, 0.064644, " utilize", false], [3796, 0.036191, " apply", false], [1896, 0.028938, " take", false], [5452, 0.027852, " scale", false], [1281, 0.018812, " make", false], [3960, 0.017616, " learn", false], [10515, 0.012242, " adapt", false]]]}, "raw_delta": -0.1312786340713501, "tuned_delta": -0.12394149555764736}, {"byte_start": 6505, "byte_end": 6510, "display": {"text": " this", "kind": "normal"}, "is_word": true, "word_id": 1093, "word_key": " this", "bytes_hex": "20 74 68 69 73", "compression": {"rwkv": "16.34% 16.34% 16.34% 16.34% 16.34%", "qwen": "14.58% 14.58% 14.58% 14.58% 14.58%"}, "model_tokens": {"rwkv": [[32234, " this", "normal", 0.01097183022648096]], "qwen": [[419, " this", "normal", 0.0175336766988039]]}, "loss": {"rwkv": 16.343029760070287, "qwen": 14.584319693908627}, "topk": {"rwkv": [32234, 15, 0.01097183022648096, [[22590, 0.395307, " the", false], [39936, 0.06662, " these", false], [51832, 0.042566, " general", false], [39931, 0.042204, " their", false], [56832, 0.03066, " patterns", false], [21256, 0.024165, " all", false], [32464, 0.019884, " what", false], [32229, 0.019346, " them", false], [21273, 0.018484, " any", false], [21265, 0.016529, " and", false]]], "qwen": [419, 8, 0.0175336766988039, [[279, 0.280644, " the", false], [1493, 0.057801, " these", false], [4586, 0.045954, " general", false], [1128, 0.045642, " what", false], [5390, 0.039438, " useful", false], [12624, 0.029172, " patterns", false], [1846, 0.024341, " those", false], [419, 0.017534, " this", false], [6540, 0.017077, " knowledge", false], [5944, 0.015977, " structure", false]]]}, "raw_delta": 0.09752359390258791, "tuned_delta": 0.10486073241629065}, {"byte_start": 6510, "byte_end": 6520, "display": {"text": " arbitrary", "kind": "normal"}, "is_word": true, "word_id": 1094, "word_key": " arbitrary", "bytes_hex": "20 61 72 62 69 74 72 61 72 79", "compression": {"rwkv": "7.44% 7.44% 7.44% 7.44% 7.44% 7.44% 7.44% 7.44% 7.44% 7.44%", "qwen": "7.74% 7.74% 7.74% 7.74% 7.74% 7.74% 7.74% 7.74% 7.74% 7.74%"}, "model_tokens": {"rwkv": [[59163, " arbitrary", "normal", 0.016140908002853394]], "qwen": [[24168, " arbitrary", "normal", 0.013689912855625153]]}, "loss": {"rwkv": 7.438896304583716, "qwen": 7.738428168632419}, "topk": {"rwkv": [59163, 5, 0.016140908002853394, [[61720, 0.632029, " complexity", false], [51607, 0.076052, " endless", false], [51258, 0.036809, " complex", false], [59914, 0.03348, " intrinsic", false], [59163, 0.016141, " arbitrary", false], [56454, 0.0111, " inherent", false], [62680, 0.009028, " underlying", false], [51832, 0.007883, " general", false], [51970, 0.007631, " immense", false], [56125, 0.005321, " enormous", false]]], "qwen": [24168, 6, 0.013689912855625153, [[23094, 0.542489, " complexity", false], [6351, 0.061806, " complex", false], [1995, 0.052409, " information", false], [4889, 0.019668, " outside", false], [6540, 0.019221, " knowledge", false], [24168, 0.01369, " arbitrary", false], [5944, 0.013563, " structure", false], [2213, 0.012819, " content", false], [1879, 0.010544, " world", false], [3093, 0.009757, " kind", false]]]}, "raw_delta": -0.016609573364257835, "tuned_delta": -0.009272434850555098}, {"byte_start": 6520, "byte_end": 6531, "display": {"text": " complexity", "kind": "normal"}, "is_word": true, "word_id": 1095, "word_key": " complexity", "bytes_hex": "20 63 6f 6d 70 6c 65 78 69 74 79", "compression": {"rwkv": "0.46% 0.46% 0.46% 0.46% 0.46% 0.46% 0.46% 0.46% 0.46% 0.46% 0.46%", "qwen": "0.83% 0.83% 0.83% 0.83% 0.83% 0.83% 0.83% 0.83% 0.83% 0.83% 0.83%"}, "model_tokens": {"rwkv": [[61720, " complexity", "normal", 0.7533266544342041]], "qwen": [[23094, " complexity", "normal", 0.6040256023406982]]}, "loss": {"rwkv": 0.46108861392047834, "qwen": 0.8264981978603826}, "topk": {"rwkv": [61720, 1, 0.7533266544342041, [[61720, 0.753327, " complexity", false], [45, 0.170575, ",", false], [21265, 0.011136, " and", false], [51258, 0.006059, " complex", false], [52391, 0.005973, " outside", false], [59914, 0.005633, " intrinsic", false], [51308, 0.004076, " content", false], [56191, 0.002231, " external", false], [57141, 0.00192, " richness", false], [46301, 0.001835, " inside", false]]], "qwen": [23094, 1, 0.6040256023406982, [[23094, 0.604026, " complexity", false], [11, 0.203697, ",", false], [1879, 0.040507, " world", false], [4889, 0.020384, " outside", false], [323, 0.017252, " and", false], [6351, 0.016169, " complex", false], [5944, 0.016046, " structure", false], [1995, 0.009967, " information", false], [2213, 0.006884, " content", false], [714, 0.004294, " but", false]]]}, "raw_delta": -0.02026260982860218, "tuned_delta": -0.012925471314899444}, {"byte_start": 6531, "byte_end": 6532, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "14.58%", "qwen": "26.58%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.4453999698162079]], "qwen": [[13, ".", "normal", 0.22900354862213135]]}, "loss": {"rwkv": 14.581927415235127, "qwen": 26.581978183091152}, "topk": {"rwkv": [47, 1, 0.4453999698162079, [[47, 0.4454, ".", false], [45, 0.261975, ",", false], [21265, 0.058394, " and", false], [4596, 0.048518, " in", false], [5346, 0.027024, "---", false], [4423, 0.014651, " as", false], [4450, 0.009557, " by", false], [53356, 0.009502, " without", false], [275, 0.009477, " (", false], [4706, 0.009375, " of", false]]], "qwen": [13, 2, 0.22900354862213135, [[11, 0.242662, ",", false], [13, 0.229004, ".", false], [304, 0.118386, " in", false], [382, 0.102984, ".\n\n", false], [323, 0.03766, " and", false], [4421, 0.033871, "---", false], [438, 0.019708, " as", false], [448, 0.014766, " with", false], [320, 0.011584, " (", false], [389, 0.011583, " on", false]]]}, "raw_delta": -0.665424108505249, "tuned_delta": -0.6580869699915463}, {"byte_start": 6532, "byte_end": 6542, "display": {"text": " Essential", "kind": "normal"}, "is_word": true, "word_id": 1096, "word_key": " essential", "bytes_hex": "20 45 73 73 65 6e 74 69 61 6c", "compression": {"rwkv": "53.26% 53.26% 53.26% 53.26% 0.10% 0.10% 0.10% 0.10% 0.10% 0.10%", "qwen": "20.26% 20.26% 20.26% 20.26% 20.26% 20.26% 20.26% 20.26% 20.26% 20.26%"}, "model_tokens": {"rwkv": [[19840, " Ess", "normal", 7.355121397267794e-06], [41342, "ential", "normal", 0.967919647693634]], "qwen": [[47733, " Essential", "normal", 1.3228118405095302e-05]]}, "loss": {"rwkv": 21.361731167264285, "qwen": 20.25754063497075}, "topk": {"rwkv": [19840, 1247, 7.355121397267794e-06, [[261, 0.259146, "\n\n", false], [20996, 0.119164, " The", false], [29894, 0.063429, " This", false], [37453, 0.058481, " These", false], [3913, 0.043353, " In", false], [4331, 0.041702, " We", false], [29889, 0.020874, " That", false], [19417, 0.020421, " And", false], [3918, 0.017923, " It", false], [44844, 0.017732, " Search", false]]], "qwen": [47733, 1181, 1.3228118405095302e-05, [[576, 0.129797, " The", false], [1096, 0.08778, " This", false], [1205, 0.079979, " We", false], [4220, 0.061063, " These", false], [758, 0.048117, " In", false], [1752, 0.039487, " For", false], [1597, 0.029719, " And", false], [2938, 0.027698, " That", false], [1084, 0.023024, " It", false], [220, 0.01766, " ", false]]]}, "raw_delta": 0.06122932434082036, "tuned_delta": 0.0685664628545231}, {"byte_start": 6542, "byte_end": 6545, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 1097, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "3.94% 3.94% 3.94%", "qwen": "6.58% 6.58% 6.58%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.5194181799888611]], "qwen": [[311, " to", "normal", 0.33457592129707336]]}, "loss": {"rwkv": 3.9448692524307587, "qwen": 6.581643478559646}, "topk": {"rwkv": [4811, 1, 0.5194181799888611, [[4811, 0.519418, " to", false], [37694, 0.096426, " among", false], [39239, 0.042605, " parts", false], [31416, 0.027149, " meta", false], [52224, 0.027041, " methods", false], [56089, 0.024305, " elements", false], [31077, 0.021138, " here", false], [4600, 0.021037, " is", false], [21700, 0.018038, " for", false], [4596, 0.017694, " in", false]]], "qwen": [311, 1, 0.33457592129707336, [[311, 0.334576, " to", false], [8823, 0.173613, " meta", false], [369, 0.105095, " for", false], [374, 0.036002, " is", false], [5413, 0.0318, " methods", false], [304, 0.027267, " in", false], [4221, 0.02533, " among", false], [11, 0.014456, ",", false], [1588, 0.012913, " here", false], [5479, 0.012706, " parts", false]]]}, "raw_delta": -0.1462138096491496, "tuned_delta": -0.13887667113544686}, {"byte_start": 6545, "byte_end": 6551, "display": {"text": " these", "kind": "normal"}, "is_word": true, "word_id": 1098, "word_key": " these", "bytes_hex": "20 74 68 65 73 65", "compression": {"rwkv": "7.75% 7.75% 7.75% 7.75% 7.75% 7.75%", "qwen": "6.54% 6.54% 6.54% 6.54% 6.54% 6.54%"}, "model_tokens": {"rwkv": [[39936, " these", "normal", 0.07584591209888458]], "qwen": [[1493, " these", "normal", 0.1133388951420784]]}, "loss": {"rwkv": 7.748850317274705, "qwen": 6.544344024559395}, "topk": {"rwkv": [39936, 3, 0.07584591209888458, [[32234, 0.528698, " this", false], [22590, 0.109217, " the", false], [39936, 0.075846, " these", false], [32227, 0.042329, " that", false], [55666, 0.031001, " building", false], [32139, 0.026706, " such", false], [38279, 0.016205, " doing", false], [21256, 0.01447, " all", false], [21273, 0.010253, " any", false], [22248, 0.008433, " our", false]]], "qwen": [1493, 2, 0.1133388951420784, [[419, 0.486482, " this", false], [1493, 0.113339, " these", false], [279, 0.090156, " the", false], [678, 0.039767, " all", false], [429, 0.034608, " that", false], [4752, 0.018017, " building", false], [1741, 0.016435, " such", false], [3730, 0.015154, " doing", false], [6832, 0.013901, " learning", false], [894, 0.009253, " any", false]]]}, "raw_delta": 0.06679201126098633, "tuned_delta": 0.07412914977468907}, {"byte_start": 6551, "byte_end": 6559, "display": {"text": " methods", "kind": "normal"}, "is_word": true, "word_id": 1099, "word_key": " methods", "bytes_hex": "20 6d 65 74 68 6f 64 73", "compression": {"rwkv": "2.47% 2.47% 2.47% 2.47% 2.47% 2.47% 2.47% 2.47%", "qwen": "4.78% 4.78% 4.78% 4.78% 4.78% 4.78% 4.78% 4.78%"}, "model_tokens": {"rwkv": [[52224, " methods", "normal", 0.3362106680870056]], "qwen": [[5413, " methods", "normal", 0.11975329369306564]]}, "loss": {"rwkv": 2.4655432827692243, "qwen": 4.784160712014783}, "topk": {"rwkv": [52224, 2, 0.3362106680870056, [[31416, 0.366396, " meta", false], [52224, 0.336211, " methods", false], [21286, 0.142133, " are", false], [51832, 0.053155, " general", false], [22638, 0.014933, " two", false], [4600, 0.013569, " is", false], [51258, 0.005078, " complex", false], [61590, 0.003796, " approaches", false], [45, 0.002796, ",", false], [59163, 0.002555, " arbitrary", false]]], "qwen": [5413, 2, 0.11975329369306564, [[8823, 0.671973, " meta", false], [5413, 0.119753, " methods", false], [374, 0.077473, " is", false], [525, 0.054646, " are", false], [4586, 0.01824, " general", false], [19827, 0.003394, " approaches", false], [1378, 0.00277, " two", false], [11, 0.002668, ",", false], [12538, 0.002589, " techniques", false], [1714, 0.001728, " method", false]]]}, "raw_delta": -0.12857145071029663, "tuned_delta": -0.12123431219659389}, {"byte_start": 6559, "byte_end": 6562, "display": {"text": " is", "kind": "normal"}, "is_word": true, "word_id": 1100, "word_key": " is", "bytes_hex": "20 69 73", "compression": {"rwkv": "5.03% 5.03% 5.03%", "qwen": "2.68% 2.68% 2.68%"}, "model_tokens": {"rwkv": [[4600, " is", "normal", 0.4312137961387634]], "qwen": [[374, " is", "normal", 0.6401692628860474]]}, "loss": {"rwkv": 5.025012023929657, "qwen": 2.6811448543085183}, "topk": {"rwkv": [4600, 2, 0.4312137961387634, [[21286, 0.478565, " are", false], [4600, 0.431214, " is", false], [45, 0.034258, ",", false], [32475, 0.015883, " will", false], [4706, 0.008986, " of", false], [40219, 0.003924, " would", false], [21700, 0.003673, " for", false], [4596, 0.002801, " in", false], [21265, 0.002626, " and", false], [47266, 0.002606, " should", false]]], "qwen": [374, 1, 0.6401692628860474, [[374, 0.640169, " is", false], [525, 0.278169, " are", false], [11, 0.031505, ",", false], [686, 0.009927, " will", false], [1265, 0.007983, " should", false], [369, 0.004219, " for", false], [1969, 0.003339, " must", false], [304, 0.003269, " in", false], [315, 0.003194, " of", false], [320, 0.003101, " (", false]]]}, "raw_delta": 0.12997159361839292, "tuned_delta": 0.13730873213209566}, {"byte_start": 6562, "byte_end": 6567, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 1101, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"rwkv": "9.52% 9.52% 9.52% 9.52% 9.52%", "qwen": "12.61% 12.61% 12.61% 12.61% 12.61%"}, "model_tokens": {"rwkv": [[32227, " that", "normal", 0.07150499522686005]], "qwen": [[429, " that", "normal", 0.03027326427400112]]}, "loss": {"rwkv": 9.524041480868545, "qwen": 12.61453016086352}, "topk": {"rwkv": [32227, 3, 0.07150499522686005, [[22590, 0.289062, " the", false], [56537, 0.132633, " learning", false], [32227, 0.071505, " that", false], [332, 0.054224, " a", false], [52195, 0.038265, " massive", false], [63370, 0.021919, " computation", false], [4811, 0.018009, " to", false], [47202, 0.014364, " search", false], [51832, 0.014102, " general", false], [4419, 0.013178, " an", false]]], "qwen": [429, 6, 0.03027326427400112, [[279, 0.385126, " the", false], [26943, 0.090273, " scaling", false], [264, 0.049859, " a", false], [34447, 0.0463, " computation", false], [6832, 0.037336, " learning", false], [429, 0.030273, " that", false], [2711, 0.029554, " search", false], [311, 0.018949, " to", false], [458, 0.013936, " an", false], [5452, 0.011061, " scale", false]]]}, "raw_delta": -0.17137308120727546, "tuned_delta": -0.16403594269357272}, {"byte_start": 6567, "byte_end": 6572, "display": {"text": " they", "kind": "normal"}, "is_word": true, "word_id": 1102, "word_key": " they", "bytes_hex": "20 74 68 65 79", "compression": {"rwkv": "0.82% 0.82% 0.82% 0.82% 0.82%", "qwen": "1.10% 1.10% 1.10% 1.10% 1.10%"}, "model_tokens": {"rwkv": [[32232, " they", "normal", 0.7950537204742432]], "qwen": [[807, " they", "normal", 0.7365784645080566]]}, "loss": {"rwkv": 0.8171514880035143, "qwen": 1.1027221229226438}, "topk": {"rwkv": [32232, 1, 0.7950537204742432, [[32232, 0.795054, " they", false], [4858, 0.050943, " we", false], [22590, 0.034654, " the", false], [39931, 0.017465, " their", false], [45, 0.013836, ",", false], [39934, 0.011988, " there", false], [4706, 0.005195, " of", false], [63370, 0.003587, " computation", false], [21256, 0.003424, " all", false], [22226, 0.003333, " one", false]]], "qwen": [807, 1, 0.7365784645080566, [[807, 0.736578, " they", false], [582, 0.065723, " we", false], [279, 0.056088, " the", false], [11, 0.016532, ",", false], [34447, 0.012233, " computation", false], [1052, 0.010324, " there", false], [862, 0.010036, " their", false], [315, 0.005888, " of", false], [432, 0.004903, " it", false], [264, 0.004412, " a", false]]]}, "raw_delta": -0.015835398435592653, "tuned_delta": -0.008498259921889916}, {"byte_start": 6572, "byte_end": 6576, "display": {"text": " can", "kind": "normal"}, "is_word": true, "word_id": 1103, "word_key": " can", "bytes_hex": "20 63 61 6e", "compression": {"rwkv": "11.13% 11.13% 11.13% 11.13%", "qwen": "11.62% 11.62% 11.62% 11.62%"}, "model_tokens": {"rwkv": [[21413, " can", "normal", 0.08541898429393768]], "qwen": [[646, " can", "normal", 0.07595773786306381]]}, "loss": {"rwkv": 11.130166819358212, "qwen": 11.62081074954688}, "topk": {"rwkv": [21413, 4, 0.08541898429393768, [[39590, 0.140765, " scale", false], [21286, 0.129975, " are", false], [4435, 0.11445, " be", false], [21413, 0.085419, " can", false], [22681, 0.032041, " use", false], [31059, 0.025783, " have", false], [56540, 0.024464, " leverage", false], [47266, 0.024231, " should", false], [4491, 0.021471, " do", false], [38877, 0.018663, " learn", false]]], "qwen": [646, 4, 0.07595773786306381, [[387, 0.126536, " be", false], [525, 0.094305, " are", false], [5452, 0.082216, " scale", false], [646, 0.075958, " can", false], [1265, 0.054224, " should", false], [1969, 0.0487, " must", false], [32064, 0.036971, " leverage", false], [614, 0.023595, " have", false], [1896, 0.021734, " take", false], [990, 0.019605, " use", false]]]}, "raw_delta": -0.02720707654953003, "tuned_delta": -0.019869938035827293}, {"byte_start": 6576, "byte_end": 6581, "display": {"text": " find", "kind": "normal"}, "is_word": true, "word_id": 1104, "word_key": " find", "bytes_hex": "20 66 69 6e 64", "compression": {"rwkv": "12.34% 12.34% 12.34% 12.34% 12.34%", "qwen": "10.19% 10.19% 10.19% 10.19% 10.19%"}, "model_tokens": {"rwkv": [[30858, " find", "normal", 0.03286619111895561]], "qwen": [[1477, " find", "normal", 0.059287264943122864]]}, "loss": {"rwkv": 12.341805232604802, "qwen": 10.190334947014732}, "topk": {"rwkv": [30858, 5, 0.03286619111895561, [[39590, 0.245418, " scale", false], [4435, 0.132087, " be", false], [38877, 0.081592, " learn", false], [56540, 0.053152, " leverage", false], [30858, 0.032866, " find", false], [22681, 0.02315, " use", false], [32187, 0.022318, " take", false], [51133, 0.020498, " capture", false], [46158, 0.01748, " handle", false], [31358, 0.015736, " make", false]]], "qwen": [1477, 4, 0.059287264943122864, [[5452, 0.217553, " scale", false], [387, 0.111124, " be", false], [32064, 0.070474, " leverage", false], [1477, 0.059287, " find", false], [1896, 0.033056, " take", false], [3960, 0.031697, " learn", false], [32194, 0.022243, " exploit", false], [12322, 0.019151, " capture", false], [3705, 0.016545, " handle", false], [990, 0.016301, " use", false]]]}, "raw_delta": 0.11930284500122068, "tuned_delta": 0.12663998351492342}, {"byte_start": 6581, "byte_end": 6586, "display": {"text": " good", "kind": "normal"}, "is_word": true, "word_id": 1105, "word_key": " good", "bytes_hex": "20 67 6f 6f 64", "compression": {"rwkv": "22.54% 22.54% 22.54% 22.54% 22.54%", "qwen": "20.73% 20.73% 20.73% 20.73% 20.73%"}, "model_tokens": {"rwkv": [[30992, " good", "normal", 0.0019435964059084654]], "qwen": [[1661, " good", "normal", 0.003192703705281019]]}, "loss": {"rwkv": 22.542110013890053, "qwen": 20.727514185330524}, "topk": {"rwkv": [30992, 45, 0.0019435964059084654, [[21265, 0.347782, " and", false], [22590, 0.077422, " the", false], [59163, 0.065804, " arbitrary", false], [45, 0.038407, ",", false], [63293, 0.038036, " arbitrarily", false], [32448, 0.020353, " ways", false], [332, 0.017295, " a", false], [56832, 0.017031, " patterns", false], [22168, 0.01591, " new", false], [60572, 0.015899, " structure", false]]], "qwen": [1661, 35, 0.003192703705281019, [[323, 0.373493, " and", false], [279, 0.122858, " the", false], [11, 0.049253, ",", false], [264, 0.021193, " a", false], [419, 0.019855, " this", false], [1128, 0.018387, " what", false], [12624, 0.01774, " patterns", false], [24168, 0.017142, " arbitrary", false], [23094, 0.014599, " complexity", false], [862, 0.014111, " their", false]]]}, "raw_delta": 0.10062255859374991, "tuned_delta": 0.10795969710745265}, {"byte_start": 6586, "byte_end": 6601, "display": {"text": " approximations", "kind": "normal"}, "is_word": true, "word_id": 1106, "word_key": " approximations", "bytes_hex": "20 61 70 70 72 6f 78 69 6d 61 74 69 6f 6e 73", "compression": {"rwkv": "2.64% 2.64% 2.64% 2.64% 2.64% 2.64% 2.64% 2.64% 2.64% 2.64% 2.64% 2.64% 2.64% 2.64% 0.17%", "qwen": "6.57% 6.57% 6.57% 6.57% 6.57% 6.57% 6.57% 0.01% 0.01% 0.01% 0.01% 0.01% 0.01% 0.01% 0.01%"}, "model_tokens": {"rwkv": [[64831, " approximation", "normal", 0.1297345757484436], [116, "s", "normal", 0.9907426238059998]], "qwen": [[9848, " approx", "normal", 0.07817225903272629], [96376, "imations", "normal", 0.9960803389549255]]}, "loss": {"rwkv": 2.4720006580336205, "qwen": 3.06905465744766}, "topk": {"rwkv": [64831, 1, 0.1297345757484436, [[64831, 0.129735, " approximation", false], [32448, 0.121486, " ways", false], [65275, 0.093937, " representations", false], [60521, 0.079533, " solutions", false], [45, 0.064058, ",", false], [63245, 0.050646, " abstraction", false], [65135, 0.023984, " generalization", false], [45865, 0.02109, " enough", false], [63292, 0.016466, " approximate", false], [51832, 0.013099, " general", false]]], "qwen": [9848, 2, 0.07817225903272629, [[43613, 0.137482, " representations", false], [9848, 0.078172, " approx", false], [9904, 0.074397, " solutions", false], [5510, 0.067546, " ways", false], [11, 0.048612, ",", false], [44868, 0.030861, " approximate", false], [4586, 0.027049, " general", false], [2750, 0.026102, " values", false], [3322, 0.019664, " enough", false], [4119, 0.017806, " models", false]]]}, "raw_delta": -0.03310770370687042, "tuned_delta": -0.025770565193167682}, {"byte_start": 6601, "byte_end": 6602, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "42.55%", "qwen": "43.14%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.09255068749189377]], "qwen": [[11, ",", "normal", 0.09145106375217438]]}, "loss": {"rwkv": 42.54823265121747, "qwen": 43.13570388873347}, "topk": {"rwkv": [45, 3, 0.09255068749189377, [[4811, 0.580132, " to", false], [4706, 0.097475, " of", false], [45, 0.092551, ",", false], [32227, 0.028419, " that", false], [4596, 0.025407, " in", false], [21700, 0.019691, " for", false], [47, 0.019201, ".", false], [21265, 0.01801, " and", false], [5346, 0.013103, "---", false], [275, 0.012328, " (", false]]], "qwen": [11, 3, 0.09145106375217438, [[311, 0.526465, " to", false], [315, 0.162268, " of", false], [11, 0.091451, ",", false], [369, 0.029232, " for", false], [304, 0.021169, " in", false], [13, 0.020419, ".", false], [429, 0.019746, " that", false], [323, 0.018833, " and", false], [4421, 0.011141, "---", false], [448, 0.008905, " with", false]]]}, "raw_delta": -0.03257632255554199, "tuned_delta": -0.025239184041839256}, {"byte_start": 6602, "byte_end": 6606, "display": {"text": " but", "kind": "normal"}, "is_word": true, "word_id": 1107, "word_key": " but", "bytes_hex": "20 62 75 74", "compression": {"rwkv": "20.85% 20.85% 20.85% 20.85%", "qwen": "18.68% 18.68% 18.68% 18.68%"}, "model_tokens": {"rwkv": [[21400, " but", "normal", 0.009839987382292747]], "qwen": [[714, " but", "normal", 0.01588658057153225]]}, "loss": {"rwkv": 20.851451762848296, "qwen": 18.675148902300144}, "topk": {"rwkv": [21400, 21, 0.009839987382292747, [[21265, 0.180016, " and", false], [4715, 0.088607, " or", false], [4596, 0.058533, " in", false], [30788, 0.050832, " even", false], [22187, 0.044708, " not", false], [32227, 0.043643, " that", false], [4788, 0.034359, " so", false], [32487, 0.024708, " with", false], [4423, 0.020107, " as", false], [47001, 0.019113, " rather", false]]], "qwen": [714, 10, 0.01588658057153225, [[323, 0.225587, " and", false], [1496, 0.073592, " even", false], [476, 0.052948, " or", false], [892, 0.049974, " which", false], [304, 0.047493, " in", false], [537, 0.041677, " not", false], [448, 0.031349, " with", false], [438, 0.027299, " as", false], [429, 0.023634, " that", false], [714, 0.015887, " but", false]]]}, "raw_delta": 0.12067985534667969, "tuned_delta": 0.12801699386038243}, {"byte_start": 6606, "byte_end": 6610, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 1108, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "16.91% 16.91% 16.91% 16.91%", "qwen": "14.26% 14.26% 14.26% 14.26%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.023803692311048508]], "qwen": [[279, " the", "normal", 0.042297009378671646]]}, "loss": {"rwkv": 16.90658251041754, "qwen": 14.260313408772268}, "topk": {"rwkv": [22590, 9, 0.023803692311048508, [[22187, 0.216313, " not", false], [32232, 0.165504, " they", false], [32227, 0.063869, " that", false], [39115, 0.046973, " never", false], [4692, 0.042079, " no", false], [45409, 0.037314, " cannot", false], [30135, 0.03441, " also", false], [21413, 0.031123, " can", false], [22590, 0.023804, " the", false], [21286, 0.023436, " are", false]]], "qwen": [279, 5, 0.042297009378671646, [[537, 0.165363, " not", false], [807, 0.163116, " they", false], [429, 0.05804, " that", false], [2581, 0.044574, " never", false], [279, 0.042297, " the", false], [653, 0.026959, " do", false], [419, 0.025683, " this", false], [1172, 0.023613, " only", false], [646, 0.023518, " can", false], [304, 0.021847, " in", false]]]}, "raw_delta": 0.14674031734466553, "tuned_delta": 0.15407745585836827}, {"byte_start": 6610, "byte_end": 6617, "display": {"text": " search", "kind": "normal"}, "is_word": true, "word_id": 1109, "word_key": " search", "bytes_hex": "20 73 65 61 72 63 68", "compression": {"rwkv": "11.83% 11.83% 11.83% 11.83% 11.83% 11.83% 11.83%", "qwen": "10.83% 10.83% 10.83% 10.83% 10.83% 10.83% 10.83%"}, "model_tokens": {"rwkv": [[47202, " search", "normal", 0.010242145508527756]], "qwen": [[2711, " search", "normal", 0.014953196048736572]]}, "loss": {"rwkv": 11.834607757292277, "qwen": 10.827504379684806}, "topk": {"rwkv": [47202, 11, 0.010242145508527756, [[64831, 0.364622, " approximation", false], [52224, 0.073882, " methods", false], [30992, 0.037612, " good", false], [30273, 0.036568, " best", false], [31458, 0.024773, " more", false], [21952, 0.015541, " key", false], [61720, 0.012345, " complexity", false], [31461, 0.011925, " most", false], [31581, 0.011908, " only", false], [45098, 0.010371, " actual", false]]], "qwen": [2711, 11, 0.014953196048736572, [[9848, 0.096294, " approx", false], [23094, 0.055132, " complexity", false], [3565, 0.054822, " details", false], [5042, 0.035948, " actual", false], [56204, 0.035316, " approximation", false], [5413, 0.02631, " methods", false], [1850, 0.022449, " best", false], [4271, 0.016598, " quality", false], [44868, 0.015384, " approximate", false], [4734, 0.014968, " exact", false]]]}, "raw_delta": 0.055845669337681314, "tuned_delta": 0.06318280785138405}, {"byte_start": 6617, "byte_end": 6621, "display": {"text": " for", "kind": "normal"}, "is_word": true, "word_id": 1110, "word_key": " for", "bytes_hex": "20 66 6f 72", "compression": {"rwkv": "9.23% 9.23% 9.23% 9.23%", "qwen": "7.36% 7.36% 7.36% 7.36%"}, "model_tokens": {"rwkv": [[21700, " for", "normal", 0.12873318791389465]], "qwen": [[369, " for", "normal", 0.19535474479198456]]}, "loss": {"rwkv": 9.22817628693624, "qwen": 7.361974269267249}, "topk": {"rwkv": [21700, 2, 0.12873318791389465, [[21265, 0.16269, " and", false], [21700, 0.128733, " for", false], [4600, 0.089759, " is", false], [39750, 0.057025, " space", false], [31475, 0.056437, " must", false], [52224, 0.056422, " methods", false], [4715, 0.04538, " or", false], [47266, 0.032136, " should", false], [46, 0.028564, "-", false], [21413, 0.025788, " can", false]]], "qwen": [369, 2, 0.19535474479198456, [[323, 0.248778, " and", false], [369, 0.195355, " for", false], [3550, 0.060089, " space", false], [374, 0.051573, " is", false], [476, 0.047005, " or", false], [5413, 0.034343, " methods", false], [646, 0.031523, " can", false], [1969, 0.021933, " must", false], [1184, 0.019861, " need", false], [9777, 0.016862, "-and", false]]]}, "raw_delta": 0.10348421335220337, "tuned_delta": 0.11082135186590611}, {"byte_start": 6621, "byte_end": 6626, "display": {"text": " them", "kind": "normal"}, "is_word": true, "word_id": 1111, "word_key": " them", "bytes_hex": "20 74 68 65 6d", "compression": {"rwkv": "12.45% 12.45% 12.45% 12.45% 12.45%", "qwen": "22.09% 22.09% 22.09% 22.09% 22.09%"}, "model_tokens": {"rwkv": [[32229, " them", "normal", 0.03112850710749626]], "qwen": [[1105, " them", "normal", 0.002185772405937314]]}, "loss": {"rwkv": 12.454515782674253, "qwen": 22.094102087698467}, "topk": {"rwkv": [32229, 7, 0.03112850710749626, [[30992, 0.339901, " good", false], [64831, 0.113961, " approximation", false], [39936, 0.107803, " these", false], [22590, 0.084286, " the", false], [32139, 0.072933, " such", false], [45301, 0.035328, " better", false], [32229, 0.031129, " them", false], [39944, 0.027383, " those", false], [332, 0.026662, " a", false], [63292, 0.015308, " approximate", false]]], "qwen": [1105, 47, 0.002185772405937314, [[1661, 0.158216, " good", false], [279, 0.120957, " the", false], [264, 0.08415, " a", false], [4734, 0.061812, " exact", false], [1493, 0.041712, " these", false], [458, 0.038725, " an", false], [9848, 0.032758, " approx", false], [1741, 0.028929, " such", false], [4285, 0.027181, " simple", false], [4727, 0.019721, " perfect", false]]]}, "raw_delta": -0.5345321655273436, "tuned_delta": -0.5271950270136408}, {"byte_start": 6626, "byte_end": 6633, "display": {"text": " should", "kind": "normal"}, "is_word": true, "word_id": 1112, "word_key": " should", "bytes_hex": "20 73 68 6f 75 6c 64", "compression": {"rwkv": "5.84% 5.84% 5.84% 5.84% 5.84% 5.84% 5.84%", "qwen": "5.68% 5.68% 5.68% 5.68% 5.68% 5.68% 5.68%"}, "model_tokens": {"rwkv": [[47266, " should", "normal", 0.10364801436662674]], "qwen": [[1265, " should", "normal", 0.11030002683401108]]}, "loss": {"rwkv": 5.836796342882247, "qwen": 5.679455557845392}, "topk": {"rwkv": [47266, 3, 0.10364801436662674, [[4600, 0.298511, " is", false], [31475, 0.190521, " must", false], [47266, 0.103648, " should", false], [21800, 0.052637, " has", false], [21413, 0.0521, " can", false], [32475, 0.032246, " will", false], [45409, 0.031016, " cannot", false], [30659, 0.025341, " does", false], [45, 0.022651, ",", false], [39105, 0.022128, " needs", false]]], "qwen": [1265, 2, 0.11030002683401108, [[374, 0.354648, " is", false], [1265, 0.1103, " should", false], [1969, 0.082882, " must", false], [646, 0.063995, " can", false], [1558, 0.034168, " does", false], [4157, 0.033618, " cannot", false], [702, 0.031089, " has", false], [686, 0.029944, " will", false], [11, 0.025467, ",", false], [1231, 0.025081, " may", false]]]}, "raw_delta": 0.008724825722830676, "tuned_delta": 0.016061964236533412}, {"byte_start": 6633, "byte_end": 6636, "display": {"text": " be", "kind": "normal"}, "is_word": true, "word_id": 1113, "word_key": " be", "bytes_hex": "20 62 65", "compression": {"rwkv": "6.29% 6.29% 6.29%", "qwen": "5.80% 5.80% 5.80%"}, "model_tokens": {"rwkv": [[4435, " be", "normal", 0.34870123863220215]], "qwen": [[387, " be", "normal", 0.38093888759613037]]}, "loss": {"rwkv": 6.293005712210972, "qwen": 5.801535190406596}, "topk": {"rwkv": [4435, 2, 0.34870123863220215, [[22187, 0.349701, " not", false], [4435, 0.348701, " be", false], [39115, 0.062855, " never", false], [45150, 0.026983, " always", false], [55851, 0.016838, " continue", false], [31581, 0.013219, " only", false], [52570, 0.013001, " proceed", false], [32122, 0.011866, " stop", false], [52051, 0.009384, " involve", false], [31059, 0.00849, " have", false]]], "qwen": [387, 2, 0.38093888759613037, [[537, 0.406596, " not", false], [387, 0.380939, " be", false], [2581, 0.03639, " never", false], [2936, 0.018259, " stop", false], [2677, 0.017082, " always", false], [7146, 0.012229, " remain", false], [3060, 0.009484, " continue", false], [10354, 0.009378, " proceed", false], [1172, 0.006784, " only", false], [835, 0.00434, " end", false]]]}, "raw_delta": 0.027252912521362305, "tuned_delta": 0.034590051035065045}, {"byte_start": 6636, "byte_end": 6639, "display": {"text": " by", "kind": "normal"}, "is_word": true, "word_id": 1114, "word_key": " by", "bytes_hex": "20 62 79", "compression": {"rwkv": "29.87% 29.87% 29.87%", "qwen": "32.12% 32.12% 32.12%"}, "model_tokens": {"rwkv": [[4450, " by", "normal", 0.006882506888359785]], "qwen": [[553, " by", "normal", 0.004782747942954302]]}, "loss": {"rwkv": 29.868295768404316, "qwen": 32.11643578221786}, "topk": {"rwkv": [4450, 24, 0.006882506888359785, [[37810, 0.077796, " based", false], [46141, 0.067956, " guided", false], [30666, 0.049359, " done", false], [37862, 0.026134, " blind", false], [332, 0.023582, " a", false], [45796, 0.021656, " driven", false], [4423, 0.016234, " as", false], [31269, 0.014002, " left", false], [64862, 0.012265, " computational", false], [4596, 0.011855, " in", false]]], "qwen": [553, 33, 0.004782747942954302, [[2814, 0.098134, " done", false], [2115, 0.091625, " left", false], [3118, 0.038297, " based", false], [32587, 0.033109, " guided", false], [264, 0.02995, " a", false], [27498, 0.019021, " automated", false], [7199, 0.018033, " limited", false], [22978, 0.012739, " abandoned", false], [16227, 0.011882, " driven", false], [13075, 0.010533, " conducted", false]]]}, "raw_delta": -0.1246633529663086, "tuned_delta": -0.11732621445260585}, {"byte_start": 6639, "byte_end": 6643, "display": {"text": " our", "kind": "normal"}, "is_word": true, "word_id": 1115, "word_key": " our", "bytes_hex": "20 6f 75 72", "compression": {"rwkv": "38.89% 38.89% 38.89% 38.89%", "qwen": "34.49% 34.49% 34.49% 34.49%"}, "model_tokens": {"rwkv": [[22248, " our", "normal", 0.00017572223441675305]], "qwen": [[1039, " our", "normal", 0.0004757429996971041]]}, "loss": {"rwkv": 38.88513977396034, "qwen": 34.49228151342959}, "topk": {"rwkv": [22248, 401, 0.00017572223441675305, [[37920, 0.103837, " brute", false], [38989, 0.058257, " means", false], [332, 0.046134, " a", false], [52195, 0.041049, " massive", false], [52224, 0.038828, " methods", false], [56537, 0.037187, " learning", false], [22590, 0.036963, " the", false], [38888, 0.025153, " lever", false], [47202, 0.024959, " search", false], [63370, 0.024668, " computation", false]]], "qwen": [1039, 235, 0.0004757429996971041, [[264, 0.064584, " a", false], [26943, 0.05475, " scaling", false], [4586, 0.048367, " general", false], [5413, 0.040268, " methods", false], [279, 0.036895, " the", false], [34447, 0.029067, " computation", false], [458, 0.028545, " an", false], [64098, 0.026486, " brute", false], [2711, 0.018504, " search", false], [8823, 0.01828, " meta", false]]]}, "raw_delta": 0.2435917854309082, "tuned_delta": 0.2509289239446109}, {"byte_start": 6643, "byte_end": 6651, "display": {"text": " methods", "kind": "normal"}, "is_word": true, "word_id": 1116, "word_key": " methods", "bytes_hex": "20 6d 65 74 68 6f 64 73", "compression": {"rwkv": "7.61% 7.61% 7.61% 7.61% 7.61% 7.61% 7.61% 7.61%", "qwen": "7.91% 7.91% 7.91% 7.91% 7.91% 7.91% 7.91% 7.91%"}, "model_tokens": {"rwkv": [[52224, " methods", "normal", 0.034680359065532684]], "qwen": [[5413, " methods", "normal", 0.029909150674939156]]}, "loss": {"rwkv": 7.607962129687892, "qwen": 7.9113583364123246}, "topk": {"rwkv": [52224, 5, 0.034680359065532684, [[22251, 0.172577, " own", false], [30273, 0.10965, " best", false], [31461, 0.058648, " most", false], [39026, 0.052117, " minds", false], [52224, 0.03468, " methods", false], [45124, 0.032291, " agents", false], [56567, 0.020129, " machines", false], [51832, 0.013952, " general", false], [59345, 0.00941, " computers", false], [38989, 0.008589, " means", false]]], "qwen": [5413, 6, 0.029909150674939156, [[1828, 0.28534, " own", false], [54480, 0.03619, " computational", false], [3738, 0.03306, " human", false], [4586, 0.032884, " general", false], [20062, 0.03041, " minds", false], [5413, 0.029909, " methods", false], [8823, 0.01548, " meta", false], [1850, 0.013422, " best", false], [13009, 0.012272, " agents", false], [34447, 0.011803, " computation", false]]]}, "raw_delta": -0.01682385802268982, "tuned_delta": -0.009486719508987083}, {"byte_start": 6651, "byte_end": 6652, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "14.65%", "qwen": "10.56%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.44375190138816833]], "qwen": [[11, ",", "normal", 0.5567399263381958]]}, "loss": {"rwkv": 14.652371509028534, "qwen": 10.561556704184026}, "topk": {"rwkv": [45, 1, 0.44375190138816833, [[45, 0.443752, ",", false], [4706, 0.104686, " of", false], [40, 0.048938, "'", false], [21265, 0.040952, " and", false], [47, 0.038513, ".", false], [32227, 0.033652, " that", false], [47001, 0.032465, " rather", false], [22187, 0.028773, " not", false], [5346, 0.021571, "---", false], [21700, 0.019591, " for", false]]], "qwen": [11, 1, 0.5567399263381958, [[11, 0.55674, ",", false], [323, 0.076192, " and", false], [315, 0.048468, " of", false], [4751, 0.040143, " rather", false], [13, 0.03996, ".", false], [4421, 0.037418, "---", false], [429, 0.032771, " that", false], [369, 0.02546, " for", false], [320, 0.018558, " (", false], [382, 0.016291, ".\n\n", false]]]}, "raw_delta": 0.2268429398536682, "tuned_delta": 0.23418007836737095}, {"byte_start": 6652, "byte_end": 6656, "display": {"text": " not", "kind": "normal"}, "is_word": true, "word_id": 1117, "word_key": " not", "bytes_hex": "20 6e 6f 74", "compression": {"rwkv": "1.81% 1.81% 1.81% 1.81%", "qwen": "2.91% 2.91% 2.91% 2.91%"}, "model_tokens": {"rwkv": [[22187, " not", "normal", 0.6701511740684509]], "qwen": [[537, " not", "normal", 0.5248613357543945]]}, "loss": {"rwkv": 1.8051299034560393, "qwen": 2.906224371822002}, "topk": {"rwkv": [22187, 1, 0.6701511740684509, [[22187, 0.670151, " not", false], [21265, 0.109385, " and", false], [47001, 0.032279, " rather", false], [40186, 0.019984, " which", false], [4450, 0.018982, " by", false], [4423, 0.009663, " as", false], [40085, 0.006972, " using", false], [4596, 0.006773, " in", false], [32487, 0.006487, " with", false], [53356, 0.005776, " without", false]]], "qwen": [537, 1, 0.5248613357543945, [[537, 0.524861, " not", false], [323, 0.174363, " and", false], [892, 0.037924, " which", false], [4751, 0.031897, " rather", false], [553, 0.022549, " by", false], [438, 0.017158, " as", false], [773, 0.01376, " so", false], [1667, 0.012388, " using", false], [429, 0.010594, " that", false], [448, 0.009621, " with", false]]]}, "raw_delta": -0.061057642102241516, "tuned_delta": -0.053720503588538776}, {"byte_start": 6656, "byte_end": 6659, "display": {"text": " by", "kind": "normal"}, "is_word": true, "word_id": 1118, "word_key": " by", "bytes_hex": "20 62 79", "compression": {"rwkv": "2.11% 2.11% 2.11%", "qwen": "1.98% 1.98% 1.98%"}, "model_tokens": {"rwkv": [[4450, " by", "normal", 0.7054336071014404]], "qwen": [[553, " by", "normal", 0.7199219465255737]]}, "loss": {"rwkv": 2.1133228138021924, "qwen": 1.9753651389266438}, "topk": {"rwkv": [4450, 1, 0.7054336071014404, [[4450, 0.705434, " by", false], [22590, 0.081872, " the", false], [22248, 0.048407, " our", false], [31597, 0.016694, " ours", false], [4596, 0.013091, " in", false], [38720, 0.008677, " human", false], [53140, 0.007893, " through", false], [39944, 0.006471, " those", false], [37924, 0.005713, " built", false], [21700, 0.00514, " for", false]]], "qwen": [553, 1, 0.7199219465255737, [[553, 0.719922, " by", false], [1039, 0.078851, " our", false], [279, 0.035263, " the", false], [11350, 0.023112, " ours", false], [304, 0.01811, " in", false], [3738, 0.007074, " human", false], [504, 0.00552, " from", false], [1128, 0.005099, " what", false], [1846, 0.00484, " those", false], [264, 0.004775, " a", false]]]}, "raw_delta": 0.007649997870127365, "tuned_delta": 0.014987136383830101}, {"byte_start": 6659, "byte_end": 6662, "display": {"text": " us", "kind": "normal"}, "is_word": true, "word_id": 1119, "word_key": " us", "bytes_hex": "20 75 73", "compression": {"rwkv": "32.31% 32.31% 32.31%", "qwen": "28.03% 28.03% 28.03%"}, "model_tokens": {"rwkv": [[4835, " us", "normal", 0.004650012124329805]], "qwen": [[601, " us", "normal", 0.009435177780687809]]}, "loss": {"rwkv": 32.31035768657574, "qwen": 28.032226186058057}, "topk": {"rwkv": [4835, 20, 0.004650012124329805, [[22590, 0.274335, " the", false], [22248, 0.136093, " our", false], [38720, 0.108349, " human", false], [31597, 0.029068, " ours", false], [21273, 0.02526, " any", false], [52224, 0.024696, " methods", false], [47629, 0.021388, " trying", false], [55666, 0.01915, " building", false], [31044, 0.018624, " hand", false], [39944, 0.015058, " those", false]]], "qwen": [601, 16, 0.009435177780687809, [[1039, 0.258688, " our", false], [279, 0.135349, " the", false], [3738, 0.051711, " human", false], [1128, 0.040592, " what", false], [1246, 0.030586, " how", false], [894, 0.029897, " any", false], [11350, 0.029029, " ours", false], [1045, 0.022115, " some", false], [4460, 0.01838, " trying", false], [264, 0.016735, " a", false]]]}, "raw_delta": 0.23722998301188158, "tuned_delta": 0.24456712152558432}, {"byte_start": 6662, "byte_end": 6663, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "14.44%", "qwen": "17.46%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.44986504316329956]], "qwen": [[13, ".", "normal", 0.3797611594200134]]}, "loss": {"rwkv": 14.441039227648314, "qwen": 17.460447263063372}, "topk": {"rwkv": [47, 1, 0.44986504316329956, [[47, 0.449865, ".", false], [45, 0.147026, ",", false], [47629, 0.0488, " trying", false], [57419, 0.023866, " thinking", false], [55666, 0.020158, " building", false], [60, 0.016601, ";", false], [52157, 0.013814, " looking", false], [46227, 0.011987, " humans", false], [52614, 0.010683, " putting", false], [5346, 0.009696, "---", false]]], "qwen": [13, 1, 0.3797611594200134, [[13, 0.379761, ".", false], [382, 0.197382, ".\n\n", false], [11, 0.133295, ",", false], [4460, 0.027582, " trying", false], [4421, 0.02084, "---", false], [13217, 0.019914, " ourselves", false], [26, 0.01801, ";", false], [4752, 0.015604, " building", false], [304, 0.013535, " in", false], [624, 0.012272, ".\n", false]]]}, "raw_delta": -0.1674315333366394, "tuned_delta": -0.16009439482293666}, {"byte_start": 6663, "byte_end": 6666, "display": {"text": " We", "kind": "normal"}, "is_word": true, "word_id": 1120, "word_key": " we", "bytes_hex": "20 57 65", "compression": {"rwkv": "15.97% 15.97% 15.97%", "qwen": "12.74% 12.74% 12.74%"}, "model_tokens": {"rwkv": [[4331, " We", "normal", 0.06995029002428055]], "qwen": [[1205, " We", "normal", 0.12015379965305328]]}, "loss": {"rwkv": 15.967327926505453, "qwen": 12.7376915233504}, "topk": {"rwkv": [4331, 3, 0.06995029002428055, [[261, 0.32492, "\n\n", false], [20996, 0.102782, " The", false], [4331, 0.06995, " We", false], [29894, 0.065244, " This", false], [3913, 0.03047, " In", false], [37453, 0.024223, " These", false], [20571, 0.023633, " Our", false], [3918, 0.019177, " It", false], [19417, 0.015377, " And", false], [3908, 0.0128, " If", false]]], "qwen": [1205, 2, 0.12015379965305328, [[576, 0.124349, " The", false], [1205, 0.120154, " We", false], [1096, 0.100161, " This", false], [758, 0.045278, " In", false], [1084, 0.03561, " It", false], [4220, 0.029118, " These", false], [1597, 0.026011, " And", false], [2938, 0.025488, " That", false], [2379, 0.023709, " They", false], [1416, 0.022571, " If", false]]]}, "raw_delta": 0.17908906936645508, "tuned_delta": 0.18642620788015782}, {"byte_start": 6666, "byte_end": 6671, "display": {"text": " want", "kind": "normal"}, "is_word": true, "word_id": 1121, "word_key": " want", "bytes_hex": "20 77 61 6e 74", "compression": {"rwkv": "17.13% 17.13% 17.13% 17.13% 17.13%", "qwen": "16.53% 16.53% 16.53% 16.53% 16.53%"}, "model_tokens": {"rwkv": [[32435, " want", "normal", 0.008509294129908085]], "qwen": [[1366, " want", "normal", 0.01023530401289463]]}, "loss": {"rwkv": 17.13200361055644, "qwen": 16.525756167132496}, "topk": {"rwkv": [32435, 11, 0.008509294129908085, [[47266, 0.572821, " should", false], [21286, 0.059149, " are", false], [21413, 0.054245, " can", false], [31059, 0.047191, " have", false], [31475, 0.032528, " must", false], [4491, 0.032117, " do", false], [31506, 0.028109, " need", false], [45409, 0.022205, " cannot", false], [32475, 0.018088, " will", false], [46227, 0.008578, " humans", false]]], "qwen": [1366, 11, 0.01023530401289463, [[1265, 0.475429, " should", false], [646, 0.080123, " can", false], [525, 0.070954, " are", false], [653, 0.048946, " do", false], [614, 0.043774, " have", false], [1184, 0.03069, " need", false], [4157, 0.023288, " cannot", false], [1969, 0.021519, " must", false], [686, 0.020723, " will", false], [1936, 0.014334, " build", false]]]}, "raw_delta": 0.033617496490478516, "tuned_delta": 0.040954635004181256}, {"byte_start": 6671, "byte_end": 6674, "display": {"text": " AI", "kind": "normal"}, "is_word": true, "word_id": 1122, "word_key": " ai", "bytes_hex": "20 41 49", "compression": {"rwkv": "33.63% 33.63% 33.63%", "qwen": "33.82% 33.82% 33.82%"}, "model_tokens": {"rwkv": [[3609, " AI", "normal", 0.003760707564651966]], "qwen": [[15235, " AI", "normal", 0.003602352924644947]]}, "loss": {"rwkv": 33.625314104052656, "qwen": 33.82018764574531}, "topk": {"rwkv": [3609, 19, 0.003760707564651966, [[4811, 0.381438, " to", false], [22248, 0.168507, " our", false], [52224, 0.097623, " methods", false], [22590, 0.06869, " the", false], [332, 0.041422, " a", false], [30992, 0.023749, " good", false], [39936, 0.018056, " these", false], [32229, 0.016651, " them", false], [47202, 0.010847, " search", false], [4419, 0.00818, " an", false]]], "qwen": [15235, 19, 0.003602352924644947, [[311, 0.431843, " to", false], [1039, 0.151343, " our", false], [279, 0.06933, " the", false], [5413, 0.062271, " methods", false], [1105, 0.055695, " them", false], [264, 0.020451, " a", false], [1493, 0.020378, " these", false], [13009, 0.007229, " agents", false], [458, 0.006334, " an", false], [18495, 0.00584, " computers", false]]]}, "raw_delta": -0.010806083679199219, "tuned_delta": -0.003468945165496482}, {"byte_start": 6674, "byte_end": 6681, "display": {"text": " agents", "kind": "normal"}, "is_word": true, "word_id": 1123, "word_key": " agents", "bytes_hex": "20 61 67 65 6e 74 73", "compression": {"rwkv": "5.03% 5.03% 5.03% 5.03% 5.03% 5.03% 5.03%", "qwen": "4.27% 4.27% 4.27% 4.27% 4.27% 4.27% 4.27%"}, "model_tokens": {"rwkv": [[45124, " agents", "normal", 0.1399744600057602]], "qwen": [[13009, " agents", "normal", 0.19034291803836823]]}, "loss": {"rwkv": 5.031720985243315, "qwen": 4.273798663792818}, "topk": {"rwkv": [45124, 4, 0.1399744600057602, [[53087, 0.242502, " systems", false], [4811, 0.199609, " to", false], [52224, 0.194399, " methods", false], [45124, 0.139974, " agents", false], [63843, 0.051099, " researchers", false], [57103, 0.044614, " research", false], [32227, 0.022472, " that", false], [56949, 0.01724, " programs", false], [116, 0.013439, "s", false], [45, 0.010417, ",", false]]], "qwen": [13009, 3, 0.19034291803836823, [[5942, 0.341456, " systems", false], [311, 0.200749, " to", false], [13009, 0.190343, " agents", false], [5413, 0.066325, " methods", false], [429, 0.04606, " that", false], [11811, 0.04474, " researchers", false], [3412, 0.025602, " research", false], [7468, 0.008014, " programs", false], [11, 0.006924, ",", false], [537, 0.003817, " not", false]]]}, "raw_delta": 0.04202813761574883, "tuned_delta": 0.04936527612945156}, {"byte_start": 6681, "byte_end": 6686, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 1124, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"rwkv": "3.92% 3.92% 3.92% 3.92% 3.92%", "qwen": "3.77% 3.77% 3.77% 3.77% 3.77%"}, "model_tokens": {"rwkv": [[32227, " that", "normal", 0.33919060230255127]], "qwen": [[429, " that", "normal", 0.35199281573295593]]}, "loss": {"rwkv": 3.9166916149133963, "qwen": 3.7659552707815522}, "topk": {"rwkv": [32227, 2, 0.33919060230255127, [[4811, 0.520668, " to", false], [32227, 0.339191, " that", false], [22762, 0.032211, " who", false], [45, 0.029602, ",", false], [32487, 0.014748, " with", false], [40191, 0.008318, " whose", false], [51127, 0.005618, " capable", false], [21265, 0.004605, " and", false], [4596, 0.003761, " in", false], [275, 0.003637, " (", false]]], "qwen": [429, 2, 0.35199281573295593, [[311, 0.565987, " to", false], [429, 0.351993, " that", false], [448, 0.011837, " with", false], [11, 0.010759, ",", false], [6693, 0.005431, " whose", false], [879, 0.005186, " who", false], [2952, 0.004026, " able", false], [537, 0.003776, " not", false], [12875, 0.003059, " capable", false], [5798, 0.002581, " built", false]]]}, "raw_delta": 0.008358597755432129, "tuned_delta": 0.015695736269134865}, {"byte_start": 6686, "byte_end": 6690, "display": {"text": " can", "kind": "normal"}, "is_word": true, "word_id": 1125, "word_key": " can", "bytes_hex": "20 63 61 6e", "compression": {"rwkv": "4.68% 4.68% 4.68% 4.68%", "qwen": "4.18% 4.18% 4.18% 4.18%"}, "model_tokens": {"rwkv": [[21413, " can", "normal", 0.3550959825515747]], "qwen": [[646, " can", "normal", 0.3953403830528259]]}, "loss": {"rwkv": 4.684532237261526, "qwen": 4.18385258194923}, "topk": {"rwkv": [21413, 1, 0.3550959825515747, [[21413, 0.355096, " can", false], [21286, 0.168078, " are", false], [30858, 0.051808, " find", false], [31059, 0.036422, " have", false], [4491, 0.035775, " do", false], [38877, 0.02443, " learn", false], [47202, 0.020374, " search", false], [32475, 0.019544, " will", false], [22681, 0.017564, " use", false], [39942, 0.01729, " think", false]]], "qwen": [646, 1, 0.3953403830528259, [[646, 0.39534, " can", false], [525, 0.170227, " are", false], [3960, 0.036257, " learn", false], [614, 0.029221, " have", false], [653, 0.026931, " do", false], [686, 0.022574, " will", false], [1477, 0.018476, " find", false], [975, 0.015161, " work", false], [1744, 0.014971, " think", false], [11, 0.010416, ",", false]]]}, "raw_delta": 0.027763575315475464, "tuned_delta": 0.035100713829178204}, {"byte_start": 6690, "byte_end": 6699, "display": {"text": " discover", "kind": "normal"}, "is_word": true, "word_id": 1126, "word_key": " discover", "bytes_hex": "20 64 69 73 63 6f 76 65 72", "compression": {"rwkv": "7.95% 7.95% 7.95% 7.95% 7.95% 7.95% 7.95% 7.95% 7.95%", "qwen": "8.66% 8.66% 8.66% 8.66% 8.66% 8.66% 8.66% 8.66% 8.66%"}, "model_tokens": {"rwkv": [[56010, " discover", "normal", 0.018892979249358177]], "qwen": [[6997, " discover", "normal", 0.013267488218843937]]}, "loss": {"rwkv": 7.952355477122325, "qwen": 8.661056807501929}, "topk": {"rwkv": [56010, 7, 0.018892979249358177, [[30858, 0.27055, " find", false], [38877, 0.074919, " learn", false], [4491, 0.049321, " do", false], [47202, 0.045693, " search", false], [39942, 0.032728, " think", false], [4435, 0.027714, " be", false], [56010, 0.018893, " discover", false], [63292, 0.018513, " approximate", false], [22681, 0.018304, " use", false], [37923, 0.016654, " build", false]]], "qwen": [6997, 13, 0.013267488218843937, [[1477, 0.163343, " find", false], [3960, 0.0668, " learn", false], [653, 0.063917, " do", false], [1744, 0.040563, " think", false], [11625, 0.026984, " solve", false], [2711, 0.02423, " search", false], [387, 0.022677, " be", false], [1936, 0.019734, " build", false], [1281, 0.018899, " make", false], [2874, 0.017637, " reason", false]]]}, "raw_delta": -0.03929874632093644, "tuned_delta": -0.0319616078072337}, {"byte_start": 6699, "byte_end": 6704, "display": {"text": " like", "kind": "normal"}, "is_word": true, "word_id": 1127, "word_key": " like", "bytes_hex": "20 6c 69 6b 65", "compression": {"rwkv": "36.07% 36.07% 36.07% 36.07% 36.07%", "qwen": "32.17% 32.17% 32.17% 32.17% 32.17%"}, "model_tokens": {"rwkv": [[31296, " like", "normal", 4.6584904339397326e-05]], "qwen": [[1075, " like", "normal", 0.00013390577805694193]]}, "loss": {"rwkv": 36.06737602222408, "qwen": 32.1662350786017}, "topk": {"rwkv": [31296, 497, 4.6584904339397326e-05, [[22590, 0.147892, " the", false], [21265, 0.084655, " and", false], [30992, 0.066648, " good", false], [45, 0.060637, ",", false], [39931, 0.056924, " their", false], [39936, 0.053667, " these", false], [22168, 0.044699, " new", false], [52224, 0.036966, " methods", false], [21835, 0.036459, " how", false], [32464, 0.031666, " what", false]]], "qwen": [1075, 249, 0.00013390577805694193, [[279, 0.162703, " the", false], [323, 0.109268, " and", false], [369, 0.064706, " for", false], [862, 0.062624, " their", false], [1128, 0.058175, " what", false], [1661, 0.057383, " good", false], [11, 0.041455, ",", false], [1493, 0.039444, " these", false], [1246, 0.029323, " how", false], [2513, 0.02278, " things", false]]]}, "raw_delta": 0.21632518768310538, "tuned_delta": 0.22366232619680812}, {"byte_start": 6704, "byte_end": 6707, "display": {"text": " we", "kind": "normal"}, "is_word": true, "word_id": 1128, "word_key": " we", "bytes_hex": "20 77 65", "compression": {"rwkv": "12.68% 12.68% 12.68%", "qwen": "11.68% 11.68% 11.68%"}, "model_tokens": {"rwkv": [[4858, " we", "normal", 0.12293319404125214]], "qwen": [[582, " we", "normal", 0.14333263039588928]]}, "loss": {"rwkv": 12.679936882813154, "qwen": 11.677338222210782}, "topk": {"rwkv": [4858, 2, 0.12293319404125214, [[4835, 0.445539, " us", false], [4858, 0.122933, " we", false], [46227, 0.075263, " humans", false], [52224, 0.040122, " methods", false], [32234, 0.033084, " this", false], [46, 0.032214, "-", false], [38720, 0.02475, " human", false], [22248, 0.021068, " our", false], [22590, 0.020151, " the", false], [26307, 0.019696, "ness", false]]], "qwen": [582, 3, 0.14333263039588928, [[601, 0.288519, " us", false], [33323, 0.180082, "-minded", false], [582, 0.143333, " we", false], [12677, 0.092214, " humans", false], [13217, 0.027994, " ourselves", false], [3738, 0.027534, " human", false], [264, 0.024417, " a", false], [5577, 0.018602, " themselves", false], [279, 0.018061, " the", false], [20062, 0.014807, " minds", false]]]}, "raw_delta": 0.05559587478637695, "tuned_delta": 0.0629330133000797}, {"byte_start": 6707, "byte_end": 6711, "display": {"text": " can", "kind": "normal"}, "is_word": true, "word_id": 1129, "word_key": " can", "bytes_hex": "20 63 61 6e", "compression": {"rwkv": "15.50% 15.50% 15.50% 15.50%", "qwen": "8.59% 8.59% 8.59% 8.59%"}, "model_tokens": {"rwkv": [[21413, " can", "normal", 0.03212219104170799]], "qwen": [[646, " can", "normal", 0.14863568544387817]]}, "loss": {"rwkv": 15.49770063454941, "qwen": 8.594211152096834}, "topk": {"rwkv": [21413, 3, 0.03212219104170799, [[4491, 0.852939, " do", false], [56010, 0.05113, " discover", false], [21413, 0.032122, " can", false], [31059, 0.011253, " have", false], [21532, 0.00928, " did", false], [46227, 0.007689, " humans", false], [40219, 0.006771, " would", false], [60112, 0.003744, " ourselves", false], [39021, 0.003565, " might", false], [61885, 0.002275, " discovered", false]]], "qwen": [646, 3, 0.14863568544387817, [[653, 0.568086, " do", false], [6997, 0.174734, " discover", false], [646, 0.148636, " can", false], [1521, 0.021359, " did", false], [11105, 0.010338, " discovered", false], [1410, 0.007818, " could", false], [1035, 0.007264, " would", false], [1477, 0.007214, " find", false], [11, 0.006526, ",", false], [1744, 0.006406, " think", false]]]}, "raw_delta": 0.3828107416629791, "tuned_delta": 0.39014788017668184}, {"byte_start": 6711, "byte_end": 6712, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "11.41%", "qwen": "13.22%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.5289064049720764]], "qwen": [[11, ",", "normal", 0.48036783933639526]]}, "loss": {"rwkv": 11.411943194531839, "qwen": 13.222356190044069}, "topk": {"rwkv": [45, 1, 0.5289064049720764, [[45, 0.528906, ",", false], [47, 0.181639, ".", false], [56010, 0.06384, " discover", false], [5346, 0.063762, "---", false], [60, 0.035638, ";", false], [21265, 0.021945, " and", false], [4596, 0.013222, " in", false], [59, 0.011791, ":", false], [275, 0.009209, " (", false], [21400, 0.004757, " but", false]]], "qwen": [11, 1, 0.48036783933639526, [[11, 0.480368, ",", false], [6997, 0.207943, " discover", false], [13, 0.099656, ".", false], [4421, 0.064796, "---", false], [382, 0.043028, ".\n\n", false], [26, 0.024823, ";", false], [320, 0.007874, " (", false], [323, 0.007799, " and", false], [25, 0.007231, ":", false], [1477, 0.004184, " find", false]]]}, "raw_delta": -0.10039061307907104, "tuned_delta": -0.0930534745653683}, {"byte_start": 6712, "byte_end": 6716, "display": {"text": " not", "kind": "normal"}, "is_word": true, "word_id": 1130, "word_key": " not", "bytes_hex": "20 6e 6f 74", "compression": {"rwkv": "7.64% 7.64% 7.64% 7.64%", "qwen": "7.45% 7.45% 7.45% 7.45%"}, "model_tokens": {"rwkv": [[22187, " not", "normal", 0.18526971340179443]], "qwen": [[537, " not", "normal", 0.19144868850708008]]}, "loss": {"rwkv": 7.643184176584596, "qwen": 7.453032633549699}, "topk": {"rwkv": [22187, 2, 0.18526971340179443, [[21265, 0.188898, " and", false], [22187, 0.18527, " not", false], [21400, 0.145465, " but", false], [47001, 0.046234, " rather", false], [32227, 0.040212, " that", false], [4450, 0.030805, " by", false], [4596, 0.027682, " in", false], [4788, 0.026189, " so", false], [4715, 0.025331, " or", false], [4811, 0.017496, " to", false]]], "qwen": [537, 2, 0.19144868850708008, [[323, 0.224467, " and", false], [537, 0.191449, " not", false], [714, 0.158138, " but", false], [553, 0.039503, " by", false], [429, 0.02697, " that", false], [2041, 0.026324, " without", false], [476, 0.023965, " or", false], [4751, 0.023311, " rather", false], [448, 0.023124, " with", false], [773, 0.020411, " so", false]]]}, "raw_delta": 0.010544240474700928, "tuned_delta": 0.017881378988403664}, {"byte_start": 6716, "byte_end": 6722, "display": {"text": " which", "kind": "normal"}, "is_word": true, "word_id": 1131, "word_key": " which", "bytes_hex": "20 77 68 69 63 68", "compression": {"rwkv": "22.45% 22.45% 22.45% 22.45% 22.45% 22.45%", "qwen": "26.25% 26.25% 26.25% 26.25% 26.25% 26.25%"}, "model_tokens": {"rwkv": [[40186, " which", "normal", 0.0005667924997396767]], "qwen": [[892, " which", "normal", 0.0001608761231182143]]}, "loss": {"rwkv": 22.448184555498845, "qwen": 26.25367046853784}, "topk": {"rwkv": [40186, 74, 0.0005667924997396767, [[31296, 0.348727, " like", false], [32227, 0.16236, " that", false], [31580, 0.067522, " ones", false], [31198, 0.052766, " just", false], [3609, 0.038088, " AI", false], [45124, 0.036987, " agents", false], [56010, 0.032506, " discover", false], [22590, 0.01857, " the", false], [39944, 0.016601, " those", false], [4423, 0.015503, " as", false]]], "qwen": [892, 153, 0.0001608761231182143, [[1075, 0.258698, " like", false], [429, 0.23203, " that", false], [6997, 0.062718, " discover", false], [1101, 0.053694, " just", false], [6174, 0.038152, " ones", false], [279, 0.03279, " the", false], [825, 0.025358, " one", false], [13009, 0.025107, " agents", false], [15235, 0.02273, " AI", false], [553, 0.022475, " by", false]]]}, "raw_delta": -0.21102094650268555, "tuned_delta": -0.2036838079889828}, {"byte_start": 6722, "byte_end": 6730, "display": {"text": " contain", "kind": "normal"}, "is_word": true, "word_id": 1132, "word_key": " contain", "bytes_hex": "20 63 6f 6e 74 61 69 6e", "compression": {"rwkv": "19.02% 19.02% 19.02% 19.02% 19.02% 19.02% 19.02% 19.02%", "qwen": "19.92% 19.92% 19.92% 19.92% 19.92% 19.92% 19.92% 19.92%"}, "model_tokens": {"rwkv": [[51306, " contain", "normal", 0.00022376440756488591]], "qwen": [[6644, " contain", "normal", 0.00014512930647470057]]}, "loss": {"rwkv": 19.01990532421973, "qwen": 19.922457377248936}, "topk": {"rwkv": [51306, 151, 0.00022376440756488591, [[4858, 0.307145, " we", false], [21413, 0.286255, " can", false], [4706, 0.028424, " of", false], [31296, 0.027398, " like", false], [21286, 0.027122, " are", false], [22752, 0.020349, " way", false], [31580, 0.018615, " ones", false], [31059, 0.015789, " have", false], [56010, 0.015693, " discover", false], [4600, 0.009122, " is", false]]], "qwen": [6644, 286, 0.00014512930647470057, [[582, 0.509987, " we", false], [315, 0.054849, " of", false], [646, 0.046551, " can", false], [374, 0.044929, " is", false], [525, 0.02955, " are", false], [1075, 0.015272, " like", false], [1616, 0.011093, " way", false], [5510, 0.009118, " ways", false], [5413, 0.008642, " methods", false], [11, 0.008383, ",", false]]]}, "raw_delta": -0.050048112869262695, "tuned_delta": -0.042710974355559955}, {"byte_start": 6730, "byte_end": 6735, "display": {"text": " what", "kind": "normal"}, "is_word": true, "word_id": 1133, "word_key": " what", "bytes_hex": "20 77 68 61 74", "compression": {"rwkv": "9.41% 9.41% 9.41% 9.41% 9.41%", "qwen": "11.11% 11.11% 11.11% 11.11% 11.11%"}, "model_tokens": {"rwkv": [[32464, " what", "normal", 0.07396214455366135]], "qwen": [[1128, " what", "normal", 0.045924846082925797]]}, "loss": {"rwkv": 9.411330930799096, "qwen": 11.11145338711783}, "topk": {"rwkv": [32464, 4, 0.07396214455366135, [[31296, 0.360174, " like", false], [22248, 0.126501, " our", false], [22590, 0.089253, " the", false], [32464, 0.073962, " what", false], [59943, 0.060057, " knowledge", false], [4596, 0.025612, " in", false], [38720, 0.021304, " human", false], [4835, 0.019227, " us", false], [32227, 0.018806, " that", false], [332, 0.015148, " a", false]]], "qwen": [1128, 4, 0.045924846082925797, [[1039, 0.192355, " our", false], [601, 0.074176, " us", false], [279, 0.071885, " the", false], [1128, 0.045925, " what", false], [678, 0.043658, " all", false], [304, 0.040075, " in", false], [264, 0.038176, " a", false], [1075, 0.030652, " like", false], [2878, 0.026761, " within", false], [43613, 0.026124, " representations", false]]]}, "raw_delta": -0.0942748069763184, "tuned_delta": -0.08693766846261566}, {"byte_start": 6735, "byte_end": 6738, "display": {"text": " we", "kind": "normal"}, "is_word": true, "word_id": 1134, "word_key": " we", "bytes_hex": "20 77 65", "compression": {"rwkv": "0.65% 0.65% 0.65%", "qwen": "0.56% 0.56% 0.56%"}, "model_tokens": {"rwkv": [[4858, " we", "normal", 0.8968513011932373]], "qwen": [[582, " we", "normal", 0.9115656614303589]]}, "loss": {"rwkv": 0.6516078675890092, "qwen": 0.5565898267061866}, "topk": {"rwkv": [4858, 1, 0.8968513011932373, [[4858, 0.896851, " we", false], [31296, 0.020356, " like", false], [22248, 0.008127, " our", false], [4600, 0.00737, " is", false], [21413, 0.005825, " can", false], [32232, 0.005258, " they", false], [46227, 0.003963, " humans", false], [332, 0.00354, " a", false], [22590, 0.003478, " the", false], [4601, 0.002226, " it", false]]], "qwen": [582, 1, 0.9115656614303589, [[582, 0.911566, " we", false], [374, 0.010946, " is", false], [1039, 0.007368, " our", false], [7952, 0.003925, " appears", false], [304, 0.002683, " in", false], [5868, 0.002403, " looks", false], [807, 0.002394, " they", false], [4977, 0.002156, " seems", false], [3643, 0.002092, " makes", false], [12677, 0.002075, " humans", false]]]}, "raw_delta": 0.005268918971220653, "tuned_delta": 0.01260605748492339}, {"byte_start": 6738, "byte_end": 6743, "display": {"text": " have", "kind": "normal"}, "is_word": true, "word_id": 1135, "word_key": " have", "bytes_hex": "20 68 61 76 65", "compression": {"rwkv": "10.71% 10.71% 10.71% 10.71% 10.71%", "qwen": "15.79% 15.79% 15.79% 15.79% 15.79%"}, "model_tokens": {"rwkv": [[31059, " have", "normal", 0.050879254937171936]], "qwen": [[614, " have", "normal", 0.012539910152554512]]}, "loss": {"rwkv": 10.707502256597774, "qwen": 15.793323332944}, "topk": {"rwkv": [31059, 5, 0.050879254937171936, [[21413, 0.228571, " can", false], [39942, 0.158661, " think", false], [31223, 0.152265, " know", false], [4491, 0.097188, " do", false], [31059, 0.050879, " have", false], [31296, 0.039003, " like", false], [32435, 0.022002, " want", false], [39021, 0.018444, " might", false], [50888, 0.016436, " already", false], [51025, 0.016132, " believe", false]]], "qwen": [614, 9, 0.012539910152554512, [[1744, 0.472448, " think", false], [1414, 0.110558, " know", false], [1366, 0.071092, " want", false], [646, 0.048242, " can", false], [4411, 0.046941, " believe", false], [2669, 0.041109, " already", false], [653, 0.021499, " do", false], [1035, 0.015672, " would", false], [614, 0.01254, " have", false], [1477, 0.010907, " find", false]]]}, "raw_delta": -0.28201780319213865, "tuned_delta": -0.27468066467843594}, {"byte_start": 6743, "byte_end": 6754, "display": {"text": " discovered", "kind": "normal"}, "is_word": true, "word_id": 1136, "word_key": " discovered", "bytes_hex": "20 64 69 73 63 6f 76 65 72 65 64", "compression": {"rwkv": "2.46% 2.46% 2.46% 2.46% 2.46% 2.46% 2.46% 2.46% 2.46% 2.46% 2.46%", "qwen": "3.06% 3.06% 3.06% 3.06% 3.06% 3.06% 3.06% 3.06% 3.06% 3.06% 3.06%"}, "model_tokens": {"rwkv": [[61885, " discovered", "normal", 0.2222803235054016]], "qwen": [[11105, " discovered", "normal", 0.15453387796878815]]}, "loss": {"rwkv": 2.4591392742425504, "qwen": 3.061369163855374}, "topk": {"rwkv": [61885, 1, 0.2222803235054016, [[61885, 0.22228, " discovered", false], [47, 0.141644, ".", false], [52112, 0.104162, " learned", false], [4596, 0.073449, " in", false], [50888, 0.065892, " already", false], [4811, 0.041626, " to", false], [38547, 0.032957, " found", false], [53137, 0.031178, " thought", false], [45, 0.019424, ",", false], [22339, 0.017038, " put", false]]], "qwen": [11105, 2, 0.15453387796878815, [[304, 0.207364, " in", false], [11105, 0.154534, " discovered", false], [4766, 0.066517, " inside", false], [2669, 0.053761, " already", false], [1730, 0.043844, " found", false], [5798, 0.040682, " built", false], [9498, 0.036944, " learned", false], [3381, 0.029962, " thought", false], [13, 0.023349, ".", false], [382, 0.016495, ".\n\n", false]]]}, "raw_delta": -0.03339471600272439, "tuned_delta": -0.02605757748902165}, {"byte_start": 6754, "byte_end": 6755, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "4.72%", "qwen": "17.17%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.771290123462677]], "qwen": [[13, ".", "normal", 0.38600796461105347]]}, "loss": {"rwkv": 4.719754284158229, "qwen": 17.166218269075713}, "topk": {"rwkv": [47, 1, 0.771290123462677, [[47, 0.77129, ".", false], [45, 0.064693, ",", false], [4596, 0.019019, " in", false], [31296, 0.018397, " like", false], [21265, 0.013926, " and", false], [21700, 0.012867, " for", false], [50888, 0.01286, " already", false], [60, 0.010726, ";", false], [5346, 0.008973, "---", false], [60112, 0.008936, " ourselves", false]]], "qwen": [13, 1, 0.38600796461105347, [[13, 0.386008, ".", false], [382, 0.231522, ".\n\n", false], [304, 0.072136, " in", false], [11, 0.053785, ",", false], [911, 0.05076, " about", false], [323, 0.018208, " and", false], [13217, 0.017798, " ourselves", false], [2669, 0.015759, " already", false], [4766, 0.013275, " inside", false], [624, 0.012202, ".\n", false]]]}, "raw_delta": -0.6901785135269165, "tuned_delta": -0.6828413750132137}, {"byte_start": 6755, "byte_end": 6764, "display": {"text": " Building", "kind": "normal"}, "is_word": true, "word_id": 1137, "word_key": " building", "bytes_hex": "20 42 75 69 6c 64 69 6e 67", "compression": {"rwkv": "13.40% 13.40% 13.40% 13.40% 13.40% 13.40% 13.40% 13.40% 13.40%", "qwen": "12.49% 12.49% 12.49% 12.49% 12.49% 12.49% 12.49% 12.49% 12.49%"}, "model_tokens": {"rwkv": [[54879, " Building", "normal", 0.0012416080571711063]], "qwen": [[16858, " Building", "normal", 0.0019598412327468395]]}, "loss": {"rwkv": 13.400032063812418, "qwen": 12.493121683772598}, "topk": {"rwkv": [54879, 50, 0.0012416080571711063, [[261, 0.480431, "\n\n", false], [20996, 0.06535, " The", false], [4331, 0.061794, " We", false], [29894, 0.058216, " This", false], [0, 0.020259, "[0]", false], [19417, 0.01834, " And", false], [3913, 0.017177, " In", false], [37453, 0.015619, " These", false], [20571, 0.01341, " Our", false], [3918, 0.013253, " It", false]]], "qwen": [16858, 56, 0.0019598412327468395, [[1205, 0.156684, " We", false], [576, 0.135697, " The", false], [1096, 0.0787, " This", false], [758, 0.036291, " In", false], [220, 0.035951, " ", false], [1084, 0.029062, " It", false], [1597, 0.029, " And", false], [4220, 0.020506, " These", false], [1416, 0.019435, " If", false], [2014, 0.017807, " To", false]]]}, "raw_delta": 0.05028978983561205, "tuned_delta": 0.05762692834931479}, {"byte_start": 6764, "byte_end": 6767, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 1138, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "4.30% 4.30% 4.30%", "qwen": "3.09% 3.09% 3.09%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.4901551902294159]], "qwen": [[304, " in", "normal", 0.5984180569648743]]}, "loss": {"rwkv": 4.297089721397791, "qwen": 3.086560094633201}, "topk": {"rwkv": [4596, 1, 0.4901551902294159, [[4596, 0.490155, " in", false], [52224, 0.065005, " methods", false], [3609, 0.055092, " AI", false], [39936, 0.03906, " these", false], [32139, 0.036149, " such", false], [32234, 0.027693, " this", false], [22248, 0.022638, " our", false], [332, 0.017127, " a", false], [31162, 0.0149, " into", false], [22590, 0.014686, " the", false]]], "qwen": [304, 1, 0.5984180569648743, [[304, 0.598418, " in", false], [6540, 0.031385, " knowledge", false], [5413, 0.03018, " methods", false], [279, 0.027624, " the", false], [264, 0.025223, " a", false], [1039, 0.02026, " our", false], [389, 0.017346, " on", false], [1493, 0.014468, " these", false], [1741, 0.013214, " such", false], [419, 0.011646, " this", false]]]}, "raw_delta": 0.06712601582209268, "tuned_delta": 0.07446315433579542}, {"byte_start": 6767, "byte_end": 6771, "display": {"text": " our", "kind": "normal"}, "is_word": true, "word_id": 1139, "word_key": " our", "bytes_hex": "20 6f 75 72", "compression": {"rwkv": "7.57% 7.57% 7.57% 7.57%", "qwen": "8.73% 8.73% 8.73% 8.73%"}, "model_tokens": {"rwkv": [[22248, " our", "normal", 0.1880008727312088]], "qwen": [[1039, " our", "normal", 0.14410899579524994]]}, "loss": {"rwkv": 7.572740082791189, "qwen": 8.733648773512776}, "topk": {"rwkv": [22248, 1, 0.1880008727312088, [[22248, 0.188001, " our", false], [38720, 0.144361, " human", false], [32464, 0.110388, " what", false], [22590, 0.095063, " the", false], [59943, 0.07566, " knowledge", false], [21835, 0.064079, " how", false], [332, 0.032888, " a", false], [32234, 0.020948, " this", false], [39936, 0.016435, " these", false], [32139, 0.012728, " such", false]]], "qwen": [1039, 2, 0.14410899579524994, [[1128, 0.150954, " what", false], [1039, 0.144109, " our", false], [279, 0.11937, " the", false], [1246, 0.075014, " how", false], [3738, 0.067958, " human", false], [6540, 0.057701, " knowledge", false], [264, 0.026214, " a", false], [1741, 0.020343, " such", false], [894, 0.016577, " any", false], [419, 0.014827, " this", false]]]}, "raw_delta": -0.06437444686889648, "tuned_delta": -0.057037308355193744}, {"byte_start": 6771, "byte_end": 6783, "display": {"text": " discoveries", "kind": "normal"}, "is_word": true, "word_id": 1140, "word_key": " discoveries", "bytes_hex": "20 64 69 73 63 6f 76 65 72 69 65 73", "compression": {"rwkv": "8.17% 8.17% 8.17% 8.17% 8.17% 8.17% 8.17% 8.17% 8.17% 8.17% 8.17% 8.17%", "qwen": "9.32% 9.32% 9.32% 9.32% 9.32% 9.32% 9.32% 9.32% 9.32% 9.32% 9.32% 9.32%"}, "model_tokens": {"rwkv": [[63484, " discoveries", "normal", 0.004326296970248222]], "qwen": [[52998, " discoveries", "normal", 0.002021820517256856]]}, "loss": {"rwkv": 8.171514880035144, "qwen": 9.323051232879088}, "topk": {"rwkv": [63484, 25, 0.004326296970248222, [[59943, 0.232111, " knowledge", false], [22251, 0.132656, " own", false], [65034, 0.061273, " understanding", false], [38720, 0.055981, " human", false], [52224, 0.050118, " methods", false], [38735, 0.029319, " ideas", false], [32448, 0.02707, " ways", false], [39026, 0.025039, " minds", false], [57419, 0.017071, " thinking", false], [57422, 0.015383, " thoughts", false]]], "qwen": [52998, 43, 0.002021820517256856, [[1828, 0.254991, " own", false], [6540, 0.135437, " knowledge", false], [6708, 0.045557, " ideas", false], [8660, 0.039746, " understanding", false], [3738, 0.035428, " human", false], [5510, 0.035331, " ways", false], [11303, 0.032556, " thoughts", false], [1616, 0.026011, " way", false], [10502, 0.023597, " mental", false], [20062, 0.022822, " minds", false]]]}, "raw_delta": -0.06385473410288489, "tuned_delta": -0.05651759558918215}, {"byte_start": 6783, "byte_end": 6788, "display": {"text": " only", "kind": "normal"}, "is_word": true, "word_id": 1141, "word_key": " only", "bytes_hex": "20 6f 6e 6c 79", "compression": {"rwkv": "18.26% 18.26% 18.26% 18.26% 18.26%", "qwen": "16.08% 16.08% 16.08% 16.08% 16.08%"}, "model_tokens": {"rwkv": [[31581, " only", "normal", 0.006370143964886665]], "qwen": [[1172, " only", "normal", 0.01158465538173914]]}, "loss": {"rwkv": 18.25910911125094, "qwen": 16.079101744403204}, "topk": {"rwkv": [31581, 21, 0.006370143964886665, [[4600, 0.255097, " is", false], [4706, 0.1171, " of", false], [45, 0.080397, ",", false], [37598, 0.057938, " about", false], [32475, 0.039059, " will", false], [30659, 0.038065, " does", false], [4811, 0.036144, " to", false], [21265, 0.032342, " and", false], [38964, 0.019073, " makes", false], [4596, 0.015779, " in", false]]], "qwen": [1172, 16, 0.01158465538173914, [[374, 0.245717, " is", false], [11, 0.078962, ",", false], [686, 0.051181, " will", false], [1558, 0.046048, " does", false], [323, 0.039916, " and", false], [315, 0.031096, " of", false], [1035, 0.030783, " would", false], [911, 0.028587, " about", false], [3643, 0.028279, " makes", false], [311, 0.022778, " to", false]]]}, "raw_delta": 0.1208852767944335, "tuned_delta": 0.12822241530813624}, {"byte_start": 6788, "byte_end": 6794, "display": {"text": " makes", "kind": "normal"}, "is_word": true, "word_id": 1142, "word_key": " makes", "bytes_hex": "20 6d 61 6b 65 73", "compression": {"rwkv": "5.85% 5.85% 5.85% 5.85% 5.85% 5.85%", "qwen": "6.56% 6.56% 6.56% 6.56% 6.56% 6.56%"}, "model_tokens": {"rwkv": [[38964, " makes", "normal", 0.1435735672712326]], "qwen": [[3643, " makes", "normal", 0.11284811794757843]]}, "loss": {"rwkv": 5.846859784852732, "qwen": 6.557386758844204}, "topk": {"rwkv": [38964, 1, 0.1435735672712326, [[38964, 0.143574, " makes", false], [38875, 0.106222, " leads", false], [40212, 0.037512, " works", false], [39719, 0.029747, " slows", false], [45691, 0.027132, " delays", false], [30109, 0.023721, " adds", false], [30965, 0.022295, " gets", false], [38686, 0.020486, " helps", false], [47237, 0.02036, " serves", false], [38989, 0.018903, " means", false]]], "qwen": [3643, 1, 0.11284811794757843, [[3643, 0.112848, " makes", false], [69170, 0.060295, " slows", false], [11508, 0.059239, " leads", false], [81220, 0.028288, " wastes", false], [17045, 0.026327, " serves", false], [27236, 0.024041, " tends", false], [13388, 0.023396, " limits", false], [31074, 0.022752, " delays", false], [9044, 0.020737, " becomes", false], [305, 0.02037, " h", false]]]}, "raw_delta": -0.03939998149871826, "tuned_delta": -0.03206284298501552}, {"byte_start": 6794, "byte_end": 6797, "display": {"text": " it", "kind": "normal"}, "is_word": true, "word_id": 1143, "word_key": " it", "bytes_hex": "20 69 74", "compression": {"rwkv": "10.66% 10.66% 10.66%", "qwen": "15.04% 15.04% 15.04%"}, "model_tokens": {"rwkv": [[4601, " it", "normal", 0.17133721709251404]], "qwen": [[432, " it", "normal", 0.0819397121667862]]}, "loss": {"rwkv": 10.66053952740217, "qwen": 15.03872193505929}, "topk": {"rwkv": [4601, 2, 0.17133721709251404, [[22590, 0.197584, " the", false], [4601, 0.171337, " it", false], [32229, 0.122272, " them", false], [47539, 0.105951, " things", false], [4835, 0.079731, " us", false], [22248, 0.062105, " our", false], [21700, 0.042001, " for", false], [32234, 0.024939, " this", false], [39936, 0.014955, " these", false], [39931, 0.014597, " their", false]]], "qwen": [432, 4, 0.0819397121667862, [[279, 0.208293, " the", false], [1105, 0.119184, " them", false], [601, 0.115135, " us", false], [432, 0.08194, " it", false], [1039, 0.061006, " our", false], [2513, 0.045762, " things", false], [5530, 0.041568, " sense", false], [369, 0.036062, " for", false], [1493, 0.033041, " these", false], [15235, 0.028617, " AI", false]]]}, "raw_delta": -0.24277798334757483, "tuned_delta": -0.2354408448338721}, {"byte_start": 6797, "byte_end": 6804, "display": {"text": " harder", "kind": "normal"}, "is_word": true, "word_id": 1144, "word_key": " harder", "bytes_hex": "20 68 61 72 64 65 72", "compression": {"rwkv": "1.62% 1.62% 1.62% 1.62% 1.62% 1.62% 1.62%", "qwen": "1.70% 1.70% 1.70% 1.70% 1.70% 1.70% 1.70%"}, "model_tokens": {"rwkv": [[46162, " harder", "normal", 0.5326055288314819]], "qwen": [[15750, " harder", "normal", 0.5171852707862854]]}, "loss": {"rwkv": 1.6202141572483475, "qwen": 1.6986549836390592}, "topk": {"rwkv": [46162, 1, 0.5326055288314819, [[46162, 0.532606, " harder", false], [31458, 0.134851, " more", false], [31048, 0.050604, " hard", false], [45819, 0.049416, " easier", false], [59516, 0.031625, " difficult", false], [62082, 0.030636, " impossible", false], [56895, 0.017559, " possible", false], [31277, 0.013399, " less", false], [30788, 0.011633, " even", false], [40216, 0.010945, " worse", false]]], "qwen": [15750, 1, 0.5171852707862854, [[15750, 0.517185, " harder", false], [803, 0.171217, " more", false], [5000, 0.047931, " difficult", false], [2588, 0.045289, " hard", false], [8661, 0.030418, " easier", false], [11997, 0.028264, " impossible", false], [1753, 0.02736, " much", false], [2686, 0.022846, " less", false], [10960, 0.009127, " worse", false], [1602, 0.008539, " very", false]]]}, "raw_delta": -0.004349683012281141, "tuned_delta": 0.002987455501421595}, {"byte_start": 6804, "byte_end": 6807, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 1145, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "3.36% 3.36% 3.36%", "qwen": "4.58% 4.58% 4.58%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.5702154636383057]], "qwen": [[311, " to", "normal", 0.46676692366600037]]}, "loss": {"rwkv": 3.357835137485705, "qwen": 4.5801072380351435}, "topk": {"rwkv": [4811, 1, 0.5702154636383057, [[4811, 0.570215, " to", false], [21700, 0.347331, " for", false], [21265, 0.025766, " and", false], [45, 0.023029, ",", false], [47, 0.010901, ".", false], [38869, 0.005975, " later", false], [4596, 0.004291, " in", false], [22187, 0.001156, " not", false], [5346, 0.001038, "---", false], [275, 0.000921, " (", false]]], "qwen": [311, 2, 0.46676692366600037, [[369, 0.474168, " for", false], [311, 0.466767, " to", false], [11, 0.020797, ",", false], [323, 0.014098, " and", false], [304, 0.003788, " in", false], [382, 0.002963, ".\n\n", false], [13, 0.00262, ".", false], [2937, 0.002214, " later", false], [320, 0.001455, " (", false], [1091, 0.000865, " than", false]]]}, "raw_delta": -0.06777715682983401, "tuned_delta": -0.06044001831613127}, {"byte_start": 6807, "byte_end": 6811, "display": {"text": " see", "kind": "normal"}, "is_word": true, "word_id": 1146, "word_key": " see", "bytes_hex": "20 73 65 65", "compression": {"rwkv": "20.71% 20.71% 20.71% 20.71%", "qwen": "23.37% 23.37% 23.37% 23.37%"}, "model_tokens": {"rwkv": [[22449, " see", "normal", 0.010286270640790462]], "qwen": [[1490, " see", "normal", 0.005611109547317028]]}, "loss": {"rwkv": 20.710563575261485, "qwen": 23.367181732922425}, "topk": {"rwkv": [22449, 10, 0.010286270640790462, [[56010, 0.348179, " discover", false], [30858, 0.28432, " find", false], [31358, 0.049123, " make", false], [37923, 0.041945, " build", false], [4491, 0.027143, " do", false], [38877, 0.025571, " learn", false], [21751, 0.015759, " get", false], [55851, 0.010823, " continue", false], [31205, 0.010527, " keep", false], [22449, 0.010286, " see", false]]], "qwen": [1490, 20, 0.005611109547317028, [[6997, 0.197757, " discover", false], [1477, 0.197086, " find", false], [1936, 0.079119, " build", false], [1281, 0.06395, " make", false], [653, 0.033076, " do", false], [5452, 0.029453, " scale", false], [633, 0.026675, " get", false], [7269, 0.024902, " improve", false], [3960, 0.022128, " learn", false], [11075, 0.018933, " achieve", false]]]}, "raw_delta": -0.147314190864563, "tuned_delta": -0.13997705235086025}, {"byte_start": 6811, "byte_end": 6815, "display": {"text": " how", "kind": "normal"}, "is_word": true, "word_id": 1147, "word_key": " how", "bytes_hex": "20 68 6f 77", "compression": {"rwkv": "10.85% 10.85% 10.85% 10.85%", "qwen": "7.47% 7.47% 7.47% 7.47%"}, "model_tokens": {"rwkv": [[21835, " how", "normal", 0.09116177260875702]], "qwen": [[1246, " how", "normal", 0.19070583581924438]]}, "loss": {"rwkv": 10.848390444184586, "qwen": 7.470559278009971}, "topk": {"rwkv": [21835, 3, 0.09116177260875702, [[22590, 0.211943, " the", false], [32464, 0.182443, " what", false], [21835, 0.091162, " how", false], [32229, 0.090144, " them", false], [22168, 0.057789, " new", false], [32227, 0.029298, " that", false], [21265, 0.026005, " and", false], [22248, 0.018847, " our", false], [39936, 0.017489, " these", false], [51816, 0.016837, " further", false]]], "qwen": [1246, 3, 0.19070583581924438, [[1128, 0.219279, " what", false], [279, 0.196197, " the", false], [1246, 0.190706, " how", false], [429, 0.055472, " that", false], [1380, 0.043963, " where", false], [1039, 0.03091, " our", false], [1105, 0.026745, " them", false], [501, 0.020996, " new", false], [323, 0.014204, " and", false], [979, 0.012656, " when", false]]]}, "raw_delta": 0.1873067319393158, "tuned_delta": 0.19464387045301854}, {"byte_start": 6815, "byte_end": 6819, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 1148, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "11.41% 11.41% 11.41% 11.41%", "qwen": "10.42% 10.42% 10.42% 10.42%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.0800740048289299]], "qwen": [[279, " the", "normal", 0.0990520566701889]]}, "loss": {"rwkv": 11.411943194531839, "qwen": 10.423967358819077}, "topk": {"rwkv": [22590, 2, 0.0800740048289299, [[4811, 0.457365, " to", false], [22590, 0.080074, " the", false], [32232, 0.079312, " they", false], [4858, 0.072639, " we", false], [22248, 0.053443, " our", false], [31466, 0.046823, " much", false], [39936, 0.020099, " these", false], [3609, 0.017004, " AI", false], [39944, 0.011843, " those", false], [21660, 0.007374, " far", false]]], "qwen": [279, 3, 0.0990520566701889, [[311, 0.27446, " to", false], [582, 0.129452, " we", false], [279, 0.099052, " the", false], [807, 0.088681, " they", false], [1039, 0.063842, " our", false], [1753, 0.028114, " much", false], [1493, 0.026621, " these", false], [15235, 0.02435, " AI", false], [3041, 0.021774, " far", false], [2513, 0.01097, " things", false]]]}, "raw_delta": 0.05478501319885254, "tuned_delta": 0.06212215171255528}, {"byte_start": 6819, "byte_end": 6831, "display": {"text": " discovering", "kind": "normal"}, "is_word": true, "word_id": 1149, "word_key": " discovering", "bytes_hex": "20 64 69 73 63 6f 76 65 72 69 6e 67", "compression": {"rwkv": "10.85% 10.85% 10.85% 10.85% 10.85% 10.85% 10.85% 10.85% 10.85% 10.85% 10.85% 10.85%", "qwen": "11.51% 11.51% 11.51% 11.51% 11.51% 11.51% 11.51% 11.51% 11.51% 11.51% 11.51% 11.51%"}, "model_tokens": {"rwkv": [[63485, " discovering", "normal", 0.000732090265955776]], "qwen": [[41587, " discovering", "normal", 0.00047218933468684554]]}, "loss": {"rwkv": 10.848390444184586, "qwen": 11.508694901152227}, "topk": {"rwkv": [63485, 102, 0.000732090265955776, [[37636, 0.163121, " agent", false], [40213, 0.103612, " world", false], [45124, 0.068925, " agents", false], [52224, 0.054678, " methods", false], [3609, 0.04211, " AI", false], [59544, 0.039181, " discovery", false], [63484, 0.035616, " discoveries", false], [31427, 0.032576, " mind", false], [52391, 0.032253, " outside", false], [31835, 0.02154, " real", false]]], "qwen": [41587, 131, 0.00047218933468684554, [[1879, 0.122462, " world", false], [8315, 0.114564, " agent", false], [15235, 0.097821, " AI", false], [13009, 0.080342, " agents", false], [52998, 0.069388, " discoveries", false], [18335, 0.04886, " discovery", false], [5413, 0.035019, " methods", false], [1849, 0.023291, " system", false], [11105, 0.023193, " discovered", false], [1931, 0.017734, " real", false]]]}, "raw_delta": -0.03661505381266272, "tuned_delta": -0.029277915298959987}, {"byte_start": 6831, "byte_end": 6839, "display": {"text": " process", "kind": "normal"}, "is_word": true, "word_id": 1150, "word_key": " process", "bytes_hex": "20 70 72 6f 63 65 73 73", "compression": {"rwkv": "6.97% 6.97% 6.97% 6.97% 6.97% 6.97% 6.97% 6.97%", "qwen": "6.32% 6.32% 6.32% 6.32% 6.32% 6.32% 6.32% 6.32%"}, "model_tokens": {"rwkv": [[52571, " process", "normal", 0.04531576484441757]], "qwen": [[1882, " process", "normal", 0.06064356863498688]]}, "loss": {"rwkv": 6.9739652855472345, "qwen": 6.317970785469655}, "topk": {"rwkv": [52571, 4, 0.04531576484441757, [[4600, 0.148359, " is", false], [21413, 0.124032, " can", false], [37636, 0.113327, " agent", false], [52571, 0.045316, " process", false], [51896, 0.044143, " happens", false], [38128, 0.032347, " could", false], [40212, 0.032036, " works", false], [22748, 0.031812, " was", false], [39021, 0.027612, " might", false], [52224, 0.02573, " methods", false]]], "qwen": [1882, 7, 0.06064356863498688, [[646, 0.159018, " can", false], [1410, 0.095712, " could", false], [8315, 0.08047, " agent", false], [4278, 0.076773, " works", false], [374, 0.075503, " is", false], [1265, 0.065869, " should", false], [1882, 0.060644, " process", false], [3520, 0.036977, " actually", false], [5413, 0.026838, " methods", false], [572, 0.026468, " was", false]]]}, "raw_delta": 0.03637605905532837, "tuned_delta": 0.04371319756903111}, {"byte_start": 6839, "byte_end": 6843, "display": {"text": " can", "kind": "normal"}, "is_word": true, "word_id": 1151, "word_key": " can", "bytes_hex": "20 63 61 6e", "compression": {"rwkv": "8.28% 8.28% 8.28% 8.28%", "qwen": "9.65% 9.65% 9.65% 9.65%"}, "model_tokens": {"rwkv": [[21413, " can", "normal", 0.16019323468208313]], "qwen": [[646, " can", "normal", 0.11752419918775558]]}, "loss": {"rwkv": 8.277181020725253, "qwen": 9.653031478712043}, "topk": {"rwkv": [21413, 2, 0.16019323468208313, [[40212, 0.253306, " works", false], [21413, 0.160193, " can", false], [46342, 0.117424, " itself", false], [38128, 0.086728, " could", false], [39021, 0.077251, " might", false], [4600, 0.044465, " is", false], [47266, 0.024825, " should", false], [55448, 0.017539, " actually", false], [22074, 0.017034, " may", false], [30988, 0.016146, " goes", false]]], "qwen": [646, 2, 0.11752419918775558, [[4278, 0.37059, " works", false], [646, 0.117524, " can", false], [5086, 0.064597, " itself", false], [1410, 0.063524, " could", false], [1265, 0.060406, " should", false], [3520, 0.059734, " actually", false], [2578, 0.044, " might", false], [374, 0.037924, " is", false], [2167, 0.033396, " really", false], [1035, 0.018969, " would", false]]]}, "raw_delta": -0.07629334926605225, "tuned_delta": -0.0689562107523495}, {"byte_start": 6843, "byte_end": 6846, "display": {"text": " be", "kind": "normal"}, "is_word": true, "word_id": 1152, "word_key": " be", "bytes_hex": "20 62 65", "compression": {"rwkv": "4.98% 4.98% 4.98%", "qwen": "5.28% 5.28% 5.28%"}, "model_tokens": {"rwkv": [[4435, " be", "normal", 0.4363786578178406]], "qwen": [[387, " be", "normal", 0.4152001440525055]]}, "loss": {"rwkv": 4.9780492947340536, "qwen": 5.283838389237209}, "topk": {"rwkv": [4435, 1, 0.4363786578178406, [[4435, 0.436379, " be", false], [32499, 0.126246, " work", false], [52570, 0.067917, " proceed", false], [55851, 0.054353, " continue", false], [4559, 0.047789, " go", false], [39590, 0.029026, " scale", false], [46342, 0.015794, " itself", false], [46159, 0.015218, " happen", false], [39166, 0.01187, " occur", false], [32187, 0.009245, " take", false]]], "qwen": [387, 1, 0.4152001440525055, [[387, 0.4152, " be", false], [975, 0.147852, " work", false], [10354, 0.076191, " proceed", false], [3060, 0.061021, " continue", false], [5452, 0.036785, " scale", false], [728, 0.034755, " go", false], [5086, 0.013146, " itself", false], [11996, 0.013124, " succeed", false], [1477, 0.012888, " find", false], [3537, 0.01178, " happen", false]]]}, "raw_delta": -0.016956547896067264, "tuned_delta": -0.009619409382364528}, {"byte_start": 6846, "byte_end": 6851, "display": {"text": " done", "kind": "normal"}, "is_word": true, "word_id": 1153, "word_key": " done", "bytes_hex": "20 64 6f 6e 65", "compression": {"rwkv": "10.43% 10.43% 10.43% 10.43% 10.43%", "qwen": "11.39% 11.39% 11.39% 11.39% 11.39%"}, "model_tokens": {"rwkv": [[30666, " done", "normal", 0.05511769279837608]], "qwen": [[2814, " done", "normal", 0.04250689595937729]]}, "loss": {"rwkv": 10.425725881424148, "qwen": 11.390398067945}, "topk": {"rwkv": [30666, 4, 0.05511769279837608, [[59203, 0.203805, " automated", false], [31351, 0.105263, " made", false], [56418, 0.091931, " improved", false], [30666, 0.055118, " done", false], [63594, 0.03889, " generalized", false], [56189, 0.033822, " extended", false], [50937, 0.019193, " applied", false], [63246, 0.01874, " accelerated", false], [38547, 0.018107, " found", false], [55689, 0.016281, " captured", false]]], "qwen": [2814, 5, 0.04250689595937729, [[27498, 0.193687, " automated", false], [1865, 0.114809, " made", false], [12944, 0.06158, " improved", false], [30690, 0.057649, " scaled", false], [2814, 0.042507, " done", false], [66117, 0.037587, " generalized", false], [11577, 0.030584, " extended", false], [8570, 0.022971, " continued", false], [85610, 0.02253, " sped", false], [11691, 0.020541, " carried", false]]]}, "raw_delta": -0.05349278450012207, "tuned_delta": -0.04615564598641933}, {"byte_start": 6851, "byte_end": 6853, "display": {"text": ".\n", "kind": "control"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e 0a", "compression": {"rwkv": "28.88% 96.37%", "qwen": "45.90% 45.90%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.2023681104183197], [11, "\n", "control", 0.0046869907528162]], "qwen": [[624, ".\n", "control", 0.006153350230306387]]}, "loss": {"rwkv": 62.624799382338296, "qwen": 45.90257367451315}, "topk": {"rwkv": [47, 1, 0.2023681104183197, [[47, 0.202368, ".", false], [4450, 0.151416, " by", false], [4596, 0.091885, " in", false], [45301, 0.091735, " better", false], [45, 0.086847, ",", false], [31458, 0.039052, " more", false], [4424, 0.026907, " at", false], [32458, 0.022975, " well", false], [64839, 0.021832, " automatically", false], [63507, 0.01626, " effectively", false]]], "qwen": [624, 20, 0.006153350230306387, [[553, 0.132295, " by", false], [13, 0.127566, ".", false], [304, 0.122575, " in", false], [382, 0.113753, ".\n\n", false], [11, 0.091856, ",", false], [2664, 0.084548, " better", false], [803, 0.043739, " more", false], [9463, 0.017869, " automatically", false], [29720, 0.016849, " efficiently", false], [1632, 0.016194, " well", false]]]}, "raw_delta": 0.9272770881652832, "tuned_delta": 0.934614226678986}], "meta": {"model_a": "RWKV7-G1D-1.5B", "model_b": "Qwen3-1.7B-Base", "avg_compression": {"rwkv": 9.337770518398914, "qwen": 9.47008618524935}, "avg_delta": -0.007337138513702737, "avg_delta_compression": -0.13231566685042945}}</script>
     <script>
         const svgOverlay = document.getElementById('svg-overlay');
         const content = document.querySelector('.content');